tariquzzamanf/SPIP

The official GitHub repository of "Prompting with Sign Parameters for Low-resource Sign Language Instruction Generation" # Prompting with Sign Parameters for Low-resource Sign Language Instruction Generation Md Tariquzzaman · Md Farhan Ishmam · Saiyma Sittul Muna · Md Kamrul Hasan · Hasan Mahmud --- **tldr:** We introduce BdSLIG, a low-resource sign language instruction generation dataset on Bengali and Sign Parameter-Infused (SPI) prompting that integrates the visual cues used to describe the sign language into the vision-language prompt. ## Sign Parameters The following sign parameters are provided to the vision-language prompt for SPI prompting: 1. **Handshape**: The morphological configuration, e.g., raised, extended, pointed, bent, spread, twisted, of the fingers and palms. 2. **Movement Type**: The trajectory or action of the hands, e.g., static, circular, squeezing, grabbing, rotating, pulling. 3. **Location**: The placement of the hands while producing the sign, e.g., near head, forehead, eye, ear, nose, mouth, chest, shoulder. 4. **Palm Orientation**: The direction the palm is facing relative to the signer's body, e.g., inward, outward, upward, downward, left, right. 5. **Spatial Interaction**: The role of one or both hands in the sign's spatial scheme, e.g., right-hand active, left-hand active, both-hands symmetric, both-hands asymmetric. 6. **Temporal Dynamics**: The temporal pattern of the movement onset, duration, and repetition, e.g., sustained hold, repeated oscillation, single tap, repeated tapping. 7. **Facial Cues**: Facial expressions, e.g., neutral, brows-raised, brows-furrowed, mouth-open, mouth-closed, lip-pursed, that can disambiguate the sign language.