Skip to content

VIPL-SLP/Awesome-Sign-Language-Processing

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

92 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Awesome Sign Language Processing

Awesome

A curated list of sign language procesing (e.g., sign language recognition, sign language translation) and related area (e.g., speech translation, motion generation) resources. The old version can be found here.

Contents

Conference Paper

Sign Language Recognition

  • [ICLR 2026 Submission] BANZ-FS: BANZSL FINGERSPELLING DATASET. [paper]
    Submission15125 Authors
  • [ICLR 2026 Submission] EmoSign: A Multimodal Dataset for Understanding Emotions in American Sign Language. [paper]
    Submission14816 Authors
  • [ICLR 2026 Submission] LexSign: Learning Sign Language from Lexical Descriptions. [paper]
    Submission7787 Authors
  • [EMNLP 2025] Logos as a Well-Tempered Pre-train for Sign Language Recognition. [paper]
    Ilya Ovodov, Petr Surovtsev, Karina Kvanchiani, Alexander Kapitanov, Alexander Nagaev
  • [EMNLP Findings 2025] Rethinking Sign Language Translation: The Impact of Signer Dependence on Model Evaluation. [paper]
    Keren Artiaga, Sabyasachi Kamila, Haithem Afli, Conor Lynch, Mohammed Hasanuzzaman
  • [ICCV 2025] Cross-View Isolated Sign Language Recognition via View Synthesis and Feature Disentanglement. [paper]
    Xin Shen, Xinyu Wang, Lei Shen, Kaihao Zhang, Xin Yu
  • [CVPR 2025] VSNet: Focusing on the Linguistic Characteristics of Sign Language. [paper]
    YuHao Li, Xinyue Chen, Hongkai Li, Xiaorong Pu, Peng Jin, Yazhou Ren
  • [OpenReview] Representing Signs as Signs: One-Shot ISLR to Facilitate Functional Sign Language Technologies. [paper]
    Toon Vandendriessche, Mathieu De Coster, Annelies Lejon, Joni Dambre
  • [NeurIPS 2024] MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Dataset. [paper]
    Xin Shen, Heming Du, Hongwei Sheng, Shuyun Wang, Hui Chen, Huiqiang Chen, Zhuojie Wu, Xiaobiao Du, Jiaying Ying, Ruihan Lu, Qingzheng Xu, Xin Yu
  • [EMNLP 2024] SignCLIP: Connecting Text and Sign Language by Contrastive Learning. [paper]
    Zifan Jiang, Gerard Sant, Amit Moryossef, Mathias Müller, Rico Sennrich, Sarah Ebling
  • [EMNLP 2024] Towards Online Continuous Sign Language Recognition and Translation. [paper]
    Ronglai Zuo, Fangyun Wei, Brian Mak
  • [CVPR 2024] SignGraph: A Sign Sequence is Worth Graphs of Nodes. [paper] [code]
    Shiwei Gan, Yafeng Yin, Zhiwei Jiang, Hongkai Wen, Kang Xia, Lei Xie, Sanglu Lu
  • [EMNLP Findings 2023] Handshape-Aware Sign Language Recognition: Extended Datasets and Exploration of Handshape-Inclusive Methods. [paper]
    Xuan Zhang, Kevin Duh
  • Complete List of Sign Language Recognition

Sign Language Translation

  • [ICLR 2026 Submission]T2G-Reasoner: Deep Reasoning for Text-to-Gloss Translation. [paper]
    Submission23323 Authors
  • [ICLR 2026 Submission] Sigma: Semantically Informative Pre-training for Skeleton-based Sign Language Understanding. [paper]
    Submission11776 Authors
  • [EMNLP 2025] PoseStitch-SLT: Linguistically Inspired Pose-Stitching for End-to-End Sign Language Translation. [paper]
    Abhinav Joshi, Vaibhav Sharma, Sanjeet Singh, Ashutosh Modi
  • [WMT 2025] SONAR-SLT: Multilingual Sign Language Translation via Language-Agnostic Sentence Embedding Supervision. [paper]
    Yasser Hamidullah, Shakib Yazdani, Cennet Oguz, Josef Van Genabith, Cristina España-Bonet
  • [NeurIPS 2025] Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translation. [paper]
    Edward Fish, Richard Bowden
  • [NeurIPS 2025] Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation. [paper]
    Jianyuan Guo, Peike Li, Trevor Cohn
  • [ICCV 2025] Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation. [paper]
    Jungeun Kim, Hyeongwoo Jeon, Jongseong Bae, Ha Young Kim
  • [ACM MM 2025] Gloss Matters: Unlocking the Potential of Non-Autoregressive Sign Language Translation. [paper]
    Zhihao Wang, Shiyu Liu, Zhiwei He, Kangjie Zheng, Liangying Shao, Junfeng Yao, Jinsong Su
  • [BMVC 2025] Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translation. [paper]
    Sobhan Asasi, Mohamed Ilyas Lakhal, Ozge Mercanoglu Sincan, Richard Bowden
  • [ACL 2025] SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction. [paper]
    Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich, Karen Livescu, Alexander H. Liu
  • [ACL 2025] Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation Model. [paper]
    Sihan Tan, Taro Miyazaki, Kazuhiro Nakadai
  • [ACL Findings 2025] SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale. [paper]
    Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich, Karen Livescu
  • Complete List of Sign Language Translation

Sign Language Production

  • [ICLR 2026 Submission] SignAligner: Harmonizing Complementary Pose Modalities for Coherent Sign Language Generation. [paper]
    Submission1706 Authors
  • [NeurIPS 2025] Advanced Sign Language Video Generation with Compressed and Quantized Multi-Condition Tokenization. [paper]
    Cong Wang, Zexuan Deng, Zhiwei Jiang, Yafeng Yin, Fei Shen, Zifeng Cheng, Shiping Ge, Shiwei Gan, Qing Gu
  • [ICCV 2025] GReg: Geometry-Aware Region Refinement for Sign Language Video Generation. [paper]
    Tongkai Shi, Lianyu Hu, Fanhua Shang, Liqing Gao, Wei Feng
  • [ICCV 2025] Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generator. [paper]
    Ronglai Zuo, Rolandos Alexandros Potamias, Evangelos Ververas, Jiankang Deng, Stefanos Zafeiriou
  • [CVPR 2025] Discrete to Continuous: Generating Smooth Transition Poses from Sign Language Observations. [paper]
    Shengeng Tang, Jiayi He, Lechao Cheng, Jingjing Wu, Dan Guo, Richang Hong
  • [EMNLP Findings 2024] Word-Conditioned 3D American Sign Language Motion Generation. [paper]
    Lu Dong, Xiao Wang, Ifeoma Nwogu
  • [ECCV 2024] A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars. [paper]
    Ronglai Zuo, Fangyun Wei, Zenggui Chen, Brian Mak, Jiaolong Yang, Xin Tong
  • [ECCV 2024] Pose Guided Fine-Grained Sign Language Video Generation. [paper]
    Tongkai Shi, Lianyu Hu, Fanhua Shang, Jichao Feng, liu peidong, Wei Feng
  • [ECCV 2024] SignGen: End-to-End Sign Language Video Generation with Latent Diffusion. [paper]
    Fan Qi, Yu Duan, Changsheng Xu, Huaiwen Zhang
  • [ACL 2024] T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text. [paper]
    Aoxiong Yin, Haoyuan Li, Kai Shen, Siliang Tang, Yueting Zhuang
  • [ACL Findings 2024] MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production. [paper]
    Jian Ma, Wenguan Wang, Yi Yang, Feng Zheng
  • Complete List of Sign Language Production

Other Sign Language Topic

  • [WMT 2025] Meaningful Pose-Based Sign Language Evaluation. [paper]
    Zifan Jiang, Colin Leong, Amit Moryossef, Oliver Cory, Maksym Ivashechkin, Neha Tarigopula, Biao Zhang, Anne Göhring, Annette Rios, Rico Sennrich, Sarah Ebling
  • [EMNLP 2025] Improving Handshape Representations for Sign Language Processing: A Graph Neural Network Approach. [paper]
    Alessa Carbo, Eric Nalisnick
  • [EMNLP Findings 2025] Investigating Dictionary Expansion for Video-based Sign Language Dictionaries. [paper]
    Aashaka Desai, Daniela Massiceti, Richard Ladner, Hal Daumé Iii, Danielle Bragg, Alex Xijie Lu
  • [ACM MM 2025] Sentence-level Segmentation for Long Sign Language Videos with Captions. [paper]
    Bowen Guo, Shiwei Gan, Yafeng Yin, Xiao Liu, Zhiwei Jiang, Shunmei Meng
  • [ACL Findings 2025] Sign2Vis: Automated Data Visualization from Sign Language. [paper]
    Yao Wan, Yang Wu, Zhen Li, Guobiao Zhang, Hongyu Zhang, Zhou Zhao, Hai Jin, April Wang
  • [ACL Findings 2025] 2M-BELEBELE: Highly Multilingual Speech and American Sign Language Comprehension Dataset. [paper]
    Marta R. Costa-jussà, Bokai YU, Pierre Andrews, Belen Alastruey, Necati Cihan Camgoz, Joe Chuang, Jean Maillard, Christophe Ropers, Arina Turkatenko, Carleigh Wood
  • [ACL Findings 2025] Large Language Models as Sign Language Interfaces: Mitigating the Requests of Deaf Users of LLMs in a Hearing-Centric World. [paper]
    Mert Inan, Anthony Sicilia, Malihe Alikhani
  • [EMNLP Findings 2024] Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label Smoothing. [paper]
    Pooya Fayyazsanavi, Antonios Anastasopoulos, Jana Kosecka
  • [EMNLP 2024] Unsupervised Discrete Representations of American Sign Language. [paper]
    Artem Abzaliev, Rada Mihalcea
  • [EMNLP 2024] Studying and Mitigating Biases in Sign Language Understanding Models. [paper]
    Katherine Atwell, Danielle Bragg, Malihe Alikhani
  • [ECCV 2024] Uncertainty-aware sign language video retrieval with probability distribution modeling. [paper]
    Xuan Wu, Hongxiang Li, yuanjiang luo, Xuxin Cheng, Xianwei Zhuang, Meng Cao, Keren Fu
  • [ECCV 2024] SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmark. [paper]
    Zhengdi Yu, Shaoli Huang, yongkang cheng, Tolga Birdal
  • [ACL 2024] Semi-Supervised Spoken Language Glossification. [paper]
    Huijie Yao, Wengang Zhou, Hao Zhou, Houqiang Li
  • [ACL 2024] American Sign Language Handshapes Reflect Pressures for Communicative Efficiency. [paper]
    Kayo Yin, Terry Regier, Dan Klein
  • [EMNLP Findings 2023] Enhancing Accessible Communication: from European Portuguese to Portuguese Sign Language. [paper]
    Catarina Sousa, Luisa Coheur, Mara Moita
  • [CVPR 2023] CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning. [paper][code]
    Yiting Cheng, Fangyun Wei, Jianmin Bao, Dong Chen, Wenqiang Zhang
  • [CVPR 2023] Ham2Pose: Animating Sign Language Notation into Pose Sequences. [paper]
    Rotem Shalev Arkushin, Amit Moryossef, Ohad Fried

Co-speech Gesture Generation

  • [NeurIPS 2025] PyraMotion: Attentional Pyramid-Structured Motion Integration for Co-Speech 3D Gesture Synthesis. [paper]
    Zhizhuo Yin, Yuk Hang Tsui, Pan Hui
  • [ICCV 2025] Democratizing High-Fidelity Co-Speech Gesture Video Generation. [paper]
    Xu Yang, Shaoli Huang, Shenbo Xie, Xuelin Chen, Yifei Liu, Changxing Ding
  • [ICCV 2025] GestureHYDRA: Semantic Co-speech Gesture Synthesis via Hybrid Modality Diffusion Transformer and Cascaded-Synchronized Retrieval-Augmented Generation. [paper]
    Quanwei Yang, Luying Huang, Kaisiyuan Wang, Jiazhi Guan, Shengyi He, Fengguo Li, Hang Zhou, Lingyun Yu, Yingying Li, Haocheng Feng, Hongtao Xie
  • [ICCV 2025] GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modeling. [paper]
    Pinxin Liu, Luchuan Song, Junhua Huang, Haiyang Liu, Chenliang Xu
  • [ICCV 2025] SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learning. [paper]
    Lanmiao Liu, Esam Ghaleb, asli ozyurek, Zerrin Yumak
  • [ACM MM 2025] Contextual Gesture: Co-Speech Gesture Video Generation through Context-aware Gesture Representation [paper]
    Pinxin Liu, Pengfei Zhang, Hyeongwoo Kim, Pablo Garrido, Ari Shapiro, Kyle Olszewski
  • [CVPR 2025] Retrieving Semantics from the Deep: an RAG Solution for Gesture Synthesis. [paper]
    Muhammad Hamza Mughal, Rishabh Dabral, Merel CJ Scholman, Vera Demberg, Christian Theobalt
  • [CVPR 2025] Co-Speech Gesture Video Generation with Implicit Motion-Audio Entanglement. [paper]
    Xinjie Li, Ziyi Chen, Xinlu Yu, Iek-Heng Chu, Peng Chang, Jing Xiao
  • [CVPR 2025] HOP: Heterogeneous Topology-based Multimodal Entanglement for Co-Speech Gesture Generation. [paper]
    Hongye Cheng, Tianyu Wang, guangsi shi, Zexing Zhao, Yanwei Fu
  • [ACM MM 2025] Realistic-Gesture: Co-Speech Gesture Video Generation through Semantic-aware Gesture Representation. [paper]
    Pinxin Liu, Pengfei Zhang, Hyeongwoo Kim, Pablo Garrido, Ari Shapiro, Kyle Olszewski
  • Complete List of Co-speech Gesture Generation

Gesture Recognition

  • [NeurIPS 2025] Doodle to Detect: A Goofy but Powerful Approach to Skeleton-based Hand Gesture Recognition. [paper]
    Sang Hoon Han, Seonho Lee, Hyeok Nam, Jae Hyeon Park, Min Hee Cha, Min Geol Kim, Hyunse Lee, Sangyeon Ahn, Chae moon ju, Sung In Cho
  • [CVPR 2025] Ges3ViG: Incorporating Pointing Gestures into Language-Based 3D Visual Grounding for Embodied Reference Understanding. [paper]
    Atharv Mahesh Mane, Dulanga Weerakoon, Vigneshwaran Subbaraju, Sougata Sen, Sanjay Sarma, Archan Misra
  • [CVPR 2025] SocialGesture: Delving into Multi-person Gesture Understanding. [paper]
    Xu Cao, Pranav Virupaksha, Wenqi Jia, Bolin Lai, Fiona Ryan, Sangmin Lee, James Rehg
  • [OpenReview] Revisiting Noise Resilience Strategies in Gesture Recognition: Short-Term Enhancement in Surface Electromyographic Signal Analysis. [paper]
    Weiyu Guo, Ziyue Qiao, Ying Sun, Hui Xiong
  • [ICCV 2023] Learning Robust Representations with Information Bottleneck and Memory Network for RGB-D-based Gesture Recognition. [paper]
    Yunan Li, Huizhou Chen, Guanwen Feng, Qiguang Miao
  • [ICCV 2023] Data-Free Class-Incremental Hand Gesture Recognition. [paper]
    Shubhra Aich, Jesus Ruiz-Santaquiteria, Zhenyu Lu, Prachi Garg, K J Joseph, Alvaro Fernandez Garcia, Vineeth N Balasubramanian, Kenrick Kin, Chengde Wan, Necati Cihan Camgoz, Shugao Ma, Fernando De la Torre
  • [BMVC 2022] Towards more efficient few-shot learning based human gesture recognition via dynamic vision sensors. [paper]
    Linglin Jing, Yifan Wang, Tailin Chen, Shirin Dora, Zhigang Ji, Hui Fang
  • [BMVC 2022] Continuous Hand Gesture Recognition using Deep Coarse and Fine Hand Features. [paper]
    Hazem Wannous, Jean-Philippe Vandeborre
  • [CVPR 2022] LD-ConGR: A Large RGB-D Video Dataset for Long-Distance Continuous Gesture Recognition. [paper]
    Dan Liu; Libo Zhang; Yanjun Wu
  • [AAAI 2022] Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial Autoencoders. [paper]
    Abhishek Banerjee, Uttaran Bhattacharya, Aniket Bera
  • Complete List of Gesture Recognition

Sign Language Workshop

Dataset

Dataset Task Modality Statistic
Name Language Isolated Continuous RGB Depth #Signers #Vocab #Sequences
DGS Kinect DGS 15 40 3,000
ASLLVD ASL 6 2,742 9,794
DEVISIGN-L CSL 8 2,000 24,000
CSL-500 CSL 50 500 125,000
MSASL ASL 222 1,000 25,513
WLASL2000 ASL 119 2,000 21,083
AUTSL TSL 43 226 38,336
SIGNUM DGS 9 455 2,340
Phoenix14 DGS 9 1,200 6,841
KETI KSL 14 524 15,672
GSL GSL 7 310 10,290
CSL-100 CSL 50 2,000 25,000
CSL-Daily CSL 10 2,000 20,654
BSL-1K BSL 40 1,064 273K
VRT-NEWS VGT 9 6,325 7,174
How2Sign BSL 11 15,686 35,191
BOBSL BSL 39 2,281 452K
OpenASL ASL 220 33,549 98,417
YouTube-ASL ASL >2519 60K 11,093

About

💡 Resources about Sign Language Processing (e.g., Sign Language Recognition / Translation / Production)

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •