A curated list of sign language procesing (e.g., sign language recognition, sign language translation) and related area (e.g., speech translation, motion generation) resources. The old version can be found here.
- [Wiki] Sign Language
- [Wiki] Sign Language Recognition
- [Wiki] Gesture_recognition
- [Wiki] Sign Language Tranlsation
- [Resource] jinwchoi/awesome-action-recognition
- [Resource] xinghaochen/awesome-hand-pose-estimation
- [Resource] OpenHuman-ai/awesome-gesture_generation
- [Resource] zzw922cn/awesome-speech-recognition-speech-synthesis-papers
- [ICLR 2026 Submission] BANZ-FS: BANZSL FINGERSPELLING DATASET. [paper]
Submission15125 Authors - [ICLR 2026 Submission] EmoSign: A Multimodal Dataset for Understanding Emotions in American Sign Language. [paper]
Submission14816 Authors - [ICLR 2026 Submission] LexSign: Learning Sign Language from Lexical Descriptions. [paper]
Submission7787 Authors - [EMNLP 2025] Logos as a Well-Tempered Pre-train for Sign Language Recognition. [paper]
Ilya Ovodov, Petr Surovtsev, Karina Kvanchiani, Alexander Kapitanov, Alexander Nagaev - [EMNLP Findings 2025] Rethinking Sign Language Translation: The Impact of Signer Dependence on Model Evaluation. [paper]
Keren Artiaga, Sabyasachi Kamila, Haithem Afli, Conor Lynch, Mohammed Hasanuzzaman - [ICCV 2025] Cross-View Isolated Sign Language Recognition via View Synthesis and Feature Disentanglement. [paper]
Xin Shen, Xinyu Wang, Lei Shen, Kaihao Zhang, Xin Yu - [CVPR 2025] VSNet: Focusing on the Linguistic Characteristics of Sign Language. [paper]
YuHao Li, Xinyue Chen, Hongkai Li, Xiaorong Pu, Peng Jin, Yazhou Ren - [OpenReview] Representing Signs as Signs: One-Shot ISLR to Facilitate Functional Sign Language Technologies. [paper]
Toon Vandendriessche, Mathieu De Coster, Annelies Lejon, Joni Dambre - [NeurIPS 2024] MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Dataset. [paper]
Xin Shen, Heming Du, Hongwei Sheng, Shuyun Wang, Hui Chen, Huiqiang Chen, Zhuojie Wu, Xiaobiao Du, Jiaying Ying, Ruihan Lu, Qingzheng Xu, Xin Yu - [EMNLP 2024] SignCLIP: Connecting Text and Sign Language by Contrastive Learning. [paper]
Zifan Jiang, Gerard Sant, Amit Moryossef, Mathias Müller, Rico Sennrich, Sarah Ebling - [EMNLP 2024] Towards Online Continuous Sign Language Recognition and Translation. [paper]
Ronglai Zuo, Fangyun Wei, Brian Mak - [CVPR 2024] SignGraph: A Sign Sequence is Worth Graphs of Nodes. [paper] [code]
Shiwei Gan, Yafeng Yin, Zhiwei Jiang, Hongkai Wen, Kang Xia, Lei Xie, Sanglu Lu - [EMNLP Findings 2023] Handshape-Aware Sign Language Recognition: Extended Datasets and Exploration of Handshape-Inclusive Methods. [paper]
Xuan Zhang, Kevin Duh - Complete List of Sign Language Recognition
- [ICLR 2026 Submission]T2G-Reasoner: Deep Reasoning for Text-to-Gloss Translation. [paper]
Submission23323 Authors - [ICLR 2026 Submission] Sigma: Semantically Informative Pre-training for Skeleton-based Sign Language Understanding. [paper]
Submission11776 Authors - [EMNLP 2025] PoseStitch-SLT: Linguistically Inspired Pose-Stitching for End-to-End Sign Language Translation. [paper]
Abhinav Joshi, Vaibhav Sharma, Sanjeet Singh, Ashutosh Modi - [WMT 2025] SONAR-SLT: Multilingual Sign Language Translation via Language-Agnostic Sentence Embedding Supervision. [paper]
Yasser Hamidullah, Shakib Yazdani, Cennet Oguz, Josef Van Genabith, Cristina España-Bonet - [NeurIPS 2025] Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translation. [paper]
Edward Fish, Richard Bowden - [NeurIPS 2025] Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation. [paper]
Jianyuan Guo, Peike Li, Trevor Cohn - [ICCV 2025] Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation. [paper]
Jungeun Kim, Hyeongwoo Jeon, Jongseong Bae, Ha Young Kim - [ACM MM 2025] Gloss Matters: Unlocking the Potential of Non-Autoregressive Sign Language Translation. [paper]
Zhihao Wang, Shiyu Liu, Zhiwei He, Kangjie Zheng, Liangying Shao, Junfeng Yao, Jinsong Su - [BMVC 2025] Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translation. [paper]
Sobhan Asasi, Mohamed Ilyas Lakhal, Ozge Mercanoglu Sincan, Richard Bowden - [ACL 2025] SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction. [paper]
Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich, Karen Livescu, Alexander H. Liu - [ACL 2025] Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation Model. [paper]
Sihan Tan, Taro Miyazaki, Kazuhiro Nakadai - [ACL Findings 2025] SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale. [paper]
Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich, Karen Livescu - Complete List of Sign Language Translation
- [ICLR 2026 Submission] SignAligner: Harmonizing Complementary Pose Modalities for Coherent Sign Language Generation. [paper]
Submission1706 Authors - [NeurIPS 2025] Advanced Sign Language Video Generation with Compressed and Quantized Multi-Condition Tokenization. [paper]
Cong Wang, Zexuan Deng, Zhiwei Jiang, Yafeng Yin, Fei Shen, Zifeng Cheng, Shiping Ge, Shiwei Gan, Qing Gu - [ICCV 2025] GReg: Geometry-Aware Region Refinement for Sign Language Video Generation. [paper]
Tongkai Shi, Lianyu Hu, Fanhua Shang, Liqing Gao, Wei Feng - [ICCV 2025] Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generator. [paper]
Ronglai Zuo, Rolandos Alexandros Potamias, Evangelos Ververas, Jiankang Deng, Stefanos Zafeiriou - [CVPR 2025] Discrete to Continuous: Generating Smooth Transition Poses from Sign Language Observations. [paper]
Shengeng Tang, Jiayi He, Lechao Cheng, Jingjing Wu, Dan Guo, Richang Hong - [EMNLP Findings 2024] Word-Conditioned 3D American Sign Language Motion Generation. [paper]
Lu Dong, Xiao Wang, Ifeoma Nwogu - [ECCV 2024] A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars. [paper]
Ronglai Zuo, Fangyun Wei, Zenggui Chen, Brian Mak, Jiaolong Yang, Xin Tong - [ECCV 2024] Pose Guided Fine-Grained Sign Language Video Generation. [paper]
Tongkai Shi, Lianyu Hu, Fanhua Shang, Jichao Feng, liu peidong, Wei Feng - [ECCV 2024] SignGen: End-to-End Sign Language Video Generation with Latent Diffusion. [paper]
Fan Qi, Yu Duan, Changsheng Xu, Huaiwen Zhang - [ACL 2024] T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text. [paper]
Aoxiong Yin, Haoyuan Li, Kai Shen, Siliang Tang, Yueting Zhuang - [ACL Findings 2024] MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production. [paper]
Jian Ma, Wenguan Wang, Yi Yang, Feng Zheng - Complete List of Sign Language Production
- [WMT 2025] Meaningful Pose-Based Sign Language Evaluation. [paper]
Zifan Jiang, Colin Leong, Amit Moryossef, Oliver Cory, Maksym Ivashechkin, Neha Tarigopula, Biao Zhang, Anne Göhring, Annette Rios, Rico Sennrich, Sarah Ebling - [EMNLP 2025] Improving Handshape Representations for Sign Language Processing: A Graph Neural Network Approach. [paper]
Alessa Carbo, Eric Nalisnick - [EMNLP Findings 2025] Investigating Dictionary Expansion for Video-based Sign Language Dictionaries. [paper]
Aashaka Desai, Daniela Massiceti, Richard Ladner, Hal Daumé Iii, Danielle Bragg, Alex Xijie Lu - [ACM MM 2025] Sentence-level Segmentation for Long Sign Language Videos with Captions. [paper]
Bowen Guo, Shiwei Gan, Yafeng Yin, Xiao Liu, Zhiwei Jiang, Shunmei Meng - [ACL Findings 2025] Sign2Vis: Automated Data Visualization from Sign Language. [paper]
Yao Wan, Yang Wu, Zhen Li, Guobiao Zhang, Hongyu Zhang, Zhou Zhao, Hai Jin, April Wang - [ACL Findings 2025] 2M-BELEBELE: Highly Multilingual Speech and American Sign Language Comprehension Dataset. [paper]
Marta R. Costa-jussà, Bokai YU, Pierre Andrews, Belen Alastruey, Necati Cihan Camgoz, Joe Chuang, Jean Maillard, Christophe Ropers, Arina Turkatenko, Carleigh Wood - [ACL Findings 2025] Large Language Models as Sign Language Interfaces: Mitigating the Requests of Deaf Users of LLMs in a Hearing-Centric World. [paper]
Mert Inan, Anthony Sicilia, Malihe Alikhani - [EMNLP Findings 2024] Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label Smoothing. [paper]
Pooya Fayyazsanavi, Antonios Anastasopoulos, Jana Kosecka - [EMNLP 2024] Unsupervised Discrete Representations of American Sign Language. [paper]
Artem Abzaliev, Rada Mihalcea - [EMNLP 2024] Studying and Mitigating Biases in Sign Language Understanding Models. [paper]
Katherine Atwell, Danielle Bragg, Malihe Alikhani - [ECCV 2024] Uncertainty-aware sign language video retrieval with probability distribution modeling. [paper]
Xuan Wu, Hongxiang Li, yuanjiang luo, Xuxin Cheng, Xianwei Zhuang, Meng Cao, Keren Fu - [ECCV 2024] SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmark. [paper]
Zhengdi Yu, Shaoli Huang, yongkang cheng, Tolga Birdal - [ACL 2024] Semi-Supervised Spoken Language Glossification. [paper]
Huijie Yao, Wengang Zhou, Hao Zhou, Houqiang Li - [ACL 2024] American Sign Language Handshapes Reflect Pressures for Communicative Efficiency. [paper]
Kayo Yin, Terry Regier, Dan Klein - [EMNLP Findings 2023] Enhancing Accessible Communication: from European Portuguese to Portuguese Sign Language. [paper]
Catarina Sousa, Luisa Coheur, Mara Moita - [CVPR 2023] CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning. [paper][code]
Yiting Cheng, Fangyun Wei, Jianmin Bao, Dong Chen, Wenqiang Zhang - [CVPR 2023] Ham2Pose: Animating Sign Language Notation into Pose Sequences. [paper]
Rotem Shalev Arkushin, Amit Moryossef, Ohad Fried
- [NeurIPS 2025] PyraMotion: Attentional Pyramid-Structured Motion Integration for Co-Speech 3D Gesture Synthesis. [paper]
Zhizhuo Yin, Yuk Hang Tsui, Pan Hui - [ICCV 2025] Democratizing High-Fidelity Co-Speech Gesture Video Generation. [paper]
Xu Yang, Shaoli Huang, Shenbo Xie, Xuelin Chen, Yifei Liu, Changxing Ding - [ICCV 2025] GestureHYDRA: Semantic Co-speech Gesture Synthesis via Hybrid Modality Diffusion Transformer and Cascaded-Synchronized Retrieval-Augmented Generation. [paper]
Quanwei Yang, Luying Huang, Kaisiyuan Wang, Jiazhi Guan, Shengyi He, Fengguo Li, Hang Zhou, Lingyun Yu, Yingying Li, Haocheng Feng, Hongtao Xie - [ICCV 2025] GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modeling. [paper]
Pinxin Liu, Luchuan Song, Junhua Huang, Haiyang Liu, Chenliang Xu - [ICCV 2025] SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learning. [paper]
Lanmiao Liu, Esam Ghaleb, asli ozyurek, Zerrin Yumak - [ACM MM 2025] Contextual Gesture: Co-Speech Gesture Video Generation through Context-aware Gesture Representation [paper]
Pinxin Liu, Pengfei Zhang, Hyeongwoo Kim, Pablo Garrido, Ari Shapiro, Kyle Olszewski - [CVPR 2025] Retrieving Semantics from the Deep: an RAG Solution for Gesture Synthesis. [paper]
Muhammad Hamza Mughal, Rishabh Dabral, Merel CJ Scholman, Vera Demberg, Christian Theobalt - [CVPR 2025] Co-Speech Gesture Video Generation with Implicit Motion-Audio Entanglement. [paper]
Xinjie Li, Ziyi Chen, Xinlu Yu, Iek-Heng Chu, Peng Chang, Jing Xiao - [CVPR 2025] HOP: Heterogeneous Topology-based Multimodal Entanglement for Co-Speech Gesture Generation. [paper]
Hongye Cheng, Tianyu Wang, guangsi shi, Zexing Zhao, Yanwei Fu - [ACM MM 2025] Realistic-Gesture: Co-Speech Gesture Video Generation through Semantic-aware Gesture Representation. [paper]
Pinxin Liu, Pengfei Zhang, Hyeongwoo Kim, Pablo Garrido, Ari Shapiro, Kyle Olszewski - Complete List of Co-speech Gesture Generation
- [NeurIPS 2025] Doodle to Detect: A Goofy but Powerful Approach to Skeleton-based Hand Gesture Recognition. [paper]
Sang Hoon Han, Seonho Lee, Hyeok Nam, Jae Hyeon Park, Min Hee Cha, Min Geol Kim, Hyunse Lee, Sangyeon Ahn, Chae moon ju, Sung In Cho - [CVPR 2025] Ges3ViG: Incorporating Pointing Gestures into Language-Based 3D Visual Grounding for Embodied Reference Understanding. [paper]
Atharv Mahesh Mane, Dulanga Weerakoon, Vigneshwaran Subbaraju, Sougata Sen, Sanjay Sarma, Archan Misra - [CVPR 2025] SocialGesture: Delving into Multi-person Gesture Understanding. [paper]
Xu Cao, Pranav Virupaksha, Wenqi Jia, Bolin Lai, Fiona Ryan, Sangmin Lee, James Rehg - [OpenReview] Revisiting Noise Resilience Strategies in Gesture Recognition: Short-Term Enhancement in Surface Electromyographic Signal Analysis. [paper]
Weiyu Guo, Ziyue Qiao, Ying Sun, Hui Xiong - [ICCV 2023] Learning Robust Representations with Information Bottleneck and Memory Network for RGB-D-based Gesture Recognition. [paper]
Yunan Li, Huizhou Chen, Guanwen Feng, Qiguang Miao - [ICCV 2023] Data-Free Class-Incremental Hand Gesture Recognition. [paper]
Shubhra Aich, Jesus Ruiz-Santaquiteria, Zhenyu Lu, Prachi Garg, K J Joseph, Alvaro Fernandez Garcia, Vineeth N Balasubramanian, Kenrick Kin, Chengde Wan, Necati Cihan Camgoz, Shugao Ma, Fernando De la Torre - [BMVC 2022] Towards more efficient few-shot learning based human gesture recognition via dynamic vision sensors. [paper]
Linglin Jing, Yifan Wang, Tailin Chen, Shirin Dora, Zhigang Ji, Hui Fang - [BMVC 2022] Continuous Hand Gesture Recognition using Deep Coarse
and Fine Hand Features. [paper]
Hazem Wannous, Jean-Philippe Vandeborre - [CVPR 2022] LD-ConGR: A Large RGB-D Video Dataset for Long-Distance Continuous Gesture Recognition. [paper]
Dan Liu; Libo Zhang; Yanjun Wu - [AAAI 2022] Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial Autoencoders. [paper]
Abhishek Banerjee, Uttaran Bhattacharya, Aniket Bera - Complete List of Gesture Recognition
- [CVPR SLRTP 2025] Sign language recognition, translation & production.
- [ECCV SLRTP 2022] Sign language recognition, translation & production.
- [ECCV SLRTP 2020] Sign language recognition, translation & production. [Accepted papers]
- [WWW CV-SLR 2025] Cross-View Isolated Sign Language Recognition Challenge
- [ICCV MSLR 2025] 1st Multimodal Sign Language Recognition Workshop
- [ICCV ACVR 2023] Eleventh International Workshop on Assistive Computer Vision and Robotics
- [CVPR ChaLearn-SLR 2021] 2021 ChaLearn Looking at People Sign Language Recognition in the Wild Workshop at CVPR
- [ACL LoResMT 2024] The Seventh Workshop on Technologies for Machine Translation of Low-Resource Languages
| Dataset | Task | Modality | Statistic | |||||
|---|---|---|---|---|---|---|---|---|
| Name | Language | Isolated | Continuous | RGB | Depth | #Signers | #Vocab | #Sequences |
| DGS Kinect | DGS | √ | √ | √ | 15 | 40 | 3,000 | |
| ASLLVD | ASL | √ | √ | 6 | 2,742 | 9,794 | ||
| DEVISIGN-L | CSL | √ | √ | √ | 8 | 2,000 | 24,000 | |
| CSL-500 | CSL | √ | √ | 50 | 500 | 125,000 | ||
| MSASL | ASL | √ | √ | 222 | 1,000 | 25,513 | ||
| WLASL2000 | ASL | √ | √ | 119 | 2,000 | 21,083 | ||
| AUTSL | TSL | √ | √ | √ | 43 | 226 | 38,336 | |
| SIGNUM | DGS | √ | √ | √ | 9 | 455 | 2,340 | |
| Phoenix14 | DGS | √ | √ | 9 | 1,200 | 6,841 | ||
| KETI | KSL | √ | √ | 14 | 524 | 15,672 | ||
| GSL | GSL | √ | √ | √ | 7 | 310 | 10,290 | |
| CSL-100 | CSL | √ | √ | 50 | 2,000 | 25,000 | ||
| CSL-Daily | CSL | √ | √ | 10 | 2,000 | 20,654 | ||
| BSL-1K | BSL | √ | √ | 40 | 1,064 | 273K | ||
| VRT-NEWS | VGT | √ | √ | 9 | 6,325 | 7,174 | ||
| How2Sign | BSL | √ | √ | √ | 11 | 15,686 | 35,191 | |
| BOBSL | BSL | √ | √ | 39 | 2,281 | 452K | ||
| OpenASL | ASL | √ | √ | 220 | 33,549 | 98,417 | ||
| YouTube-ASL | ASL | √ | √ | >2519 | 60K | 11,093 |