Skip to content
BranchesTags

Latest commit

 

History

102 Commits

Folders and files

NameName
Last commit message
Last commit date
complete_list
complete_list
 
 
dataset
dataset
 
 
README.md
README.md
 
 
README_old.md
README_old.md
 
 
SLRTP_acccepted_list.md
SLRTP_acccepted_list.md
 
 
license
license
 
 

Repository files navigation

Awesome Sign Language Processing

Awesome

A curated list of sign language procesing (e.g., sign language recognition, sign language translation) and related area (e.g., speech translation, motion generation) resources. The old version can be found here.

Contents

Conference Paper

Sign Language Recognition

  • [BMVC 2026] Recognising BSL Fingerspelling in Continuous Signing Sequences. [paper] [code]
    Alyssa Chan, Taein Kwon, Andrew Zisserman
  • [BMVC 2026] RAIDAL: Redundancy-Aware Information Density Active Learning for CTC-Based Continuous Sign Language Recognition. [paper pending]
    Full author list pending.
  • [BMVC 2026] SMART: MLLM-guided Temporal Alignment for Unifying Sign Language Recognition and Spotting. [paper]
    Eunjee Choi, JungHoon Sung, Seongwhan Cho, Chu Xin, Younggeun Choi
  • [ICLR 2026] BANZ-FS: BANZSL FINGERSPELLING DATASET. [paper]
    Xin Shen, Yan Ke, Xinyu Wang, Xin Yu
  • [EMNLP 2025] Logos as a Well-Tempered Pre-train for Sign Language Recognition. [paper] [code]
    Ilya Ovodov, Petr Surovtsev, Karina Kvanchiani, Alexander Kapitanov, Alexander Nagaev
  • [EMNLP Findings 2025] Rethinking Sign Language Translation: The Impact of Signer Dependence on Model Evaluation. [paper]
    Keren Artiaga, Sabyasachi Kamila, Haithem Afli, Conor Lynch, Mohammed Hasanuzzaman
  • [ICCV 2025] Cross-View Isolated Sign Language Recognition via View Synthesis and Feature Disentanglement. [paper]
    Xin Shen, Xinyu Wang, Lei Shen, Kaihao Zhang, Xin Yu
  • [CVPR 2025] VSNet: Focusing on the Linguistic Characteristics of Sign Language. [paper] [code]
    YuHao Li, Xinyue Chen, Hongkai Li, Xiaorong Pu, Peng Jin, Yazhou Ren
  • [NeurIPS 2024] MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Dataset. [paper]
    Xin Shen, Heming Du, Hongwei Sheng, Shuyun Wang, Hui Chen, Huiqiang Chen, Zhuojie Wu, Xiaobiao Du, Jiaying Ying, Ruihan Lu, Qingzheng Xu, Xin Yu
  • [EMNLP 2024] SignCLIP: Connecting Text and Sign Language by Contrastive Learning. [paper] [code]
    Zifan Jiang, Gerard Sant, Amit Moryossef, Mathias Müller, Rico Sennrich, Sarah Ebling
  • [EMNLP 2024] Towards Online Continuous Sign Language Recognition and Translation. [paper] [code]
    Ronglai Zuo, Fangyun Wei, Brian Mak
  • [CVPR 2024] SignGraph: A Sign Sequence is Worth Graphs of Nodes. [paper] [code]
    Shiwei Gan, Yafeng Yin, Zhiwei Jiang, Hongkai Wen, Kang Xia, Lei Xie, Sanglu Lu
  • [EMNLP Findings 2023] Handshape-Aware Sign Language Recognition: Extended Datasets and Exploration of Handshape-Inclusive Methods. [paper] [code]
    Xuan Zhang, Kevin Duh
  • Complete List of Sign Language Recognition

Sign Language Translation

  • [ECCV 2026] Q-BridgeNet: A Quantization Network for Cross-Lingual Sign Language Translation. [paper]
    Liqian Feng, Lintao Wang, Xiaochen Liu, Anusha Withana, Ken-Tye Yong, Dehui Kong, Zhiyong Wang, Kun Hu
  • [ECCV 2026] Video-Text Alignment Model for Sign Language Translation. [paper] [code]
    Junyi Hu, Zhewen He, Haomian Huang, Yi Fang, Aoxiang Yang
  • [ECCV 2026] SIGNET: Motion-Level Knowledge Transfer for Cross-Language Sign Language Translation. [paper] [code]
    Sobhan Asasi, Ozge Mercanoglu Sincan, Richard Bowden
  • [ECCV 2026] SignBind-LLM: Multi-Stage Modality Fusion for Sign Language Translation. [paper]
    Marshall Thomas, Edward Fish, Richard Bowden
  • [ECCV 2026] Event Stream-based Sign Language Translation: A High-Definition Benchmark Dataset and A Novel Baseline. [paper] [code]
    Shiao Wang, Xiao Wang, Duoqing Yang, Yao Rong, Fuling Wang, Jianing Li, Lin Zhu, Bo Jiang
  • [ACL 2026] SAME: Signer-Aware Mixture-of-Experts for Test-Time Adaptation in Sign Language Translation. [paper]
    Lujia Yang, Weicai Yan, Yongbo He, Qifei Zhang, Tao Jin, Jinshan Zhang, Meng Xi, Jianwei Yin
  • [ACL Findings 2026] Can Small Vision–Language Models Perform Sign Language Translation? [paper] [code]
    Anal Roy Chowdhury, Debarshi Kumar Sanyal
  • [ACL Findings 2026] J-Shuwa: A Large-Scale Web-Collected Japanese Sign Language-Japanese Parallel Corpus. [paper] [code]
    Junwen Mo, MinhDuc Vo, Noriki Nishida, Shin’ichi Satoh, Hideki Nakayama
  • [ACL 2026] Think in Latent Thoughts: A New Paradigm for Gloss-Free Sign Language Translation. [paper] [code]
    Yiyang Jiang, Li Zhang, Xiao-Yong Wei, Li Qing
  • [ACL 2026] Selective Contrastive Learning For Gloss Free Sign Language Translation. [paper]
    Chang Hao Lai, Rui Zhao, Xuewen Zhong, Jinsong Su, Yidong Chen
  • [CVPR 2026] Learning Effective Sign Features without Text for Gloss-free Sign Language Translation. [paper]
    Shiwei Gan, Xiao Liu, Yafeng Yin, Nan Liu, Kuizhuang Liu, Desibieer Tuerdaken, Zhiwei Jiang, Lei Xie, Sanglu Lu, Hongkai Wen
  • [CVPR 2026] BoostSLT: Boosting Sign Language Translation via a Plug-and-Play Diffusion-Based Semantic Enhancer. [paper] [code]
    Changzhou Han, Wanlun Ma, XI TANG, Kun Hu, Sheng Wen, Yang Xiang
  • [WACV 2026] Large Sign Language Models: Toward 3D American Sign Language Translation. [paper]
    Sen Zhang, Xiaoxiao He, Di Liu, Zhaoyang Xia, Mingyu Zhao, Chaowei Tan, Vivian Li, Bo Liu, Dimitris N. Metaxas, Mubbasir Kapadia
  • [NeurIPS 2025] MixSignGraph: A Sign Sequence is Worth Mixed Graphs of Nodes. [paper] [code]
    Shiwei Gan, Yafeng Yin, Zhiwei Jiang, Lei Xie, Sanglu Lu, Hongkai Wen
  • [EMNLP 2025] PoseStitch-SLT: Linguistically Inspired Pose-Stitching for End-to-End Sign Language Translation. [paper] [code]
    Abhinav Joshi, Vaibhav Sharma, Sanjeet Singh, Ashutosh Modi
  • [WMT 2025] SONAR-SLT: Multilingual Sign Language Translation via Language-Agnostic Sentence Embedding Supervision. [paper]
    Yasser Hamidullah, Shakib Yazdani, Cennet Oguz, Josef Van Genabith, Cristina España-Bonet
  • [NeurIPS 2025] Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translation. [paper] [code]
    Edward Fish, Richard Bowden
  • [NeurIPS 2025] Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation. [paper]
    Jianyuan Guo, Peike Li, Trevor Cohn
  • [ICCV 2025] Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation. [paper] [code]
    Jungeun Kim, Hyeongwoo Jeon, Jongseong Bae, Ha Young Kim
  • [ACM MM 2025] Gloss Matters: Unlocking the Potential of Non-Autoregressive Sign Language Translation. [paper] [code]
    Zhihao Wang, Shiyu Liu, Zhiwei He, Kangjie Zheng, Liangying Shao, Junfeng Yao, Jinsong Su
  • [BMVC 2025] Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translation. [paper] [code]
    Sobhan Asasi, Mohamed Ilyes Lakhal, Ozge Mercanoglu Sincan, Richard Bowden
  • [ACL 2025] SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction. [paper] [code]
    Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich, Karen Livescu, Alexander H. Liu
  • [ACL 2025] Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation Model. [paper] [code]
    Sihan Tan, Taro Miyazaki, Kazuhiro Nakadai
  • [ACL Findings 2025] SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale. [paper]
    Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich, Karen Livescu
  • Complete List of Sign Language Translation

Sign Language Production

  • [BMVC 2026] SignFML: Gloss-Free Sign Language Production via Multi-Scale Latent Flow Matching. [paper pending]
    Kieu Vo, Tho Quan
  • [BMVC 2026] M3T: Discrete Multi-Modal Motion Tokens for Sign Language Production. [paper]
    Alexandre Symeonidis-Herzig, Jianhe Low, Ozge Mercanoglu Sincan, Richard Bowden
  • [BMVC 2026] SignRR: Retrieve and Refine Real Motion for Sign Language Production. [paper]
    Fidel Omar Tito Cruz, Angie Sanchez Marquina, Summy Farfan, Gissella Bejarano
  • [ECCV 2026] SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning. [paper] [code]
    Jian He Low, Alexandre Symeonidis-Herzig, Maksym Ivashechkin, Ozge Mercanoglu Sincan, Richard Bowden
  • [ECCV 2026] SignRefine: Adapting Foundational Video Models for Sign Language Generation. [paper pending]
    Anton Pelykh, Edward Fish, Ozge Mercanoglu Sincan, Richard Bowden
  • [ECCV 2026] SIGNER: Temporally Grounded Sign Language Generation via Time-Resolved Conditioning. [paper]
    Taeryung Lee, Hyeongjin Nam, Gyeongsik Moon, Kyoung Mu Lee
  • [ACL 2026] Hybrid Autoregressive-Diffusion Model for Real-Time Sign Language Production. [paper]
    Maoxiao Ye, Xinfeng Ye, Sathiamoorthy Manoharan
  • [ACL 2026] Stable Signer: Hierarchical Sign Language Generative Model. [paper]
    Sen Fang, Yalin Feng, Hongbin Zhong, Yanxin Zhang, Dimitris N. Metaxas
  • [WACV 2026] DexAvatar: 3D Sign Language Reconstruction with Hand and Body Pose Priors. [paper] [code]
    Kaustubh Kundu, Hrishav Bakul Barua, Lucy Robertson-Bell, Zhixi Cai, Kalin Stefanov
  • [CVPR 2026] Focal–General Diffusion Model with Semantic Consistent Guidance for Sign Language Production. [paper] [code]
    Yiheng Yu, Sheng Liu, Yuan Feng, Zhelun Jin, Yining Jiang, Min Xu
  • [CVPR 2026] SignPR: A Progressive Vector-Quantized Diffusion Framework for Sign Language Production. [paper]
    Xiao Liu, Shiwei Gan, Yafeng Yin, Bowen Guo, Zhiwei Jiang, Shunmei Meng, Lei Xie, Sanglu Lu
  • [WACV 2026] Disentangle and Regularize: Sign Language Production with Articulator-Based Disentanglement and Channel-Aware Regularization. [paper]
    Sumeyye Meryem Tasyurek, Tugce Kiziltepe, Hacer Yalim Keles
  • [NeurIPS 2025] Advanced Sign Language Video Generation with Compressed and Quantized Multi-Condition Tokenization. [paper] [code]
    Cong Wang, Zexuan Deng, Zhiwei Jiang, Yafeng Yin, Fei Shen, Zifeng Cheng, Shiping Ge, Shiwei Gan, Qing Gu
  • [ICCV 2025] GReg: Geometry-Aware Region Refinement for Sign Language Video Generation. [paper]
    Tongkai Shi, Lianyu Hu, Fanhua Shang, Liqing Gao, Wei Feng
  • [ICCV 2025] Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generator. [paper] [code]
    Ronglai Zuo, Rolandos Alexandros Potamias, Evangelos Ververas, Jiankang Deng, Stefanos Zafeiriou
  • [CVPR 2025] Discrete to Continuous: Generating Smooth Transition Poses from Sign Language Observations. [paper]
    Shengeng Tang, Jiayi He, Lechao Cheng, Jingjing Wu, Dan Guo, Richang Hong
  • [EMNLP Findings 2024] Word-Conditioned 3D American Sign Language Motion Generation. [paper] [code]
    Lu Dong, Xiao Wang, Ifeoma Nwogu
  • [ECCV 2024] A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars. [paper] [code]
    Ronglai Zuo, Fangyun Wei, Zenggui Chen, Brian Mak, Jiaolong Yang, Xin Tong
  • [ECCV 2024] Pose Guided Fine-Grained Sign Language Video Generation. [paper]
    Tongkai Shi, Lianyu Hu, Fanhua Shang, Jichao Feng, liu peidong, Wei Feng
  • [ECCV 2024] SignGen: End-to-End Sign Language Video Generation with Latent Diffusion. [paper] [code]
    Fan Qi, Yu Duan, Changsheng Xu, Huaiwen Zhang
  • [ACL 2024] T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text. [paper]
    Aoxiong Yin, Haoyuan Li, Kai Shen, Siliang Tang, Yueting Zhuang
  • [ACL Findings 2024] MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production. [paper]
    Jian Ma, Wenguan Wang, Yi Yang, Feng Zheng
  • Complete List of Sign Language Production

Other Sign Language Topic

  • [BMVC 2026] SignMatch: Matching Dictionary Signs to Continuous Sign Language Video. [paper]
    Ryan Wong, Youngjoon Jang, Liliane Momeni, Gül Varol, Andrew Zisserman
  • [ECCV 2026] SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks. [paper] [code]
    Zhewen He, Junyi Hu, Haomian Huang, Zhenhua Li, Yushen Liu, Yi Fang
  • [ECCV 2026] BackTranslation2.0 - A Linguistically Motivated Metric to Assess Sign Language Production. [paper]
    Oliver Cory, Maksym Ivashechkin, Oline Ranum, Jian He Low, Edward Fish, Anton Pelykh, Karahan Sahin, Ozge Mercanoglu Sincan, Richard Bowden
  • [ACL 2026] Semantic Hardness Is Not Visual Hardness: Sign-Aware Hard Negative Mining for Sign Language Retrieval. [paper] [code]
    Junmyeong Lee, Chan Hur, ChangSu Choi, Sukmin Cho, Fitsum Gaim, Eui Jun Hwang, Hoyun Song, KyungTae Lim
  • [ACL 2026] Segment, Embed, and Align: A Universal Recipe for Aligning Subtitles to Signing. [paper] [code]
    Zifan Jiang, Youngjoon Jang, Liliane Momeni, Gül Varol, Sarah Ebling, Andrew Zisserman
  • [ACL 2026] The Visual Iconicity Challenge: Evaluating Vision-Language Models on Sign Language Form–Meaning Mapping. [paper] [code]
    Onur Keleş, Asli Ozyurek, Gerardo Ortega, Kadir Gökgöz, Esam Ghaleb
  • [ACL 2026] Sign-Language Datasets at Scale: A Comprehensive Survey on Resources, Benchmarks, and Annotation Standards. [paper]
    Yiming Ni, Zhi-Qi Cheng, Jiayu Li, Wei Cheng
  • [OpenReview] LexSign: Learning Sign Language from Lexical Descriptions. [paper]
    Honggang Zou, Yuecong Min, Peiqi Jiao, Xilin Chen
  • [ACL 2026] CNSL-bench: Benchmarking the Sign Language Understanding Capabilities of MLLMs on Chinese National Sign Language. [paper]
    Rui Zhao, Xuewen Zhong, Xiaoyun Zheng, Jinsong Su, Yidong Chen
  • [CVPR 2026] OpenFS: Multi-Hand-Capable Fingerspelling Recognition with Implicit Signing-Hand Detection and Frame-Wise Letter-Conditioned Synthesis. [paper] [code]
    Junuk Cha, Jihyeon Kim, Han-Mu Park
  • [CVPR 2026] Text-Driven 3D Hand Motion Generation from Sign Language Data. [paper] [code]
    Léore Bensabath, Mathis Petrovich, Gül Varol
  • [WMT 2025] Meaningful Pose-Based Sign Language Evaluation. [paper] [code]
    Zifan Jiang, Colin Leong, Amit Moryossef, Oliver Cory, Maksym Ivashechkin, Neha Tarigopula, Biao Zhang, Anne Göhring, Annette Rios, Rico Sennrich, Sarah Ebling
  • [EMNLP 2025] Improving Handshape Representations for Sign Language Processing: A Graph Neural Network Approach. [paper]
    Alessa Carbo, Eric Nalisnick
  • [EMNLP Findings 2025] Investigating Dictionary Expansion for Video-based Sign Language Dictionaries. [paper]
    Aashaka Desai, Daniela Massiceti, Richard Ladner, Hal Daumé Iii, Danielle Bragg, Alex Xijie Lu
  • [ACM MM 2025] Sentence-level Segmentation for Long Sign Language Videos with Captions. [paper]
    Bowen Guo, Shiwei Gan, Yafeng Yin, Xiao Liu, Zhiwei Jiang, Shunmei Meng
  • [ACL Findings 2025] Sign2Vis: Automated Data Visualization from Sign Language. [paper]
    Yao Wan, Yang Wu, Zhen Li, Guobiao Zhang, Hongyu Zhang, Zhou Zhao, Hai Jin, April Wang
  • [ACL Findings 2025] 2M-BELEBELE: Highly Multilingual Speech and American Sign Language Comprehension Dataset. [paper] [code]
    Marta R. Costa-jussà, Bokai YU, Pierre Andrews, Belen Alastruey, Necati Cihan Camgoz, Joe Chuang, Jean Maillard, Christophe Ropers, Arina Turkatenko, Carleigh Wood
  • [ACL Findings 2025] Large Language Models as Sign Language Interfaces: Mitigating the Requests of Deaf Users of LLMs in a Hearing-Centric World. [paper]
    Mert Inan, Anthony Sicilia, Malihe Alikhani
  • [EMNLP Findings 2024] Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label Smoothing. [paper] [code]
    Pooya Fayyazsanavi, Antonios Anastasopoulos, Jana Kosecka
  • [EMNLP 2024] Unsupervised Discrete Representations of American Sign Language. [paper] [code]
    Artem Abzaliev, Rada Mihalcea
  • [EMNLP 2024] Studying and Mitigating Biases in Sign Language Understanding Models. [paper]
    Katherine Atwell, Danielle Bragg, Malihe Alikhani
  • [ECCV 2024] Uncertainty-aware sign language video retrieval with probability distribution modeling. [paper] [code]
    Xuan Wu, Hongxiang Li, yuanjiang luo, Xuxin Cheng, Xianwei Zhuang, Meng Cao, Keren Fu
  • [ECCV 2024] SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmark. [paper] [code]
    Zhengdi Yu, Shaoli Huang, yongkang cheng, Tolga Birdal
  • [ACL 2024] Semi-Supervised Spoken Language Glossification. [paper] [code]
    Huijie Yao, Wengang Zhou, Hao Zhou, Houqiang Li
  • [ACL 2024] American Sign Language Handshapes Reflect Pressures for Communicative Efficiency. [paper] [code]
    Kayo Yin, Terry Regier, Dan Klein
  • [EMNLP Findings 2023] Enhancing Accessible Communication: from European Portuguese to Portuguese Sign Language. [paper] [code]
    Catarina Sousa, Luisa Coheur, Mara Moita
  • [CVPR 2023] CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning. [paper][code]
    Yiting Cheng, Fangyun Wei, Jianmin Bao, Dong Chen, Wenqiang Zhang
  • [CVPR 2023] Ham2Pose: Animating Sign Language Notation into Pose Sequences. [paper] [code]
    Rotem Shalev Arkushin, Amit Moryossef, Ohad Fried

Co-speech Gesture Generation

  • [ECCV 2026] CtrlCoMo: Controllable Co-Speech Motion Generation with Gesture–Action Disentanglement. [paper pending]
    Xinghan Wang, Ming Zhou, Yanbo Zheng, Youjiang Xu, Yuan Zhang, Mingyuan Gao, Nan Zhuang, Yadong Mu
  • [ECCV 2026] HolisticSemGes: Semantic Grounding of Holistic Co-Speech Gesture Generation with Contrastive Flow-Matching. [paper]
    Lanmiao Liu, Esam Ghaleb, Aslı Özyürek, Zerrin Yumak
  • [ECCV 2026] RoboGesture: Real-Time Semantic-aligned Co-Speech Gestures Generation for Humanoid Interaction. [paper]
    Zifan Wang, Ziang Ren, Pengyang Shi, Zirui Wang, Chenghuai Lin, Tianze Wang, Zekun Qi, Liangliang Zhao, He Wang, Li Yi
  • [ECCV 2026] SICAGE: Speaker-Independent Culture-Aware Gesture Generation using TED4C-L Dataset. [paper] [code]
    Ariel Gjaci, Antonio Sgorbissa, Vittorio Murino
  • [ECCV 2026] StreamTalk: Streaming Co-Speech Gesture Generation with Key-Pose Anchoring. [paper] [code]
    Jianfang Li, Xiangyue Zhang, Jiaxu Zhang, Kaixing Yang, Steven Hoi
  • [AAAI 2026] Streaming Generation of Co-Speech Gestures via Accelerated Rolling Diffusion. [paper] [code]
    Evgeniia Vu, Andrei Boiarov, Dmitry Vetrov
  • [CVPR 2026] CoordSpeaker: Exploiting Gesture Captioning for Coordinated Caption-Empowered Co-Speech Gesture Generation. [paper]
    Fengyi Fang, Sicheng Yang, Wenming Yang
  • [CVPR 2026] LiveGesture Streamable Co-Speech Gesture Generation Model. [paper]
    Muhammad Usama Saleem, Mayur Jagdishbhai Patel, Ekkasit Pinyoanuntapong, Zhongxing Qin, Li Yang, Hongfei Xue, Ahmed Helmy, Chen Chen, Pu Wang
  • [NeurIPS 2025] PyraMotion: Attentional Pyramid-Structured Motion Integration for Co-Speech 3D Gesture Synthesis. [paper] [code]
    Zhizhuo Yin, Yuk Hang Tsui, Pan Hui
  • [ICCV 2025] Democratizing High-Fidelity Co-Speech Gesture Video Generation. [paper] [code]
    Xu Yang, Shaoli Huang, Shenbo Xie, Xuelin Chen, Yifei Liu, Changxing Ding
  • [ICCV 2025] GestureHYDRA: Semantic Co-speech Gesture Synthesis via Hybrid Modality Diffusion Transformer and Cascaded-Synchronized Retrieval-Augmented Generation. [paper] [code]
    Quanwei Yang, Luying Huang, Kaisiyuan Wang, Jiazhi Guan, Shengyi He, Fengguo Li, Hang Zhou, Lingyun Yu, Yingying Li, Haocheng Feng, Hongtao Xie
  • [ICCV 2025] GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modeling. [paper] [code]
    Pinxin Liu, Luchuan Song, Junhua Huang, Haiyang Liu, Chenliang Xu
  • [ICCV 2025] SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learning. [paper] [code]
    Lanmiao Liu, Esam Ghaleb, asli ozyurek, Zerrin Yumak
  • [ACM MM 2025] Contextual Gesture: Co-Speech Gesture Video Generation through Context-aware Gesture Representation [paper]
    Pinxin Liu, Pengfei Zhang, Hyeongwoo Kim, Pablo Garrido, Ari Shapiro, Kyle Olszewski
  • [CVPR 2025] Retrieving Semantics from the Deep: an RAG Solution for Gesture Synthesis. [paper] [code]
    Muhammad Hamza Mughal, Rishabh Dabral, Merel CJ Scholman, Vera Demberg, Christian Theobalt
  • [CVPR 2025] Co-Speech Gesture Video Generation with Implicit Motion-Audio Entanglement. [paper] [code]
    Xinjie Li, Ziyi Chen, Xinlu Yu, Iek-Heng Chu, Peng Chang, Jing Xiao
  • [CVPR 2025] HOP: Heterogeneous Topology-based Multimodal Entanglement for Co-Speech Gesture Generation. [paper] [code]
    Hongye Cheng, Tianyu Wang, guangsi shi, Zexing Zhao, Yanwei Fu
  • [ACM MM 2025] Realistic-Gesture: Co-Speech Gesture Video Generation through Semantic-aware Gesture Representation. [paper]
    Pinxin Liu, Pengfei Zhang, Hyeongwoo Kim, Pablo Garrido, Ari Shapiro, Kyle Olszewski
  • Complete List of Co-speech Gesture Generation

Gesture Recognition

  • [ECCV 2026] Amplify, Aggregate, and Adjust: VideoMAE-based Holistic-Subtle Aggregation for Micro-Action Recognition. [paper pending]
    Yan Zhang, Nan Pu, Wenjing Li, Zhun Zhong, Meng Wang
  • [ECCV 2026] Beyond Language: Grounding Referring Expressions with Hand Pointing in Egocentric Vision. [paper]
    Ling Li, Bowen Liu, Zinuo Zhan, Peng Jie, Jianhui Zhong, Kenglun Chang, Zhidong Deng
  • [ECCV 2026] BiCE-HG: A Bi-Conditional Egocentric Hand Gesture Dataset for Intelligent Reality Systems. [paper pending]
    Awfa Dakheel, Charith Abhayaratne
  • [ECCV 2026] Recognizing Co-Speech Gestures in-the-Wild. [paper] [code]
    Sindhu Hegde, K R Prajwal, Andrew Zisserman
  • [ECCV 2026] S2Gest: Split-Scan State Space Models for Dynamic Hand Gesture Recognition. [paper pending]
    KeFan Chen, Yong Gu, Bo Li, Longjie Huang, Jiajun Zhang
  • [CVPR 2026] SHANDS: A Multi-View Dataset and Benchmark for Surgical Hand-Gesture and Error Recognition Toward Medical Training. [paper]
    Le Ma, Thiago Freitas dos Santos, Nadia Magnenat-Thalmann, Katarzyna Wac
  • [CVPR 2026] Active Inference for Micro-Gesture Recognition: EFE-Guided Temporal Sampling and Adaptive Learning. [paper]
    Weijia Feng, Jingyu Yang, Ruojia Zhang, Fengtao Sun, Qian Gao, Chenyang Wang, Tongtong Su, Jia Guo, Xiaobai Li, Minglai Shao
  • [ICCV 2025] Understanding Co-speech Gestures in-the-wild. [paper] [code]
    Sindhu B Hegde, K R Prajwal, Taein Kwon, Andrew Zisserman
  • [NeurIPS 2025] Doodle to Detect: A Goofy but Powerful Approach to Skeleton-based Hand Gesture Recognition. [paper] [code]
    Sang Hoon Han, Seonho Lee, Hyeok Nam, Jae Hyeon Park, Min Hee Cha, Min Geol Kim, Hyunse Lee, Sangyeon Ahn, Chae moon ju, Sung In Cho
  • [CVPR 2025] Ges3ViG: Incorporating Pointing Gestures into Language-Based 3D Visual Grounding for Embodied Reference Understanding. [paper] [code]
    Atharv Mahesh Mane, Dulanga Weerakoon, Vigneshwaran Subbaraju, Sougata Sen, Sanjay Sarma, Archan Misra
  • [CVPR 2025] SocialGesture: Delving into Multi-person Gesture Understanding. [paper] [code]
    Xu Cao, Pranav Virupaksha, Wenqi Jia, Bolin Lai, Fiona Ryan, Sangmin Lee, James Rehg
  • [OpenReview] Revisiting Noise Resilience Strategies in Gesture Recognition: Short-Term Enhancement in Surface Electromyographic Signal Analysis. [paper]
    Weiyu Guo, Ziyue Qiao, Ying Sun, Hui Xiong
  • [ICCV 2023] Learning Robust Representations with Information Bottleneck and Memory Network for RGB-D-based Gesture Recognition. [paper]
    Yunan Li, Huizhou Chen, Guanwen Feng, Qiguang Miao
  • [ICCV 2023] Data-Free Class-Incremental Hand Gesture Recognition. [paper] [code]
    Shubhra Aich, Jesus Ruiz-Santaquiteria, Zhenyu Lu, Prachi Garg, K J Joseph, Alvaro Fernandez Garcia, Vineeth N Balasubramanian, Kenrick Kin, Chengde Wan, Necati Cihan Camgoz, Shugao Ma, Fernando De la Torre
  • [BMVC 2022] Towards more efficient few-shot learning based human gesture recognition via dynamic vision sensors. [paper]
    Linglin Jing, Yifan Wang, Tailin Chen, Shirin Dora, Zhigang Ji, Hui Fang
  • [BMVC 2022] Continuous Hand Gesture Recognition using Deep Coarse and Fine Hand Features. [paper]
    Hazem Wannous, Jean-Philippe Vandeborre
  • [CVPR 2022] LD-ConGR: A Large RGB-D Video Dataset for Long-Distance Continuous Gesture Recognition. [paper] [code]
    Dan Liu; Libo Zhang; Yanjun Wu
  • [AAAI 2022] Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial Autoencoders. [paper]
    Abhishek Banerjee, Uttaran Bhattacharya, Aniket Bera
  • Complete List of Gesture Recognition

Sign Language Workshop

Dataset

Dataset Task Modality Statistic
Name Language Isolated Continuous RGB Depth #Signers #Vocab #Sequences
DGS Kinect DGS √ √ √ 15 40 3,000
ASLLVD ASL √ √ 6 2,742 9,794
DEVISIGN-L CSL √ √ √ 8 2,000 24,000
CSL-500 CSL √ √ 50 500 125,000
MSASL ASL √ √ 222 1,000 25,513
WLASL2000 ASL √ √ 119 2,000 21,083
AUTSL TSL √ √ √ 43 226 38,336
SIGNUM DGS √ √ √ 9 455 2,340
Phoenix14 DGS √ √ 9 1,200 6,841
KETI KSL √ √ 14 524 15,672
GSL GSL √ √ √ 7 310 10,290
CSL-100 CSL √ √ 50 2,000 25,000
CSL-Daily CSL √ √ 10 2,000 20,654
BSL-1K BSL √ √ 40 1,064 273K
VRT-NEWS VGT √ √ 9 6,325 7,174
How2Sign BSL √ √ √ 11 15,686 35,191
BOBSL BSL √ √ 39 2,281 452K
OpenASL ASL √ √ 220 33,549 98,417
YouTube-ASL ASL √ √ >2519 60K 11,093
Slovo RSL √ √ 194 1,000 20,400
MM-WLAuslan ASULAN √ √ √ 73 3,215 282,000
NationalCSL-DP CSL √ √ 10 6,707 67,070

About

💡 Resources about Sign Language Processing (e.g., Sign Language Recognition / Translation / Production)

Topics

gesture-recognitionpaper-recommendationsign-language-recognitionsign-language-translation

Resources

Readme
CC0-1.0 license
Activity
Custom properties

Stars

260 stars

Watchers

8 watching

Forks

25 forks
Report repository

Releases

Packages

Contributors