content type videopublished November 6, 2023
Apple Workshop on Machine Learning for Health : Web3 and Decentralized AI (DecAI)
AuthorsRamesh Raskar (MIT)
Related readings and updates.
DiscoSign: Discourse-Aware Text to Sign Language Gloss Translation
September 11, 2026research area Accessibility, research area Speech and Natural Language Processingconference EMNLP
Sign language processing systems have traditionally operated at the sentence level, ignoring critical discourse phenomena fundamental to sign language comprehension. We introduce DiscoSign, a computational approach for discourse-aware text to sign language gloss translation grounded in linguistic research. We address three key phenomena within our modular Large Language Model (LLM)-based translation framework: (i) spatial coreference resolution,…
Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering
September 11, 2026research area Computer Vision, research area Data Science and Annotationconference ACL
Evaluating video captioning remains a critical challenge for Visual Large Language Models (VLLMs). Existing metrics primarily rely on matching generated text against ground-truth references. This paradigm suffers from the “one-to-many” nature of video description, where high-quality captions are often penalized for lexical mismatches or valid shifts in visual focus. Furthermore, such assessments are typically one-dimensional, failing to provide a…
Discover opportunities in Machine Learning.
Our research in machine learning breaks new ground every day.