Academics can contribute to domain-specialized language models
Argues for academic focus on domain-specific language models, where they can excel beyond general-purpose leaderboards.
Topics:
Commercially available models dominate academic leaderboards. While impressive, this has concentrated research on creating and adapting general-purpose models to improve NLP leaderboard standings for large language models. However, leaderboards collect many individual tasks and general-purpose models often underperform in specialized domains; domainspecific or adapted models yield superior results. This focus on large general-purpose models excludes many academics and draws attention away from areas where they can make important contributions. We advocate for a renewed focus on developing and evaluating domain- and task-specific models, and highlight the unique role of academics in this endeavor
Latest publications
RECAP: Regression evaluation for continual adaptation of prompts
A benchmark that measures continual-learning phenomena at the constraint level for prompt-level adaptation methods.
EMNLPMEMGUARD: Preventing memory contamination in long-term memory-augmented large language models
A type-aware memory framework that preserves functional memory boundaries during memory construction and retrieval.
EMNLPSPARC-RAG: Adaptive Sequential–Parallel Scaling with Context Management for Retrieval-Augmented Generation
A multi-agent framework that coordinates sequential and parallel inference-time scaling.
EMNLP