International Journal of Research and Innovation
Vol 1, Issue 1 (January 2026), pp. 1-11
Computer ScienceVol 1, Issue 1 (January 2026), pp. 1-11
Sparse Attention Mechanisms for Low-Resource Language Models
Ananya Rao, Devashish Kumar · Indian Institute of Science, Bengaluru
Abstract
A learned sparse-attention scheme cuts inference cost for morphologically rich, low-resource languages with no measurable loss in accuracy.
Continue reading the full article
The abstract is free. Full text and PDF download require a subscription. Sign in or subscribe to continue.
Reviewed under double-blind evaluation by 2 members of the editorial board:
Prof. Vidyadhar Reddy AileniDr Rajendran Govender
Accepted and published by Dr Cynthia Menezes Prabhu, Editor-in-Chief.