International Journal of Research and Innovation
Vol 1, Issue 1 (July 2026), pp. 1-14

Computer Science

Sparse Attention Mechanisms for Low-Resource Language Models

Ananya Rao, Devashish Kumar · Indian Institute of Science, Bengaluru

Abstract

We present a sparse attention scheme that reduces inference cost for morphologically rich, low-resource languages without measurable loss in downstream accuracy.

Subscribers only

Continue reading the full article

The abstract is free. Full text and PDF download require a subscription. Sign in or subscribe to continue.

Peer review

Reviewed under double-blind evaluation by 2 members of the editorial board:

Dr. Rohan IyerDr. Priya Menon

Accepted and published by Prof. S. Nagaraj, Editor-in-Chief.