NerAxom: A BIO-Tagged NER Dataset and HybridNeural-Rule Framework for Assamese

Counts differ because each database indexes a different set of publications. We treat OpenAlex as the canonical count; Google Scholar is not shown (no API, and crawling it violates its ToS).

Named Entity Recognition (NER) in low-resource, morphologically rich languages such as Assamese (ISO 639-3: asm) remains a significant challenge due to the scarcity of annotated corpora and the limited applicability of models designed for resource-rich languages. Existing Assamese NER resources suffer from critical limitations: WikiAnn provides broad language coverage but insufficient data volume for neural model training; AsNER, while a gold-standard corpus, supports only five entity categories and lacks a formal tagging scheme, restricting its utility for downstream tasks such as relation extraction and information retrieval. Furthermore, prior Assamese NER systems have relied predominantly on traditional tagging approaches and classical machine learning methods, with limited exploration of modern pre-trained language models and linguistically motivated post-processing strategies. To address these gaps, we present NerAxom, a BIO-tagged NER dataset for Assamese comprising 4,173 sentences and 106,046 tokens annotated across seven entity categories: Person (PER), Location (LOC), Organization (ORG), Date (DATE), Work_of_Art (WOA), Occupation (OCC), and Number (NUM). The dataset was independently annotated by two trained native speakers, achieving an inter-annotator agreement of κ = 0.82 (Cohen’s Kappa), with disagreements resolved through expert linguist adjudication. We evaluate NerAxom using two modeling paradigms: (i) a BiLSTM–CRF model with an attention mechanism, tested with FastText, BERT, and MuRIL embeddings; and (ii) direct fine-tuning of the MuRIL transformer as a token classifier. Among embedding-based models, MuRIL yields the highest F1-score of 68%, outperforming FastText (62%) and BERT (64%). Fine-tuning MuRIL directly as a token classifier achieves an F1-score of 70%, establishing a competitive transformer baseline. To address entity misclassifications arising from Assamese morphological complexity, we further introduce a set of language-specific post-processing rules based on morphological suffixes and keyword cues.