Wen-Lung Tsai, Ren-Qi Huang · Journal of Experimental & Theoretical Artificial Intelligence 2026 · 2026
DOI: 10.1080/0952813x.2026.2729304
Counts differ because each database indexes a different set of publications. We treat OpenAlex as the canonical count; Google Scholar is not shown (no API, and crawling it violates its ToS).
Retrieval-augmented generation (RAG) supports policy question answering by grounding responses in institutional documents. This study describes a campus assistant developed with Azure OpenAI GPT-4 and an Azure Cosmos DB knowledge store containing university regulations. The evaluation covers 51 regulation documents organised into five categories and a question-answer set comprising 1,742 items. Human reviewers classified 1,644 system replies as correct, yielding an overall response accuracy of 94.37%. Response accuracy is an aggregate human-judged correctness measure, not exact match. Because the study did not retain item-level evaluation materials, it does not report separate measures of retrieval quality, citation fidelity, unsupported content, latency, or user experience.
No comments yet — start the discussion below.