VākQA introduces a Telugu spoken factoid question‑answering benchmark comprising 2,001 QA pairs across six domains, accompanied by 2.53 hours of speech audio and bilingual transcriptions with human‑verified reference answers. The benchmark aims to fill the gap in spoken QA resources for low‑resource languages and to quantify the reliability of automatic evaluation in this setting.
Read original
huggingface/daily-papers