From 1637dc0bde05940c300b51e212356b4c200bc079 Mon Sep 17 00:00:00 2001 From: leshem Date: Thu, 30 Jul 2026 16:19:01 -0400 Subject: [PATCH] Cite the paper, not the schema release The README's Citation section pointed at a placeholder @misc entry for the v0.2 schema release, written before the paper existed. Replace it with the canonical arXiv entry for arXiv:2606.14516, and add a paper link to the header, which had no reference to it at all. --- README.md | 19 +++++++++++-------- 1 file changed, 11 insertions(+), 8 deletions(-) diff --git a/README.md b/README.md index 2af8b4280..7eea43f59 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ > [EvalEval Coalition](https://evalevalai.com) โ€” "We are a researcher community developing scientifically grounded research outputs and robust deployment infrastructure for broader impact evaluations." -๐Ÿ“– **[Documentation](https://evalevalai.com/every_eval_ever/)** +๐Ÿ“– **[Documentation](https://evalevalai.com/every_eval_ever/)** ยท ๐Ÿ“„ **[Paper (arXiv:2606.14516)](https://arxiv.org/abs/2606.14516)** **Every Eval Ever** is a shared schema and crowdsourced eval database. It defines a standardized metadata format for storing AI evaluation results โ€” from leaderboard scrapes and research papers to local evaluation runs โ€” so that results from different frameworks can be compared, reproduced, and reused. The three components that make it work: @@ -354,13 +354,16 @@ Qualifying contributors will be invited as co-authors on the shared task paper. ## ๐Ÿ“Ž Citation +If Every Eval Ever informs your research, please cite the paper: + ```bibtex -@misc{everyevalever2026schema, - title = {Every Eval Ever Metadata Schema v0.2}, - author = {EvalEval Coalition}, - year = {2026}, - month = {February}, - url = {https://github.com/evaleval/every_eval_ever}, - note = {Schema Release} +@misc{batzner2026evaleverunifyingschema, + title={Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results}, + author={Jan Batzner and Sree Harsha Nelaturu and Damian Stachura and Anastassia Kornilova and Jon Crall and Tommaso Cerruti and Yanan Long and Yifan Mai and Sanchit Ahuja and Asaf Yehudai and Marek ล uppa and John P. Lalor and Oluwagbemike Olowe and Jatin Ganhotra and Brian H. Hu and Eliya Habba and Andrew M. Bean and Chang Liu and Sander Land and Steven Dillmann and Aniketh Garikaparthi and Elron Bandel and Saki Imai and James Edgell and Wm. Matthew Kennedy and Jenny Chim and Patrick Meusling and Asteria Kaeberlein and Venkata Ramachandra Karthik Chundi and Manasi Patwardhan and Martin Ku and Austin Meek and Leon Knauer and Brian Wingenroth and Srishti Yadav and Usman Gohar and Felix Friedrich and Michelle Lin and Jennifer Mickel and Arman Cohan and Stella Biderman and Irene Solaiman and Zeerak Talat and Anka Reuel and Mubashara Akhtar and Gjergji Kasneci and Avijit Ghosh and Leshem Choshen}, + year={2026}, + eprint={2606.14516}, + archivePrefix={arXiv}, + primaryClass={cs.AI}, + url={https://arxiv.org/abs/2606.14516}, } ```