Sort and Search

This repository contains algorithms developed for the paper:

Efficient Lifelong Model Evaluation in an Era of Rapid Progress, Arxiv
Ameya Prabhu*, Vishaal Udandarao*, Philip Torr, Matthias Bethge+, Adel Bibi+, Samuel Albanie+

[PDF] [Slides] [Poster] [Bibtex]

Installation and Dependencies

Usage

If you discover any bugs in the code please contact me, I will cross-check them with my nightmares.

Citation

We hope Sort and Search is a strong baseline and comparison for efficiently evaluating your cool large test set! To cite our work:

@article{prabhu2024lifelong,
  title={Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress},
  author={Prabhu, Ameya and Udandarao, Vishaal and Torr, Philip and Bethge, Matthias and Bibi, Adel and Albanie, Samuel},
  journal={arXiv preprint arXiv:2402.19472},
  year={2024}
}