From 25f528dc72e2066f760b217dc15ab6227f195763 Mon Sep 17 00:00:00 2001 From: Amir Ingber <93526572+ingberam@users.noreply.github.com> Date: Tue, 23 Jan 2024 22:28:28 +0200 Subject: [PATCH] ongoing leaderboard (#271) * ongoing leaderboard * comments * VM --- neurips23.html | 15 +++++++++++++-- 1 file changed, 13 insertions(+), 2 deletions(-) diff --git a/neurips23.html b/neurips23.html index 164e59ad..d6b70333 100644 --- a/neurips23.html +++ b/neurips23.html @@ -71,6 +71,18 @@

+

+ Update: we will maintain a new ongoing leaderboard to include + existing and new submissions to the big-ann repository, + that will be published periodically. The first updates are planned for 2/1/2024 and 3/1/2024. + Same rules apply as in the original competition, except: + (1) Open source is encouraged but not enforced. Closed-source entries will be marked as such. + In any case, a short description of the algorithm is required. + (2) We will only evaluate the public query sets in the new leaderboard + (on the same VM type: Azure Standard D8lds v5 with 8 vcpus, 16 GiB memory) + (3) To participate, simply send a PR with the new algorithm (no need for a CMT entry). +

+

This challenge is to encourage the development of indexing data structures and search algorithms for practical variants of @@ -83,7 +95,6 @@

submit new algorithms that improve on the baselines for these variants. This competition aims at being accessible to participants by limiting the scale of the datasets to about 10 million points. - You may request cloud compute credits ($1000) for development by July 31st.

@@ -303,7 +314,7 @@

Streaming Search

Authors: Jie Yin, Ben Huang, Baidu. -

^M +

* Zihao Wang is also an employee of Zilliz. However, he declares that the PyANNs entry was created on his time off, without any involvement from Zilliz or any of the other organizers. This entry did not declare conflict with organizers before participating.

Organizer Presentations