Skip to content

Commit

Permalink
Merge pull request #64 from OpenDriveLab/dev_jiajie
Browse files Browse the repository at this point in the history
Update submission.json example and test server status
  • Loading branch information
ChonghaoSima authored Mar 26, 2024
2 parents 2beb598 + c59c033 commit eff4b04
Show file tree
Hide file tree
Showing 3 changed files with 94 additions and 161 deletions.
21 changes: 10 additions & 11 deletions challenge/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -199,6 +199,8 @@ final score: 0.3240234750718823

## Submit to Test Server

**Update Mar 26, 2024**: our test server is now open for submission!

### Submission Instruction

The competition server is held on [Hugging Face space](https://huggingface.co/spaces/AGC2024/driving-with-language-2024).
Expand Down Expand Up @@ -236,9 +238,6 @@ Please infer your model on the `DriveLM-nuScenes version-1.1 val`(this is our te
<font color=red> Note: you can make up to 3 submissions per day. </font>
## FAQ
### How to View My Submissions?
You can check the status of your submissions in the `My submissions` tab of the competition space.
Expand All @@ -247,6 +246,14 @@ Please refer to [these slides](https://docs.google.com/presentation/d/1bicxoR_L3
You can select a submission and click `Update Selected Submissions` on the bottom to update its evaluation status to the private leaderboard. Please note that <font color=red>public score and private score are exactly the same</font> in our case. So please ignore the descriptions in `My Submissions` tab.
## FAQ
### The `New Submission` page shows `Invalid Token` when I click `Submit`, what should I do?
This means you are no longer logged in to the current competition space, or the space has automatically logged you out due to inactivity (more than a day).
Please refresh the page, click `Login with Hugging Face` at the bottom of the left panel, and resubmit.
### Can I Submit Without Making My Submission Public?
Of course. The competition space accepts Hugging Face private models. in fact, we recommend participants to submit as private models to keep their submissions private.
Expand All @@ -273,14 +280,6 @@ Body:
Email: {}
```
### The submission page shows `Invalid Token`, what should I do?
This means you are no longer logged in to the current competition space, or the space has automatically logged you out due to inactivity (more than a day).
Please refresh the page, click `Login with Hugging Face` at the bottom of the left panel, and resubmit.
### I could not visit `My Submissions` page, what should I do?
Chances are that you are not logged in to the current competition space.
Expand Down
2 changes: 1 addition & 1 deletion challenge/llama_adapter_v2_multimodal7b/demo.py
Original file line number Diff line number Diff line change
Expand Up @@ -82,7 +82,7 @@ def worker(rank, gpu_id, args, data_dict):

for i, result in enumerate(results):
print(f"Thread {rank}: Result - {result}")
data_dict.append({'id': ids[i], 'question': questions[i], 'gt_answer': gt_answers[i], 'answer': result})
data_dict.append({'id': ids[i], 'question': questions[i], 'answer': result})

print(f"Thread {rank} finished")

Expand Down
Loading

0 comments on commit eff4b04

Please sign in to comment.