Skip to content

Commit

Permalink
Edited script a little
Browse files Browse the repository at this point in the history
  • Loading branch information
Kirill Semin committed Feb 17, 2024
1 parent 244896b commit 428deb9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion run_models.sh
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ model_args_list=(

# Iterate over the list and run the command
for model_args_value in "${model_args_list[@]}"; do
command="accelerate launch -m lm_eval --model hf --tasks winogrande_ru --batch_size 32 --model_args $model_args_value"
command="accelerate launch -m lm_eval --model hf --tasks winogrande_ru,arc_challenge_ru,hellaswag_ru,mmlu_ru,gsm8k_ru,truthfulqa_mc2_ru --batch_size 4 --model_args $model_args_value"
echo "Running command: $command"
$command
done

0 comments on commit 428deb9

Please sign in to comment.