Skip to content

Commit

Permalink
Update Tokenizer Actions Workflow dependencies
Browse files Browse the repository at this point in the history
  • Loading branch information
ConnorHack committed Sep 16, 2024
1 parent c603be0 commit 08ab742
Showing 1 changed file with 10 additions and 9 deletions.
19 changes: 10 additions & 9 deletions .github/workflows/run-tokenizer-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -67,31 +67,32 @@ jobs:
run: |
ls -la ${GITHUB_WORKSPACE}
# Place sleep step before the test execution to "exec" into the test k8s POD and run tests manually to identify what dependencies are being used.
- name: "[DEBUG] sleep"
id: sleep
if: ${{ github.event.inputs.debug == 'true' && github.event.inputs.sleep_time != '' }}
run: |
sleep ${{ inputs.sleep_time }}
# TODO Identify version of pip prior to installing dependencies
- name: "Installing 'llama-models' dependencies"
id: pip_install
run: |
echo "[STEP] Installing 'llama-models' models"
pip install -U pip setuptools
pip3 install -U pip setuptools
pip3 install -r requirements.txt
- name: Set environment variable
id: set_env
run: |
echo "TOKENIZER_PATH=models/llama3/api/tokenizer.py" >> $GITHUB_ENV
# Place sleep step before the test execution to "exec" into the test k8s POD and run tests manually to identify what dependencies are being used.
- name: "[DEBUG] sleep"
id: sleep
if: ${{ github.event.inputs.debug == 'true' && github.event.inputs.sleep_time != '' }}
run: |
sleep ${{ inputs.sleep_time }}
# TODO Identify version of python prior to running tests
- name: Run tests
id: run_tests
run: |
echo "Running tests on Self-Hosted k8s ARC Runner"
cd $GITHUB_WORKSPACE && python -m unittest models/llama3/api/test_tokenizer.py
cd $GITHUB_WORKSPACE && python3 -m unittest models/llama3/api/test_tokenizer.py
- name: Publish Test Summary
id: test_summary
Expand Down

0 comments on commit 08ab742

Please sign in to comment.