Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update dev branch with task5-workflow #55

Merged
merged 51 commits into from
Jun 5, 2024
Merged
Changes from all commits
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
568794c
set up initial workflow to run UK Biobank terms through mapper
nguyenank Sep 20, 2021
f3ba66e
update workflow to have correct command for calling mapper
nguyenank Sep 20, 2021
af95902
try adding link to test repo
nguyenank Oct 3, 2021
3bdc0fe
add runs-on to new test job
nguyenank Oct 3, 2021
f0a43ce
update job dependencies, enabled github authentication for private repo
nguyenank Oct 3, 2021
5181db2
explicitly git add file
nguyenank Oct 3, 2021
92bbd52
update workflow to use MAPPER_SECRET token
nguyenank Oct 4, 2021
f98812b
condense workflow to only test accessing the repository
nguyenank Oct 4, 2021
dc8a7de
temporarily remove dependency
nguyenank Oct 4, 2021
02cbc50
restore full workflow
nguyenank Oct 4, 2021
7f0d0ec
fix nesting
nguyenank Oct 4, 2021
066ad04
update workflow; remove unnecessary files
nguyenank Oct 10, 2021
9b302f3
update workflow so repos are nested rather than side-by-side
nguyenank Oct 10, 2021
35670be
change reference to test repo and add debug 'ls'
nguyenank Oct 10, 2021
3afdc7f
make moving into the tests repo a separate step
nguyenank Oct 10, 2021
5486413
fix typo
nguyenank Oct 10, 2021
aa2c0fa
update paths
nguyenank Oct 10, 2021
dc8dd5b
don't use relative path for output
nguyenank Oct 10, 2021
e79a3d3
update output file reference
nguyenank Oct 10, 2021
869ea95
wrap output path in quotes
nguyenank Oct 10, 2021
5a09805
add debug 'ls', refactor git add
nguyenank Oct 10, 2021
c4536b1
fix summary path typo
nguyenank Oct 10, 2021
8f9ef88
update to use working-directory attribute
nguyenank Oct 10, 2021
a217bf4
correct typo in sumamry_path var name
nguyenank Oct 10, 2021
b3e4b06
fix formatting on start of row
nguyenank Oct 10, 2021
38dfcd2
set minimum score for mapper tool to 0
nguyenank Nov 4, 2021
108fefe
merge in main
nguyenank Feb 7, 2022
1fccdff
update numpy version
nguyenank Feb 7, 2022
7cf3a43
update testing script to run coverage error script
nguyenank Feb 7, 2022
4843594
t2t.py -> text2term.py
nguyenank Feb 7, 2022
27540e1
fix typo in coverage-script running
nguyenank Feb 7, 2022
e424d44
test summary.csv
nguyenank Feb 7, 2022
20505a1
adjust working directory for coverage-erro script
nguyenank Feb 7, 2022
3c282d6
update output path
nguyenank Feb 7, 2022
90d96b6
debug coverage_error script run error
nguyenank Feb 7, 2022
b36a996
update coverage_error script to use new column names
nguyenank Feb 7, 2022
ae4e50d
add UK Biobank EFO owl version and one error and commit message
nguyenank Feb 10, 2022
803db57
switch to coverage_one_error script
nguyenank Feb 11, 2022
741c28b
test, escaping commas
nguyenank Feb 20, 2022
6f21f0b
test 2, now with fixed variable names
nguyenank Feb 20, 2022
ea3e124
test 3, with more quote marks
nguyenank Feb 20, 2022
da9ddc6
add escaping, full pipeline
nguyenank Feb 20, 2022
0ec28ce
Merge pull request #47 from ccb-hms/development
paynejason Mar 6, 2024
b8eaf76
Merge pull request #48 from ccb-hms/development
paynejason Mar 28, 2024
7faefc9
Merge pull request #50 from ccb-hms/development
rsgoncalves Jun 4, 2024
af66474
Merge pull request #51 from ccb-hms/development
rsgoncalves Jun 4, 2024
d256539
Merge pull request #52 from ccb-hms/development
rsgoncalves Jun 5, 2024
cfd5733
Merge pull request #53 from ccb-hms/development
rsgoncalves Jun 5, 2024
0786f8a
Merge branch 'main' into task5-workflow
rsgoncalves Jun 5, 2024
a97c99c
Merge pull request #13 from ccb-hms/task5-workflow
rsgoncalves Jun 5, 2024
02b1fa2
Merge pull request #54 from ccb-hms/development
rsgoncalves Jun 5, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
76 changes: 76 additions & 0 deletions .github/workflows/mapper-test.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,76 @@
# This workflow will install Python dependencies, run tests and lint with a single version of Python
# For more information see: https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions

name: Mapper Test

on:
push:
branches: [task5-workflow]
pull_request:
branches: [task5-workflow]

jobs:
run_mapper:
runs-on: ubuntu-latest
name: Run Tests
steps:
- uses: actions/checkout@v2
name: Checkout out mapper repository
- uses: actions/checkout@v2
name: Checkout test repository
with:
path: tests
repository: "ccb-hms/ontology-mapper-tests"
token: ${{ secrets.MAPPER_TESTING }}
fetch-depth: 0 # otherwise, there would be errors pushing refs to the destination repository.
- name: Set up Python 3.9
uses: actions/setup-python@v2
with:
python-version: 3.9
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install flake8 pytest
if [ -f requirements.txt ]; then pip install -r requirements.txt; fi
- name: Run mapper on UK Biobank source terms
run: |
python3 text2term.py -s $source_path -t $target_path -min 0 -o "./tests/mapper-outputs/ukb-efo/${GITHUB_SHA}.csv"
env:
source_path: ./tests/data/ukb-efo/terms.txt
# https://github.com/EBISPOT/efo/releases/tag/v2019-03-18
# 2019-03-18 EFO 2.106, as referenced by:
# https://github.com/EBISPOT/EFO-UKB-mappings/blob/master/ISMB_Mapping_UK_Biobank_to_EFO.pdf
# page 2, footnote 9
target_path: ./tests/data/ukb-efo/efo-v2019-03-18.owl
- name: Setup summary spreadsheet row
run: |
if grep -q "," <<< "${{ github.event.head_commit.message }}"
then
MSG='"${{ github.event.head_commit.message }}"'
else
MSG='${{ github.event.head_commit.message }}'
fi
echo -n "${GITHUB_REF},${GITHUB_SHA},${MSG},ukb-efo/${GITHUB_SHA}.csv," >> $summary_path
working-directory: tests
env:
summary_path: summary.csv
- name: Run coverage__one_error script
run: |
python3 $script_path
working-directory: tests/compare-scripts
env:
script_path: coverage_one_error.py
- name: Commit changes to tests repo
run: |
git config --local user.email "41898282+github-actions[bot]@users.noreply.github.com"
git config --local user.name "github-actions[bot]"
git add mapper-outputs/*
git add summary.csv
git commit -m "Add files"
working-directory: tests
- name: Push changes
uses: ad-m/github-push-action@master
with:
repository: "ccb-hms/ontology-mapper-tests"
github_token: ${{ secrets.MAPPER_TESTING }}
directory: "tests"