Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix WF and tutorial extraction #225

Closed
wants to merge 2 commits into from
Closed

Fix WF and tutorial extraction #225

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
5d196c9
Rename tool columns and add documentation
bebatut Nov 6, 2024
ae45d26
Fix wf and tutorial extraction
bebatut Nov 7, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 38 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,43 @@ Galaxy Codex

Galaxy Communities Dock aka Galaxy Codex is a catalog of Galaxy resources (tools, training, workflows) that can be filtered for any community.

This repository stores the sources to build this catalog. The catalog is automatically updated every week.

This repository stores the sources to build this catalog and its content. The catalog is automatically updated every week.

Any Galaxy community can be added to this project and benefit from the dedicated resources, including interactive tables that can be embedded into subdomains and website via an iframe. **Learn [how to add your community](https://training.galaxyproject.org/training-material//topics/dev/tutorials/community-tool-table/tutorial.html) in the dedicated GTN tutorial**.

# Catalog content

## Tool table

Column | Description
--- | ---
Suite ID | ID of Galaxy suite
Tool IDs | List of Galaxy tool IDs
Description | Description of the suite
Homepage | Homepage for tool
Suite version | Version of the Galaxy suite
Suite Conda package | Conda package used as requirement for the suite
Latest suite conda package version | Latest Conda package version on anaconda
Suite version status | Update status derived by comparing the suite version to the latest conda package version
ToolShed categories |
EDAM operations | EDAM operations extracted using bio.tools
EDAM reduced operations | EDAM operations where only the most specific terms are kept, i.e. all terms that are superclasses of other terms are removed
EDAM topics | EDAM topics extracted using bio.tools
EDAM reduced topics | EDAM topics where only the most specific terms are kept, i.e. all terms that are superclasses of other terms are removed
Suite owner | Owner of the Galaxy suite
Suite source | Path to the Galaxy suite
bio.tools ID | ID of the bio.tools entry corresponding to the tool
bio.tools name | Name of the bio.tools entry corresponding to the tool
bio.tools description | Description in bio.tools entry corresponding to the tool
bii ID | ID of BII entry corresponding to the tool
Number of tools available on ... | Number of tools available on given Galaxy server
Suite users (last 5 years) on ... | Number of users of the suite in the last 5 years on given Galaxy server
Suite users on ... | Number of users of the suite on given Galaxy server
Suite runs (last 5 years) on ... | Number of runs of the suite tools in the last 5 years on given Galaxy server
Suite runs on ... | Number of runs of the suite tools on given Galaxy server
Suite users (last 5 years) on main servers | Number of users of the suite in the last 5 years on all UseGalaxy servers
Suite users on main servers | Number of users of the suite on all UseGalaxy servers
Suite runs (last 5 years) on main servers | Number of runs of the suite tools in the last 5 years on all UseGalaxy servers
Suite runs on main servers | Number of runs of the suite tools on all UseGalaxy servers
Deprecated | Deprecation status after review by a domain expert
To keep | Status to add to a community after review by a domain expert
786 changes: 373 additions & 413 deletions communities/all/resources/test_tools.json
View file
Open in desktop

Large diffs are not rendered by default.

13 changes: 6 additions & 7 deletions communities/all/resources/test_tools.tsv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
Galaxy wrapper id Galaxy tool ids Description bio.tool id bio.tool ids biii bio.tool name bio.tool description EDAM operation EDAM topic Status Source ToolShed categories ToolShed id Date of first commit of the suite Galaxy wrapper owner Galaxy wrapper source Galaxy wrapper parsed folder Galaxy wrapper version Conda id Conda version EDAM operation (no superclasses) EDAM topic (no superclasses) Available on UseGalaxy.org (Main) Available on UseGalaxy.org.au Available on UseGalaxy.eu Available on UseGalaxy.fr Tools available on UseGalaxy.org (Main) Tools available on UseGalaxy.org.au Tools available on UseGalaxy.eu Tools available on UseGalaxy.fr Tools available on APOSTL Tools available on BF2I-MAP Tools available on BioBix Tools available on CIRM-CFBP Tools available on Center for Phage Technology (CPT) Tools available on ChemFlow Tools available on Coloc-stats Tools available on CoralSNP Tools available on CropGalaxy Tools available on Dintor Tools available on FreeBioinfo Tools available on GASLINI Tools available on Galaxy@AuBi Tools available on Galaxy@Pasteur Tools available on GalaxyTrakr Tools available on Genomic Hyperbrowser Tools available on GigaGalaxy Tools available on HyPhy HIV NGS Tools Tools available on IPK Galaxy Blast Suite Tools available on ImmPort Galaxy Tools available on InteractoMIX Tools available on MISSISSIPPI Tools available on Mandoiu Lab Tools available on MiModD NacreousMap Tools available on Oqtans Tools available on Palfinder Tools available on PepSimili Tools available on PhagePromotor Tools available on UseGalaxy.be Tools available on UseGalaxy.cz Tools available on UseGalaxy.no Tools available on Viral Variant Visualizer (VVV) No. of tool users (5 years) (usegalaxy.eu) No. of tool users (all time) (usegalaxy.eu) Tool usage (5 years) (usegalaxy.eu) Tool usage (all time) (usegalaxy.eu) No. of tool users (5 years) (usegalaxy.org) No. of tool users (all time) (usegalaxy.org) Tool usage (5 years) (usegalaxy.org) Tool usage (all time) (usegalaxy.org) No. of tool users (5 years) (usegalaxy.org.au) No. of tool users (all time) (usegalaxy.org.au) Tool usage (5 years) (usegalaxy.org.au) Tool usage (all time) (usegalaxy.org.au)
2d_auto_threshold ip_threshold Automatic thresholding scikit-image scikit-image scikit-image scikit-image Scikit-image contains image processing algorithms for SciPy, including IO, morphology, filtering, warping, color manipulation, object detection, etc. Image analysis, Image annotation, Visualisation, Data handling Imaging, Software engineering, Literature and language To update https://github.com/bmcv Imaging 2d_auto_threshold 2024-03-01 imgteam https://github.com/BMCV/galaxy-image-analysis/tree/master/tools/2d_auto_threshold/ https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/2d_auto_threshold 0.0.6-2 scikit-image Image analysis, Image annotation, Visualisation, Data handling Imaging, Software engineering, Literature and language 0 1 1 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 1434 6746 120 122 0 0 0 0 305 305 11 11
abritamr abritamr A pipeline for running AMRfinderPlus and collating results into functional classes To update https://zenodo.org/record/7370628 Sequence Analysis abritamr 2024-03-01 iuc https://github.com/galaxyproject/tools-iuc/tree/master/tools/abritamr https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/abritamr 1.0.14 abritamr 1.0.19 0 0 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1139 1139 109 109 0 0 0 0 0 0 0 0
aldex2 aldex2 Performs analysis Of differential abundance taking sample variation into account aldex2 aldex2 ALDEx2 A differential abundance analysis for the comparison of two or more conditions. It uses a Dirichlet-multinomial model to infer abundance from counts, that has been optimized for three or more experimental replicates. Infers sampling variation and calculates the expected FDR given the biological and sampling variation using the Wilcox rank test and Welches t-test, or the glm and Kruskal Wallis tests. Reports both P and fdr values calculated by the Benjamini Hochberg correction. Statistical inference Gene expression, Statistics and probability To update https://github.com/ggloor/ALDEx_bioc Metagenomics aldex2 2024-03-01 iuc https://github.com/galaxyproject/tools-iuc/tree/master/tools/aldex2 https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/aldex2 1.26.0 bioconductor-aldex2 1.34.0 Statistical inference Gene expression, Statistics and probability 0 0 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 262 262 36 36 0 0 0 0 0 0 0 0
fastp fastp Fast all-in-one preprocessing for FASTQ files fastp fastp fastp A tool designed to provide fast all-in-one preprocessing for FastQ files. This tool is developed in C++ with multithreading supported to afford high performance. Sequencing quality control, Sequence contamination filtering Sequence analysis, Probes and primers To update https://github.com/OpenGene/fastp Sequence Analysis fastp 2024-03-11 iuc https://github.com/galaxyproject/tools-iuc/tree/master/tools/fastp https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/fastp fastp 0.23.4 Sequence contamination filtering Probes and primers 1 1 1 0 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 1 0 0 0 1 0 0 0 0 0 0 1 1 1 1 1126086 1127111 6847 6909 422259 422259 10722 10722 76462 76462 2242 2242
spades spades_biosyntheticspades, spades_coronaspades, spades_metaplasmidspades, metaspades, spades_metaviralspades, spades_plasmidspades, rnaspades, spades_rnaviralspades, spades SPAdes is an assembly toolkit containing various assembly pipelines. It implements the following 4 stages: assembly graph construction, k-bimer adjustment, construction of paired assembly graph and contig construction. spades metaplasmidspades, rnaspades, metaviralspades, spades, rnaviralspades, plasmidspades, coronaspades, biosyntheticspades, metaspades SPAdes St. Petersburg genome assembler – is intended for both standard isolates and single-cell MDA bacteria assemblies. SPAdes 3.9 works with Illumina or IonTorrent reads and is capable of providing hybrid assemblies using PacBio, Oxford Nanopore and Sanger reads. Additional contigs can be provided and can be used as long reads. Genome assembly Sequence assembly To update https://github.com/ablab/spades Assembly, RNA, Metagenomics spades 2024-03-12 iuc https://github.com/galaxyproject/tools-iuc/tree/master/tools/spades https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/spades 3.15.5 spades 4.0.0 Genome assembly Sequence assembly 9 9 9 0 9 9 9 0 0 0 0 0 0 0 0 0 0 0 0 0 1 3 8 0 0 2 0 0 0 3 0 0 0 0 0 0 3 9 3 0 82716 87113 8209 8526 120471 120475 14787 14790 54067 61541 5817 6653

Suite ID Tool IDs Description Suite first commit date Homepage Suite version Suite conda package Latest suite conda package version Suite version status ToolShed categories EDAM operations EDAM reduced operations EDAM topics EDAM reduced topics Suite owner Suite source Suite parsed folder bio.tool ID bio.tool name bio.tool description biii ID Number of tools on UseGalaxy.org (Main) Number of tools on UseGalaxy.org.au Number of tools on UseGalaxy.eu Number of tools on UseGalaxy.fr Number of tools on APOSTL Number of tools on BF2I-MAP Number of tools on BioBix Number of tools on CIRM-CFBP Number of tools on Center for Phage Technology (CPT) Number of tools on ChemFlow Number of tools on Coloc-stats Number of tools on CoralSNP Number of tools on CropGalaxy Number of tools on Dintor Number of tools on FreeBioinfo Number of tools on GASLINI Number of tools on Galaxy@AuBi Number of tools on Galaxy@Pasteur Number of tools on GalaxyTrakr Number of tools on Genomic Hyperbrowser Number of tools on GigaGalaxy Number of tools on HyPhy HIV NGS Tools Number of tools on IPK Galaxy Blast Suite Number of tools on ImmPort Galaxy Number of tools on InteractoMIX Number of tools on MISSISSIPPI Number of tools on Mandoiu Lab Number of tools on MiModD NacreousMap Number of tools on Oqtans Number of tools on Palfinder Number of tools on PepSimili Number of tools on PhagePromotor Number of tools on UseGalaxy.be Number of tools on UseGalaxy.cz Number of tools on UseGalaxy.no Number of tools on Viral Variant Visualizer (VVV) Suite users (last 5 years) (usegalaxy.eu) Suite users (usegalaxy.eu) Suite runs (last 5 years) (usegalaxy.eu) Suite runs (usegalaxy.eu) Suite users (last 5 years) (usegalaxy.org) Suite users (usegalaxy.org) Suite runs (last 5 years) (usegalaxy.org) Suite runs (usegalaxy.org) Suite users (last 5 years) (usegalaxy.org.au) Suite users (usegalaxy.org.au) Suite runs (last 5 years) (usegalaxy.org.au) Suite runs (usegalaxy.org.au) Suite users (last 5 years) on main servers Suite users on main servers Suite runs (last 5 years) on main servers Suite runs on main servers
2d_auto_threshold ip_threshold Automatic thresholding 2024-03-01 https://github.com/bmcv 0.0.6-2 scikit-image To update Imaging Image analysis, Image annotation, Visualisation, Data handling Image analysis, Image annotation, Visualisation, Data handling Imaging, Software engineering, Literature and language Imaging, Software engineering, Literature and language imgteam https://github.com/BMCV/galaxy-image-analysis/tree/master/tools/2d_auto_threshold/ https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/2d_auto_threshold scikit-image scikit-image Scikit-image contains image processing algorithms for SciPy, including IO, morphology, filtering, warping, color manipulation, object detection, etc. scikit-image 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 120 122 1434 6746 0 0 0 0 11 11 305 305 131 395 1739 10529
abritamr abritamr A pipeline for running AMRfinderPlus and collating results into functional classes 2024-03-01 https://zenodo.org/record/7370628 1.0.14 abritamr 1.0.19 To update Sequence Analysis iuc https://github.com/galaxyproject/tools-iuc/tree/master/tools/abritamr https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/abritamr 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 109 109 1139 1139 0 0 0 0 0 0 0 0 109 327 1139 3417
aldex2 aldex2 Performs analysis Of differential abundance taking sample variation into account 2024-03-01 https://github.com/ggloor/ALDEx_bioc 1.26.0 bioconductor-aldex2 1.34.0 To update Metagenomics Statistical inference Statistical inference Gene expression, Statistics and probability Gene expression, Statistics and probability iuc https://github.com/galaxyproject/tools-iuc/tree/master/tools/aldex2 https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/aldex2 aldex2 ALDEx2 A differential abundance analysis for the comparison of two or more conditions. It uses a Dirichlet-multinomial model to infer abundance from counts, that has been optimized for three or more experimental replicates. Infers sampling variation and calculates the expected FDR given the biological and sampling variation using the Wilcox rank test and Welches t-test, or the glm and Kruskal Wallis tests. Reports both P and fdr values calculated by the Benjamini Hochberg correction. 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 36 36 262 262 0 0 0 0 0 0 0 0 36 108 262 786
fastp fastp Fast all-in-one preprocessing for FASTQ files 2024-03-11 https://github.com/OpenGene/fastp fastp 0.23.4 To update Sequence Analysis Sequencing quality control, Sequence contamination filtering Sequence contamination filtering Sequence analysis, Probes and primers Probes and primers iuc https://github.com/galaxyproject/tools-iuc/tree/master/tools/fastp https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/fastp fastp fastp A tool designed to provide fast all-in-one preprocessing for FastQ files. This tool is developed in C++ with multithreading supported to afford high performance. 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 1 0 0 0 1 0 0 0 0 0 0 1 1 1 1 6847 6909 1126086 1127111 10722 10722 422259 422259 2242 2242 76462 76462 19811 59495 1624807 4875446
spades spades_biosyntheticspades, spades_coronaspades, spades_metaplasmidspades, metaspades, spades_metaviralspades, spades_plasmidspades, rnaspades, spades_rnaviralspades, spades SPAdes is an assembly toolkit containing various assembly pipelines. It implements the following 4 stages: assembly graph construction, k-bimer adjustment, construction of paired assembly graph and contig construction. 2024-03-12 https://github.com/ablab/spades 3.15.5 spades 4.0.0 To update Assembly, RNA, Metagenomics Genome assembly Genome assembly Sequence assembly Sequence assembly iuc https://github.com/galaxyproject/tools-iuc/tree/master/tools/spades https://github.com/paulzierep/Galaxy-Tool-Metadata-Extractor-Test-Wrapper/tree/main/tools/spades spades SPAdes St. Petersburg genome assembler – is intended for both standard isolates and single-cell MDA bacteria assemblies. SPAdes 3.9 works with Illumina or IonTorrent reads and is capable of providing hybrid assemblies using PacBio, Oxford Nanopore and Sanger reads. Additional contigs can be provided and can be used as long reads. 9 9 9 9 0 0 0 0 0 0 0 0 0 0 0 0 1 3 8 0 0 2 0 0 0 3 0 0 0 0 0 0 3 9 3 0 8209 8526 82716 87113 14787 14790 120471 120475 5817 6653 54067 61541 28813 87595 257254 783637
2 changes: 1 addition & 1 deletion sources/bin/extract_all_tutorials.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ then
python sources/bin/extract_gtn_tutorials.py \
extract \
--all "communities/all/resources/test_tutorials.json" \
--tools "communities/all/resources/tools.json" \
--tools "communities/all/resources/test_tools.json" \
--api $PLAUSIBLE_API_KEY \
--test
else
Expand Down
2 changes: 1 addition & 1 deletion sources/bin/extract_all_workflows.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ if [ ! -z $1 ]
then
python sources/bin/extract_galaxy_workflows.py extract \
--all communities/all/resources/test_workflows.json \
--tools communities/all/resources/tools.json \
--tools communities/all/resources/test_tools.json \
--test
else
python sources/bin/extract_galaxy_workflows.py extract \
Expand Down
Loading