Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add MGnify amplicon pipeline #343

Open
wants to merge 60 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
5292081
amplicon subworkflows
RZ9082 Feb 25, 2024
8fbf0ac
add .dockstore.yml
RZ9082 Feb 25, 2024
8b37b93
update trimmomatic suffix
RZ9082 Feb 28, 2024
aeccaa9
update trimmomatic revision
RZ9082 Feb 28, 2024
b1ba46f
update workflows
RZ9082 Feb 29, 2024
48191eb
updated PE and SE tests
RZ9082 Mar 1, 2024
fcf4550
updated PE and SE tests
RZ9082 Mar 1, 2024
195028a
add workflow to test query_tabular input
RZ9082 Mar 1, 2024
5702b8d
add workflow to test query_tabular input
RZ9082 Mar 1, 2024
a33ac5d
add workflow to test query_tabular input
RZ9082 Mar 1, 2024
5459484
update test query_tabular
RZ9082 Mar 5, 2024
159ad05
update test query_tabular
RZ9082 Mar 5, 2024
216d0e4
updated cmsearch-deoverlap
RZ9082 Mar 18, 2024
69c84c0
update cmsearch-deoverlap
RZ9082 Mar 20, 2024
d7d913e
remove testing-query-tabular
RZ9082 Mar 20, 2024
8b64392
update after-quality-control tests
RZ9082 Mar 21, 2024
79ee75b
update after-quality-control tests
RZ9082 Mar 21, 2024
6c38879
add annotations to the post-QC sub-WF
RZ9082 Mar 21, 2024
b6b6472
updated input names
RZ9082 Mar 21, 2024
cd67328
add annotations
RZ9082 Mar 25, 2024
51d1f93
typo in the annotation
RZ9082 Mar 25, 2024
a9e5b4a
update PE-WF annotation
RZ9082 Mar 25, 2024
e2bcf6f
typo
RZ9082 Mar 25, 2024
d6c95d7
update QC annotations
RZ9082 Mar 25, 2024
d100f3f
add README files
RZ9082 Mar 25, 2024
b2e975b
split post-QC sub-WF & create a complete WF
RZ9082 May 10, 2024
5be7fc9
delete old post-QC sub-WF
RZ9082 May 10, 2024
195516d
adding dockstore files
RZ9082 May 10, 2024
dadf707
update mapseq-DB IDs
RZ9082 May 22, 2024
d654a4e
update tests
RZ9082 May 22, 2024
296d58e
add summary tables sub-WF
RZ9082 May 24, 2024
7f9f3d3
update QC tests
RZ9082 May 24, 2024
9868fb0
add annotation and license to summery tables sub-WF
RZ9082 May 24, 2024
f6536bd
added READMEs
RZ9082 May 24, 2024
c135b67
update seqprep in PE sub-WF
RZ9082 May 27, 2024
c4b0880
hide mid-steps, add input parameter for summary table names
RZ9082 May 28, 2024
f684cce
ITSonedb --> ITSoneDB
RZ9082 May 28, 2024
17ef750
added summary-tables-swf to complete wf
RZ9082 May 28, 2024
da27edf
fastq-dump --> fasterq-dump & test updates
RZ9082 May 29, 2024
07c9648
del not used test files
RZ9082 May 29, 2024
d2192a4
add delta values to tests
RZ9082 May 29, 2024
edfe16b
has_n_lines
RZ9082 May 29, 2024
ffb7642
first line in summary tables was missing
RZ9082 Jun 10, 2024
bda2fb7
add mapseq-to-ampvis2 WF
RZ9082 Jun 12, 2024
b63223f
filter empty datasets
RZ9082 Jun 12, 2024
1c4085b
update mapseq-to-ampvis2/.dockstore.yml
RZ9082 Jun 12, 2024
6ad41d9
update QC tests
RZ9082 Jun 14, 2024
57c81df
update ampvis test
RZ9082 Jun 19, 2024
1b4d037
update WF-names & add conditions for col-join, krona, and biom-convert
RZ9082 Jun 26, 2024
85bcec4
del old WFs
RZ9082 Jun 26, 2024
901d05c
adjust ssu summ test
RZ9082 Jun 28, 2024
4bb715b
set fasta width to 60 in PE sub-WF
RZ9082 Jul 29, 2024
0085af6
update PE QC processed fasta test-file
RZ9082 Jul 29, 2024
69a9fe8
Merge branch 'galaxyproject:main' into mgnify_amplicon_pipeline
RZ9082 Sep 26, 2024
05af05a
add zenodo link & remove test files
RZ9082 Sep 27, 2024
aec58c6
move workflows to dedicated folder
RZ9082 Sep 27, 2024
80ace02
add taxonomic rank abundane summary table workflow
RZ9082 Sep 27, 2024
a5ec087
apply review suggestions
RZ9082 Oct 28, 2024
04d9015
add release to WFs
RZ9082 Oct 28, 2024
798153a
add missing quotation mark
RZ9082 Oct 28, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions workflows/amplicon-mgnify/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# MGnify Amplicon Workflow and Add-on-workflows

This directory contains the following workflows:
* **MGnify amplicon workflow v5.0** and its sub-workflows:
* **Quality control for single-end reads**
* **Quality control for paired-end reads**
* **rRNA-prediction**
* **ITS**
* **Summary tables**
13 changes: 13 additions & 0 deletions workflows/amplicon-mgnify/mapseq-to-ampvis2/.dockstore.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
version: 1.2
workflows:
- name: main
subclass: Galaxy
publish: true
primaryDescriptorPath: /mapseq-to-ampvis2.ga
testParameterFiles:
- /mapseq-to-ampvis2-tests.yml
authors:
- name: Rand Zoabi
orcid: 0009-0000-2501-8053
- name: Mara Besemer
url: https://github.com/MaraBesemer
5 changes: 5 additions & 0 deletions workflows/amplicon-mgnify/mapseq-to-ampvis2/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# Changelog

## [0.1] - 07-06-2024

- First release
16 changes: 16 additions & 0 deletions workflows/amplicon-mgnify/mapseq-to-ampvis2/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
# MAPseq to ampvis workflow

The MAPseq to Ampvis workflow processes MAPseq OTU tables and associated metadata for analysis in Ampvis2. This workflow involves reformatting MAPseq output datasets to produce structured output files suitable for Ampvis2.

## Input datasets

- **MAPseq OTU tables** These tables, generated by MAPseq, include sequence counts and taxonomic classifications.
- **Metadata** Contextual information associated with the data from the OTU tables.

## Outputs

- **otu_table** A newly formatted OTU table structured for Ampvis2.
- **tax_table** A taxonomy table containing the taxonomic classifications from the OTU tables.
- **ampvis2** An R object compatible with the Ampvis2 tool for further analysis.
- **metadata_list_out** A structured list of metadata used in the analysis.
- **taxonomy_list_out** A processed taxonomy list ready for integration with Ampvis2.
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
- doc: Test outline for mapseq-to-ampvis2.ga
job:
MAPseq OTU tables:
class: Collection
collection_type: list
elements:
- class: File
identifier: SRR11032273
location: https://zenodo.org/records/13347829/files/SRR11032273.tsv
- class: File
identifier: SRR11032274
location: https://zenodo.org/records/13347829/files/SRR11032274.tsv
- class: File
identifier: SRR11032275
location: https://zenodo.org/records/13347829/files/SRR11032275.tsv
- class: File
identifier: SRR11032276
location: https://zenodo.org/records/13347829/files/SRR11032276.tsv
- class: File
identifier: SRR11032277
location: https://zenodo.org/records/13347829/files/SRR11032277.tsv
- class: File
identifier: SRR11038211
location: https://zenodo.org/records/13347829/files/SRR11038211.tsv
- class: File
identifier: SRR11038212
location: https://zenodo.org/records/13347829/files/SRR11038212.tsv
- class: File
identifier: SRR11038213
location: https://zenodo.org/records/13347829/files/SRR11038213.tsv
- class: File
identifier: SRR11038214
location: https://zenodo.org/records/13347829/files/SRR11038214.tsv
- class: File
identifier: SRR11038215
location: https://zenodo.org/records/13347829/files/SRR11038215.tsv
OTU table metadata:
class: File
location: https://zenodo.org/records/13347829/files/test_metadata_formatted.tabular
outputs:
OTU_table:
location: https://zenodo.org/records/13347829/files/OTU_table.tabular
tax_table:
location: https://zenodo.org/records/13347829/files/tax_table.tabular
ampvis:
asserts:
- that: has_size
value: 15000
delta: 1000
metadata_list_out:
location: https://zenodo.org/records/13347829/files/metadata_list.tabular
taxonomy_list_out:
location: https://zenodo.org/records/13347829/files/taxonomy_list.tabular
Loading
Loading