Add custom dataset capability to torch trainer #242
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
schobbejak
deleted the
172-enh-add-custom-dataset-input-into-torch-trainer
branch
schobbejak
added a commit
that referenced
this pull request
Dec 3, 2024
* Bump actions/github-script from 6 to 7 Bumps [actions/github-script](https://github.com/actions/github-script) from 6 to 7. - [Release notes](https://github.com/actions/github-script/releases) - [Commits](actions/github-script@v6...v7) --- updated-dependencies: - dependency-name: actions/github-script dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Bump actions/setup-node from 3 to 4 Bumps [actions/setup-node](https://github.com/actions/setup-node) from 3 to 4. - [Release notes](https://github.com/actions/setup-node/releases) - [Commits](actions/setup-node@v3...v4) --- updated-dependencies: - dependency-name: actions/setup-node dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Bump actions/checkout from 2 to 4 Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](actions/checkout@v2...v4) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Bump actions/setup-python from 3 to 5 Bumps [actions/setup-python](https://github.com/actions/setup-python) from 3 to 5. - [Release notes](https://github.com/actions/setup-python/releases) - [Commits](actions/setup-python@v3...v5) --- updated-dependencies: - dependency-name: actions/setup-python dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Bump eifinger/setup-rye from 3.0.2 to 4.2.1 Bumps [eifinger/setup-rye](https://github.com/eifinger/setup-rye) from 3.0.2 to 4.2.1. - [Release notes](https://github.com/eifinger/setup-rye/releases) - [Commits](eifinger/setup-rye@v3.0.2...v4.2.1) --- updated-dependencies: - dependency-name: eifinger/setup-rye dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Bump the python-packages group across 1 directory with 7 updates Updates the requirements on [torch](https://github.com/pytorch/pytorch), [numpy](https://github.com/numpy/numpy), [sphinx](https://github.com/sphinx-doc/sphinx), [sphinx-autodoc-typehints](https://github.com/tox-dev/sphinx-autodoc-typehints), [sphinxawesome-theme](https://github.com/kai687/sphinxawesome-theme), [myst-parser](https://github.com/executablebooks/MyST-Parser) and [pygit2](https://github.com/libgit2/pygit2) to permit the latest version. Updates `torch` from 2.2.2 to 2.4.0 - [Release notes](https://github.com/pytorch/pytorch/releases) - [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md) - [Commits](pytorch/pytorch@v2.2.2...v2.4.0) Updates `numpy` to 2.0.1 - [Release notes](https://github.com/numpy/numpy/releases) - [Changelog](https://github.com/numpy/numpy/blob/main/doc/RELEASE_WALKTHROUGH.rst) - [Commits](numpy/numpy@v1.22.4...v2.0.1) Updates `sphinx` from 7.2.6 to 8.0.2 - [Release notes](https://github.com/sphinx-doc/sphinx/releases) - [Changelog](https://github.com/sphinx-doc/sphinx/blob/v8.0.2/CHANGES.rst) - [Commits](sphinx-doc/sphinx@v7.2.6...v8.0.2) Updates `sphinx-autodoc-typehints` from 2.0.0 to 2.2.3 - [Release notes](https://github.com/tox-dev/sphinx-autodoc-typehints/releases) - [Changelog](https://github.com/tox-dev/sphinx-autodoc-typehints/blob/main/CHANGELOG.md) - [Commits](tox-dev/sphinx-autodoc-typehints@2.0.0...2.2.3) Updates `sphinxawesome-theme` from 5.1.3 to 5.2.0 - [Release notes](https://github.com/kai687/sphinxawesome-theme/releases) - [Commits](kai687/sphinxawesome-theme@5.1.3...5.2.0) Updates `myst-parser` from 2.0.0 to 3.0.1 - [Release notes](https://github.com/executablebooks/MyST-Parser/releases) - [Changelog](https://github.com/executablebooks/MyST-Parser/blob/master/CHANGELOG.md) - [Commits](executablebooks/MyST-Parser@v2.0.0...v3.0.1) Updates `pygit2` from 1.14.1 to 1.15.1 - [Changelog](https://github.com/libgit2/pygit2/blob/master/CHANGELOG.md) - [Commits](libgit2/pygit2@v1.14.1...v1.15.1) --- updated-dependencies: - dependency-name: torch dependency-type: direct:production update-type: version-update:semver-minor dependency-group: python-packages - dependency-name: numpy dependency-type: direct:production dependency-group: python-packages - dependency-name: sphinx dependency-type: direct:production update-type: version-update:semver-major dependency-group: python-packages - dependency-name: sphinx-autodoc-typehints dependency-type: direct:production update-type: version-update:semver-minor dependency-group: python-packages - dependency-name: sphinxawesome-theme dependency-type: direct:production update-type: version-update:semver-minor dependency-group: python-packages - dependency-name: myst-parser dependency-type: direct:production update-type: version-update:semver-major dependency-group: python-packages - dependency-name: pygit2 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: python-packages ... Signed-off-by: dependabot[bot] <support@github.com> * Update CODEOWNERS * Fix pre-commit * Unprivatize functions * Add dataset that can take a training pipeline (#236) * Add DataRetrieval, Data and PipelineDataset classes * Add tests and update enum * Add tests for Data & DataRetrieval * Finish testing PipelineDataset * Turn TrainingPipeline into dataclass * Add dataclass to Logger * Add mixed precision to torch trainer (#237) * Add mixed precision to torch trainer * Add tests for batch_to_device * Add tests for torch trainer * Remove numpy as an optional dependency (#238) * Add new action and update dependabot (#240) * Add Conv1dBnRelu block (#241) * Add Conv1dBnRelu block * Improve test coverage and fix spelling mistake for Conv1dBnRelu * Add custom dataset capability to torch trainer (#242) * Update log message for inference on loader (#243) * Reduce cyclomatic complexity of caching (#244) * Refactor _get_cache to reduce cyclomatic complexity * Refactor store cache * Fix errors with cacher * Remove unused arguments and fix typing --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.