Releases: vincentclaes/datajob
Releases · vincentclaes/datajob
0.11.0
0.10.1
https://github.com/vincentclaes/datajob/milestone/8?closed=1
release notes:
- bugfix updating workflow
0.10.0
https://github.com/vincentclaes/datajob/milestone/7?closed=1
release notes:
- add support for sagemaker
- add examples for sagemaker
- improve stepfunctions build of workflow
0.9.0
https://github.com/vincentclaes/datajob/milestone/6?closed=1
release notes:
- upgrade step functions version
- use was cdk stepfunctions to include the workflow instead of using cloudformation-include
0.8.0
https://github.com/vincentclaes/datajob/milestone/5?closed=1
release notes:
- construct more complex pipelines. Handle parallel pipelines better
- implement notification on error/succes
- update cdk libs
0.7.0
https://github.com/vincentclaes/datajob/milestone/4?closed=1
release notes:
- orchestrate 1 job with
task1 >> ...
- add pyspark example
- fix some bugs related to steps to follow in readme
- update readme
0.6.1
https://github.com/vincentclaes/datajob/milestone/3?closed=1
release notes:
- better handling of AWS region for stepfunctions workflow
- fix stage values that can be set via cli, on init of datajob stack or none at all
- update readme
0.6.0
https://github.com/vincentclaes/datajob/milestone/2?closed=1
release notes:
- add --package poetry / --package setuppy so that we can specify what tool to use to package the code
- shell out commands more securely
0.5.0
milestones: https://github.com/vincentclaes/datajob/milestone/1?closed=1
- use python 3.6
- make stage optional
- easy access data bucket
0.4.0
make it work on python 3.6