Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KPOps 3.0 #420

Merged
merged 38 commits into from
Jan 17, 2024
Merged

KPOps 3.0 #420

merged 38 commits into from
Jan 17, 2024

Conversation

disrupted
Copy link
Member

No description provided.

disrupted and others added 30 commits September 13, 2023 17:52
fixes #373

> I am getting this error when I try to use dry-run:
subprocess.CalledProcessError: Command '['helm', 'get', 'manifest',
'account-producer', '--namespace', 'my-namespace']' returned non-zero
exit status 1. why? does he launch it first in dry-run ? when I do that
in my commandline I get
To learn more, consult
https://cloud.google.com/blog/products/containers-kubernetes/kubectl-auth-changes-in-gke
Error: release: not found

The [problem came
from](2.0.9...2.0.10#diff-1ca7465daf9238dfe221304df636d96704ebf4935288b854a5c4c6b3ea9e3162R215)
setting `subproces.run(..., check = True)` without handling the raised
exception.

I took some imports out of `TYPE_CHECKING` blocks to avoid problems with
`pydantic` as it uses type hints at runtime

Updated to the latest (`0.1.1`) version. Now all fixes deemed unsafe
will not be automatically carried out even if it is possible to do so.
The user can choose to enable the unsafe autofixes with the
`--unsafe-fixes` flag

While testing I noticed that we could use the namespace env var in some
places in the example, so I did it and had to adjust the tests.
closes #341

---------

Co-authored-by: Salomon Popp <salomon.popp@bakdata.com>
closes #153

---------

Co-authored-by: Salomon Popp <salomon.popp@bakdata.com>
Co-authored-by: Salomon Popp <salomon.popp@bakdata.com>
for added convenience, ability to set pipeline base dir and components
module globally for the project. therefore it won't be necessary to
specify these with each invocation
will be used for automatic schema generation (editor integration)
Fixes #327 

Remove previous workaround for setting Helm app `nameOverride` in favor
of a more robust implementation in `HelmApp`
- Mark component type property as computed Pydantic field
- Remove hack
`template` renamed to ~~`render`~~ `manifest` as it's no longer strictly
tied to Helm template, can be used to render final resources of any
pipeline component, e.g. Kubernetes manifest
Extract `kpops generate --template` into separate ~~`kpops render`~~
`kpops manifest` command
Return Kubernetes manifest as mapping for use with Python API

Closes #103

---------

Co-authored-by: Ivan Yordanov <i.p.yordanov@proton.me>
sujuka99 and others added 8 commits January 11, 2024 18:14
Preceeds #398

---------

Co-authored-by: Salomon Popp <salomon.popp@bakdata.com>
Depends on #397 

extracted the cleanup job needed for streams-bootstrap producer and
streams apps to its own HelmApp nested inside the parent component

- [x] Create docs for `StreamsBootstrap` base
- [x] Update KPOps component inheritance graph
- [x] Update docs gen for multiple component inheritance (#406)
@disrupted disrupted merged commit dbf82c4 into main Jan 17, 2024
7 of 8 checks passed
@disrupted disrupted deleted the v3 branch January 17, 2024 12:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants