Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Redpanda chart fails to deploy #3265

Open
mattfysh opened this issue Oct 16, 2024 · 4 comments
Open

Redpanda chart fails to deploy #3265

mattfysh opened this issue Oct 16, 2024 · 4 comments
Labels
area/helm kind/bug Some behavior is incorrect or out of spec

Comments

@mattfysh
Copy link

What happened?

Using the exact same values, redpanda chart fails to deploy via pulumi but succeeds when deployed via Helm directly

Example

https://github.com/mattfysh/redpanda-deploy-bug

Output of pulumi about

CLI
Version 3.136.1
Go Version go1.23.2
Go Compiler gc

Plugins
KIND NAME VERSION
resource kubernetes 4.18.1
language nodejs 3.136.1-dev.0
resource random 4.16.6

Host
OS darwin
Version 14.6.1
Arch arm64

This project is written in nodejs: executable='/opt/homebrew/bin/node' version='v22.9.0'

Current Stack: mattfysh/bug/dev

TYPE URN
pulumi:pulumi:Stack urn:pulumi:dev::bug::pulumi:pulumi:Stack::bug-dev

Additional context

No response

Contributing

Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

@mattfysh
Copy link
Author

Feel free to close this issue if you're unable to recreate. I suspect this is localized to k8s running in Orbstack on mac

@rquitales rquitales added the awaiting-feedback Blocked on input from the author label Oct 22, 2024
@rquitales
Copy link
Member

@mattfysh would you also be able to provide the error message you obtained from the pulumi up operation? In the future, it'd be extremely helpful if you could also provide the error messages. Thanks!

@rquitales rquitales removed the needs-triage Needs attention from the triage team label Oct 22, 2024
@mattfysh
Copy link
Author

hi @rquitales - apologies, there is no error message as the chart deployment hangs. more details here: redpanda-data/helm-charts#1564

When the deployment is stuck, the pods look like this:

redpanda-0                          0/2     Init:2/3   0             1s

The redpanda team found what was causing the issue (insufficient memory limit on the 3rd init container) - so it seems to be an issue with orbstack not managing resources: orbstack/orbstack#1520

However, the reason I opened an issue here is because it was almost always happening when trying to deploy the k8s.helm.v3.Release via the Pulumi CLI. If I deployed the exact same chart with exact same values via the Helm CLI, it would typically deploy without hanging

Reproduction repo is here: https://github.com/mattfysh/redpanda-deploy-bug/tree/main/helm

@pulumi-bot pulumi-bot added needs-triage Needs attention from the triage team and removed awaiting-feedback Blocked on input from the author labels Oct 23, 2024
@rquitales
Copy link
Member

Thanks for the additional information here, and the linked issue. When I attempted to repro this issue (using KinD and Docker), I hit another issue related to tsx/compilation, hence why I wanted to see what error you're facing. I believe @blampe was actually able to repro the same error you mentioned on Orbstack. We'll need to investigate this further to see why Helm CLI works as expected so I'll keep this ticket open.

@rquitales rquitales removed the needs-triage Needs attention from the triage team label Oct 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/helm kind/bug Some behavior is incorrect or out of spec
Projects
None yet
Development

No branches or pull requests

4 participants