Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Lumen Monitor example #335

Open
jbednar opened this issue Nov 6, 2023 · 2 comments
Open

Add Lumen Monitor example #335

jbednar opened this issue Nov 6, 2023 · 2 comments
Assignees
Labels
new_project Projects to add

Comments

@jbednar
Copy link
Contributor

jbednar commented Nov 6, 2023

The examples collected in this repo are currently deployed on an Anaconda Enterprise cluster that manages deployments, and we have an internal application based on Lumen that can monitor those deployments and the nodes they are running on to see usage patterns, memory leaks, memory requirements, etc. It would be great to add that Lumen app here as an example of using Lumen to do such monitoring, since most of what it does is independent of AE5 and valid as an illustration of monitoring separate deployments in general.
image

@maximlt
Copy link
Contributor

maximlt commented Nov 7, 2023

Yes that's good idea.

Although there's a limitation in that this project needs to declare some secrets as environment variables (e.g. AE5_PASSWORD) but we have no way yet to set Github environment variables and pass them to anaconda-project, either for testing/building the project or deploying to AE5. For sure we could inject environment variables set in Github into an anaconda-project file (e.g. relying on a naming scheme to find them like EXAMPLES__<PROJNAME>__<VARNAME>), this needs some infrastructure development.

I also wonder how we will demonstrate this example from a notebook. Maybe using Lumen's Python API to incrementally build the monitor dashboard, to finally spit out the YAML spec.

If there's a goal of adding any kind of Lumen example to the gallery, there are certainly easier examples. But I also like the idea of having the Monitor as an example, that can be tested, built and deployed from this Github repo.

@maximlt maximlt added the new_project Projects to add label Nov 7, 2023
@jbednar
Copy link
Contributor Author

jbednar commented Nov 7, 2023

I'm not sure how to handle the secrets, but it's worth having an answer to that, since projects like this do often need secrets. I don't think we have to demonstrate the example from a notebook, as we can simply add a notebook that documents the app and explains it. It doesn't have to be runnable within the notebook itself, as there will be a link to the running app.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new_project Projects to add
Projects
None yet
Development

No branches or pull requests

2 participants