Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AWS CloudWatch logs exporter should have an option to automatically create log group/stream #4714

Closed
errordeveloper opened this issue Aug 18, 2021 · 12 comments
Assignees
Labels
comp:aws AWS components comp:aws-cw AWS CW related issues exporter/awscloudwatchlogs awscloudwatchlogs exporter Stale

Comments

@errordeveloper
Copy link
Contributor

Is your feature request related to a problem? Please describe.

Currently log exporter relies on having an existing log group and log steam, it would be more convenient if auto-create option was available. Being able to set TTL would be nice also.

Describe the solution you'd like

Add an auto-create option to the exporter config, it would be nice if it was enabled by default.

Describe alternatives you've considered

An alternative requires user to either go to console and click around, or use another tool to automate it. For getting started this seems like extra work one shouldn't have to do. Also, in some cases user might want to generate collector configuration and shouldn't need to worry about CloudWatch setup.

@errordeveloper errordeveloper changed the title AWS CloudWatch logs exporter AWS CloudWatch logs exporter should have an option to automatically create log group/stream Aug 18, 2021
@errordeveloper
Copy link
Contributor Author

xref #4721

@alolita alolita added the comp:aws AWS components label Sep 2, 2021
@MovieStoreGuy
Copy link
Contributor

Being able to create external resources is rather powerful thing, I worry adding something like this could mean that users could spawn too many resources for them to be easily managed, maintained and leading to them being orphaned.

@alolita alolita added the comp:aws-cw AWS CW related issues label Sep 30, 2021
@aateeqi
Copy link
Contributor

aateeqi commented Nov 12, 2021

@alolita could you assign me to this?

@alolita
Copy link
Member

alolita commented Nov 12, 2021

Assigned @aateeqi

@github-actions
Copy link
Contributor

github-actions bot commented Nov 7, 2022

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

@github-actions github-actions bot added the Stale label Nov 7, 2022
@atoulme atoulme added the exporter/awscloudwatchlogs awscloudwatchlogs exporter label Mar 12, 2023
@github-actions
Copy link
Contributor

Pinging code owners for exporter/awscloudwatchlogs: @boostchicken. See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot removed the Stale label Mar 26, 2023
@github-actions
Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the Stale label May 26, 2023
@MovieStoreGuy
Copy link
Contributor

Hey @aateeqi ,

Is this done?

@aateeqi
Copy link
Contributor

aateeqi commented May 26, 2023

@github-actions
Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the Stale label Jul 26, 2023
@bryan-aguilar
Copy link
Contributor

Creating a new log group and setting retention policies is now supported

codeboten pushed a commit that referenced this issue Sep 6, 2023
**Description:** 
Recreate #23820 with updates and fixes
Original PR body
```
Description:
Replaced old example in documentation with a new one. Also clarified some important information for the user, such as the fact that log groups and log streams are created automatically, and that Resource ARNs are not supported. Additionally, updated some descriptions of configs.

Link to tracking Issue: #4714

Testing: N/A

Documentation:

Added a new example in documentation that shows how to configure the Exporter to send EMF Logs
Clarified that log group and log stream are automatically created for user
Stated Resource ARN isn't supported in the Additional Notes section
Updated some descriptions of configs
```

---------

Co-authored-by: Zahid Mirza <zam19@rogers.com>
Co-authored-by: bryan-aguilar <46550959+bryan-aguilar@users.noreply.github.com>
@DzmitryZaitsauIG
Copy link

DzmitryZaitsauIG commented Aug 30, 2024

Looks like there is no possibility create log streams with unique names automatically. They should be preconfigured, and a proper name should be set to a config. Which is rather inconvenient for a Kubernetes setup with multiple dynamic containers.

A related PR adding a possibility to parameterise stream names was never merged: #12179
Related issue for reference: #10887

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp:aws AWS components comp:aws-cw AWS CW related issues exporter/awscloudwatchlogs awscloudwatchlogs exporter Stale
Projects
None yet
Development

No branches or pull requests

7 participants