Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamic selection of log_group_name and log_stream_name in aws cloudwatch logs exporter #31382

Open
sorobon opened this issue Feb 22, 2024 · 9 comments
Labels
enhancement New feature or request exporter/awscloudwatchlogs awscloudwatchlogs exporter needs triage New item requiring triage

Comments

@sorobon
Copy link

sorobon commented Feb 22, 2024

Component(s)

exporter/awscloudwatchlogs

Is your feature request related to a problem? Please describe.

Duplicate with #14554
We are running the opentelemetry collector to send logs from our edge systems to a central opentelemetry gateway service. From the gateway we'd like to write logs to cloudwatch logs in different log groups and streams based on log resources.

Describe the solution you'd like

We'd like to be able to set the log_group_name and log_stream_name dynamically based on fields from the log event:

awscloudwatchlogs:
    log_group_name: "{log_file_name}"
    log_stream_name: "{resource.hostname}"

Describe alternatives you've considered

No response

Additional context

No response

@sorobon sorobon added enhancement New feature or request needs triage New item requiring triage labels Feb 22, 2024
@github-actions github-actions bot added the exporter/awscloudwatchlogs awscloudwatchlogs exporter label Feb 22, 2024
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the Stale label Apr 23, 2024
@sorobon
Copy link
Author

sorobon commented Apr 25, 2024

Any update?

@github-actions github-actions bot removed the Stale label Apr 26, 2024
@abhishekmahajan0709222
Copy link

Any update, we are also looking for same feature

@bpalermo
Copy link

Duplicate #30773?

Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@using-system
Copy link

Same here !
We needs for this features because we want to have on collector for mulitple app and each app has his own log group name !

@using-system
Copy link

using-system commented Aug 7, 2024

Any update ? @boostchicken @bryan-aguilar @rapphil

@warsiafaz
Copy link

Any update we are also looking for same solution . At least log streams should be dynamic .
Fluent bit provides that solution , but for awscloudwatchlogexporter log_stream is a requirement and not dynamic .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request exporter/awscloudwatchlogs awscloudwatchlogs exporter needs triage New item requiring triage
Projects
None yet
Development

No branches or pull requests

5 participants