Skip to content

[GCP] Improve metadata collectors caching #43959

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
gpop63 opened this issue Apr 16, 2025 · 0 comments
Open

[GCP] Improve metadata collectors caching #43959

gpop63 opened this issue Apr 16, 2025 · 0 comments
Assignees
Labels
enhancement Team:Obs-InfraObs Label for the Observability Infrastructure Monitoring team

Comments

@gpop63
Copy link
Contributor

gpop63 commented Apr 16, 2025

NewMetadataService is executed based on the period set in the config e.g. 1m, so the in memory maps we're using for caching aren't actually helping, we're still fetching fresh data every time.

We need proper caching for all metadata collectors:

  • compute
  • cloudsql
  • redis
  • dataproc (once it's merged)

It could be made configurable to be refreshed every hour/12h/day etc.

@gpop63 gpop63 added enhancement Team:Obs-InfraObs Label for the Observability Infrastructure Monitoring team labels Apr 16, 2025
@gpop63 gpop63 self-assigned this Apr 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Team:Obs-InfraObs Label for the Observability Infrastructure Monitoring team
Projects
None yet
Development

No branches or pull requests

1 participant