Add ingestion of sdk metrics temporal via Prometheus scraping

[ishleenk17]

Add the ingestion of SDK metrics from Temporal via the Prometheus scraping/
Details: https://github.com/elastic/observability-dev/issues/6015#issue-5144545474

Related Issue: https://github.com/elastic/observability-dev/issues/6049

[github-actions]

✅ Elastic Docs Style Checker (Vale)

No issues found on modified lines!

---

The Vale linter checks documentation changes against the Elastic Docs style guide. To use Vale locally or report issues, refer to Elastic style guide for Vale.

[Copilot]

Pull request overview

This pull request extends the temporal integration to ingest Temporal Worker/SDK Prometheus metrics (in addition to existing Temporal Cloud OpenMetrics) by adding a new sdk_metrics data stream based on the prometheus_input_otel dependency.

Changes:

• Bump the Temporal package version to 0.2.0 and update the package description/policy template to include SDK metrics.
• Add a new sdk_metrics data stream (manifest, fields, and policy rendering tests) for scraping Worker/SDK Prometheus endpoints.
• Update documentation and changelog to describe and track the new SDK metrics capability.

Reviewed changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
packages/temporal/manifest.yml	Bumps package version and adds sdk_metrics to the policy template.
packages/temporal/docs/README.md	Updates user docs to describe Cloud + SDK metrics streams and setup.
packages/temporal/data_stream/sdk_metrics/manifest.yml	Introduces the sdk_metrics stream configuration and variables for scraping Worker endpoints.
packages/temporal/data_stream/sdk_metrics/fields/base-fields.yml	Adds fields metadata for the new metrics data stream.
packages/temporal/data_stream/sdk_metrics/_dev/test/policy/test-http-scrape.yml	Adds policy test coverage for explicit HTTP scraping configuration.
packages/temporal/data_stream/sdk_metrics/_dev/test/policy/test-http-scrape.expected	Expected rendered policy output for HTTP scrape config.
packages/temporal/data_stream/sdk_metrics/_dev/test/policy/test-default.yml	Adds policy test coverage for default stream variables.
packages/temporal/data_stream/sdk_metrics/_dev/test/policy/test-default.expected	Expected rendered policy output for default config.
packages/temporal/changelog.yml	Adds a 0.2.0 changelog entry for the new data stream.
packages/temporal/_dev/build/docs/README.md	Mirrors the user-facing docs update in the built docs location.

---

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

[elastic-vault-github-plugin-prod]

Changelog link mismatch — expected https://github.com/elastic/integrations/pull/20929 in the following file(s):

• packages/temporal/changelog.yml

Tip

If expected, add the changelog-link-check:skip label to skip this check. Or, if an issue link was intended, use .../issues/<n> instead.

View Buildkite build
@ishleenk17

[infra-vault-gh-plugin-prod]

💔 Build Failed

• Buildkite Build
• Commit: 6695c1a

Failed CI Steps

• 📜 Check changelog PR links

History

• 💔 Build #48634 failed 9bd96eb
• 💔 Build #48628 failed 071189e