Skip to content

[zeek] Fix smtp Date header parsing and event.created robustness - #20903

Open
mjwolf wants to merge 1 commit into
elastic:mainfrom
mjwolf:zeek_smtp_date_format
Open

[zeek] Fix smtp Date header parsing and event.created robustness#20903
mjwolf wants to merge 1 commit into
elastic:mainfrom
mjwolf:zeek_smtp_date_format

Conversation

@mjwolf

@mjwolf mjwolf commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Proposed commit message

Expand the zeek.smtp date processor to handle a wider range of email Date header formats (RFC 5322 with/without weekday, date(1) 12h/24h, obs-zone comments like "(CET)") and drop the field silently on failure instead of failing the whole document. Adds three normalization processors before parsing: strip trailing obs-zone comment, collapse multiple spaces, and trim whitespace.

Add ignore_empty_value: true to the event.created set processor across all 43 zeek data streams so that _simulate usage without a pre-existing @timestamp does not raise a missing-field error.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices

Related issues

Expand the zeek.smtp date processor to handle a wider range of email
Date header formats (RFC 5322 with/without weekday, date(1) 12h/24h,
obs-zone comments like "(CET)") and drop the field silently on failure
instead of failing the whole document. Adds three normalization
processors before parsing: strip trailing obs-zone comment, collapse
multiple spaces, and trim whitespace.

Add ignore_empty_value: true to the event.created set processor across
all 43 zeek data streams so that _simulate usage without a pre-existing
@timestamp does not raise a missing-field error.

Fixes: elastic#17332

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@mjwolf mjwolf self-assigned this Aug 25, 2026
@mjwolf
mjwolf requested a review from a team as a code owner August 25, 2026 21:37
@mjwolf mjwolf added Integration:zeek Zeek bugfix Pull request that fixes a bug issue Team:Integration-Experience Security Integrations Integration Experience [elastic/integration-experience] labels Aug 25, 2026
@infra-vault-gh-plugin-prod

Copy link
Copy Markdown

Pinging @elastic/integration-experience (Team:Integration-Experience)

@github-actions

Copy link
Copy Markdown
Contributor

✅ Elastic Docs Style Checker (Vale)

No issues found on modified lines!


The Vale linter checks documentation changes against the Elastic Docs style guide. To use Vale locally or report issues, refer to Elastic style guide for Vale.

@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

Changelog link mismatch — expected https://github.com/elastic/integrations/pull/20903 in the following file(s):

  • packages/zeek/changelog.yml

Tip

If expected, add the changelog-link-check:skip label to skip this check. Or, if an issue link was intended, use .../issues/<n> instead.

View Buildkite build
@mjwolf

@infra-vault-gh-plugin-prod

infra-vault-gh-plugin-prod Bot commented Aug 25, 2026

Copy link
Copy Markdown

💔 Build Failed

Failed CI Steps

History

cc @mjwolf

changes:
- description: Parse a wider range of SMTP Date header formats; drop the field silently instead of failing the document when a header is unparseable.
type: bugfix
link: https://github.com/elastic/integrations/pull/17332

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Severity: 🟡 Medium confidence: high path: packages/zeek/changelog.yml:6

Changelog links a different PR number

Details

The changelog entries added on lines 6, 9 point at pull/17332 (line 6), pull/17332 (line 9), but they were added in PR #​20903. They are likely leftover template placeholders or copies from another PR.

Recommendation:

Point each added changelog entry's link at this PR:

link: https://github.com/elastic/integrations/pull/20903

🤖 AI-Generated Review | Vera Review Bot - v0.2.7 | 📚 Knowledge base: integration-skills

⚠️ Automated review — verify suggestions before applying.

@vera-review-bot

Copy link
Copy Markdown

Review summary

Issues found across the latest commits 32ba8dd — 1 medium
  • 🟡 Changelog links a different PR number (link) (Unresolved)

A new commit triggers another review — at most once every 15 minutes. I skip the PR while it's approved or has merge conflicts.

🤖 AI-Generated Review | Vera Review Bot - v0.2.7 | 📚 Knowledge base: integration-skills

⚠️ Automated review — verify suggestions before applying.

@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugfix Pull request that fixes a bug issue Integration:zeek Zeek Team:Integration-Experience Security Integrations Integration Experience [elastic/integration-experience]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Zeek] Fix zeek.smtp ingest pipeline processor order and missing date formats

1 participant