Datadog Integration
Overview
OpsWorker integrates with Datadog as an alert source. Datadog monitors send alerts to OpsWorker via webhook, and OpsWorker investigates the underlying Kubernetes issue using its standard agent toolchain.
OpsWorker does not currently query Datadog metrics or APM data directly during investigations. For metric and log queries during investigation, use the Grafana MCP integration — it covers PromQL, LogQL, and Grafana dashboards, including dashboards backed by Datadog datasources if you've configured them in Grafana.
Webhook Setup
1. Create a Webhook in Datadog
- In Datadog, go to Integrations → Webhooks
- Click New Webhook
- Name:
opsworker - URL: Your OpsWorker webhook URL (from the portal → Integrations → select the cluster → Datadog)
- Leave payload as default
- Click Save
2. Add to Monitors
Add @webhook-opsworker to the notification text of monitors you want OpsWorker to investigate. Example:
@webhook-opsworker
The {{check_type.name}} check has been triggered for {{host.name}}.
You can route only specific monitors to OpsWorker (recommended) or route everything (high alert volume — combine with alert rules to filter what triggers investigations).
3. Verify
Trigger a test alert from a configured monitor. Check the OpsWorker portal under Alerts for the incoming signal. If the alert matches an alert rule with auto-investigation enabled, an investigation starts within seconds.
Supported Monitor Types
| Monitor Type | OpsWorker Receives | Investigation Quality |
|---|---|---|
| Metric | Yes | Good — alert name and tags map cleanly to Kubernetes resources |
| APM | Yes | Good when traces include kube_* tags |
| Log | Yes | Good for error-rate and pattern detection alerts |
| Process | Yes | Limited — process monitors often lack namespace/pod context |
| Composite | Yes | Quality depends on the underlying monitors |
Investigation works best when Datadog tags include the Kubernetes context — kube_namespace, pod_name, deployment — so OpsWorker can map the alert directly to a resource topology.
Next Steps
- Datadog Alerts Setup Guide — Detailed step-by-step
- Grafana MCP — Add metric and log querying to investigations
- Alert Rules — Control which Datadog alerts trigger investigations