Datadog Data Streams Monitoring
Real-time monitoring of data streams
Detect slowdowns anywhere in your event-driven applications
- Measure latency between any two points throughout your pipeline, including queues, producers, and consumers.
- Easily identify delayed messages by viewing actionable lag metrics both in seconds and offset.
- Quickly detect abnormal latency or throughput across your streaming data pipelines by creating threshold, anomaly, and outlier monitors.
Localize and resolve pipeline bottlenecks and failures
- Easily detect failing dependencies between queues, producers, and consumers with automatic, end-to-end pipeline topology mapping.
- Triage whether delays are originating from issues with application services or queueing systems, and identify the owning team.
- Prioritize troubleshooting efforts by impact of delay, with message backup volumes for services and queues.
Remediate floods of backed-up messages
- Quickly detect and resolve downstream bottlenecks to prevent long lags, message downtime, and delayed messages.
- Spot where bursts in message flow may be occurring upstream with automated consumer lag notifications for every service.
- Visually track the flow of messages across all dependent services and queues to ensure you constantly meet your SLAs.
Correlate streaming data pipeline metrics with all telemetry in context
- Resolve application issues faster by seamlessly pivoting between DSM metrics, distributed traces, infrastructure metrics, and logs.
- Gain complete pipeline visibility by adding latency and throughput metrics to your Kafka or RabbitMQ integration dashboards.
- Streamline incident response with quick access to service owners, on-call engineers, and critical resources via Service Catalog.