Datadog Observability Pipelines
Collect, transform & route data anywhere
Control costs, improve visibility
• Cost-effectively ingest and process all of your logs with flexibility to route noisy data to low-cost storage and rehydrate data as needed.
• Reduce your total data volumes through rule-based sampling and aggregation without losing access to mission-critical KPIs and trends.
• Impose rule-based throttles and reactive routing strategies for spike protection.
Simplify migrations, reduce lock-in
• Orchestrate and monitor data delivery from any source to any destination, including on-prem locations.
• Adopt new technologies at your own pace without vendor lock-in.
• Automatically parse, enrich, and map data to the right schema.
Protect sensitive data
• Redact sensitive data before it leaves your infrastructure.
• Stay compliant with residency laws with full control over data routing.
• Centralized and multi-region deployments give you flexibility to choose the right strategy for your sensitive data.
Enforce data quality
• Format, transform, and enrich all observability data using built-in processors to get more insights out of your existing systems.
• Adopt schemas to enforce consistent data quality and improve investigation and resolution times.
• Manage and preserve data quality when changes are made with type-safe transforms.
Monitor and manage pipelines through a single control plane
• Understand the health, bottleneck, and performance of all your pipelines deployed in your infrastructure.
• Build or edit pipeline configurations in an easy-to-use, point-and-click UI.
• Easily update and deploy all or a specific subset of your pipeline instances by remotely deploying from the UI.