2.2 Datadog Log Management - duttdev489/Datadog GitHub Wiki

Datadog Log Management

  • allows you to cost-effectively collect, process, *archive, explore, and monitor all your logs without limitations.

When you use Datadog Log Management:

  1. You can collect logs from various sources, such as hosts, containers, and cloud providers.
  2. Once the logs are ingested, you can enhance them using pipelines and processors, create metrics from the logs, and manage storage-optimized archives with Log Configuration options.
  3. You can connect logs to metrics and traces from other sources for greater insights.
  4. Finally, you can search, filter, and query the ingested logs in the Log Explorer.

Log Explorer

The Log Explorer is your central hub for investigating and exploring logs. You can browse logs, search for specific words, filter many log lines to show only the lines you’re interested in, group content, visualize patterns, and export logs.

A search query in Log Explorer is composed of terms (either a single word or a group of words surrounded by double quotes) and Boolean operators. You can also filter logs using log facets, which are user-defined tags and attributes from your indexed logs, which are logs that have been collected, processed, and retained for analysis, alerting, and troubleshooting.

Logs can be valuable as individual events, but sometimes valuable information lives in a subset of events. In order to get this information, you can group your logs into fields, patterns, and transactions.

To better visualize the results of the filtered and aggregated logs, you can choose different visualizations to surface crucial information. For example, you can arrange your log data into columns by viewing them as a list, or track changes in your log data over time by observing them in a timeseries. Other visualizations include top list, nested tables, pie charts, and a tree map.

Lastly, you can export your log exploration as a saved view, Dashboard widget, monitor, metric, and more!

Log Explorer Facet, Log Side panel. service:store-discounts @filename:discounts.py search using text pattern : "Total advertisements available"

Field aggregations

With field aggregation, all logs matching the query filter are split into groups (that is, aggregated) based on the different values of a specified log facet. Aggregating or grouping logs this way can help you see trends more clearly and visualize relationships between different types of log facets.