Red Hat Kibana logs cheat sheet - cloudigrade/cloudigrade GitHub Wiki

CI and QA environments

• Kibana lives at https://logs.insights-dev.openshift.com/app/kibana#/discover
• Kibana captures all of the pods' consoles output
• choose cloudigrade-qa or cloudigrade-ci from the project index filter first

stage and prod environments

• stage Kibana lives at https://kibana.apps.crcs02ue1.urby.p1.openshiftapps.com/app/kibana#/discover
• prod Kibana lives at https://kibana.apps.crcp01ue1.o9m8.p1.openshiftapps.com/app/kibana#/discover
• Kibana only has messages from the configured Python logger, not all of the pods' consoles
• There is no standard per-project index filter, AFAICT. Instead, add to all of your KQL queries either @log_stream:"cloudigrade-stage" or @log_stream:"cloudigrade-prod" as needed.

Example queries for stage/prod Kibana

Example KQL for the Kibana "Discover" UI

@log_stream:"cloudigrade-prod" AND @message:"Received task: api.tasks.persist_inspection_cluster_results_task"

Example query syntax for the "Dev Tools" (ElasticSearch proxy)

GET _search
{
  "from": 0,
  "size": 4,
  "query": {
    "bool": {
      "filter": [
        {
          "match_phrase": {
            "@log_stream": "cloudigrade-stage"
          }
        },
        {
          "match_phrase": {
            "@message": "api.clouds.aws.tasks.scale_up_inspection_cluster"
          }
        },
        {
          "range": {
            "@timestamp": {
              "format": "strict_date_optional_time",
              "lte": "2020-11-30T18:05:07.356Z",
              "gte": "2020-11-30T17:05:07.356Z"
            }
          }
        }
      ]
    }
  }
}