Crawlers Dashboard & Logging - ActoKids/web-crawler GitHub Wiki

This dashboard and logging will monitor the lambda functions and to make sure that they work as expected without burning through resources.

Lambda function to add to dashboard and logging-

• ad440-w19-lambda-crawler-launchec2
• ad440-w19-lambda-crawler-googlecrawler

How to add to function's metrics to dashboard-

• Click on AWS CloudWatch -> Dashboard -> Create dashboard

• Click on Add widget -> Choose Widget type -> Configure

• Click on All metrics -> Lambda -> By Function Name -> Select all metrics from a function -> Create widget

• Dashboard is ready for both EC2 and Google Calendar

How to add log events to Logging-

• Click on Logs -> Actions -> Create log group -> Enter log name "crawlerlogs" -> Create log group

• Click on crawlerlogs -> Create Log Stream -> Enter name of log stream -> Create Log Stream

Example Log Display