Muting Alerts - CDCgov/prime-simplereport GitHub Wiki

Depending on external systems means that we can run into a host of problems that occur, none of which are solvable by our team. If that happens, it's okay! The alarm that keeps going off on your phone, however, seems to insistently indicate otherwise.

Before you throw your phone off a building, know that there is hope!

If you need to mute a troublesome alert, simply follow the steps below. Remember, muting alerts takes place in Microsoft Azure, not in PagerDuty. You will need to be logged into Azure with an operational SU account to perform this procedure.

1. Run a search in the top bar for prime-simple-report-<env>-insights, replacing <env> with the short code for your environment. You're looking for an "Application Insights" object.
2. On the left menu, under "Monitoring", click the blade for "Alerts". This will pull up a table of all recently-fired alerts.
3. From there, click "Alert rules" at the top of the screen.
4. You can then select the alerts you don't want firing, and click "Disable". That should shut them up until you manually re-enable them, or someone pushes to the environment in question.

If you're unsure what alert is causing the trouble, consult your PagerDuty app or email for reference. It should give you enough detail in the title and description to make a proper cross-reference.

Now, go relax!