2021 08 21 (Saturday) Deployment - ustaxcourt/ef-cms GitHub Wiki
General Notes
This deployment includes several bugfixes and batch 6.
Due to the high amount of code changes, we will be performing this deployment after hours and on the weekend. It has been tested in mig and test environments.
Timeline
- 22:00 - ran account specific
Terraform will perform the following actions:
# aws_iam_role_policy.migration_segments_policy will be updated in-place
~ resource "aws_iam_role_policy" "migration_segments_policy" {
id = "migration_segments_role_prod:migration_segments_policy_prod"
name = "migration_segments_policy_prod"
~ policy = jsonencode(
~ {
~ Statement = [
# (2 unchanged elements hidden)
{
Action = [
"sqs:DeleteMessage",
"sqs:SendMessage",
"sqs:SendMessageBatch",
"sqs:ReceiveMessage",
"sqs:GetQueueAttributes",
]
Effect = "Allow"
Resource = "arn:aws:sqs:us-east-1:980423577122:*"
},
+ {
+ Action = [
+ "s3:GetObject",
+ "s3:PutObject",
]
+ Effect = "Allow"
+ Resource = [
+ "arn:aws:s3:::dawson.ustaxcourt.gov-documents-*",
]
},
]
# (1 unchanged element hidden)
}
)
# (1 unchanged attribute hidden)
}
- 22:05 -Β made the Pull Request
- 22:10 - Ensured that destination table is deleted (
efcms-prod-alpha) - 22:12 - merged PR β ; CircleCI build
- 22:14 - while tests were running, to ensure we had a clean slate and because I had not the previous time, I destroyed the migration infrastructure:
npm run destroy:migration -- ${ENV} - 22:15 - observed a new requirement for
var.documents_bucket_name, and useddawson.ustaxcourt.gov-documents-prod-us-east-1 - 22:21 - completed the destruction of migration infrastructure
Destroy complete! Resources: 7 destroyed. - 22:24 - tests pass β
- 22:46 - observed setup of migration worked! β
π
migrate:truedestination-table-version:alphasource-table-version:beta
- 22:57 - Migration kicked off β
- 23:16 - Created a PR for removing migrations that have been run on every Court environment.
- 23:56 - migration finished; β indexing begins π
- 01:00 - migration rolling along
βββββββββββ¬ββββββββββββββββββββββββ¬βββββββββββββ¬ββββββββββββ¬ββββββββββ
β (index) β indexName β countAlpha β countBeta β diff β
βββββββββββΌββββββββββββββββββββββββΌβββββββββββββΌββββββββββββΌββββββββββ€
β 0 β 'efcms-case' β 1450636 β 1992576 β 541940 β
β 1 β 'efcms-case-deadline' β 3102 β 16468 β 13366 β
β 2 β 'efcms-docket-entry' β 13907091 β 18270116 β 4363025 β
β 3 β 'efcms-message' β 56535 β 300626 β 244091 β
β 4 β 'efcms-user' β 927765 β 2004226 β 1076461 β
β 5 β 'efcms-user-case' β 1040375 β 1981774 β 941399 β
β 6 β 'efcms-work-item' β 395824 β 767286 β 371462 β
βββββββββββ΄ββββββββββββββββββββββββ΄βββββββββββββ΄ββββββββββββ΄ββββββββββ
Total Difference: -7551744 (17781328/25333072) 70.19%
- 01:45 - clusters quieted, testing looks good, switched colors
Comparison between ES Clusters (Alpha was destination; Beta was source)
βββββββββββ¬ββββββββββββββββββββββββ¬βββββββββββββ¬ββββββββββββ¬βββββββ
β (index) β indexName β countAlpha β countBeta β diff β
βββββββββββΌββββββββββββββββββββββββΌβββββββββββββΌββββββββββββΌβββββββ€
β 0 β 'efcms-case' β 1992576 β 1992576 β 0 β
β 1 β 'efcms-case-deadline' β 16468 β 16468 β 0 β
β 2 β 'efcms-docket-entry' β 18270116 β 18270116 β 0 β
β 3 β 'efcms-message' β 300626 β 300626 β 0 β
β 4 β 'efcms-user' β 2004226 β 2004226 β 0 β
β 5 β 'efcms-user-case' β 1981774 β 1981774 β 0 β
β 6 β 'efcms-work-item' β 767286 β 767286 β 0 β
βββββββββββ΄ββββββββββββββββββββββββ΄βββββββββββββ΄ββββββββββββ΄βββββββ
Batch 6 in the books
