Development Log - Samariya57/leetcode_score_monitoring GitHub Wiki
On Fridays, I will devote at least a half hour to reflect on the work I've done over the previous week.
Date Log of what you've done during the week (can be a bulleted list or as detailed as you want).
Week 1 - Dec, 14th 2018
Accomplishment:
- Created the Scraping Script to crawl the following data
Obstacles:
- There are multiple html templates for the user's LeetCode profile. One with contest information (with a chart) and one with out. So I updated the code to handle both possible templates.
Week 2 - Dec, 21st 2018
Accomplishment:
- Created database Schema
Week 3 - Dec, 28th 2018
Accomplishment:
- Created airflow scheduler
More details can be found in the Trello Board
Week 4 - Jan, 11th 2018
Accomplishment:
- Set up PostreSQL as the main database for both application and airflow
More details can be found in the Trello Board
Week 5 - Jan, 18th 2018
Accomplishment:
- Set up Dash webapp and tested the application and deployed into AWS
More details can be found in the Trello Board