Development Log - Samariya57/leetcode_score_monitoring GitHub Wiki

On Fridays, I will devote at least a half hour to reflect on the work I've done over the previous week.

Date Log of what you've done during the week (can be a bulleted list or as detailed as you want).


Week 1 - Dec, 14th 2018

Accomplishment:

  • Created the Scraping Script to crawl the following data

Obstacles:

  • There are multiple html templates for the user's LeetCode profile. One with contest information (with a chart) and one with out. So I updated the code to handle both possible templates.

Week 2 - Dec, 21st 2018

Accomplishment:

  • Created database Schema

Week 3 - Dec, 28th 2018

Accomplishment:

  • Created airflow scheduler

More details can be found in the Trello Board

Week 4 - Jan, 11th 2018

Accomplishment:

  • Set up PostreSQL as the main database for both application and airflow

More details can be found in the Trello Board

Week 5 - Jan, 18th 2018

Accomplishment:

  • Set up Dash webapp and tested the application and deployed into AWS

More details can be found in the Trello Board