The EBScraper reads a json file and then opens url's found to gather data and generate a json file with the results.

Dependencies -

Python - https://www.python.org/downloads/
Pip - https://pip.pypa.io/en/stable/installing/
Beautiful Soup 4 - pip install beautifulsoup4
dateutil - pip install python-dateutil
datetime - pip install DateTime

How it works

Opens the url's found in the eventbrite_url_data.json file and parses each page while gathering specific data to be used when producing the output json file. Displays timestamp of start time and end time, logs connecting to link successful or failed, and a queue of remaining url's.

Running the crawler

Make sure ALL dependencies are installed before running AND that you have ran EBCrawler.py first. Once done simply run the EBScraper.py script and wait until it finishes creating the json.

Example of output

Following is the JSON generated -
EventBrite

{
   "https://www.eventbrite.com/e/ofccp-tech-industry-town-hall-tickets-55916280099?aff=ebdssbdestsearch": {
        "URL": "https://www.eventbrite.com/e/ofccp-tech-industry-town-hall-tickets-55916280099?aff=ebdssbdestsearch",
        "Location": "OFCCP OFCCP 300 Fifth Avenue Suite 1100  OFCCP OFCCP 300 Fifth Avenue Suite 1100  Conference Rooms 811/815  ",
        "Title": "OFCCP - Tech Industry Town Hall ",
        "Date": "2019-02-28",
        "Time": "\n\t\t\t\t\t\t\tThu, February 28, 2019, 8:30 AM \u2013 3:00 PM PST\n\t\t\t\t\t\t",
        "Description": "\n\n**PLEASE NOTE: REGISTRATION FOR THIS EVENT WILL CLOSE FEBRUARY 26, 2019 AT MIDNIGHT**\nTech Industry Town Halls: OFCCP Wants to Help\nThe compliance assistance that OFCCP provides is free and critically important to ensuring that you and other federal contractors have the tools and resources you need to comply with the equal employment opportunity obligations required by Executive Order 11246, Section 503, and VEVRAA. We designed all of our fact sheets, educational webinars, frequently asked questions, and staffed Help Desk to assist you and other contractors understand and implement these obligations.  \nTo enhance the scope and quality of our outreach materials and events, OFCCP is holding a Town Hall meeting focused on the technology industry. The meeting is open to the public but will be of particular interest to human resource managers, equal employment opportunity specialists, chief compliance officers, and other personnel in the technology industry who are directly involved with ensuring their company\u2019s compliance with OFCCP\u2019s requirements. Workers, jobseekers, community groups and anyone interested in OFCCP and our work are also encouraged to attend.\nDuring the meeting, we want to obtain your views and learn more about the unique experiences of federal contractors in the technology industry when implementing and managing their equal employment opportunity requirements, and how we can help. If you are a worker, jobseeker, or interested organization we also want to hear from you about how we can improve our outreach to you or your organization.  \n\nSeating will be limited, so please register early. Please note only two tickets are available per organization on a first come, first serve basis. OFCCP reserves the right to cancel any attendee once their organization has reached the two ticket limit.\nIf you have questions about the event, or if you need disability accommodations to participate fully in the event, please contact Jaime Regan at 202-693-0114 or 202-693-0101.\n\n "
    },
    "https://www.eventbrite.com/e/atlas-obscura-society-seattle-searching-for-the-north-pacific-right-whale-tickets-55988947449?aff=ebdssbdestsearch": {
        "URL": "https://www.eventbrite.com/e/atlas-obscura-society-seattle-searching-for-the-north-pacific-right-whale-tickets-55988947449?aff=ebdssbdestsearch",
        "Location": "The Center for Wooden Boats Floating Boathouse Gallery The Center for Wooden Boats Floating Boathouse Gallery 1010 Valley Street  The Center for Wooden Boats Floating Boathouse Gallery The Center for Wooden Boats Floating Boathouse Gallery 1010 Valley Street  Seattle, Washington 98109  ",
        "Title": "Atlas Obscura Society Seattle: Searching for the North Pacific Right Whale",
        "Date": "2019-03-14",
        "Time": "\n\t\t\t\t\t\t\tThu, March 14, 2019, 7:00 PM \u2013 8:30 PM PDT\n\t\t\t\t\t\t",
        "Description": "\n\nJoin Kevin Campion, captain of the historic vessel Orion, at the Center for Wooden Boats to learn about right whales \u2014 some of the largest animals ever to exist. Kevin will share why these rarest of whales matter today, and his work to make the North Pacific right whale the mascot for the Northwest coast.  \nFewer than 200 years ago, thousands of North Pacific right whales swam in the waters of the Pacific Ocean. Today they number less than 50. The story of how we got to this point weaves ecology with industry, and geopolitics with adventure. And the story of how or if we save them is still being written.\nAt this event, you'll learn about the history of indigenous and industrial whaling in the regions of the North Pacific, explore the tragedies and mistakes of the past, and hear about efforts in place to preserve this magnificent mammal. Kevin will introduce us to the work of contemporary researchers and the extraordinary lengths they must go to in order to collect data, and will share stories of his own team\u2019s voyage to find and observe a North Pacific right whale. We will see clips from a film about this voyage, which is still in production, and listen to recordings of exquisitely beautiful whale songs.\nADDITIONAL DETAILS\n\nThis event will take place in the Floating Boathouse Gallery space, which is the wooden building closer to the water.\nThis event is open to all ages.\nParking options in the area can be found here, but the Center for Wooden Boats is also accessible by public transportation, including the South Lake Union Trolley.\nADA Accessible spaces are available for vehicles with disability permits or for visitors requiring drop-off in both the South parking lot and the North parking lot, next to MOHAI.  Follow the directions at the gate for access to this lot.\nThe dock and Boathouse gallery are wheelchair accessible, though the dock can be uneven or slippery depending on the weather.\n\nQUESTIONS?\nEmail Tamara Bunnell at [email protected].\nStay connected! Subscribe to the Atlas Obscura Society Seattle newsletterand join  our Facebook groupfor a first glimpse at upcoming events.\nAdvance ticket sales only. All ticket sales are final. No refunds or exchanges.\n\n \n\n "
    },
    ...
]