Agenda

• pros/cons of online server environment for visualizations
• Fenil: contact Shengsong and see if you can set up a meeting to learn how to ssh into Arbutus, and install mediacat
• Fenil: look at proquest newspaper to see if complex query can be run:
  • try 1970-1975 to see if comparable results to current ones
  • Alejandro: share excel with Fenil

Server:

• figured out ssh to arbutus
• documentation is decent

Proquest:

• using command line but was getting very low results
• using regular search gave us 1,384 results for: pubid(45545) AND ha?aretz

online server documentation

• Excel: 3 million rows in 3 sheets, really depends on the stuff you want
• visually interactive kinds of visualizations, need server

Action Item

• Shawn: access jupyter-lab and try to produce a visualization on arbutus with NYTimes twitter data
  • see here for placement: https://docs.google.com/document/d/14yylvd_zl5BaOvD8WbM0AEV8opVIgr_zJ2pXuMFBzcQ/edit#
• Fenil: install Twitter crawler on Arbutus and try to crawl FoxNews handles:
  • https://docs.google.com/spreadsheets/d/14fOCbBGFMO2okJCEnajk4KpzvzNS3oFxcoTFYIY5h2U/edit#gid=1609056254
• Fenil: try to get proquest working for mass download
• Fenil & Shawn are meeting on Saturday to go over entering Arbutus.
• Alejandro: ask digital alliance to increase Arbutus allowance
• Alejandro: ask Shengsong about moving storage to Arbutus, cc Shengsong

Backburner

• create test results to check installation