Work Packages dashboards - panosc-eu/panosc GitHub Wiki

To join mailing lists, please contact Jordi.

To join the WP3 mailing list, just contact [email protected]

To join ExPaNDS mailing lists: https://github.com/ExPaNDS-eu/ExPaNDS/wiki/Useful-links-and-first-steps#how-to-register-to-internal-mailing-lists

WP2 : Data Policy & Stewardship

WP Leader: Andy Gotz (ESRF)

Partner Correspondent DP before PaNOSC PaNOSC DP approved DP implemented DMP approved DMP implemented Data portal Findable Accessible Interoperable Reusable
ESRF A.Gotz βœ“ in progress yes (42 beamlines) - - https://data.esrf.fr - - - -
ILL E.Le Gall βœ“ on hold
ESS J.Taylor βœ“ in progress https://scicat.ess.eu/
EuXFEL K.Wrona βœ“ in progress https://in.xfel.eu/metadata
CERIC D.Roccella only partially approved https://vuo.elettra.trieste.it/pls/vuo/open_access_data_portal.show_search
ELI T.Ivănoaica no in progress

Upcoming deliverables & milestones:

  • D2.3 Guidelines in best practices M24 (November 2020)
  • D2.2 DMP Template for users published M36 (November 2021)
  • MS2.3 Implementation of DP Framework M36 (November 2021)

WP3 : Data Catalog Services

WP Leader: Tobias Richter

Partner Correspondents API end point API serving live data API Authentication API in PaNOSC Portal API registered in EOSC OAI-PMH OAI-PMH serving live data OpenAIRE compatibility
ESRF A de Maria βœ“ βœ“ βœ“ βœ“ βœ“ βœ“(?)
ILL S Caunt βœ“ βœ“ βœ“ βœ“ βœ“ βœ“
ESS T Richter βœ“ βœ“ βœ“ βœ“ βœ“
XFEL L Maia βœ“ βœ“ βœ“ βœ“ βœ“ βœ“
CERIC E. Coghetto. A. Olivo βœ“ No No No No βœ“ No βœ“
ELI L Schrettner No No No No No No No βœ“
EGI N/A

Upcoming deliverables & milestones:

  • D3.3 Catalog Service M40 (March 2022)
  • D3.5 NeXus Metadata Mapping Schema and Proposed New Definitions (May 2022)
  • D3.4 Implementation Report from Facilities (July 2022)

WP4 : Data Analysis Services

WP Leader: Fabio Dall'Antonia (Sandor and Hans have led this WP in the past)

Partner Correspondent Pilot PaN Portal PaN Portal V2 in production at site (M42) PaN Portal Search API PaN Portal Remote desktop PaN Portal Jupyter PaN Portal data transfer PaN Portal simulation (ViNyL - WP5) Local PaN portal developments Number of people
ESRF Thomas Vincent / Andy Gotz βœ“ YES planned for 8/21 YES currently test version YES currently guacamole YES currently jupyter-slurm YES currently globus YES currently OASYS jupyter-slurm, h5web, jupyterlab-h5web, silx 4
ILL Jamie Hall βœ“ Planned for autumn 2021 Production Search API deployed Yes Yes Yes --- VISA and micro-service development 3
ESS Lottie Greenwood βœ“ planned before eoy 2021 planned currently guacamole/vnc currently both k8s&slurm based planned planned 1
XFEL F Dall'Antonia βœ“ planned for end 2021 planned (currently none) currently FastX jupyter-slurm (current) and/or K8s-based Globus currently SIMEX (not integrated yet, but planned) Packages for Python/Jupyter: h5py, extra-data, extra geom - Jupyter technology: nbconvert, nbparametrize, Binder 2
CERIC Marco De Simone / Emiliano Coghetto / Andrea Lorenzon βœ“ planned before eoy 2021 test version eoy 2021 currently guacamole/vnc and AWS NICE DCV Yes Yes OASYS 3
ELI T Ivanoaica βœ“ planned before eoy 2021 test version eoy 2021 - jupyter-slurm Globus - considered, also testing jupyter-slurm (current) and/or K8s-based
Public Demonstrator βœ“ βœ“ βœ“ βœ“ βœ“ ? ?

[Extended version]

Partner Correspondent Pilot PaN Portal PaN Portal v2 in use at site PaN Portal includes Search API PaN Portal includes Remote desktop PaN Portal includes Jupyter PaN Portal allows data transfer PaN Portal includes simulation (WP5) PaN Portal registered in EOSC
aim status challenge aim status challenge aim status challenge aim status challenge aim status challenge aim status challenge
ESRF T Vincent, A Gotz βœ“ βœ“ service migration βœ“ ? coordination with WP3 βœ“ βœ“ βœ“ βœ“ coordination with WP5 ?
ILL J Hall βœ“ Autumn 2021 VISA/portal migration Aligning code bases βœ“ Design stage coordination with WP3 βœ“ VISA (guacamole)/portal migration βœ“ VISA (JupyterLab)/portal migration βœ“ VISA/sftp/web ? ?
ESS L Greenwood βœ“ βœ“ WIP service migration βœ“ ? coordination with WP3 βœ“ Local: VNC/Gauc βœ“ Local: k8s/slurm based jhub βœ“ βœ“ collecting usecases ?
XFEL F Dall'Antonia βœ“ βœ“ planned for end 2021 demo + WIP service migration βœ“ ? coordination with WP3 βœ“ local: FastX βœ“ [Jhub-based] local: Jhub βœ“ local: Globus βœ“ [ use case ] coordination with WP5 ?
CERIC M De Simone / E Coghetto βœ“ βœ“ WIP service migration βœ“ ? coordination with WP3 βœ“ currently guacamole/vnc and AWS NICE DCV service migration βœ“ βœ“ local, rclone OASYS WIP service migration ?
ELI T Ivanoaica βœ“ βœ“ service migration βœ“ ? coordination with WP3 βœ“ βœ“ ? ? ?
EGI βœ“ βœ“ service migration βœ“ ? coordination with WP3 βœ“ βœ“ βœ“ βœ“ coordination with WP5 [as federated portal host]

Upcoming deliverables & milestones:

  • IMS4.3a KPI snapshot M30 (May 2021)
  • IMS4.4a PaN Portal v2.0 M33 (August 2021)
  • D4.3 Remote desktop and Jupyter analysis service deployed at EOSC M42 (May 2022)
  • MS4.2 Data Analysis Services accessible through the EOSC M42 (May 2022)
  • D4.4 Publicly accessible demostrator M48 (November 2022)

WP5 : VIrtual Neutron and x-raY Laboratory (VINYL)

WP Leader: Carsten Fortmann-Grote (supported by Juncheng E)

Partner Correspondent Adopt OpenPMD Adopt NeXus integration in PaN Portal OASYS is a remote service COMSYL is a remote service Collection of simulation Jupyter Notebooks / Oasys Workspacess
ESRF M. Sanchez-Rio βœ“ βœ“
ILL Shervin Nourbakhsh βœ“ WIP NA NA WIP
ESS Mads Bertelsen βœ“ WIP NA NA WIP
XFEL C. Fortmann-Grote, Juncheng E βœ“ WIP NA NA WIP
CERIC Aljosa Haffner βœ“ βœ“ βœ“
ELI Mousumi Upadhyay Kahaly βœ“ NA NA NA WIP
EGI NA NA NA NA NA NA NA

Upcoming deliverables & milestones: https://github.com/PaNOSC-ViNYL/ViNYL-project/milestones


WP6 : EOSC Integration

WP Leader: Jean-FranΓ§ois Perrin

Partner Correspondent Adopt AAI w/ EduGain WP3 implements AAI WP4 implements AAI WP5 implements AAI Data Transfer in production Software Catalogue Cloud Procurement Integrate local resources in EOSC
ESRF JF Perrin βœ“ βœ“ Yes, βœ“ or NO
ILL ?? βœ“
ESS ? βœ“
XFEL Fabio Dall'Antonia βœ“
CERIC ? βœ“
ELI Teodor Ivanoaica βœ“
EGI ? βœ“

Upcoming deliverables & milestones:

  • D6.4 Demonstration of the PaN software catalogue integration into EOSC M24 (November 2020) LATE
  • D6.2 Integration of local compute resources in to the EOSC cloud M36 (November 2021)
  • D6.3 Integration of the PaN AAI into the EOSC M36 (November 2021)
  • MS6.3 Second release of PaNOSC series, data and resources M36 (November 2021)
  • D6.5 Report on EOSC integration M48 (November 2022)

WP7 : Sustainability

WP Leader: Ornela de Giacomo

Partner Correspondent Cost collection Cost analysis Feedback draft B Models Feedback draft sustainability plan Questionnaire agreed Questionnaire Shared B Model endorsed Sustainability Plan endorsed ?
ESRF R Dimper, JF Perrin βœ“ in progress
ILL E Le Gall βœ“ in progress
ESS T Holm βœ“ βœ“
XFEL F Dall'Antonia in progress in progress
CERIC O De Giacomo, A Zennaro, R Pugliese βœ“ in progress
ELI T Ivanoaica, F Gliksohn βœ“ in progress
EGI G La Rocca NA NA

Upcoming deliverables & milestones: *** D7.2 PaN EOSC metrics and cost model M36 (November 2021)**

  • D7.3 PaN EOSC Business model M42 (May 2022)
  • D7.4 PaN EOSC Sustainability Plan M48 (November 2022)
  • MS7.2 Final Sustainability Plan M48 (November 2022)

and several Internal milestones:

  • IMS7.01 Complete cost collection and eventually adjust scope (April 2021)
  • IMS7.02 First draft of Deliverable 7.2 (July 2021)
  • IMS7.03 Development of the first draft business models (December 2021)
  • IMS7.04 Development of the draft sustainability plan M43 (June 2022)
  • IMS7.05 Refinement of the metrics, according to the stakeholders consultation and first implementations M35 (October 2021)
  • IMS7.06 Refinement of the business model and development of the funding model M40 (March 2022)
  • IMS7.07 Development of the outline of the sustainability plan M33 (August 2021)
  • IMS7.08 Final version of the sustainability plan M48 (November 2022)

WP8 : Staff and User Training

WP Leader: Thomas Rod

Partner Correspondent Created content in pan-learning.org Jupyter content created pan-learning showcases Search API pan-learning showcases PaN Portal pan-learning showcases WP5's software users attended school At least 3 courses created ?
ESRF ?? βœ“ βœ“ Yes, βœ“ or NO
ILL ?? βœ“
ESS Thomas Rod βœ“
XFEL ? βœ“
CERIC ? βœ“
ELI Florian Gliksohn/Teodor Ivanoaica βœ“
EGI ? βœ“

Upcoming deliverables & milestones:

  • MS8.4 Jpyter integrated with e-learning platform M30 (May 2021)
  • MS8.5 e-learning virtual facilities M36 (November 2021)
  • D8.1 Report on lessons learned and future prospects for adopting best practices on data stewardship at PaNOSC facilities M32 (July 2021)
  • D8.2 Report on lessons learned adn future prospects for adopting e-learning platform at the PaNOSC facilities M42 (May 2022)
  • D8.3 Teaching material for users of PaNOSC services, FAIR principles and the PaNOSC facilities accessible in the e-learning platform M42 (May 2022)
  • D8.4 Closing report including report from summer school M48 (November 2022)

WP9 : Outreach/Communication and Dissemination/Impact

WP Leader: Nicoletta Carboni

Partner Correspondent Interviewed Provided 5+ use cases Provided 10+ use cases PaNOSC in 2021 user meeting PaNOSC in 2022 user meeting Provided 1-minute video ?? ?
ESRF Delphine Chenevier NO
ILL Steph Monfront YES NO
ESS James Tierney, Lenka Petkova, Margaret Armstrong NO
XFEL Bernd Ebeling βœ“
CERIC Nicoletta Carboni n/a NO
ELI DΓ³ra VΓΆrΓΆs YES NO
EGI Dimple Sokartara NO

Upcoming deliverables & milestones:

  • D9.4 Dissemination and Outreach activities M48 (November 2022)