Globus Online for ESGF CSSEF - ESGF/esgf.github.io GitHub Wiki

Wiki Reorganisation
This page has been classified for reorganisation. It has been given the category MOVE.
The content of this page will be revised and moved to one or more other pages in the new wiki structure.
<title>Globus Online | Globus Online for ESGF/CSSEF</title>

Globus Online for ESGF/CSSEF

ESGF/CSSEF uses Globus Online for data transfer solutions. Globus Online addresses the challenges faced by researchers in moving, sharing, and archiving large volumes of data among distributed sites. With Globus Online, you hand off data movement tasks to a hosted service that manages the entire operation, monitoring performance and errors, retrying failed transfers, correcting problems automatically whenever possible, and reporting status to keep you informed so that you can focus on your research. Command line and web-based interfaces are available. The transfer process can be started and monitored from any location with an Internet connection, e.g. from your university, airport, or home.

  1. Instruction for using Globus Online from ESGF Portal
    1. Using Globus Online for downloading to your machine
    2. Using Globus Online to transfer to other servers
  2. Videos on using Globus Online from ESGF Portal

Instructions for using Globus Online from ESGF Portal

Using Globus Online for downloading to your machine

ESGF Portal has an option for downloading data via Globus Online. This document outlines the steps for transferring the dataset from the data cart in the portal to your local machine or to a server.

  1. Log into ESGF Portal

    Figure 1: Choose Login option

    Figure 2: Provide ESGF OpenID

    Figure 3: Provide ESGF password

  2. Search and added datasets to the data cart, and choose Globus Online option for download.

    Figure 4: Choose Globus Online as transfer option

  3. If you have a Globus Online account, log in using Globus Online username and password. If you don’t click on Sign Up with Globus Online option.

    Figure 5: Choose option to sign up for Globus Online

  4. Complete the form and sign up for a new Globus Online account. It may take a few minutes to provision your account. Once done, click on Let’s Go

    Figure 6: Complete the form for Globus Online account

    Figure 7: Your account will be provisioned

    Figure 8: Click on Let’s Go

  5. If you have not installed Globus Connect before, select one of the links below and follow the instructions.
    Mac OS X 10.4 or higher (Intel only)
    Linux (32 or 64 bit x86, most common distributions)
    Windows (XP, Vista, 7)
  6. Once Globus Connect is installed, you may now browse to your local machine using the name you provided during installation.

    Figure 12: Select Globus Connect endpoint

  7. Browser to the directory you want the file transferred, and click Proceed

    Figure 13: Browse to directory to transfer to

  8. Provide your ESGF password to start the transfer.

    Figure 14: ESGF password

  9. Transfer will be submitted to Globus Online, and you will be notified when it is completed. You can also monitor the status by clicking on the View Transfer link.

    Figure 15: Submit transfer

Note: You need to create a Globus Online account only once, and setup Globus Connect only once for a local machine.

Using Globus Online to transfer to other servers

If the machine you want to move data to already has a Globus Online endpoint, you can move to that machine without installing any software.

  1. Log into ESGF Portal
  2. Search and added datasets to the data cart.
  3. Choose Globus Online option for download
  4. If you have a Globus Online account, log in using Globus Online username and password. If you don’t click on Sign Up option.
  5. Complete the form and sign up for a new Globus Online account. It may take a few minutes to provision your account. Once done, click on Let’s Go
  6. On the drop down, select the machine you want to transfer to. You can search by typing in a name. For example typing in nersc, will give you list of servers there.
  7. You will be prompted to authenticate to the selected machine, and the you can choose the directory into which you want the files transferred, and click Proceed
  8. Provide your ESGF password to start the transfer
  9. Transfer will be submitted to Globus Online, and you will be notified when it is completed. You can also monitor the status by clicking on the View Transfer link.

Videos

There are two videos provided here that demonstrate use of Globus Online with ESGF portal:

  1. If you already have a Globus Online account, this video provides a quick overview
  2. If you are new to Globus Online, this video provides detailed step by step instructions.
⚠️ **GitHub.com Fallback** ⚠️