Configure a personal Data Provider (CBRAIN) - aces/cbrain GitHub Wiki
The final option is to configure a personal data provider.
Creating a personal data provider will have great advantages such as connecting storage on systems like lab-based systems. However, the configuration will only work for systems that don't require 2-factor authentification.
![](https://private-user-images.githubusercontent.com/115739667/333654799-4c6d6f42-19ed-423e-9783-55a0fbf541c0.jpeg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjUxNTA2ODEsIm5iZiI6MTcyNTE1MDM4MSwicGF0aCI6Ii8xMTU3Mzk2NjcvMzMzNjU0Nzk5LTRjNmQ2ZjQyLTE5ZWQtNDIzZS05NzgzLTU1YTBmYmY1NDFjMC5qcGVnP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDkwMSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA5MDFUMDAyNjIxWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9YWQ1ZTA5NmFhYWQyOGQyNzI4OTc5OTdhMTJlZDI2NDU1MWZmODVjZWU0MTUxMzFmMzFmNzRhYmQ2YTZiM2U4OCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.JSNWcvW0-YwTAuv28o1bBTEzKwqLeky9_YyMeAp9hRQ)
1. Go to CBRAIN Data providers
A new page will pop up asking you to complete the following form:
Complete the form as per:
- Name: Name of the personal data provider
- Description: Short description
- Project: assigned project
- Remote Hostname: this is the server name where you get the file. In this example, I want to move a file from Compute Canada Beluga to the personal data provider hosted in CBRAIN
- Remote Username of your Compute Canada Account
- Full Directory Path: where the file is located in Beluga
Before saving your configuration, you will need to configure the SSH in your host storage. A public SSH key needs to be added to the authorized keys of the user on the host. Paste the SSH key provided on CBRAIN in a text file
-
If you use the nano or pico text editor, please make sure to use the
-w
option to prevent the editor from splitting the line of the key. The SSH key must all be in a single long line -
Run a command to add it to the authorized keys file on the host, as for an example the below one:
ssh-copy-id -f -i key.pub username@hostname
If you prefer, you can also directly create a .ssh
directory on your host server, add the authorized key
file in .ssh
and copy the SSH key in that file without using the previous command line.
Now, you can click on Create new Data Provider
Note:
Please remember to manually push the CBRAIN SSH key to the cluster if you want the personal data provider to be connected directly, otherwise, you will get the following message:
To push the CBRAIN SSH key, please go to My account then edit your System SSH Key
To make sure your data provider has been successfully configured, you will have to test it before the files can be automatically registered. When you don't need it anymore, you will be able to deconfigure it as well.
- TEST CONFIGURATION
By clicking on the button, a message will pop up confirming the configuration is successful
- REGISTER FILES
Please go to Resources Data Providers and select the personal data provider.
Click on browse and you will see the files available to be registered
You can now go to the project you assigned the files, and you will see the new file(s) uploaded under Files with the personal data provider name:
- DELETE
If you want to delete this personal storage, simply select your personal data provider from the list the list and click delete: