Home - grnet/e-science GitHub Wiki

Welcome to the e-science wiki!

Useful links

Τravis CI how-to:

  1. Getting Started
  2. Travis for Python

Kamaki

  1. Kamaki, stick to 0.16 . Also consult this on python code: https://www.synnefo.org/docs/kamaki/latest/developers/ssl.html#ignore-ssl-errors to ignore warnings/errors for certificate
  2. Using kamaki to update pithos image metadata

Hadoop

  1. M.Noll's guide on ubuntu/debian installation
  2. Hadoop Filesystem API definition

Git / Github

  1. Syncing a fork
  2. Merging from a parallel fork
  3. Resolve conflicts
  4. Branching

Ansible

If a playbook hungs during gathering data, do rm ~/.ansible

Django

  1. Django Rest Framework Docs, stick to 2.4.3
  2. Django Postgres database

Grunt task runner (+ uglify/minify task)

http://agile.escience.grnet.gr:8080/browse/ES-188?focusedCommentId=10685&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-10685

Celery: Distributed Task Queue

https://celery.readthedocs.org/en/latest/

Warning: Celery requires at least 1GB free of hard disk for its workers to function.

SonarQube: Code Quality

  1. [SonarQube Server] (https://github.com/grnet/e-science/wiki/sonarqube-server)
  2. [Sonar Client] (https://github.com/grnet/e-science/wiki/sonarqube-client)

Development

  1. How to install Dev Env

Testing

  1. [Test staging VM from backend] (https://github.com/grnet/e-science/wiki/Test-staging-VM-from-backend)
  2. [Create local orka (using some commit)] (https://github.com/grnet/e-science/wiki/Create-local-orka-using-some-commit)

VREs

  1. Integrate a new VRE into orka (using docker)

Create JAR file

  1. Create orka-pithos.jar file