Experimentation guideline - minerva-ml/open-solution-toxic-comments GitHub Wiki
Prerequisites
- Installation was performed successfully. Refer to the Getting started: Neptune Cloud (preferred) or Getting started: local instance.
- You are logged in to neptune
$ neptune login
- In case you work locally (not is Neptune cloud) your virtualenv is activated.
$ source path/to/venv/toxic_venv/bin/activate
First experiment
Neptune cloud
$ neptune send --environment keras-2.0-gpu-py3 --worker gcp-gpu-medium --config neptune.yaml -- train_evaluate_predict_pipeline --pipeline_name glove_lstm
Note that data is already in the cloud and neptune.yaml
is already filled with appropriate directories.
Locally
- Download data to the directory defined in
neptune.yaml#L29
. It isdata_dir
- Run function that will perform train/validation split for you:
$ cd path/to/toxic-starter
$ python main.py train_valid_split
- Start experiment
$ neptune run -- train_evaluate_predict_pipeline --pipeline_name glove_lstm