You should know
How-to guides
Integrations and Supported Tools
API reference
Administration
Log model building metadata
Introduction
Adding Neptune is a simple process that only takes a few steps. We’ll go through those, one by one.
Before you start
Make sure you meet the following prerequisites before starting:
- Have
Python 3.6+installed - Have
scikit-learnandjoblibinstalled
Step 1: Connect Neptune to your script
At the top of your script add
1
import neptune.new as neptune
2
​
3
run = neptune.init(project='common/quickstarts',
4
api_token='ANONYMOUS')
Copied!
This creates a new
run in Neptune to which you can log metadata.You need to tell Neptune who you are and where you want to log things. To do that you specify:
project=my_workspace/my_project: your workspace name and project name,api_token=YOUR_API_TOKEN: your Neptune API token.
If you configured your Neptune API token correctly, as described here, you can skip the
api_tokenargument.Runs can be viewed as dictionary-like structures - namespaces - that you can define in your code. You can apply hierarchical structure to your metadata that will be reflected in the UI as well. Thanks to this you can easily organize your metadata in a way you feel is most convenient.
Step 2: Log parameters
1
PARAMS = {'lr': 0.1, 'epoch_nr': 10, 'batch_size': 32}
2
run['parameters'] = PARAMS
Copied!
It logs your
PARAMS dictionary with all the parameters that you want to keep track of.See also:
How to Track Hyperparameters of Machine Learning Models? - neptune.ai
neptune.ai
Step 3: Log dataset version
1
run["dataset/train"].track_files('data/train/images')
2
run["dataset/test"].track_files('data/test/images')
Copied!
Step 4: Add logging for metrics and losses
To log a metric or loss during training you should use:
1
loss = ...
2
run["train/loss"].log(loss)
Copied!
Few explanations here:
"train/loss"is a name of the log with a hierarchical structure."train/loss"is a series of values - you can log multiple values to this log.- You can have one or multiple log names like
'train/acc','val/f1_score’,‘train/log-loss’,‘test/acc’). - The argument of the
log()method is the actual value you want to log.
Typically during training, there will be some sort of a loop where those losses are logged. You can simply call
run["train/loss"].log(loss) multiple times at each step.1
for i in range(epochs):
2
...
3
run["train/loss"].log(loss)
4
run["train/acc"].log(accuracy)
Copied!
Step 5: Add logging of test score
1
run['test/acc'] = 0.76
Copied!
In this way, you will log a single value, not a series of values. Again, you can make use of the hierarchical structure of the run to organize scores -
'test/acc'.Step 6: Add logging of performance charts
1
# confusion_matrix is matplotlib figure object
2
confusion_matrix = ...
3
run['diagnostic_charts'].upload(neptune.types.File.as_image(confusion_matrix))
4
​
5
# log image predictions
6
img_pred = neptune.types.File(path_to_image)
7
run['predictions'].log(img_pred)
Copied!
Step 7: Add logging of model files
1
run["model"].track_files('my_model.pkl')
Copied!
Log your model as a versioned artifact with
.track_files() method. Just pass the path to the file you want to log to Neptune.There are many other objects that you can log to Neptune:
Step 7: Stop logging
Once you are done logging, you should stop tracking the run using the
stop() method. This is needed only while logging from a notebook environment. While logging through a script, Neptune automatically stops tracking once the script has completed execution.1
run.stop()
Copied!
Last modified 5mo ago
Export as PDF
Copy link