Neptune objects overview#
Neptune objects refer to entities that can contain metadata: runs, models, model versions, and projects.
The type of Neptune object you initialize in your code determines where the data goes and what you can do with it in the app.
|Object type||Represents||Description||Section in app|
||A tracked experiment||A namespace inside a project where you log ML metadata. Typically, you create a run every time you execute a script that does model training, re-training, or inference.||Runs|
||An ML model||Collection of metadata common to all versions of a model you're working on.||Models|
||A version of an ML model||Collection of metadata specific to a version of a model.||Models|
||A Neptune project (an ML task you're solving)||An object that can be used to log and query project-level metadata.||Project metadata|
How it works in the code#
The below code creates a run in your Neptune project, as specified by the
NEPTUNE_PROJECT environment variable.
Run objects can contain any metadata you want to track, plus some automatically logged system metrics.
Once the run is stopped, you get a link to the run in the Neptune app.
Register a model once, then create as many versions as you need.
Just like with runs, you can create new model objects or resume existing ones, and store metadata in a structure of your choosing.
A Neptune project can itself be treated as a Neptune object, which lets you track and query metadata that applies on project level.
You can use the same logging methods as for runs and model objects.
Anatomy of a Neptune object#
- Namespace: A "folder" inside a Neptune object.
- Field: Location inside a namespace where a piece of metadata is stored.
When viewing the run in the app:
To fetch the value of the field through the Neptune API:
- The Neptune ID of the run. It's stored in the
sys/idfield. You can also use a custom run ID.
Similarities and differences between Neptune objects#
In your code, you work with the objects in much the same way:
- You initialize the object with its own
init()function, either to create a new object or log to an existing one.
- You can resume a connection to an object any number of times.
- It's up to you to define what types of metadata to log and in what structure.
- When you're done logging, you should stop the connection to the object.
The main differences are:
- The available methods and properties. For example, managing the stage is only available for model versions.
- Model and project objects do not monitor things in the background, like runs do.
- Run and model version objects are designed for multiple trials and comparison, so their Neptune IDs include a counter.