Comparing Runs
You can compare model building Runs you log to Neptune based on parameters, metrics, and other model-building metadata.
Neptune has three comparison views:
  • Charts: where you can compare learning curves for metrics or losses
  • Parallel coordinates: where you can see parameters and metrics displayed on a parallel coordinates plot
  • Side-by-side: which shows you the difference between Runs in a table format

How to compare Runs

To compare Runs in Neptune you need to:
  • Go to the Runs table
Finding Runs section of the UI
  • Click on the "eye icon" to select the Runs you want to compare
Selecting Runs for comparison
  • Switch to the Horizontal split or Compare runs mode of the Run UI
Choosing the Runs UI mode to Horizontal split
You can update Runs that are selected for comparison and see visualizations change live when you are in the Horizontal split mode.
  • Switch between Charts, Side-by-side, and Parallel coordinates to see different Run comparisons
Choosing comparison option

Comparison options

Charts

Use Charts comparison to compare learning curves for metrics or losses.
You can:
  • filter out metrics that contain a particular string by typing it into Filter charts
  • hover over a chart to see metric value at a particular step
  • zoom in and out by selecting an X or Y range of the chart
Compare metrics or losses on Charts
To add/remove columns from the chart legend, drag them in/out of the RUN LABEL section of the Runs table:
Adding columns to chart legend

Parallel coordinates

Use Parallel coordinates comparison to see how model parameters affect the metrics.
It shows all the parameters and metrics that are different between selected Runs.
You can:
  • explore different parameter and metric ranges by selecting a range of a metric/parameter column of interest
  • download the comparison as a CSV table by clicking the Export button
  • download the comparison as PNG of the parallel coordinates plot by clicking the Download as PNG button
Parallel coordinates comparison plot

Side-by-side

Use Side-by-side comparison to see the details of selected Runs in a table format.
Each column is one Run and each row is a single Field of that Run like a parameter or metric.
You can:
  • See the difference-only view of parameters and metrics by ticking the box Rows with diff only
  • See where the metrics and parameters changed by ticking the box Show cell changes. Choose which Run is a reference by clicking the Pin icon.
Side-by-side comparison of Runs

Artifact

Use Artifact comparison to see the difference between datasets, models, and other artifacts that you version in Neptune.
For Runs where artifacts are different, each artifact is displayed.
You can:
  • Choose for which Runs you want to compare artifacts (you can only compare two artifacts at the same time)
  • See the difference in Hash (md5 signature) of artifacts
  • Compare the size of the artifact
  • Browse the artifacts folder
Compare dataset artifacts in the Neptune UI
To compare objects with the Artifacts comparison you need to log them as artifacts first.

What's next?

Last modified 15d ago