Comparing Runs

You can compare model building Runs you log to Neptune based on parameters, metrics, and other model-building metadata.

Neptune has three comparison views:

  • Charts: where you can compare learning curves for metrics or losses

  • Parallel coordinates: where you can see parameters and metrics displayed on a parallel coordinates plot

  • Side-by-side: which shows you the difference between Runs in a table format

How to compare Runs

To compare Runs in Neptune you need to:

  • Go to the Runs table

Finding Runs section of the UI
  • Click on the "eye icon" to select the Runs you want to compare

Selecting Runs for comparison
  • Switch to the Horizontal split or Compare experiments mode of the Run UI

Choosing the Runs UI mode to Horizontal split

You can update Runs that are selected for comparison and see visualizations change live when you are in the Horizontal split mode.

  • Switch between Charts, Side-by-side, and Parallel coordinates to see different Run comparisons

Choosing comparison option

Comparison options


Use Charts comparison to compare learning curves for metrics or losses.

You can:

  • filter out metrics that contain a particular string by typing it into Filter charts

  • hover over a chart to see metric value at a particular step

  • zoom in and out by selecting an X or Y range of the chart

Compare metrics or losses on Charts

Parallel coordinates

Use Parallel coordinates comparison to see how model parameters affect the metrics.

It shows all the parameters and metrics that are different between selected Runs.

You can:

  • explore different parameter and metric ranges by selecting a range of a metric/parameter column of interest

  • download the comparison as a CSV table by clicking the Export button

  • download the comparison as PNG of the parallel coordinates plot by clicking the Download as PNG button

Parallel coordinates comparison plot


Use Side-by-side comparison to see the details of selected Runs in a table format.

Each column is one Run and each row is a single Field of that Run like a parameter or metric.

You can:

  • See the difference-only view of parameters and metrics by ticking the box Rows with diff only

  • See where the metrics and parameters changed by ticking the box Show cell changes. Choose which Run is a reference by clicking the Pin icon.

Side-by-side comparison of Runs


Use Artifact comparison to see the difference between datasets, models, and other artifacts that you version in Neptune.

For Runs where artifacts are different, each artifact is displayed.

You can:

  • Choose for which Runs you want to compare artifacts (you can only compare two artifacts at the same time)

  • See the difference in Hash (md5 signature) of artifacts

  • Compare the size of the artifact

  • Browse the artifacts folder

See this example in Neptune

Compare dataset artifacts in the Neptune UI

To compare objects with the Artifacts comparison you need to log them as artifacts first.

What's next?