Comparing Runs
You can compare model building Runs you log to Neptune based on parameters, metrics, and other model-building metadata.
Neptune has three comparison views:
​Charts: where you can compare learning curves for metrics or losses
​Parallel coordinates: where you can see parameters and metrics displayed on a parallel coordinates plot
​Side-by-side: which shows you the difference between Runs in a table format
To compare Runs in Neptune you need to:
Go to the Runs table
Click on the "eye icon" to select the Runs you want to compare
Switch to the Horizontal split or Compare experiments mode of the Run UI
You can update Runs that are selected for comparison and see visualizations change live when you are in the Horizontal split mode.
Switch between Charts, Side-by-side, and Parallel coordinates to see different Run comparisons
Use Charts comparison to compare learning curves for metrics or losses.
You can:
filter out metrics that contain a particular string by typing it into Filter charts
hover over a chart to see metric value at a particular step
zoom in and out by selecting an X or Y range of the chart
Use Parallel coordinates comparison to see how model parameters affect the metrics.
It shows all the parameters and metrics that are different between selected Runs.
You can:
explore different parameter and metric ranges by selecting a range of a metric/parameter column of interest
download the comparison as a CSV table by clicking the Export button
download the comparison as PNG of the parallel coordinates plot by clicking the Download as PNG button
Use Side-by-side comparison to see the details of selected Runs in a table format.
Each column is one Run and each row is a single Field of that Run like a parameter or metric.
You can:
See the difference-only view of parameters and metrics by ticking the box Rows with diff only
See where the metrics and parameters changed by ticking the box Show cell changes. Choose which Run is a reference by clicking the Pin icon.
Use Artifact comparison to see the difference between datasets, models, and other artifacts that you version in Neptune.
For Runs where artifacts are different, each artifact is displayed.
You can:
Choose for which Runs you want to compare artifacts (you can only compare two artifacts at the same time)
See the difference in Hash (md5 signature) of artifacts
Compare the size of the artifact
Browse the artifacts folder
​See this example in Neptune​
To compare objects with the Artifacts comparison you need to log them as artifacts first.
