Comparing Runs

You can compare model building Runs you log to Neptune based on parameters, metrics, and other model-building metadata. 
Neptune has three comparison views:
​Charts: where you can compare learning curves for metrics or losses
​Parallel coordinates: where you can see parameters and metrics displayed on a parallel coordinates plot
​Side-by-side: which shows you the difference between Runs in a table format
How to compare Runs
To compare Runs in Neptune you need to:
Go to the Runs table
Finding Runs section of the UI
Click on the "eye icon" to select the Runs you want to compare
Selecting Runs for comparison
Switch to the Horizontal split or Compare runs mode of the Run UI 
Choosing the Runs UI mode to Horizontal split
You can update Runs that are selected for comparison and see visualizations change live when you are in the Horizontal split mode. 
Switch between Charts, Side-by-side, and Parallel coordinates to see different Run comparisons
Choosing comparison option
Comparison options
Charts
Use Charts comparison to compare learning curves for metrics or losses. 
You can:
filter out metrics that contain a particular string by typing it into Filter charts
hover over a chart to see metric value at a particular step
zoom in and out by selecting an X or Y range of the chart
Compare metrics or losses on Charts
To add/remove columns from the chart legend, drag them in/out of the RUN LABEL section of the Runs table:
Adding columns to chart legend
Parallel coordinates
Use Parallel coordinates comparison to see how model parameters affect the metrics.
It shows all the parameters and metrics that are different between selected Runs. 
You can:
explore different parameter and metric ranges by selecting a range of a metric/parameter column of interest
download the comparison as a CSV table by clicking the Export button
download the comparison as PNG of the parallel coordinates plot by clicking the Download as PNG button
Parallel coordinates comparison plot
Side-by-side
Use Side-by-side comparison to see the details of selected Runs in a table format.
Each column is one Run and each row is a single Field of that Run like a parameter or metric. 
You can: 
See the difference-only view of parameters and metrics by ticking the box Rows with diff only
See where the metrics and parameters changed by ticking the box Show cell changes. Choose which Run is a reference by clicking the Pin icon. 
Side-by-side comparison of Runs
Artifact
Use Artifact comparison to see the difference between datasets, models, and other artifacts that you version in Neptune. 
For Runs where artifacts are different, each artifact is displayed.
You can: 
Choose for which Runs you want to compare artifacts (you can only compare two artifacts at the same time)
See the difference in Hash (md5 signature) of artifacts
Compare the size of the artifact
Browse the artifacts folder
​See example in Neptune​
Compare dataset artifacts in the Neptune UI
To compare objects with the Artifacts comparison you need to log them as artifacts first. 
What's next?
Querying and downloading metadata
Monitor model training live
Model visualization and debugging