Logging from multiple places#
Whether you're logging from multiple scripts, processes, or parts of a pipeline, you can log all generated metadata to a single run. You have a couple of options for this:
-
Passing the run object between files
- You can use the
Run
object as a parameter in functions you import from other scripts. - This method applies to other Neptune objects as well:
Model
,ModelVersion
, andProject
.
- You can use the
-
- You can create a custom identifier for the run and use that to access the same run from multiple locations.
- You can also export the custom run ID as an environment variable (
NEPTUNE_CUSTOM_RUN_ID
).
Related
- Using
wait()
andsync()
to ensure synchronous logging - For a practical example, see Tutorials ≫ Tracking distributed training jobs