Logging system metrics#
The following is logged automatically by default:
- Hardware consumption (CPU, GPU, and memory)
- Console logs (stdout, stderr)
You'll find these in the
monitoring namespace of each run.
The metrics are organized into subfolders per process –
monitoring/<hash>/ – where the hash is calculated based on environment information, to ensure that it's unique for each process.
How to disable
To turn off logging of system metrics, use one or more of the following parameters with
Setting a custom monitoring namespace name#
You can provide your custom monitoring namespace name by passing it to the
monitoring_namespace argument at initialization:
This custom name will replace the
monitoring/<hash>/ pattern. If you're logging metrics from multiple processes, ensure that your custom name is unique for each process.
Logging Python Logger output#
You can also capture logs from a Python Logger .
Create and add a Neptune handler to your Logger:
import logging from neptune.integrations.python_logger import NeptuneHandler logger = logging.getLogger("my_python_logger") logger.addHandler(NeptuneHandler(run=run)) # a previously initialized run logger.debug("Starting training")
You can customize what level of logs you want to capture or the name of the field where the logs will be stored.
For details, see API reference → Python Logger.