OpenLLMetry instrumentation for Transformers
An OpenTelemetry instrumentor for supported Hugging Face Transformers calls.
Published by Traceloop
How to use it
Run the same local input through a model twice and compare trace timing. Label the cold and warm runs so model-loading time can be distinguished from repeat workload timing.
Run pip install opentelemetry-instrumentation-transformers in the Python model process and export sample spans to a local collector. Choose a supported Transformers workload and model that fit the available hardware.
- Compatibility
- Python, Transformers, OpenTelemetry
- Monitoring areas
- Local model tracing, Model workload timing
- Access
- Local Python instrumentation. A compatible OpenTelemetry receiver is needed to view traces.