OpenInference smolagents Instrumentation
Project description
OpenInference smolagents Instrumentation
Python auto-instrumentation library for LLM agents implemented with smolagents
Crews are fully OpenTelemetry-compatible and can be sent to an OpenTelemetry collector for monitoring, such as arize-phoenix.
Installation
pip install openinference-instrumentation-smolagents
Quickstart
This quickstart shows you how to instrument your LLM agent application.
You've already installed openinference-instrumentation-smolagents. Next is to install packages for smolagents,
Phoenix and opentelemetry-instrument, which exports traces to it.
pip install smolagents arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp-proto-grpc opentelemetry-distro
Start Phoenix in the background as a collector, which listens on http://localhost:6006 and default gRPC port 4317.
Note that Phoenix does not send data over the internet. It only operates locally on your machine.
python -m phoenix.server.main serve
Create an example like this:
from smolagents import CodeAgent, DuckDuckGoSearchTool, HfApiModel
agent = CodeAgent(tools=[DuckDuckGoSearchTool()], model=HfApiModel())
agent.run("How many seconds would it take for a leopard at full speed to run through Pont des Arts?")
Then, run it like this:
opentelemetry-instrument python example.py
Finally, browse for your trace in Phoenix at http://localhost:6006!
Manual instrumentation
opentelemetry-instrument is the Zero-code instrumentation approach
for Python. It avoids explicitly importing and configuring OpenTelemetry code in your main source. Alternatively, you
can copy-paste the following into your main source and run it without opentelemetry-instrument.
from opentelemetry.sdk.trace import TracerProvider
from openinference.instrumentation.smolagents import SmolagentsInstrumentor
from opentelemetry.exporter.otlp.proto.grpc.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk.trace.export import SimpleSpanProcessor
otlp_exporter = OTLPSpanExporter(endpoint="http://localhost:4317", insecure=True)
trace_provider = TracerProvider()
trace_provider.add_span_processor(SimpleSpanProcessor(otlp_exporter))
SmolagentsInstrumentor().instrument(tracer_provider=trace_provider)
