Unified LLM data management
Project description
log10
⚡ Unified LLM data management ⚡
Quick Install
pip install log10-io
🤔 What is this?
A one-line Python integration to manage your LLM data.
import openai
from log10.load import log10
log10(openai)
# all your openai calls are now logged
Access your LLM data at log10.io
🚀 What can this help with?
🔍🐞 Prompt chain debugging
Prompt chains such as those in Langchain can be difficult to debug. Log10 provides prompt provenance, session tracking and call stack functionality to help debug chains.
📝📊 Logging
Log all your OpenAI calls to compare and find the best prompts, store feedback, collect latency and usage metrics, and perform analytics and compliance monitoring of LLM powered features.
💿🧩 Flexible data store
log10 provides a managed data store, but if you'd prefer to manage data in your own environment, you can use data stores like google big query.
Install the big query client library with:
pip install log10-io[bigquery]
And provide the following configuration in either a .env
file, or as environment variables:
Name | Description |
---|---|
LOG10_DATA_STORE |
Either log10 or bigquery |
LOG10_BQ_PROJECT_ID |
Your google cloud project id |
LOG10_BQ_DATASET_ID |
The big query dataset id |
LOG10_BQ_COMPLETIONS_TABLE_ID |
The name of the table to store completions in |
Note that your environment should have been setup with google cloud credentials. Read more here about authenticating.
🧠🔁 Readiness for RLHF & self hosting
Use your data and feedback from users to fine-tune custom models with RLHF with the option of building and deploying more reliable, accurate and efficient self-hosted models.
👥🤝 Collaboration
Create flexible groups to share and collaborate over all of the above features
⚙️ Setup
- Create a free account at log10.io
- Set the following environment variables:
LOG10_URL=https://log10.io
LOG10_TOKEN
: From the Settings tab in log10.ioLOG10_ORG_ID
: From the Organization tab in log10.ioOPENAI_API_KEY
: OpenAI API key
💬 Community
We welcome community participation and feedback. Please leave an issue, submit a PR or join our Discord.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for log10_io-0.0.10-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d07727b473f50d06da1dfd7cdfba1844e4f7a1f88b4fb8208cd484e2897158ba |
|
MD5 | 8d679b1ab37fb99b053c5ecf65f3ba52 |
|
BLAKE2b-256 | 3ee80b1d6b67c38f8594a448130b7d8c4f79aabf1bd7ed6c29930bdbc82aa08b |