8 projects
bentoml
BentoML: Build Production-Grade AI Applications
openllm-core
OpenLLM Core: Core components for OpenLLM.
openllm-client
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.
openllm
OpenLLM: Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
bentoml-core
The rust core of BentoML: The Unified Model Serving Framework
open-llm-server
whispercpp
bentoml-plugins-arize
BentoML Monitoring Arize Plugin