OpenLLM Core: Core components for OpenLLM.
Project description
📖 Introduction
With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps, and more.
To learn more about OpenLLM, please visit OpenLLM's README.md
This package holds the core components of OpenLLM, and considered as internal.
Components includes:
- Configuration generation.
- Utilities for interacting with OpenLLM server.
- Schema and generation utilities for OpenLLM server.
📔 Citation
If you use OpenLLM in your research, we provide a citation to use:
@software{Pham_OpenLLM_Operating_LLMs_2023,
author = {Pham, Aaron and Yang, Chaoyu and Sheng, Sean and Zhao, Shenyang and Lee, Sauyon and Jiang, Bo and Dong, Fog and Guan, Xipeng and Ming, Frost},
license = {Apache-2.0},
month = jun,
title = {{OpenLLM: Operating LLMs in production}},
url = {https://github.com/bentoml/OpenLLM},
year = {2023}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
openllm_core-0.3.0.tar.gz
(68.2 kB
view hashes)
Built Distributions
Close
Hashes for openllm_core-0.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 35860094cc50277412519d6e1bd608d4c7c3a9436915fb3ab38f3bb92597d1c9 |
|
MD5 | 798ede440ab2a7cb755d815018ade6d3 |
|
BLAKE2b-256 | ebc68203434b3ed6292d7e5d77f8dc158a0fa35849e389dd4bbc8d956a74f1ac |
Close
Hashes for openllm_core-0.3.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7a5cecd300d8f81c88f0578f609a9be5b0b1a7c8b715d1edb2abf284b78e9aa8 |
|
MD5 | aec9d6714fa0c8a5d201f767ef018f5a |
|
BLAKE2b-256 | 84abc28eef30313f168bd9ed38464a901d9c2af12f3ace867d72d02393ee54ed |
Close
Hashes for openllm_core-0.3.0-cp311-cp311-macosx_10_16_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4d48749d4cc5b4e053ba5062129fe1edcb7ec92726f2123735b0bd3644b58b41 |
|
MD5 | 4a4696b4d1388fdc2a1eecac1fbcd06f |
|
BLAKE2b-256 | e6824f19702ef6a504b8175b39ab95df244a432161b1544712fd67eb09de723f |
Close
Hashes for openllm_core-0.3.0-cp311-cp311-macosx_10_16_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f9da0bf2e7367ac7489cb0599c16e7be1d1fe44c67f6d39e2ea999ca535cd1a9 |
|
MD5 | 9c7e893fb5371cd0f176b8bc56ebeea7 |
|
BLAKE2b-256 | 2b8d1df4ba938d59a872b53a1beb8e0cfd130eb9d6b776f98fa5b25949ff25f2 |
Close
Hashes for openllm_core-0.3.0-cp311-cp311-macosx_10_16_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ce9a586f4c84a40ea5e19771290731c7a97442343f521ab6406ab524de555244 |
|
MD5 | 1c371260aed10197438acfda8951fe18 |
|
BLAKE2b-256 | 78d7523fc87568edd0ad3af6f20615cf5e715ab1ebc8f350289233803624bc48 |
Close
Hashes for openllm_core-0.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 775220fe263b2589e6a0e8c9a5e3ab3cd2409f36fc0f3d57c9ef5638ed1627ef |
|
MD5 | 8338ab07c3d44b8a6e11a3ccda3de66a |
|
BLAKE2b-256 | 35babcd128214d46acb9faf06698cec813beabc109687f53a5a40583cecb6eaa |
Close
Hashes for openllm_core-0.3.0-cp310-cp310-macosx_10_16_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a183fde4bfc4e1e4fbdd81a81ce6d8991cf56b737782c839cdc7c063490b5b93 |
|
MD5 | ab6068733e4074d2e7314d793c37c0a0 |
|
BLAKE2b-256 | f64b7a360d9ebaf0b5a1d42eafbde733d4ca997a937d956caeb29589f2b21f22 |
Close
Hashes for openllm_core-0.3.0-cp310-cp310-macosx_10_16_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d4e4ea76bc37b117e61c88bee630d73981f868fcd7f90dfae342f50653c54a6 |
|
MD5 | 68ad41a4e89d7f1b87e6b5b520febb6e |
|
BLAKE2b-256 | ff11219a6e6b69b06ae92ffcd91f46073a86c9766685574f0561b12bb1264aca |
Close
Hashes for openllm_core-0.3.0-cp310-cp310-macosx_10_16_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f25cbb724bb4dd7737311b9ab1678ff6555978adad2c57ddb136ef7c33a4d5a2 |
|
MD5 | bbc0c2896a797d8b21e90f74467aa83b |
|
BLAKE2b-256 | 4b68bde549598277fea1acaf8bb4ae89f718cca865da2d3496b2363f947bff38 |
Close
Hashes for openllm_core-0.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6992f3893ed6d5fc2b45dd033e17caf4fb59aa02558624d27d0ed7e5e67a3c69 |
|
MD5 | 83e4cbb7e622b45b6c85645122b24464 |
|
BLAKE2b-256 | a2d37bc3b903e17b7a409bfb9e660ad75882a22d597e5086ff96b0f8e411f95a |
Close
Hashes for openllm_core-0.3.0-cp39-cp39-macosx_10_16_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9728d4661cd24b77a79a7b09bc49d8acd4f05e9b1d2227b59beb79296c2e9f01 |
|
MD5 | f5e73a477566c858f95113aeadb670a3 |
|
BLAKE2b-256 | 64c80df1176cef98ef5ac02fdfe85553da6d0e96218bb2037817ba97583564fe |
Close
Hashes for openllm_core-0.3.0-cp39-cp39-macosx_10_16_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8e5cc5b3a7775970891e5811ab8303b26a27945c56ef30b4a60eb9f15d30c0f5 |
|
MD5 | e98f07943b4bef7a451011fa16c5927f |
|
BLAKE2b-256 | 9ec7cdaba2b3c8e28c7c13c9bb8006abd832b51ff78939f566a68e13e3935a52 |
Close
Hashes for openllm_core-0.3.0-cp39-cp39-macosx_10_16_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ee670a3c39a6642b36d75309070ee55eb90fa17a7f2ce6bbd4d4a48b0a5b443d |
|
MD5 | b24841ab5ee6e0479656c6332db06bf1 |
|
BLAKE2b-256 | 6864b50a21b3a47749076592e58886a4e92d173345b25538d5649d727f9eea2e |
Close
Hashes for openllm_core-0.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 359eccee8129fd3dd8f7e6602013da8cda75c211489862952bafbfdb7be0f09f |
|
MD5 | 9f3590a5c811423bf78e3cea72a87c54 |
|
BLAKE2b-256 | 7791124a7f6f43cefbcf8227d4fc8f7ef75f8029108c5ba578034b4b8cc7541d |
Close
Hashes for openllm_core-0.3.0-cp38-cp38-macosx_10_16_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c51e90b8ca1e6e750494e0d9c91761d14ecbc97450a2013a8e015292e7974908 |
|
MD5 | 0fbf3920f2adb998a93fecd6ae16fd13 |
|
BLAKE2b-256 | a406ce910b03693fe22f523f8ec7d331d8b98a838fb607adb932eee7a112fc52 |
Close
Hashes for openllm_core-0.3.0-cp38-cp38-macosx_10_16_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bef34ecc98ae8e1abeb83101eadcd033b96f66db59d5276e2c46001f0a617350 |
|
MD5 | cfd3b51e95fcceb2cceab7eee553db08 |
|
BLAKE2b-256 | dc3b0329f06317c5cf7d2c997d16d09c703f57757b09ba928e5ee9b02cf5d33b |
Close
Hashes for openllm_core-0.3.0-cp38-cp38-macosx_10_16_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0e9e3648beb2d04faa63c4114782fabc5f4381eae83cd8c03be514ea52e046ee |
|
MD5 | 77dbee75cbc505cafa1884fd1b2fcc32 |
|
BLAKE2b-256 | 69bc13175f867f4c1d033daf644baafae5607e35f0746fc006edb49999f1e465 |