OpenLLM Core: Core components for OpenLLM.
Project description
📖 Introduction
With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps, and more.
To learn more about OpenLLM, please visit OpenLLM's README.md
This package holds the core components of OpenLLM, and considered as internal.
Components includes:
- Configuration generation.
- Utilities for interacting with OpenLLM server.
- Schema and generation utilities for OpenLLM server.
📔 Citation
If you use OpenLLM in your research, we provide a citation to use:
@software{Pham_OpenLLM_Operating_LLMs_2023,
author = {Pham, Aaron and Yang, Chaoyu and Sheng, Sean and Zhao, Shenyang and Lee, Sauyon and Jiang, Bo and Dong, Fog and Guan, Xipeng and Ming, Frost},
license = {Apache-2.0},
month = jun,
title = {{OpenLLM: Operating LLMs in production}},
url = {https://github.com/bentoml/OpenLLM},
year = {2023}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
openllm_core-0.2.27.tar.gz
(68.2 kB
view hashes)
Built Distributions
Close
Hashes for openllm_core-0.2.27-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 260dd66f0f9d09a201cd7ef5f5491f6d4682354ae81f295245fd162f2f261669 |
|
MD5 | 4b734b0114000e11ae254bb6cb01c599 |
|
BLAKE2b-256 | c51a820f42bfe325c4955ca773409b09358de09ce722b57efb4f6011c4e606d7 |
Close
Hashes for openllm_core-0.2.27-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4cd22552a8b7d0f8a28e48be80324443f10b4f244f7c32e8e4fb7de35db7f317 |
|
MD5 | aa53da0e6db5a1ce2c1dff69eb635990 |
|
BLAKE2b-256 | 7f55e6d08d432273c2f5947c5f48540bcbc6a7e07dc497ce27b3b8356b2f2ac5 |
Close
Hashes for openllm_core-0.2.27-cp311-cp311-macosx_10_16_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a8c0ad590076547e336b100189040691e5af06bc0dc1462f7cc241397033d3b5 |
|
MD5 | c680cb0eb89111fcc300065da88d71d8 |
|
BLAKE2b-256 | 045c114526b68770fd055e7a502e24aae0dcee2e70dfed5e83ed9e0771f6a770 |
Close
Hashes for openllm_core-0.2.27-cp311-cp311-macosx_10_16_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ea5aca1e1b9262df5f841a44ece8a76fdf1e3b61d60c44314768805246307468 |
|
MD5 | ef284e13df6fdfa04eeea73c7e65f747 |
|
BLAKE2b-256 | 59ce9cba268c821efd9cc1d8c8cec745a00fd3790dd3d68f4919da9eca90fc57 |
Close
Hashes for openllm_core-0.2.27-cp311-cp311-macosx_10_16_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e37db8ac09c6f6b74eb8f0d61c20dbf967b3037505294844190b09b973318f1d |
|
MD5 | 7a0b95cfbe31b1b8ea531ce5bff908f5 |
|
BLAKE2b-256 | c7bbfb8f08dddc1f80ffdfabe241385a93cca9ab9b0add647958469c52524f70 |
Close
Hashes for openllm_core-0.2.27-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b73bb98bcee8099093207d58d6458c08652d0bdeaa982494e0dc05edb8d16d23 |
|
MD5 | 65b718ed877f1fdda405fc6c6c62637d |
|
BLAKE2b-256 | a8c1d1a16543d15fece25c96f34a07941ae7d90d24692d921145a301a10c903d |
Close
Hashes for openllm_core-0.2.27-cp310-cp310-macosx_10_16_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4f76d22081c1e4f2538150afcede51c13044e6bc634c518b7889eab7ed34ebd9 |
|
MD5 | 0b638df8149ea37705a9dec7f2f8a4d5 |
|
BLAKE2b-256 | 48f691cd50c242519a3e98fffce90b6f13f84c7bfc37c90433587e1d498af847 |
Close
Hashes for openllm_core-0.2.27-cp310-cp310-macosx_10_16_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a885fa32da35b8687d4bd6774946180e5e7b60ba6568950fe0a41e4531c75e6f |
|
MD5 | 5156c7c89a1fe572eb927aee084609f3 |
|
BLAKE2b-256 | 9d2aca98373b56349317942b3acfe871e34b59df4194943876b272e26acf16be |
Close
Hashes for openllm_core-0.2.27-cp310-cp310-macosx_10_16_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d4cc83509c042cc55088ecf9dca8320a9a9f37732a8c5f5cc9ff47af0a39dce9 |
|
MD5 | 42cfe69e43c0623f514fa696d5857564 |
|
BLAKE2b-256 | 6d553a0d89134dad35126324c815aaaa488f0086472373b9b6d1436a0709cd07 |
Close
Hashes for openllm_core-0.2.27-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c5374148b558d3d95fdd5d814260096e1c4fa02105d9de6877c8e2ee84601958 |
|
MD5 | 87f81b212dbcaad72324f5aaee8083b8 |
|
BLAKE2b-256 | b77b53e5cadfd0c292f8afb87a43b6384767204f6bee11b199fba715a0920cb9 |
Close
Hashes for openllm_core-0.2.27-cp39-cp39-macosx_10_16_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 72cc96e14f6147978e7669ce0b012cf742d46b527cacfa61b27c8432cde980d3 |
|
MD5 | 7378c9e4535318212688bcde2daad583 |
|
BLAKE2b-256 | 0f0b67fa5310e637ba0a26bd1226ee2014511f35b10ff0772c75332e86844469 |
Close
Hashes for openllm_core-0.2.27-cp39-cp39-macosx_10_16_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a9c562fd9aa39df1b578173d3eb4786dc4e6a5beeffb92929a46d019104271e7 |
|
MD5 | 4905dce80f5169daea89b41e3f884dae |
|
BLAKE2b-256 | e78078d485b9c91eb8bdeb319dae90f4954b119f90fce7b111fa90c0d22f6851 |
Close
Hashes for openllm_core-0.2.27-cp39-cp39-macosx_10_16_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6c34466ed50053d7becb17f8788f9502309aa129d325e059f7988fc9c984fe13 |
|
MD5 | 8e995fba9615aefedfb2d2c771f306dc |
|
BLAKE2b-256 | 3824ff50e37a9451f7940b92233485eb897c890debf24b62ccce51e2b0ec9d9f |
Close
Hashes for openllm_core-0.2.27-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 323a2586a64a183a17fabcbbd9dc893548a606d545e1a21180c1d4a5e552893b |
|
MD5 | 656a017f46d94b436adc59db92dcb763 |
|
BLAKE2b-256 | 08fd20590be6602433ec8b9960399ab6c784f0bfec159ac518ab66d1809feed5 |
Close
Hashes for openllm_core-0.2.27-cp38-cp38-macosx_10_16_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba989f5cf9bcc373a78e4d9dc84d1cce00b5b5b39bf56d35bab18ca88af60ff8 |
|
MD5 | 436b434723e27fe2dc6d39459a6cc0f5 |
|
BLAKE2b-256 | 27e4206033bd232aa181416f0d7adbfa60aeb92b028adfcbd0b56f482e0d95ea |
Close
Hashes for openllm_core-0.2.27-cp38-cp38-macosx_10_16_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 06a2164194259b1cf8d4022a5d65aa127698e06f5caeaf93968df01a30a4a524 |
|
MD5 | 9de1a9fc9a39dc49646e0279b7b48c2f |
|
BLAKE2b-256 | 1c1803fc5089d945f6e54ed3f39fa4db0a3090373e298d0df90db093080b1d74 |
Close
Hashes for openllm_core-0.2.27-cp38-cp38-macosx_10_16_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a2f87f31bbe9f4d09652c2934ce7e0ffa5fb9b65d0ca18772e636cd50205e164 |
|
MD5 | 9f41224a4a86b86785d45e194ad3e1c2 |
|
BLAKE2b-256 | 61ee369cd7ae27090420c08aaec59936865133695d5880c17b6ef9afa4e75462 |