Some utilities for tensorflow serving
Project description
# serving-utils
[![Build Status](https://travis-ci.org/Yoctol/serving-utils.svg?branch=master)](https://travis-ci.org/Yoctol/serving-utils) [![PyPI version](https://badge.fury.io/py/serving-utils.svg)](https://badge.fury.io/py/serving-utils)
Some python utilities when using tensorflow-serving.
## Installation
From PYPI:
1. Manually install tensorflow CPU or GPU version.
2. `pip install serving-utils`
From Github repository:
1. `git clone git@github.com:Yoctol/serving-utils.git`
2. `make install`
## Usage
1. Client
```python
from serving_utils import Client
client = Client(addr="localhost:8500")
client.predict(...)
# or async
await client.async_predict(...)
```
2. Saver
```python
import tensorflow as tf
from serving_utils import Saver
saver = Saver(
session=tf.Session(graph=your_graph),
output_dir='/path/to/serving',
signature_def_map={
'predict': tf.saved_model.signature_def_utils.predict_signature_def(
inputs={'tensor_name': tf.Tensor...},
outputs={'tensor_name': tf.Tensor...},
)
},
)
saver.save(...)
```
## Test
Run the following commands:
```
make lint
make test
```
## Dev
```
make install
```
[![Build Status](https://travis-ci.org/Yoctol/serving-utils.svg?branch=master)](https://travis-ci.org/Yoctol/serving-utils) [![PyPI version](https://badge.fury.io/py/serving-utils.svg)](https://badge.fury.io/py/serving-utils)
Some python utilities when using tensorflow-serving.
## Installation
From PYPI:
1. Manually install tensorflow CPU or GPU version.
2. `pip install serving-utils`
From Github repository:
1. `git clone git@github.com:Yoctol/serving-utils.git`
2. `make install`
## Usage
1. Client
```python
from serving_utils import Client
client = Client(addr="localhost:8500")
client.predict(...)
# or async
await client.async_predict(...)
```
2. Saver
```python
import tensorflow as tf
from serving_utils import Saver
saver = Saver(
session=tf.Session(graph=your_graph),
output_dir='/path/to/serving',
signature_def_map={
'predict': tf.saved_model.signature_def_utils.predict_signature_def(
inputs={'tensor_name': tf.Tensor...},
outputs={'tensor_name': tf.Tensor...},
)
},
)
saver.save(...)
```
## Test
Run the following commands:
```
make lint
make test
```
## Dev
```
make install
```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
serving-utils-0.4.5.tar.gz
(3.7 kB
view hashes)
Built Distribution
Close
Hashes for serving_utils-0.4.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1e486dfad3a67bbc7acdede4562692a5724acd60e300def003e0db01f5f39fe7 |
|
MD5 | bcf6f6cb7af72536cf966497aa935f3c |
|
BLAKE2b-256 | 66068df3eeae50b2a5aa7c9e2e37d263d96fd3ae39ebd830f3815c75902a33fe |