Metadata-Version: 2.1
Name: tritonv2
Version: 0.2.0
Summary: project descriptions here
Home-page: https://console.cloud.baidu-int.com/devops/icode/repos/baidu/themis/windmill-endpoint/tree/master
Author: zhoubohan
Author-email: zhoubohan@baidu.com
License: MIT
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Requires-Python: >=3.7
Description-Content-Type: text/markdown

# tritonv2
A client library for promote triton official client

## Installation

```bash
pip install tritonv2==0.2.0
```

## Usage

First, you need to create a client object.

```python
from tritonv2.client_factory import TritonClientFactory
server_url = "localhost:8000"

http_client = TritonClientFactory.create_grpc_client(server_url)
or
async with TritonClientFactory.create_http_aio_client(server_url) as http_aio_client
or 
grpc_client = TritonClientFactory.create_grpc_client(server_url)
or
async with TritonClientFactory.create_grpc_aio_client(server_url) as grpc_aio_client
```
In addition, you can set retry for grpc client:<br>
```python
client = TritonClientFactory.create_grpc_client(server_url, num_retries=3,max_interval_secs=20,base_interval_secs=0.3)
```
for http client we have default setting:<br>
```python
NUMBER_RETRIES = 3
MAX_INTERVAL_SECS = 20
BASE_INTERVAL_SECS = 0.3
```

Now you can easy use the client to send requests to the server.

for server:

```python
client.server_live()
client.server_ready()
client.server_metadata()
```

for model:

```python
client.model_metadata(model_name)
client.model_config(model_name)
client.model_ready(model_name)
client.model_statistics(model_name)
```

for infer:
```python
client.model_infer(model_name, inputs, model_version, outputs)
client.stream_infer(inputs_iterator)
```

for repository:
```python
client.repository_index()
client.repository_model_load(model_name)
client.repository_model_unload(model_name)
```

for system shared memory:
```python
client.system_shared_memory_status()
client.system_shared_memory_register()
client.system_shared_memory_unregister()
```

for cuda shared memory:
```python
client.cuda_shared_memory_status()
client.cuda_shared_memory_register()
client.cuda_shared_memory_unregister()
```

for trace setting:
```python
client.trace_setting()
client.get_trace_settings()
```



