Add infinity to readme
#39
by
michaelfeil
- opened
README.md
CHANGED
|
@@ -5575,6 +5575,15 @@ print(similarities)
|
|
| 5575 |
# [0.31938642 0.7853526 ]]
|
| 5576 |
```
|
| 5577 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5578 |
# FAQ
|
| 5579 |
|
| 5580 |
Q: The details of training?
|
|
|
|
| 5575 |
# [0.31938642 0.7853526 ]]
|
| 5576 |
```
|
| 5577 |
|
| 5578 |
+
## Infinity
|
| 5579 |
+
|
| 5580 |
+
Usage with [Infinity, MIT Licensed Inference Server](https://github.com/michaelfeil/infinity) and Docker.
|
| 5581 |
+
```bash
|
| 5582 |
+
docker run --gpus all -v $PWD/data:/app/.cache \
|
| 5583 |
+
michaelf34/infinity:0.0.69-trt-onnx \
|
| 5584 |
+
v2 --model-id dunzhang/stella_en_1.5B_v5 --batch-size 16 --device cuda --engine torch --port 7997
|
| 5585 |
+
```
|
| 5586 |
+
|
| 5587 |
# FAQ
|
| 5588 |
|
| 5589 |
Q: The details of training?
|