RedHatAI
/

gpt-oss-20b

Text Generation

text-generation-inference

8-bit precision

8-bit precision

Model card Files Files and versions

robgreenberg3 commited on 14 days ago

Commit

da5030f

·

verified ·

1 Parent(s): b9af430

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -217,7 +217,7 @@ spec:
           memory: 4Gi
           nvidia.com/gpu: '1'
       runtime: vllm-cuda-runtime	# must match the ServingRuntime name above
-      storageUri: oci://registry.redhat.io/rhelai1/gpt-oss-20b:1.5
     tolerations:
     - effect: NoSchedule
       key: nvidia.com/gpu

           memory: 4Gi
           nvidia.com/gpu: '1'
       runtime: vllm-cuda-runtime	# must match the ServingRuntime name above
+      storageUri: oci://registry.redhat.io/rhelai1/modelcar-gpt-oss-20b:1.5
     tolerations:
     - effect: NoSchedule
       key: nvidia.com/gpu