Intel
/

roberta-base-squad2-int8-static-inc

Intel® Neural Compressor

PostTrainingStatic

Inference Endpoints

Model card Files Files and versions Community

violetch24 commited on Nov 16, 2022

Commit

bab0264

•

1 Parent(s): d56926a

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -32,8 +32,8 @@ The linear modules **roberta.encoder.layer.7.output.dense**, **roberta.encoder.l
 ### Load with optimum:
 ```python
-from optimum.intel.neural_compressor.quantization import IncQuantizedModelForCausalLM
-int8_model = IncQuantizedModelForCausalLM.from_pretrained(
     'Intel/roberta-base-squad2-int8-static',
 )
 ```

 ### Load with optimum:
 ```python
+from optimum.intel.neural_compressor.quantization import IncQuantizedModelForQuestionAnswering
+int8_model = IncQuantizedModelForQuestionAnswering.from_pretrained(
     'Intel/roberta-base-squad2-int8-static',
 )
 ```