Update README.md

README.md

@@ -14,7 +14,7 @@ language:
 
 <!-- Provide a quick summary of what the model is/does. -->
 
-**For transformers versions v4.40.0 or newer, please use [OLMo 7B HF](https://huggingface.co/allenai/OLMo-7B-hf) instead.**
+**For transformers versions v4.40.0 or newer, we suggest using [OLMo 7B HF](https://huggingface.co/allenai/OLMo-7B-hf) instead.**
 
 OLMo is a series of **O**pen **L**anguage **Mo**dels designed to enable the science of language models.
 The OLMo models are trained on the [Dolma](https://huggingface.co/datasets/allenai/dolma) dataset.
@@ -44,8 +44,9 @@ In particular, we focus on four revisions of the 7B models:
 
 To load a specific model revision with HuggingFace, simply add the argument `revision`:
 ```bash
-import hf_olmo # pip install ai2-olmo
-olmo = AutoModelForCausalLM.from_pretrained("allenai/OLMo-7B", revision="step1000-tokens4B")
+from hf_olmo import OLMoForCausalLM  # pip install ai2-olmo
+
+olmo = OLMoForCausalLM.from_pretrained("allenai/OLMo-7B", revision="step1000-tokens4B")
 ```
 
 All revisions/branches are listed in the file `revisions.txt`. 
@@ -95,11 +96,10 @@ pip install ai2-olmo
 ```
 Now, proceed as usual with HuggingFace:
 ```python
-import hf_olmo
+from hf_olmo import OLMoForCausalLM, OLMoTokenizerFast
 
-from transformers import AutoModelForCausalLM, AutoTokenizer
-olmo = AutoModelForCausalLM.from_pretrained("allenai/OLMo-7B")
-tokenizer = AutoTokenizer.from_pretrained("allenai/OLMo-7B")
+olmo = OLMoForCausalLM.from_pretrained("allenai/OLMo-7B")
+tokenizer = OLMoTokenizerFast.from_pretrained("allenai/OLMo-7B")
 message = ["Language modeling is "]
 inputs = tokenizer(message, return_tensors='pt', return_token_type_ids=False)
 # optional verifying cuda
@@ -109,17 +109,8 @@ response = olmo.generate(**inputs, max_new_tokens=100, do_sample=True, top_k=50,
 print(tokenizer.batch_decode(response, skip_special_tokens=True)[0])
 >> 'Language modeling is the first step to build natural language generation...'
 ```
-Alternatively, with the pipeline abstraction:
-```python
-import hf_olmo
-
-from transformers import pipeline
-olmo_pipe = pipeline("text-generation", model="allenai/OLMo-7B")
-print(olmo_pipe("Language modeling is "))
->> 'Language modeling is a branch of natural language processing that aims to...'
-```
 
-Or, you can make this slightly faster by quantizing the model, e.g. `AutoModelForCausalLM.from_pretrained("allenai/OLMo-7B", torch_dtype=torch.float16, load_in_8bit=True)` (requires `bitsandbytes`).
+You can make this slightly faster by quantizing the model, e.g. `AutoModelForCausalLM.from_pretrained("allenai/OLMo-7B", torch_dtype=torch.float16, load_in_8bit=True)` (requires `bitsandbytes`).
 The quantized model is more sensitive to typing / cuda, so it is recommended to pass the inputs as `inputs.input_ids.to('cuda')` to avoid potential issues.
 
 Note, you may see the following error if `ai2-olmo` is not installed correctly, which is caused by internal Python check naming. We'll update the code soon to make this error clearer.