Update README.md

README.md

@@ -25,6 +25,29 @@ Made possible thanks to [a detailed notebook from Unsloth](https://colab.researc
 - "**wikimedia/wikipedia**:" (20231101.ja) for continued pretaining
 - "**FreedomIntelligence/alpaca-gpt4-japanese**" for instruction fine tuning
 
+# Inference Template:
+
+# Use a pipeline as a high-level helper
+
+```
+from transformers import pipeline
+
+pipe = pipeline("text-generation", model="Ryu-m0m/16bit-japanese-finetuned-mistral-7b-v0")
+
+instruction = "侍の歴史を簡単に教えてください。" # Can you give us a brief history of the Samurai?
+response = pipe(
+    instruction,
+    max_length=150,         # Controls the length of the output
+    temperature=0.7,        # Controls randomness; lower is more deterministic
+    top_k=50,               # Limits sampling pool to top 50 tokens
+    top_p=0.9,              # Nucleus sampling, considering tokens up to 90% cumulative probability
+    num_return_sequences=1  # Generates only one response
+)
+
+print(response[0]['generated_text'])
+
+```
+
 # Uploaded  model
 
 - **Developed by:** Ryu-m0m