base_model: DevQuasar/llama3_8b_chat_brainstorm
datasets:
- DevQuasar/brainstorm_vicuna_1k
inference: true
license: apache-2.0
model_context_window: 8192
model_creator: DevQuasar
model_name: llama3_8b_chat_brainstorm
pipeline_tag: text-generation
quantized_by: afrideva
tags:
- gguf
- ggml
- quantized
llama3_8b_chat_brainstorm-GGUF
Quantized GGUF model files for llama3_8b_chat_brainstorm from DevQuasar
Original Model Card:
Model intention
Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas.
Examples
Inference code
https://github.com/csabakecskemeti/ai_utils/blob/main/brainstorm_inference.py
Example generations
[USER] (Ctrl+C to exit): Today I'm gonna buy all healthy product at the grocery store.
[CHAT]: What kind of healthy products are you thinking of buying?
[USER] (Ctrl+C to exit): Mainly vegetables, and some lean white meet like fish and chicken
[CHAT]: Have you considered organic produce for your veggies?
[USER] (Ctrl+C to exit): I'm thinking to invest in a franchise to get a new source of income.
[CHAT]: That's an interesting idea! What kind of franchises are you considering?
[USER] (Ctrl+C to exit): Something that is a small upfront cost, not sure what would be a great choice.
[CHAT]: Have you considered food-related franchises like pizza or ice cream shops? They often have low startup costs.
[USER] (Ctrl+C to exit): But that risky due to publich healt requirements
[CHAT]: You're right, there are some regulations to consider. How would you plan to mitigate those risks?
[USER] (Ctrl+C to exit): I guess do some other non food related franchise
[CHAT]: What about a business service franchise like janitorial or landscaping services? Those might have lower regulatory burdens.