TroyDoesAI commited on
Commit
51a6fe6
·
verified ·
1 Parent(s): 64ffbeb

Update README.md

Browse files

Readme needed some love.

Files changed (1) hide show
  1. README.md +122 -1
README.md CHANGED
@@ -10,6 +10,127 @@ New Prompt Template.
10
 
11
  ---
12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  Example of what you would send to my model to get a flow graph that ends with ``` every time.
14
 
15
- https://drive.google.com/file/d/1z1QM9KZdg_VeH-tGwIY-cyxDas0ucnKc/view?usp=sharing
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
  ---
12
 
13
+ ---
14
+ license: apache-2.0
15
+ ---
16
+
17
+ **MermaidLLama: Unleashing the Power of Llama 3 - 8 Billion Parameters**
18
+
19
+ Introducing Mermaid-LLama-3-8B, a robust language model designed for Python code understanding and crafting captivating story flow maps.
20
+ With a petite 8.3 billion parameters, this model builds on the success of LLama 3's ability to maintain versatility in programming, mathematical reasoning,
21
+ and general language processing.
22
+
23
+ **Key Features:**
24
+
25
+ 1. **Code Understanding:**
26
+ - Masters Python intricacies with finesse.
27
+ - Generates clear and accurate Mermaid Diagram Flow Charts.
28
+ - Ideal for developers seeking visual representations of their code's logic to better solve problems.
29
+
30
+ 2. **Storytelling Capabilities:**
31
+ - Converts narrative inputs into captivating Mermaid Diagrams.
32
+ - Maps character interactions, plot developments, and narrative arcs.
33
+
34
+ 3. **Unmatched Performance:**
35
+ - Surpasses GPT-4 in generating well-organized and detailed Mermaid Diagrams, its not even a competition Mermaid's do it better.🧜‍♀️
36
+
37
+ 4. **Training Insights:**
38
+ - Trained on a diverse dataset, including 800 unique, hand curated Mermaid Graph examples utilizing 478 complete python programs (hand tested each program) rather than code snippets.
39
+ - Exhibits emergent properties in story-to-flow map translations and step by step instruction flow maps to which it was not trained for.
40
+ - Adaptable and willing to be Prompt Engineered for your specific utilization.
41
+
42
+ **Collaboration:**
43
+
44
+ Mermaid is open to collaboration to further enhance its capabilities.
45
+
46
+ If you're interested in contributing or collaborating, feel free to reach out to [email protected].
47
+ Your expertise could play a pivotal role in refining Mermaid.
48
+
49
+ **Example Use Cases:**
50
+
51
+ - **Code Documentation:**
52
+ Developers can use Mermaid to automatically generate visual flow charts from their Python code, aiding in documentation and code understanding.
53
+
54
+ - **Storyboarding:**
55
+ Storytellers and writers can input their narrative and receive visually appealing Mermaid Diagrams, offering a structured overview of character interactions and plot progression.
56
+
57
+ - **Project Planning:**
58
+ Project managers can create visual project flow maps, facilitating effective communication and planning among team members.
59
+
60
+ - **Learning Python:**
61
+ Students and beginners can visually understand Python code structures, enhancing their learning experience.
62
+
63
+ - **Game Design:**
64
+ Game developers can utilize Mermaid for visualizing game storylines, ensuring a coherent narrative structure and character development.
65
+
66
+ **Proof of Concept:**
67
+
68
+ Mermaid proves that innovation thrives in compact packages, delivering exceptional performance across diverse applications.
69
+
70
+ Stay tuned for the release of the VSCode Extension that displays the Live Flow Map every time a user stops typing for more than 10 seconds.
71
+
72
+ For best results, use full precision with one of the three different instruction types:
73
+
74
+ Exciting times ahead as we delve into the MermaidLLama revolution! 🚀
75
+
76
+ # Training:
77
+ LoRA Rank
78
+ - 2048
79
+
80
+ LoRA Alpha
81
+ - 4096
82
+
83
+ Batch Size
84
+ - 1
85
+
86
+ Micro Batch Size
87
+ - 1
88
+
89
+ Cutoff Length
90
+ - 4096
91
+
92
+ Save every n steps
93
+ - 1000
94
+
95
+ Epochs
96
+ - 3
97
+
98
+ Learning Rate
99
+ - 1e-6
100
+
101
+ LR Scheduler
102
+ - cosine
103
+
104
+
105
+ Target Modules
106
+
107
+ - Enable q_proj
108
+ - Enable v_proj
109
+ - Enable k_proj
110
+ - Enable o_proj
111
+ - Enable gate_proj
112
+ - Enable down_proj
113
+ - Enable up_proj
114
+
115
  Example of what you would send to my model to get a flow graph that ends with ``` every time.
116
 
117
+ https://drive.google.com/file/d/1z1QM9KZdg_VeH-tGwIY-cyxDas0ucnKc/view?usp=sharing
118
+ ---
119
+
120
+ Start by downloading one of my models.
121
+ ![0 TroyDoesAI GIF](Mermaid_ShowCase/0_TroyDoesAI.gif)
122
+
123
+ Load the model.
124
+ ![1 Load Model in 4-bit Show Example Use GIF](Mermaid_ShowCase/1_LoadModel_in_4bit_Show_Example_Use.gif)
125
+
126
+ Inference the model using my prompt template replacing your instruction and input to generate a Mermaid code block,
127
+ that can be viewed in the Mermaid Live Editor or Using the Mermaid CLI tool directly creating an image of the flow map.
128
+ More on the cli tool here: https://github.com/mermaid-js/mermaid-cli
129
+
130
+ ![2 Loaded Model in Full Precision 16-bit Show Inference and Mermaid Live Editor GIF](Mermaid_ShowCase/2_Loaded_Model_in_Full_Precision_16bit_Show_Inference_and_Mermaid_Live_editor.gif)
131
+
132
+ Here We Open the additional VLLM GUI Program I wrote for the example, while still running the Mermaid-Llama-8B to compare the flow diagram to the actual program.
133
+ ![3 Open The Program VLLM Program With Full Precision Mermaid-Llama-8B Running to Evaluate Flow Map GIF](Mermaid_ShowCase/3_Open_The_Program_VLLM_Program_With_Full_Precision_Mermaid-Llama-8B-Running_to_evaluate_flow_map.gif)
134
+
135
+ # More on my cute VLLM Class and inference GUI.
136
+ ![Python RtdBsaz8gy GIF](Mermaid_ShowCase/python_RtdBsaz8gy.gif)