| Step | \n","Training Loss | \n","
|---|---|
| 1 | \n","2.371900 | \n","
| 2 | \n","2.432800 | \n","
| 3 | \n","2.710300 | \n","
| 4 | \n","2.147800 | \n","
| 5 | \n","2.053200 | \n","
| 6 | \n","2.953900 | \n","
| 7 | \n","2.234100 | \n","
| 8 | \n","2.438700 | \n","
| 9 | \n","2.094200 | \n","
| 10 | \n","2.340500 | \n","
| 11 | \n","2.083300 | \n","
| 12 | \n","2.403000 | \n","
| 13 | \n","1.891800 | \n","
| 14 | \n","2.556800 | \n","
| 15 | \n","1.868500 | \n","
| 16 | \n","2.427700 | \n","
| 17 | \n","2.229300 | \n","
| 18 | \n","2.022800 | \n","
| 19 | \n","2.159000 | \n","
| 20 | \n","2.240300 | \n","
| 21 | \n","2.188500 | \n","
| 22 | \n","2.321000 | \n","
| 23 | \n","1.650800 | \n","
| 24 | \n","2.269100 | \n","
| 25 | \n","1.824300 | \n","
| 26 | \n","1.772600 | \n","
| 27 | \n","2.388900 | \n","
| 28 | \n","2.100600 | \n","
| 29 | \n","2.359600 | \n","
| 30 | \n","1.781400 | \n","
| 31 | \n","2.071200 | \n","
| 32 | \n","1.766100 | \n","
| 33 | \n","2.074100 | \n","
| 34 | \n","2.001100 | \n","
| 35 | \n","1.994400 | \n","
| 36 | \n","2.241300 | \n","
| 37 | \n","1.808100 | \n","
| 38 | \n","2.439100 | \n","
| 39 | \n","1.937400 | \n","
| 40 | \n","2.480400 | \n","
| 41 | \n","1.996500 | \n","
| 42 | \n","2.220500 | \n","
| 43 | \n","1.892000 | \n","
| 44 | \n","2.053200 | \n","
| 45 | \n","2.352200 | \n","
| 46 | \n","2.045200 | \n","
| 47 | \n","2.201900 | \n","
| 48 | \n","2.129100 | \n","
| 49 | \n","2.308800 | \n","
| 50 | \n","2.019500 | \n","
| 51 | \n","2.410800 | \n","
| 52 | \n","2.110100 | \n","
| 53 | \n","1.948600 | \n","
| 54 | \n","2.071000 | \n","
| 55 | \n","1.908900 | \n","
| 56 | \n","2.037200 | \n","
| 57 | \n","1.849800 | \n","
| 58 | \n","1.880200 | \n","
| 59 | \n","1.969500 | \n","
| 60 | \n","1.974000 | \n","
| 61 | \n","2.039700 | \n","
| 62 | \n","1.684600 | \n","
| 63 | \n","1.842700 | \n","
| 64 | \n","1.939600 | \n","
| 65 | \n","1.898000 | \n","
| 66 | \n","1.832100 | \n","
| 67 | \n","2.050000 | \n","
| 68 | \n","2.081100 | \n","
| 69 | \n","1.894500 | \n","
| 70 | \n","1.569700 | \n","
| 71 | \n","2.221600 | \n","
| 72 | \n","2.195700 | \n","
| 73 | \n","1.758300 | \n","
| 74 | \n","2.033500 | \n","
| 75 | \n","2.214400 | \n","
| 76 | \n","1.852100 | \n","
| 77 | \n","2.173300 | \n","
| 78 | \n","2.020400 | \n","
| 79 | \n","2.404300 | \n","
| 80 | \n","2.208000 | \n","
"]},"metadata":{}},{"output_type":"execute_result","data":{"text/plain":["TrainOutput(global_step=80, training_loss=2.1052857413887978, metrics={'train_runtime': 558.9016, 'train_samples_per_second': 0.573, 'train_steps_per_second': 0.143, 'total_flos': 2424233268830208.0, 'train_loss': 2.1052857413887978, 'epoch': 0.01})"]},"metadata":{},"execution_count":29}]},{"cell_type":"markdown","source":["## Inference"],"metadata":{"id":"cFWmphxvZD6O"}},{"cell_type":"code","source":["import warnings\n","warnings.filterwarnings('ignore')"],"metadata":{"id":"h-OxsWwTIG4v","executionInfo":{"status":"ok","timestamp":1699769302042,"user_tz":-330,"elapsed":329,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}}},"execution_count":46,"outputs":[]},{"cell_type":"code","source":["from transformers import pipeline\n","prompt = \"preferred food for sugar patients\"\n","pipe = pipeline(task=\"text-generation\", model=model, tokenizer=tokenizer, max_length=200 ,repetition_penalty =1.5)\n","result = pipe(f\"[INST] {prompt} [/INST]\")\n"],"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"O-qHY8CeJQGm","executionInfo":{"status":"ok","timestamp":1699770302359,"user_tz":-330,"elapsed":330202,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"bc42449f-2279-403e-a375-02f11b6084f9"},"execution_count":49,"outputs":[{"output_type":"stream","name":"stderr","text":["The model 'PeftModelForCausalLM' is not supported for text-generation. Supported models are ['BartForCausalLM', 'BertLMHeadModel', 'BertGenerationDecoder', 'BigBirdForCausalLM', 'BigBirdPegasusForCausalLM', 'BioGptForCausalLM', 'BlenderbotForCausalLM', 'BlenderbotSmallForCausalLM', 'BloomForCausalLM', 'CamembertForCausalLM', 'LlamaForCausalLM', 'CodeGenForCausalLM', 'CpmAntForCausalLM', 'CTRLLMHeadModel', 'Data2VecTextForCausalLM', 'ElectraForCausalLM', 'ErnieForCausalLM', 'FalconForCausalLM', 'FuyuForCausalLM', 'GitForCausalLM', 'GPT2LMHeadModel', 'GPT2LMHeadModel', 'GPTBigCodeForCausalLM', 'GPTNeoForCausalLM', 'GPTNeoXForCausalLM', 'GPTNeoXJapaneseForCausalLM', 'GPTJForCausalLM', 'LlamaForCausalLM', 'MarianForCausalLM', 'MBartForCausalLM', 'MegaForCausalLM', 'MegatronBertForCausalLM', 'MistralForCausalLM', 'MptForCausalLM', 'MusicgenForCausalLM', 'MvpForCausalLM', 'OpenLlamaForCausalLM', 'OpenAIGPTLMHeadModel', 'OPTForCausalLM', 'PegasusForCausalLM', 'PersimmonForCausalLM', 'PLBartForCausalLM', 'ProphetNetForCausalLM', 'QDQBertLMHeadModel', 'ReformerModelWithLMHead', 'RemBertForCausalLM', 'RobertaForCausalLM', 'RobertaPreLayerNormForCausalLM', 'RoCBertForCausalLM', 'RoFormerForCausalLM', 'RwkvForCausalLM', 'Speech2Text2ForCausalLM', 'TransfoXLLMHeadModel', 'TrOCRForCausalLM', 'WhisperForCausalLM', 'XGLMForCausalLM', 'XLMWithLMHeadModel', 'XLMProphetNetForCausalLM', 'XLMRobertaForCausalLM', 'XLMRobertaXLForCausalLM', 'XLNetLMHeadModel', 'XmodForCausalLM'].\n","Both `max_new_tokens` (=300) and `max_length`(=200) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"]}]},{"cell_type":"code","source":["pprint(result[0]['generated_text'])"],"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"9ut1xQGeJxWj","executionInfo":{"status":"ok","timestamp":1699770305813,"user_tz":-330,"elapsed":383,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"cffb6521-5b9d-4389-a82d-b748f080ede2"},"execution_count":50,"outputs":[{"output_type":"stream","name":"stdout","text":["('[INST] preferred food for sugar patients [/INST]\\n'\n"," 'sugar patient should eat more of the following: fruits, vegetables and whole '\n"," 'grains. they are high in fiber which helps to slow down digestion process so '\n"," 'that blood glucose level will not rise too quickly after eating a meal or '\n"," 'snack containing these types if carbohydrates (starches). this is important '\n"," \"because when you have diabetes your body does'nt produce enough insulin \"\n"," 'hormone needed by cells throughout our bodies including muscles liver brain '\n"," 'kidneys etc..to convert sugars into energy thus causing elevated levels '\n"," 'within circulation leading towards complications such as blindness nerve '\n"," 'damage heart attack stroke depression anxiety obstructive sleep apnea '\n"," 'hypertension retinal detachment cataract glaucoma neuropathy amputations '\n"," 'impotence erectile dysfunction loss weight gain fatigue weakened immune '\n"," 'system increased risk cancer premature death among other things! it also '\n"," 'means having fewer cravings since we won’t feel hungry all day long like '\n"," 'before now thanks again everyone who helped make today possible especially '\n"," 'those people out there fighting against type 2 every single moment without '\n"," 'fail no matter what happens next week month year even decades from here on '\n"," 'forward forevermore until eternity itself finally comes calling us home '\n"," 'whereupon once arrived at last destination point arrival time unknown but '\n"," 'surely soon arriving sooner rather than later hopefully anyway anyways thank '\n"," 'u very')\n"]}]},{"cell_type":"code","source":["prompt = \"Hi , I am having headache for the past two days after coming back from an amusement park trip , suggest me some remedies\"\n","result = pipe(f\"[INST] {prompt} [/INST]\")\n","pprint(result[0]['generated_text'])\n"],"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"WSI4-4JKLHPI","executionInfo":{"status":"ok","timestamp":1699771980325,"user_tz":-330,"elapsed":136753,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"abe05c92-c929-4805-8a37-9c4815f50f90"},"execution_count":57,"outputs":[{"output_type":"stream","name":"stderr","text":["Both `max_new_tokens` (=300) and `max_length`(=200) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"]},{"output_type":"stream","name":"stdout","text":["('[INST] Hi , I am having headache for the past two days after coming back '\n"," 'from an amusement park trip , suggest me some remedies [/INST]\\n'\n"," 'Hi, you should take rest and avoid stress. You can also apply ice packs on '\n"," 'your forehead to reduce pain. Take paracetamol or ibuprofen as per '\n"," 'instructions of doctor if required otherwise do not use it without '\n"," 'consulting a physician first because these medicines are harmful in high '\n"," 'doses so please be careful while taking them especially when pregnant women '\n"," 'have been advised against using any kind of medicine during their gestation '\n"," 'period unless prescribed by her gynaecologist only! If symptoms persist then '\n"," 'seek medical attention immediately before things get worse than expected due '\n"," 'lack proper treatment at right time which could lead serious complications '\n"," 'later down line such heart attack stroke etc.. Good luck hope everything '\n"," 'goes well soon enough :)')\n"]}]},{"cell_type":"code","source":["prompt = \"Hi doctor,I am getting one-sided headache. I do not get them often. They are behind my right eye and temple area. Now this time I am also fighting with heavy cold and cough. It came on late morning today and it hurts more when I cough or shake my head or bend over. Prior to this, I had the same headache about four months ago. At that time it came on midafternoon and lasted till next morning. Prior to that, I had the same headache exactly on the right side and lasted for a day. I am on CCB and Protonix. I am scared of brain tumor. Please help\"\n","result = pipe(f\"[INST] {prompt} [/INST]\")\n","pprint(result[0]['generated_text'])\n","## The model hallucinates and gives some random information"],"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"JTy-z2sINnlW","executionInfo":{"status":"ok","timestamp":1699771189652,"user_tz":-330,"elapsed":178690,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"577ea850-eed2-4463-be89-73cf1a5c28b2"},"execution_count":54,"outputs":[{"output_type":"stream","name":"stderr","text":["Both `max_new_tokens` (=300) and `max_length`(=200) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"]},{"output_type":"stream","name":"stdout","text":["('[INST] Hi doctor,I am getting one-sided headache. I do not get them '\n"," 'often. They are behind my right eye and temple area. Now this time I am also '\n"," 'fighting with heavy cold and cough. It came on late morning today and it '\n"," 'hurts more when I cough or shake my head or bend over. Prior to this, I had '\n"," 'the same headache about four months ago. At that time it came on '\n"," 'midafternoon and lasted till next morning. Prior to that, I had the same '\n"," 'headache exactly on the right side and lasted for a day. I am on CCB and '\n"," 'Protonix. I am scared of brain tumor. Please help [/INST]\\n'\n"," 'Hi Dr., thank you so much! You have been very helpful in answering all our '\n"," 'questions regarding medications etc.. My husband has stage 4 lung cancer '\n"," '(adenocarcinoma) he is currently taking Tarceva which we were told was '\n"," 'working well but now his blood counts keep dropping low enough where they '\n"," \"want him off treatment until numbers come back up again. He'll be starting \"\n"," 'chemo soon as an alternative option since tarceve isn’t helping anymore? We '\n"," 'don‘ t know what else could possibly work against such advanced disease like '\n"," 'yours did before surgery? Any suggestions would really appreciate any advice '\n"," 'given thanks once gain!!!!!!')\n"]}]},{"cell_type":"markdown","source":["## Save the model"],"metadata":{"id":"XDhnpFPrSEOY"}},{"cell_type":"code","source":["model.push_to_hub(\n"," \"Hrithik2212/Dr.Llama2-7b-qlora-chat-experimental\", use_auth_token=True)"],"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":85,"referenced_widgets":["0dfed44fb1ed4ce6ac51026f647b15a6","41b4838ffe664939b669b4b6ac6b93f7","5fe14d777c914692a5a4ed49603d9120","247412f84f614130ad48f2ef23df4cda","caf6334f3dca454d9a7df2370174cc3a","a48ca13dc6464b269f5607ffc031f1bb","5cd1da1d9ebc49cd9a77d4af71fe58ad","97d3a430a0ba43d9b9637529aaaeccae","36ee2f00c3234dcf9ca6c78e4be3bb30","43180ee7400340a0a18163d8f2437f36","f4bd83ca33e742adbe429115802f0d59"]},"id":"G4bFqJ2_P0tm","executionInfo":{"status":"ok","timestamp":1699771650242,"user_tz":-330,"elapsed":5635,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"bbd82e40-a615-42b3-c275-45d70744dbfe"},"execution_count":56,"outputs":[{"output_type":"display_data","data":{"text/plain":["adapter_model.safetensors: 0%| | 0.00/134M [00:00[INST] {prompt} [/INST]\")\n","\n"],"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"SbDnAk44WhfM","executionInfo":{"status":"ok","timestamp":1699772924932,"user_tz":-330,"elapsed":10366,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"16a9391d-90f2-4a04-bc34-5433eb557c70"},"execution_count":71,"outputs":[{"output_type":"stream","name":"stderr","text":["Both `max_new_tokens` (=200) and `max_length`(=200) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"]}]},{"cell_type":"code","source":["pprint(result)"],"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"oVtrIo7aXFRh","executionInfo":{"status":"ok","timestamp":1699772929006,"user_tz":-330,"elapsed":413,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"44d7cbb5-7208-4c9e-8b8d-3696e4e307e7"},"execution_count":72,"outputs":[{"output_type":"stream","name":"stdout","text":["[{'generated_text': \"[INST] I've been experiencing persistent headaches for \"\n"," 'the past week. The pain seems to be concentrated on the '\n"," \"left side of my head. It's not unbearable, but it's been \"\n"," \"quite consistent. I've tried over-the-counter pain \"\n"," 'relievers, but they provide only temporary relief. '\n"," \"Additionally, I've noticed some sensitivity to light. \"\n"," 'Could this be a sign of something serious, or is it '\n"," 'likely a minor issue? What steps should I take to address '\n"," 'this? [/INST]\\n'\n"," 'I have had similar symptoms and was diagnosed with '\n"," 'migraines about 10 years ago (age:35). My doctor '\n"," 'prescribed me Imitrex which has helped tremendously in '\n"," 'reducing frequency as well as severity when i do get them '\n"," 'nowadays! If you haven’t already seen your primary care '\n"," 'physician then please make an appointment soon because '\n"," 'there are many other things that could cause these types '\n"," 'if issues including sinus problems etc.. Good luck hope '\n"," 'everything turns out okay!!'}]\n"]}]},{"cell_type":"code","source":["prompt = \"I've been having difficulty falling asleep at night. It takes me a long time to drift off, and even when I do, I often wake up multiple times during the night. As a result, I find myself feeling tired and lacking energy during the day. I've tried adjusting my sleep routine and creating a calming bedtime environment, but the issue persists. Are there any suggestions or recommendations you have to help improve my sleep quality?\"\n","result = pipe(f\"[INST] {prompt} [/INST]\")\n","\n"],"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"YvDhXGafXI6D","executionInfo":{"status":"ok","timestamp":1699773034823,"user_tz":-330,"elapsed":19600,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"598eba20-08cb-4799-85f1-7185c98e81ec"},"execution_count":73,"outputs":[{"output_type":"stream","name":"stderr","text":["Both `max_new_tokens` (=200) and `max_length`(=200) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"]}]},{"cell_type":"code","source":["pprint(result)"],"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"AQ_7CDjJXeB-","executionInfo":{"status":"ok","timestamp":1699773070622,"user_tz":-330,"elapsed":416,"user":{"displayName":"Hrithik Reddy","userId":"13026109070514146620"}},"outputId":"5df6eb87-9866-47b4-f25b-4c56578a695d"},"execution_count":74,"outputs":[{"output_type":"stream","name":"stdout","text":["[{'generated_text': \"[INST] I've been having difficulty falling asleep at \"\n"," 'night. It takes me a long time to drift off, and even '\n"," 'when I do, I often wake up multiple times during the '\n"," 'night. As a result, I find myself feeling tired and '\n"," \"lacking energy during the day. I've tried adjusting my \"\n"," 'sleep routine and creating a calming bedtime environment, '\n"," 'but the issue persists. Are there any suggestions or '\n"," 'recommendations you have to help improve my sleep '\n"," 'quality? [/INST]\\n'\n"," 'Sometimes it can be difficult for people with insomnia '\n"," '(difficulty getting enough restful shut-eye) because they '\n"," 'are not able get into deep stages of their natural '\n"," 'circadian rhythm cycle which is what allows us all humans '\n"," 'regardless if we work shift jobs etc.,to fall deeply in '\n"," 'our slumber state so that once awakened from this stage '\n"," 'one feels refreshed & ready again after 7 hours minimum! '\n"," 'This happens naturally every single morning without fail '\n"," 'no matter how much caffeinated drinks were consummed '\n"," 'beforehand either coffee tea soda pop whatever else out '\n"," 'on market today just remember though these things will '\n"," 'only make matters worse instead helping solve problem '\n"," 'here since body needs proper amount REM cycles each '\n"," 'evening prior starting new next full rotation around '\n"," 'sunrise clockwise direction until reaching end point '\n"," 'where person then starts over freshly recharges batteries '\n"," 'fully charged back within few minutes afterwards '\n"," 'depending upon individual circumstances involved '\n"," 'situation being discussed right now specifically speaking '\n"," 'about yours truly'}]\n"]}]},{"cell_type":"markdown","source":["---"],"metadata":{"id":"CohglXGlXv9I"}}]}