Mistral 7B Instruct v0.2 when trained with lora adapters is giving output without spaces.

#122
by Xlar - opened

Kindly help !!
The prompt format is as follows :-
mistral_instruct_prompt = '''

[INST] {} [/INST]
{}
'''

Here is the output by the model which is trained for 3 epochs on 156k rows of data. I have not copied the medical report. The question and output of model is as follows:-

""question:Can you provide a simplified paraphrase of the sentence, 'To avoid rapid deterioration and respiratory failure, a step-by-step approach was used for position changes' in the patient's discharge summary? """"
In other information does notions such as changing positions gradually rather than sudden movements which could cause distress breathabilitybreathletes who are injured person after surgery may use this technique when they start exercising again slowly build upwards more advancedexercisesgradually insteadthanableniencytically.'avoidentherapyprovidedailyprogressiveimprogresstodiscontinuationofsympthepatientrespondedwelltotreatmentappropriatemedsinterventionalhighstandardlevelcarenecessarytherapiemonitoringsupproffullerccareattirehabcentersubsequencypromonitormovexperienceshouldoversightlyreceivedfollowuplenienceachievedbeforeleadaycludingnewsymsconcernotificationtobehaviouralreadyfortransferringpatientspecialongradysignalsafeforwardspositionduringmonitorungmonitorsupportmedicemaskoxygenmaintainreliefrespirationassistdevicedevicesrampresureportssportsactivitieslowinitialstrengthwalkingeasthiketherequwintensivecarenursestaffnursehealthyfoodnutritionplanmealtimeschealthylowca

Sign up or log in to comment