script-normalization-kurdish-persian-arabic

Sleeping

SinaAhmadi commited on Jul 10, 2023

Commit

59dfad3

•

1 Parent(s): 7a9e350

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -77,8 +77,7 @@ def normalize(text, language_script):
         tokenizer=tokenizer,
         sequence_encoder=sequence_encoder,
     )
-    test_data.set_item(text)
-    # test_data.set_item(INPUT.rstrip())
     cfg=test_cfg
     _, _, hypotheses, trg_tokens, trg_scores, _ = predict(

         tokenizer=tokenizer,
         sequence_encoder=sequence_encoder,
     )
+    test_data.set_item(text.strip())
     cfg=test_cfg
     _, _, hypotheses, trg_tokens, trg_scores, _ = predict(