checksum does not match
Hi!
For me everything goes fine until the last step, after calling xor_codec.py I get all the files but not with the correct checksum.
Do you know how I could debug it?
Update: JSON files are not correct json files. Looks like xor_codec.py did not work for me but don't know why
Update: JSON files are not correct json files. Looks like xor_codec.py did not work for me but don't know why
This seems to often happen for Windows users. Unfortunately we cannot assist with this (tested only on Ubuntu)
I am on ubuntu as well
@OllieStanley It seems the json on this repo are broken. Both trough git on ubuntu and by hand download (mac + chrome browser), they do not look like json
@OllieStanley It seems the json on this repo are broken. Both trough git on ubuntu and by hand download (mac + chrome browser), they do not look like json
They are not meant to be standalone JSONs, they are XOR differences from the LLaMA JSONs. When combined with those LLaMA JSONs they produce valid JSONs. Many users have successfully completed this process
@OllieStanley It seems the json on this repo are broken. Both trough git on ubuntu and by hand download (mac + chrome browser), they do not look like json
They are not meant to be standalone JSONs, they are XOR differences from the LLaMA JSONs. When combined with those LLaMA JSONs they produce valid JSONs. Many users have successfully completed this process
Error was on me! Thanks for the answers and for your work
Update: JSON files are not correct json files. Looks like xor_codec.py did not work for me but don't know why
This seems to often happen for Windows users. Unfortunately we cannot assist with this (tested only on Ubuntu)
I am on Ubuntu and have same issue the hash./added_tokens.json files do not match all other files are as expected by READ.ME
@OllieStanley It seems the json on this repo are broken. Both trough git on ubuntu and by hand download (mac + chrome browser), they do not look like json
They are not meant to be standalone JSONs, they are XOR differences from the LLaMA JSONs. When combined with those LLaMA JSONs they produce valid JSONs. Many users have successfully completed this process
Error was on me! Thanks for the answers and for your work
What was your solution to your problem?
It seems, the problem can be with CRLF on windows vs LF.
Have you solved this problem yet? The josn file seems to be garbled when it is opened
I did, convert CRLF to LF (before xor) or find the LLaMA json files with the required checksum here, on HF