Spaces:
Running
on
Zero
Running
on
Zero
message updates
Browse files- app/messages.py +5 -6
app/messages.py
CHANGED
@@ -19,12 +19,11 @@ Choose 2 candidates and vote on which one is better! Currently in beta.
|
|
19 |
|
20 |
INSTR = """
|
21 |
* Press ⚡ to quickly get cached sample pairs you've yet to vote on. (Fast 🐇)
|
22 |
-
* Or press 🎲
|
23 |
* Or input text (🇺🇸 English only) to synthesize audio. (Slowest 🐌)
|
24 |
* _Listen to the two audio clips, one after the other and then vote on which audio sounds more natural to you._
|
25 |
* Model names are revealed after the vote is cast.
|
26 |
-
|
27 |
-
⚠ Note: It **may take up to 30 seconds** to ***synthesize*** audio.
|
28 |
""".strip()
|
29 |
|
30 |
request = ""
|
@@ -39,7 +38,7 @@ The TTS Arena evaluates leading speech synthesis models. It is inspired by LMsys
|
|
39 |
### Motivation
|
40 |
The field of speech synthesis has long lacked an accurate method to measure the quality of different models. Objective metrics like WER (word error rate) are unreliable measures of model quality, and subjective measures such as MOS (mean opinion score) are typically small-scale experiments conducted with few listeners. As a result, these measurements are generally not useful for comparing two models of roughly similar quality. To address these drawbacks, we are inviting the community to rank models in an easy-to-use interface, and opening it up to the public in order to make both the opportunity to rank models, as well as the results, more easily accessible to everyone.
|
41 |
### The Arena
|
42 |
-
The leaderboard allows a user to enter text, which will be synthesized by two models.
|
43 |
### Credits
|
44 |
Thank you to the following individuals who helped make this project possible:
|
45 |
* VB ([Twitter](https://twitter.com/reach_vb) / [Hugging Face](https://huggingface.co/reach-vb))
|
@@ -51,14 +50,14 @@ Thank you to the following individuals who helped make this project possible:
|
|
51 |
* Apolinário Passos ([Twitter](https://twitter.com/multimodalart) / [Hugging Face](https://huggingface.co/multimodalart))
|
52 |
* Pedro Cuenca ([Twitter](https://twitter.com/pcuenq) / [Hugging Face](https://huggingface.co/pcuenq))
|
53 |
|
54 |
-
\* ***You are currently in a cloned/forked space of TTS-AGI/TTS-Arena***
|
55 |
|
56 |
{request}
|
57 |
### Privacy statement
|
58 |
We may store text you enter and generated audio. We store a unique ID for each session. You agree that we may collect, share, and/or publish any data you input for research and/or commercial purposes.
|
59 |
### License
|
60 |
Generated audio clips cannot be redistributed and may be used for personal, non-commercial use only.
|
61 |
-
Random sentences are sourced from a filtered subset of the [Harvard Sentences](https://www.cs.columbia.edu/~hgs/audio/harvard.html).
|
62 |
""".strip()
|
63 |
|
64 |
LDESC = f"""
|
|
|
19 |
|
20 |
INSTR = """
|
21 |
* Press ⚡ to quickly get cached sample pairs you've yet to vote on. (Fast 🐇)
|
22 |
+
* Or press 🎲 pick a random sentence from a prepared list. (Slow 🐢)
|
23 |
* Or input text (🇺🇸 English only) to synthesize audio. (Slowest 🐌)
|
24 |
* _Listen to the two audio clips, one after the other and then vote on which audio sounds more natural to you._
|
25 |
* Model names are revealed after the vote is cast.
|
26 |
+
* You can use a [hotkey] for quicker voting.
|
|
|
27 |
""".strip()
|
28 |
|
29 |
request = ""
|
|
|
38 |
### Motivation
|
39 |
The field of speech synthesis has long lacked an accurate method to measure the quality of different models. Objective metrics like WER (word error rate) are unreliable measures of model quality, and subjective measures such as MOS (mean opinion score) are typically small-scale experiments conducted with few listeners. As a result, these measurements are generally not useful for comparing two models of roughly similar quality. To address these drawbacks, we are inviting the community to rank models in an easy-to-use interface, and opening it up to the public in order to make both the opportunity to rank models, as well as the results, more easily accessible to everyone.
|
40 |
### The Arena
|
41 |
+
The leaderboard allows a user to enter text, which will be synthesized by two models. Only after fully listening to each sample, the user can vote on which model sounds more natural. Due to the risks of human bias and abuse, model names are revealed only after a vote is submitted.
|
42 |
### Credits
|
43 |
Thank you to the following individuals who helped make this project possible:
|
44 |
* VB ([Twitter](https://twitter.com/reach_vb) / [Hugging Face](https://huggingface.co/reach-vb))
|
|
|
50 |
* Apolinário Passos ([Twitter](https://twitter.com/multimodalart) / [Hugging Face](https://huggingface.co/multimodalart))
|
51 |
* Pedro Cuenca ([Twitter](https://twitter.com/pcuenq) / [Hugging Face](https://huggingface.co/pcuenq))
|
52 |
|
53 |
+
\* ***You are currently in a cloned/forked HF space of [TTS-AGI/TTS-Arena](https://huggingface.co/spaces/TTS-AGI/TTS-Arena)***
|
54 |
|
55 |
{request}
|
56 |
### Privacy statement
|
57 |
We may store text you enter and generated audio. We store a unique ID for each session. You agree that we may collect, share, and/or publish any data you input for research and/or commercial purposes.
|
58 |
### License
|
59 |
Generated audio clips cannot be redistributed and may be used for personal, non-commercial use only.
|
60 |
+
Random sentences are sourced from a filtered subset of the [Harvard Sentences](https://www.cs.columbia.edu/~hgs/audio/harvard.html) and also from [KingNish](https://huggingface.co/KingNish)'s generated LLM sentences.
|
61 |
""".strip()
|
62 |
|
63 |
LDESC = f"""
|