|
The information provided in this report presents the accuracy performance of the commercially available Text-to-Speech (TTS) products. Using a test corpus of over twelve hundred phrases, each unit was tested, scored and the results tabulated. Over 20 TTS products were tested. Included were products from: Aculab; AT&T, Acapela Group; Cepstral; Fonix; IBM; Loquendo; Nuance; Microsoft; Rhetorical Systems; ScanSoft; Voiceware (NeoSpeech); and Winbond. The test corpus was segmented into categories which included: Number Handling; Homograph Handling; Handling of Words of Foreign Origin; Acronym Handling; Abbreviation Handling; Name Handling; and Address Handling and the test results were presented in these categories. The average score for all units tested was 71.8% correct. Overall scores ranged from 50.0% to 91.2% correct. Within a category, scores ranged from a low of 7.9% to a high of 100.0%. The products that were tested represented the latest available release of their product as of November, 2006.
Table 1.1
TTS Accuracy Testing Summary Results - Server-based Products
|
AT&T
NV |
Acapela Group
HQ TTS |
Cepstral
TTS |
Fonix
FAAST |
IBM TTS |
Loquendo
TTS |
Nuance
Vocalizer 4 |
Rhetorical
rVoice |
SpanSoft
RealSpeak |
Voiceware/NeoSpeech
Voicetext |
|
Total Correct |
N |
856 |
779 |
1,105 |
853 |
909 |
1,001 |
1,116 |
895 |
1,176 |
1,094 |
|
% |
66.4 |
|
85.7 |
66.2 |
70.5 |
77.7 |
86.6 |
69.4 |
91.2 |
84.87 |
|
Number = |
1,289 |
Total Number = |
12,890 |
Total Correct = |
9,784 |
Avg Correct = |
75.9 |
TTS Accuracy Testing Summary Results – Embedded/Desktop-based Products
|
Aculab
TTS |
Acapela Group
HD TTS |
Cepstral
TTS |
Fonix
DECtalk |
IBM TTS
|
Loquendo
Embedded
TTS |
Microsoft |
ScanSoft |
Winbond
TTS |
|
TTS |
TTS3000 |
ETI-Eloquence |
RealSpeak Solo |
|
Total Correct |
N |
674 |
779 |
1,105 |
782 |
909 |
1,001 |
785 |
848 |
1,176 |
1,176 |
644 |
|
% |
52.3 |
60.4 |
85.7 |
60.7 |
70.5 |
77.7 |
60.9 |
65.8 |
91.2 |
91.2 |
50.0 |
|
Number = |
1,289 |
Total Number = |
14,179 |
Total Correct = |
9,879 |
Avg Correct = |
69.7 |
The testing (as well as the entire development of the test program) was funded entirely by Voice Information Associates. This makes the testing and the results that were obtained unique in that they are completely unbiased and independent of the influence of any of the vendors. They represent the most objective assessment of the relative accuracy of commercially available TTS products that existed as of February, 2006.
If you have additional questions,
or would like to purchase a copy of this market study, please send your name and address to:
accuracytesting@asrnews.com
|
