Google  

Home
   
e-ASRNews Log-on
     
Subscription Info
 
Market Reports 
 
Speech Industry Links
 
Examples of Good VUIs
   
Repairs for wrecks
   
Get2human Consulting Services
  
Tern Systems
 
Get2Human
Text-to-Speech Accuracy Testing - 2011

The information provided in this report presents the accuracy performance of the commercially available Text-to-Speech (TTS) products. Using a test corpus of over fifteen hundred phrases, each unit was tested, scored and the results tabulated. 10 TTS products were tested. Included were products from:  AT&T, Acapela Group; Cepstral; CereProc; IVONA; Loquendo; Nuance; Microsoft; NeoSpeech; and SVOX. The test corpus (1,587 words/phrases) was segmented into categories which included: Number Handling; Homograph Handling; Handling of Words of Foreign Origin; Acronym Handling; Abbreviation Handling; Name Handling; and Address Handling and the test results were presented in these categories. The average score for all units tested was 77.1% correct. Overall scores ranged from 55.3% to 94.1% correct. Within a category, scores ranged from a low of 26.4% to a high of 99.9%. The products that were tested represented the latest available release of their product as of August, 2011.

 

AT&T

Acapela Group

Cepstral

Cere-Proc

IVONA Software

Loquendo

Micro-soft

Neo-Speech

Nuance

SVOX

 

Total Correct

N

1,018

1,406

1,133

1,432

1,494

1,039

1,221

1,492

1,124

878

%

64.2

88.5

71.4

90.2

94.1

65.5

76.9

94.0

70.8

55.3

The testing (as well as the entire development of the test program) was funded entirely by Voice Information Associates. This makes the testing and the results that were obtained unique in that they are completely unbiased and independent of the influence of any of the vendors. They represent the most objective assessment of the relative accuracy of commercially available TTS products that existed as of August, 2011.

If you have additional questions, or would like to purchase a copy of this report, contact Walt Tetschner 978-266-1966 or tetschner@aol.com


ASRNews is published by Voice Information Associates, Inc.
P.O. Box 2861
Acton, MA 01720
Walt Tetschner, Publisher and Editor.
For all inquiries, email us at tetschner@aol.com
call 978-266-1966 or fax us at 815-550-8730.