Google  
Home
   
e-ASRNews Log-on
     
Subscription Info
 
Market Reports 
 
Speech Industry Links
 
Examples of Good VUIs
   
Repairs for wrecks
   
Gethuman Consulting Services
  
Tern Systems
 
Gethuman

Repairs for Wrecks 
American Airlines   Tufts   Charter   Washington Post   NY Times   WSJ   SSA   Dell   Virgin Mobile  VerizonBroadband   Cingular   Apple   Federal Trade Commission  
Eureka   FedEx  Comcast    United Airlines   Verizon    CareMark   Amtrak   USPS   aol   Bank of America  

   
Telephone self-service is able to provide real value to consumers. It makes access to information available 24/7. It is available without waiting in line. Consumers can purchase things. They can check availability. They can check the status of an order. They can obtain directions. In addition to making customers happy, telephone self-service is also able to save money for the enterprise that is providing it.

Unfortunately, this situation is rarely achieved. Telephone self-service is intensely disliked by many consumers because it is implemented very badly. The caller wants a quick & easy experience and most telephone self-service instead provides an experience that is slow & difficult.

We present here a few of these telephone self-service implementations that were evaluated during the last months. These were selected mostly at random and it's unlikely that they represent the worst implementations.

Table 1 summarizes the results of this testing. We have adapted the www.gethuman.com Voice User Interface (VUI) Standard as the basis for our evaluation. The scoring/rating scheme is simple to understand and scoring of a particular VUI is relatively easy to do. All that is needed is to make a phone call and observe how the system responds. The scheme that we are using has some obvious limitations. The fact that we give each item equal weight is certainly arguable. On the other hand, despite its simplicity, it appears to yield results that seem to correlate with the relative goodness of the self-service system.

For each of the VUIs that we tested, we provide a discussion of it from the perspective of the caller. This is done by Walt Tetschner, who has suffered through many poorly implemented telephone self-service implementations. We also provide a clinical analysis of the system from the viewpoint of a highly-regarded VUI designer (Dr. Walter Rolandi). This identifies what the system is doing incorrectly and offers recommendations regarding what should be done to repair it.

Table 1

gethuman Telephone Self-service Rating
gethuman item FTC Apple Cingular Verizon Broadband Virgin Mobile Dell SSA WSJ NY Times Washington Post
Charter Commun-
ication
Tufts Health
care
American Airlines
The caller must always be able to dial 0 or to say "operator" to queue for a human. 0 0 0 0 0 0 0 0 0 0 0 0 1
An accurate estimated wait-time, based on call traffic statistics at the time of the call, should always be given when the caller arrives in the queue.  A revised update should be provided periodically during hold time. 0 1 0 0 0 0 0 0 0 1 0 0 0
Callers should never be asked to repeat any information (name, full account number, description of issue, etc.) provided to a human or an automated system during a call. 0 0 0 0 0 0 0 0 0 0 0 0 0
Callers should always be offered the option to be called back when a human is not available. This option should be offered periodically during hold time. If 24 hour service is not available, the caller should be able to leave a message and be called back promptly when humans are available.. 0 0 0 0 0 0 0 0 0 1 1 0 0
Speech applications should provide touch tone (DTMF) fall-back, where appropriate.  0 0 NA 1 1 0 0 0 NA 1 NA 1 1
Callers should not be forced to listen to long/verbose prompts.  0 0 0 0 0 0 0 0 0 0 0 0 0
Callers should be able to interrupt prompts (via dial-through for in DTMF applications and/or via barge-in for speech applications) whenever doing so will enable the user to complete his task more efficiently. 0 0 0 0 0 0 0 0 1 1 0 0 1
Do not disconnect for user errors, including when there are no perceived key presses (as the caller might be on a rotary phone); instead queue for a human operator and/or offer the choice for call-back.  0 0 0 1 0 1 0 0 0 1 1 0 1
Default language should be based on consumer demographics for each organization.  Primary language should be assumed with the option for the caller to change language.   (i.e. English should generally be assumed for the US, with a specified key for Spanish.) 0 1 0 1 0 1 0 1 1 1 0 1 1
All operators/representatives of the organization should be able to communicate clearly with the caller  1 1 1 0 0 0 1 1 1 1 1 1 1
Gethuman Subtotal (Average score) 0.10 0.30 0.11 0.30 0.10 0.20 0.10 0.20 0.33 0.70 0.33 .30 0.6
Recognize me by caller ID (home or mobile) and then let me enter a four digit PIN to authenticate, so you then have my info on file and don't make me type in long account numbers etc. 0 0 0 0 NA 0 0 0 0 0 0 0 0
No "Your call is important to us" greeting.  1 1 1 1 1 1 1 0 1 1 1 0 1
No "You can access our website to answer most questions" message. I already know that. 0 0 0 0 1 0 0 0 1 1 1 1 0
No "Please listen carefully, since our menu has changed" message.  0 0 1 1 1 1 1 1 1 0 1 0 1
Do not play advertisements to me 1 0 0 0 1 1 1 1 1 1 1 1 1
Do not speak to me in legalese or corporate language 0 1 0 0 0 1 1 1 1 1 1 1 1
Is it a Quick-&-Easy experience? 0 0 0 0