Home > Store

Art and Business of Speech Recognition, The: Creating the Noble Voice

Register your product to gain access to bonus material or receive a coupon.

Art and Business of Speech Recognition, The: Creating the Noble Voice


  • Your Price: $23.99
  • List Price: $29.99
  • Usually ships in 24 hours.


  • Copyright 2003
  • Dimensions: 7-3/8" x 9-1/4"
  • Pages: 208
  • Edition: 1st
  • Book
  • ISBN-10: 0-321-15492-4
  • ISBN-13: 978-0-321-15492-7

Most people have experienced an automated speech-recognition system when calling a company. Instead of prompting callers to choose an option by entering numbers, the system asks questions and understands spoken responses. With a more advanced application, callers may feel as if they're having a conversation with another person. Not only will the system respond intelligently, its voice even has personality.

The Art and Business of Speech Recognition examines both the rapid emergence and broad potential of speech-recognition applications. By explaining the nature, design, development, and use of such applications, this book addresses two particular needs:

  1. Business managers must understand the competitive advantage that speech-recognition applications provide: a more effective way to engage, serve, and retain customers over the phone.
  2. Application designers must know how to meet their most critical business goal: a satisfying customer experience.

Author Blade Kotelly illuminates these needs from the perspective of an experienced, business-focused practitioner. Among the diverse applications he's worked on, perhaps his most influential design is the flight-information system developed for United Airlines, about which Julie Vallone wrote in Investor's Business Daily: "By the end of the conversation, you might want to take the voice to dinner."

If dinner is the analogy, this concise book is an ideal first course. Managers will learn the potential of speech-recognition applications to reduce costs, increase customer satisfaction, enhance the company brand, and even grow revenues. Designers, especially those just beginning to work in the voice domain, will learn user-interface design principles and techniques needed to develop and deploy successful applications. The examples in the book are real, the writing is accessible and lucid, and the solutions presented are attainable today.


Sample Content

Online Sample Chapter

Speech Recognition: Writing Effective Prompts

Downloadable Sample Chapter

Click below for Sample Chapter(s) related to this title:
Sample Chapter 6

Table of Contents



1.On Telephones, Touchtones, and Business Needs.

Speech Recognition versus Touchtone Functionality.

Problems with Touchtone, and a Speech Recognition Remedy.

What Kinds of Companies Are Using Speech Recognition?

Why Are Companies Using It?

Speech-Recognition Applications: A Typical Example.

Where We've Been-Where We're Going.

2. Technology Primer: About Speech Recognizers.

What the Recognizer Hears (and the Need for Confirmation)

When the Recognizer Listens.

Why Designing a Speech-Recognition Application Is Challenging.

Where We've Been-Where We're Going.

3. The Psychology of How People Interact with Speech-Recognition Systems.

Social-Psychological Research

Ask “Dr.” Blade.

Where We've Been-Where We're Going.


4. Research.

Clients' Objectives.

Callers' Objectives and Needs.

Aspects of Research.

Assembling a Requirements Specification.

Anticipating Change.

Where We've Been-Where We're Going.

5. Developing the Design.

Conceptualizing and Brainstorming.

Congruence of Style.

Defining the Call Flow.

Vision Clips/Sample Calls.

The Design Specification-Conveying the Details of the Design.

Constructing a Design Specification.

Following Through on the Initial Design Phase.

Where We've Been-Where We're Going.

6. Writing Effective Prompts.

The Language of Asking Questions.

The Art of Writing Perfect Prompts.

Writing Prompts for Elegance, Speed, and Value.

Getting Callers to Focus on the Essentials.

Some Subtleties of Prompt Writing.

Top Five Good Tenets for Writing Prompts.

Top Five Mistakes When Writing Prompts.

Where We've Been-Where We're Going.

7. Production and Branding.

Notes About Implementation and Programming.


Prompt Creation-Text-to-Speech and Recorded Voices.


Directing Voice Talents.

The Art of Recording Prompts.

Other Thoughts on Directing.

Concatenative Prompt Recording.

Some Metrics and Technical Notes.

Audio Icons.


Where We've Been-Where We're Going.

8. Usability Testing.

The Value of Usability Testing.

How We Test an Application.

Objectives of Usability Testing.

Preparing for the Test.

The Test Subjects.

How to Get Test Subjects.

The Test Environment.

Types of Tests.

The Test Is Over-Now What?

Interpreting Test Results.

Where We've Been-Where We're Going.

9. Deployment.

The Importance of Multi-Phase Deployment.

The Three Phases of Deployment.

Pilot Deployment.

Partial Deployment.

Full Deployment.

Where We've Been-Where We're Going.


10. Case Studies.

United Airlines: Shortcuts for Frequent Fliers.

United Airlines: Providing Extra Help for Those Who Need It.

Continental Airlines: A Different Approach to Flight Information.

A Top-Five Investment Management Company: Handling Complex Two-Choice Questions.

An Online Brokerage Firm: Managing More Complex Tasks.

An Online Brokerage Firm: Preferences and Other Rarely Used Functions.

A Regional Telephone Company: Dealing with Legal Notices and Disclaimers.

Wildfire: List Navigation.

Wildfire: Small Header, Large Body Lists.

A Top-Five U.S. Bank: Large Header, Small Body Lists.

The “Race Condition”.

FedEx: Scaffolding Prompts.

Amtrak: Implicit Confirmation and the “Ellipses/and” Question Form.

AirTran: Reducing the Information Burden.

Guessing Right.

Semantics: When “Problem” Was a Problem.

Where We've Been-Where We Must Go.

Suggested Reading List.
Index. 0321154924T01032003


Speech-recognition technology is being used increasingly in a variety of over-the-phone applications in transportation, financial, telecommunications, and other industries. Most people by now have experienced at least one automated phone system, in which questions are posed by a computer to callers seeking help or information, and the callers' spoken answers are understood and acted on by that computer. In the best cases, the computer even sounds human!

Given the rapid emergence of these applications, the time seems right for a concise overview of the topic—a guide for business managers looking for new and better ways to engage and service their customers, a resource for designers getting started with voice applications (or refreshing their current knowledge), a good read for anyone interested in this exciting technology. Having built applications in many of these industries, I feel well positioned, and eager, to explain important aspects of the art and business of speech recognition, and to illuminate the extraordinary returns a well-designed and well-deployed over-the-phone system can yield—increased revenues, lower costs, customer satisfaction and retention, brand development. Speech-recognition technology can give a company an identifiable and welcome voice—a noble voice, even—and, in this book, I mean to show how.

The key to voice-application success, as I demonstrate in a variety of examples, is a well-constructed user interface—interactions between the system and its users that are both pleasing and effective. The best voice interfaces avoid the confusion or annoyance of touch-tone systems and the expense of operators or customer representatives. A good voice interface can solve critical business problems.

This book certainly is not meant to be exhaustive in its coverage of speech-recognition technology, or to be academically rigorous in its style. Other fine books delve more deeply and exclusively into particular elements of design, such as brainstorming techniques and usability testing principles. Rather, this book is the product of one experienced, business-focused practitioner—me—talking about what works in this domain, and what does not. I speak from the real-world perspective of a designer who has had to fight with deadlines, work around technological limitations, satisfy and excite the system's users, all while meeting contractual obligations to the client and financial expectations. (That experience will sound familiar to all practitioners!) From this perspective, I convey insights and advice about user-interface design, production, testing, and deployment that I hope will help others plan and build their own successful speech-recognition applications.

Readers familiar with other software development processes will see some similarities between the design of systems for over-the-phone speech-recognition systems and the design of systems for other media. This book, however, focuses on that which is unique to designing speech-recognition systems. It is important for client companies and designers alike to understand these unique elements in order to produce a system that works optimally for both the client company and its calling population.

To keep the book's focus on more fundamental design concepts, I have chosen not to discuss specific technologies, algorithms, or programming methodologies that may be popular at the moment, but that likely will change with each passing year, or perhaps even soon become obsolete. Thus, I do not cover here VoiceXML, SSML, and certain proprietary software packages currently in use; although important and popular today, these changing standards are less central for understanding the basic principles.

There are two principal audiences for this book:

  • People who want to be effective speech-recognition user-interface designers
  • People who want to understand or profit from these systems
  • Prospective designers should find all chapters of the book useful. Other readers—particularly call-center managers, programmers/implementers, and project managers—are likely to benefit most from the chapters that address the design and deployment process, and the ideas that drive the process (Chapters 5, 6, 8 and 9).

    After you've read this book, you will have a fundamental understanding of what goes into the design, production, testing and deployment of over-the-phone speech-recognition applications. You'll have learned design guidelines, tips, and techniques which help ensure that an application works well and that people enjoy using it. In as much as examples are often the best way to learn, you'll have seen how other designers have dealt with real-life issues to solve real business problems. By addressing the main principles behind the creation of speech-recognition systems, I hope to have shown you the tight connection between the process of solving business problems using speech-recognition technology and the art of designing those systems.


    No matter how immersed they become in the minutiae, designers of over-the-phone speech-recognition systems must never lose sight of one, over-arching goal: These systems are made to help people do what they have to do. It doesn't matter if it's mundane (home-banking) or flashy (entertainment/infotainment like a voice-portal), the goal is the same: to help people accomplish their tasks swiftly, easily, and unobtrusively.

    Every designer should be guided by a philosophy. Having a philosophy gives a designer both a starting position and a compass to point the way—a compass to navigate through the plethora of decisions that must be made along the way. At the very least, having a philosophy enables a designer to answer the Why question at each point in the design process. Why am I writing this question? Why am I using a particular word here in a particular context? Why will this design solve the problem better than another design?

    When I was about four years old, my mom taught me that if I was confused at all about whether or not to do something, I could simply think about the Golden Rule: "Do unto others as you would have them do unto you." Her point was to make sure that I considered other people's perspectives before I did something that might affect them. I've applied this rule both consciously and subconsciously throughout my life in a variety of situations.

    When I was a teenager, I became driven by the idea that I should design things—at that point I wasn't sure just what things—that improved people's lives. Eventually, this winding road led me to become a speech-recognition system designer. And when I first approached problems and thought about how to develop the best solutions, I wandered back to the Golden Rule as a way to solve design problems on a variety of levels. I've found that this rule is especially applicable in the design of speech-recognition systems.

    When designing a system, designers need to put themselves mentally in the place of the people calling into the system. If we can understand what it's like to be those people in their varying moods—happy, angry, confused, rushed, impatient—we can design a system to accommodate them. While empathizing is not always easy to do, we can often satisfy callers by understanding who they are and why they're calling and then decide on the most appropriate way to handle different callers and different situations. Some situations are easy to design for, others present problems that require more work to solve. In both cases knowledge of psychology will aid the designer more than knowledge of technology alone.



    Click below to download the Index file related to this title:


    Submit Errata

    More Information

    Unlimited one-month access with your purchase
    Free Safari Membership