Item Details

Giving CANDY to Children: User-Tailored Gesture Input Driving an Articulator Based Speech Synthesizer

Pausch, Randy; Williams, R
Format
Report
Author
Pausch, Randy
Williams, R
Abstract
The CANDY Project (Communication Assistance to Negate Disabilities in Youth) seeks to provide a realtime speech synthesizer for disabled individuals, particularly non-vocal children with cerebral palsy. Existing speech synthesizers convert user input into discrete linguistic or phonetic symbols which are converted into sound. Complicated sentences must be created by concatenating lower level symbols, precluding real-time conversational speech. We have developed an articulator-based speech synthesizer which simulates the motion of the human tongue and produces the corresponding speech sounds in real time. The synthesizer is driven by two continuous input signals and non-disabled users can produce realtime speech with a joystick. Disabled users will drive the synthesizer via passive tracking of their body movements. Magnetic trackers attached to the user report their location and tailoring software allows each user to move the tracker in an optimal orientation and range. The user motion is then converted into the two continuous signals that drive the speech synthesizer. In this way, we hope to allow each child to compensate for their inoperative vocal tract by using their "best" set of muscles to operate a simulated vocal tract. The motion mapping software may also have future potential as a physical therapy aid. to appear in: Communications of the ACM Note: Abstract extracted from PDF text
Language
English
Date Received
20121029
Published
University of Virginia, Department of Computer Science, 1991
Published Date
1991
Collection
Libra Open Repository
Logo for In CopyrightIn Copyright

Availability

Access Online