A Sign of the Times: ASL Research by Carol Neidle

view31

Video /today/science-tech/2008/02/28/sign-times-asl

For the hearing-impaired and their families, learning American Sign Language can be a kind of Catch-22. There are ASL dictionaries in print, but because the language lacks a written form the signs are often organized according to their nearest English translation. “You can only look up a sign in the dictionary if you already know what it means,” says Carol Neidle, Professor of French and Linguistics in the Department of Romance Studies and coordinator of the Undergraduate Linguistics Program at BU.

Neidle and Stanley Sclaroff, a professor and chair of the CAS computer science department, hope that before long it will be possible to demonstrate signs in front of a camera and have a computer look up their meaning. With a three-year, $900,000 National Science Foundation grant, the two BU professors are collaborating on computer technology that could identify a sign based on its visual properties.

The first step is establishing a comprehensive ASL video lexicon — 3,000 to 5,000 signs. Native ASL users have already logged countless hours in front of a camera at BU’s National Center for Sign Language and Gesture Resources. Neidle and Sclaroff have developed a computer program called SignStream, which displays videos of ASL signing from multiple angles for linguistic annotation.

Neidle says that the ASL look-up and search capabilities have important implications for improving education, opportunities, and access for the deaf and their families. “Ninety percent of deaf children are born into hearing families,” she says. “This would allow parents to look up a sign produced by their deaf child.”

Devin Hahn can be reached at dhahn@bu.edu.

view23

view12