ScribeAR

Features

Any device, anywhere.

ScribeAR meets you wherever you are. Captions on a laptop? A phone? An augmented-reality headset? Check, check, and check. No download required.

Choose your captioning service.

ScribeAR connects to your preferred captioning sources, ranging from on-demand automatic systems to high-accuracy human captioners.

The little things that aren't so little.

Themes. Font size. Language selection*. Custom word lists*. With so many ways to interact and personalize, ScribeAR makes your captions your captions.

*Available for some captioning services

About ScribeAR

What is ScribeAR?

The ScribeAR project is exploring ways to enhance real-time captioning as a communication access tool.

Traditional captioning paradigms can be constraining:
Availability

Captions might be available only for specific events, such as when watching a movie or taking a class. But life takes place 24/7.

Participation

Captions are often streamed on laptops or mobile devices. User attention is therefore split between the captions and the action.

Logistics

It's often possible to pre-arrange for captioning services. But what about spontaneous interactions, like water cooler chats?

ScribeAR strives to address some of these challenges with creative design:
Flexibility

ScribeAR is a lightweight, web app that can run on nearly any device with a web browser anytime and anywhere with an internet connection.

Connection

ScribeAR is compatible with augmented-reality (AR) headsets, which allow users to view captions while fully engaging in the action.

Options

ScribeAR can stream captioning from a wide range of sources spanning various price points and accuracy levels.

Meet the Team

We are a team of undergraduate and graduate students working at the University of Illinois Urbana-Champaign as a research group within the Grainger College of Engineering.

Interested in joining us? We'd love to hear from you—especially if you're an undergraduate or graduate student at the University of Illinois. Send us an email

Professor Lawrence

Lawrence Angrave

(co-principal investigator)

Professor, Department of Computer Science

Colin Lualdi

Colin Lualdi

(co-principal investigator)

PhD Student, Department of Physics

Current Members

For Contributors

Github

Visit Our Github page page for the latest in development and contribution opportunities.

Version history

00010 - Whisper and Semantic Analysis demonstrations
00009 - Added Audio Visualization
00008 - Updated Phrase Recognition
00007 - Refactored Version
00006 - Added StreamText compatability
00005 - Added audio visualizations
00004 - Microsoft Azure cognitive services compatibility
00003 - Added sidebar and changed UI components
00002 - Added visualizations
00001 - ScribeAR original version