Skip to content
/ readAR Public

For HackHarvard 2017. Some children have trouble reading out loud. We want to make a system in which kids can have a fun time reading out loud by providing a reward system that allows them to also be part of the story using augmented reality.

Notifications You must be signed in to change notification settings

suoken/readAR

Repository files navigation

readAR (for HackHarvard)

To run

> npm install
> node index.js

Inspiration

Some children have trouble reading out loud. We want to make a system in which kids can have a fun time reading out loud by providing a reward system that allows them to also be part of the story using augmented reality.

What it does

The child would read a sentence out loud and the sentence would be transcribed using Google's Speech Recognition service. When their speech matches the sentence, the child receives a prize in the form of a AR face filter (a virtual mask). That mask would be related to the story (eg. if the story talks about a puppy, the mask would be a puppy).

Picture of filter after reading a sentence

How we built it

HTML, CSS, JavaScript, Google Cloud Platform. Face tracking was developed using tracker.js

Challenges we ran into

Team members did not know how to use Node.js or Google's Speech Recognition Service / Cloud platform.

Accomplishments that we're proud of

We were able to get the AR web application to work and it was able to place a mask on top of the user's face. And we devised a business model by having a series of books that can be sold and have different filters.

What we learned

Node.js. CSS. Google Cloud Platform.

What's next for ReadAR

We learn how to integrate Google's Speech Recognition service with our application.

About

For HackHarvard 2017. Some children have trouble reading out loud. We want to make a system in which kids can have a fun time reading out loud by providing a reward system that allows them to also be part of the story using augmented reality.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published