Background

Mixed Reality promises a new way to learn in the world: blending holograms with our surroundings to create contextually rich experiences that find their place in our daily routine. Existing situated learning platforms limit the learner and implicitly enforce the designer's intent by hard-coding content and predetermining what elements in the environment are actionable.

The Process

WordSense is a Mixed Reality app built on Unity for the Hololens. It recognizes objects in the learner's vicinity and embeds holographic content that identifies the corresponding word, provides sentence and definition cues for practice, and displays dynamic audiovisual content that shows example usage.

‍