EXECUTIVE EDUCATION

Designing New Interactions: Non-Visual Interfaces & AR/VR UX Design in Unity

Get Your Brochure

Course Dates

STARTS ON

March 22, 2021

Course Duration

DURATION

7 weeks, online
15–20 hours per week

Course Duration

Why Study Designing New Interactions: Non-Visual Interfaces & AR/VR UX Design in Unity?

Extended reality (XR) is becoming more affordable as XR content offerings and applications expand, leading to projections of exponential growth both in demand for XR and the technology’s capabilities in the next few years. That also means more opportunities for those with the know-how to design visual and non-visual user experiences for 3D and XR interactions.

The Designing New Interactions: Non-Visual Interfaces & AR/VR UX Design in Unity program from NYU’s Tandon School of Engineering was developed to prepare UX designers to create user experiences for non-visual interfaces like voice, and interactive audio, and to use industry standard tools like Adobe XD, Reaper, and Unity to create high-fidelity prototypes of XR experiences that include visual and non-visual elements. As a participant, you can work to advance your career in UX design while building a design portfolio using these new and emerging technologies

443 million

The worldwide AR/VR user base is projected to reach 443 million by 2025.

SOURCE: Statista

$40.9 billion

As the use of haptics expands, the global market is projected to reach $40.9 billion by 2027, from $12.9 in 2020.

SOURCE: Research and Markets

60%

Unity is increasingly being used across a variety of industries, and powers 60% of all AR and VR content.

SOURCE: TechCrunch

Key Takeaways

  • Develop fundamental skills for haptic design, sound design, and interactive audio experience design
  • Develop fundamental skills for designing and prototyping in Unity
  • Exploring UX design principles for non-visual interfaces like haptics and voice
  • Using industry standard tools to design for XR environments and Voice applications
  • Learn best practices for sharing your design ideas

Program Syllabus

Week 1:

Haptics

Explore haptics and the importance of feedback, as well as the use of haptics to generate realistic experiences in XR environments.

Week 2:

Audio User Experience

Learn key components of the audio user experience, including UX sound design (theory and practice), audio user flows, and audio moment mapping. Learn how to source, edit and place sound in your demos and prototypes, working in Adobe XD. Guest speaker: Sean Thornton of Audio UX.

Week 3:

Interactive & Spatial Audio

Explore ambient computing, conversation design, mixing and rendering sound design, and using sound design to enhance user experience. Guest speaker: Eric Seay of Audio UX.

Week 4:

Intro to Unity

Get an introduction to the Unity game engine, and experience prototyping using this industry standard tool.

Week 5:

Setting the Stage: World Building

Use Unity to create storyboards for an XR experience of your own design, block out key moments and UI elements, and prototype the core interactions in your experience.

Week 6:

Production, Refinement, and Tuning

Refine your Unity design by setting up an art pipeline, generating production assets, replacing UI Elements with more refined pieces, and test, reinforce, and complete your XR experience.

Week 7:

Sharing Your Vision

Learn about documenting, presenting, distributing and marketing your product, as well as payment methods and getting your product reviewed.

Week 1:

Haptics

Explore haptics and the importance of feedback, as well as the use of haptics to generate realistic experiences in XR environments.

Week 5:

Setting the Stage: World Building

Use Unity to create storyboards for an XR experience of your own design, block out key moments and UI elements, and prototype the core interactions in your experience.

Week 2:

Audio User Experience

Learn key components of the audio user experience, including UX sound design (theory and practice), audio user flows, and audio moment mapping. Learn how to source, edit and place sound in your demos and prototypes, working in Adobe XD. Guest speaker: Sean Thornton of Audio UX.

Week 6:

Production, Refinement, and Tuning

Refine your Unity design by setting up an art pipeline, generating production assets, replacing UI Elements with more refined pieces, and test, reinforce, and complete your XR experience.

Week 3:

Interactive & Spatial Audio

Explore ambient computing, conversation design, mixing and rendering sound design, and using sound design to enhance user experience. Guest speaker: Eric Seay of Audio UX.

Week 7:

Sharing Your Vision

Learn about documenting, presenting, distributing and marketing your product, as well as payment methods and getting your product reviewed.

Week 4:

Intro to Unity

Get an introduction to the Unity game engine, and experience prototyping using this industry standard tool.

Real-world Applications

Decorative image relating to Audio user experience design.

Audio user experience design

Study examples of successful sonic branding from companies including Apple, Netflix, Bose, and Mastercard.

Decorative image relating to Voice design and interactive audio.

Voice design

See how voice design and interactive audio are used via examples including Google’s Home Assistant, Amazon’s Alexa, and Apple’s Siri.

Decorative image relating to interaction mechanics.

Interaction mechanics

Explore interaction mechanics via gaming examples including Super Mario Bros, Beat Saber, Monopoly, and Call of Duty.

Program Experience

Decorative image relating to Video Lectures.

Video Lectures

Decorative image relating to Assignments.

Assignments

Decorative image relating to Discussions.

Discussions

Real-World Tools & Technology

Decorative image relating to Capstone Project.

Capstone Project

Decorative image relating to Live Office Hours with Program Leaders.

Live Office Hours with Program Leaders

Decorative image relating to Dedicated Program Support Team.

Dedicated Program Support Team

Decorative image relating to Mobile Learning App.

Mobile Learning App

Who Should Attend

This seven-week program is designed for professionals pursuing UX design careers with an interest in working with non-visual interfaces, as well as those who want to enhance their skills in prototyping with Unity. Participants will have foundational visual design skills and experience with Adobe Photoshop/Illustrator, and be seeking to transition to working with emerging technologies—including interactive 3D, AR, VR and Voice—while enhancing their skills in user experience design.

It is ideal for:

  • Designers looking to develop a deeper understanding of UX design concepts and the associated technicalities.
  • Product Designers/Managers looking to improve the user experience of the products/services offered by their company and explore new product ideas.
  • UX Developers/Engineers looking to advance in the field of UX design.
  • Consultants aiming to develop their knowledge of UX design to offer end-to-end solutions for their clients.

Program Faculty

Nien Lam

Adjunct Faculty, NYU Tisch School of the Arts, Co-founder of Line Break

Nien Lam is a designer, an educator, and a dad. He is a partner and co-founder of Line Break, a multi-disciplinary design and technology studio based in New York City. His clients have included Apple, Google, Pentagram, Pace Gallery, Estée Lauder, The Cleveland Clinic, Ai Weiwei Studio, and Studio Olafur Eliasson. His projects have included exhibitions, interactive installations, data visualizations, mobile applications, websites, spatial computing projects, and more. Prior to starting Line Break, Nien worked as a lead engineer at Bloomberg designing real-time applications for data visualization and analysis. More info

Sebastian Buys

Adjunct Faculty, NYU Tisch School of the Arts, Co-founder of Line Break

Sebastian Buys is a designer and lifelong coder. He is a partner and co-founder of Line Break, a multi-disciplinary design and technology studio based in New York City. His clients have included Apple, Google, Pentagram, Pace Gallery, Estée Lauder, The Cleveland Clinic, Ai Weiwei Studio and Studio Olafur Eliasson. His projects have included exhibitions, interactive installations, data visualizations, mobile applications, websites, spatial computing projects, and more. More info

Certificate

Example image of certificate that will be awarded after successful completion of this program

Certificate

Upon successful completion of the program, participants will be awarded a verified digital certificate by NYU Tandon.

Download Brochure

Apply Now

Early registrations are encouraged. Seats fill up quickly!

Flexible payment options available. Learn more.