Storytelling using Immersive Technologies

This is Kickstarter presentation for understanding the domain of Immersive technologies and giving a guide to creating an immersive experience using Unity, Vuforia and Aframe.

Even before we get into how to do StoryTelling using this new media, we need to understand what's possible and where is it heading, which positions us better to design the story and capture it properly.

This help you understand the ecosystem of Immersive Technologies from Business, Product, Design and Development perspective.

1. Storytelling
using
AR and VR
Kumar Ahir
Nov 18
Design4India

Twitter: @kernel_kumar
Medium: @kumar.ahir

3. Kumar Ahir
Twitter: @kernel_kumar

Interaction Design, IIT Bombay
MahaWar - Funskool
CISCO, Microsoft, Symantec
OoBI - Out of Box Interactions -
oobi.in
Exit to NewsCorp, Rupert Murdoch
9 month old startup, exit
Consulting ...

4. OoBI
Surface

5. Tanishq
Jewellery Browser

6. Interior
Designer

7. 4dview
Interactive property browsing

8. Why are you here?
Your expectations

9. Experienced VR
Own VR headset
Actively working on VR project

10. Workshop objectives
The workshop will help you know about Immersive Technology space and what it
takes to conceptualize, design and built an immersive experience
We are going to take a glance at AR and VR technologies from different angles
●Hardware
●Industry where it’s actively being used
●Different tools and solutions developed for deploying AR and VR
●Critical choices in deploying Immersive tech
●Design
Develop an Immersive experience using both AR and VR

11. Workshop schedule
Part 1 - General, Managers, Strategy
Difference between AR and VR and XR
Devices - Hardware
Applications - Consumer and Business
Part 2 - Designers, Developers
Technology standards
Product and Design strategy
Design fundamentals
Part 3 - Hands on - Team
Build An Immersive App for Tourism

12. Virtual
Immersive
Block the real world
Teleport to a new world and time
Part of simulation
Augmented
Overlay information
View the real world
Present in time and space
Part of real world

14. Why you should pay attention ?
if you currently own a smartphone
chances are,
you are already carrying a virtual reality
device in your pocket
And am going to tell you how you can create
Memorable Experiences

15. Design for VR - hardware dependent
DoF - Degrees of Freedom
Input/Interaction
FOV
Latency

16. Degree of Freedom - DOF
3 DOF
6 DOF
Extended reality

17. 3 DoF
Orientation
tracking

18. 6 DoF
Orientation +
Position
tracking

19. Extended Reality

20. Input - Interaction
Headset
Gaze
Controller - 3 DoF
Controller - 6 DoF

22. FOV - Field of view

23. FOV - Field of view

25. Latency / Video lag
Expected: 7 ms
Current: 50 ms
Oculus: 30-40 ms
Mobile VR: 40-90 ms
Vive: 8-10 ms

26. Mobile
3 DoF
High latency
Low FoV
Gaze
Standalone
3 DoF
Low latency
100 FoV
3 DoF controller
Roomscale
6 DoF
Perceptive
latency
110 FoC
6 DoF controller
cardboard daydream Gear VR
Oculus GO
Vive Focus Mirage Solo Lenovo MR
Oculus Rift HTC Vive Pro
VR headsets

27. VR Technology standards
Tools
Unity
Unreal
A-Frame
WebVR

Hardware
Mobile based
Standalone
Roomscale
Body suit

28. Design for AR - mobile
Design for Real Environment
Augment the world
Take care of user nuances
Interaction with Virtual Assets

29. Real
Environment
Designing for AR means
designing for many different
environments
Clear understanding of the
amount of space needed for
the task at hand

30. Augment real
world
Guide on how to interact
Visual affordance
Interactable surfaces/environment

31. User Nuances
User phases
User movement
Accessibility & ease of access

32. Interaction
patterns
Selection
Translation
Rotation
Scaling
Gestures and Proximity

33. AR and MR headsets

34. AR Technology standards
Unity
ARCore
ARKit
SLAM
Vuforia
8th Wall
8i

Marker based
Markerless
2D Image Tracking
Environment scanning
3d Object perception
Face AR
Body AR

35. Business
applications
Manufacturing
Education - Learning
Industrial Design
Automotive, Engineering and
Construction
Healthcare
Quality inspection
Games

36. $$ Business $$
Games
Real Estate
Training
Quality inspection
Designing

37. Product Strategy
Understand the technology capabilities
Address 2-3 Major pain points and make solid use case
Identify audience - niche/scale/single user
What’s the current end to end process
VR or AR or MR
Design in context
Content creation - 360 photo/video/3d

38. Use case
Tourism Safety training

39. Critical choices
Evaluate the current processes and medium
What alternatives available that people are used to?
Understand the nature of medium
Understand the context of use

40. How to ?!?
Location of use
Hardware
Storyboard and UX
3d Content development
UI patterns - Mapping interactions to controllers
User testing

41. Context Users Goals
Design Process
Experience
Immersion
Learning
Explore
Media
Gamers
Enterprise
Entertainment
Gaming
Healthcare
Automotive
Manufacturing
Design
user personas, conceptual flows, wireframes, an interaction model

42. Mimic the real space and behaviour

43. Design Fundamentals
Not pixels but cm, m, feet
Peripheral vision
Interactions attached to world UI
Skybox
Spatial sound
Modes of interactions
Design for Collaboration
Text with Background - solid or translucent

44. Units
https://virtualrealitypop.com/practical-vr-ce80427e8e9d
Reticle > Head > Body
They are in cm, m, in, ft and degrees
NOT PIXELS
Screens are fixed distance and area
Immersive world has depth

45. Peripheral Vision
Space Layout

46. Prototype of a tool to check
layout of elements in VR

48. Skybox
The secondary world
Background
Scene elements and depth of layers

49. Environment
Skybox
3d objects

51. Audio/Sound
Spatial audio is a key ingredient for true immersion,
making the design process around sound absolutely essential

52. Seated vs Standing vs Movement

53. Design for Collaboration

54. Tools
A-frame
Unity - ProBuilder
Blender
Paper Prototyping - VR Sketch sheets

55. Popsicle based
handheld characters for
real life prototyping and
quick user feedback

59. VR Sketch sheets

60. Collaboration with Developers
Create a standard visual vocabulary
Guidelines for elements layout - back, middle, foreground
User Test everything
Test with Physical models - buy some cardboards and sheets

61. StoryTelling
Imagineering
Improvisation
Presence
Point of View
Set and Setting
Space is Dynamic
Inspiration from Theatre
Plot in 360
Character and Dialogue
Style

62. https://youtu.be/JxVVNm35rJE

63. Let’s get started

64. Experience a
Monument
An XR experience to view a
monument from birds eye view and
get a real close 360 view of different
points

65. Unity and Vuforia
Setup Vuforia License
Image target and database
Unity Android platform
Vuforia - AR Camera - Configuration
Image Target
Monument Model setup
Test
Story and interactions
Add some sound
Test
Publish app
https://goo.gl/68bRPw

66. VR setup
Surround
Upload 360 image
http://surround.infivr.com

67. VR setup
A-frame
https://glitch.me/~aframe
Resume coding
Add 360 image
Assets

68. Thank You
Kumar Ahir
www.kumarahir.com

[phone]
Twitter
@kernel_kumar
LinkedIn
/in/kumarahir


[email protected]