Sixth Sense (The Future of Technology)

'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital Information and lets us use natural hand gestures to interact with that information. All of us are aware of the five basic senses - seeing, feeling, smelling,
tasting and hearing. But there is also another sense called the sixth sense. Sixth Sense Technology is the science of tomorrow with the aim of connecting the digital world with the physical world seamlessly, eliminating hardware devices.This combination of devices and software together create a reality in which the digital world is merged with the physical world.

1. Sixth Sense Technology Presented By Faheema Fairuj Monica （莫妮卡） Student Id- S20141501 Information and Communication Engineering University of Science & Technology, Beijing

2. What is Sixth Sense? 'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital Information and lets us use natural hand gestures to interact with that information. All of us are aware of the five basic senses - seeing, feeling, smelling, tasting and hearing. But there is also another sense called the sixth sense. It is basically a connection to something greater than what their physical senses are able to perceive. To a layman, it would be something supernatural. Some might just consider it to be a superstition or something psychological. But the invention of sixth sense technology has completely shocked the world. Although it is not widely known as of now but the time is not far when this technology will change our perception of the world .

3. Evolution of Sixth Sense Technology Steve Mann is considered as the pioneer of Sixth Sense Technology who made wearable computer in 1990. He implemented the Sixth Sense Technology as the neck projector with a camera system which he referred to as “Synthetic Synesthesia of the Sixth Sense”. Self-portraits of Mann with "Digital Eye Glass" (wearable computer and Augmediated Reality systems) from 1980s to 2000s

4. Sixth Sense-The Future of Technology And then his work was carried forward by Pranav Mistry , 28 year old, of Indian origin who is a Ph.D. student in the Fluid Interfaces Group at the Massachusetts Institute of Technology (MIT) Media Lab. He came up with exciting new applications from this technology. Sixth sense technology was later coined as Wear Ur World (WUW). The inventors have filed patent under the name Wear Ur World (WUW) in February 2010.

5. Related Technologies Sixth sense technology has integrated the real world objects with digital world. It’s a blend of many exquisite technologies. The thing which makes it magnificent is the marvelous integration of all those technologies and presents it into a single portable and economical product. It associates technologies like- Augmented reality- It is a term for a live direct or indirect view of a physical real world environment whose elements are augmented by virtual computer generated imagery. Gesture recognition- It’s a topic in computer science and language technology with the goal of interpreting human gestures via mathematical algorithms. Computer vision- It is the science and technology of machines that see. It is concerned with the theory behind artificial systems that extract information from images. Radio frequency identification/RFD- It is basically an electronic tagging technology that allows the detection, tracking of tags and consequently the objects that they are affixed to.

6. Sixth Sense Device At present the commercial product isn’t launched but the prototype is prepared. The current prototype system costs approximate $350 to build. The sixth sense prototype is composed of- Camera Projector Mirror Mobile component Colored markers Pranav Mistry with sixth sense prototype

7. The Components of 6 th Sense Prototype Captures an object in view and tracks the user’s hand gestures. It sends the data to smart phone. It acts as a digital eye , connecting you to the world of digital information 1. Camera It is at the tip of the user’s fingers . Marking the user’s fingers with red, yellow, green, and blue tape helps the webcam recognize gestures. The movements and arrangements of these makers are interpreted into gestures that act as interaction instructions for the projected application interfaces. 2. Color Markers

8. The Components of 6 th Sense Prototype 3. Mirror The usage of the mirror is significant as the projector dangles pointing downwards from the neck. 4. Smart Phone A Web-enabled smart phone in the user’s pocket processes the video data Other software searches the Web and interprets the hand gestures

9. The Components of 6 th Sense Prototype The projector projects visual information enabling surfaces and physical objects to be used as interfaces The project itself contains a battery inside, with 3 hours of battery life. A tiny LED projector displays data sent from the smart phone on any surface in view–object, wall, or person 5. Projector

10. Application of 6 th Sense Technology

11. Applications of 6 th Sense Technology Make a call You can use the Sixth Sense to project a keypad onto your hand, then use that virtual keypad to make a call. Palm is the new dialer!

12. Applications of 6 th Sense Technology Call up a map With the map application we can call up the map of our choice and then use thumbs and index fingers to navigate the map. Using any surfaces as an interface.

13. Applications of 6 th Sense Technology Take pictures If you fashion your index fingers and thumbs into a square ("framing" gesture), the system will snap a photo. After taking the desired number of photos, we can project them onto a surface, and use gestures to sort through the photos, and organize and resize them. Capture photos with fingers!

14. Applications of 6 th Sense Technology Check the time Draw a circle on your wrist to get a virtual watch that gives you the correct time. Create multimedia reading experiences Sixth Sense can be programmed to project related videos onto newspaper articles you are reading. Newspaper showing live video news!

15. Applications of 6 th Sense Check your Flight Status:   Just place the ticket in front of the projector and it checks its status from the internet . Get book information Sixth Sense uses image recognition or marker technology to recognize products we pick up, then feeds us information on those products. The system can project Amazon ratings on that book, as well as reviews and other relevant information

16. Advantages & Disadvantages Portable Support Multi touch and Multi user interaction Cost Effective(300$) Data access directly from the machines in real time Mind map the idea anywhere Open Source Software Hardware limitations of the devices, that we currently carry around with us. For example many phones will not allow the external camera feed to be manipulated in real time. Post processing can occur however. ADVANTAGES DISADVANTAGES

17. Future Enhancement To get rid of color markers. To incorporate camera and projector inside mobile computing device. To have 3D gesture tracking. To make Sixth Sense work as fifth Sense for disabled person.

18. Leap Motion Controller $79.99 Microsoft Kinect XBOX 360 $249.99 Think by Texting Samsung Galaxy Gear Smartwatch $299 MYO Electric Arm Band $149 Google Glass $1500

19. Conclusion It’s the beginning of a new era of technology where engineering will reach new milestones. Just like in the science fiction movies where display of computer screen appears on walls, commands are given by gestures, the smart digital environment which talks to us to do our work and so on, these all will be possible very soon. You imagine it and  Sixth Sense Technology  will make it possible. “Minority Report” (Steven Spielberg, 2002) THE FUTURE OF TECHNOLOGY IS HERE!

20. Sources: http://wearcam.org/6ense.pdf http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.html http://www.pranavmistry.com/projects/sixthsense https://github.com/sixthsense/sixthsen http://www.engineersgarage.com/articles/sixth-sense-technology?page=2 "WUW - wear Ur world: a wearable gestural interface", Proceedings of CHI EA '09 Extended Abstracts on Human Factors in Computing Systems Pages 4111-4116, ACM New York, NY, USA MIT Media Lab Technical Report 260, December 1994 Pattie Maes + Pranav Mistry: Meet the Sixth Sense interaction. Video on . Ted.com. Retrieved on 2013-12-09.