AatifKhan ppt on ppt analytics data and bca

ppt

1. Empowering Interaction: The World of Sixth Sense Technology Presented By: Aatif Khan

2. Introduction Sixth Sense Technology is a wearable gesture interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. Sixth Sense bridges this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. Sixth Sense frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.

3. History Steve Mann is considered as the father of Sixth Sense technology who made wearable computer in 1990. He implemented the Sixth Sense technology as the neck worn projector with a camera system which Mann referred to as “Synthetic Synesthesia of the Sixth Sense”. In later years, following his footsteps, Pranav Mistry, a young research scientist at MIT came up with new applications for this technology. Thus, the sixth sense technology was developed at Media labs at MIT.

4. Why Choose Sixth Sense? This sixth sense technology provides us with the freedom of interacting with the digital world using hand gestures. This technology has a wide application in the field of artificial intelligence. This methodology can aid in the synthesis of bots that will be able to interact with humans. This technology enables people to interact in the digital world as if they are interacting in the real world. The Sixth Sense prototype implements several applications that demonstrate the usefulness, viability, and flexibility of the system.

5. Components Camera Colored Markers Projector Mobile Computing Device Mirror

6. Camera: The camera is the key input device of the Sixth Sense system. The camera acts as a digital eye of the system. It basically captures the scene the user is looking at. The video stream captured by the camera is passed to mobile computing device which does the appropriate computer vision computation. Projector: The projector is the key output device of the Sixth Sense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces. The mobile computing device provides the projector with the content to be projected. The projector unit used in prototype runs on a rechargeable battery.

7. Mirror: The mirror reflects the projection coming out from the projector and thus helps in projecting onto the desired locations on walls or surfaces. The user manually can change the tilt of the mirror to change the location of the projection. Mobile Computing Device: The Sixth Sense system uses a mobile computing device in user’s pocket as the processing device. The software program enabling all the features of the system runs on this computing device. This device can be a mobile phone or a small laptop computer. The camera, the projector are connected to this device using wired or wireless connection. Colored Markers: The tips of the user’s fingers are marked with red, yellow, green, and blue tape to help the camera recognize gestures. The movements and arrangements of these markers are interpreted into gestures that act as interaction instructions for the projected application interfaces.

8. Construction and Working Device Composition: Sixth Sense technology integrates a pocket projector, a mirror, and a camera into a wearable device that can be configured as head-mounted, handheld, or pendant-like. These components are connected to a mobile computing device in the user’s pocket. Projection and Interaction: The projector casts visual information onto various surfaces, turning them into interactive interfaces, while the camera uses computer-vision techniques to recognize and track user hand gestures and physical objects. Gesture Recognition and Processing: The software processes the video stream from the camera, tracking colored markers at the fingertips, known as visual tracking fiducials. These movements and arrangements are interpreted into gestures that control the projected application interfaces. Software and Interaction Features: The open-source software facilitates multi-touch and multi-user interactions, enabling intuitive and collaborative engagement with the digital information projected in the physical environment.

9. Block Diagram

10. Applications Viewing Map Making Calls Drawing Application Checking Time Interacting With Physical Objects Getting Information

11. Advantages Portability: Sixth Sense technology offers portability, allowing users to access digital information and interact with interfaces while on the move, enhancing convenience and flexibility. Multi-Touch and Multi-User Interface: The technology supports multi-touch and multi-user interaction, enabling collaborative engagement and simultaneous input from multiple users, fostering teamwork and creativity. Cost-Effectiveness: Sixth Sense devices can be cost-effective, offering advanced functionalities at relatively affordable prices compared to traditional computing and interaction devices, making them accessible to a wider user base. Real-Time Data Access: Users can access data directly from machines or other sources in real-time, enabling instant access to relevant information and enhancing decision-making processes and productivity.

12. Disadvantages Privacy Concerns: Constantly capturing and processing video data raises privacy concerns, as users may feel uncomfortable with the potential for unauthorized surveillance or data breaches. Technical Limitations: Current implementations of Sixth Sense technology may have limitations in terms of accuracy, reliability, and performance, particularly in varied lighting conditions or complex environments. Wearable Design Challenges: Wearable devices can be bulky, uncomfortable, or socially awkward to wear, particularly for extended periods, which may limit user adoption and acceptance in certain contexts. Dependency on External Devices: Sixth Sense devices rely on external components such as mobile computing devices for processing power and connectivity, which could introduce dependencies and potential points of failure.

13. Conclusion Sixth Sense recognizes the objects around us, displaying information automatically and allowing us to access it in any way we need. It has the potential to become the ultimate “transparent” user interface for accessing information about everything around us. Integrating information into everyday objects will not only help us get rid of the digital divide but will also help us, in some way, to stay human and be more connected to our physical world. It will not end up making us machines sitting in front of other machines!

14. Future Enhancements To get rid of Color Markers. To incorporate camera and Projector inside mobile computing device. To have advanced gesture recognition algorithms and machine learning techniques. To make sixth sense work as a fifth sense for Disabled person.