VOICE AND EYE TRACKING TECHNOLOGY PPT.pptx

It explains things you should know about voice and eye tracking technology.

1. VOICE AND EYE TRACKING TECHNOLOGY Group 3

2. VOICE TRACKING What is it? Voice tracking is a feature that uses beam-forming algorithms to detect and follow the sound of a speaker’s voice. It d etects, records, and analyzes voice input Voice tracking = follows and interprets what you say

3. EYE TRACKING What is it? Eye tracking is a feature that follows where we look, also known as the point where the gaze patterns are fixed. An eye tracker records the position of the eyes and the movements they make during these measurements. Eye tracking = follows and interprets what you look at .

4. VOICE TRACKING DEVELOPME N T: In 1952, Bell Labs marked an advancement: The AUDREY (   Automatic Digit Recognition) System , which recognized spoken digits. To recognize the numbers 1 to 9, spoken by a single voice and discerned with an accuracy of 90% seemed astounding.

5. VOICE TRACKING DEVELOPMENT: Ten years later, IBM unveiled its Shoebox machine at the 1962 World Fair in Seattle. Shoebox could understand up to 16 words, including the digits 0 through 9. Carnegie Mellon’s “HARPY” voice recognition system was capable of processing and understanding more than 1,000 words. It could understand sentences comparable to a three-year-old’s vocabulary.

6. VOICE TRACKING DEVELOPMENT: These advances were largely powered by the development of the Hidden Markov Model (HMM) statistical models, often used in machine learning for tasks like speech recognition, natural language processing, and bioinformatics.

7. VOICE TRACKING DEVELOPMENT: In 1990 , Dragon Systems released “Dragon Dictate,” the first consumer speech recognition product allowing users to dictate text hands-free. Following this, Dragon Dictate’s 1997 successor, Dragon NaturallySpeaking, was the first commercial voice recognition program that could understand the natural speech of up to 100 words per minute.

8. VOICE TRACKING DEVELOPMENT: By the early 2000s , speech recognition accuracy had reached about 80%, with substantial advancements following as AI and deep learning were increasingly integrated into speech-to-text technologies. Apple’s iPhone caused a stir when it came out in 2007 , as tech began to advance towards an increasingly smartphone-centric and mobile-first future. But with the release of Google Voice Search App for the iPhone in 2008 , voice recognition technology began to once again make major changes.

9. VOICE TRACKING DEVELOPMENT: Voice Search in 2008 continues to define voice recognition technology to this day by allowing you to find information online or within an app by speaking your question instead of typing it, which is practical for hands-free use. It wasn’t until 2010 that voice technology began to take off again — this time, in a big way. Google’s approach was then perfected by Apple in 2011 with the release of Siri, an AI-driven personal assistant technology that uses voice recognition and natural language processing to perform tasks, answer questions, and offer recommendations based on user commands.

10. EYE TRACKING DEVELOPMENT: Origins of eye tracking date back to 1879 when the French ophthalmologist Louis Émile Javal noticed, for the first time, that readers’ eyes do not skim fluently through the text while reading, but make quick movements ( saccades ) mixed with short pauses ( fixations ). These studies were based on naked-eye observations in the absence of a more advanced technology.

11. EYE TRACKING DEVELOPMENT: In 1908, Edmund Huey built a device that could track eye movement during the reading process. The first eye tracker was very intrusive as readers had to wear a type of contact lens with a small opening for the pupil. The lens was attached to a pointer, which changed its position following the movements of the eye. In 1937, Guy Thomas Buswell , an educational psychologist, used light beams that were reflected on readers’ eyes and recorded them on film.

12. EYE TRACKING DEVELOPMENT: Alfred Lukyanovich Yarbus , a Russian psychologist, conducted several eye tracking studies in the 1950s and 1960s. The results showed that the readers’ eye movement and fixation depend on their interest and the given task. In the 1970s, the eye trackers became less intrusive, provided better accuracy, and were able to separate eye from head movements.

13. EYE TRACKING DEVELOPMENT: In the 1980s, computers became powerful enough to do eye tracking in real time, which enabled the application of video-based eye trackers to human-computer interaction. At the end of the 1990s, companies such as the large advertising agency EURO RSCG started using eye-tracking technology to observe reactions to the Internet content.

14. VOICE TRACKING APPLICATION: 1. Voice search Allows the user to use a voice to search the Internet, a website, or an app.

15. VOICE TRACKING APPLICATION: 2. Speech-to-text Voice recognition facilitates hands-free computing with various applications, including writing emails, creating documents on Google Docs, generating automatic closed captions (such as on YouTube), providing automatic translations, and sending texts..

16. VOICE TRACKING APPLICATION: 3. Voice commands to smart home devices Smart home devices utilize voice recognition technology to automate household tasks, such as turning on lights, boiling water, adjusting thermostats, and more. Ex. Amazon, Alexa

17. VOICE TRACKING APPLICATION:

18. EYE TRACKING APPLICATION: 1. Marketing and Design Visual technology tracking offers the opportunity for companies to better understand customers and what holds their interest.

19. EYE TRACKING APPLICATION: 2. Healthcare Eye tracking also shows promise for improving research and the diagnosis process in the medical field. In ophthalmology, for better understanding of eye movements and for development of means to prevent, diagnose and treat abnormalities;

20. EYE TRACKING APPLICATION: 3. Sports and E-sports Recent studies use eye tracking glasses to examine active, in-game play within a variety of sports, from basketball to cricket to cycling and even karate.

21. EYE TRACKING APPLICATION:

22. VOICE TRACKING SOCIETAL IMPACT: Integrating voice recognition systems in household electronics increases usability for diverse user groups. It also provides convenience for multitasking. Households use smart assistants for controlling lights or thermostats, allowing users to manage various household tasks simultaneously while remaining physically engaged elsewhere.

23. VOICE TRACKING SOCIETAL IMPACT: Users can utilize vocal interfaces for tasks like making calls, sending messages, or seeking information, which indicates a growing trend toward hands-free operation.

24. VOICE TRACKING SOCIETAL IMPACT: It provides accessibility for individuals with disabilities, as voice recognition technology in electronic gadgets can serve as a bridge, with studies indicating that users with disabilities find vocal interaction easier than traditional methods. Studies show that some adults have difficulty using their hands due to various disabilities. For this group, engaging with solutions through vocal commands facilitates better access to functionality.

25. EYE TRACKING SOCIETAL IMPACT: · In high-risk fields like surgery, aviation, and maritime operations, eye tracking identifies how experts and trainees perform, improving training methods and safety protocols.

26. EYE TRACKING SOCIETAL IMPACT: · Eye-tracking technology helps identify difficulties in social attention and inferring mental states in individuals with autism, enabling the early detection of social-cognitive challenges and providing a tool for research.

27. EYE TRACKING SOCIETAL IMPACT: · Eye-tracking devices can use eye movements to enable individuals with limited mobility to communicate, express needs, and control devices, fostering independence and removing communication barriers.

28. Quiz Time! Instructions: Read and understand what is asked. Pick the best answer. It is an application of voice tracking technology, which enables its users to use their voice as a means to automate different appliances and devices to make living easier. Voice Tracking c. Voice command to smart home appliances b. Healthcare d. Sports and E-sports

29. Quiz Time! Instructions: Read and understand what is asked. Pick the best answer. 2. It is a system created in 1952 that can recognize the numbers 1 to 9, spoken by a single voice, and discerned with an accuracy of 90% seemed astounding. HMM c. AUDREY b. Bell Labs d. Shoebox

30. Quiz Time! Instructions: Read and understand what is asked. Pick the best answer. 3. Siri was released in? 2043 c. 1956 b. 2005 d. 2011

31. Quiz Time! Instructions: Read and understand what is asked. Pick the best answer. 4. It can provide convenience for multi-tasking by automating this technology with the use of commands. Eye tracking c. Apple phones b. Voice Tracking d. Appliances

32. Quiz Time! Instructions: Read and understand the instructions carefully. Pick the best answer. 5. A voice recognition system that was capable of processing and understanding more than 1,000 words HARPY c. HMM b. Dragon dictate d. Google

33. Quiz Time! Instructions: Read and understand the instructions carefully. Identify the correct answer. 6. The Russian psychologist who conducted several eye tracking studies in the 1950s and 1960s. 7. In 1990 , Dragon Systems released _____ the first consumer speech recognition product allowing users to dictate text hands-free.

34. Quiz Time! Instructions: Read and understand the instructions carefully. Identify the correct answer. 8. In _____, Edmund Huey built a device that could track eye movement during the reading process. 9. Eye tracking also shows promise for improving research and the diagnosis process in the medical field. What application is this?

35. Quiz Time! Instructions: Read and understand the instructions carefully. Identify the correct answer. 10. It provides accessibility for individuals with disabilities, as ___________ in electronic gadgets can serve as a bridge, with studies indicating that users with disabilities find vocal interaction easier than traditional methods. This is an example of the societal impact of what technology?

36. Quiz Time! Instructions: Read and understand the instructions carefully. Identify the correct answer. 11. By the early _____ , speech recognition accuracy had reached about 80%, with substantial advancements following as AI and deep learning were increasingly integrated into speech-to-text technologies.

37. Quiz Time! Instructions: Read and understand the instructions carefully. Identify the correct answer. 12. Visual technology tracking offers the opportunity for companies to better understand customers and what holds their interest. What application in voice technology is this?

38. Quiz Time! Instructions: Read and understand the instructions carefully. Identify the correct answer. 13. This technology follows and interprets what you look at . 14. What kind of technology is SIRI?

39. Quiz Time! Instructions: Read and understand the instructions carefully. Identify the correct answer. 15. This technology is used in healthcare to help identify difficulties in social attention and infer mental states in individuals with autism, enabling the early detection of social-cognitive challenges and providing a tool for research.

40. References: https://medium.com/@eyesee/eye-tracking-through-history-b2e5c7029443 https://www.callrail.com/blog/history-voice-recognition https://research.aimultiple.com/voice-recognition-applications/ https://www.gazept.com/eye-tracking/?srsltid=AfmBOopluBFh0Tnwlceql5KB15xXG3NFgiSQ5N0mCGny6Rs4tVQA8ov-&v=da984e42a589 https://moldstud.com/articles/p-the-impact-of-voice-technology-on-smart-device-user-experience-enhancing-interaction-and-accessibility https://imotions.com/blog/insights/trend/future-eye-tracking-technology/?srsltid=AfmBOoo1nkAVrY8zudeffy_hmmVVztAr7X0CYcIXX9iz4VCqssItiyEi https://www.mdpi.com/1424-8220/21/13/4289#:~:text=Eye%20tracking%20technologies%20have%20been,trackers%20%5B26%2C27%5D . https://pmc.ncbi.nlm.nih.gov/articles/PMC10694880/#:~:text=Results%20and%20conclusions,the%20association%20with%20autism%20characteristics . https://www.youtube.com/watch?v=-zjqCdvEpus&t=25

41. THANK YOU!