BLUE EYES T EC H NOLO G Y 1 Gayatri vidya parishad College for Degree And P.G Courses (A) Rushikonda-530045 Visakhapatnam Master of Computer Science Presented by Under the Guidance Doddi.Sa iRama Mrs.P.Ratna Pavani PG212206009 M.Sc (2021-2023)
Contents: Introduction What is Blue Eyes Technology Need of Blue Eyes Technologies used Hardware Components Data Security Advantages and Disadvantages Applications Conclusion
Introduction Blue Eyes is a technology conducted by the research team of IBM at its Almaden Research Center (ARC) in San Jose, California since 1997. Blue eyes technology makes a computer to understand and sense human feelings and behaviour and also enables the computer to react according to the sensed emotional levels.
What is Blue Eyes Technology A i m s a t c r e a ting c o m p u t a ti o n a l m a ch i n e s t h a t have perceptual and sensory abilities . Us e c a m e r a an d mi c r o p ho n e to ide n ti f y u ser actions and emotions 2 ?
The Term Blue Eyes BLUE in the term stands for Bluetooth, which enables reliable wireless communication EYES , because eye movement enables us to obtain a lot of interesting and important information. 3
Need of Blue Eyes Technology To b u ilt a m ach ine th a t c a n u n de rs t a n d yo u r emotions A PC that can listen, talk or scream V e r i f y y o u r iden t i t y, f e e ls y our Presence, and interact with you. To avoid and reduce human limitations such as tiredness,oversight,mental illness etc.. 4
Technologies Used Emotion Mouse Manual And Gaze Input Cascaded (MAGIC) Artificial Intelligent Speech Recognition Simple User Interest Tracker (SUITOR) The eye movement Sensor 5
Emotion Mouse Simplest way People spend approximately 1/3 of their total computer time touching input device p hysiological data is O btained and emotional state is determined A user model will be built that reflects the personality of the user. 6
7
Expression Glasses Expression Glass is an alternative for the usually available machine vision face or eye recognition methods. By analyzing pattern recognition methods and facial muscle variations, the glass senses and identifies the expressions . The prototype used for this glass uses piezoelectric sensors .
Magic Pointing Reduce The C ursor movement need for target selection C l i c k o n t h e t a rg e t w i t h a r e g ul a r m a n u a l i n p ut device. Webcam is used to determine the glints and pupils of the user 8
Approaches Liberal Approach To warp the cursor to every new object user looks at. User takes control of the target by find and search or ignore it and search for next. Conservative Approach Does not warp the cursor target until the manual input device has been actuated . Cursor is wrapped to the gaze area through the eye tracker 9
Artificial Intelligence in Speech Recognition Id en t i f i c a t i on ca use s s o m e ac t i o n t o b e taken User sp e a k s t o t h e co mpu t e r t h r o u g h micropho ne I np u t w o r ds are s ca n n e d a n d m a t c h e d against internally stored words F i l t e r e d a n d fe d t o A D C a n d th e n s t o r e d in RAM 10
Pilot gives commands to computers by speaking into microphones Can be connected to word processors and instead of writing, simply dictate to them 11 Applications of Artificial Intelligence
Suitor Help by fetching more information at desktop Notice where the user’s eyes focus on the screen Fills a sc r o l li n g ti cke r o n a co m p u t e r sc r e e n w ith information related to user’s task E x . I f r e a d ing h e ad li n e , p o p s u p the s t o r y in t h e browser window 12
The Eye Movement Sensor Design A personal area network for linking all the operators and the supervising system Two major units DAU (data acquisition unit ) CSU (central system unit ) 13
DAU The DAU consists of the following components : ATMEL 8952 microcontroller A Bluetooth Module A small LCD Display A removable ID cards A 13bit PCM code Jazz multi-sensors The LED indicators A beeper The 6AA batteries A voltage level monitor 14
DA U Components
DAU- Features Lightweight Runs on batteries - low power consumption Easy to use - does not disturb the operator working ID cards for operator authorization Voice transmission using hardware PCM codec 15
CSU – Components Connection Manager – main task to perform low-level blue tooth communication Data analysis Module – performs the analysis of the raw sensor data Data Logger Module – provides support for storing the monitored data. Visualization Module – provides user interface for the supervisors 16
CSU -Features 17 Central System Unit Data Analysis V i s ua li z at i on Module B lue tooth C o nn e c t i on Manager Data Logger Connection management Data processing Data recording Access verification System maintenance
Data Security Only registered mobile devices can connect to the system Bluetooth connection authentication Bluetooth connection encryption Access rights restrictions Personal and physiological data encryption 18
Advantages Disadvantages Advantages Disadvantages ● High accuracy level ● Fast in speed ● Naturalness as compared to the old traditional pointing ● Less physical effort and stress as compared to manual pointing ● Distraction while reading ● Reliability of the system ● High accuracy level ● Fast in speed ● Naturalness as compared to the old traditional pointing ● Less physical effort and stress as compared to manual pointing ● Distraction while reading ● Reliability of the system
Applications: In retailing record and interpret customer movements In automobile industry In video games To create “Face Responsive Display” and “Perceptive Environment” Generic control rooms Used to prevent car accidents Flight control centres Operating theatres 19
Conclusion: P r ov i d e m o r e d e li c a te a nd u s e r f r i en d ly f a c iliti e s in computing devices G a p b e t w e e n the e l ec t r o n i c a nd ph y s i c a l w o r ld is reduced The computers can be run using implicit commands instead of the explicit commands 20