PC Control with Eye Movement for Specially Abled.pptx

Blueprint of making a device that can help specially abled people to communicate with technology

1. PC Control with Eye Movement for Specially Abled People Concept Node By: Vivek Bhatt (your id) Ananya Manral (56945) Vaibhav Raj Singh (56944) Anjali Grover (her id)

2. Objective Creating a goggles like device for capturing eye movement of a person by an IR blink sensor and a camera, and controlling the monitor screen by eye and head movements.

3. Rationale There are many people in the world who have cognitive neurological disorders, people with carpal tunnel syndrome and people who for some accident/reasons get paralyzed neck down for a brief period of time or while in recovery cannot move their body properly. They could be aided to use Computers just by eye movements and head gestures

4. Methodology Infra red sensor will detect the blinks of an eye. The lateral motions of eyes will trigger a lateral movement of the cursor on the screen. Head tilts and movements will move cursor by a large pixel distance Blinking motion triggers a click, to differentialte between natural and intentional, a continued blink for 2-3 seconds will be considered a click , Image processing of the data given by camera will be done by the use of convolutional neural networks Eye and head movements captured by camera as input for cursor movements on screen. We will use raspberry pi to interface the sensors and camer a modules with the desktop

5. Translating the tilt and sudden movements of head into large pixel movement. Repeated tweaks will be needed to done for accurate calibration of the sensors and the monitor for accurate translation of the cursor during design process Dim light environment and ambient light could effect the accuracy of the readings of eye movements by the camera module Finding the point of fixation of the cursor w.r.t the computer screen and eyes for efficient movement of cursor across the screen. Every user’s eyes and shape are different, also there are slight jitters and drift going on in a person’s eye, these issues have to be accommodated with robust algorithm and careful calibration. Challenges

6. Raspberry Pi (from GeM website) : ₹ 1500 - ₹ 3000 Camera Module : : ₹300 - ₹500 Infra-sensor module : ₹100 - ₹300 Clear goggles : ₹200- ₹400 Connecting wires: ₹100 - ₹200 Total Estimate : ₹ 2200 - ₹ 4600 Hardware Requirements With Estimate