VISVESVARAYA TECHNOLOGICAL UNIVERSITY "Jnana Sangama ", Belgaum: 590 018 H.K.E SOCIETY’S SIR M VISVESVARAYA COLLEGE OF ENGINEERING (Affiliated to VTU - Belagavi, Approved by AICTE, Accredited by NAAC) Yeramarus Camp, Raichur-584135, Karnataka 2023-2024 FINAL YEAR PROJECT PHASE- 2 PRESENTATION ON “ VOICE CONTROLLED HUMANOID ROBOT WITH FACIAL EXPRESSIONS” UNDER THE GUIDENCE OF DR. VISHWANATH P DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING
VOICE CONTROLLED HUMANOID ROBOT WITH FACIAL EXPRESSIONS
TEAM MEMBERS MD SOUDAGAR KAIF MD SHOAIB RAMYA TULSAMMA SAHANA
CONTENTS INTRODUCTION LITERATURE SURVEY OBJECTIVES IMPLEMENTATION OF PROPOSED SYSTEM HARDWARE AND SOFTWARE REQUIREMENTSS RESULTS CONCLUSION REFERENCES
INTRODUCTION So far, In the area of robotics, creating human like machines capable of mimicking basic human movements has been developing One such attempt is the development of a voice controlled humanoid robot that can showcase basic human locomotions To ensure the interaction between the humans and machine in the proposed system a wireless communication method is used
Intro.... This project integrates Arduino Mega microcontroller and HC-05 Bluetooth module to establish wireless communication and control between the robot and a smartphone application. By harnessing the power of speech recognition technology, users can effortlessly command the robot to perform various human-like movements such as turning to left , turning to right , and hand movements. Inspired with the humans facial expressions we have also developed the machine to showcase the Facial expressions that resemble the human
LITERATURE REVIEW Vishal P. Patil et al [1] proposed on A Review on Voice Command Recognition Techniques for Robot Control which provides an overview of various voice recognition techniques and their applications in robot control systems. Shubham S. Bhende et al [2] "Bluetooth Technology for Robotics Applications: A Survey" which explores the use of Bluetooth technology in robotics applications, including communication protocols and hardware considerations. Yajia Zhang et al [3] explored on "Humanoid Robot Motion Planning and Control: A Literature Review" which discusses various approaches to motion planning and control for humanoid robots, which could be useful for implementing locomotion patterns. Tareq Alhmeiedat et al [4] proposed on "Arduino-Based Robotics: A Review" which provides an overview of the use of Arduino-based platforms in robotics, including hardware capabilities, programming environment, and applications.
1 2 3 4 OBJECTIVES Leveraging wireless Co mmunication voice Recognition Prototype Locomotion Systems Showcasing predefined facial expressions
BLOCK DIAGRAM FOR HUMAN LOCOMOTIONS Designing the Control Interface Sending Commands via Bluetooth Executing Actions Interpreting User Input Parsing Incoming Data on Arduino
METHODOLOGY 1. Designing the Control Interface: Designing user-friendly interface in the Bluetooth app that allows users to input commands or select actions for the robot. This interface include s buttons, sliders, dropdown menus, or text input fields, etc., 2. Sending Commands via Bluetooth: Implement the necessary functionality in the app to send commands or instructions to the Arduino Mega via Bluetooth. This involves establishing a Bluetooth connection with the HC-05 module and sending data packets containing the user's input. 3. Parsing Incoming Data on Arduino: passsing the commands to the Arduino Mega to receive and interpret the data sent by the Bluetooth app. it involve reading characters or strings from the serial buffer and parsing them to extract the user's commands or instructions.
4. Interpreting User Input: Once the data is received, the Arduino code interpret s the user's input to determine the desired action for the robot. This involve s mapping specific input values or commands to corresponding robot movements or behaviors. 5. Executing Actions: Based on the interpreted user input, trigger the appropriate actions on the robot.
BLOCK DIAGRAM FOR PREDEFINED EXPRESSIONS Choosing facial expressions Choosing text Scaling Bitmap Format Waveform format Convert to 8-bit PCM Hexcode ESP32 PAM OLED display Output
METHODOLOGY Choosing facial expressions: I n this 1st step , some of the facial expressions are choose to display on the OLED display . Scaling: I norder to match the resolution images to resolution of the display, the images are converted to a resolution of 128*64 pixels . Bitmap format: T he omages are converted to the bitmap format, where the pixels color information is encoded as a binary value ( 1 for illumknated, 0 for non-illuminated ). Choosing text: G athering the predefined texts that we want the robot to utter .
Waveformat: U sing a text to speech converter, we convert the text to corresponding audio waveform . Convert to 8-bit PCM : U nsigned 8-bit PCM format is one of ghe simplest audio format, making it easier to work with ESP 32 . Hexcode: I terating through the audio samples and convert each samples to hexadecimal format . Hexadecimal representation allows for compact storage of audio data .
HARDWARE REQUIREMENTS HC05 BLUETOOTH ARDUINO MEGA SERVO MOTOR
SOFTWARE REQUIREMENTS Arduino IDE To write the computer code and upload the code to the physical board. Notevibes Is an AI voice generator that allows to read digital text a loud and save the audio you produce as either a WAV or MP3 file. Audacity Is the software used for recording and editing audio. Bit Map Array It is used to convert image in the form of code (store digital images) Tomeko Converting hexadecimal log into series of bits. Used to debug unexpected bit shift when writing and reading back data to SPI memory chip. MIT App I nventor MIT App Inventor is an intuitive, visual programming environment that allows everyone to build fully functional apps for smartphones and tablets.
ADVANTAGES This template has been created by Slidesgo customizable and Adaptable Low cost accesseble design Interfacing with arduino mega Remote control
APPLICATIONS 1 Education tool 2 Physical Therapy and Rehabilitation 3 Medical Institutions 4 Assistive technology 5 Entertainment industry
RESULTS
REFERENCES (1) Patil, V. P., Shinde, S. B., & Khatal, L. G. (2015). A Review on Voice Command Recognition Techniques for Robot Control. DOI:10.1109/ICAL.2008.4636587. IEEE Xplore . (2) Bhende, S. S., Patil, P. H., & Patil, M. D. (2013). Bluetooth Technology for Robotics Applications: A Survey. ISSN 2320-2882 International journal of creative reasearch thoughts. (3) Zhang, Y., Liu, Y., & Fu, C. (2013). Humanoid Robot Motion Planning and Control: A Literature Review. September 2020 / 134(2020):103643 DOI:10.1016/j.robot.2020.103643. IEEE explore. (4) Alhmiedat, T., & Almashaqbeh, G. (2019). Arduino-Based Robotics: A Review. DOI:10.1007/978-1-4302-3184-4_2 In book: Arduino Robotics (pp.51-82). IEEE explore
CONCLUSION Through this project, we have successfully showcased the integration of hardware and software to enable seamless communication and control between a user and a robotic system.We have developed a model that showcases the basic human locomotions and aslo some of the predefined facial expressionsWe can conclude that by combining the proposed system with other technologies such as machine learning and Advanced Robotics Platforms etc , this system can become more sophisticated, their impact on the future is likely to be profound