final_ppt[1].pptxCCCCCCCCCCCCCCCCCCCCCCCC

FINAL PPT

1. Contents Introduction Problem Statement Objectives Methodology Features Technology Stack Implementation Results Future Enhancements Conclusion Acknowledgements

2. Introduction Welcome to the presentation on our exciting project: Designing an Advanced Voice Assistant Inspired by J.A.R.V.I.S. Inspired by the iconic AI assistant, J.A.R.V.I.S., from the Iron Man movies, we embarked on a journey to bring a futuristic vision to life through the power of artificial intelligence. Our project aims to address the growing need for intelligent virtual assistants capable of seamlessly understanding and executing a wide range of commands, thereby revolutionizing human-computer interaction. Throughout this presentation, we will delve into the challenges we faced, the methodologies we employed, and the remarkable features of our voice assistant, showcasing its potential to enhance productivity and streamline everyday tasks.

3. Problem Statement D espite the advancements in artificial intelligence, the existing virtual assistants often lack the sophistication and versatility required to meet the diverse needs of users effectively. The challenge lies in designing and implementing a virtual assistant capable of understanding and executing commands seamlessly, regardless of complexity or variability in speech patterns. Existing virtual assistants often struggle with accurately interpreting user commands, leading to frustration and inefficiency. Our project seeks to address this gap by developing an advanced voice assistant inspired by J.A.R.V.I.S. from the Iron Man movies. The goal is to create a sophisticated system that not only understands a wide range of commands but also executes them seamlessly, bringing a futuristic vision to life using the power of artificial intelligence.

4. Objectives 1. Seamless Command Interpretation: Develop algorithms and models to accurately understand and interpret user commands, regardless of complexity or variability in speech patterns. 2. User Interaction: Design an intuitive user interface that reflects the futuristic aesthetics often portrayed in science fiction, providing both voice and text-based interaction options to enhance user experience. 3. Integration with External Services: Integrate with external services such as Wikipedia, news APIs, email servers, and messaging platforms to enable seamless communication and information retrieval. 4. Natural Language Processing: Utilize advanced natural language processing techniques to enhance the assistant's ability to understand and respond to user queries in a conversation.

5. Methodology 1. Research and Analysis: Conducted extensive research on existing virtual assistant technologies and their limitations. Analyzed user requirements and expectations to determine the features and functionalities to be implemented. 2. Technology Selection: Selected appropriate technologies and programming languages based on their suitability for natural language processing, user interface development, and integration with external services. 3. Development Process: Adopted an agile development approach to iteratively design, develop, and test the voice assistant. Divided the project into sprints, with each sprint focusing on implementing specific features or functionalities.

6. 4. Natural Language Processing (NLP): Employed state-of-the-art NLP techniques to process and understand user commands. Leveraged pre-trained language models and custom algorithms to enhance the assistant's ability to interpret natural language input. 5 . Integration with External Services: Integrated with external services such as Wikipedia, news APIs, email servers, and messaging platforms using appropriate APIs and protocols. 6. Deployment and Monitoring: Deployed the voice assistant on appropriate platforms, such as desktop computers, mobile devices, or smart speakers. Implemented monitoring and analytics tools to track usage patterns, identify bottlenecks, and optimize performance.

7. Features 1. Voice Recognition: Seamlessly recognize and interpret natural language commands spoken by the user. 2. Functional Diversity: Perform a wide range of tasks, including setting alarms, sending messages, playing music, querying websites, and more. 3. Joke Telling: Entertain users with a collection of witty jokes and humorous responses. 4. Application Control: Open, close, or switch between applications based on user commands. 5. Information Retrieval: Query online sources such as Wikipedia to retrieve information.

8. 6. News Updates: Provide users with the latest news updates from reputable sources. 7. Natural Language Understanding: Understand and respond to user queries in a conversational manner, enhancing the user experience. 8. Customizable Preferences: Allow users to customize preferences and settings to tailor the assistant to their needs. 9.Futuristic User Interface: Present a visually appealing and intuitive user interface inspired by science fiction aesthetics. 10. Error Handling: Implement robust error handling mechanisms to gracefully handle unexpected inputs or errors.

9. Technology Stack 1. Programming Languages: Python: Used for the backend development, natural language processing, and integration with external services. PyQt5: Employed for frontend development to create the user interface. 2 . Libraries and Modules: pyttsx3: For text-to-speech conversion. speech_recognition : For speech recognition. datetime : For working with date and time. os : For interacting with the operating system. wikipedia : For fetching information from Wikipedia.

10. pywhatkit : For sending WhatsApp messages and playing YouTube videos. sys: For interacting with the Python interpreter. pyjokes : For fetching random jokes. PyQt5: For creating the graphical user interface (GUI). 4. APIs and Services: News APIs: Utilized to fetch the latest news updates from various news sources. 5. Development Tools: Git: Utilized for version control and collaborative development. VS Code: Chosen as the primary integrated development environment (IDE) for coding and debugging.

11. Implementation Imported libraries such as ` webbrowser `, `pyttsx3`, ` speech_recognition `, ` datetime `, ` os `, `cv2`, `requests`, ` wikipedia `, ` pywhatkit `, ` smtplib `, `sys`, ` pyjokes `, and PyQt5 modules and initialized the `pyttsx3` engine for text-to-speech conversion. Designed the overall architecture of the voice assistant, including backend and frontend user interface. Defining a subclass ` MainThread ` of ` QThread ` for handling the main tasks of the application asynchronously. The ` taskExecution ` method of ` MainThread ` performs the main functionalities of the virtual assistant.

12. GUI Implementation defines a class ` UserInterface ` that subclasses ` QMainWindow `. It starts the ` MainThread ` instance when a button is clicked and updates the UI with current time. Initialize a ` QApplication ` instance, create the ` UserInterface ` object, and display the GUI. It starts the event loop with ` app.exec _()` to run the application. Conducted tests to ensure the reliability and functionality of the voice assistant. The latestNews function fetches and reads news articles from various categories using the News API.

13. Code main.py import webbrowser import pyttsx3 import speech_recognition as sr import datetime import os import cv2 from requests import get import wikipedia import pywhatkit as kit import smtplib import sys import pyjokes from PyQt5 import QtWidgets , QtCore , QtGui from PyQt5.QtCore import * from PyQt5.QtGui import * from PyQt5.QtWidgets import * from PyQt5.uic import loadUiType from jarvisGUI import Ui_JarvisGUI engine = pyttsx3.init('sapi5') voices = engine.getProperty ('voices') engine.setProperty ('voices', voices[0].id) def speak(audio): engine.say (audio) print(audio) engine.runAndWait () def wish(): hour = int( datetime.datetime.now ().hour) if hour >= 0 and hour < 12: speak("good morning") elif hour > 12 and hour < 18: speak("good afternoon") else: speak("good evening") speak(" i am jarvis tell me how can i help you") def sendEmail (to, content): server = smtplib.SMTP ('smtp.gmail.com', 587) server.ehlo () server.starttls () server.login ('[email protected]', 'vikas12345@') server.sendmail ('your mail id', to, content) server.close () class MainThread ( QThread ): def __ init __(self): super( MainThread , self).__ init __() def run(self): self.taskExecution () def takecommand (self): r = sr.Recognizer () with sr.Microphone () as source: print("listening......") r.pause_threshold = 1 audio = r.listen (source) try: print("Recognizing.....") query = r.recognize_google (audio) print( f"user said: {query}") except Exception as e: speak("Say that again please.....") return "none" return query

14. def taskExecution (self): # speak(" hii hello") wish() while True: self.query = self.takecommand ().lower() if "open chrome" in self.query : cr = "C:\\Program Files\\Google\Chrome\\Application\\chrome.exe" os.startfile ( cr ) elif "open command prompt" in self.query : os.system ("start cmd ") elif "open camera" in self.query : cap = cv2.VideoCapture(0) while True: ret, img = cap.read () cv2.imshow('webcam', img ) k = cv2.waitKey(50) if k == 27: break; cap.release () cv2.destroyAllWindows() elif "play music" in self.query : music_dir = "E:\\songs" songs = os.listdir ( music_dir ) for song in songs: if song.endswith ('.mp3'): os.startfile ( os.path.join ( music_dir , song)) elif " ip address" in self.query : ip = get('https://api.ipify.org').text speak( f"your ip address is { ip }") elif " wikipedia " in self.query : speak("searching wikipedia ...") self.query = self.query.replace (" wikipedia ", "") results = wikipedia.summary ( self.query , sentences=2) speak("according to wikipedia ...") speak(results) print(results) elif "news" in self.query : from NewsRead import latestNews latestNews () elif "open youtube " in self.query : speak("opening youtube ") webbrowser.open ("www.youtube.com") elif "open facebook " in self.query : speak("opening facebook ") webbrowser.open ("www.facebook.com") elif "open linkedin " in self.query : speak("opening linkedin ") webbrowser.open ("www.linkedin.com") elif "open google" in self.query : speak("sir what do I search on google") cm = self.takecommand ().lower() webbrowser.open (f"{cm}") elif "send whatsapp message" in self.query : kit.sendwhatmsg ("[phone]", “Hello", 20, 13) elif "search songs on youtube " in self.query : kit.playonyt ("see you again") elif "send email to vikas " in self.query :

15. try: speak("what should i say?") content = self.takecommand ().lower() to = "[email protected]" sendEmail (to, content) speak("email has been sent") except Exception as e: print(e) speak("sorry sir i am not able to send this email") elif "no thanks" in self.query : speak("thanks for using me sir, have a good day") sys.exit () elif "stop" in self.query : speak("ok sir") sys.exit () elif "close chrome" in self.query : speak("closing chrome sir") os.system (" taskkill /f / im chrome.exe") elif "set alarm" in self.query : nn = int( datetime.datetime.now ().hour) if nn == 00: speak( f"alarm is set at { nn }") music_dir = "E:\\songs" songs = os.listdir ( music_dir ) os.startfile ( os.path.join ( music_dir , songs[1])) elif "tell me a joke" in self.query : jk = pyjokes.get_joke () speak( jk ) elif "shut down the system" in self.query : os.system ('shutdown /s /t 5') elif "restart the system" in self.query : os.system ("shutdown /r /t 5") elif "sleep the system" in self.query : os.system ("rund1132.exe powrprof.dll, SetSuspendState 0,1,0") speak("sir, do you have any other work") startExecution = MainThread () class UserInterface ( QMainWindow ): def __ init __(self): super().__ init __() self.ui = Ui_JarvisGUI () self.ui.setupUi (self) self.ui.pushButton.clicked.connect ( self.startTask ) self.ui.pushButton_2.clicked.connect( self.close ) def startTask (self): self.ui.movie = QtGui.QMovie ("Gifs/MImN.gif") self.ui.label.setMovie ( self.ui.movie ) self.ui.movie.start () self.ui.movie = QtGui.QMovie ("Gifs/7kmF.gif") self.ui.label_2.setMovie( self.ui.movie ) self.ui.movie.start () self.ui.movie = QtGui.QMovie ("Gifs/SUV4.gif") self.ui.label_4.setMovie( self.ui.movie ) self.ui.movie.start () self.ui.movie = QtGui.QMovie ("Gifs/Jarvis_Loading_Screen.gif") self.ui.label_5.setMovie( self.ui.movie ) self.ui.movie.start () self.ui.movie = QtGui.QMovie ("Gifs/7fi4") self.ui.label_3.setMovie( self.ui.movie ) self.ui.movie.start () timer = QTimer (self) timer.timeout.connect ( self.showTime ) timer.start (1000) startExecution.start ()

16. def showTime (self): current_time = QTime.currentTime () current_date = QDate.currentDate () time = current_time.toString (" hh:mm:ss ") date = current_date.toString ("dd/MM/ yyyy ") self.ui.textBrowser.setText ("\n\ nDate : "+date+"\n\ nTime : "+time) app = QApplication ( sys.argv ) jarvis = UserInterface () jarvis.show () exit( app.exec _())

17. NewsRead.py import requests import json import pyttsx3 engine = pyttsx3.init('sapi5') voices = engine.getProperty ('voices') engine.setProperty ('voices', voices[0].id) def speak(audio): engine.say (audio) print(audio) engine.runAndWait () def latestNews (): apidict = {"business": "https://newsapi.org/v2/ top-headlines?country = in&category = business&apiKey =69dcc3ac5fb64dad8465953e66dd70b5", "sports": "https://newsapi.org/v2/ top-headlines?country = in&category = sports&apiKey =69dcc3ac5fb64dad8465953e66dd70b5", "entertainment": "https://newsapi.org/v2/ top-headlines?country = in&category = entertainment&apiKey =69dcc3ac5fb64dad8465953e66dd70b5", "health": "https://newsapi.org/v2/ top-headlines?country = in&category = health&apiKey =69dcc3ac5fb64dad8465953e66dd70b5", "technology": "https://newsapi.org/v2/ top-headlines?country = in&category = technology&apiKey =69dcc3ac5fb64dad8465953e66dd70b5" } content = None url = None speak("which field news do you want, [business] , [sports] , [entertainment] , [health] , [technology]") field= input("type field news that you want") for key, values in apidict.items (): if key.lower () in field.lower (): url =values print( url ) print(" url was found") break else: url = False if url is False: print(" url not found") news = requests.get ( url ).text news = json.loads (news) speak("this is your first news") arts = news["articles"] for articles in arts: article = articles["title"] print(article) speak(article) news_url = articles[' url '] print( f"for more info visit { news_url }") a = input("[press 1 to continue] and [press 2 to stop]") if str(a) == "1": pass elif str(a) == "2": break speak("that's all")

18. Results 1. Successful Development: Successfully developed and implemented an advanced voice assistant inspired by J.A.R.V.I.S. Implemented a wide range of features and functionalities, including voice recognition, natural language processing, and integration with external services. 2. Seamless User Experience: Delivered a seamless and intuitive user experience through a futuristic user interface and natural language understanding capabilities. Users can interact with the assistant effortlessly, performing tasks such as setting alarms, sending messages, and retrieving information with ease. 3. High Accuracy: Achieved high accuracy in speech recognition and natural language understanding tasks, minimizing errors and misunderstandings. Fine-tuned machine learning models and algorithms to improve accuracy and performance.

19. 4. Positive Feedback: Received positive feedback from users on the assistant's functionality, reliability, and user interface design. Users appreciated the assistant's ability to understand and execute commands effectively, enhancing their productivity and convenience. 5. Increased Productivity: Users reported increased productivity and efficiency in performing various tasks with the assistance of the voice assistant. The assistant streamlined routine tasks such as setting reminders, checking the weather, and retrieving information, saving users time and effort.

20. Future Enhancements 1. Multi-Language Support: Enhance the natural language processing capabilities to support multiple languages, catering to a broader user base. 2. Personalization and User Profiles: Implement user profiles and preferences to personalize the assistant's responses and recommendations based on individual user preferences. 3. Contextual Understanding: Develop algorithms to improve the assistant's ability to understand and respond contextually to user queries, considering previous interactions and user history. 4. Voice Modulation and Customization: Introduce voice modulation and customization options, allowing users to personalize the assistant's voice and tone.

21. 5. Advanced Task Automation: Expand the range of tasks the assistant can automate, such as scheduling appointments, booking reservations, and managing finances. 6. Emotion Recognition and Response: Incorporate emotion recognition capabilities to detect and respond to users' emotional states, providing empathetic and personalized interactions. 7. Continuous Learning and Improvement: Implement mechanisms for continuous learning and improvement, allowing the assistant to adapt and evolve over time based on user feedback and usage patterns. 8. Accessibility Features: Introduce accessibility features such as text-to-speech and voice commands for users with disabilities, ensuring inclusivity and accessibility for all users. 9. Augmented Reality (AR) Integration: Explore integration with augmented reality technologies to provide immersive and interactive experiences through AR interfaces.

22. Conclusion In conclusion, our project to design an advanced voice assistant inspired by J.A.R.V.I.S. has been a significant step towards realizing the potential of artificial intelligence in revolutionizing human-computer interaction. Through meticulous planning, implementation, and testing, we have successfully developed a sophisticated virtual assistant capable of understanding and executing a wide range of commands seamlessly. The voice assistant's futuristic user interface, coupled with its natural language processing capabilities, has provided users with an intuitive and immersive experience, reminiscent of science fiction.

23. Acknowledgement Faculty Advisors: [Dr. Roopa H] - for their guidance, support, and mentorship throughout the project. Team Members: [Tulasi, Ujjwal, Vikas, Shubham] - for their hard work, dedication, and collaborative efforts in bringing this project to fruition. Open Source Community: - for providing access to various tools, libraries, and resources that were instrumental in the development process. [Bangalore Institute of Technology]: - for providing the necessary resources, facilities, and opportunities.

24. Thank You !! We respect your valuable time