UTD-Template-lsdflkskllksPresentation.pptx

Rpa presention.

1. Web Scraping Automation with UiPath Likhith Reddy Bandi LXB230014

2. The goal of this project is to automate the web scraping process by using UiPath . In today's data-driven world, web scraping is essential since it allows for the major insights and advantages that come from pulling relevant information from websites. This project is necessary because human web scraping is labor-intensive and prone to errors, issues that may be effectively resolved by automation. Introduction

3. Justification Web scraping is essential for organizations needing to collect data from websites for analysis, decision-making, or monitoring purposes. UiPath provides a robust platform for automating repetitive tasks, making it an ideal tool for efficient web scraping. This project aims to leverage UiPath to automate the web scraping process, reducing manual effort, increasing accuracy, and ensuring timely data retrieval.

4. No RPA alternatives : The decision to use UiPath was made after thoroughly evaluating for Ease of Use, Scalability, Robustness, Community and Support, Integration Capabilities for web scraping . No example of modernization : Rather than updating old scraping jobs, the procedure entails creating new, customized ones. Stability : The websites that are the goal of scraping have a consistent structure that doesn't alter often. Iteration : To gather updated data, the procedure must be carried out on a frequent basis.

5. Process Quality : By getting rid of manual mistakes, the process's quality will considerably increase. Data Quality : Accuracy, consistency in formatting, and great data quality are all guaranteed via automated scraping. Process Mechanics : RPA implementation is a good fit for the scraping process's simple mechanics.

6. Data set Used : For this project. I used data from stackoverflow website where I will be extracting data. It is very complex data where u have so much of data to search and filter, which is big task. And also I used self made data set which contains names of the player. Which we will be using to scrap the bio data of the player

7. As-Is Workflow: Manually access the target websites. Copy-paste the required data into a document or spreadsheet. Manually format and correct any errors in the data. Manually send the data via email to stakeholders. Store the data in an Excel file. Structure of Workflow

8. Automated access to target websites using UiPath. Automatic extraction of data and consolidation. Automated data formatting and validation. Sending the formatted data via email using UiPath’s email activities. Automatically saving the data in an Excel file. To-Be Workflow

9. Automated Access to Target Websites (UiPath): Automate the navigation to the target websites by using UiPath. Take pertinent information (pricing, product details, etc.) from these websites. Automated Data Extraction and Consolidation: Web sites, APIs, databases, and other sources can all have data scraped using UIPath . Combine the extracted data into a database, CSV file, or other structured format. Automated Data Formatting and Validation: Format the data in accordance with your needs by using UiPath activities. Verify the data (e.g., look for anomalies, missing values, etc.). Workflow with UIpath

10. Accessing the dataset (UiPath): Automate the access to the data variable stored in the file by using UiPath. Workflow with UIpath

11. Automated Access to Target Websites (UiPath): Automate the navigation to the target websites by using UiPath. Workflow with UIpath

12. Iterating the data variable (UiPath): Automate the iteration of the data variable stored in the file by using UiPath to get required data in the website. Workflow with UIpath

13. Automated Data Searching: Automating data Search using UIPath . Workflow with UIpath

14. Automated Data selection: Automating data Selection by using click function available in UIPath . Workflow with UIpath

15. Automated Data Scraping: Automating data scraping using UIPath . Workflow with UIpath

16. Data storing (UiPath): Set up UiPath to store the data automatically.

17. Automatic Data Storage in an Excel File: Formatted data can be automatically saved by UiPath into an Excel file. Indicate the location of the file and the naming style

18. Formatted Data Emailing (UiPath Email Activities): Set up UiPath to send the formatted data in an email. Indicate the recipients and any more details that are required

19. Using Graphics and UTD Logos. Another similar web scraping which I did using different approach (build in data scarping tool in Uipath ) which is so flexible, easy and useful in many ways. Using data scraping tool web scarping can be made is and fast. In this presentation I am going present 2 projects and I am going show how is the data scraping tool from uipath can make it easy. Projects explanation

20. Using Graphics and UTD Logos. Project using data Scraping tool

21. Using Graphics and UTD Logos. Project using data Scraping tool

22. Using Graphics and UTD Logos. Project using data Scraping tool

23. Using Graphics and UTD Logos. Project using data Scraping tool

24. Using Graphics and UTD Logos. While doing this project I got to face challenges while scraping data form different websites using same Uipath code. I mean it is hard to make it generalize the code for it use for every other website. But I solved it using anchor concept which is used to Uniquely identify the text that user is interested into even the website design is different. It investigates common thing where every similar website use. Problems faced

25. Using Graphics and UTD Logos. Demo Video

26. Using Graphics and UTD Logos. UiPath Studio: For developing automation workflows. Microsoft Excel: For storing and processing the scraped data. Email Client: For sending the extracted data to stakeholders. Tools used

27. · Market Researchers: Require accurate and timely data for market analysis. · Data Analysts: Reporting and trend analysis require consistent data. company Strategists: Make strategic company decisions by utilizing data insights · IT Department: In charge of upkeep and assistance with the automation infrastructure. Project Managers: Supervise the project's execution and guarantee that its goals are met · Business Strategists: Use data insights to make strategic business decisions. · Finance Department: Analyzes financial implications and ROI of implementing the automation. · Customer Service Teams: May use competitive data to improve customer interactions and support.   Stakeholders

28. Automated Web Scraping Scripts: Ready-to-use UiPath scripts for scraping data from specified websites. Data Storage Solutions: Structured data stored in the desired format (e.g., CSV, database). Documentation: Comprehensive documentation of the automation process, including user manuals and technical guides. Training Sessions: Training for stakeholders on how to use and maintain the automation scripts.

29. Increased Efficiency: Reduced manual effort and time spent on data collection. Improved Data Accuracy: Automated processes minimize human errors. Timely Data Availability: Regular and automated data extraction ensures up-to-date information. Cost Savings: Automation reduces operational costs associated with manual data scraping. This proposal outlines the key aspects of the web scraping project using UiPath, ensuring clarity and alignment with project goals and stakeholder expectations. Stakeholder Benefits

30. Deliverables from this project will offer a dependable, accurate, and effective way to scrape websites, which will be of great utility to stakeholders. Process automation will guarantee timely data transmission, minimize errors, and cut down on manual work. This will improve output and decision-making skills, which will ultimately lead to improved corporate results and more knowledgeable strategic choices. The study demonstrates how RPA may be used to turn laborious manual operations into efficient, automated workflows. Conclusion

31. Thank you for listening.