Technical Club PPT for BTech CS and Btech IT

Technical Club PPT for BTech CS and Btech IT

1. Search Engine

2. What is a Search Engine? We use search engine like Google like every second. Search Engine is a software program which helps us find information over internet with just a piece of string or query.

3. How does a search engine works? Search engines, have a vast database, which contains information about every publicly accessible and allowed pages. Search engines just performs a search in their respective databases to provide users with the results.

4. So, who is entering data into these databases? Is there someone sitting in a cubicle and saving each page into the database?

5. Heck No! There is no one doing this manually. During the dot-com bubble, search engines like Yahoo, used to index web pages manually. Then Google came, Google did an innovation and replaced this process with a bot called "Crawler". After, search engines like Yahoo and Bing also adopted this.

6. How does a search engine work?

7. So how do we get results? We simply get results, after the search engine performs a search in their DATABASE.  Databases of search engines are so large, they almost contain every reachable site on the internet. So we can say they perform the search on internet, but they don’t actually perform search over internet.

8. FlexFind does the same, but less

9. Components of FlexFind Search Engine

10. Crawler As discussed before, crawler is an important for a search engine, our project is no different. It too have a crawler built in NodeJS and TypeScript. This crawler is responsible for going on each possible page on the internet and index every accessible page into FlexFind database.

11. So Why TypeScript? Not PHP? Making bots like crawler is possible but is not feasible. Crawlers are the bots, whose task will never be finished, as internet is almost filled with infinite number of pages, every minute new page comes live. So its almost infinite process, and PHP can not handle it. We can not perform infinite loading with PHP, as browsers will cancel the loading process and will declare the site as "THIS SITE TOOK TOO LONG RESPOND". That's why a programming language out of browser was needed to be chosen, here we chose TypeScript in NodeJS.

12. Database

13. So, why a SQL based database? Of course, we could use a NoSQL database like MySQL, but we decided to use MySQL as it provides and outstanding integration with both PHP and NodeJS.  Whereas, database like MongoDB is not well made for PHP, and it would be easy to create complex queries in SQL.

14. Backend We are using PHP to process user's search query and create SQL queries and fetch relevant records from the Database.

15. Don’t ask about HTML or CSS that isn't the focus.

16. Relevancy? So, you must have used Google to search something on Google, how does Google decide what are you searching for, what to rank on top, hence is the most relevant and what to show afterwards. Is it on random basis?

17. Why this matters? Users will probably visit the site in top 3 in the search result.  Ranking on top in Google on a keyword with large searches, will create a million dollars business and will surely generate a lot of revenue. And this can not be on luck basis, and it is not.

18. Search Algorithms Search engines like Google validates a page for over 200 factors to rank, like backlinks, on page optimization, mobile friendliness, bounce back rate etc. Other search engines do the same. This presentation is not about Google or SEO, hence we'll not go deep into it.

19. FlexFind uses similar approach Remember crawler? In FlexFind, crawler is responsible for not only indexing page content, but also to index meta data about the page. And also, the score for the pages. FlexFind crawler calculates a score for on page meta data available.  Crawler also increments the backlink count for target URL's it find. Finally, crawler increment the domain authority for each backlink it finds.

20. How FlexFind performs a search? FlexFind provide ranks to matched pages in following manner. Pages with Search string in their URL Search string exists distributively in single type of data about page. Search string in H1 tags. Search string in H2 / H3 / H4 / H5 / H6 HTML Tags. Search string exists in anywhere in page body. All words of the search string in the page present separetely. Any word except pronoun of search query exists in the page.

21. Algorithm of FlexFind With the ranking levels in the previous slide, FlexFind priorities ranking in descending order of a derived value which is calculated as  (domain autority + number of backlinks +(1.5*page optimization score))/3

22. Scope of Features & Correction This project can provide more relevant results, with more efficient search algorithm. Feature to search Multimedia Files like Images and Videos. Using OpenGraph tags to record answers and more accurate information in database to provide user directly with answers. Storing meta keywords from webpages into separate table to provide autocomplete feature. Lastly, providing Pagination or On Page End Scroll instead of loading all results in one go.

23. That's it for 10 Marks