AI & Microsoft Cognitive Services

AI & Microsoft Cognitive Services

1. Microsoft Cognitive Services Omnia Ismail TSP-Technical Solution Professional Amplifying human ingenuity

2. Labs An early look at emerging Cognitive Services technologies: discover, try, and give feedback on new technologies before general availability Knowledge Map complex information and data in order to solve specific tasks   Language Process text and learn how to recognize what users want Search Access billions of web pages, images, videos, and news with the power of Bing Vision From faces to feelings, allow your apps to understand images and video Speech Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Microsoft Cognitive Services Give your apps a human side

3. Easy Flexible Tested Why Microsoft Cognitive Services? Integrate into the language and platform of your choice Breadth of offerings helps you find the right for your app Bring your own data for your custom experience Built by experts in their field from Microsoft Research, Bing, and Azure Machine Learning Quality documentation, sample code, and community support Roll your own with REST APIs Simple to add: just a few lines of code required Get a key, Build www.Azure.com/Cognitive. 

4. A variety of real-world applications Category People; 5 faces Adult/ R acy? False /False Dominant c olors Accent color What is in the image or video? Computer Vision Vision Give me directions to the nearest local branch Speech Service Convert spoken audio to text Convert text to spoken audio Extract intent of user Speech Play today’s customer call recording Language Understanding Intelligent Service (LUIS) Now Playing 11/29/2016 Customer Call Natural Language Processing Intent: PlayCall Content: Customer# DateTime.date : today Speech to text Intelligent Image insights Language QnA Pair of this site? QnA Maker Automatic extraction of questions and answers Knowledge Search for ‘fraud prevention’ Bing News Search Intelligent web search Information Communications Media Market News It also investigates the top three expected Fraud Detection and Prevention programs, in terms of demand in key markets… The Big Question: In-House or Outsourced Fraud Protection? First, let’s point out that there is not one absolute answer—there are “pros” and “cons” to each. Those who favor in-house… How to Protect Your Business from Online Fraud this Holiday Season Michael heads fraud prevention tool. Online and mobile shopping are expected to continue growing apace… Search

5. Cognitive Services Top Customers

6. “Thousands of partners sign in to our platform every hour. The response time from the Face API is incredible, enabling us to verify our drivers without slowing them down.” Dima Kovalev, Product Manager, Uber Face API See video here Read case study here

7. Conversions related to recommendations account for 15 percent of our sales. The ability to automate recommendations and scale them to 10,000 products has had a big impact on our revenues. Miao Xue: Chief Information Officer DutchCrafters

8. Cognitive Services capabilities Infuse your apps, websites, and bots with human-like intelligence

9. Cognitive Services capabilities Infuse your apps, websites, and bots with human-like intelligence

10. Vision Content Moderator Custom Vision Video Indexer Process and extract smart insights from videos Customizable web service that learns to recognize specific content in imagery Image, Text and Video Computer Vision Distill actionable information from images Face Detect, identify, analyze, organize, tag faces in photos, and even recognize emotions

11. Speech Convert spoken audio into text, use voice for verification, or add speaker recognition to your app

12. Speech Speaker Recognition Use speech to identify and verify individual speakers Bing Speech Custom Speech Translator Speech Unified Speech service Convert speech to text and back again to understand user intent Overcome speech recognition barriers like speaking style, background noise, and vocabulary Easily conduct real-time speech translation with a simple REST API call Unified speech service for speech-to-text (general and custom speech models), text-to-speech (general and custom voice models) and speech translation (general and custom translator)

13. Search Add Bing Search APIs to your apps and harness the ability to comb billions of webpages, images, videos, and news with a single API call

14. Search Bing Autosuggest Give your app intelligent autosuggest options for searches Bing Search Web Search Image Search News Search Video Search Create a highly-customized web search experience Enrich user experiences with contextual entity search results Bing Entity Search Bing Custom Search Bing Visual Search Get rich insights to help build compelling image applications on the device of your choice Bing Statistics add-in Get powerful Bing API usage insights in an easy-to-use add-in

15. Demo - Kiosk

16. Demo - Azure Search and Cognitive Services Using Azure and AI to Explore the JFK Files https://jfk-demo.azurewebsites.net/

17. Language Allow your apps to process natural language with pre-built scripts, evaluate sentiment and learn how to recognize what users want

18. Language Understanding  Teach your apps to understand commands from your users Language Text Analytics Detect sentiment, key phrases, language, and extract top entities from your text Bing Spell Check Detect and correct spelling mistakes within your app Easily perform speech and text translation Translator Text

19. Knowledge Map complex information and data in order to solve specific tasks 

20. Knowledge Custom Decision Create custom experiences with adaptive, contextual decision-making QnA Maker Distill information into conversational, easy-to-navigate answers

21. Customer Understanding Closing the feedback loop QnA Ma ... Operati Azure Bot ... Annotated logs: sentiment intent + entities Applications evolve chat bot evolve business processes stay fresh Key phrase extraction Speech to Text Recordings (archival) troubleshoot Sentiment Analysis Social Media Reviews Voice of Customer Evolve: Don’t spend one year developing the “perfect bot” Launch small, add a new feature every week Which feature? Follow your users

22. Identify customers and staff use case unlock multifactor authentication train identities live ops Face Verify Emotion Speaker Verify Assess and react: emotion at point-of-help & checkout reinforce happiness with rewards, or instant direct to customer care "disgust" : 0.6847 , "sadness" : 0.2135 , "anger" : 0.0955… "happy" : 0.999…  "happy" : 0.992… Extra security: light-touch extra verification before sensitive operations Practical when: passwords cumbersome customer fingerprints not available staff using gloves, carrying tools etc. Applications customer identification greeting, in-store support satisfaction … light-touch identification o n-the-spot instant survey

23. Developer resources Pricing https://azure.microsoft.com/en-us/pricing/details/cognitive-services/ Documentation https://docs.microsoft.com/en-us/azure/#pivot=products&panel=cognitive Client SDKs https://azure.microsoft.com/en-us/resources/samples/?sort=0&term=cognitive+services https://github.com/southwood/project-oxford-python Example Code https://github.com/jsturtevant/happy-image-tester-django https://github.com/Microsoft/Cognitive-Face-Android https://github.com/Microsoft/Cognitive-Samples-IntelligentKiosk Join Our Community https://stackoverflow.com/questions/tagged/microsoft-cognitive https://cognitive.uservoice.com/

24. Thank You