Introducing Amazon Rekognition, Amazon Polly and Amazon Lex

  • Published on
    16-Apr-2017

  • View
    1.669

  • Download
    5

Embed Size (px)

Transcript

<ul><li><p>#aws_serverless</p><p>Introducing Amazon Rekognition, Amazon Polly and </p><p>Amazon LexKeisuke Nishitani (@Keisuke69)</p><p>Amazon Web Services Japan K.K.Dec 07, 2016</p></li><li><p>#aws_serverless</p><p>ProfileKeisuke NishitaniSpecialist Solutions Architect, Amazon Web Service Japan K.K</p><p>@Keisuke69 Keisuke69</p><p> Specialist SA- Serverless- Mobile- DevOps- Application Service</p><p> REST : http://keisuke69.hatenablog.jp/</p><p>Keisuke69 Keisuke69Keisuke69x</p></li><li><p>#aws_serverless</p><p>Amazon Rekognition</p></li><li><p>#aws_serverless</p><p>Amazon Rekognition</p></li><li><p>#aws_serverless</p><p>Amazon Rekognition</p><p> DetectLabels DetectFaces CompareFaces IndexFaces</p><p>SearchFaceByImage</p></li><li><p>#aws_serverless</p><p>Amazon Rekognition API: DetectLables</p><p>DetectLabels</p><p>{"Confidence": 94.62968444824219,"Name": "adventure"</p><p>},{</p><p>"Confidence": 94.62968444824219,"Name": "boat"</p><p>},{</p><p>"Confidence": 94.62968444824219,"Name": "rafting"</p><p>},. . .</p></li><li><p>#aws_serverless</p><p>Flower</p><p>ChairCoffeeTable</p><p>LivingRoom</p><p>Indoors</p></li><li><p>#aws_serverless</p><p>Maple</p><p>Villa</p><p>Plant</p><p>Garden</p><p>Water</p><p>SwimmingPool</p><p>Tree</p><p>PottedPlant</p><p>Backyard</p></li><li><p>#aws_serverless</p><p>Amazon Rekognition API: DetectFaces </p><p> [</p><p>{"BoundingBox": {"Height": 0.3449999988079071,"Left": 0.09666666388511658,"Top": 0.27166667580604553,"Width": 0.23000000417232513</p><p>},"Confidence": 100,"Emotions": [</p><p>{"Confidence": 99.1335220336914,"Type": "HAPPY" },</p><p>{"Confidence": 3.3275485038757324,"Type": "CALM"},</p><p>{"Confidence": 0.31517744064331055,"Type": "SAD"}</p><p>],"Eyeglasses": {"Confidence": 99.8050537109375,</p><p>"Value": false},"EyesOpen": {Confidence": 99.99979400634766,</p><p>"Value": true},"Gender": {"Confidence": 100,</p><p>"Value": "Female}</p><p>DetectFaces</p></li><li><p>#aws_serverless</p><p>DemographicData</p><p>FacialLandmarks</p><p>SentimentExpressed</p><p>ImageQuality GeneralAttributes</p></li><li><p>#aws_serverless</p><p>DemographicData</p><p>FacialLandmarks</p><p>SentimentExpressed</p><p>ImageQuality</p><p>Brightness:25.84</p><p>Sharpness:160GeneralAttributes</p></li><li><p>#aws_serverless</p><p>Amazon Rekognition API: CompareFaces</p><p>CompareFaces</p><p>{"FaceMatches": [</p><p>{"Face": {"BoundingBox": {"Height": 0.2683333456516266,"Left": 0.5099999904632568,"Top": 0.1783333271741867,"Width": 0.17888888716697693},</p><p>"Confidence": 99.99845123291016},"Similarity": 96</p><p>},{"Face": {"BoundingBox": {</p><p>"Height": 0.2383333295583725,"Left": 0.6233333349227905,"Top": 0.3016666769981384,"Width": 0.15888889133930206},</p><p>"Confidence": 99.71249389648438},"Similarity": 0</p><p>}],"SourceImageFace": {"BoundingBox": {</p><p>"Height": 0.23983436822891235,"Left": 0.28333333134651184,"Top": 0.351423978805542,"Width": 0.1599999964237213},</p><p>"Confidence": 99.99344635009766}}</p></li><li><p>#aws_serverless</p></li><li><p>#aws_serverless</p><p>Amazon Rekognition API: IndexFaces/SearchFacesByImage</p><p>f7a3a278-2a59-5102-a549-a12ab1a8cae8&amp;v1</p><p>02e56305-1579-5b39-ba57-9afb0fd8782d&amp; v2</p><p>FaceID&amp;vectorFace</p><p>4c55926e-69b3-5c80-8c9b-78ea01d30690&amp; v3</p><p>tran</p><p>sformed</p><p>stored</p><p>{f7a3a278-2a59-5102-a549-a12ab1a8cae8,02e56305-1579-5b39-ba57-9afb0fd8782d,4c55926e-69b3-5c80-8c9b-78ea01d30690}</p><p>IndexFaceCollection</p></li><li><p>#aws_serverless</p><p>Amazon Rekognition API: IndexFaces/SearchFacesByImage</p><p>Face</p><p>{f7a3a278-2a59-5102-a549-a12ab1a8cae8,02e56305-1579-5b39-ba57-9afb0fd8782d,4c55926e-69b3-5c80-8c9b-78ea01d30690}</p><p>SearchFacebyImage CollectionNearestneighborsearch</p><p>FaceID</p></li><li><p>#aws_serverless</p></li><li><p>#aws_serverless</p><p> /</p></li><li><p>#aws_serverless</p><p>Benefit</p><p> AWS </p></li><li><p>#aws_serverless</p><p>Pricing5000 images per month for first 12 months </p><p>ImageAnalysisTiers Priceper1000 imagesprocessed</p><p>First1millionimagesprocessed*permonth $1.00</p><p>Next9millionimagesprocessed*permonth $0.80</p><p>Next90millionimagesprocessed*permonth $0.60</p><p>Over100millionimagesprocessed*permonth $0.40</p><p>*Imagesprocessed:ForAPIswithimageasinput,itsthenumberofimagesanalyzed.ForAPIswithnoimageinput1APIcall=1imageprocessed.</p></li><li><p>#aws_serverless</p><p>Amazon Polly</p></li><li><p>#aws_serverless</p><p>Amazon Polly</p></li><li><p>#aws_serverless</p><p>Amazon Polly Text to Speech as a Service</p><p> 2447</p></li><li><p>#aws_serverless</p><p>Amazon Polly: Americas:</p><p> Brazilian Portuguese</p><p> CanadianFrench</p><p> English(US)</p><p> Spanish(US)</p><p>A-PAC:</p><p> Australian English</p><p> IndianEnglish</p><p> Japanese</p><p>EMEA:</p><p> BritishEnglish</p><p> Danish</p><p> Dutch</p><p> French</p><p> German</p><p> Icelandic</p><p> Italian</p><p> Norwegian</p><p> Polish</p><p> Portuguese</p><p> Romanian</p><p> Russian</p><p> Spanish</p><p> Swedish</p><p> Turkish</p><p> Welsh</p><p> WelshEnglish</p></li><li><p>#aws_serverless</p><p>Amazon Polly: SSMLSpeech Synthesis Markup Language</p><p> W3CXML</p><p>My name is Kuklinski. It is spelled </p><p>Kuklinski</p></li><li><p>#aws_serverless</p><p>Amazon Polly: Lexicons</p><p> My daughters name is Kaja.</p><p>KajakajaKAJA"kaI.@</p></li><li><p>#aws_serverless</p><p>TEXT</p><p>Marketgrewby&gt;20%.WORDSPHONEMES</p><p>{ { { { {twn.tip.sntm.kt gu ba</p><p>mon</p><p>PROSODYCONTOURUNITSELECTIONANDADAPTATION</p><p>TEXTPROCESSING</p><p>PROSODYMODIFICATIONSTREAMING</p><p>Market grew by morethan</p><p>twentypercent</p><p>Speechunitsinventory</p></li><li><p>#aws_serverless</p><p>Pythonfrom boto3 import Session</p><p>from contextlib import closing</p><p>polly = Session().client("polly")</p><p>response = polly.synthesize_speech(</p><p>Text="Hello world!", </p><p>OutputFormat="mp3", VoiceId="Joanna")</p><p>with closing(response["AudioStream"]) as stream:</p><p>with open("speech.mp3", "wb") as file:</p><p>file.write(stream.read())</p></li><li><p>#aws_serverless</p><p>Pricing</p><p> 100$4</p><p>500</p></li><li><p>#aws_serverless</p><p>Amazon Lex</p></li><li><p>#aws_serverless</p><p>Amazon Lex</p></li><li><p>#aws_serverless</p><p>1st Gen:PunchCards&amp;MemoryRegisters</p><p>2nd Gen:Pointers&amp;Sliders</p><p>3nd Gen:ConversationalInterfaces</p></li><li><p>#aws_serverless</p><p>On-Demand</p><p>Accessible</p><p>Efficient</p><p>Natural</p></li><li><p>#aws_serverless</p><p>Amazon Lex</p></li><li><p>#aws_serverless</p><p>Amazon Lex - Alexa</p><p>SaaS</p></li><li><p>#aws_serverless</p><p>Alexa</p></li><li><p>#aws_serverless</p><p>AmazonLex</p><p>FacebookMessenger</p><p>CardDescriptionButton1Button2Button3</p><p>CardDescription</p><p>Option1</p><p>Option2</p><p>Authentication</p><p>RichFormattingOne-ClickDeployment</p><p>Mobile</p></li><li><p>#aws_serverless</p><p>Efficientandintuitivetoolstobuildconversations</p></li><li><p>#aws_serverless</p><p>AliasVersioning</p><p>v1 v2 v3 latest</p><p>v1 Dev</p><p>v2 Stage</p><p>v3 Prod</p></li><li><p>#aws_serverless</p><p>AWS Mobile Hub</p><p>More.</p><p>LexAWS Mobile SDKs</p><p>AWS Mobile Hub</p></li><li><p>#aws_serverless</p><p>Mobile Hub</p><p>AmazonLex</p><p>MobileApp</p><p>MobileHubSaaSConnector</p><p>AmazonAPIGateway</p><p>AWSLambda</p><p>1:Understanduserintent</p><p>AmazonAPIGateway</p><p>AWSLambda</p><p>3:TranslateRESTresponseintonaturallanguage</p><p>MobileHubCustomConnector</p><p>2:InvokeaSaaSapplicationoranexistingbusinessapplication</p><p>BusinessApplication</p><p>Firewall</p><p>UserInput</p></li><li><p>#aws_serverless</p><p>Amazon Lex Use CasesInformationalBots</p><p>ApplicationBots</p><p> .</p><p> .</p><p>EnterpriseProductivityBots</p><p> .</p><p>InternetofThings(IoT)Bots</p><p> .</p></li><li><p>#aws_serverless</p><p>Amazon Lex - </p><p>AWS</p></li><li><p>#aws_serverless</p><p>Lex Bot</p><p>Utterances</p><p>BookHotelIntents</p><p>Slots</p><p>Fulfillment</p></li><li><p>#aws_serverless</p><p>Fulfillment</p><p>AWSLambdaIntegration ReturntoClient</p><p>AWS</p><p>Lambda</p></li><li><p>#aws_serverless</p><p>Book a HotelBook Hotel</p><p>NYC</p><p>BookaHotelinNYC</p><p>Hotel Booking</p><p>New York City</p><p> Intent/Slot</p><p>UtterancesHotelBooking</p><p>City NewYorkCity</p><p>Check In Nov30th</p><p>CheckOut Dec2nd</p><p>YourhotelisbookedforNov30th</p><p>Polly:Yourhotelisbookedfor</p><p>Nov30th</p><p>ain</p><p>CanIgoaheadwiththebooking?</p></li><li><p>#aws_serverless</p><p>Save, Build and Publish</p><p>Save Build</p><p>Publish</p><p>Test</p></li><li><p>#aws_serverless</p><p>Monitoring</p><p>Trackyourbot</p><p>RequestLatency</p><p>MissedUtteranceCount</p></li><li><p>#aws_serverless</p><p>Pricing</p><p>Text Speech</p><p>Priceper1000requests $0.75 $4.00</p><p>FreeTier*(requestspermonth) 10,000 5,000</p><p>*Availableforthefirstyearuponsign-uptonewAmazonLexcustomers</p></li><li><p>#aws_serverless</p></li></ul>