Introducing Amazon Rekognition, Amazon Polly and Amazon Lex

  • View
    1.669

  • Download
    5

Embed Size (px)

Transcript

  • #aws_serverless

    Introducing Amazon Rekognition, Amazon Polly and

    Amazon LexKeisuke Nishitani (@Keisuke69)

    Amazon Web Services Japan K.K.Dec 07, 2016

  • #aws_serverless

    ProfileKeisuke NishitaniSpecialist Solutions Architect, Amazon Web Service Japan K.K

    @Keisuke69 Keisuke69

    Specialist SA- Serverless- Mobile- DevOps- Application Service

    REST : http://keisuke69.hatenablog.jp/

    Keisuke69 Keisuke69Keisuke69x

  • #aws_serverless

    Amazon Rekognition

  • #aws_serverless

    Amazon Rekognition

  • #aws_serverless

    Amazon Rekognition

    DetectLabels DetectFaces CompareFaces IndexFaces

    SearchFaceByImage

  • #aws_serverless

    Amazon Rekognition API: DetectLables

    DetectLabels

    {"Confidence": 94.62968444824219,"Name": "adventure"

    },{

    "Confidence": 94.62968444824219,"Name": "boat"

    },{

    "Confidence": 94.62968444824219,"Name": "rafting"

    },. . .

  • #aws_serverless

    Flower

    ChairCoffeeTable

    LivingRoom

    Indoors

  • #aws_serverless

    Maple

    Villa

    Plant

    Garden

    Water

    SwimmingPool

    Tree

    PottedPlant

    Backyard

  • #aws_serverless

    Amazon Rekognition API: DetectFaces

    [

    {"BoundingBox": {"Height": 0.3449999988079071,"Left": 0.09666666388511658,"Top": 0.27166667580604553,"Width": 0.23000000417232513

    },"Confidence": 100,"Emotions": [

    {"Confidence": 99.1335220336914,"Type": "HAPPY" },

    {"Confidence": 3.3275485038757324,"Type": "CALM"},

    {"Confidence": 0.31517744064331055,"Type": "SAD"}

    ],"Eyeglasses": {"Confidence": 99.8050537109375,

    "Value": false},"EyesOpen": {Confidence": 99.99979400634766,

    "Value": true},"Gender": {"Confidence": 100,

    "Value": "Female}

    DetectFaces

  • #aws_serverless

    DemographicData

    FacialLandmarks

    SentimentExpressed

    ImageQuality GeneralAttributes

  • #aws_serverless

    DemographicData

    FacialLandmarks

    SentimentExpressed

    ImageQuality

    Brightness:25.84

    Sharpness:160GeneralAttributes

  • #aws_serverless

    Amazon Rekognition API: CompareFaces

    CompareFaces

    {"FaceMatches": [

    {"Face": {"BoundingBox": {"Height": 0.2683333456516266,"Left": 0.5099999904632568,"Top": 0.1783333271741867,"Width": 0.17888888716697693},

    "Confidence": 99.99845123291016},"Similarity": 96

    },{"Face": {"BoundingBox": {

    "Height": 0.2383333295583725,"Left": 0.6233333349227905,"Top": 0.3016666769981384,"Width": 0.15888889133930206},

    "Confidence": 99.71249389648438},"Similarity": 0

    }],"SourceImageFace": {"BoundingBox": {

    "Height": 0.23983436822891235,"Left": 0.28333333134651184,"Top": 0.351423978805542,"Width": 0.1599999964237213},

    "Confidence": 99.99344635009766}}

  • #aws_serverless

  • #aws_serverless

    Amazon Rekognition API: IndexFaces/SearchFacesByImage

    f7a3a278-2a59-5102-a549-a12ab1a8cae8&v1

    02e56305-1579-5b39-ba57-9afb0fd8782d& v2

    FaceID&vectorFace

    4c55926e-69b3-5c80-8c9b-78ea01d30690& v3

    tran

    sformed

    stored

    {f7a3a278-2a59-5102-a549-a12ab1a8cae8,02e56305-1579-5b39-ba57-9afb0fd8782d,4c55926e-69b3-5c80-8c9b-78ea01d30690}

    IndexFaceCollection

  • #aws_serverless

    Amazon Rekognition API: IndexFaces/SearchFacesByImage

    Face

    {f7a3a278-2a59-5102-a549-a12ab1a8cae8,02e56305-1579-5b39-ba57-9afb0fd8782d,4c55926e-69b3-5c80-8c9b-78ea01d30690}

    SearchFacebyImage CollectionNearestneighborsearch

    FaceID

  • #aws_serverless

  • #aws_serverless

    /

  • #aws_serverless

    Benefit

    AWS

  • #aws_serverless

    Pricing5000 images per month for first 12 months

    ImageAnalysisTiers Priceper1000 imagesprocessed

    First1millionimagesprocessed*permonth $1.00

    Next9millionimagesprocessed*permonth $0.80

    Next90millionimagesprocessed*permonth $0.60

    Over100millionimagesprocessed*permonth $0.40

    *Imagesprocessed:ForAPIswithimageasinput,itsthenumberofimagesanalyzed.ForAPIswithnoimageinput1APIcall=1imageprocessed.

  • #aws_serverless

    Amazon Polly

  • #aws_serverless

    Amazon Polly

  • #aws_serverless

    Amazon Polly Text to Speech as a Service

    2447

  • #aws_serverless

    Amazon Polly: Americas:

    Brazilian Portuguese

    CanadianFrench

    English(US)

    Spanish(US)

    A-PAC:

    Australian English

    IndianEnglish

    Japanese

    EMEA:

    BritishEnglish

    Danish

    Dutch

    French

    German

    Icelandic

    Italian

    Norwegian

    Polish

    Portuguese

    Romanian

    Russian

    Spanish

    Swedish

    Turkish

    Welsh

    WelshEnglish

  • #aws_serverless

    Amazon Polly: SSMLSpeech Synthesis Markup Language

    W3CXML

    My name is Kuklinski. It is spelled

    Kuklinski

  • #aws_serverless

    Amazon Polly: Lexicons

    My daughters name is Kaja.

    KajakajaKAJA"kaI.@

  • #aws_serverless

    TEXT

    Marketgrewby>20%.WORDSPHONEMES

    { { { { {twn.tip.sntm.kt gu ba

    mon

    PROSODYCONTOURUNITSELECTIONANDADAPTATION

    TEXTPROCESSING

    PROSODYMODIFICATIONSTREAMING

    Market grew by morethan

    twentypercent

    Speechunitsinventory

  • #aws_serverless

    Pythonfrom boto3 import Session

    from contextlib import closing

    polly = Session().client("polly")

    response = polly.synthesize_speech(

    Text="Hello world!",

    OutputFormat="mp3", VoiceId="Joanna")

    with closing(response["AudioStream"]) as stream:

    with open("speech.mp3", "wb") as file:

    file.write(stream.read())

  • #aws_serverless

    Pricing

    100$4

    500

  • #aws_serverless

    Amazon Lex

  • #aws_serverless

    Amazon Lex

  • #aws_serverless

    1st Gen:PunchCards&MemoryRegisters

    2nd Gen:Pointers&Sliders

    3nd Gen:ConversationalInterfaces

  • #aws_serverless

    On-Demand

    Accessible

    Efficient

    Natural

  • #aws_serverless

    Amazon Lex

  • #aws_serverless

    Amazon Lex - Alexa

    SaaS

  • #aws_serverless

    Alexa

  • #aws_serverless

    AmazonLex

    FacebookMessenger

    CardDescriptionButton1Button2Button3

    CardDescription

    Option1

    Option2

    Authentication

    RichFormattingOne-ClickDeployment

    Mobile

  • #aws_serverless

    Efficientandintuitivetoolstobuildconversations

  • #aws_serverless

    AliasVersioning

    v1 v2 v3 latest

    v1 Dev

    v2 Stage

    v3 Prod

  • #aws_serverless

    AWS Mobile Hub

    More.

    LexAWS Mobile SDKs

    AWS Mobile Hub

  • #aws_serverless

    Mobile Hub

    AmazonLex

    MobileApp

    MobileHubSaaSConnector

    AmazonAPIGateway

    AWSLambda

    1:Understanduserintent

    AmazonAPIGateway

    AWSLambda

    3:TranslateRESTresponseintonaturallanguage

    MobileHubCustomConnector

    2:InvokeaSaaSapplicationoranexistingbusinessapplication

    BusinessApplication

    Firewall

    UserInput

  • #aws_serverless

    Amazon Lex Use CasesInformationalBots

    ApplicationBots

    .

    .

    EnterpriseProductivityBots

    .

    InternetofThings(IoT)Bots

    .

  • #aws_serverless

    Amazon Lex -

    AWS

  • #aws_serverless

    Lex Bot

    Utterances

    BookHotelIntents

    Slots

    Fulfillment

  • #aws_serverless

    Fulfillment

    AWSLambdaIntegration ReturntoClient

    AWS

    Lambda

  • #aws_serverless

    Book a HotelBook Hotel

    NYC

    BookaHotelinNYC

    Hotel Booking

    New York City

    Intent/Slot

    UtterancesHotelBooking

    City NewYorkCity

    Check In Nov30th

    CheckOut Dec2nd

    YourhotelisbookedforNov30th

    Polly:Yourhotelisbookedfor

    Nov30th

    ain

    CanIgoaheadwiththebooking?

  • #aws_serverless

    Save, Build and Publish

    Save Build

    Publish

    Test

  • #aws_serverless

    Monitoring

    Trackyourbot

    RequestLatency

    MissedUtteranceCount

  • #aws_serverless

    Pricing

    Text Speech

    Priceper1000requests $0.75 $4.00

    FreeTier*(requestspermonth) 10,000 5,000

    *Availableforthefirstyearuponsign-uptonewAmazonLexcustomers

  • #aws_serverless