DevOps: The Future is Already Here — It’s Just Unevenly Distributed

  • Published on
    16-Jul-2015

  • View
    1.292

  • Download
    4

Embed Size (px)

Transcript

  • DevOps: The Future is Already Here Its Just Unevenly Distributed

    Damon Edwards @damonedwards

  • @damonedwards

    Damon Edwards

  • DevOps Consulting

    Automation Design

    Support & Services

  • devopscafe.org

    dev2ops.org

  • The history of DevOps is important

  • A B

  • A B

    OpsDev

  • Agile Infrastructure

  • Agile Infrastructure

  • Agile Infrastructure

  • Agile Infrastructure

  • June 23, 2009

  • "10+ Deploys Per Day: Dev and Ops Cooperation at Flickr

    June 23, 2009

  • "10+ Deploys Per Day: Dev and Ops Cooperation at Flickr

    June 23, 2009

  • "10+ Deploys Per Day: Dev and Ops Cooperation at Flickr

    June 23, 2009

  • "10+ Deploys Per Day: Dev and Ops Cooperation at Flickr

    June 23, 2009

  • October 30 - 31, 2009: Ghent, Belgium

  • DevOctober 30 - 31, 2009: Ghent, Belgium

  • DevOctober 30 - 31, 2009: Ghent, Belgium

    Ops

  • DevOctober 30 - 31, 2009: Ghent, Belgium

    OpsDays

  • DevOctober 30 - 31, 2009: Ghent, Belgium

    OpsDays

    *and many more!

  • DevOctober 30 - 31, 2009: Ghent, Belgium

    # OpsDays

    *and many more!

  • DevOps DaysGhent 2009

  • DevOps DaysGhent 2009Sydney 2010

  • DevOps DaysGhent 2009Sydney 2010

    Mountain View 2010

  • DevOps DaysGhent 2009Sydney 2010

    Mountain View 2010

    +49 more as of Jan 2015

    devopsdays.org

  • The Rise of a New IT Operations Support Model

    By 2015, DevOps will evolve from a niche strategy employed by large cloud providers into a mainstream strategy employed

    by 20% of Global 2000 organizations

    Why DevOps will emerge:

    !DevOps is not usually driven from

    Why DevOps will not emerge:

    !Cultural changes are the hardest to

    by 20% of Global 2000 organizations.

    !DevOps is not usually driven from the top down and, thus, may be more easily accepted by IT operations teams.

    !Cultural changes are the hardest to implement, and DevOps requires a significant rethinking of IT operations conventional wisdom.

    !ITIL and other best practices frameworks are acknowledged to have not delivered on their goals, enabling IT organizations to look for

    !There is a large body of work with respect to ITIL and other best practices frameworks that is already accepted within the industry enabling IT organizations to look for

    new models.

    !The growing interest in tools such as Chef, Puppet, etc., will help

    accepted within the industry.

    !Open source (OSS) management tools, which are more aligned with this approach, have not seen pp p

    stimulate demand for OSS-based management

    ppsignificant enterprise market share traction.

    March 18, 2011

  • The Rise of a New IT Operations Support Model

    By 2015, DevOps will evolve from a niche strategy employed by large cloud providers into a mainstream strategy employed

    by 20% of Global 2000 organizations

    Why DevOps will emerge:

    !DevOps is not usually driven from

    Why DevOps will not emerge:

    !Cultural changes are the hardest to

    by 20% of Global 2000 organizations.

    !DevOps is not usually driven from the top down and, thus, may be more easily accepted by IT operations teams.

    !Cultural changes are the hardest to implement, and DevOps requires a significant rethinking of IT operations conventional wisdom.

    !ITIL and other best practices frameworks are acknowledged to have not delivered on their goals, enabling IT organizations to look for

    !There is a large body of work with respect to ITIL and other best practices frameworks that is already accepted within the industry enabling IT organizations to look for

    new models.

    !The growing interest in tools such as Chef, Puppet, etc., will help

    accepted within the industry.

    !Open source (OSS) management tools, which are more aligned with this approach, have not seen pp p

    stimulate demand for OSS-based management

    ppsignificant enterprise market share traction.

    March 18, 2011

  • Next October 19-21, 2015 in San Franciscodevopsenterprise.io

  • 2014 State of DevOps Survey

    9,200+ Respondents from 110 countries, across all industries

  • 2014 State of DevOps Survey

    9,200+ Respondents from 110 countries, across all industries

  • Why is the history important?

  • Why is the history important?It reminds us that DevOps is...

  • Why is the history important?

    from practitioners, by practitioners

    It reminds us that DevOps is...

  • Why is the history important?

    from practitioners, by practitioners not a thing (product, methodology, specification, job title)

    It reminds us that DevOps is...

  • Why is the history important?

    from practitioners, by practitioners not a thing (product, methodology, specification, job title) an experience-based movement

    It reminds us that DevOps is...

  • Why is the history important?

    from practitioners, by practitioners not a thing (product, methodology, specification, job title) an experience-based movement decentralized and open to all

    It reminds us that DevOps is...

  • Why is the history important?

    from practitioners, by practitioners not a thing (product, methodology, specification, job title) an experience-based movement decentralized and open to all

    It reminds us that DevOps is...

    Biggest source of tensions in community is not understanding this!

  • What have we learned?

  • DevWa

    ll of

    Con

    fusio

    n

    Ops

  • At first we forgot the context!

  • OpsDev

    We are in business to give the customer... What they want When they want it At the lowest cost possible

  • OpsDev

    DevOps Problems!

  • Ah-ha!

    OpsDev Remove

    Shorten

    Lead Time

    Feedback

  • Ah-ha!

    OpsDev Remove

    Shorten

    Lead Time

    Feedback

  • My organization is stuck! and I dont know why

    Business pressuring to route around me

    I have no real visibility Org has low confidence in ability to deliver

    Usual coping mechanisms arent working

    Dont bring me more tools!

    My job is painful!.. and I know why

    Im always waiting for someone or being undermined by someone else

    If you just let me do it myself We should automate everything first

    Using new tools like company x will fix our problems!

    Executives Teams

    I think DevOps can help me I think DevOps can help me

  • My organization is stuck! and I dont know why

    Business pressuring to route around me

    I have no real visibility Org has low confidence in ability to deliver

    Usual coping mechanisms arent working

    Dont bring me more tools!

    My job is painful!.. and I know why

    Im always waiting for someone or being undermined by someone else

    If you just let me do it myself We should automate everything first

    Using new tools like company x will fix our problems!

    Executives Teams

    I think DevOps can help me I think DevOps can help me

  • My organization is stuck! and I dont know why

    Business pressuring to route around me

    I have no real visibility Org has low confidence in ability to deliver

    Usual coping mechanisms arent working

    Dont bring me more tools!

    My job is painful!.. and I know why

    Im always waiting for someone or being undermined by someone else

    If you just let me do it myself We should automate everything first

    Using new tools like company x will fix our problems!

    Executives Teams

    I think DevOps can help me I think DevOps can help me

  • My organization is stuck! and I dont know why

    Business pressuring to route around me

    I have no real visibility Org has low confidence in ability to deliver

    Usual coping mechanisms arent working

    Dont bring me more tools!

    My job is painful!.. and I know why

    Im always waiting for someone or being undermined by someone else

    If you just let me do it myself We should automate everything first

    Using new tools like company x will fix our problems!

    Executives Teams

    I think DevOps can help me I think DevOps can help meOrganizational Analysis

    Process Redesign

    Management Coaching

  • My organization is stuck! and I dont know why

    Business pressuring to route around me

    I have no real visibility Org has low confidence in ability to deliver

    Usual coping mechanisms arent working

    Dont bring me more tools!

    My job is painful!.. and I know why

    Im always waiting for someone or being undermined by someone else

    If you just let me do it myself We should automate everything first

    Using new tools like company x will fix our problems!

    Executives Teams

    I think DevOps can help me I think DevOps can help meOrganizational Analysis

    Process Redesign

    Management Coaching

    Software Tools

    Design Patterns and Methodologies

    Training

  • My organization is stuck! and I dont know why

    Business pressuring to route around me

    I have no real visibility Org has low confidence in ability to deliver

    Usual coping mechanisms arent working

    Dont bring me more tools!

    My job is painful!.. and I know why

    Im always waiting for someone or being undermined by someone else

    If you just let me do it myself We should automate everything first

    Using new tools like company x will fix our problems!

    Executives Teams

    I think DevOps can help me I think DevOps can help meOrganizational Analysis

    Process Redesign

    Management Coaching

    Software Tools

    Design Patterns and Methodologies

    Training

  • My organization is stuck! and I dont know why

    Business pressuring to route around me

    I have no real visibility Org has low confidence in ability to deliver

    Usual coping mechanisms arent working

    Dont bring me more tools!

    My job is painful!.. and I know why

    Im always waiting for someone or being undermined by someone else

    If you just let me do it myself We should automate everything first

    Using new tools like company x will fix our problems!

    Executives Teams

    I think DevOps can help me I think DevOps can help meOrganizational Analysis

    Process Redesign

    Management Coaching

    Software Tools

    Design Patterns and Methodologies

    Training

  • Execs

    Teams

    "I want to transform my organization"

    "I want to transform how I work"

    DevOps?

  • Organizational Transformation

    Execs

    "I want to transform my organization"

  • Predictability Short Time-to-Market High Quality Operations

  • My silo works just fine

    Its out of my control

    Not the way weve always

    done it

    That just wont work

    here

    Too busy running the business

    What is important?

    Didnt work last time, why

    now?

    Where do I start?

  • Improved Time to Market & Quality

    Quicker Feedbackfrom Users

    BusinessIdea

    RunningServices

    Dev Ops

    DevOps and Agile Ops

    Security

    Auditing

    Compliance

    Availability

    Ops is in a particularly tough spot

  • Success: an organization that learns to fix itself

    Focus is on: Seeing end-to-end Fast feedback

    Eliminating waiting, rework Catching problems early

    Predictability Short Time-to-Market High Quality Operations

  • If you stand back far enough

  • Silos are the #1 enemy of throughput and quality

    Dev Release Ops Business

  • Silos are the #1 enemy of throughput and quality

    Dev Release Ops Business

  • Silos are the #1 enemy of throughput and quality

    Dev Release Ops Business

    Handoff!

    Handoff!

    Handoff!

  • Silos are the #1 enemy of throughput and quality

    Dev Release Ops Business

    Application Knowledge

    Handoff!

    Handoff!

    Handoff!

  • Silos are the #1 enemy of throughput and quality

    Dev Release Ops Business

    Application Knowledge

    Operational Knowledge

    Handoff!

    Handoff!

    Handoff!

  • Silos are the #1 enemy of throughput and quality

    Dev Release Ops Business

    Application Knowledge

    Operational Knowledge

    Business Intent

    Handoff!

    Handoff!

    Handoff!

  • Silos are the #1 enemy of throughput and quality

    Dev Release Ops Business

    Application Knowledge

    Operational Knowledge

    Business Intent

    Handoff!

    Handoff!

    Handoff!

    Ownership but limited Accountability

  • Silos are the #1 enemy of throughput and quality

    Dev Release Ops Business

    Application Knowledge

    Operational Knowledge

    Business Intent

    Handoff!

    Handoff!

    Handoff!

    Ownership but limited Accountability

    Accountability but no Ownership

  • Organizational alignment is the key to overcoming silos

  • Organizational alignment is the key to overcoming silos

    1000s of small decisions made daily How do we harness that?

  • Organizational alignment is the key to overcoming silos

    1000s of small decisions made daily How do we harness that?

    Top down is brittle Conditions, people, tools are always

    changing... how do we handle that?

  • Organizational alignment is the key to overcoming silos

    1000s of small decisions made daily How do we harness that?

    Top down is brittle Conditions, people, tools are always

    changing... how do we handle that? Alignment:

    When you know that different individuals would independently see a set of conditions and arrive at the same decision that is directionally correct to achieve the companys goals

  • Organizational alignment is the key to overcoming silos

    1000s of small decisions made daily How do we harness that?

    Top down is brittle Conditions, people, tools are always

    changing... how do we handle that? Alignment:

    When you know that different individuals would independently see a set of conditions and arrive at the same decision that is directionally correct to achieve the companys goals

    Startups have it; Enterprises lose it

  • Value Stream Mapping

  • Value Stream Mapping

    Process1

  • Value Stream Mapping

    Process1

    ?PD

    TS

    W

    EP M

    MM

    TS

    PDM

    W

    DWastes2

  • Value Stream Mapping

    Process1

    ?PD

    TS

    W

    EP M

    MM

    TS

    PDM

    W

    DWastes2

    ?PD

    TS

    W

    EP M

    MM

    TS

    PDM

    W

    DOps

    involved early

    Unify ticket/req

    tools

    Write service tests in

    devAutomate

    from spec

    SystemVerification

    Tests Move into Dev

    Self-Service

    ACLsVerify from definition of done

    Counter-measures

    3

  • Core business service delivery process Current state value stream map

    DevelopmentEnvironments

    ReleaseBuild and deploy

    QAEnvironments

    PerformanceEnvironment

    StagingEnvironment

    ProductionEnvironment

    Deploy to Performance

    Web Assets, flows and

    wireframes

    Delta features and

    fixesSet of service

    branches

    Documented test plans and cases

    Request QA build

    Daily Scrum meeting

    Daily Scrum meeting

    Deployment Meeting Business Systems

    Support

    Stan Walters

    Change Control

    Project Manager

    Erica Switzer

    Change request

    Business Analyst

    Erica Switzer

    Steering Committee

    Erica Switzer

    Full Projects / Expedites

    Estimates and

    requirements

    Technical Specification

    Deployment Document

    Change Control Forms

    RT tickets

    Jira issues

    Jira issues

    Tested packages

    Development

    Joe Harbaugh

    L/T 8 weeksP/TH/CS/R

    4 weeks525%

    DevelopmentBuild and deploy

    Joe Harbaugh

    L/T 2 daysP/TH/CS/R

    4 hours110%

    Development Integration testing

    Joe Harbaugh

    L/T 1 dayP/TH/CS/R

    1 day595%

    Performance testing

    Deploy toProduction

    Build test plan

    Raj Lee

    L/T 5 daysP/TH/CS/R

    4 days110%

    Build test cases

    Raj Lee

    L/T 2 weeksP/TH/CS/R

    8 days220%

    Fernando Gomez

    L/T 8 hoursP/TH/CS/R

    7 hours12%

    Acceptance testing

    Raj Lee

    L/T 5 daysP/TH/CS/R

    5 hours210%

    Feature testing

    Raj Lee

    L/T 4 weeksP/TH/CS/R

    2.5 weeks420%

    Allen Cannata

    L/T 1 weekP/TH/CS/R

    3 days166%

    RT tickets

    Deploy to Staging

    Frances Middleton

    L/T 6 daysP/TH/CS/R

    90 minutes366%

    Staging testing

    Frances Middleton

    L/T 1 weekP/TH/CS/R

    3.5 days466%

    Allen Cannata

    L/T 9 hoursP/TH/CS/R

    8 hours666%

    Frances Middleton

    L/T 6 daysP/TH/CS/R

    90 minutes366%

    D Dx2W

    DPD

    TSx5 Dx2 Wx2 PDx4

    EPD PDx3 Mx8

    DWx2

    PDx2

    What should we be looking for? Long lead times (vs processing time) Request and approval queues Large batch sizes Human to human information transfer Scrap / Rework / Backwash Process or tooling inconsistency Manual deployment / configuration Reliance on manual testing / verification Injecting requirements late in the process Fixing in place (vs rebuilding) Snowf...

Recommended

View more >