Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 1 of 52 Page ID #:186
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 1 of 52 Page ID #:186
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`EXHIBIT F
`
`EXHIBIT F
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 2 of 52 Page ID #:187
`Case 81203100529 ”0°“mem 1'6 FlIIIIlllIIIIIIIIIII||||l’|I|I1‘I||lFl|I1|flIIllllllfllliIIIIIHIII‘IIIIIIII
`
`US008572138B2
`
`(12) Unlted States Patent
`(10) Patent No.:
`US 8,572,138 B2
`
`Sundar et al.
`(45) Date of Patent:
`Oct. 29, 2013
`
`(54) DISTRIBUTED COMPUTING SYSTEM
`HAVING AUTONOMIC DEPLOYMENT 0F
`
`VIRTUAL MACHINE DISK IMAGES
`
`(75)
`
`Inventors Jagane Sundar, SaratOga, CA (US);
`Sanjay Radia, Fremont, CA (US);
`David A. Henseler, Maplewood, MN
`(US)
`
`.
`.
`(73) Ass1gnee: CA, Inc., Island1a, NY (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 1339 days.
`
`(21) Appl. NO': 11/694’483
`.
`.
`Ffled‘
`
`Ma“ 30’ 2007
`
`(22)
`
`7,246,351 B2 *
`2002/0129129 A1 *
`2002/0156877 A1
`2003/0074360 A1 *
`2003/0078958 A1 *
`2003/0110173 A1*
`2003/0126265 A1
`
`................... 717/175
`................... 709/220
`
`7/2007 Bloch et a1.
`9/2002 Bloch et al.
`10/2002 Lu et al.
`4/2003 Chen et al.
`.................... 707/100
`4/2003 Pace et al.
`709/201
`
`6/2003 Marsland ........................ 707/10
`7/2003 Aziz et al.
`(Continued)
`
`WO
`W0
`
`FOREIGN PATENT DOCUMENTS
`WO/03/085526 A1
`10/2003
`WO/2006/081503 A1
`8/2006
`(Continued)
`OTHER PUBLICATIONS
`
`E.N. Herness et al., “WebSphere Application Server: A Foundation
`for on Demand Computing,” IBM Systems Journal IBM, vol. 43, No.
`2, pp. 213—237, XP-002383791, 2004.
`
`(65)
`
`Prior Publication Data
`
`(Continued)
`
`US 2007/0233698 A1
`
`Oct. 4, 2007
`
`Related US. Application Data
`(60) Provisional application No. 60/787,280, filed on Mar.
`30, 2006.
`
`(51)
`
`(2006.01)
`(2006.01)
`
`Int. Cl.
`G06F 12/00
`G06F 1 7/30
`(52) US. Cl.
`USPC ................................ 707/828; 707/831; 718/1
`(58) Field of Classification Search
`None
`See application file for complete search history.
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`6,256,637 B1 *
`6,513,059 B1 *
`6,775,829 B1
`6,865,737 B1
`7,093,239 B1 *
`
`7/2001 Venkatesh et al.
`.................... 1/1
`
`1/2003 Gupta et al.
`.................. 709/202
`8/2004 Kroening
`3/2005 Lucas et al.
`8/2006 van der Made ............... 717/135
`
`Primary Examiner 7 Angelica Ruiz
`(74) Attorney, Agent, or Firm 7 Baker Botts, L.L.P.
`
`ABSTRACT
`(57)
`One or more control nodes provide for the efiicient and auto-
`mated allocation and management of computing functions
`and resources within the distributed computing system. The
`distributed computing system includes a software image
`repository storing: (i) one or more image instances of a virtual
`machine manager that is executable on the application nodes,
`wherein When executed on the applications nodes, the image
`instances ofthe virtual machine manager provide one or more
`virtual machines, and (ii) one or more image instances of one
`or more software applications that are executable on the vir-
`tual machines. The distributed computing system also
`includes a control node that comprises an automation infra-
`structure to provide autonomic deployment of the image
`instances of the virtual machine manager on the application
`nodes and to provide autonomic deployment of the image
`instances of the software applications on the virtual
`machines.
`
`26 Claims, 29 Drawing Sheets
`
`11
`
`/—10
`__________________
`
`1
`DIscovEREDPooL 11F
`DISCOVERED
`
`
`
`
`CONTROL MODE
`g
`
`'I11
`
`,,,,,,,,,,,,,,,,,
`
`FREE POOL
`
`
`UNALLocATED
`NoDEs
`
`
`I5
`1 ALLOCATED TIERS :
`
`1' """" E""""
`
`__________________n" 17
`
`APPLICATION
`I
`MAINTENANCE 1:001.
`MODES
`
`
`
`FAILED MODES
`
`
`
`
`5
`1
`
`
`
`
`
`1:
`
`11
`’T
`1
`111
`
`111111111111
`
`
`
`20
`ADMINISTRATOR
`
`ORGANIZATIONAL
`DATA
`21
`
`IMAGE
`REPosIToRV
`2E
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 3 of 52 Page ID #:188
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 3 of 52 Page ID #:188
`
`US 8,572,138 B2
`
`Page 2
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`2003/0135509 A1 *
`2003/0135658 A1 *
`2003/0140282 A1
`
`7/2003 Davis et a1.
`7/2003 Haggar et a1.
`7/2003 Kaler et a1.
`
`................... 707/100
`................ 709/312
`
`2003/0192035 A1* 10/2003 Duesterwald ald ........... 717/138
`
`FOREIGN PATENT DOCUMENTS
`WO/2006/083727 A1
`8/2006
`WO/2006/083893 A1
`8/2006
`WO/2006/083894 A1
`8/2006
`W0/2006/083895 A1
`800%
`W0/2006/083901 A1
`800%
`
`WO
`WO
`W0
`W0
`W0
`
`~~~~~~~~~~~~~~~~~ 717/114
`
`5/2004 H0
`2004/0088694 A1
`8/2004 Flaxer et 3L
`2004/0162741 A1
`9/2004 Coleman et 31~
`2004/0181794 A1
`9/2004 Sardesai et a1.
`2004/0187104 A1
`2004/0230948 A1 * “/2004 Talwar et 31~
`2004/0260734 A1
`12/2004 R611 6t 31.
`2005/0005200 A1
`1/2005 Matena et a1.
`.................. 718/1
`2005/0039180 A1 *
`2/2005 Fultheim et a1.
`2005/0138370 A1*
`6/2005 Goud et a1.
`................... 713/164
`200 5/0 193265 A1
`9/200 5 Lin et 31.
`2006/0173856 A1
`8/2006 Jackson et a1.
`2006/0173857 A1
`8/2006 Jackson
`2006/0173895 A1
`8/2006 En
`uist et a1.
`-
`gq
`8/2006 Eme1s et a1.
`8/2006 Henseler et 31'
`8/2006 Eme1s et 3L
`8/2006 Henseler et 31~
`11/2006 Solomon et a1.
`7/2007 Henseler et a1.
`
`2006/0173984 A1
`2006/0173993 A1
`2006/0173994 A1
`2006/0174238 A1
`2006/0259292 A1 *
`2007/0168919 A1*
`
`................ 703/27
`.............. 717/101
`
`B. Urgaonkar et a1., “Resource Overbooking and Application Profil-
`ing in Shared Hosting Platforms,” Proceedings ofthe 5” Symposium
`on Operating Systems Design and Implementation,
`17 pgs.,
`XP-002387427, 2002.
`G. Lodi et a1., “QoS-aware Clustering of Application Servers,” Pro-
`ceedings of the 15’ IEEE Workshop on Quality of Service for Appli-
`cation Servers, In Conjunction With the 23rd International Sympo-
`sium on Reliable Distributed Systems, 6 pages, XP-002383792, Oct.
`17, 2004
`Preinstalling Microsoft Windows )9 by Using the OEMPreinsta/la—
`lion Kit, Part 1, XP-002301441, Apr. 4, 2003, 24 pages.
`R. Mark Koan et a1., It Takes a Village to Build an Image,
`”002384269, 2003’ PP' 200'207'
`PP
`a
`a
`P yrn
`US. A 1. No. 11/607 819 ent1tled “Automated De lo
`ent and
`Configuration of Applications in an Autonomically Controlled Dis-
`tributed Computing System”, filed Dec. 1, 2006.
`U.S. Appl. No. 11/607,820 entitled, “Automated Deployment and
`Configuration of Applications in an Autonomically Controlled Dis-
`tributed Computing System”, filed Dec. 1, 2006.
`
`2007/0169049 A1 *
`
`7/2007 Gingell et a1.
`
`................ 717/151
`
`* Cited by examiner
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 4 of 52 Page ID #:189
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 4 Of 52 Page ID #:189
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 1 of 29
`
`US 8,572,138 B2
`
`/—10
`
`
`
`
`UNALLOCATED
`_
`NODES
`
`DISCOVERED
`NODES
`
`r _________________ F 13
`FREE POOL
`
`
`
`, _________________ f 17
`MAINTENANCE POOL I
`
`I
`|
`fl APPLICATION '-
`I
`I
`
`I
`I
`E
`I
`I
`I
`
`
`
`NODES
`
`N ETWORK
`
`FAILED NODES
`
`:
`:
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I___________________.
`
`CONTROL NODE
`12
`
`ADMINISTRATOR
`
`
`
`fl
`
`
`ORGANIZATIONAL
`IMAGE
`
`REPOSITORY
`DATA
`
`
`
`E
`
`FIG. 1
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 5 of 52 Page ID #:190
`H
`
`bS
`
`\\\\D0//////\\\\\\
`
`Ot<3//\\/(\2a//[\\
`9\\\VV»\///\\‘//2\\/I/A%\\\w//A/\M"F/0wm\VAoEmEAAAIIIIIIIIIIIIIIIVA.59.Acemommssoom.
`
`AAAA,AAm_m_m"_\AA
`
`
`/Y\\Oc////
`.1_Lmml:AAAA2%.“?mmAz_<_AA_0oAAA50”.“.Am9,
`6A/AAA\\|/,AAAA,
`Amoz<zEAAAAAAammohwwmmav/</\//
`
`dMyCV”H/HM—W\//<\\
`\xwém/yMAalumAAAAAAA1mm:AAmm:AAE:Awm\VAAA,mm:AAA/meAAAAAnE<AAAAmm;AAAA
`mMAA\/A\\|oon/,AAAAAAxwwm/A
`
`
`wP
`
`AAA5.7/CuFN
`
`m1,e2mm,
`
`O2
`
`
`
`\\)//2S\AA\\\\Ila”///A//\AAAA%//\AA\a//\\Aa//\AAAA%//\\Aa//\\a//\AAAa,//5UA\/A
`
`,mAA56A5.6AA5.5AA5.6AAA5%AA5.6AA5.5AA5.6A5/m_o02AAAAA
`
`
`
`
`
`m,_n_02AAAAAAMQOZAAAAAAAAmooZAAA%/\\/\/\AAAAAm.n_02AAAAAAAA,m_o02AAAAAAA/mooZAAAAAAmaoZAAA
`8\)/)>/\\)/,\\|//,\\)/\\)//
`
`
`
`
`
`mB.#%N0.".
`
`
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 6 of 52 Page ID #:191
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 6 of 52 Page ID #:191
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 3 of 29
`
`US 8,572,138 B2
`
`50
`
`52
`
`54
`
`56
`
`RECEIVE INPUT DEFINING
`HIERARCHY OF DISTRIBUTED
`COMPUTING SYSTEM
`
`RECEIVE INPUT IDENTIFYING
`
`NODE REQUIREMENTS OF TIERS
`
`TIERS
`
`SELECT NODES FROM FREE
`
`POOL OR LOWER PRIORITY TIER
`
`DYNAMICALLY ASSIGN NODES TO
`NODE SLOTS OF THE DEFINED
`
`FIG. 3
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 7 of 52 Page ID #:192
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 7 of 52 Page ID #:192
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 4 of 29
`
`US 8,572,138 B2
`
`SELECT A TIER TO ENABLE
`
`RETRIEVE TIER REQU IREM ENTS
`
`COMPARE CAPABILITIES OF A
`NODE TO TIER REQUIREMENTS
`
`NODE MEETS
`INIMUM REQ’TS"
`
`REMOVE NODE FROM LIST OF
`CANDIDATES
`
`NODE IS IMMEDIATELY ASSIGNED
`TO THE TIER
`
`FOR TIER MET?
`
`CALCULATE AND RECORD THE
`ENERGY OF THE NODE
`
`NODE COUNT
`FOR TIER MET?
`
`MORE NODES IN
`THE FREE POOL?
`
`IDENTIFY AND ASSIGN NODE
`WITH THE MINIMUM POSITIVE
`ENERGY TO THE TIER
`
`NODE COUNT
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 8 of 52 Page ID #:193
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 8 of 52 Page ID #:193
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 5 of 29
`
`US 8,572,138 B2
`
`IDENTIFY NEED FOR MORE NODE
`CAPACITY ON TIER
`
`94
`
`NODES IN THE
`
`FREE POOL? SELECT NODE
`
`IDENTIFY TIERS WITH A LOWER
`PRIORITY
`
`DETERMINE WHICH NODES OF
`THE LOWER PRIORITY TIERS
`MEET REQUIREMENTS
`
`CALCULATE ENERGY OF NODES
`THAT MEET REQUIREMENTS
`
`SELECT NODE WITH THE LOWEST
`ENERGY
`
`ASSIGN THE SELECTED NODE TO
`THE TIER IN NEED OF CAPACITY
`
`FIG. 5
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 9 of 52 Page ID #:194
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 9 of 52 Page ID #:194
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 6 of 29
`
`US 8,572,138 B2
`
`IDENTIFY EXCESS NODE
`
`CAPACITY ON TIER
`
`CALCULATE ENERGY OF ALL THE
`
`NODES IN THE TIER
`
`110
`
`112
`
`114
`
`116
`
`FREE POOL
`
`SELECT NODE WITH THE HIGHEST
`
`ENERGY (FURTHEST MATCH
`FROM TIER’S IDEAL NODE)
`
`RETURN SELECTED NODE TO THE
`
`FIG. 6
`
`

`

`aP
`f0O1e
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 10 of 52 Page ID #:195
`925
`._H
`am
`/
`g
`
`I19wna5P82S5U
`
`%2.1_B
`
`wncmma8Pe0sSa.CU
`
`
`
` 1Bt0n2m9,u1maDO
`
`30fl73t0wdhbS
`
`0M2f
`
`w3N9“.
`
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 11 of 52 Page ID #:196196
`Case 8
`ZO-cv-00529 Document 1-6 F
`led 03/13/20 Page 11 of 52 Page ID #
`
`U.S. Patent
`
`Oct. 29, 2013
`
`Sheet 8 of 29
`
`US 8,572,138 B2
`
`o9.
`
`
`
`‘5‘
`
`,wtiuh
`
`
`
`u3§§§§3\kkkkkV~tt§§§§§§tt\=§§§§.\§:=
`
`
`a?»“avwhmnfim388$
`
`gwfiw
`
`
`
`cc«.gun»
`
`
`e5.\
`
`w.0.”—
`
`.n25
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 12 of 52 Page ID #:197197
`Case 8
`ZO-cv-00529 Document 1-6 F
`led 03/13/20 Page 12 of 52 Page ID #
`
`U.S. Patent
`
`Oct. 29, 2013
`
`Sheet 9 of 29
`
`US 8,572,138 B2
`
`c3.
`
`
`
`\\\\\\\A\A\A\A\A\\\\\\\\\\\\\\\A\A\A\A\A\\\\\\\\\\\\\\\A\A\A\A\\\\\\\\\\\\\\\\\\A\A
`
`\\.
`
`
`
`
`
`Chara;x‘5
`
`“a..31»3qu
`
`a“,N
`WSW»..
`
`
`
`v.36»"35.5NF«Pu,....uEn;:r..
`
`“3:
`
`£35mNfl
`
`

`

`aP
`f031e
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 13 of 52 Page ID #:198
`925
`._H6
`o
`g
`
`mtwncmwa8PeoSSa.CU
`
`
`
` 1Bt0n2m9,u2.maDO
`
`mS
`
`mOfm0nm3t
`
`%2.1_B#83m1,Wu2aMP82S5U
`
`
`
`§§§§§
`
`
`
`9—..0."—
`
`MEan
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 14 of 52 Page ID #:199199
`Case 8
`ZO-cv-00529 Document 1-6 F
`led 03/13/20 Page 14 of 52 Page ID #
`
`U.S. Patent
`
`Oct. 29, 2013
`
`Sheet 11 0f 29
`
`US 8,572,138 B2
`
`\\
`
`mcuzmu., 1
`
`
`
`4:955.__.
`
`,w.5runavgm\rttt:ht.53th:.tzittrtttttx
`
`
`
`
`
`
`
`.2_..:QENHE..
`
`
`
`\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\.\\\\\\\\\\\\\\\\\\
`
`V~
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 15 of 52 Page ID #:200200
`Case 8
`ZO-cv-00529 Document 1-6 F
`led 03/13/20 Page 15 of 52 Page ID #
`
`U.S. Patent
`
`Oct. 29, 2013
`
`Sheet 12 0f 29
`
`US 8,572,138 B2
`
`a:
`
` NF.0."—
`
`“$5
`
`m
`
`1.3rum::2_.4...:33fififi
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 16 of 52 Page ID #:201201
`Case 8
`ZO-cv-00529 Document 1-6 F
`led 03/13/20 Page 16 of 52 Page ID #
`
`U.S. Patent
`
`Oct. 29, 2013
`
`Sheet 13 of 29
`
`US 8,572,138 B2
`
`our
`
`\\\\\\\\\\\\\\\\\\\
`
`\
`
`
`
`efibfiu‘t.393v\\\\\\\\\\\\\\\\\\\\\\\\\\x
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 17 of 52 Page ID #:202202
`Case 8
`ZO-cv-00529 Document 1-6 F
`led 03/13/20 Page 17 of 52 Page ID #
`
`U.S. Patent
`
`Oct. 29, 2013
`
`Sheet 14 0f 29
`
`US 8,572,138 B2
`
`\\\\\\\\\\\\\\\\\A\\\,
`
`
`
`
`\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\§§x§
`
`
`
`
`
`“23am?‘‘.,:iE363
`
`\\\x
`
`3‘.6.”—
`
`

`

`e
`aD.
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 18 of 52 Page ID #:203
`2
`,m
`0
`m5O
`g
`
`cU
`
`8.P
`
`cm
`
`a
`
`Ot
`
`maDO
`
`umm2,
`
`9S
`
`mm.mmu3t
`
`a5P8,
`
`mm#.8mm
`
`
`
`
`
`
`
`:Zumsz_._.o<U_m_m_<n_<._.<n_wD._.<._.w
`
`
`
`mnm:.9".
`
`
`
`010.\\//
`
`
`
`
`
`
`
`
`
`
`zO_._.<_>_m_Ou_z_oz_m_0._._zO_>_._<_._._z_
`
`
`
`
`
`
`
`
`mMmthDOmm29.54.
`wm§
`
`
`
`6DMHUMn—Xm._<_._._z_._m_>m_._mo_>m_m_w
`
`wnmoOzJOmFZOU
`
`
`

`

`Otwn
`
`&PNON%S.aoCU
`
`
`MW2593392.202205.
`
`aP
`,m91e
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 19 of 52 Page ID #:204
`2
`4
`
`w%.HSN20.2.2282.
`
`Mm.mmm
`
`
`
`wwm.2053.604.2053.50
`
`ea:NmzoF<oEF02mMU.Cd.
`
`63.29.205...<E2.
`
`
`1..3«mm1mmm262m.3.29.205.
`
`OOaDI
`
`
`3.29.205.%>52...9».
`cumm2m5>mmwmofimmfiz.2.62.:
`
`gIIIIIIIIIIII
`
`I1m2,
`aMP8,SaU
`
`2mB
`
`
`
`#.D%m:0—"—
`
`
`

`

`a
`2e
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 20 of 52 Page ID #:205
`2
`2
`,m
`g
`
`wP.3NsSaocU
`
`0«a:N
`
`923933
`
`
`
`M15”.Em:$00.5
`
`
`Pll0m'-23%EvamMflmzazmmmzmhw:mU$660..m5”.2mm:
`
`620.2092..IE:
`
`$995wm.HwmwflEmma.HM15905.zo_5<mbm_
`
`58.”:mM,SN259.8%m2.mob‘mmzmwamowzmwmwFzm>mmz_ozm_mmzmpw:
`
`1..B55.mz_ozm_mmzmpm:
`
`t0IHamNmm:
`
`
`I0.mN:v$58.18wmmanhoamhmémz20.25.93._m_>m_._mo_>mm_m
`
`
`%mokomnimEmpw>wmnww_m>._<z<
`
`
`mm#.8
`
`mB,t.0.".
`
`e2wM
`
`
`
`
`
`
`
`mzo_k<o_n_:02&mmbfiwP8,whwmzomE20.54..2554.
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 21 of 52 Page ID #:206
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 21 Of 52 Page ID #:206
`
`U.S. Patent
`
`Oct. 29, 2013
`
`Sheet 18 0f 29
`
`US 8,572,138 B2
`
`WORKING MEMORY
`
`r270
`
`EXPECTED STATE (READ ONLY)
`
`272
`
`MAX NODES: 5
`
`/
`
`<f
`\
`
`
`
`
`
`
`
`BLT
`
`ACTUAL STATE (READ/WRITE)
`
`274
`
`/
`5 MINUTE LOAD AVERAGE: 2.4. <
`\
`
`
`
`
`
`
`
`SENSOR/
`RULE
`ENGINES
`
`LOCAL OBJECT (READ/WRITE)
`
`276
`
`
`
`
`
`
`
`<
`
`/
`
`\
`
`SENSOR/
`RULE
`ENGINES
`
`FIG. 18
`
`

`

`8.Pe0mS.8NCU
`
`
`
`
`
`2amm:060..wmmzaam
`
`e
`a
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 22 of 52 Page ID #:207
`2
`,m
`
`0twm0.t
`
`mmm9,wm.
`0c
`
`DOI
`
`
`
`
`
`
`I9».mmmofimmfiz.:8556.80%“...zoEzEmomo_>~_m_mmm;whzmjo%mo_>mm_mmm;
`
`tmw
`
`d%wowam
`
`1..BEm:oEmE
`HmomaF55%mo_>mm_m
`
`6292592.22iwwwfiwi29259232smwmmmwsw
`
`
`
`fQ0m01,
`
`mgaa
`
`
`
`
`Pmmw<z<2wxmfimofimmfiz.$323”.9wwa02zo:.o<
`
`2A
`
`
`5Umob/«$25Eofim
`
`2M<55xmfimommEonmE
`
`mBW2,
`
`mm
`
`2.#.82.0—"—
`
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 23 of 52 Page ID #:208
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 23 of 52 Page ID #:208
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 20 of 29
`
`US 8,572,138 B2
`
`RULE ENGINE
`
`RULE COMPILER
`
`m
`
`EXECUTION ENGINE
`
`m
`
`fl
`
`WORKING MEMORY
`
`fl
`
`LOCAL
`OBJECTS
`
`FIG. 20
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 24 of 52 Page ID #:209
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 24 of 52 Page ID #:209
`
`U.S. Patent
`
`S
`
`2759
`
`2B
`
`NF
`
`JOKFZOU
`
`2,020.56.m0.mm<”.
` w20fi0<”ZO_._.<U_|_n_n_<I1M«mm
`
`Iamomfl0mm:mmzhonEmEuz.
`
`00IIS8m.an«8U55$...«00309:.5.39320\
`
`
`1m02mm>00am8mzo.h<o.._n.n.<.........mz.0zm3.5”.mzo.p<o...n.n.<
`
`
`
`mo.>mmmzo.k<0...n.n.< a3mm:5:Ew<Ez.20.2.2056.m..m.>m...
`
`00.B,_.N0—".
` m_n_OZ
`0.00..082.me20.2.2054...m.>m...35me
`
`
`
`
`
`
`20.F<o.._n.n.<zo.h<m:0.u.zoo025.920....n«k<55
`
`
`
`
`
`035m
`
`

`

`
`
` 1Bt0n2m9,u2.ma.DO
`
`mOfm0nn3aommS
`
`m.22B#83m1,ma2aMP82S5U
`
`aP
`f052e
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 25 of 52 Page ID #:210
`925
`H6
`g
`
`mtwncmma8PeoSSa.CU
`
`..mSnags—um:
`
`52.226
`
`:mem><mvmo.___
`
`0923959583
`wgwmzcwmucwn.
`
`”2:35am
`
`.8239?
`
`.bmficmoEn.
`
`n:o_.o.mm.axw
`
`”2:33am
`
`..¢m$w><vmo._=
`EchvwwEkmSomxmr
`
`”52.06298
`
`-Eon
`
`nwEw:
`
`Nhn
`
`En
`
`won
`
`man
`
`._.Zm__>_>0._n_m_n_
`
`w._.z_<m._.szU
`
`mo_>m_m_w
`
`w|_m_>m_n_
`
`m0_>m_mw
`
`moOz
`
`wMHDmEHHd.
`
`wm3._<>
`
`DUN—0.5205.
`Dump—.205.
`
`..T:nu_o;me._.me
`
`n:o_wmm.axw
`
`:_\:HU—°F—m@-_Sn—-:_E
`
`:wummzcommcficwnr
`
`..mSnags—92..
`
`:wuwmzcommcficwnr
`
`:O©:H—U°_u—¢Q
`
`:ON:HU_OSW0LSI_IXNE
`
`.bSnags—99:.
`
`:m__nu_o:mo._;._.:_E
`
`:Om:HU°_u—¢Q
`
`meEoEwéconn...
`
`”52.06298
`
`:Om:HU°_u—¢Q
`-UmeHwSowxm
`
`nmEm:
`
`zoov.1
`
`”2:33am
`
`“550058.
`
`icoEwEowE:
`__o.m__n_u_o;mo._;._.:_E
`
`”233:5
`
`:O
`
`”2.30022
`
`.om:nu_o:mw._:._.me
`IUmeLqusowxm
`
`..._V:Hu_°£mwu=v—I_IXNE
`_Eo._.vm9;._.9:omxm_
`
`:_\I:HU—OF—W0-_SI—-:_E
`
`15:00
`
`.bSHUOIoQ
`
`.bSnags—99:.
`
`”mew:
`
`ommgo><mum3
`
`ZO_._.<U_._n_n_< 8m
`
`-ooEEoSon.
`
`qum:
`
`boEoE
`
`3__\..u£8_
`
`5:83
`
`“n:
`
`1865203
`
`
`
`Noméw.ENC
`
`nmEmz
`
`qum:
`
`Hw__v_._0>>..HwEN—._
`
`romeo.ENC
`
`
`
`LGwDkmvtog
`
`qumz
`
`.bothE
`olhmimwummmcwe
`
`un:
`
`:mezégwoo
`
`-_wB__\..n£mQ
`
`_<..H¢ENC
`
`imdezcgmmU
`
`
`
`3:5“;an.mmwm.
`
`Em~w>w..nwEm:
`
`18.8.6
`
`won
`
`New
`
`wm_0_>m_m_w
`ZO_._.<0_:_n_n_<
`
`mun—Oz
`
`
`
`Loméo.54K7,
`
`un__:_Eum
`
`EmEoomfio
`
`qumz
`
`”ten—EEUN
`
`:OOF—\:
`
`
`
`=EEU<36>?
`
`n._¢_._.:_Eum
`
`nwEmzhwquu
`
`19.35589.
`
`|§_\..u£mo_in<w_>_m_o..uwemc
`
`FILoEwwummmcmE
`Emoqztmuwuouooaxo
`
`OS;
`
`,_fim.xo<|m_>_mo
`
`:QQ<..HwEm:
`
`Pnfimn
`
`\muofloalhmm:
`
`\mEmEov
`
`133%
`
`.EMonm
`
`mm.0."—
`
`omvigwoumo.
`
`NHWflUOZXN—C
`
`erwuozp‘Eh
`
`c_mEon_-_mton_
`
`nwEm:
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 26 of 52 Page ID #:211
`Case 8:20-Cv-00529 Document 1-6 Filed 03/13/20 Page 26 of 52 Page ID #:211
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 23 of 29
`
`US 8,572,138 B2
`
`STAGE APPLICATION WITHIN STAGING
`
`ENVIRONMENT AND GENERATE
`
`380
`
`APPLICATION DEFINITION
`
`382
`
`384
`
`386
`
`388
`
`39o
`
`392
`
`394
`
`DEFINE APPLICATION CONFIGURATION
`
`PROPERTIES
`
`GENERATE APPLICATION ENTRY USING
`
`APP. DEFINITION AND APP.
`
`CONFIGURATION PROPERTIES
`
`MODIFY APPLICATION ENTRY
`
`INSERT APPLICATION ENTRY INTO
`APPLICATION MATRIX
`
`APPLICATION MATRIX ALERTS
`
`CONFIGURATION PROCESSOR
`
`
`
`CONFIGURATION PROCESSOR UPDATES
`
`APPLICATION RULE ENGINE AND
`
`MONITORING SUBSYSTEM
`
`CONTROL NODE HAS AUTONOMIC
`
`CONTROL OVER APPLICATION
`
`FIG. 23
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 27 of 52 Page ID #:212
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 27 of 52 Page ID #:212
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 24 of 29
`
`US 8,572,138 B2
`
`,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,d9§fl (4033
`
`(403“
`
`OSIAPP.
`
`M
`
`OSIAPP.
`
`4063
`
`OS/APP.
`
`406N
`
`VIRTUALMACHINE
`404A
`
`VIRTUALMACHINE
`404B
`
`VIRTUALMACHINE
`404N
`
`
`
`
`
`
`
`
`
`
`VIRTUAL MACHINE MANAGER
`
`M
`
`PHYSICAL NODE
`
`M
`
`
`
`FIG. 24
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 28 of 52 Page ID #:213
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 28 of 52 Page ID #:213
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 25 of 29
`
`US 8,572,138 B2
`
`410
`
`412
`
`414
`
`416
`
`418
`
`SET ASIDE A NODE AS AN
`
`IMAGE HOST
`
`INSTALL VIRTUAL MACHINE
`
`MANAGER ON HOST
`
`MACHINE MANAGER
`
`CONFIGURE VIRTUAL MACHINE
`
`MANAGER WITH DESIRED
`
`NUMBER OF VM INSTANCES
`
`PERFORM NETWORK OR SAN
`
`CONFIGURATION FOR NODE
`
`CAPTURE NODE WITH THE
`
`CONTROL NODE, SPECIFY IP
`
`ADDRESS, AND SPECIFY
`CAPTURE OF A VIRTUAL
`
`FIG. 25
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 29 of 52 Page ID #:214
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 29 of 52 Page ID #:214
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 26 of 29
`
`US 8,572,138 B2
`
`420
`
`422
`
`424
`
`426
`
`428
`
`430
`
`432
`
`SET ASIDE A NODE THAT IS
`
`RUNNING VIRTUAL MACHINE
`
`MANAGER
`
`CREATE A VIRTUAL MACHINE
`
`ON THE NODE
`
`INSTALL AN OPERATING
`
`SYSTEM ON THE VIRTUAL
`
`MACHINE
`
`INSTALL APPLICATIONS ON
`
`THE OPERATING SYSTEM
`
`PERFORM ANY NEEDED
`
`CONFIGURATION TO OS OR
`
`APPLICATONS
`
`
`
`SNAPSHOT THE VIRTUAL DISK
`
`OF THE VIRTUAL MACHINE
`
`CAPTURE THE VIRTUAL DISK
`
`TO THE CONTROL NODE
`
`FIG. 26
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 30 of 52 Page ID #:215
`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 30 of 52 Page ID #:215
`
`US. Patent
`
`Oct. 29, 2013
`
`Sheet 27 of 29
`
`US 8,572,138 B2
`
`CREATE NEW TIER
`
`SPECIFY CAPTU RED VIRTUAL
`MACHINE MANAGER IMAGE
`FOR NEW TIER
`
`
`
`ACTIVATE TIER
`
`440
`
`442
`
`444
`
`CREATE NEW TIER
`
`SPECIFY CAPTURED OS/
`APPLICATION IMAGE FOR NEW
`TIER
`
`SET TARGETS FOR TIER
`
`ACTIVATE TIER
`
`446
`
`448
`
`450
`
`452
`
`FIG. 27A
`
`FIG. 27B
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 31 of 52 Page ID #:216
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 32 of 52 Page ID #:217
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 33 of 52 Page ID #:218
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 34 of 52 Page ID #:219
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 35 of 52 Page ID #:220
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 36 of 52 Page ID #:221
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 37 of 52 Page ID #:222
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 38 of 52 Page ID #:223
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 39 of 52 Page ID #:224
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 40 of 52 Page ID #:225
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 41 of 52 Page ID #:226
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 42 of 52 Page ID #:227
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 43 of 52 Page ID #:228
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 44 of 52 Page ID #:229
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 45 of 52 Page ID #:230
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 46 of 52 Page ID #:231
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 47 of 52 Page ID #:232
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 48 of 52 Page ID #:233
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 49 of 52 Page ID #:234
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 50 of 52 Page ID #:235
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 51 of 52 Page ID #:236
`
`

`

`Case 8:20-cv-00529 Document 1-6 Filed 03/13/20 Page 52 of 52 Page ID #:237
`
`