`a2) Patent Application Publication co) Pub. No.: US 2004/0225952 Al
`Nov.11, 2004
`(43) Pub. Date:
`Brownetal.
`
`US 20040225952A1
`
`(54) ARCHITECTURE FOR DISTRIBUTED
`COMPUTING SYSTEM AND AUTOMATED
`DESIGN, DEPLOYMENT, AND
`MANAGEMENTOF DISTRIBUTED
`APPLICATIONS
`
`(75)
`
`Inventors: Mathilde C. Brown, Seattle, WA (US);
`Charlie D. Chase, Woodinville, WA
`(US); Kevin Grealish, Seattle, WA
`(US); Galen C. Hunt, Bellevue, WA
`(US); Aamer Hydrie, Seattle, WA
`(US); David Noble, Redmond, WA
`(US); Geoffrey Outhred, Seattle, WA
`(US); Glenn R. Peterson, Kenmore,
`WA(US); Bassam Tabbara,Seattle,
`WA(US); Alexander Torone,
`Sammamsih, WA (US); Robert V.
`Welland,Seattle, WA (US)
`
`Related U.S. Application Data
`
`(60) Provisional application No. 60/452,736, filed on Mar.
`6, 2003.
`
`Publication Classification
`
`(51)
`
`Int. Cl.’ see eeeceeeeeseenceeceeeeeseeeeeeeeeseenensesseeeeeeene HO4L 1/22
`
`(52)
`
`UWS. Che
`
`cicccccccccccccessecesesescsesesessseseeseeeseseeesenes 714/819
`
`(57)
`
`ABSTRACT
`
`Correspondence Address:
`LEE & HAYES PLLC
`421 W RIVERSIDE AVENUESUITE 500
`SPOKANE, WA 99201
`
`(73) Assignee: Microsoft Corporation
`
`(21) Appl. No.:
`
`10/789,440
`
`(22)
`
`Filed:
`
`Feb. 26, 2004
`
`.
`:
`:
`:
`A design tool includes a service definition model to enable
`abstract description of distributed computing systems and
`distributed applications. The design tool also includes a
`schema to dictate how functional operations within the
`service definition model are to be specified. The functional
`operations
`include design of distributed applications,
`deploymentof distributed applications, and managementof
`distributed applications.
`
`
`MyService
`
`<> MyFrontEnd |-<o---=—=<>>- MyBackEnd
`
`Application
`
`
`
`
`
`
`
`
`Host Oo
`
`Is
`
`
`
`
`[<a eeex SQL
`
`
`
`
`
`VDC
`
`Network
`
`
`
`Hardware
`
`Google Exhibit 1099
`Google v. VirtaMove
`
`Google Exhibit 1099
`Google v. VirtaMove
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 1 of 93
`
`US 2004/0225952 Al
`
`
`
`100x
`
`te2
`
`Zzouw
`
`LuOf<QO=wi
`
`O0oWw-Zz
`
`iPiill=ibSSSe
`
`
`
` it
`
`ENTITY B
`
`
`
`ea)CK
`
`=oceilaeeSs
`
`(HS:
`
`104
`
`DLo&6°
`data|MyBackEnd
`MyFrontEnd
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 2 of 93
`
`US 2004/0225952 Al
`
`
`
`Se eee <) MyBackEnd MyService MyFrontEnd
`
`
`
`<
`
`Is Gere< SQL
`
`Application
`
`Host
`
`
`
`
`
`
`
`Hardware
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 3 of 93
`
`US 2004/0225952 Al
`
`
`
`MyService
`
`MyFrontEnd
`
`
`
`
`
`
`
`|-<c==—-—-—<> MyBackEnd Application
`
`
`Network
`
`VDC
`
`
`
`Hardware
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 4 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`Auth="SSe”"
`
`Aarth="Windows”
`
`Application
`
`Host
`
`
`
`
`:
`. —
`Storage ‘
`
`~~
`
`ad
`
`j
`
`My
`
`aS aS) GRAS
`
`Voc
`
`Hardware
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 5 of 93
`
`US 2004/0225952 Al
`
`
`MyService
`
`
` MyFrontEnd
`MyBackEnd
`
`
`
`Application
`
`
`
`HStie
`|.
`
` Network —
`
`
`
`
`
`ia
`
`n
`
`Hardware
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 6 of 93
`
`US 2004/0225952 Al
`
`_Appileation
`
`Host
`
`Virtual Data Center
`
`MyFrontlnd
`
`
`
` WebService —
`
`
`
`
`
`
`GC
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 7 of 93
`
`US 2004/0225952 Al
`
`
` MyFrontEnd
`
`
` Application
` WebService
`
`WebService
`
`
`
`Host
`
`Virtual Data Center
`
` us
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 8 of 93
`
`US 2004/0225952 Al
`
`
`
`Settings
`Schema
`
`Deployment
`Manifest
`
`Port Implementation
`Reference
`
`
`
`
`
`
`
`
`
`Settings
`Values
`
`
`Port Types
`or
`Hosted TypeList
`
`
`
`Deployment
`Values
`
`Constraints Values
`
`Fy. 10
`
`
`
`US 2004/0225952 Al
`Patent Application Publication Nov. 11, 2004 Sheet 9 of 93
`
`
`
`MyService
`
`
`
` MyFrontEnd [<e e --— <> MyBackEnd
`
`
`
`Application
`
`
`
`<>
`
`HS)
`
`Deployment
`
`rrr << SQL
`
`
`
`
`
`| \ S
`
`VDC
`
`.
`
`?
`
`:
`
`Storage
`
`o LUNN
`
`
`
`Hardware
`
`Fig. Wt
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 10 of 93
`
`US 2004/0225952 Al
`
` MyService
`
` MyFrontEnd
`MyBackEnd
`Application
`
`
`
`
`
`Deployment
`
`
`
`VDC
`
`
`
`
`
`
`
`;
`Storage
`Network =
`
`
` eeIN x—aN
`
`E
`2
`
`
`
`Hardware
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 11 of 93
`
`US 2004/0225952 Al
`
`MyService
`
`
`
`Application
`
`
`
`Deployment
`
`Error
`
`Network h
`
`
`
`VDC
`
`Hardware
`
`Fig. (5
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 12 of 93
`
`US 2004/0225952 Al
`
`Application
`
`
`
`MyFrontEnd
`
`Web Service
`
`a
`
`Deployment
`
`Virtual Data Center
`
`
`
`
`
`
`Windows
`App
`
`
`
`
`Windows Server
`
`
`
`
`ty. (4
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 13 of 93
`
`US 2004/0225952 Al
`
`Application
`
`
`
` MyFrontEnd
`
`WebService
`
`acc cm
`ns
`
`|
`— ee eeEE EE EE -——
`
`WebService|Web App
`
`Deployment
`
`Virtual Data Center
`
`Windows Application
`
`Windows
`App
`
`
`
`
`
`Windows Server
`
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 14 of 93
`
`US 2004/0225952 Al
`
`Ordar App Ul
`
`Coder Business Logie)
`
`|Aulhorlzation Service||Gourler Senice
`
`1
`\
`I
`I
`I
`I
`
`;
`\Providea Sala fniformeaiiogyy
`|
`I
`I
`1
`|
`1
`i
`1 Gantinm Authorization |
`I
`I
`
`Auihorze Sala
`
`I
`
`I
`Arrsnege'Dalivary
`
`Gontirm lDatinnany
`
`Garin
`
`I
`I
`
`|
`
`I
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 15 of 93
`
`US 2004/0225952 Al
`
`Retail Agplication
`
`BIS x
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 16 of 93
`
`US 2004/0225952 Al lntervat
`
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 17 of 93
`
`US 2004/0225952 Al
`
`Dige
`
`+ ales we gp
`
`payesBoqUTOZAHACHPue—PHIES~=I
`
`
`
`SSITIYSSEMEQIRSTLOUSHE
`
`
`
`oaqulequaneNyLOPS
`
`
`
`(2200.02)pae.6asuyozApepurtC},LORNS
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`S261LEHIO1SWF
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 18 of 93
`
`US 2004/0225952 Al
`
`lgOE
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 19 of 93
`
`US 2004/0225952 Al
`
`My
`
`Services
`
`Database
`I
`
`Service Hosts
`
`OMZ/DZ Ly
`Firewall
`
`Network
`I-7~ cw ee a es et ee es ]
`Architecture
`1
`La ce tm, mm ms \
`
`|
`1
`_--,!
`rit |
`]
`
`I 4
`
`1|
`
`1
`i
`i
`
`|1
`
`ot
`it
`!
`|
`sane se on a J
`|
`aoe ee ae sens ce in cea Me nent i toe, mts ees mee oe d
`
`°
`2
`
`
`.
`Switch
`
`Hardware
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 20 of 93
`
`US 2004/0225952 Al
`
`
`NL.
`
`Visual Studi
`
`N\
`
`SDMNE
` Logical
`
`
`
`
`Instance
`Request
`
`
`
`Jaol
`
`Placement
`
`Physical
`Placement
`
` SDM Runtime
`
`
`
`
`SDM
`Runtime
`
`
`
`API
`
`
`
`
`
`
`
`SDM
`Instance Store
`
`Installer API
`
`SQL
`NS
`BizTalk
`Installer|Installer|Installer
`
`Fig. 23
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 21 of 93
`
`US 2004/0225952 Al
`
`
`
`Fig. 24
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 22 of 93
`
`US 2004/0225952 Al
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 23 of 93
`
`US 2004/0225952 Al
`
`Fig.26
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 24 of 93
`
`US 2004/0225952 Al
`
`—SDM
`
`Development and
`Deployment Tools
`
`ManagementTools
`
`Component Instances
`
`
`
`
`|SDM
`
`
`
`
` SDM Runtime
`
`Component
`Implementation
`Host
`
` Service
`Deployment
`Units
`
`
`
`SQLClient SQLServer|MyBackEnd be
`
`
`catalog
`
`
`Fig. 2S
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 25 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`
`©
`
`
`SqlServer[
`catalog
`
`
`
`O—-
`
`catalog
`
`
`
`
`
`MyService
`(SDML)
`
`=>
`
`J|compite
`
`Install
`
`
`
`
`
`
`
`(CLR DILL)
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 26 of 93
`
`US 2004/0225952 Al
`
`Tvpe Space
`
`Member
`
`Instance
`
`component T a
`
`
`
` componenttvne T
`
`
`Fig. Sl
`
`Fig. 52
`
`
`
`
`myService
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 27 of 93
`
`US 2004/0225952 Al
`
`Fig, 53
` myService[2]
`
` myService[1]
`
`|
`
`SomeCheapService
`
`SomeRichService
`
`Fig. 54
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 28 of 93
`
`US 2004/0225952 Al
`
`
`
` root[1] Component
`
`Instance
`
`
`“u[1].foo[2]’
`foo[t]
`foo[2]
`
`port { z[1} }
`port { z[1], z[2] }
`
`
`
`wire { w[1]}
`wire { w[1] }
`
`
`
`
`
`2. New
`
`Component
`Instance Created
`
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 29 of 93
`
`US 2004/0225952 Al
`
`Runtime 1
`
`
`
`
`
`root{1]
`
`Instance
`
`“u(1].foo[2]”
`
` Component
`
`
`
`
`foo[t]
`foo[2]
`port { z{1] }
`port { 2[1], 2[2] }
`
`
`
`wire { w[1]}
`wire { w[1] }
`
`
`
`
`
`
` 2. New PortInstance Created
`port { y[1] }
`
`
`
`e[2]
`
` Component
`
`
`Instance
`
`“u[1]foo[2]”
`S
`foo[t]
`foo[2]
`port { z[1} }
`port { z[1], z[2] }
`
`
`wire { w(t] }
`wire { w[1] }
`wire { p[1] }
`
`
`
`
`2. New Wire
`c[2]
`Instance Created
`
`
`port { y[1] }
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 30 of 93
`
`US 2004/0225952 Al
`
`Machine 1
`
`Runtime 1
`
`CompenentInstance
`u[1].foo[2].c[2]
`
`Machine2
`
`Component Instance
`uft].foo[2].cf2].b1 [1]
`
`Machines.
`
`ComponentInstance
`ul] .fo0[2].cf2].b2[1]
`
`
` port { z[1] }
`wire { w[1] } 3. Port x[1] is offline
`x{1] to offline
`
`3. Port x[1] is offline
`
`3. Port x[1] is offline
`
`root [1]
`
`foo[t]
`
`wire { w[1]}
`
`foo[2]
`port { z[1], z[2] }
`
`
`1. Set Port State
`2]
`port { y[1] }
`
`
`comp{ b1{1]. b2[1] }
`
`
`wire { p[1] = (b1[1] x[1], b2[1} x[1] )}
`
`F ° 14
`¢
`,
`
`2. Port state
`
`change recorded
`
`Machine t
`
`Component
`Instance 1
`Component
`Instance 2
`
`Machine 2
`
`SDM
`RTL
`
`Machine 3
`
`SDM Runtime 1
`
`Machine 4
`
`ComponentInstance 4
`
`Component|SDM [J SDM RTL
`Instance 3
`RTL
`
`SDM Runtime 2
`
`. [
`
`7G.
`
`
`
`wire { p }
`
`bar
`port { z}
`wire {w }
`
`Cc
`
`port { y}
`comp {b1, b2 }
`
`Patent Application Publication Nov. 11, 2004
`
`Sheet 31 of 93
`
`US 2004/0225952 Al
`
`Cc
`
`port {y}
`comp {b1, b2 }
`wire { p }
`
` bar[1]
`
`
`
`foo[1]
`foo[2]
`
`port { 2[1], z[2] }
`
`
`port { z[1] }
`port { 2[1], z[2] }
`
`
`wire { w[1] }
`wire { w[1]}
`wire { w[1]}
`
`
`
`
`
`
`
`
`
` c[1]
`
`
`c[1]
`c[2]
`c[1]
`
`port { y[1] }
`port { y[1] }
`port { y[1] }
`port { y[1] }
`
`
`
`
`
`comp { b1[1], b1[2]}
`comp { b1[1], b2[1] }
`comp { b1[1] }
`comp { b1[1] }
`
`
`
`
`
`wire { p[1] }
`wire { p[1]}
`wire { p[1]}}
`wire { p[1] }
`
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 32 of 93
`
`US 2004/0225952 Al
`
`Runtime1
`
`root[1]
`
`
`
`bar[1]
`foo[2]
`foo[1]
`
`port { z[1] }
`port { z[1], z[2]}
`port { z[1], z[2] }
`
`wire { w[1]} wire { w[t]}
`
`wire { w(t} }
`
`
`
`wire { p[1]}
`
`c(t]
`port { y[t] }
`comp {b1[1], b2[1}}
`wire { p[t]}
`
`port { y[1] }
`comp { b1[1] }
`wire { p[1]}
`
`port { y{1] }
`comp { b1[1] }
`
`c(t]
`port { yi] }
`comp { bi[1], b1[2]}
`wire { p[1]}
`
`Fig. 4S
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 33 of 93
`
`Deployment
`Tool UI or
`
`CLI
`
`Windows
`Service
`
`Runtime a)
`Libr
`| soap
`
`Identity US 2004/0225952 Al
`
`| SDM Runtime ;
`
`Role-based
`Z Authorization §
`
`Trusted
`Service
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 34 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`
`
`Runtime OM
`UI or other
`
`
`
`Client library
`client
`
`
`
`
` Runtime
`engine web
`service
`
`
`
`File share
`
`
`
`
`
`machines
`
`
`Deployment
`Target
`engine
`
`windows
`
`
`service
`
`Plug-ins
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 35 of 93
`
`US 2004/0225952 Al
`
`UI or other
`client
`
`library
`
`Runtime and
`
`Deployment
`
`
`
`
`
`
`
` Runtime OM
`
`
`
`engine
`
`
`
`
`
` ————___—}
`Binaries
`
`machines
`
`
`Fig. 47
`
`File share
`
`
`
`
`library Target
`
`
`
`
`
`————
`
`Runtime
`Database
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 36 of 93
`
`US 2004/0225952 Al
`
`OPERATIONS LOGIC
`
`COMPONENTS
`
`SERVICE DEFINITION MODEL & RUNTIME
`
`LOGICAL RESOURCE MANAGEMENT
`
`PHYSICAL RESOURCE MANAGEMENT
`
`NETWORK MANAGEMENT
`
`AUTOMATED DEPLOYMENT SERVICES
`
`PHYSICAL COMPUTING RESOURCES
`
`316
`
`314
`
`312
`
`310
`
`308
`
`306
`
`304
`
`302
`
`Fig. 45
`
`
`
`oupunyAS|
`
`
`
`joo,juawuAojdsqg
`
`dajuajvjvg
`
`
`IdVSOMOORL-LULAyjuawAo|deq
`|FlOs|Sit|ioiduoseq
`
`
`AIAIISJOSIV],4ojd1iosaq
`
`-
`
`Patent Application Publication Nov. 11,2004 Sheet 37 of 93
`
`US 2004/0225952 Al
`
`quesy"uoneoyddy
`
`bp6
`
`
`
`-31Q)19j0998)eQ-
`
`-31¢QJusUIdO[IA0q
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 38 of 93
`
`US 2004/0225952 Al
`
`App settings
`(shoppingcart)
`
`Host settings:
`
`
`
`
`
`~~O.
`“ir
`
`het
`ee
`
`®nD[Se
`
`aoe
`
`eee
`
`a)
`
`Fy. 50
`
`Initial Phase
`
`Synch datacenter &
`LIM
`
`App Development
`Phase
`
`Code/Test versus LIM
`
`Install Phase
`
`Running Phase
`
`Install Application
`
`Scale-out
`Topology-
`
`a
`
`St
`
`
`
`
`mo
`
`soa.2! taer7?
`PEWOoOtT
`RRA
`
`JEKSi:
`RES
`WH: PGE TGR22 WEP 12. I98.29.27
`SV, 9922.188.22.253
`
`Patent Application Publication Nov. 11, 2004 Sheet 39 of 93
`
`US 2004/0225952 Al
`
`;
`Microsoft-
`Systems Architecture
`Internet Data Center
`
`ROWE PRE VES2S.THD
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 40 of 93
`
`US 2004/0225952 Al
`
`
`
`
`Map Application &
`Enter deployment-
`
`settings
`
`
`
`
`
`
`
`Check settings/
`constraints against
`
`machine (s)
`
`
`
`
`
`
`
` Overwrite
`icts?
`No
`conflicts?
`
`
`Overwrite
`host-settings
`
`
`
` F5 or Test/debug
`
`Write application &
`deployment -time
`settings
`
`Fig. 5S
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 41 of 93
`
`US 2004/0225952 Al
`
`
`
`Deployment
`Descriptor?
`
` oad existing
`
`
`
` Copy/Load
`
`
`Application
`
`(all files)
`
`
`
`
`
`Descriptor
`
`
`
` Update
`Application SDM
`Runtime
`Registered
`
`
`Show: must
`migrate state
`out-of-band
`
`
`Map Application &
`Enter deployment-
`settings
`
` generate
`
`Deployment
`
`
`
`Preview
`
`deployment ?
`
`
`
`Handle
`Stateful data
`
`
`& Content
`
`
` Hig. 54
`
`Check constraints
`
`as user is mapping
`
`Remote query &
`show diff
`
`make
`
`deployment would
`
`
`
`Patent Application Publication Nov. 11
`
`’
`
`2004 Sheet 42 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`[LINSWSIT€[T]GamMAW
`
`
`
`
`
`[Z]NSWSTI€[Z]damMAW
`
`
`
`
`
`[T]NSWIOS€[Tt]aakn
`
`quewdoTdep>
`
`
`
`d4ojdisssagjuaudojdag
`
`ADJUIIDIVG JOO],
`WIT21970098}¢pNSIA:
`
`
`
`
`
`[tT]ddyazotL
`
`cf
`
`
`
`Juamacjuag=~81M.AayuaaEjeq-,7
`
`
`
`810yuawidojaaag-
`
`
`
`QddyzetizLdwopdwo
`
`semanddvzotete3duip
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 43 of 93
`
`US 2004/0225952 Al
`
`
`
`Load existing
`Deployment
`
`
`Select running
`
` SDM Application
`
`
`ee
`
`Show: must
`
`
`Checkconstraints
`
`Add/delete components,
`migrate state
`
`as useris mapping
`out-of-band
`ports, wires &
`
`
`Enter deployment-settings
`
`
`
`
`generate
`
`Descriptor
`
`
`Preview
`v
`
`deployment?
`
`
`
`
`
`Remote query &
`show diff
`
`deployment would
`make
`
`Descriptor?
`
`
` Yes
`
`Deployment
`
`
`
`
`
`Update
`Runtime
`
`
`Populate,
`Migrate
`
`state
`
`
`Fig. 56
`
`
`
`Patent Application Publication Nov. 11, 2004
`
`Sheet 44 of 93
`
`US 2004/0225952 Al
`
`
`oad existing
`Deployment
`Descriptor?
`
`
` Launch GUI/
`CLI
`
`
`
`Select running
`
` SDM Application
`
`
`
`
`Update
`Runtime
`
`
`
`
`
`Show: must
`
`
`Check constraints
`
`
`
`Edit ports & wires,
`:
`.
`migrate state
`
`
`
`
`as user is mapping
`out-of-band
`Add wires,
`
`
`Enter deployment-settings
`
`deployment ?
`
`
`
`
`
`generate
`
`
`Deployment
`
`Descriptor
`
`
`Preview
`
`
`No
`
`Remote query &
`show diff
`deployment would
`make
`
`Deploy
`
`
`
`ay. 57
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 45 of 93
`
`US 2004/0225952 Al
`
`Deployment
`Descriptor?
`
`
`Show: must
`
`out-of-band Select running
`migrate state
`SDM Application
`
`
` oad existing
`
`
`
`
`Update
`Runtime
`
`Application SDM
`Unregistered
`
`
`
`
`Lp
`
`
` —______|_---____}
`
`
`
`
`
`
`
`
`generate
`Deployment
`Descriptor
`
`
`
`
` Preview
`
`deployment?
`
`
`Remote query &
`show diff
`
`
`
`deployment would
`make
`
`
`
`Handle
`Stateful data
`& Content
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 46 of 93
`
`US 2004/0225952 Al
`
`Model-Based Management: Closer Look
`Model
`Reality
`
`
`
`
`Config Management System
`
`
`
`Modify
`Aggregate Model Ops Logic
`
`
`
`Unit Model
`Service Types (SOM)
`
`Primitive Component
`
`Service Instances
`
`
`Orchestrate Change
`Instances, Assigned
`Service Availability Policy
`
`to Machines
`Maintain Availability
`
`
`
`Alerts
`
`(bad states,
`responses)
`
`
`Notify
`
`Admins
`
`Managed
`
`Nodes
`
`41 Diagnose, Local Fix Diagnose, Local Fix
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 47 of 93
`
`US 2004/0225952 Al
`
`MODEL-
`BASED
`POLICY
`
`SDM AGGREGATE MODEL
`
`SDM INSTANCE OR UNIT MODEL
`
`OVERALL RESOURCE MANAGER
`
`
`
`
`
`CONSISTENCY
`AND VALIDATION
`
`RESOURCE MANAGERS
`
`DRIVERS
`
`PHYSICAL SERVERS
`
`MONITORING SERVICE
`
`EVENT-
`BASED
`TRIGGERS
`
`tg. 60
`
`,
`
`Kick-off Ops
`Management and
`Process:
`Gather
`Triqger:
`Ops Tasks
`.
`Context:
`Human a List of process
`+ Cmdlets
`SDM Info
`steps, such as:
`Request
`-
`- WMI.Next
`Application
`-
`Runtime Inf.
`» Upgrade OS
`:
`°
`Request —> —- - Remove a —> Windows Agents
`.
`.
`Resource
`Server
`- SDM Runtime
`Hardware
`info
`. Install an App
`Trigger
`- Back-up Data
`- Third-party Ops
`Oth
`software(ie,
`automatic
`Executed by
`back-up)
`MSOE or OLEE
`threshold
`Human Steps
`
`Note: Console undefined, but needed for a userto: hyp
`
`eEnter and display trigger
`eConfirm and monitor tasks
`
`«Review task status and reporting
`
`Fig. 6
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 48 of 93
`
`US 2004/0225952 Al
`
`entityId
`name
`
`
`
`
`
`
`
`duallid
`cardinality
`identifier
`
`
`
`Fig. 62
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 49 of 93
`
`US 2004/0225952 Al
`
`Room 42/4814,
`Power Grid 4800
`
`side
`
`
`
`
`
`Sample Physical Graph
`
`
`
`Disk, IBM372720:
`
`
`
`
`
`
`
` Disk, Quantc20
`Power Source,
`Grid4g0o0
`
`
`Net Dévice.
`SumMmitaesr
`
`
`
`
`
`
`
`dwNet, Device,
`Maxtor4a100
`
`
` Disk. MaxtorD540
`
`
`
`
`
`
`Physical Cont.,
`Room424814
`
`Net Device,
`Summit43sBe
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 50 of 93
`
`US 2004/0225952 Al
`
`
`Gridd800 Cd
`a
`
`[PhysicalContainer _|Roomazag1a[|__|
`xegPC|ecoo|SY
`[a]
`[Disk |!msrava0_ [CiCCCOb
`
`[sr_|[pisk__———*dGuantex20—[ a
`a jetwork Device
`[Summnasa[8
`[—7t_
`[Summaaep[6S
`a
`[Maxtor41aq0__||__|
`[Maxtorosaox|__|
`=
`
`
`of4IACOunets|——SsSSSSOSC—S sy
`nego7
`Tif2|
`[3]
`ioeOi
`73] 3]
`ioe%|)|
`3
`INico___| _____|mac:00-B0-bo-20-sF-a2_[1|
`[1s] 3]
`Nici |__| mac:00-A0-G9-A0-08-06___ [1
`[16]pCconnector[|__| ir
`[73][AGGonnector|i
`[Outside|Cd
`inside[|
`[19] 3)
`[20] 4!
`[Port|
`
`[33f—_a]IDGConnector[| ry8|[22] a]
`
`
`
`lOutside|SS —
`
`
`
`[Port|id 7]
`
`
`-—sI[DGGonnector|i [| 8
`
`[Outside| —
`[2st5
`
`
` [36[Port32|iY
`[Porat||
`37[6
`[—2e[|[AGGonnector[|__|SI
`[—20[ 5]
`CEa
`
`of 7] CSeT
`[Ponta
`[AGGonnector|__|
`[OutsidePd
`[sala] [Nico|____ }mae:00-A0-25-FE-GA.20
`
`[ss]| Init||mae:00-A0-30-FE-CA-21 [1
`
`[se]5
`ioeCS
`[37][OGConnector|Cd
`[sa]8[AGConnector|i
`[39/5
`Outside CS —
`[~ao[8 [inside[|__id
`
`
`[—ai[ 5]
`[Por|
`
`
`[~a2[__9]IDGConnector[|__| i]
`
`[Outside| -—
`~as[__6|
`LSa
`[~45[30]15] Wicesin =
`fcordo|dE
`[~45[ 10] 17
`[Gontained|__|
`[4713] _t8|
`
`[ae] 72 20]Ce—
`[—~aa[_t6]23locGapie| ra
`
`
`internat| C1"
`[—s0|_19] 22
`6
`
`
`
`[—s1[ 13] _23] Gable|id —
`
`=[pcGable| 14a (|"6]
`
`
`[~s4[_27]
`hwirez|_|
`—
`wiresol F
`[ss[__s1
`[~se[19]eora0oF 2
`[Containedeee §
`
`
`IATA_——S—S—iaigdPCS -——
`
`cable_—+i|iY ne
`[12 6
`ET)
`[internal]
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 51 of 93
`
`US 2004/0225952 Al
`
`aSenoSeen
`
`0,#,#
`haors
`0,1,#
`
`
`
`1,#,#
`
`
`
`Highnee)
`
`1,1,#
`
`Piano
`
`Dagsaschetieeieerate
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 52 of 93
`
`US 2004/0225952 Al
`
`[Allocate]
`Type = PC
`Cpu >= 1000
`
`Ram >= 512
`
`[Allocate]
`Type=Storage
`
`[Allocate]
`Type = Disk
`Size >= 100
`
`Fig. 68
`
`Id = PC201
`
`
`
` Id = IDE201.1
`
` Id = DISK201.1
`
`
`
`
`
`[Allocate]
`[Allocate]
`[Allocate]
`Type = Storage
`
`Type = Disk
`Type = OS Vroot
`
`
`
`
`
`
`
`[Allocate]
`Type = Network
`
`[Allocate]
`Type = SQL DB
`
`
`Fig. 10
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 53 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`
`
`[Allocate]
`[Allocate]
`[Allocate]
`
`Type = Storage
`Type = Disk
`
`Type = PC
`
`
`CPU>= 500
`
`
`
`
`
`
`[Allocate]
`Type = PC
`CPU >= 500
`
`
`[Allocate]
`Type = Network
`
`Id = Switch
`
`
`
` Type = Network
`
`
`Type = Location
`
`Td = Rack17
`
`
`
`
`
`
`[Allocate]
`[Allocate]
`[Allocate]
`Type = Storage
`Type = Disk
`Type = PC
`
`
`I CPU>= 500
`Size < 9GB
`
`
`
`
`
`[Allocate]
`Type = Network
`
`
`
` [Allocate]
`
` 4 CPU>= 500
`
`iy. 12
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 54 of 93
`
`US 2004/0225952 Al
`
`[Allocate]
`Type = PC
`Cpu >= 1000
`
`Ram >= 512
`
`Allocat
`[Allocate]
`Type=Storage
`
`[Allocate]
`Type = Disk
`Size >= 100
`
`Fig. (5
`
`
`
`
`[Allocate]
`[Allocate]
`Type = VLAN
`Type = VLAN
`
`
`
`
` Id = PC519
`
`Id = PCS01
`
`Fig. 74
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 55 of 93
`
`US 2004/0225952 Al
`
`Fig. 75
`
`me)
`
`
`[Allocate]
`Type = DNSName
`
`
`
`
`
`[Allocate]
`Type = Assignment
`
`
`
` [Allocate]
`
`Type = NAT Address
`
`
`
`
`[Allocate]
`Type = Network
`
`
`
`Id = PC101
`
`
`
`
`
`Id = NAT299
`
`[Allocate]
`Type = Network
`
`[Allocate]
`Type = LoadBalGroup
`
`
`
`
`
`
`
`
`
`[Allocate]
`[Allocate]
`Type = Network
`Type = Network
`
`
`
`
` Id = PC101
`
`[Allocate]
`Type = PC
`
`Cpu >= 1000
`
`Ram >= 512
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 56 of 93
`
`US 2004/0225952 Al
`
`Id = PC201
`
`
`
`[Allocate] *
`Type = Network
`BandWidth >= 80
`
`Id = PC219
`
`Fig. 7
`
`
`
`[Allocate]
`
`
`[Allocate]
`
`
`[Allocate]
`Type = Disk
`
`
`
`Type = PC
`
`
`Type = Storage
`Size >= 100
`
`
`
`
`
`Heads >= 4
`
`
`
`Rpm >= 10000
`Fig. 75
`
`
`
`
`
`
`[Allocate]
`[Allocate]
`Type = PC
`Type = PC
`
`
`
`
`
`
`
`[Allocate]
`[Allocate]
`Type = Storage
`Type = Storage
`
`
`
`
` [Allocate]
`
`Type = Disk
`
`Size >= 100
`
`
`
`
`Heads >= 4
`
`Rpm >= 10000
`
`Fig. 79
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 57 of 93
`
`US 2004/0225952 Al
`
` Id = PC101
`Id = PC102
`
`Id = PC105
`
`
`f)‘i
`
`
`
`
`[Allocate]
`Type = Network
`
`
`[Allocate]
`
`
`Type = FileShare
`Size >= 50
`
`
`
`Fig. 80
`
`Id = PC201
`
`
`
`
`
`[Allocate]
`Type = Network
`Type = PC
`
`Hops <= 2
`
`Cpu >= 1000
`
`
`Ram >= 512
`
`
`
`[Allocate]
`
`Type = Network
`Bandwidth >= 20
`
`
`
`
`
`
`Id = PC301
`
`
`Fig. St
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 58 of 93
`
`US 2004/0225952 Al
`
`
`
`Id != PowerGrid3
`
`
`
`
`
`[Allocate]
`[Allocate]
`[Allocate]
`
`Type = Disk
`Type = PC
`
`
`Type = Storage
`
`
`Ram >= 512
`Size >= 1TB
`
`
`
`Type = PowerGrid
`
`
`
`Type = PowerGrid
`
` Id = PC231
`
`
`
`
`
`
`
` [Allocate]
`
`
`[Allocate]
`
`Type = Disk
`Type = PC
`
`
`Ram >= 512
`Size >= 1TB
`
`
`
`[Allocate]
`Type = Storage
`
`Fig. 88
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 59 of 93
`
`US 2004/0225952 Al
`
`
`[Allocate]
`Type = PC
`Cpu >= 1000
`
`Ram >= 512
`
`
`
`
`
`[Allocate]
`‘|
`
`Type = Network
`
`
` Latency <= Sms
`
`
`
` Id = PC301 Id = PC309
`
`Fig. 54
`
`
`
`[Allocate]
`Type = PC
`Cpu >= 1000
`
`
`Ram >= 512
`
`
` Type = Network
`
`Hops = 1
`
`
`
`
`
`[Free]
`[Free]
`
`Type = PC
`Type = PC
`
`
`
`Cpu >= 1000
`Cpu >= 1000
`
`
`
`Ram >= 512
`Ram >= 512
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 60 of 93
`
`US 2004/0225952 Al
`
`Type=LoadBalGrp
`
`[Allocate]
`Type=LoadBalGrp
`
`
` [Allocate]
`
`
`
`
`[Allocate]
`[Allocate]
`Type=PC
`Type=PC
`
`Cpu>=1000
`Cpu>=1000
`
`
`Ram>=512
`Ram>=5120
`
`
`
`[Allocate]
`Type=LoadBalGrp
`
`
`
`[Allocate]
`Type=PC
`
`
`Cpu>=1000
`
`
`Ram>=512_
`
`
`
`
`
`
`[Allocate]
`[Allocate]
`
`Type = PC
`Type = PC
`
`
`
`
`
`
`
`[Allocate]
`[Allocate]
`
`Type = Disk
`Type = Disk
`
`
`
`
`Fig. 56
`
`
`
` SI9ALIG
`
`waukoidea||————~,<>YOMJON*9sIeMPIeHS89SIAIISOIG
`
`
`aueusessa(fom]so1nosay(6uiBeuy)Woe
`
`[Lienes26e210}$|Jajynoy|91|YoUMS
`
`
`
`SI9ALUQSI39ALQSI9ALQSI9ANQ
`
`
`
`seje|dwe)suonesijddy*‘S8DIAIOS
`
`
`
`
`
`21607]suonesedoasiudiaqug|SEdIMSSF2M
`
`
`SIOAIISaBei0j}Ssi9jnoy
`
`aoue}su|[———91a!
`suoljeisdo9——,aapnfenssj}uauodwo9
`
`
`gq106S408TOS
`
`slaourjeg(sd.usIajay
`
`peoSOUDIMSaiemMpseH)
`
`
`
`ewijuny(IGS)ePOWUOR!UYEqed1AJag
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 61 of 93
`
`US 2004/0225952 Al
`
`
`
`21607suoneisdg
`
`IdvswHunYyWdS
`
`Cc
`
`
`
`
`
`Jayndwoyig
`
`yuowabeuey
`
`
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 62 of 93
`
`Internal
`Network
`
`US 2004/0225952 Al IP Gateway
`
`Hardware
`Building
`Blocks
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 63 of 93
`
`US 2004/0225952 Al
`
`
`
`(sepelqpL)eansojauenz
`
`
`
`WVda9903858
`
`
`
`uoexjend
`
`
`
`
`
`JOUUBYDaqi4JOGD|‘OOL/OLJWepuNpeY
`
`
`
`salddnssamodAA00Z1(+)
`
`
`
`youauysUqebig(+)
`
`
`
`WV99038D21
`
`
`
`
`
`a@HeBIO}SJOUUBYDOJQ!4JO[SOS
`
`
`
`apejqBuissoo01yg
`
`
`
`apeig[oqU0D
`
`
`
`yorsadsepeiqBuissedoidpz
`
`
`
`
`
`sapeiqejqe66nidjoy
`
`f
`
`
`
`syuyjdnyWqebig(+)‘yoymsZ40Ae7]+
`
`SSE[9-91g}UB!|OldOdH
`
`ZHINOOZII]WNUad+
`
`ASICPIZHVLVBOOE+We993ADL—GWZIS+
`
`yOUauy>SEOOL/OLENG«
`
`saijddnsjuepunpaysamod
`
`
`yoedNZrPJadsapelqgE-
`ZHOP¢'|uoeXAem-F10Z
`sweijapelgeisuebe
`
`sajuegepelgWal
` |aie i,‘
`02)ainsojouane
`3tipies
`
`
`
`
`
`
`
`
`
`satjddnssamodAAO09JUBPpUNpeY-
`
`JO\ssadGz‘YORINZpJadsapeiqOgz«
`
`
`
`ASIQPIEHISOSAD9p1-9e
`
`
`
`WYVY99389z-SIN8Z1
`
`
`
`ZHOZ'LIllwnnUadJeng«
`
`
`
`
`
`OSS9)2Bpgiemog[190
`
`
`
`
`
`youayysyqebisjeng«
`
`
`
`
`
`
`
`syuljdnyqebig(7)‘sayoumsZ10X27(Z)
`
`
`
`
`
`solddnssamodAAOFO|JUepuNpeYy-
`
`
`
`yoesNzpsedsapelqpg«
`
`(sapelq9)ainsojousn¢e
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 64 of 93
`
`US 2004/0225952 Al
`
`
`-—WJ,-H_——
`
`
`
`
`
`Hardware
`Resource
`
`
`Manager
`
` Pe ne ee ge eee ee eee neee:
`Network
`we cne eee e cece tenn eee enneen eens «—| Resource
`
`Manager
`
`
`Storage
`
`
`
` PC
`
`Manager-
`
`Resource
`Manager
`
`QL
`Resource
`Manager
`
`Is
`Resource
`
`Fig. GO
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 65 of 93
`
`US 2004/0225952 Al
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 66 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`SavunssuaAsasjabie]
`
`ogeeeeee>
`4Xd+dOHa
`
`‘|300gJIOMION
`
`9}JEDIUNUIWODO}Jude,
`
`
`
`
`
`J9]|01}U0DYMPpd}eI0]-09aqURDSBDIAIBSSGV
`
`
`
`
`
`vetSIBAIBSayesedasUOpahojdapJo
`
`
`
`temySO1A1ES|iq---->)”JIpIIN|96w.aimanal
`
`ABAIOGJOBie|,-—
`
`
`tay/dlaL+3Xdfe}+veqSbeul].wonesddy
`
`
`J9]{01]U0994}0}89E}19}UIBY}SIJINM«
`
`
`
`
`
`iL~JOAIVS8S11d19}UQJAN‘UOAjUOSUNL41a]]01]U05-&d8Al8SLAN+.
`
`2OE
`
`/000¢Smopul/-
`
`|eseqejyeq
`
`
`
`JO@AIOSyobsey‘maage
`
`bddtiitinluly
`
`—ABoIUED
`
`wa
`
`a
`
`pueunuiog
`
`‘i
`
`
`
`JO@AINSyohIe]
`
`Se£on?
`
`
`
`
`
`
`
`
`
`US 2004/0225952 Al
`
`
`
`obeull'T
`
`Patent Application Publication Nov. 11,2004 Sheet 67 of 93
`
`
`peojumoqg oinjde,
` ~~toe=eges
`
`
`
` 2eer-ESQGbz-SMOnUINK,
`
`
`
`dH“f
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 68 of 93
`
`US 2004/0225952 Al
`
`Component A
`
` Component B
`
`Fig. 94
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 69 of 93
`
`US 2004/0225952 Al
`
`1!}eoiniaghw
`
`edAyuouodwos.
`
`
`~~}pugjyuosjsAadA}juguodwoo
`
`|
`
`‘JOSwa}sAsHulsn_fwaysXg
`Buisn
`
`
`
`‘S]|"waysAsBuisn-
`
`
`
`
`
`BDIAJOSAIOWeUAjquasse
`
` 6h
`-9qpugqyIegAJUsUOdWOD~7‘aypuyolJAWjuaUodUIODwe
`
`
`cya==djYped.
`
`—es3*puaoeadnadAyuauodwoog|
`ees}aseqejeqos
`
`|‘aon‘ash.uoeyUawe;dut
`
`Valofw“~DSAIN,.uonejuawe;dui
`
`‘Bojeyeoyualjg10SHod}uoneoddyasy
`
`{
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 70 of 93
`
`US 2004/0225952 Al
`
`juautAojdag
`
`a/eys
`
`
`
`Jayndwoyig
`
`9b
`
`ca
`VIIAIBSAIN
`
`awnunyWas
`
`[eysul
`
`&
`
`eudwiog||(qIWas)
`
`SdIAIBSAIN
`
`be,
`WX)
`_SdIAIESAI
`
`.BDIAIESAW (nas)
`
`49430
`
`VIIAIBS
`
`soleulg
`
`
`
`(11auT19)
`
`
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 71 of 93
`
`US 2004/0225952 Al
`
`2. server=GetPeerPort(catalog[1]);
`
`1. DeclarePort(sql[1],
`“DataSource-10.0.0.1;
`Auth=Kerb; Catalog=be[1]”);
`
`MyService[1]
`
`Fig. W
`
`
`
`US 2004/0225952 Al
`
`wips'
`
`snosusb019}98H/peynquysiq
`
`09S!
`Patent Application Publication Nov. 11,2004 Sheet 72 of 93 je907
`
`
`
`YOSOJsIIINJON
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 73 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`ue10(apod)21607]suoijes9ado
`
`
`
`
`
`J00}uUsWAOdapeBulsnJoyesadg
`
`
`
`
`
`saoue}suluoljeoljddeoy}soyeai9
`
`
`
`
`
`‘g0edsaoue}sulaieMpseY9y}UI
`
`
`
`aoeds9s0ue}sU]AAH2UOHeDI|ddy
`
`4011Jam
`
`
`
`(INAS)Uoneaiddy
`
`sJeMpsey0}sdew
`
`
`
`
`
`*(DAA)uonoeysqy
`
`
`
`Buiddewsy!pueWAS24}YM
`
`DAA04}0}uoneonddy
`
`.¥weueciag
`
`44PE
`
`
`
`ZO}4aAsaS
`
`
`
`uol}duosepjeo16o7
`
`
`
`4ajua0Byep&jo
`
`
`
`
`
`JolGqoaoedssseiyauempieH
`
`
`
`Buoyesaleuiquonjesyddeau}
`
`
`
`
`
`
`
`
`
`sulejuosabeyoedyuawAojdag
`
`
`
`
`
`aoedssse]5uolneoddy
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 74 of 93
`
`US 2004/0225952 Al
`
`_—
`=
`meh LE i
`
`b
`
`mixa
`WELTFO
`
`a
`
`‘eens,ak
`
`
`
`TaONeYBaryBHqrOIS
`
`[REcomnse&(punesby2ea)0
`ORBILeerweve,
`
`YOSOISIIAI
`
`
`cesmerearevtece
`
`
`
`(11)&eoigsono
`
`ADOREWAM
`
`
`
`SINJD9PYDIYSULB}SAG
`
`
`
`4QU99EyeQesudiaiuy
`
`SETAEVO)
`a
`
`9TH ESLsl
`TErer 9)
`SAV
`
`2x
`
`
`
`cctnemnncenocasnantennaesecaaacansHEYLGUNoeLGNES
`
`(au) poddng
`SBRPEARS (EDU
`
`
`
`
`
`~(G54)¥omgvoReaTdyyaDg3g
`
`
`
`LaSOMAUonyaBesors
`
`+o,eensweg
`
`ea)
`iaOSYN
`AAC§
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 75 of 93
`
` aieMpley
`
`IOMION
`
`
`
`uojedddy
`
`Sagid3i
`
`Picnie
`
`™~.
`
`US 2004/0225952 Al
`
`
`
`lonPE
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 76 of 93
`
`US 2004/0225952 Al
`
`Jaysibau
`}no-ajeoS
`
`pueSunnoy
`
`Buibessayy
`
`LANSId
`
`auuijund
`
`JEW}
`
`jugwebeuew
`
`goinosey
`
`JEWO}
`
`[oe
`
`juawAo\dep
`yodsuey
`
`ajlduuo09
`
`se-passaldxy
`
`uOHIUNaQ
`Aqpazijenyxayu04
`
`BOIAIOS
`
`suoneiedo
`
`SEDANS
`ssanoy
`JONJUODPuy
`
`qe
`
`eleq
`
`Buvoyu0jpy
`
`
`
`
`
`
`
`US 2004/0225952 Al
`
`&+
`
`
`
`JOULONUJORG
`
`sgeetgXedLPe:.=canyon:oe¢
`
`Patent Application Publication Nov. 11,2004 Sheet 77 of 93
`
`
`(ejdoad=SBCIOISI[AN/S4O@AIOS=AAS)
`
`SABOI. SOMOS=SUOMEDIIGGY
`
`
`
`E(IFSGUAPEUEIGE‘SI{UILUT|DSISVSD[pauseSOUDIDAW
`
`
`
`MOMSUIA,[GIS[pedugMIDIEMEPIESESIETore)
`[.=:
`meresereteeDSi}
`BITALOS
`
` SNOUTS_AUBINISOL
`
`[SAS
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 78 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`aanoedsiedAysuagjealyWal
`
`
`Tar868001reApoaryAreqaNOAUoIueOTAUODNOGTUGILOAULLARuD3
`
`
`Ob0zS00z9002S66.Oa6LS86LO86)Sé6tOL6ES96bOpes
`onSJ2Es,Sigwine10PINDSTuw
`
`
`
`Welz,AoonEssroeeaseudorme{ulSamer=|sexe[8]
`
`
`penmgegeSrsinameaseyesmanne“syjuowpZ0}gtAinoBuignopWor
`
`
`
`
`
`
`
`
`
`
`
`
`“BILTUD.HABER)4TOASROTpOOaOngSunooTEeo4Gupno7spurtOU)Buus,FOSABODERUETuOGCogfz][TRIGwODGoTrYqUIILIOOTICMYMEL)Aonang11]UoRUeAU|+INNTUROOOTAaLAasOL,RURAL.UOCTOARDuk“sorery
`
`
`cenangarava:;
`
`
`SoneomysuumelpatioAegy
`
`
`paseasout&reaS®y}S09JUSUOdWiODWNWIUIWSt
`
`
`zeoso\|wy&PerbastSYIUOWBLNoywreeet:
`
`
`"SAADIMIOMNOCLOM
`Lorte208SESYIWwOL
`
`
`
`
`nH,0}papuaweJ3]2][cg]weededamyjo
`wore:soyoRy@ApyGnoujoayereye.
`
`
`
`_.
`ZANEElACOS«
`
`TraewanedEslWb3wou
`
`
`
`
`
`
`
`
`
`
`
`
`
`UNLTEUOL(5960)9d“9"ROE“TOA‘OaRnasonD,BETPOINTOROsUOVOKLUNSNOUOUND,‘OO;UOpIED[¢}“Waerssopo.danegoonszyuaoguEaUgDMYcilORSOTOIORIYBuyPORZENLATESOGLHREECD|y}
`
`hassurindd@&(eleeetneSAgeeanoounporayenedaH%IloroSMe
`SUIUOLYZZ/vonuarowiFats
`o7ce~~AVEOHYDFi
`p01LE
`qa3™amYHOO!S.
`‘
`
`eatsonsapeyas
`
` 4“esyaoO8"ot2s70asedepy.ldwcsonyor
`
`s.=.&&=e=as”
`
` puoczes sod saiqesew
`PaspeuiveEMsyeDpSiAye.~
`
`Pore~~Gone
`
`
`2008L064268s2881caeL206
`
`
`
`
`LOB}TeasOnRaLssaiborgABojouysayjosueaAEP
`
`
`
`BABGoeql2Secdi¢lJames
`
`d,en,ean
`
`
`
`303AyxaydwodOu,ME}S.A100/)
`
`Qo
`
`>g=©:
`
`anur
`
`HOA
`
`.
`
`
`
`beieo000
`
`SyuOWSPSa
`
`se
`
`Ot
`
`eee
`
`boas.4]Broate
`
`SUR
`
`We
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 79 of 93
`
`US 2004/0225952 Al
`
`
`
`
`
`HujujenpueAypiqepeae‘ajdoedAquaALpSi}SODayyso%GE
`
` MSIMH+Bululesy+ewUMOg+ejdoeg=*""5g5],
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 80 of 93
`
`US 2004/0225952 Al
`
`Fig. 106
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 81 of 93
`
`US 2004/0225952 Al
`
`Name
`
`‘Management,Apt
`and)Solutions
`
`shared useof resources
`
`Achievemoreflexcoand
`iduaearien
`
`WOecessaiCom
`FNSUSMAIAOTALIKeeoak)
`_ and3parti
`
`|
`
`Customer Benefit
`
`Fig. 107
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 82 of 93
`
`US 2004/0225952 Al
`
`Fig. 105
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 83 of 93
`
`US 2004/0225952 Al
`
`punodwoo
`
`jusuodwioo
`
`juauodwoo[|
`
`wod~<
`
`
`JIM-——e7
`
`BIIAIOSXBL.
`
`peoq
`
`Jequejeg.
`
`.oy]
`
`yousayy|
`
`
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 84 of 93
`
`SQL Cluster
`
`Failure
`Detector
`
`ff
`|,
`
`7
`
`sal
`
`:
`|
`
` US 2004/0225952 Al
`
`" Server -
`. sal .
`
`|
`
`Consensus
`__ .
`
`>
`B
`
`>|
`
`[|
`
`sa.
`Server
`
`Server
`
`Fig. U0
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 85 of 93
`
`US 2004/0225952 Al
`
`
`
`Buoy,wouoduiejs
`
`ASI
`
`
`
`YIOAMIONOY)SuIEJNIEPy~
`
`
`
`TojeINdOYAMA
`
`AUBAPIEL]9]SUIEIULEYA
`
`
`
`AoeiadgsivMplepy
`
`oui)unY
`
`
`
`[PPOW49}U9>e1eqWAS
`
`2O/ZWO
`
`iNVAa[PANO||NWAAW420(|
`
`HOMION
`
`
`
`-angaeyTOTTTTotcote
`
`uEMpley
`
`AHI
`
`MH221U32dBespsUTIsagq+>
`ow]UBIsag
`
`JousIseqyusuoduieD+ms
`
`HeyporyUoHeyday
`YOMIINsy)suBisagye
`
`
`Bd1AJasoyiSUBISA+
`POMPTYWOON
`ASIe:
`
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 86 of 93
`
`US 2004/0225952 Al
`
`6
`
`ee
`
`seInqunyUOdWas
`
`arene
`
`
`
`L1HHoasuery
`
`
`
`
`
`fe}ssexpuacns,uognjos(9)
` pemwoenv6-aMj
`
`Hyfsogioyseques2-fi:
`uadyiepequoygy)-H]
`
`we
`
`
`
`S9IAIaSpajoway
`
`punodwoywas
`
`yusuodwo’)
`
`AIMWAS
`
`JOJIE/JUOD>>
`
`
`
`JODEIUODpougposgYWOdWaS<<JUOBY
`
`
`soBeuenpanejeidiSeWOd
`
`peseonaye6oleqWas&BONESGem
`
`
`
`soUsLejeydeM&.
`
`BO|AIOSGoM@:
`
`
`aviniespejoweyal
`SemwelziaFA
`uoneayddyq8M@|
`
`
`
`
`“syddsmopulygad
`
`quewinosET
`
`sadY
`
`
`
`
`
`209.11“SANSOBU9S)O)oeUEgmi
`
`aBuepeyO}
`HOd
`
`uondeuuE9&:
`
`|
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SrcHan
`
`Patent Application Publication Nov. 11, 2004 Sheet 87 of 93
`
`US 2004/0225952 Al
`
`PrcnnarpntiscnrritthicteeBitnwaSeRe,
`
`\ (Living) Mode
`
`
`
`Patent Application Publication Nov. 11,2004 Sheet 88 of 93
`
`US 2004/0225952 Al
`
`
`
`ea
`
`OcUeoomosoupoMocipue IEGaSIDALIGSEGSIENITa)
`91607]suonesiedoBuipjing49410aEa SBDIAIOS
`
`
`
`eeeeTa)SnratecaSTUUReToTeCCreBTci
`
`CIEYWETSEalesLeyseIeMTsEDUESETECpS|
`Bee
`ayWsro]BLestsJajnoy|a1
`
`BETTETTre}ht=eT=1e(@)
`
`SIopeUrPOOMOsoMESOOnm
`
`FyCelteye
`
`
`
`eiUloybere)ielehyd
`
`eeWET
`
`TULA
`
`
`
`Jajndwioy91g
`
`OLYSos6D)
`
`
`
`lapowularlyayy,
`
`TOS
`
`aseqeieg
`
`Patent Application Publication Nov. 11,2004 Sheet 89 of 93
`
`US 2004/0225952 Al
`
`
`
`BOISXBL
`
`
`
`Patent Application Publication Nov. 11, 2004 Sheet 90 of 93
`
`US 2004/0225952 Al
`
`
`
`IPPOW4974Se1eqdWAS
`
`
`
`
`
`ouUNYswi,UBIS9gq
`
`|
`
`
`
`Sunouuodpyjusuoduroy--
`
`ASI
`
`
`
`
`
`4YIOMIINLSY)SULRIUIBIAT?
`
`oNOE
`
`ZznWg|NWAa1emets|NWAa20
`
`Zz