(12) United States Patent (12) United States Patent
`
`(12) United States Patent
`Chiu et al.
`
`Chiu et al. Chiu et al.
`
`
`ofIRM11111 1111111111111110111111 ofIRM11111 1111111111111110111111
`
`11111111111111111111111111111111111111111111111111111111111111
`USOO6181336B1
`
`US 6,181,336 B1 US 6,181,336 B1
`(10) Patent No.:
`US 6,181,336 B1
`
`(to) Patent No.: (cid:9)(to) Patent No.: (cid:9)
`(45) Date of Patent:
`*Jan. 30, 2001
`
`(45) Date of Patent: (cid:9)(45) Date of Patent: (cid:9)
`
`*Jan. 30, 2001 *Jan. 30, 2001
`
`(54) DATABASE-INDEPENDENT, SCALABLE,
`
`(54) DATABASE-INDEPENDENT, SCALABLE, (54) DATABASE-INDEPENDENT, SCALABLE,
`OBJECTORIENTED ARCHITECTURE AND
`
`OBJECT-ORIENTED ARCHITECTURE AND OBJECT-ORIENTED ARCHITECTURE AND
`
`API FOR MANAGING DIGITAL API FOR MANAGING DIGITAL
`ESENASDIGITAL
`
`MULTIMEDIA ASSETS MULTIMEDIA ASSETS
`
`
`(75) Inventors: Sheng-Yang Chiu, Palo Alto; Sathis N. (75) Inventors: Sheng-Yang Chiu, Palo Alto; Sathis N.
`(75) Inventors: Sheng-Yang Chiu, Palo Alto; Sathis N.
`
`Menon, Sunnyvale; Jeffrey D. Hollar, Menon, Sunnyvale; Jeffrey D. Hollar,
`Menon Snys sty D. Hollar,
`
`Livermore, all of CA (US) Livermore, all of CA (US)
`IVermore, all O
`(US)
`
`(73) Assignee: Silicon Graphics, Inc., Mountain View, (73) Assignee: Silicon Graphics, Inc., Mountain View,
`(73) ASSignee: synsraphs Inc., Mountain View,
`
`CA (US) CA (US)
`
`c:
`- - -
`(*) Notice:
`
`( * ) Notice: (cid:9)( * ) Notice: (cid:9)
`
`This patent issued on a continued pros-
`
`This patent issued on a continued pros- This patent issued on a continued pros-
`
`ecution application filed under 37 CFR ecution application filed under 37 CFR
`ecutIOn application filed under 37 CFR
`1.53(d), and is subject to th y ny
`
`1.53(d), and is subject to the twenty year 1.53(d), and is subject to the twenty year
`
`patent term provisions of 35 U.S.C. patent term provisions of 35 U.S.C.
`past m proVISIons o
`a a- -
`
`154(a)(2). 154(a)(2).
`(a)(2).
`Under 35 U.S.C. 154(b), the term of this
`
`Under 35 U.S.C. 154(b), the term of this Under 35 U.S.C. 154(b), the term of this
`patent shall be extended for 0 days.
`
`patent shall be extended for 0 days. patent shall be extended for 0 days.
`
`(56)
`(56) (cid:9)(56) (cid:9)
`
`
`(21) Appl. No.: 08/644,686
`(21) Appl. No.: 08/644,686 (21) Appl. No.: 08/644,686
`
`(22) Filed:
`May 31, 1996
`May 31, 1996 May 31, 1996
`
`(22) Filed: (cid:9)(22) Filed: (cid:9)
`
`(51) Int. Cl." ....................................................... Gost 100
`
`
`(51) Int. Cl.' (cid:9)(51) Int. Cl.' (cid:9)
` GO6T 1/00 GO6T 1/00
`
` 345/329 345/329
`
`(52) U.S. Cl. (cid:9)(52) U.S. Cl. (cid:9)
`(52) U.S. Cl. .............................................................. 345/329
`(58) Field of Search ...
`... 345/329-332,
`
`(58) Field of Search (cid:9)(58) Field of Search (cid:9)
`
` 345/329-332, 345/329-332,
`345/352, 353, 355-357
`
`345/352, 353, 355-357 345/352, 353, 355-357
`s
`s
`References Cited
`References Cited References Cited
`
`U.S. PATENT DOCUMENTS U.S. PATENT DOCUMENTS
`
`U.S. PATENT DOCUMENTS
`2/1992 Davis et al. ......................... 395/100
` 395/100 395/100
`
`
`2/1992 Davis et al. (cid:9)2/1992 Davis et al. (cid:9)
`
`OTHER PUBLICATIONS OTHER PUBLICATIONS
`OTHER PUBLICATIONS
`Colton, M., “Multimedia Asset Management White Paper,”
`
`Colton, M., "Multimedia Asset Management White Paper," Colton, M., "Multimedia Asset Management White Paper,"
`About Informix White Papers, Informix, actual publication
`
`About Informix White Papers, Informix, actual publication About Informix White Papers, Informix, actual publication
`date unknown, estimated 1992-1993.
`
`date unknown, estimated 1992-1993. date unknown, estimated 1992-1993.
`
`5,091,849
`5,091,849 (cid:9)5,091,849 (cid:9)
`
`
`Aronson “HTML3 Manual of Style” pp. 112-123, 1995.*
`Aronson "HTML3 Manual of Style" pp. 112-123, 1995.* Aronson "HTML3 Manual of Style" pp. 112-123, 1995.*
`
`
`
`* cited by examiner * cited by examiner
`* cited by examiner
`
`Primary Examiner Almis R. Jankus
`
`Primary Examiner (cid:9) Almis R. Jankus Primary Examiner (cid:9) Almis R. Jankus
`(74) Attorney, Agent, or Firm-Sterne, Kessler, Goldstein
`
`(74) Attorney, Agent, or Firm—Sterne, Kessler, Goldstein (74) Attorney, Agent, or Firm—Sterne, Kessler, Goldstein
`& Fox, p.l.l.c.
`
`& Fox, p.l.l.c. & Fox, p.l.l.c.
`ABSTRACT
`(57)
`ABSTRACT ABSTRACT
`
`
`(57) (cid:9)(57) (cid:9)
`A System is described for providing an integrated, efficient
`
`A system is described for providing an integrated, efficient A system is described for providing an integrated, efficient
`y
`p
`9.
`9.
`and consistent production environment for the Shared devel
`
`and consistent production environment for the shared devel-and consistent production environment for the shared devel-
`opment of multimedia productions. Examples of multimedia
`
`opment of multimedia productions. Examples of multimedia opment of multimedia productions. Examples of multimedia
`productions include feature animation films, computerized
`
`productions include feature animation films, computerized productions include feature animation films, computerized
`animation films, interactive Video games, interactive
`
`animation films, interactive video games, interactive animation films, interactive video games, interactive
`movies, and other types of entertainment and/or educational
`
`movies, and other types of entertainment and/or educational movies, and other types of entertainment and/or educational
`multimedia works. The development of such multimedia
`
`multimedia works. The development of such multimedia multimedia works. The development of such multimedia
`products typically involve heterogenous and diverse forms
`
`products typically involve heterogenous and diverse forms products typically involve heterogenous and diverse forms
`of multimedia data. Further, the production tools and equip
`
`of multimedia data. Further, the production tools and equip-of multimedia data. Further, the production tools and equip-
`
`ment that are used to create and edit such diverse multimedia ment that are used to create and edit such diverse multimedia
`ment that are used to create and edit Such diverse multimedia
`data are in and of themselves diverse and often incompatible
`
`data are in and of themselves diverse and often incompatible data are in and of themselves diverse and often incompatible
`with each other. The incompatibility between such devel
`
`with each other. The incompatibility between such devel-with each other. The incompatibility between such devel-
`opment tools can be seen in terms of their methods of
`
`opment tools can be seen in terms of their methods of opment tools can be seen in terms of their methods of
`operation, operating environments, and the types and/or
`
`operation, operating environments, and the types and/or operation, operating environments, and the types and/or
`formats of data on which thev operate upon. Disclosed
`
`formats of data on which they operate upon. Disclosed formats of data on which they operate upon. Disclosed
`n (ney operate upon.
`
`herein, is a complete solution that provides a consistent and herein, is a complete solution that provides a consistent and
`herein, is a complete Solution that provides a consistent and
`integrated multimedia production environment in the form
`
`integrated multimedia production environment in the form integrated multimedia production environment in the form
`of common utilities, methods and Services. The COO
`
`of common utilities, methods and services. The common of common utilities, methods and services. The common
`utilities, methods and Services disclosed herein, are used to
`
`utilities, methods and services disclosed herein, are used to utilities, methods and services disclosed herein, are used to
`integrate the diverse world of multimedia productions. By
`
`integrate the diverse world of multimedia productions. By integrate the diverse world of multimedia productions. By
`
`using the common utilities, methods and services provided, using the common utilities, methods and services provided,
`using the common utilities, methods and Services provided,
`diverse multimedia production tools can access, Store, and
`
`diverse multimedia production tools can access, store, and diverse multimedia production tools can access, store, and
`share data in a multiple user production environment in a
`
`share data in a multiple user production environment in a share data in a multiple user production environment in a
`consistent, Safe, efficient and predictable fashion.
`
`consistent, safe, efficient and predictable fashion. consistent, safe, efficient and predictable fashion.
`
`19 Claims, 11 Drawing Sheets
`19 Claims, 11 Drawing Sheets 19 Claims, 11 Drawing Sheets
`
`
`
`
`718 (cid:9)718 (cid:9)
`
`g
`
`
`
`714 714
`
`
`
`716 716
`
`Browse Browse
`
`Query Browse
`Query Query
`
`
`Catal
`Checkini CFR Placer
`
`Catalog Checkin/ CFR Placer Catalog Checkin/ CFR Placer
`99 Checkout
`
`Checkout & CDA Checkout & CDA
`
`
`
`720 (cid:9)720 (cid:9)
`
`
`
`722 722
`
`p r
`
`
`
`724 724
`
`p
`
`
`Content Creation Content Creation
`Content Creation
`Tools
`
`Tools Tools
`
`
`
`728 728
`
`p
`
`
`Production Production
`Production
`Mgmt
`
`Mgmt Mgmt
`
`AMS clients
`AMS clients AMS clients
`
`
`Repository
`
`Repository Repository
`
`s 702
`
`702 702
`
`The Vault The Vault
`
`The Vault
`
`
`
`• • • • • •
`
`704 - 1
`
`704 --'-' 704 --'-'
`
`Repository
`
`Repository Repository
`
`730 730
`
`730
`
`Metadata Server
`Metadata Server Metadata Server
`
`
`Content Servers
`Content Servers Content Servers
`
`
`Metadata Server Metadata Server
`
`Metadata Server
`
`Content Servers
`Content Servers Content Servers
`
`
`
`
`
`
`706
`706 706
`
`
`
`5 5
`708
`
`708 708
`
`
`1 1
`
`710 710
`710
`
`712
`712 712
`
`
`Page 1 of 70
`
`MINDGEEK EXHIBIT 1002
`
`

`

`Waled *S11
`U.S. Patent
`Waled *S11
`
`Jan. 30, 2001
`
`II JO 1 lamIS
`Sheet 1 of 11
`II JO 1 lamIS
`
`HI 9££`-18r9 Sa
`HI 9££`-18r9 Sa US 6,181,336 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`102a (cid:9)
`102a (cid:9)
`
`102b (cid:9)
`102b (cid:9)
`
`102n
`102n
`
`Asset Management
`Asset Management
`Tool
`Tool
`
`• • •
`• • •
`
`Asset Management
`Asset Management
`Tool
`Tool
`
`Asset Managment
`Asset Managment
`Tool
`Tool
`
`queuuôeue N ?assy
`|OOL
`
`104
`104
`
`106
`106
`
`I
`
`StudioLib
`StudioLib
`Object Oriented Library - Data objects ,
`Object Oriented Library - Data objects ,
`user interface services, utilities, etc.
`user interface services, utilities, etc.
`
`108a
`108a
`
`(cid:9)
`(cid:9)
`
`Vault
`Vault
`Repository
`Repository
`
`109a
`109a
`
`Asset Storage
`Asset Storage
`APIs
`APIs
`
`108b
`108b
`
`(cid:9)
`
`Vault
`Vault
`Repository
`Repository
`109b Asset Storage
`109b Asset Storage
`APIs
`APIs
`
`Vault API
`Vault API
`
`Asset services (checkin/checkout),
`Asset services (checkin/checkout),
`system administration, Asset version
`system administration, Asset version
`managment, CFR support, repository
`managment, CFR support, repository
`support etc.
`support etc.
`108n — (cid:9)
`108n — (cid:9)
`
`
`
`
`Vault
`Vault
`Repository
`Repository
`109n Asset Storage
`109n --, Asset Storage
`APIs
`APIs
`
`110b
`110b
`
`110n
`110n
`
`Asset Storage
`Asset Storage
`Server
`Server
`
`Asset Storage
`Asset Storage
`Server
`Server
`
`Asset Storage
`Asset Storage
`Server
`Server
`
`FIG. 1
`FIG. 1
`
`Page 2 of 70
`
`MINDGEEK EXHIBIT 1002
`
`

`

`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 Jan. 30, 2001
`
`
`Sheet 2 of 11
`Sheet 2 of 11 (cid:9)Sheet 2 of 11 (cid:9)
`
`
`US 6,181,336 B1 US 6,181,336 B1
`
`US 6,181,336 B1
`
`
`
`dataflow dataflow
`
`Silicon Graphics
`Silicon Graphics Silicon Graphics
`
`
`
`movieplayer movieplayer
`- - - - - - -
`
`
`208 (cid:9)208 (cid:9)
`206
`-- 208
`
`206 (cid:9)206 (cid:9)
`
`Irs' Irs'
`
`I I
`- - - - ;
`
`204
`2O2
`
`202 202
`
`204 (cid:9)204 (cid:9)
`
`5 (cid:9) Silicon Graphics Silicon Graphics or Mac 5 (cid:9) Silicon Graphics Silicon Graphics or Mac
`Silicon Graphics - 5. Silicon Graphics Rsicon Gaphics at Me
`Silicon Graphics Silicon Graphics
`
`
`-
`
`-
`
`
`
`CDA CDA
`
`
`
`k k
`
`
`
`230 230
`
`Silicon Graphics
`Silicon Graphics Silicon Graphics
`
`
`
`
`CDS CDS
`
`
`
`232 232
`
`(se
`
`
`
`I I
`
`
`
`file system file system
`
`
`
`
`
`Animation Animation
`
`
`
`222 222
`
`
`
`218
`218 218
`
`
`
`Edit System Edit System
`
`212 212
`
`
`
`file system file system
`
`
`216 216
`
`
`
`ti (cid:9) ti (cid:9)
`
`file system file system
`
`
`
`220 220
`
`
`
`224 224
`
`
`
`
`
`
`210 (cid:9)210 (cid:9)
`
`
`ti (cid:9)ti (cid:9)
`
`
`file system file system
`
` 214 214
`
`
`Storyboard/Layout Storyboard/Layout
`
`Checkin/Checkout Checkin/Checkout
`
`
`
`Checkin/Checkout
`Checkin/C eckout Checkin/C eckout
`
`
`
`
`V V
`I I
`
`Checkin/Checkout Checkin/Checkout
`
`
`
`
`
`100
`100 100
`
`
`
`
`226 226
`
`
`
`
`
`AMS AMS
`
`AMS
`
`FIG. 2 FIG. 2
`
`FIG. 2
`
`Page 3 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 Jan. 30, 2001
`
`
`Sheet 3 of 11
`Sheet 3 of 11 (cid:9)Sheet 3 of 11 (cid:9)
`
`
`US 6,181,336 B1 US 6,181,336 B1
`
`US 6,181,336 B1
`
`
`
`frame(1)
`
`frame|2)
`
`O
`
`frame(5040
`
`300
`
`FIG. 3 FIG. 3
`
`FIG. 3
`
`Page 4 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 Jan. 30, 2001
`
`
`Sheet 4 of 11
`Sheet 4 of 11 (cid:9)Sheet 4 of 11 (cid:9)
`
`
`US 6,181,336 B1
`US 6,181,336 B1 US 6,181,336 B1
`
`
`
`
`2 2
`
`
`
`p p
`
`
`
`416 418 416 418
`
`
`
`
`
`
`
`408 (cid:9)408 (cid:9)
`
`
`
`
`
`1 (cid:9)1 (cid:9)
`
`
`Ed c Ed c
`
`2 9 412 2 9 412
`
`
`
`410 410
`
`rotund butcher
`
`rotund_butcher rotund_butcher
`
`404 ,y-- 404 ,y--
`
`
`
`scene1 scene1
`
`
`
`• • • •
`
`
`
`3 3
`
`
`
`402 402
`
`
`
`413 (cid:9)413 (cid:9)
`
`
`
`414 (cid:9)414 (cid:9)
`
`
`
`416 416
`
`FIG. 4 FIG. 4
`
`FIG. 4
`
`Page 5 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 Jan. 30, 2001
`
`
`Sheet 5 of 11
`Sheet 5 of 11 (cid:9)Sheet 5 of 11 (cid:9)
`
`
`US 6,181,336 B1 US 6,181,336 B1
`
`US 6,181,336 B1
`
`
`
`storyreel.31 sequence (71 scene (52) / frame (10) / background-r'
`
`storyreel.3 / sequence [7] / scene [52] / frame [10] / background' 502 storyreel.3 / sequence [7] / scene [52] / frame [10] / background' 502
`
`storyreel.3
`
`sequence (7) . .
`
`scene (52)
`
`frame 10
`
`.
`
`.
`. background . .
`. . background . . . . background . .
`
`
`
`-1-1,-,-- 520 -1-1,-,-- 520
`
`11
`
`
`
`506 506
`
`
`
`508 508
`
`
`
`510 510
`
`
`
`512 512
`
`
`
`514 514
`
`
`
`516 516
`
`
`
`518 518
`
`FIG. 5 FIG. 5
`
`FIG. 5
`
`Page 6 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 Jan. 30, 2001
`
`
`Sheet 6 of 11
`Sheet 6 of 11 (cid:9)Sheet 6 of 11 (cid:9)
`
`
`US 6,181,336 B1 US 6,181,336 B1
`
`US 6,181,336 B1
`
`
`
`FIG. 6 FIG. 6
`
`FIG. 6
`
`Page 7 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 Jan. 30, 2001
`
`
`Sheet 7 of 11
`Sheet 7 of 11 (cid:9)Sheet 7 of 11 (cid:9)
`
`
`US 6,181,336 B1
`US 6,181,336 B1 US 6,181,336 B1
`
`
`714.
`
`714 714
`
`716
`
`716 716
`
`718
`718 718
`
`
`720
`720 (cid:9)720 (cid:9)
`
`
`722
`722 722
`
`
`724 724
`
`724
`
`
`
`C C
`
`
`
`5 (cid:9)5 (cid:9)
`5 5
`
`5 5
`Checkin? CFR Placer
`
`Checkin/ CFR Placer Checkin/ CFR Placer
`Query Browse Catalog Checkout
`Catalog Catalog
`Browse Browse
`
`
`Query Query
`
`
`Checkout & CDA Checkout & CDA
`
`
`
`5 5
`
`
`S S
`
`Content Creation Content Creation
`
`Tools Tools
`
`
`
`• • • • • •
`
`
`
`728 728
`
`728
`
`S S
`
`Production Production
`Production AMS clients
`AMS clients AMS clients
`
`Mgmt
`
`Mgmt Mgmt
`
`
`
`
`
`
`
`/ /
`
`Metadata Server
`Metadata Server Metadata Server
`
`
`
`5 5
`706
`
`706 706
`
`Content Servers
`Content Servers Content Servers
`
`
`
`
`rr rr
`
`
`5 5
`708
`
`708 708
`
`
`
`Repository Repository
`
`
`
`
`
`The Vault The Vault
`
`
`
`"--'"--- 702 "--'"--- 702
`
`
`
`704 --"--- 704 --"---
`
`
`
`Repository Repository
`
`
`
`• • • • • •
`
`730
`''-'--- 730 ''-'--- 730
`
`
`
`
`\ \
`
`Metadata Server
`Metadata Server Metadata Server
`
`
`Content Servers
`Content Servers Content Servers
`
`
`
`S S
`
`710 710
`
`
`S S
`
`712 712
`712
`
`FIG. 7
`FIG. 7 FIG. 7
`
`
`Page 8 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 Jan. 30, 2001
`
`
`Sheet 8 of 11
`Sheet 8 of 11 (cid:9)Sheet 8 of 11 (cid:9)
`
`
`US 6,181,336 B1 US 6,181,336 B1
`
`US 6,181,336 B1
`
`
`movieplayer movieplayer
`movieplayer
`
`
`.„,-,„-- 822 .„,-,„-- 822
`Open
`
`Open Open
`
`804 804
`
`804
`
`
`
`
`
`Placer Placer
`
`Usage info
`Usage Info Usage Info
`
`
`CDA
`CDA CDA
`
`
`
`802 (cid:9)802 (cid:9)
`2
`
`806 806
`
`806
`
`
`808 808
`808 data stream
`data stream data stream
`
`() ) (
`) (
`) () ) N
`
`
`826 826
`
`Play Play
`
`
`
`Close Close
`
`
`
`810 810
`
`
`Open Open
`
`ii. ii.
`
`
`
`C DC D
`
`
`
`S S
`
`Ei 8 Ei 8
`
`818
`
`
`
`44
`
`
`
`**`••••••----**`••••••----
`
`(containe)
`
`
`iz!nfig Info iz!nfig Info
`
`ss
`
`Reserve
`Reserve Reserve
`
`
`
`
`820 820
`
`820
`
`GetLocation
`GetLocation GetLocation
`
`
`Connection Manager
`
`Connection Manager Connection Manager
`
`Update
`Update Update
`
`
`824
`
`.,-,..-- 824 .,-,..-- 824
`
`2 2
`
`812
`
`The Vault
`The Vault The Vault
`
`
`106
`
`,-...- 106 ,-...- 106
`
`
`
`
`
`828 828
`
`
`•-• •-•
`file system
`
`file system file system
`
`(data) (data)
`(data)
`
`...._ (cid:9)...._ (cid:9)
`
`..... .....
`Content Server
`Content Server Content Server
`
`
`7O'8 7O'8
`
`708
`
`FIG. 8
`FIG. 8 FIG. 8
`
`
`Page 9 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 Jan. 30, 2001
`
`
`Sheet 9 of 11
`Sheet 9 of 11 (cid:9)Sheet 9 of 11 (cid:9)
`
`
`US 6,181,336 B1 US 6,181,336 B1
`
`US 6,181,336 B1
`
`Video Editor 1 Video Editor 1
`
`Video Editor 1
`
`
`
`Video Editor 2
`
`Video Editor 2 Video Editor 2
`
`
`
`- 902 Rai - 902 Rai
`
`
`
`City City
`
`
`
`910 910
`
`
`
`908 908
`
`
`
`-- 904 -- 904
`
`-- 906 -- 906
`
`-
`
`Sequence
`Sequence Sequence
`
`
`
`
`— 108 — 108
`
`
`
`Vault Vault
`
`FIG. 9
`FIG. 9 FIG. 9
`
`
`Page 10 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent (cid:9)
`U.S. Patent
`
`Jan. 30, 2001
`Jan. 30, 2001 (cid:9)
`Jan, 30, 2001
`
`Sheet 10 of 11
`Sheet 10 of 11 (cid:9)
`Sheet 10 of 11 (cid:9)
`
`US 6,181,336 B1
`US 6,181,336 B1
`US 6,181,336 B1
`
`(statD-102
`
`1002
`1002
`
`Start
`Start
`
`•
`
`Design asset types
`Design asset types
`
`r1004
`(-1004
`
`•
`
`Use StudioLib to define
`Use StudioLib to define
`Use StudioLib to define
`asset types
`asset types
`asset types
`
`1006
`1006
`1006
`
`
`
`
`
`•
`•
`Provide cataloging function for
`Provide cataloging function for (cid:9)Provide cataloging function for (cid:9)
`
`filling-in values of each metadata
`filling-in values of each metadata
`filling-in values of each metadata
`field when assets are Created or
`field when assets are created or
`field when assets are created or
`checked-in
`checked-in
`checked-in
`
`1008
`1008
`1008
`
`Provide support code and function
`Provide support code and function
`Provide support code and function
`Calls to the checkin and checkout
`calls to the checkin and checkout (cid:9)
`calls to the checkin and checkout
`Services as required
`services as required
`services as required
`
`-1010
`010
`010
`
`•
`Provide support code and function
`Provide support code and function
`Provide support code and function
`calls to other services (browse,
`calls to other services (browse,
`calls to other services (browse,
`querry, etc.), as required
`querry, etc.), as required
`querry, etc.), as required
`
`•
`•
`Build program and link with progam
`Build program and link with progam
`Build program and link with progam
`resources of the present invention
`resources of the present invention
`resources of the present invention
`
`1012
`1012
`1012
`
`1014
`1014
`1014
`
`Gend D 1016
`
`End)
`(End)
`
`1016
`1016
`
`FIG. 10
`FIG. 10
`FIG. 10
`
`Page 11 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`

`

`
`
`
`
`
`
`1103
`1103
`
`„ /
`(isri
`?uedoid)
`eigel?essy|(
`ZOI I
`
`Object-ID
`Object-ID
`
`String
`String (cid:9)
`
`Integer
`Integer
`
`Object-ID
`Object-ID
`
`Char
`Char
`
`String
`String
`
`V
`
`1102
`
`|-
`
`1104a
`1104a
`
`1104b
`1104b
`
`Asset Table (Property List)
`Asset Table (Property List) /
`
`U.S. Patent
`Waled *S11
`Waled *S11
`
`1106a
`1106a
`String Metadata Table
`String Metadata Table
`
`e90 || || ?
`
`0
`
`1105
`1105
`
`|| || ||
`
`- 1114
`
`108a
`108a
`(cid:9) Ob ID
`
`(cid:9) bb -ID
`108
`108tr
`
`(cid:9),bb -ID
`ID
`
`Bool
`Bool
`
`Long
`Long
`
`* • • • - - - -
`- - - - - - - - - - -
`-},
`
`Jan. 30, 2001
`
`O
`O
`O
`O
`
`O
`O
`
`Sheet 11 of 11
`II JO II lamIS
`II JO II lamIS
`
`HI 9££`-18r9 Sa
`US 6,181,336 B1
`HI 9££`-18r9 Sa
`
`108
`108n
`
`1112
`1112
`
`)0b-ID
`)0b-ID
`
`1116
`1116
`
`—1118
`—1118
`
`(1106b
`(1106b
`Char Metadata Table
`Char Metadata Table
`
`0
`Ob ID
`Ob ID
`
`Ob-ID
`Ob-ID
`
`Ob-ID
`Ob-ID
`
`1104n -
`1104n -
`
`Object-ID
`Object-ID
`
`Float
`Float
`
`Blob
`Blob
`
`Struct
`Struct
`
`Integer Metadata Table
`Integer Metadata Table
`
`1106n
`1106n
`
`Ob-ID
`Ob-ID
`
`Ob-ID
`Ob-ID
`
`Ob-ID
`Ob-ID
`
`FIG. 11
`FIG. 11
`
`Page 12 of 70
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`
`1 1
`1
`DATABASE-INDEPENDENT, SCALABLE,
`
`DATABASE-INDEPENDENT, SCALABLE, DATABASE-INDEPENDENT, SCALABLE,
`OBJECTORIENTED ARCHITECTURE AND
`
`OBJECT-ORIENTED ARCHITECTURE AND OBJECT-ORIENTED ARCHITECTURE AND
`API FOR MANAGING DIGITAL
`
`API FOR MANAGING DIGITAL API FOR MANAGING DIGITAL
`MULTIMEDIA ASSETS
`
`MULTIMEDIA ASSETS MULTIMEDIA ASSETS
`
`BACKGROUND OF THE INVENTION
`BACKGROUND OF THE INVENTION BACKGROUND OF THE INVENTION
`
`
`1. Field of the Invention
`
`1. Field of the Invention 1. Field of the Invention
`The present invention relates generally to management
`
`The present invention relates generally to management The present invention relates generally to management
`and processing of multimedia works and more particularly
`
`and processing of multimedia works and more particularly and processing of multimedia works and more particularly
`to providing a uniform and consistent environment for the
`
`to providing a uniform and consistent environment for the to providing a uniform and consistent environment for the
`orderly development and archival of diverse multimedia
`
`orderly development and archival of diverse multimedia orderly development and archival of diverse multimedia
`WorkS.
`
`works. works.
`2. Related Art
`
`2. Related Art 2. Related Art
`The authoring of multimedia works can be a very
`
`The authoring of multimedia works can be a very The authoring of multimedia works can be a very
`expensive, time consuming and complicated process. Such
`
`expensive, time consuming and complicated process. Such expensive, time consuming and complicated process. Such
`projects can involve huge production teams, enormous
`
`projects can involve huge production teams, enormous projects can involve huge production teams, enormous
`budgets, and the resources of entire production Studios for
`
`budgets, and the resources of entire production studios for budgets, and the resources of entire production studios for
`Significant amounts of time. Such multimedia works not
`
`significant amounts of time. Such multimedia works not significant amounts of time. Such multimedia works not
`only include computerized feature films Such as those pro
`
`only include computerized feature films such as those pro-only include computerized feature films such as those pro-
`duced by major Hollywood studios and the like, but they can
`
`duced by major Hollywood studios and the like, but they can duced by major Hollywood studios and the like, but they can
`also include interactive movies, Video games and other
`
`also include interactive movies, video games and other also include interactive movies, video games and other
`entertainment and educational type content that can run on
`
`entertainment and educational type content that can run on entertainment and educational type content that can run on
`personal computers, dedicated game consoles, kiosk
`
`personal computers, dedicated game consoles, kiosk personal computers, dedicated game consoles, kiosk
`machines and the like. It is becoming more common that the
`
`machines and the like. It is becoming more common that the machines and the like. It is becoming more common that the
`production of Such multimedia titles consume monetary
`
`production of such multimedia titles consume monetary production of such multimedia titles consume monetary
`budgets and other resources not unlike those commonly
`
`budgets and other resources not unlike those commonly budgets and other resources not unlike those commonly
`asSociated with major Hollywood feature film productions.
`
`associated with major Hollywood feature film productions. associated with major Hollywood feature film productions.
`Multimedia data, Such as collections of digital animations
`
`Multimedia data, such as collections of digital animations Multimedia data, such as collections of digital animations
`come in a variety of heterogeneous formats and Structures.
`
`come in a variety of heterogeneous formats and structures. come in a variety of heterogeneous formats and structures.
`Typically, during the creation of a multimedia project, many
`
`Typically, during the creation of a multimedia project, many Typically, during the creation of a multimedia project, many
`different tools and application programs are used to create,
`
`different tools and application programs are used to create, different tools and application programs are used to create,
`edit, and otherwise process various types of multimedia
`
`edit, and otherwise process various types of multimedia edit, and otherwise process various types of multimedia
`data. In general each of the application programs, Such as
`
`data. In general each of the application programs, such as data. In general each of the application programs, such as
`multimedia content authoring tools, operate on particular
`
`multimedia content authoring tools, operate on particular multimedia content authoring tools, operate on particular
`types and/or formats of data. Such types and formats of data
`
`types and/or formats of data. Such types and formats of data types and/or formats of data. Such types and formats of data
`are typically not compatible with all the various application
`
`are typically not compatible with all the various application are typically not compatible with all the various application
`programs used in the production process.
`
`programs used in the production process. programs used in the production process.
`Additionally, each tool generally requires its own unique
`
`Additionally, each tool generally requires its own unique Additionally, each tool generally requires its own unique
`file Structures, hierarchies, and naming conventions, etc., to
`
`file structures, hierarchies, and naming conventions, etc., to file structures, hierarchies, and naming conventions, etc., to
`manage, Store and retrieve data. Each tool may also use
`
`manage, store and retrieve data. Each tool may also use manage, store and retrieve data. Each tool may also use
`different methods to catalog, Search, and preview data.
`
`different methods to catalog, search, and preview data. different methods to catalog, search, and preview data.
`Likewise, each tool may use a different method (or no
`
`Likewise, each tool may use a different method (or no Likewise, each tool may use a different method (or no
`method at all), to track different versions of multimedia data.
`
`method at all), to track different versions of multimedia data. method at all), to track different versions of multimedia data.
`In addition, many tools operate on different computer plat
`
`In addition, many tools operate on different computer plat-In addition, many tools operate on different computer plat-
`forms and environments that are not compatible with each
`
`forms and environments that are not compatible with each forms and environments that are not compatible with each
`other. In a typical shared development process, Such incon
`
`other. In a typical shared development process, such incon-other. In a typical shared development process, such incon-
`Sistencies make it difficult to coordinate and share resources
`
`sistencies make it difficult to coordinate and share resources sistencies make it difficult to coordinate and share resources
`among various members of the development team. In
`
`among various members of the development team. In among various members of the development team. In
`addition, Such inconsistencies make it difficult to catalog and
`
`addition, such inconsistencies make it difficult to catalog and addition, such inconsistencies make it difficult to catalog and
`archive data in an efficient, Safe, and consistent manner.
`
`archive data in an efficient, safe, and consistent manner. archive data in an efficient, safe, and consistent manner.
`Problems arising from Such inconsistencies can be very
`
`Problems arising from such inconsistencies can be very Problems arising from such inconsistencies can be very
`costly.
`
`costly. costly.
`
`
`
`5 5
`
`
`
`10 10
`
`15
`15 15
`
`
`
`
`20 20
`
`25
`25 25
`
`
`
`
`30 30
`
`35
`35 35
`
`
`40
`40 40
`
`
`45
`45 45
`
`
`50
`50 50
`
`
`55
`55 55
`
`
`SUMMARY OF THE INVENTION SUMMARY OF THE INVENTION
`
`SUMMARY OF THE INVENTION
`The present invention is directed toward a System and
`
`The present invention is directed toward a system and The present invention is directed toward a system and
`method for providing a consistent and efficient production
`
`method for providing a consistent and efficient production method for providing a consistent and efficient production
`environment for the development of various types of mul
`
`environment for the development of various types of mul-environment for the development of various types of mul-
`timedia works and for the orderly archiving of the multi
`
`timedia works and for the orderly archiving of the multi- 60 timedia works and for the orderly archiving of the multi- 60
`60
`media works to facilitate their re-use in later projects.
`
`media works to facilitate their re-use in later projects. media works to facilitate their re-use in later projects.
`Examples of multimedia works can include feature anima
`
`Examples of multimedia works can include feature anima-Examples of multimedia works can include feature anima-
`tion films, computer animation films, video games, interac
`
`tion films, computer animation films, video games, interac-tion films, computer animation films, video games, interac-
`tive movies, news clips, educational multimedia products,
`
`tive movies, news clips, educational multimedia products, tive movies, news clips, educational multimedia products,
`corporate multimedia productions, multimedia Sales cata
`
`corporate multimedia productions, multimedia sales cata- 65 corporate multimedia productions, multimedia sales cata- 65
`65
`logs and the like. The present invention assists artists,
`
`logs and the like. The present invention assists artists, logs and the like. The present invention assists artists,
`computer programmers, production managers, editors,
`
`computer programmers, production managers, editors, computer programmers, production managers, editors,
`
`US 6,181,336 B1
`US 6,181,336 B1 US 6,181,336 B1
`
`
`
`2 2
`2
`directors, and producers in tracking and managing all mul
`
`directors, and producers in tracking and managing all mul-directors, and producers in tracking and managing all mul-
`timedia data created and used during the process of multi
`
`timedia data created and used during the process of multi-timedia data created and used during the process of multi-
`media productions and in finding and re-using assets from
`
`media productions and in finding and re-using assets from media productions and in finding and re-using assets from
`previous productions.
`
`previous productions. previous productions.
`Multimedia data, as the term is used herein, includes any
`
`Multimedia data, as the term is used herein, includes any Multimedia data, as the term is used herein, includes any
`and all types of data used to produce any and all types of
`
`and all types of data used to produce any and all types of and all types of data used to produce any and all types of
`multimedia works. Each instance of multimedia data need
`
`multimedia works. Each instance of multimedia data need multimedia works. Each instance of multimedia data need
`not comprise multiple data components or different types of
`
`not comprise multiple data components or different types of not comprise multiple data components or different types of
`media. Indeed multimedia data can comprise data of a Single
`
`media. Indeed multimedia data can comprise data of a single media. Indeed multimedia data can comprise data of a single
`media type. For example, a JPEG data file is an industry
`
`media type. For example, a JPEG data file is an industry media type. For example, a JPEG data file is an