`Case 8:11—cv—01862-DOC-JPR Document 1-3
`Filed 12/02/11 Page1 of 60 Page ID #2105
`
`EXHIBIT 3
`
`EXHIBIT 3
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 2 of 60 Page ID #:106
`Case 8“ "°"'°‘ 862'DOC'JPR D°°”me”‘ 1'3!lllllllllllllflllflllllllllllllllllllfillflllllllllll|lfiIT|||lH|ll‘‘ ‘"3
`
`US005813014A
`
`United States Patent
`
`[19]
`
`[11] Patent Number:
`
`5,813,014
`
`Gustman
`
`[45] Date of Patent:
`
`Sep. 22, 1998
`
`[54] METHOD AND APPARATUS FOR
`MANAGEMENT OF MULTIMEDIA ASSETS
`
`Primary Examiner—Wayne Amsbury
`Assistant Examiner—Diane D. Mizvahi
`
`[75]
`
`Inventor: Samuel Gustman, Santa Monica, Calif.
`
`Attorney, Agent, or Firm—Hecker & Harriman
`
`[57]
`
`ABSTRACT
`
`The invention is a generalized solution for management of
`multimedia assets. Generalized interfaces are used between
`
`a browser component, indexing server, archive server, ter-
`tiary storage manager, and method player components. The
`generalized interface defines a communication protocol that
`can be used by any browser, indexing server, archive server,
`tertiary storage manager, or method player component.
`Thus, system components supplied by multiple vendors can
`be interconnected to form a multimedia system that com-
`municates using the generalized interfaces of the invention.
`A browser component can accept
`input such as search
`requests and display multimedia data. An indexing server
`component includes a data catalogue that catalogues multi-
`media data. The catalogue can be used to identify catalogue
`elements associated with data that can satisfy a search
`request. A search mechanism is used to identify the desired
`multimedia data. A search mechanism can create additional
`
`catalogues that are a subset of the catalogue provided on the
`indexing server. An archive server identifies a tertiary stor-
`age manager that manages the store containing the multi-
`media data. The tertiary storage manager retrieves the cor-
`responding multimedia data from its store and sends it to a
`method play which plays it
`in a display region of the
`browser. The invention retains the content and results of a
`
`search such that it is only necessary to perform a search
`once. Search elements are used to store the content of a
`
`search, i.e., search criteria. A segment element is used to
`store the results of a search.
`
`34 Claims, 24 Drawing Sheets
`
`[73] Assignee: Survivors of the Shoah Visual History
`Foundation, Los Angeles, Calif.
`
`[21] Appl. No.: 678,727
`
`[22]
`
`Filed:
`
`Jul. 10, 1996
`
`Int. Cl.6 .................................................... .. G06F 17/30
`[51]
`[52] U.S. Cl.
`............................ .. 707/103; 707/3; 707/103;
`707/104; 707/102; 707/1; 707/4
`[58] Field of Search ................................... .. 395/615, 284,
`395/285, 806, 701, 601-10, 610-619, 620-29;
`434/500, 308; 707/1, 3, 103, 4, 102, 104
`
`[56]
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`...................... .. 348/552
`3/1993 Graczyk et al.
`8/1993 Reed ............... ..
`707/104
`2/1994 Enberg et al.
`348/141
`..... ..
`2/1994 Glick et al.
`379/93.01
`3/1994 Bernstein et al.
`345/356
`4/1994 MacKay .......... ..
`345/328
`3/1995 Robison et al.
`381/119
`4/1995 Fujisawa . . . . . . . . . . .
`. . . . . . .. 707/4
`6/1995 Baker et al.
`........ ..
`345/335
`7/1995 Dinwiddie, Jr. et al.
`345/133
`7/1995 Bowen et al.
`...... ..
`370/352
`9/1995 Bergen et al.
`......... .. 707/9
`6/1996 Meske, Jr. et al.
`.. 395/200.36
`3/1997 Dockter et al.
`707/102
`5/1997 Braden—Harder ..
`707/102
`7/1997 Antognini et al.
`..... .. 707/9
`7/1997 Ferguson ................................. .. 707/10
`OTHER PUBLICATIONS
`
`
`
`.
`
`5,192,999
`5,241,671
`5,283,638
`5,283,819
`5,297,249
`5,307,456
`5,402,499
`5,404,506
`5,428,730
`5,434,592
`5,436,898
`5,450,581
`5,530,852
`5,608,900
`5,630,121
`5,649,185
`5,649,186
`
`Musei Vaticani, Internet, (http://www.virtual.co.il/orgs/orgs/
`archival/bookintr.htm), pp. 1-10, Dec. 8, 1994.
`The Judaica Archival Project, Internet, (http://www.virtual-
`.co.il.orgs/archiva/bookintrhtm), pp. 1-11, Apr. 1996.
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 3 of 60 Page ID #:107
`Case 8:11-cv—01862-DOC—JPR Document 1-3
`Filed 12/02/11 Page 3 of 60 Page ID #2107
`
`U.S. Patent
`
`Sep.22, 1998
`
`Sheet 1 of 24
`
`5,813,014
`
`106
`
`104
`
`
`
`
`Tertiary
`Storage
`Manager
`
`102
`
`Method
`
`Player
`
`Archive
`Server
`
`110
`
`Index
`Server
`
`108
`
`Client and
`Method
`
`Player
`
`Hewlett Packard
`Hardware Platform
`
`1 18
`
`
`
`Intermedia
`Servher
`
`W It
`Ind
`serve; H Archive Server
`
`
`and
`
`
`Tertiary Storage
`Manager
`
`
`
`1 16
`
`1
`. » « a a « o — o . « a a ¢ . ¢ . . . . . . . . 4 a p — a . o o a — — — . . p — — — - . - . . . . . . . . . — . . p a — — — — . » — o p — . — p — — —¢
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 4 of 60 Page ID #:108
`Case 8:11-cv—01862—DOC-JPR Document 1-3
`Filed 12/02/11 Page 4 of 60 Page ID #2108
`
`U.S. Patent
`
`Sep.22, 1998
`
`Sheet 2 of 24
`
`5,813,014
`
`I 120
`
`Method
`Player
`
`122
`
`134
`
`‘< 136 V
`
`Media
`Server
`
`130
`
`
`
`126
`
`_ Archive
`Server
`
`Index
`Serve’
`
`128
`
`§
`§
`:
`E
`
`:
`
`124 §
`
`5
`
`3
`3
`3
`5
`
`3
`
`138
`
`3 Mainframe
`
`144
`
`7
`
`Processor(s)
`
`Tertiary
`Storage
`/ Manager
`
`150A
`
`3
`
`1
`
`E
`f 148
`5
`140 V
`:\
`
`B
`
`150
`
`150C>/
`
`Index
`Server
`
`"s2i’$;”,°
`
`144
`
`;
`
`;
`
`E
`3
`E
`;
`E
`
`146
`
`
`
`
`. . . . . . . . » . . — - . . . . . . . . . . . . — . . — o o . - v . . . . . . - - a . . . . . . . . . . — . . . . . . . . . . .
`
`.
`
`.
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 5 of 60 Page ID #:109
`Case 8:11—cv—01862-DOC-JPR Document 1-3
`Filed 12/02/11 Page 5 of 60 Page ID #2109
`
`U.S. Patent
`
`Sep.22, 1998
`
`Sheet 3 of 24
`
`5,813,014
`
`Method
`Player
`
`5
`
`5
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 6 of 60 Page ID #:110
`Case 8:11-cv—01862-DOC-JPR Document 1-3
`Filed 12/02/11 Page 6 of 60 Page ID #:110
`
`U.S. Patent
`
`Sep.22, 1998
`
`Sheet 4 of 24
`
`5,813,014
`
`219
`
`216
`
`1/0
`
`VIDEO AMP
`
`CRT
`
`213
`
`214
`
`CPU
`
`VIDEO MEMORY
`
`MAIN MEMORY
`
`218
`
`210
`
`KEYBOARD
`
`MOUSE
`
`2“
`
`MASS STORAGE
`
`217
`
`215
`
`212
`
`FIG. 2
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 7 of 60 Page ID #:111
`Case 8:11—cv—01862—DOC-JPR Document 1-3
`Filed 12/02/11 Page 7 of 60 Page ID #2111
`
`U.S. Patent
`
`Sep.22, 1998
`
`Sheet 5 of 24
`
`5,813,014
`
`313
`
`310
`Browse: +1“ Method
`
`Player
`
`314 V f 312
`
`316
`
`Indexing
`Server
`
`302
`
`Archive
`Server
`
`306
`
`FIG. 3
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 8 of 60 Page ID #:112
`Case 8:11—cv—01862—DOC-JPR Document 1-3
`Filed 12/02/11 Page 8 of 60 Page ID #2112
`
`U.S. Patent
`
`Sep.22, 1998
`
`Sheet 6 of 24
`
`5,813,014
`
`1211112:
`
`input data ID
`ID
`descriptive phrase
`In/Out Timemdes
`setflceywords)
`setfinuges)
`set(persons)
`set(pmposed keywords)
`se£(proposed persons)
`
`5
`t
`JEMEL
`ID
`desgfipf-[pg phrase
`sgfiphrgsgs)
`
`K_e1cym£
`ID
`sel(types)
`semhesaural keywords)
`se!(parmt keywords)
`sef(du'ld keywords)
`se!(proposed keywords)
`
`In/Out Tirneaodes
`comment
`
`£8750?!
`ID
`Primary Name
`Occupation
`Date of Birth
`set(proposed persons)
`
`424
`
`
` Ea-ogosed Person
`
`ID
`Name
`
`Characteristic
`
`
`Name
`Preflzrred Flag
`
`keyword ID
`Label
`Language of Choice
`Preferred Flag
`
`babel
`
`Image / Video
`ID
`In/Out Tirnecadzs
`Locnior
`
`
`
`M
`Person ID
`
`Person Attribute
`
`FIG. 4A
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 9 of 60 Page ID #:113
`Case 8:11-cv—01862-DOC-JPR Document 1-3
`Filed 12/02/11 Page 9 of 60 Page ID #:113
`
`U.S. Patent
`
`Sep.22, 1998
`
`Sheet 7 of 24
`
`5,813,014
`
` Proposed
`
`438
`
`Keyword
`
`412
`
`
`
`Thesaural
`
`Keyword
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 10 of 60 Page ID
` #:114
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 11 of 60 Page ID
` #:115
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 12 of 60 Page ID
` #:116
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 13 of 60 Page ID
` #:117
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 14 of 60 Page ID
` #:118
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 15 of 60 Page ID
` #:119
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 16 of 60 Page ID
` #:120
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 17 of 60 Page ID
` #:121
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 18 of 60 Page ID
` #:122
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 19 of 60 Page ID
` #:123
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 20 of 60 Page ID
` #:124
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 21 of 60 Page ID
` #:125
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 22 of 60 Page ID
` #:126
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 23 of 60 Page ID
` #:127
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 24 of 60 Page ID
` #:128
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 25 of 60 Page ID
` #:129
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 26 of 60 Page ID
` #:130
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 27 of 60 Page ID
` #:131
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 28 of 60 Page ID
` #:132
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 29 of 60 Page ID
` #:133
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 30 of 60 Page ID
` #:134
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 31 of 60 Page ID
` #:135
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 32 of 60 Page ID
` #:136
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 33 of 60 Page ID
` #:137
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 34 of 60 Page ID
` #:138
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 35 of 60 Page ID
` #:139
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 36 of 60 Page ID
` #:140
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 37 of 60 Page ID
` #:141
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 38 of 60 Page ID
` #:142
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 39 of 60 Page ID
` #:143
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 40 of 60 Page ID
` #:144
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 41 of 60 Page ID
` #:145
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 42 of 60 Page ID
` #:146
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 43 of 60 Page ID
` #:147
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 44 of 60 Page ID
` #:148
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 45 of 60 Page ID
` #:149
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 46 of 60 Page ID
` #:150
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 47 of 60 Page ID
` #:151
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 48 of 60 Page ID
` #:152
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 49 of 60 Page ID
` #:153
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 50 of 60 Page ID
` #:154
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 51 of 60 Page ID
` #:155
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 52 of 60 Page ID
` #:156
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 53 of 60 Page ID
` #:157
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 54 of 60 Page ID
` #:158
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 55 of 60 Page ID
` #:159
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 56 of 60 Page ID
` #:160
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 57 of 60 Page ID
` #:161
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 58 of 60 Page ID
` #:162
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 59 of 60 Page ID
` #:163
`
`
`
`Case 8:11-cv-01862-DOC-JPR Document 1-3 Filed 12/02/11 Page 60 of 60 Page ID
` #:164