11!11111111111111111111111111 11!11111111111111111111111111
`1,111,11
`
`
`
`11111111111111111111111111f111j011111111111111111111111111f111j0
`
`88
`US005832495A
`[11] Patent Number:
`
`[n] (cid:9) Patent Number: (cid:9)[n] (cid:9) Patent Number: (cid:9)
`
`[45] (cid:9) Date of Patent: (cid:9)[45] (cid:9) Date of Patent: (cid:9)
`[45] Date 0f Patent:
`
`
`5,832,495 5,832,495
`5,832,495
`
`Nov. 3, 1998 Nov. 3, 1998
`Nov. 3, 1998
`
`91
`91
`
`.
`
`
`United States Patent [19] United States Patent [19]
`Ulllted States Patent [19]
`
`Gustman Gustman
`Gustman
`
`
`[54] METHOD AND APPARATUS FOR [54] METHOD AND APPARATUS FOR
`[54] METHOD AND APPARATUS FOR
`
`CATALOGUING MULTIMEDIA DATA CATALOGUING MULTIMEDIA DATA
`CATALOGUING MULTIMEDIA DATA
`
`[75] Inventor: Samuel Gustman, Santa Monica, Calif.
`
`[75] Inventor: Samuel Gustman, Santa Monica, Calif. [75] Inventor: Samuel Gustman, Santa Monica, Calif.
`
`
`[73] Assignee: Survivors of the Shoah Visual History [73] Assignee: Survivors of the Shoah Visual History
`
`Assigneez Survivors of the Shoah Visual History Foundation LOSAn eles Calif
`
`Foundation, Los Angeles, Calif. Foundation, Los Angeles, Calif.
`>
`g
`>
`"
`
`Jul. 8, 1996 Jul. 8, 1996
`
`Jul- 3, 1996
`
`[21] Appl. No.: 680,504 [21] Appl. No.: 680,504
`
`[21] Appl. No.: 680,504
`_
`
`[22] Filed: (cid:9)[22] Filed: (cid:9)
`[22]
`P116011
`
`
`[51] Int. C1.6 [51] Int. C1.6
` GO6F 17/30 GO6F 17/30
`[51] Int. Cl.6 .................................................... .. G06F 17/30
`
`[52] U.S. Cl. (cid:9)[52] U.S. Cl. (cid:9)
`
` 707/102; 707/104 707/102; 707/104
`[52] US. Cl. ........................................... .. 707/102; 707/104
`
`[58] Field of Search (cid:9)[58] Field of Search (cid:9)
`
` 395/60, 61, 62; 395/60, 61, 62;
`[58] Field of Search ................................ .. 395/60, 61, 62;
`707/102, 104
`
`707/102, 104 707/102, 104
`
`[56] (cid:9)[56] (cid:9)
`
`[56]
`
`_
`
`References Cited References Cited
`References Clted
`Us‘ PATENT DOCUMENTS
`
`U.S. PATENT DOCUMENTS U.S. PATENT DOCUMENTS
`
`
`
`
`6/1992 Beitel et al. (cid:9)6/1992 Beitel et al. (cid:9)
`
`395/807 395/807
`
`5,119,474 5,119,474
`6/1992 Beitel et al. .......................... .. 395/807
`5,119,474
`
`6/1992 Trautman (cid:9)6/1992 Trautman (cid:9)
`
`
`
`395/140 395/140
`
`5,121,470 5,121,470
`6/1992 Tfautman ----- ~~
`- 395/140
`5,121,470
`
`6/1992 Kasahara et al. (cid:9)6/1992 Kasahara et al. (cid:9)
`
`
`
`395/357 395/357
`
`5,123,088 5,123,088
`6/1992 Kesahara et al'
`- 395/357
`571237088
`
`5/1993 Shimada et al. (cid:9)5/1993 Shimada et al. (cid:9)
`
`5,210,868 5,210,868
`
`
`
`395/615 395/615
`5210368 5/1993 Shlmada et a1‘
`' 395/615
`
`5,241,671 5,241,671
`
`8/1993 Reed et al. (cid:9)8/1993 Reed et al. (cid:9)
`
`
`
`395/615 395/615
`5,241,671
`8/1993 Reed et al. ............................ .. 395/615
`.
`
`5,274,758 12/1993 Beitel et al. (cid:9)5,274,758 12/1993 Beitel et al. (cid:9)
`
`
`
`395/807 395/807
`5,274,758 12/1993 Beitel et al. .......................... .. 395/807
`572787946
`1/1994 Shimada etaL
`395/62
`
`5,278,946 5,278,946
`
`1/1994 Shimada et al. (cid:9)1/1994 Shimada et al. (cid:9)
`
`
`
`395/62 395/62
`572807573
`1/1994 Kuga et a1_
`_ 395/338
`
`395/338 395/338
`
`5,280,573 5,280,573
`
`1/1994 Kuga et al. (cid:9)1/1994 Kuga et al. (cid:9)
`
`
`5’303’296
`4/1994 Zucker _____ __
`379/67
`
`379/67 379/67
`
`5,303,296 5,303,296
`
`4/1994 Zucker (cid:9)4/1994 Zucker (cid:9)
`
`
`
`4/1995 Fujisawa et al. (cid:9)4/1995 Fujisawa et al. (cid:9)
`
`
`
`395/604 395/604
`
`5,404,506 5,404,506
`5,404,506
`4/1995 Fujisawa et al.
`. 395/604
`
`5,408,655 5,408,655
`
`4/1995 Oren et al. (cid:9)4/1995 Oren et al. (cid:9)
`
`
`
`395/601 395/601
`5,408,655
`4/1995 Oren et al. ............................ .. 395/601
`
`
`
`
`5/1995 Seaman et al. (cid:9)5/1995 Seaman et al. (cid:9)
`
`5,414,644 5,414,644
`
`395/551.01 395/551.01
`5/1995 Seaman et al. .................. .. 395/551.01
`5,414,644
`
`6/1995 Takahashi et al. (cid:9)6/1995 Takahashi et al. (cid:9)
`
`
`
`395/612 395/612
`
`5,428,774 5,428,774
`6/1995 Takahashi et al. ..
`395/612
`5,428,774
`
`5,461,611 10/1995 Drake, Jr. et al. (cid:9)5,461,611 10/1995 Drake, Jr. et al. (cid:9)
`
`
`
`370/420 370/420
`5,461,611 10/1995 Drake, Jr. et al. ..
`370/420
`
`5,493,677 5,493,677
`
`2/1996 Balogh et al. (cid:9)2/1996 Balogh et al. (cid:9)
`
`
`
`395/615 395/615
`574937677
`2/1996 Balogh et a1
`-- 395/615
`
`5,515,490 5,515,490
`
`5/1996 Buchanan et al. (cid:9)5/1996 Buchanan et al. (cid:9)
`
`
`
`345/302 345/302
`5,515,490
`5/1996 Buchanan et al.
`345/302
`
`5,608,900 5,608,900
`
`3/1997 Dockter et al. (cid:9)3/1997 Dockter et al. (cid:9)
`
`
`
`395/613 395/613
`
`5,608,900 5,615,112
`
`3/1997 Dockter et al. ....................... .. 3/1997 Sheng et al.
`395/615
`
`5,615,112 5,615,112
`
`3/1997 Sheng et al. (cid:9)3/1997 Sheng et al. (cid:9)
`
`
`
`395/615 395/615
`
`5,617,119 5,617,119
`
`4/1997 Briggs et al. (cid:9)4/1997 Briggs et al. (cid:9)
`
`
`
`395/611 395/611
`5,617,119
`4/1997 Briggs et al. ......................... .. 395/611
`
`5/1997 Braden-Harder et al. (cid:9)5/1997 Braden-Harder et al. (cid:9)
`
` 395/604 395/604
`
`5,630,121 5,630,121
`5,630,121
`5/1997 Braden-Harder et al. ............ .. 395/604
`
`5,630,125 5,630,125
`
`5/1997 Zellweger (cid:9)5/1997 Zellweger (cid:9)
`
`
`
`395/614 395/614
`. . . . . .. 395/614
`5,630,125
`5/1997 Zellweger . . . . . . . . . . . . . .
`
`5,682,330 10/1997 Seaman et al. (cid:9)5,682,330 10/1997 Seaman et al. (cid:9)
`
`
`
`364/551.01 364/551.01
`5,682,330 10/1997 Seaman et al.
`. 364/551.01
`5,724,605
`3/1998 Wissner
`.. 395/806
`
`5,724,605 5,724,605
`
`3/1998 Wissner (cid:9)3/1998 Wissner (cid:9)
`
`
`
`395/806 395/806
`
`Primary Examiner—Wayne Amsbury
`
`Primary Examiner—Wayne Amsbury Primary Examiner—Wayne Amsbury
`
`Attorney, Agent, or Firm—Hecker & Harriman Attorney, Agent, or Firm—Hecker & Harriman
`Attorney, Agent, or Firm—Hecker & Harriman
`57
`ABSTRACT
`
`
`[57] (cid:9)[57] (cid:9)
`ABSTRACT ABSTRACT
`[
`1
`
`The invention catalogues data such as multimedia data. A The invention catalogues data such as multimedia data. A
`The invention catalogues data such as multimedia data. A
`catalogue is a collection of one or more catalogue elements.
`
`catalogue is a collection of one or more catalogue elements. catalogue is a collection of one or more catalogue elements.
`
`An index is used to access a catalogue. An element of a An index is used to access a catalogue. An element of a
`An index is used to access a 'catalogue. An' element of a
`
`catalogue has one or more attributes. An attribute provides catalogue has one or more attributes. An attribute provides
`catalogue has one or more attributes. An attribute provides
`
`information that can be used to search for, answer questions information that can be used to search for, answer questions
`information that can be used to search for, answer questions
`
`about, and navigate through a catalogue. An attribute of a about, and navigate through a catalogue. An attribute of a
`about, and navigate through a catalogue. An attribute of a
`
`catalogue element can be an element that has attributes. A catalogue element can be an element that has attributes. A
`catalogue element can be an element that has attributes. A
`catalogue element attribute that is an element is referred to
`
`catalogue element attribute that is an element is referred to catalogue element attribute that is an element is referred to
`.
`.
`.
`
`as an attribute element. Attribute elements and attributes are as an attribute element. Attribute elements and attributes are
`as an attribute element. Attribute elements and attributes are
`d b .ld
`. d
`h
`b
`d f .1.
`1
`
`used to build an index that can be used to facilitate catalogue used to build an index that can be used to facilitate catalogue
`use to ur ~an1n eXt at can euse to ac1 itate cata ogue
`
`access. Within a catalogue, smaller catalogues can be cre-access. Within a catalogue, smaller catalogues can be cre-
`access. Within a catalogue, smaller catalogues can be cre
`
`ated by, for example, querying and user designation. ated by, for example, querying and user designation.
`ated by, for example, querying and user designation.
`
`29 Claims, 34 Drawing Sheets 29 Claims, 34 Drawing Sheets
`
`29 Claims, 34 Drawing Sheets
`
`, 204
`
`r 204
`
`/ % Segment
`250
`
`Segment
`
`A
`
`228 \
`
`f 206
`
`Phrase
`
`232 \
`
`230 \
`
`210
`/
`
`220
`,/
`
`224
`/
`
`218
`I/
`
`244
`\
`
`242 \
`
`234
`
`214
`/
`
`238
`
`2/12
`
`Thesaural
`Keyword
`
`2/10
`
`Keyword
`
`236
`
`2/26
`
`2/16
`
`2/22
`
`T e
`yp
`
`Thesaural
`Person
`
`Person I
`
`Person Person
`Information
`
`Information Information
`
`246 \
`‘y
`
`216
`'/
`
`Type
`
`Page 1 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`waled °S11
`waled °S11
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 1 0f 34
`tc Jo 1 13311S
`tc Jo 1 13311S
`
`5,832,495
`
`BHH
`
`VIDEO AMP
`VIDEO AMP
`
`CRT
`CRT
`
`VIDEO MEMORY
`VIDEO MEMORY
`
`MAIN MEMORY
`MAIN MEMORY
`
`112
`/
`
`118
`
`\H
`
`v
`
`MASS STORAGE
`MASS STORAGE
`
`HHH
`
`$02 % Q:
`
`MOUSE
`MOUSE
`
`m
`
`Figure 1
`Figure 1
`
`H wHSwE
`
`119
`119
`
`113
`113
`
`mHH
`
`m _H
`
`CPU
`CPU
`
`v
`v
`KEYBOARD
`KEYBOARD
`
`Page 2 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`juajud *ST1
`llialUd *S11
`
`t
`(cid:9)z loollS
`17£ Jo Z laaqS
`
`204
`204
`
`206
`206
`
`208
`208
`
`210
`210
`
`212
`212
`
`216
`216
`
`214
`214
`/
`Proposed
`Proposed
`Keyword
`Keyword
`
`218
`218
`
`220
`220
`
`222
`222
`
`226
`226
`
`224
`224
`/
`Proposed
`Proposed
`Person
`Person
`
`Figure 2A
`Figure 2A
`
`Page 3 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent (cid:9)
`U.S. Patent
`
`Nov. 3, 1998
`Nov. 3, 1998 (cid:9)
`Nov. 3, 1998 (cid:9)
`
`Sheet 3 0f 34
`Sheet 3 of 34 (cid:9)
`Sheet 3 of 34 (cid:9)
`
`5,832,495
`5,832,495
`5,832,495
`
` 204
` 204
`
`Segment “_7_» Segment
`Segment
`Segment
`250
`
`228 i T
`
`/ 206
`
`Phrase
`
`230
`
`232 \
`
`214
`214
`214
`l/
`/
`/
`Proposed
`Proposed
`Proposed
`Keyword
`Keyword
`Keyword
`
`210
`210
`,/
`/
`Ke word
`Keyword
`y
`
`220
`220
`220
`l/
`Image/
`Video
`
`224
`/
`Proposed
`Proposed
`Proposed
`Person
`Person
`Person
`
`218
`,/
`
`Person
`
`238
`238
`
`i
`
`212
`/
`/
`Thesaural
`Thesaural
`Keyword
`Keyword
`
`244
`
`242 N
`
`/
`
`Keyword
`Keyword
`d
`K
`eywor
`
`234
`
`../- 236
`_/- 236
`236
`
`216
`216
`V /
`
`Type
`Type
`
`222
`/ r
`
`Thesaural
`Person
`
`226
`226
`226
`/
`V
`V
`/
`/
`Person
`Person
`Person
`Information
`Information
`Information
`
`246
`246
`246
`
`216
`216
`216
`/
`1
`1
`
`Type
`Type
`Type
`
`Figure 2B
`Figure 2B
`Figure 2B
`
`Page 4 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`waled °S11
`waled °S11
`
`I (cid:9)
`I (cid:9)
`Tn-1
`Tn-1
`1
`I
`
`
`Pn T n
`Pn Tn
`/
`1
`i
`/
`274
`274
`
`282
`282
`/
`/
`
`284
`284
`/
`/
`
`S2
`S2
`
`I (cid:9)
`I
`T4
`T4
`I
`I
`
`P5
`P5
`
`/
`/
`268
`268
`
`1 (cid:9)
`1
`P6
`T5 P6 T6
`T5
`T6
`I
`1
`/
`I
`/
`I
`270
`270
`
`P7
`P7
`
`/
`
`/
`272
`272
`
`1
`T7
`T7
`1
`I
`
`S3
`S3
`
`4 (cid:9) 4 (cid:9) 4
`4 (cid:9) 4 (cid:9) 4
`
`280
`280
`/
`/
`
`S1
`S1
`
`TO
`TO
`
`258
`258
`
`I (cid:9)
`P2 (cid:9)
`P1
`P1 Ti P2
`
`I (cid:9)
`
`/
`/ (cid:9)
`260
`260 (cid:9)
`
`/
`/ (cid:9)
`262
`262 (cid:9)
`
`I
`I (cid:9)
`P3
`T2
`T2 P3
`1
`I (cid:9)
`
`/
`/ (cid:9)
`264
`264 (cid:9)
`
`T3
`T3
`1
`I (cid:9)
`
`P4
`P4
`
`/
`/
`266
`266
`
`tc JO 17 lamIS
`tc JO 17 lamIS
`
`Chapter Segment = (cid:9)
`Chapter Segment = (cid:9)
`
`P1+P2+P3
`P1+P2+P3
`P4 + P5
`P4 + P5
`P6+P7+...+Pn
`P6+P7+...+Pn
`
`Testimony Segment = S1 + S2 + S3
`Testimony Segment = S1 + S2 + S3
`
`General Segment = P1 + P4 + P5 + P6 + Pn
`General Segment = P1 + P4 + P5 + P6 + Pn
`
`Figure 2C
`Figure 2C
`
`Page 5 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`waled °S11
`waled °S11
`
`tc Jo s lamIS
`tc Jo s lamIS
`
`Segment
`Segment
`ID
`ID
`descriptive phrase
`descriptive phrase
`set(phrases)
`set(phrases)
`
`204
`204
`/
`/
`
`Phrase
`Phrase
`input data ID
`input data ID
`ID
`ID
`descriptive phrase
`descriptive phrase
`In/Out Timecodes
`In/Out Timecodes
`set(keywords)
`set(keywords)
`set(images)
`set(images)
`set(persons)
`set(persons)
`set(proposed keywords)
`set(proposed keywords)
`set(proposed persons)
`set(proposed persons)
`
`210
`210
`
`Type
`Type
`ID
`ID
`Label
`Label
`
`Keyword
`Keyword
`ID
`ID
`set(types)
`set(types)
`set(thesaural keywords)
`set(thesaural keywords)
`set(parent keywords)
`set(parent keywords)
`set(child keywords)
`set(child keywords)
`set(proposed keywords)
`set(proposed keywords)
`
`206
`206
`/
`/
`
`216
`216
`/
`/
`
`208
`208
`
`218
`218
`
`/
`/
`
`Event
`Event
`ID
`ID
`type
`type
`sub-type
`sub-type
`In/Out Timecodes
`In/Out Timecodes
`comment
`comment
`
`Person
`Person
`ID
`ID
`Primary Name
`Primary Name
`Occupation
`Occupation
`Date of Birth
`Date of Birth
`set(proposed persons)
`set(proposed persons)
`
`Person
`Person
`
`
`ID
`
`ID
`Name
`Name
`
`Preferred Preferred Flag
`
`Preferred Preferred Flag
`
`222 (cid:9)
`222 (cid:9)
`Thesaural Keyword
`Thesaural Keyword
`ID
`ID
`keyword ID
`keyword ID
`Label
`Label
`Language of Choice
`Language of Choice
`Preferred Flag
`Preferred Flag
`Characteristic
`Characteristic
`
`Image / Video
`Image / Video
`ID
`ID
`In/Out Timecodes
`In/Out Timecodes
`Locator
`Locator
`
`
` 220
`
` 220
`
`Person Information
`Person Information
`Person ID
`Person ID
`Person Attribute
`Person Attribute
`
` 212
` 212
`
`Proposed Keyword
`Proposed Keyword
`ID
`ID
`Label
`Label
`
`214
`214
`
`Proposed Person (cid:9)
`Proposed Person (cid:9)
`ID
`ID
`Name
`Name
`
`/
`/
`
`1
`1
`
`226
`226
`
`C
`r
`
`Figure 2D
`Figure 2D
`
`Page 6 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`waled °S11
`waled °S11
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 6 0f 34
`tc JO 9 laaqS
`tc JO 9 laaqS
`
`5,832,495
`
`mmmm
`
`<mmm
`
`297B
`297B \\
`297A \_
`297A \\
`
`296C
`296C
`296B
`296B
`296A
`296A
`
`Doom
`
`momm
`
`<wo~
`
`Thesaural
`Thesaural
`Keyword Four
`Keyword Four
`
`Sow
`EQEAQM
`19:53: P
`
`Thesaural
`Thesaural
`Keyword Three
`Keyword Three
`
`mask
`EQEKAQM
`12:63: H
`
`Thesaural
`Thesaural
`Keyword Two
`Keyword Two
`
`H3539:
`
`03F
`“3956M
`
`@50
`$635M
`18:32; P / @wN
`
`Thesaural
`Thesaural
`Keyword One
`Keyword One
`
`286 -
`286 -
`
`291E
`291E
`291D
`291D
`291C
`291C
`291B
`291B
`291A
`291A
`
`mam
`
`DHmN
`
`UHQN
`
`mam
`
`12mm
`
`Doom
`www
`
`288
`288
`
`meow
`8% /
`
`290D
`290D
`290C
`290C
`290B
`290B
`290A
`290A
`
`Keyword
`Keyword
`Instance
`Instance
`One
`One
`
`@GO
`
`13mm
`3535M
`@2835
`
`Figure 2E
`Figure 2E
`
`mm 25%
`
`mmmm
`
`<mmm
`
`294B
`294B
`294A \..
`294A \..
`
`mwmm
`
`Keyword
`Keyword
`Instance
`Instance
`Two
`Two
`
`SVQN
`2953M
`@3855
`
`03%
`
`Page 7 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`waled 'S11
`waled 'S11
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 7 0f 34
`17£ JO L laaqS
`17£ JO L laaqS
`
`5,832,495
`
`302
`302
`
`Nom
`
`/
`/
`
`Sm
`
`mom
`
`gm
`
`I
`
`oom wcm
`
`\
`
`Tco?mwsmi _
`
`5 + _
`
`3m 2m 2m
`
`mom
`0cm 0% win,
`
`H E — wcwamwm _ —ww.52\w~2w?_
`
`\ \
`
`2m
`
`Figure 3A
`Figure 3A
`
`Page 8 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`waled °S11
`waled °S11
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 8 0f 34
`tc Jo 8 lamIS
`tc Jo 8 lamIS
`
`CA
`CA
`00
`00
`CA)
`CA)
`IN
`IN
`
`5,832,495
`
`itZ
`itZ
`CA
`CA
`
`304
`304
`/
`/
`
`wow
`
`334N
`334N
`
`Zuwmm
`
`306
`306
`L.
`L.
`
`wow
`
`334A
`334A
`
`327
`327
`
`umm
`
`• • •
`• • •
`
`322 (cid:9)
`322 (cid:9)
`
`mmm
`
`g 43m
`
`1\41
`1\41
`
`01•1101111•1••1110."
`11\
`11\
`01•1101111•1••1110."
`0•00,
`0•00,
`
`304A
`304A
`
`326 1 (cid:9)
`326 1 (cid:9)
`
`327 /
`327 /
`
`\ mmm
`
`325 / (cid:9)
`325 / (cid:9)
`
`322 i
`322 i
`
`323 1 (cid:9)
`323 1 (cid:9)
`
`324
`324
`
`Figure 3B
`Figure 3B
`
`mm 25mm
`
`Page 9 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`juajud *ST1
`wawa °S.11
`
`17£ Jo 6 loollS
`17£ Jo 6 laaqS
`
`340
`340
`
`310
`310
`
`342
`342
`/2
`/2
`
`0
`0
`
`I>
`I>
`
`444
`
`4<I
`
`44
`44
`
`PO
`
`COO
`
`344
`344
`
`346
`346
`
`348
`348
`
`Figure 3C
`Figure 3C
`
`Page 10 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`waled °S11
`waled °S11
`
`17£ JO OT laaqS
`17£ JO OT laaqS
`
`314
`314
`
`/
`
`350C
`.../ 350C
`i
`
`350A
`350A
`2,
`
`21 / 354
`
`/ 354
`.
`.
`a
`a
`b
`b
`c
`c
`d
`d
`e
`e
`f
`f
`g
`g
`h
`h
`i
`i
`j
`j
`k
`k
`1
`1
`m
`m
`n
`n
`0
`0
`P
`P
`q
`q
`r
`r
`s
`s
`t
`t
`u
`u
`v
`v
`w
`w
`x
`x
`Y
`Y
`z
`z
`
`< AA
`< AA
`
`350D
`350D
`/
`/
`
`Figure 3D
`Figure 3D
`
`> If
`> If
`
`350B
`350B
`
`Keyword Alphabetical
`Keyword Alphabetical
`
`Keyword
`Keyword
`
`Type
`Type
`
`352
`352
`
`•
`•
`
`war crimes (cid:9)
`war crimes (cid:9)
`
`Chasidim (cid:9)
`Chasidim (cid:9)
`
`Hasidic Jews (cid:9)
`Hasidic Jews (cid:9)
`
`Germany (cid:9)
`Germany (cid:9)
`
`354A
`354A
`
`354B
`354B
`
`354C
`354C
`
`354D
`354D
`
`354E
`354E
`
`354F
`354F
`
`A
`A
`
`'''
`'''
`
`356A \ N
`356A \ N
`
`356B
`356B
`
`war crimes
`war crimes
`
`" Jews
`" Jews
`356C N
`356C N
`\• Jewish religion
`\• Jewish religion
`356D N
`356D N
`\ country
`\ country
`
`\.- world (cid:9)
`\.- world (cid:9)
`\., (cid:9)
`\., (cid:9)
`
`World War II (cid:9)
`World War II (cid:9)
`
`356E
`356E
`
`356F
`356F
`
`\ (cid:9)
`\ (cid:9)
`
`1 p ace
`1 p ace
`
`\. war
`\. war
`
`350E
`350E
`
`Page 11 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`waled °S11
`waled °S11
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 11 0f 34
`tc Jo IT 13311S
`tc Jo IT 13311S
`
`Pre-war Family Life (cid:9)
`Pre-war Family Life (cid:9)
`
`316
`316
`
`360
`360
`
`362
`362
`
`364
`364
`
`366
`366
`
`368
`368
`
`370
`370
`
`Pre-war Family Life
`Pre-war Family Life
`1 (cid:9) Born December 5, 1924, in Lodz... (cid:9)
`1 (cid:9) Born December 5, 1924, in Lodz... (cid:9)
`
`'`- (cid:9)
`'`- (cid:9)
`
`01:00:00:00 01:08:48:21 brothers *homes*sisters (cid:9) dating life
`01:00:00:00 01:08:48:21 brothers *homes*sisters (cid:9) dating life
`
`Start
`Start
`
`End
`End
`
`Keywords
`Keywords
`
`Proposed
`Proposed
`
`2 (cid:9) Family was happy. Parents were... 01:08:48:21 01:12:49:15 behavior * students (cid:9)
`2 (cid:9) Family was happy. Parents were... 01:08:48:21 01:12:49:15 behavior * students (cid:9)
`
`teachers * child
`teachers * child
`
`V
`V
`
`,.... (cid:9)
`,.... (cid:9)
`
`3
`3
`
`I 9,;
`EQEwQm l/
`
`Segment Two
`Segment Two
`
`< II
`< II
`
`372A
`372A
`374A
`374A
`
`374B
`374B
`
`mwmm
`
`374C
`374C
`
`372B
`372B
`
`CA
`CA
`'00
`'00
`C..o4
`C..o4
`IN
`IN
`
`5,832,495
`
`itZ
`itZ
`CA
`CA
`
`Figure 3E
`Figure 3E
`
`mm 2:5
`
`Page 12 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`Pined *S'il
`Juaied *S.11
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 12 0f 34
`17£ Jo Z1 1331IS
`17£ Jo Z1 looqS
`
`5,832,495
`
`308
`308
`/
`/1
`
`mom
`
`388
`388
`.
`
`wwm
`
`Other
`Other
`
`$50
`
`CD
`CD
`
`386
`386
`.
`.
`
`Fact
`Fact
`w
`w
`
`Figure 3F
`Figure 3F
`
`mm 2&5
`
`384
`384
`
`wwm
`
`382
`382
`•
`•
`
`Videographer
`Videographer
`
`Interviewer
`Interviewer
`
`$32535
`
`EEEEEE
`
`4 ?
`4 ?
`
`L„,
`L„,
`
`+ ?
`i+ ?
`
`,,,,
`L,,,
`
`Page 13 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`wawa °S.11
`juajud *ST1
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 13 0f 34
`17£ Jo CT 13311S
`tc JO cI 13311S
`
`5,832,495
`
`416
`416
`
`\
`
`A
`A
`
`,,.
`
`418
`418
`
`V
`V
`
`>
`
`A
`A
`
`<
`
`V
`V
`
`> ‘ II
`
`>
`>
`
`< 00 (cid:9)
`< 00 (cid:9)
`
`V
`V
`
`>
`>
`
`A
`A
`=
`-.&.
`
`4
`
`V
`V
`
`>
`
`>
`>
`
`Preferred Term
`Preferred Term
`
`> A g V
`
`Figure 4 (cid:9)
`Figure 4 (cid:9)
`
`M \ N?
`A 2 _v
`
`< 00
`<
`00
`
`ESP
`wwmD
`Eo>>
`wwiwwmhm
`
`Word Used (cid:9)
`Word Used (cid:9)
`
`.
`
`412
`412
`
`< 00
`< 05
`
`V
`V
`
`>
`>
`
`j (cid:9)
`j (cid:9)
`
`414
`414
`
`A ‘ _ g _V
`
`\?w w w?ami
`
`A
`A
`,-,
`
`IQ.
`
`V
`V
`
`< IR
`< OR
`
`>
`>
`
`__ _ _
`203x31
`\EBEBE
`9935M
`wwmomoi
`EQEEQU
`
`Keyword
`Keyword
`
`A
`A
`
`<
`
`.,'
`
`< / N2“
`
`1
`
`402
`402
`
`
`
`1 Keyword from Hilite
`1 Keyword from Hilite
`New Keyword
`New Keyword
`
`\ U25; E 8%
`
`404
`404
`
`Type
`Type
`
`Keywords for this Phrase
`Keywords for this Phrase
`
`warp _ wmmbE 25 How $835M
`
`m3“ @o% 2.: w U M
`wow
`
`Comment
`Comment
`
`a M \ w?
`
`@Sv A _ g _ V
`
`< (cid:9)
`< (cid:9)
`
`10
`10
`
`Proposed Keyword (cid:9)
`Proposed Keyword (cid:9)
`
`408
`408
`
`•
`
`< I.
`Q?
`
`m \
`
`410
`410
`
`Proposed Item
`Proposed Item
`
`\ Em:
`womoaoi
`
`A _ _ €_V >
`
`Type
`Type
`
`was?
`2033M
`l
`
`M >
`
`Keyword Hierarchy
`Keyword Hierarchy
`
`Page 14 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`waled °S11
`U.S. Patent
`waled °S11
`
`Nov. 3, 1998
`
`tc JO 17I lamIS
`tc JO 17I lamIS
`Sheet 14 0f 34
`
`5,832,495
`
`516
`516
`2
`2
`Did the interviewer appear on camera
`Did the interviewer appear on camera
`and properly introduce him/herself,
`and properly introduce him/herself,
`the interviewee, and the interview?
`the interviewee, and the interview?
`
`@553 co Emma?
`326E535 m5 ED
`H
`\ \ \ 2m Sm Sm
`
`QSEZBE
`9%. ES dwEEiBE m5
`
`518 520
`518 520
`
`Yes
`Yes
`
`No
`No
`
`A
`A
`
`520
`520
`
`V
`V
`518 (cid:9)
`518 (cid:9)
`
`>
`
`C) Yes
`C) Yes
`
`0 No
`0 No
`
`A
`A
`
`\ \ E in
`
`516
`516
`
`2
`2 Did the interviewer ask open-ended
`Did the interviewer ask open-ended
`questions, allowing the interview to
`questions, allowing the interview to
`flow?
`flow?
`
`9, 32235 2% @5302“
`dco?mmsv / mam
`
`502
`502
`
`512A
`512A
`
`522
`522
`
`512B
`512B
`
`522
`522
`
`C>
`C>
`
`Still Frame
`Still Frame
`
`506
`506
`V
`(cid:9)V
`(cid:9) 508
`Go to Phrase
`V 508
`Go to Phrase
`444 I <K1 I KX:1 COI * I •-
`4441 Q4' 144 COI
`IX> I •
`V 510
`510 (cid:9)
`Go to Last
`Go to Last
`(cid:9)V
`512C
`512C
`
`504
`504
`
`516
`516
`2
`2
`
`3
`3
`Did the interviewer attempt to clarify
`Did the interviewer attempt to clarify
`details without disrupting the
`details without disrupting the
`interview?
`interview?
`
`V
`V
`520
`518 (cid:9)
`518 520
`
`Yes
`Yes
`
`No
`No
`
`Segments
`Segments
`(
`(
`532
`532
`
`534
`5 34
`
`536
`536
`
`522
`522
`
`Figure 5
`Figure 5
`
`A
`A
`
`V
`V
`
`Page 15 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`waled °S11
`waled °S11
`
`tc Jo Si lamIS
`tc Jo Si lamIS
`
`7 602
`7 602
`..
`..
`
`y 604
`y 604
`
`606
`606
`
`610
`610
`
`620
`620
`
`TC_In +-?
`TC_In +-?
`\ (cid:9)
`\ (cid:9)
`612 (cid:9)
`612 (cid:9)
`
`614 (cid:9)
`614 (cid:9)
`
`Interviewer
`Interviewer
`\
`\
`616
`616
`
`A
`A
`
`TC_In +-?
`TC_In +-?
`\ (cid:9)
`\ (cid:9)
`\ (cid:9)
`\ (cid:9)
`624 (cid:9)
`622 (cid:9)
`624 (cid:9)
`622 (cid:9)
`
`I
`I
`Videographer
`Videographer
`\
`\
`626
`626
`
`A
`A
`
`< (cid:9)
`< (cid:9)
`
`V
`V
`
`>
`>
`630
`630
`
`< (cid:9)
`< (cid:9)
`
`TC_In +-?
`TC_In +-?
`\ (cid:9)
`\
`\ (cid:9)
`\
`632 (cid:9)
`634 (cid:9)
`632 (cid:9)
`634 (cid:9)
`
`636
`636
`
`r
`r
`
`Factual
`Factual
`
`A
`A
`—
`—
`
`TC_In +-?
`TC_In +-?
`\ (cid:9)
`1 (cid:9)
`\ (cid:9)
`1 (cid:9)
`642 (cid:9)
`644 (cid:9)
`642 (cid:9)
`644 (cid:9)
`
`\
`\
`646
`646
`
`V
`V
`
`>
`>
`
`<
`<
`
`A
`A
`
`V
`V
`
`<
`<
`
`656
`656
`
`>
`>
`
`< (cid:9)
`< (cid:9)
`
`Figure 6
`Figure 6
`
`V
`V
`
`>
`>
`640
`640
`
`I
`I
`
`Other
`Other
`
`A
`A
`—
`—
`
`V
`V
`
`>
`>
`
`Page 16 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`waled °S11
`waled °S11
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 16 0f 34
`tc JO 91 laaqS
`tc JO 91 laaqS
`
`CA
`CA
`00
`00
`f..o4
`f..o4
`IN
`IN
`
`5,832,495
`
`CA
`CA
`
`704
`704
`
`we.“
`
`702
`702
`
`Non
`
`742
`742
`
`Unclassified Item
`Unclassified Item
`
`Item (cid:9)
`Item (cid:9)
`
`Ni \ EBA
`
`\ .
`
`mconum
`
`actions
`actions
`antisemitic actions
`antisemitic actions
`746 -\... anti-Jewish measures and legislation
`746 -\... anti-Jewish measures and legislation
`antisemitic comments and behavior
`antisemitic comments and behavior
`attacks on Jewish homes
`attacks on Jewish homes
`attacks on synagogues
`attacks on synagogues
`desecration of cemetaries
`desecration of cemetaries
`bystander responses to Hollocaust
`bystander responses to Hollocaust
`744 -\.. deadly actions
`744 -\.. deadly actions
`Nazi government actions
`Nazi government actions
`violent actions
`violent actions
`amenities (cid:9)
`amenities (cid:9)
`camp personnel
`camp personnel
`character and behavior
`character and behavior
`
`y- 752
`y- 752
`
`A
`A
`_
`_
`
`Jewish nonviolent resistance
`Jewish nonviolent resistance
`Nazi courts (cid:9)
`Nazi courts (cid:9)
`occupations
`occupations
`personal property
`personal property
`
`mtsou ?n Z
`
`A
`A
`
`714
`714
`
`8532mm;
`E2228:
`5&3“;
`\Atwmoa
`Gasman
`mcommmsuuo
`@E @ in
`
`716
`716
`
`734 -.N.s.
`734 -.N.s.
`
`/ ix
`
`718
`718
`
`wK
`
`y- 744
`y- 744
`
`9.53%
`32:52am
`EmZ
`wcosum
`bung / 3R
`
`mcowum
`E20?
`
`y 742
`y 742
`
`QR \ mmEcmEm
`Eccomhwg
`Q53
`
`720
`720
`
`722
`722
`
`@ mm“ @ om“
`
`< oo
`< oo
`
`V
`V
`
`>
`>
`
`V
`V
`
`734
`734
`
`/ §
`
`>
`>
`
`40 <
`40 <
`
`732
`732
`
`mm“
`
`732
`732
`
`mm“
`
`Figure 7A
`Figure 7A
`
`Page 17 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`

`

`waled °S11
`waled °S11
`U.S. Patent
`
`Nov. 3, 1998
`
`Sheet 17 0f 34
`17£ JO a WIN
`17£ JO a WIN
`
`CA
`CA
`00
`00
`C..o4
`C..o4
`IN
`IN
`
`5,832,495
`
`itZ
`itZ
`CA
`CA
`
`704
`704
`
`won
`
`702
`702
`
`Now
`
`Unclassified Item
`Unclassified Item
`
`Em:
`wQEmwEHED
`
`772
`772
`
`Item (cid:9)
`Item (cid:9)
`
`NR \ 58A
`
`\ .
`
`A
`A
`
`714
`714
`
`Nizoz (cid:9)
`Nizoz (cid:9)
`
`z-. 782
`z-. 782
`-•
`-•
`
`A
`A
`'.,.
`'.,.
`
`@K @ in
`
`716
`716
`
`734 -.N.._
`734 -.N.._
`
`718
`718
`
`25
`
`actions
`actions
`ghetto life
`ghetto life
`air raids
`air raids
`774 -\s anti-Nazi demonstrations
`774 -\s anti-Nazi demonstrations
`apartments in teh ghettos
`apartments in teh ghettos
`Aryan side
`Aryan side
`bartering
`bartering
`beggars in ghettos
`beggars in ghettos
`bunkers in ghettos
`bunkers in ghettos
`curfew in the ghettos
`curfew in the ghettos
`
`2: 032%
`
`QUE 5x54
`
`wotwsw m5 E 3826
`wotwsw E mavens
`wotwsw E miwwwmn
`
`955%
`
`V
`V
`
`>
`>
`
`/
`/
`
`732
`732
`
`Nmm
`
`720
`720
`
`722
`722
`
`< Po
`< Po
`
`Figure 7B
`Figure 7B
`
`E as?
`
`@ Nam @ own
`
`V
`V
`
`734
`734
`
`732
`732
`
`mm“
`
`PP
`PP
`
`Page 18 of 51
`
`MINDGEEK EXHIBIT 1002
`
`(cid:9)
`(cid:9)
`

`

`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`U.S. Patent
`
`Nov. 3, 1998
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`Sheet 18 of 34 (cid:9)Sheet 18 of 34 (cid:9)
`
`Sheet 18 0f 34
`
`
`5,832,495 5,832,495
`5,832,495
`
`8
`
`action?
`
`
`
`No No
`
`|
`
`Yes Yes
`Yes
`
`I
`
`No No
`No
`
`804
`
`
`
`Yes Yes
`
`806 806
`
`806
`
`
`810 810
`810
`/
`
`create
`segment?
`
`Y
`‘35+ create segment
`
`814 814
`
`814
`/
`
`
`create event create event
`create event
`
`
`
`1 1
`
`818 818
`
`818
`/
`
`
`
`Yes Yes
`
`create image
`
`
`
`No No
`
`Figure 8A
`Figure 8A Figure 8A
`
`
`Page 19 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`U.S. Patent
`
`Nov. 3, 1998 Nov. 3, 1998
`
`Nov. 3, 1998
`
`Sheet 19 of 34 (cid:9)Sheet 19 of 34 (cid:9)
`
`Sheet 19 0f 34
`
`
`5,832,495 5,832,495
`5,832,495
`
`
`
`824 824
`
`te
`crea _
`_Yes
`+ thesaural item
`
`
`828 828
`
`z z
`
`
`create create
`create
`
`proposed item proposed item
`proposed item
`
`create
`thesaural
`item?
`
`
`
`No No
`
`create
`proposed
`item?
`
`
`
`c c
`
`
`delete/merge delete/merge
`delete / merge
`
`instance instance
`instance
`
`
`
`°CD °CD
`
`
`830 830
`
`z z
`
`
`
`834 834
`
`create phrase? —Yes —> create phrase
`
`Figure 8B Figure 8B
`
`Figure 8B
`
`Page 20 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 20 of 34 (cid:9)Sheet 20 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`start start
`
`
`
`[ (cid:9)[ (cid:9)
`
`
`
`) )
`
`
`
`902 902
`
`
`
`assign segment ID assign segment ID
`
`
`904 904
`
`z z
`
`
`obtain obtain
`
`descriptive phrase descriptive phrase
`
`
`
`906 906
`
`
`
`908 908
`
`
`create segment create segment
`
`instance instance
`
`
`create element create element
`
`relationships relationships
`
`
`
`910 910
`
`
`
`end end
`
`
`
`Figure 9A Figure 9A
`
`Page 21 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 21 of 34 (cid:9)Sheet 21 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`obtain start and obtain start and
`
`end timecodes end timecodes
`
`
`926 926
`
`r r
`
`
`obtain obtain
`
`descriptive phrase descriptive phrase
`
`
` 928 928
`
`z z
`
`
`NII (cid:9)NII (cid:9)
`
`spell check spell check
`
`descriptive phrase descriptive phrase
`
`
`
`930 930
`
`
`
`
`
`
`z z
`
`identify items in identify items in
`
`descriptive phrase descriptive phrase
`
`
`
`932 932
`
`
`934 934
`
`z z
`
`
`create element create element
`
`relationships relationships
`
`
`
`Figure 9B Figure 9B
`
`Page 22 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 22 of 34 (cid:9)Sheet 22 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`[ (cid:9) [ (cid:9)
`
`
`
`start start
`
`
`
`'N 'N
`
`
`
`./ ./
`
`
`1004 1004
`
`z z
`
`
`locate instance locate instance
`
`of index element of index element
`
`
`
`1006 1006
`
`
`
`1008 1008
`
`
`
`1010 1010
`
`
`obtain thesaural obtain thesaural
`
`term term
`
`
`create thesaural create thesaural
`
`instance instance
`
`
`create element create element
`
`relationships relationships
`
`
`
`Figure 10 Figure 10
`
`Page 23 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 23 of 34 (cid:9)Sheet 23 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`start start
`
`
`identify identify
`
`proposed item proposed item
`
`
`
`1102 1102
`
`
`1104 1104
`
`/ /
`
`
`
`enter comment enter comment
`
`
`
`1106 1106
`
`
`
`1108 1108
`
`
`create proposed create proposed
`
`element instance element instance
`
`
`create element create element
`
`relationships relationships
`
`
`
`Figure 11 Figure 11
`
`Page 24 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 24 of 34 (cid:9)Sheet 24 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`C (cid:9)C (cid:9)
`
`
`
`start start
`
`
`obtain index obtain index
`
`element to be element to be
`
`deleted deleted
`
`
`locate related locate related
`
`index elements index elements
`
`
`) )
`
`1202 1202
`
`
`
`1204 1204
`
`
`
`1206 1206
`
`
`Yes Yes
`
`+ +
`
`reassign/delete reassign/delete
`
`related elements related elements
`
`
`
`1208 1208
`
`
`
`1212 1212
`
`
`
`delete instance delete instance
`
`
`
`c (cid:9) c (cid:9)
`
`
`
`Figure 12 Figure 12
`
`Page 25 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 25 of 34 (cid:9)Sheet 25 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`/ /
`
`
`
`identify sub-type identify sub-type
`
`1306 1306
`
`
`
`
`
`
`z z
`
`
`
`obtain timecode obtain timecode
`
`
`
`III (cid:9)III (cid:9)
`
`
`1308 1308
`
`
`
`z z
`
`
`
`obtain comment obtain comment
`
`
`
`1310 1310
`
`
`
`1312 1312
`
`
`1314 1314
`
`z z
`
`
`create element create element
`
`relationships relationships
`
`
`
`Figure 13A Figure 13A
`
`Page 26 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 26 of 34 (cid:9)Sheet 26 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`1322 1322
`
`
`1324 1324
`
`z z
`
`obtain timecode obtain timecode
`
`
`
`1326 1326
`
`
`
`1328 1328
`
`
`1330 1330
`
`z z
`
`
`obtain resource obtain resource
`
`locator locator
`
`
`create element create element
`
`relationships relationships
`
`
`
`Figure 13B Figure 13B
`
`Page 27 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 Nov. 3, 1998
`
`
`
`Sheet 27 of 34 (cid:9)Sheet 27 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`Yes Yes
`
`
`
`No No
`
`
`
`No No
`
`
`Yes Yes
`
`V V
`
`request request
`
`confirmation confirmation
`
`
`1410 1410
`
`r r
`
`
`
`Figure 14A Figure 14A
`
`Page 28 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 Nov. 3, 1998
`
`
`
`Sheet 28 of 34 (cid:9)Sheet 28 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`Yes Yes
`
`
`
`111 (cid:9)111 (cid:9)
`
`
`1414 1414
`
`
`
`z z
`
`
`
`delete children delete children
`
`
`
`1416 1416
`
`
`
`delete item delete item
`
`1418 1418
`
`
`
`
`
`
`z z
`
`
`update update
`
`managment screens managment screens
`
`
`1441 1420 1441 1420
`
`end end
`
`
`
`Figure 14B Figure 14B
`
`Page 29 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 29 of 34 (cid:9)Sheet 29 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`1504 1504
`
`
`
`Yes Yes
`
`
`1 1
`
`No No
`
`IV (cid:9)IV (cid:9)
`
`get next child get next child
`
`instance instance
`
`
`1506 1506
`
`, ,
`
`
`1510 1510
`
`, ,
`
`
`identify any identify any
`
`children of instance children of instance
`
`
`
`Figure 15A Figure 15A
`
`Page 30 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 30 of 34 (cid:9)Sheet 30 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`No No
`
`
`
`Yes Yes
`
`
`1514 1514
`
`, ,
`
`
`
`delete children delete children
`
`
`
`1516 1516
`
`
`
`delete instance delete instance
`
`
`
`0 0
`
`
`
`Figure 15B Figure 15B
`
`Page 31 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 31 of 34 (cid:9)Sheet 31 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`start start
`
`
`
`[ (cid:9)[ (cid:9)
`
`
`
`"\ "\
`
`
`
`
`J J
`
`
`
`1604 1604
`
`
`remove child remove child
`
`from parent from parent
`
`
`insert item in insert item in
`
`unclassified list unclassified list
`
`
`
`( (cid:9) ( (cid:9)
`
`
`
`Figure 16 Figure 16
`
`Page 32 of 51
`
`MINDGEEK EXHIBIT 1002
`
`

`

`
`
`U.S. Patent (cid:9)U.S. Patent (cid:9)
`
`
`
`Nov. 3, 1998 (cid:9)Nov. 3, 1998 (cid:9)
`
`
`
`Sheet 32 of 34 (cid:9)Sheet 32 of 34 (cid:9)
`
`
`
`5,832,495 5,832,495
`
`
`
`C (cid:9) C (cid:9)
`
`
`
`start start
`
`
`
`r r
`
`
`III (cid:9)III (cid:9)
`
`get item ID get item ID
`
`
`
`-------- 1702 -------- 1702
`
`
`dragg