`
`FILE HISTORY
`FILE HISTORY
`US 6,212,527
`US 6,212,527
`
`6,212,527
`PATENT:
`6,212,527
`PATENT: (cid:9)
`INVENTORS: Gustman, Samuel
`INVENTORS: Gustman, Samuel
`
`TITLE:
`TITLE: (cid:9)
`
`Method and apparatus for cataloguing
`Method and apparatus for cataloguing
`multimedia data
`multimedia data
`
`APPLICATION
`APPLICATION
`NO:
`NO:
`FILED:
`FILED: (cid:9)
`ISSUED:
`ISSUED: (cid:9)
`
`US1998184921A
`US1998184921A
`
`02 NOV 1998
`02 NOV 1998
`03 APR 2001
`03 APR 2001
`
`COMPILED:
`13 OCT 2014
`COMPILED: 13 OCT 2014
`
`Page 1 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`o
`e4
`co
`▪
`m
`„c▪ n (cid:9)
`--
`cr.
`'co
`Dr4
`• 0'
`Inc
`
`ST CO
`
`PATENT NUMBER
`
`IIIIIIIIIIIIIIIIIIIIIIIIIIIII
`
`U.S. UTILITY PATENT APPLICATION
`U.S. UTILITY PATENT APPLICATION
`PATENT DATE
`PATENT DATE
`OIP.E.
`0 I.P.E.
`.
`,, (cid:9)
`0 pp /
`APR 0 3 2001
`APR 0 3 201
`SCANNED CA_
`SCANNED -C)
`
`kit)
`
`.QA.
`(cid:9) O.A.
`
`[SECTOR CLASS
`
`SUBCLASS
`
`ART UNIT
`
`EXAMINER
`
`H' DISK (CRF) H, FICHE
`FILED WITH: U DISK (CRF) U FICHE
`(Attached in pocket on right inside flap)
`(Aflached in pockei ont right inside flap)
`
`V,
`
`z
`
`PREPARED AND APPROVED FOR ISSUE
`PREPARED AND APPROVED FOR ISSUE
`
`ORIGINAL
`ORIGINAL
`CLASS
`SUBCLASS
`SUBCLASS
`CLASS
`7,2
`ID-L,
`I d__ -1-_
`-7Z)a
`INTERNATIONAL CLASSIFICATION
`INTERNATIONAL CLASSIFICATION
`
`0% O
`
` 173 ZD
`
`/
`/
`/
`/
`
`ISSUING CLASSIFICATION
`ISSUING CLASSIFICATION
`CROSS REFERENCE(S)
`CROSS REFERENCE(S)
`
`CLASS
`CLASS
`-7 r
`
`.2(9-7__
`
`SUBCLASS (ONE SUBCLASS PER BLOCK)
`SUBCLASS (ONE SUBCLASS PER BLOCK)
`
`0, Continued on Issue Slip Inside File Jacket
`0,Continued on issue Slip Inside File Jacket
`
`DRAWINGS
`DRAWINGS
`Figs. Drwg,
`Figs. Drwg.
`3 (cid:9)
``I 7
`
`TERMINAL
`H DISCLAIMER
`oTERMINAL
`DISCLAIMER
`
`Oa) The term of this patent
`El a) The term of this patent
`subsequent to ____-__(date)
`subsequent to (cid:9)
`has been disclaimed.~i
`has been disclaimed.
`
`o] b) The term of this patent shall
`• b) The term of this patent shall
`not extend beyond the expiration date
`not extend beyond the expiration date
`of U.S Patent. No.
`of U.S Patent. No. (cid:9)
`
` .
`
`Sheets Drwg.
`Sheets Drwg.
`
`3y
`
`(date)
`
`Bs' (cid:9)
`
`t (cid:9)
`mine (cid:9)
`ntp amnent.
`
`Print Fig.
`Print Fig.
`2. E
`
`
`
`. . (cid:9) e)
`
`CLAIMS ALLOWED
`CLAIMS ALLOWED
`Total Claims
`Print Claim for O.G.
`Total Claims
`Print Claim for 0.G.
`IS--
`I
`NOTICE OF ALLOWANCE MAILED
`NOTICE OF ALLOWANCE MAILED
`
`
`
`/ _ (2_ rctrt) /
`
`ISSUE FEE
`
`FEE / ISSUE
`Amount Due
`Date Paid
`Amount Due
`2~
`Date Paid
`IV ~
`0 .
`o
`f 6 7 '
`2— '27 0
`
`ISSUE BATCH NUMBER (cid:9)
`ISEBTHNME
`U 0
`
`cm
`
`____/_WAYNiCAMSBURY
`
`______-
`
`WAYN)AMSBURY
`PRIMARY PATENT EXAMINER
`PRIMARY PATENT EXAMINER
`
`_ (Primary Examiner) (cid:9)
`Examiner)
`
`-(Primary
`
`______
`
`p ate)
`(Date)
`
`oc) The terminal
`
`-..months of
`• c) The terminal (cid:9)
`months of
`this patent have been disclaimed.
`this patent have been disclaimed.
`
`_________________
`(Legal Instruments Examiner) (cid:9)
`(Lega instruments Examiner)
`I
`
`____
`(Date)
`(Date)
`
`WARNING:
`WARNING: (cid:9)
`
`r
`The information disclosed herein may be restricted Unauthorized disclosure may be prohibited by the United States Code Title 35, Sections 122. 181 and 368
`The information disclosed herein may be restricted, (cid:9) Unauthorized disclosure may be prohibited by the United States Code Title 35, Sections 122. 181 and 368.
`,
`Possession outside the U.S. Patent & Trademark Office Is restricted to authorized eMplOYees and contractors only.
`
`Possession outside the U.S. Patent & Trademark Office Is restricted to authorized employees and contractors only. (cid:9)
`Form PTO-436A
`(Rev 6/98)
`(Rev 6/98)
`
`fil
`
`AM 04,
`nmanin- L
`1P*0 L
`
`s,ZUiE
`
`t.
`
`FEE IN FILL
`FEE 11\, FILE
`
`(LABEL AREA)
`(LABEL AREA)
`
`(FACE)
`(FACE)
`
`Page 2 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`6,212,527
`6,212,527
`
`METHOD AND APPARATUS FOR CATALOGUING MULTIMEDIA
`METHOD AND APPARATUS FOR CATALOGUING MULTIMEDIA
`DATA
`DATA
`
`Transaction History
`Transaction History
`
`Transaction Description
`Date
`Transaction Description
`Date
`11/2/1998 Preliminary Amendment
`11/2/1998 Preliminary Amendment
`11/2/1998 Information Disclosure Statement (IDS) Filed
`11/2/1998 Information Disclosure Statement (IDS) Filed
`11/2/1998 Information Disclosure Statement (IDS) Filed
`11/2/1998 Information Disclosure Statement (IDS) Filed
`11/5/1998 Initial Exam Team nn
`11/5/1998 Initial Exam Team nn
`11/17/1998 IFW Scan & PACR Auto Security Review
`11/17/1998 IFW Scan & PACR Auto Security Review
`11/25/1998 Notice Mailed--Application Incomplete--Filing Date Assigned
`11/25/1998 Notice Mailed--Application Incomplete--Filing Date Assigned
`2/23/1999 Application Is Now Complete
`2/23/1999 Application Is Now Complete
`2/25/1999 Application Dispatched from OIPE
`2/25/1999 Application Dispatched from OIPE
`6/14/1999 Case Docketed to Examiner in GAU
`6/14/1999 Case Docketed to Examiner in GAU
`6/25/1999 Non-Final Rejection
`6/25/1999 Non-Final Rejection
`6/29/1999 Mail Non-Final Rejection
`6/29/1999 Mail Non-Final Rejection
`1/6/2000 Response after Non-Final Action
`1/6/2000 Response after Non-Final Action
`1/6/2000 Request for Extension of Time - Granted
`1/6/2000 Request for Extension of Time - Granted
`1/11/2000 Date Forwarded to Examiner
`1/11/2000 Date Forwarded to Examiner
`1/21/2000 Mail Final Rejection (PTOL - 326)
`1/21/2000 Mail Final Rejection (PTOL - 326)
`1/21/2000 Final Rejection
`1/21/2000 Final Rejection
`7/21/2000 Workflow - Request for CPA - Finish
`7/21/2000 Workflow - Request for CPA - Finish
`7/21/2000 Continuing Prosecution Application - Continuation (ACPA)
`7/21/2000 Continuing Prosecution Application - Continuation (ACPA)
`7/21/2000 Mail Express Abandonment (During Examination)
`7/21/2000 Mail Express Abandonment (During Examination)
`7/21/2000 Express Abandonment (during Examination)
`7/21/2000 Express Abandonment (during Examination)
`7/21/2000 Workflow - Request for CPA - Begin
`7/21/2000 Workflow - Request for CPA - Begin
`8/2/2000 Mail Incomplete CPA Notification
`8/2/2000 Mail Incomplete CPA Notification
`8/2/2000 CPA filing - Incomplete
`8/2/2000 CPA filing - Incomplete
`9/11/2000 Request for Extension of Time - Granted
`9/11/2000 Request for Extension of Time - Granted
`9/20/2000 Date Forwarded to Examiner
`9/20/2000 Date Forwarded to Examiner
`10/6/2000 Case Docketed to Examiner in GAU
`10/6/2000 Case Docketed to Examiner in GAU
`11/2/2000 Mail Notice of Allowance
`11/2/2000 Mail Notice of Allowance
`11/2/2000 Notice of Allowance Data Verification Completed
`11/2/2000 Notice of Allowance Data Verification Completed
`11/13/2000 Workflow - Request for CPA - Finish
`11/13/2000 Workflow - Request for CPA - Finish
`11/13/2000 Workflow - Request for CPA - Begin
`11/13/2000 Workflow - Request for CPA - Begin
`12/28/2000 Workflow - File Sent to Contractor
`12/28/2000 Workflow - File Sent to Contractor
`2/2/2001 Issue Fee Payment Verified
`2/2/2001 Issue Fee Payment Verified
`2/2/2001 Workflow - Drawings Finished
`2/2/2001 Workflow - Drawings Finished
`2/2/2001 Workflow - Drawings Matched with File at Contractor
`2/2/2001 Workflow - Drawings Matched with File at Contractor
`2/2/2001 Workflow - Drawings Received at Contractor
`2/2/2001 Workflow - Drawings Received at Contractor
`2/2/2001 Workflow - Drawings Sent to Contractor
`2/2/2001 Workflow - Drawings Sent to Contractor
`2/28/2001 Workflow - Complete WF Records for Drawings
`2/28/2001 Workflow - Complete WF Records for Drawings
`3/4/2001 Application Is Considered Ready for Issue
`3/4/2001 Application Is Considered Ready for Issue
`3/15/2001 Issue Notification Mailed
`3/15/2001 Issue Notification Mailed
`4/3/2001 Recordation of Patent Grant Mailed
`4/3/2001 Recordation of Patent Grant Mailed
`
` 
`
`Page 3 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`PATENT APPLICATION
`PATENT APPLICATION
`A (cid:9)
`11\
`
`09184921
`09184921
`
`Jc541711161 -PTO
`09/fl849*21
`09/194921
`
`1.1/02/98
`
`CONTENTS
`CONTENTS
`Date received
`Date received
`(Incl. C. of M.)
`(Incl. C. of M.)
`or
`or
`Date Mailed
`Date Mailed
`
`A~vTlj9y9 434g
`Nitiffity, 9 yea
`
`•
`Date received
`Date received
`(Incl. C. of M.)
`(Incl. C. of M.)
`or
`or
`Date Mailed
`Date Mailed
`
`1. Application 31._ papers.
`1. Application
`~papers,
`gth 71n
`t..
`
`3. Zreilokidafiesie
`4.
`4.
`5. rot (cid:9)
`6. 7-PiLs1/4- Aftell.r44_
`
`-16
`9<6
`/ -a --9.2
`-0
`
`_ _ _
`
`_
`
`_
`
`8.(1(
`
`9
`
`"t
`
`Q")
`
`• (9 :12C
`- 2.1-00
`
`42. (cid:9)
`42.
`43. (cid:9)
`43.
`
`44.
`44. (cid:9)
`45.-
`45. (cid:9)
`46.--
`46. (cid:9)
`
`47.
`47. (cid:9)
`
`48.
`
`49. (cid:9)
`
`51. (cid:9)
`52.
`52. (cid:9)
`
`53. (cid:9)
`
`54.
`54. (cid:9)
`
`
`
`
`
`
`
`
`
`
`
`
`
`_
`
`--
`
`_
`
`_
`
`_
`
`--
`
`__
`
`
`
`
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`
`
`
`
`
`
`
`
`C'. Y}
`)1- 114C -2)NI/In
`
`li- -/ -a)
`d
`
`___
`
`___
`
`___
`
`__55._
`
`V --
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`____
`
`17. (cid:9)
`
`18. (cid:9)
`
`19.
`
`20. (cid:9)
`
`if)
`) 1/
`I
`
`-
`
`-/
`
`-
`
`___________
`
`___
`___
`
`___
`
`
`
`
`
`
`
`55. (cid:9)
`~56.
`56. (cid:9)
`57.
`57. (cid:9)
`
`_______
`
`--
`
`58. (cid:9)
`58.
`~~~59.
`59. (cid:9)
`
`__
`
`_
`
`_ __
`
`_
`
`_
`
`_
`
`_
`
`_
`
`____________
`
`__
`
`60. (cid:9)
`60.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`61.
`61.
`
`-
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`
`
`
`
`
`
`21. (cid:9)
`
`22. (cid:9)
`
`23. (cid:9)
`
`
`
`
`
`
`
`
`
`__________
`
`______ _____
`
`62.
`62. (cid:9)
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`63.-_
`63. (cid:9)
`
`_
`
`_
`
`_
`
`_
`
`_ __
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`____________
`
`64. (cid:9)
`64.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`
`
`______ ______
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`24. (cid:9)
`
`25. (cid:9)
`
`26. (cid:9)
`
`27. (cid:9)
`
`
`
`
`
`
`
`______ ______
`
`______ ______
`
`______ ______
`
`65. (cid:9)
`65.
`
`66. (cid:9)
`66.
`
`67.
`67. (cid:9)
`
`68. (cid:9)
`68.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`
`
`
`
`
`
`28 (cid:9)
`
`29. (cid:9)
`
`30. (cid:9)
`
`
`
`
`
`
`
`______ ______
`
`______ ______
`
`__________
`
`69. (cid:9)
`69.
`
`70. (cid:9)
`70.
`
`71. (cid:9)
`71. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`31. (cid:9)
`
`32. (cid:9)
`
`33. (cid:9)
`
`34. (cid:9)
`
`
`
`
`
`
`
`
`
`______ ______
`
`______ ______
`
`____________
`
`___ __ __ __
`
`72.
`72. (cid:9)
`
`73.
`73. (cid:9)
`
`74. (cid:9)
`74.
`
`75.
`75. _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`
`
`_
`
`_
`
`35. (cid:9)
`
`36. (cid:9)
`
`37
`
`
`
`
`
`______ ______
`
`______ ______
`
`____________
`
`76. (cid:9)
`76.
`
`77. (cid:9)
`77.
`
`78. (cid:9)
`78.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`
`
`
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`38. (cid:9)
`
`39. (cid:9)
`
`40. (cid:9)
`
`41. (cid:9)
`
`
`
`
`
`
`
`
`
`____________
`
`____________
`
`___________
`
`______ ______
`
`79. (cid:9)
`79.
`
`80. (cid:9)
`80.
`
`81. _
`81. (cid:9)
`
`82. (cid:9)
`82.
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`
`
`
`
`
`
`
`
`(LEFT OUTSIDE)
`(LEFT OUTSIDE)
`
`Page 4 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`Mt
`
`N
`
`S EARCHED
`
`SEARCH NOTES
`SEARCH NOTES
`(INCLUDING SEARCH STRATEGY)
`(INCLUDING SEARCH STRATEGY)
`
`Class
`
`-712
`
`77?
`
`Sub.
`Date
`6(.2 9,(If
`1022 !
`
`Exmr.
`Exmr.
`
`la2
`i
`
`/6/?1(2av
`
``•••••1—..
`
`Date
`Date
`
`Exmr.
`Exmr.
`
`arrm.(41,-but04. 6(2-ylif
`
`tc.)/30e-w
`
`IED
`xrpr.
`
`INTERFERENCE SEARCHED
`Class
`Sub.
`Date
`101, I
`107
`10/3)(w
`
`(RIGT
`
`OUSIDE
`
`(RIGHT OUTSIDE)
`
`Page 5 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`

`

`Date
`
`11111
`
`ISSUE SLIP STAPLE AREA (for additional cross references)
`ISSUE SLIP STAPLF, AREA (for additional cross references)
`
`K- POSIION,I
`
`POSITION
`
`r
`
`INITIALS
`INITIALS
`NTIL
`
`iD NO.
`iD NO.
`O
`
`PEE DETERMINATION
`FEE DETERMINATION
`0.1.P.E. CLASSIFIER
`O.I.P.E. CLASSIFIER
`FORMALITY REVIEW
`FORMALITY REVIEW
`
`_____
`
`____
`
`__k4)5
`
`_________
`
`k 57.e-
`
`DALE
`DAII 2
`A
`
`-
`
`•
`i/-
`//-/0
`// -;2 c(-7
`
`INDEX
`OF CLAIMS
`INDEX OF CLAIMS
`N ...................... Non-elected
`......................
` Non-elected
`N
`Rejected
` Rejected
`r (cid:9)
`I ......................
`Interference
`.
` Interference
`................ Allowed
`I
` Allowed
`=
`A...................... Appeal
`(Through numeral) ... Canceled
`A
` Appeal
`— (Through numeral)... Canceled
`..................
`0 ...................... Objected
`0 (cid:9)
` Objected
`Restricted
`: (cid:9)
` Restricted
`Claim (cid:9)
`claim
`
`Date
`Date
`
`Claim (cid:9)
`
`C
`
`93
`10
`111
`112
`11
`114
`115
`116
`117
`118
`119
`20
`121
`22
`
`124
`125
`26
`127
`
`46
`4
`4
`14
`5
`
`ir. 8
`ir 8
`51
`52
`521
`53
`54
`54
`55
`56
`56
`57
`58
`59
`60
`61
`62
`63
`64
`65
`7
`66
`751
`67
`68
`69
`79
`70
`80
`71
`81
`62
`72
`73
`74
`83
`75
`76
`77
`87
`78
`79
`89
`80
`70
`81
`91
`82
`92
`83
`93
`84
`94
`85
`95
`86
`76
`87
`77
`88
`89
`90
`lisor1 cin
`5
`Ifmr8hn0
`91
`92
`stpeadtonlsethr
`93
`(L8 TISIE
`94
`95
`96
`97
`8j
`99
`
`8 9
`
`9 t
`
`If more than 150 claims or 10 actions
`staple additional sheet here
`
`(LEFT INSIDE)
`
`l
`
`Date
`
`Claim
`
`
`110
`th
`tt
`
`
`-e li. 1. 0 •S 11 1/4. ... n.
`6:1)
`NI.
``1. .
`. NS-
`‘1,
`Ns
`\*Z.
`s'49.
`\'''S.
`X
`111.
`.1c..\
`cal
`
`.
`
`jil•rt
`Thvik
`W..,
`X.
`• 79.
`'M.
`
`• 422-
`4.29.
`
`! (cid:9) '
`6
`I4,/ I
`V. 'r-
`
`1
`
`6 31 i
`'1,32 I
`Cs'. 33 V
`13 34 if
`2 3c
`36
`1-1 37
`1 0 38
`I( 39
`( 7. 40
`il 1-' 41
`t
`
`1
`
`)(/ 44
`11 as
`rat,- .0
`47
`48
`49T
`50
`
`I
`
`'
`
`Page 6 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`(12) United States Patent (cid:9)
`(12) United States Patent
`Gustman (cid:9)
`Gustman
`
`1111111111111111111111111,1!!!111,11!1111111111111111111111111111
`US00621 25273
`US 6,212,527 BL
`(t0) Patent No.:
`US 6,212,527 B1
`(10) Patent No.: (cid:9)
`*Apr. 3, 2001
`(45) I)ate of Patent:
`*Apr. 3, 2001
`(45) Date of Patent: (cid:9)
`
`(54) MFTHIOD AND APPARATUS FOR
`METHOD AND APPARATUS FOR
`CATALOGUING MULTIMEDIA DATA
`CATALOGUING MULTIMEDIA DATA
`
`(75)
`
`Inventor: Samuel Gustman, Santa Monica, CA
`Inventor: Samuel Gustman, Santa Monica, CA
`(US)
`(US)
`
`(73) Assignee: Survivors of the Shoah Visual History
`Assignee: Survivors of the Shoah Visual History
`Foundation, Los Angeles, CA (US)
`Foundation, Los Angeles, CA (US)
`
`() Notice:
`Notice:
`
`Tlhis patent issued on a continued pros-
`'Phis patent issued on a continued pros-
`ecuion application filed under 37 CFR
`ecution application filed under 37 CFR
`1.53(d), and is subject to the twenty year
`1.53(d), and is subject to the twenty year
`term provisions of 35 U.S.C.
`patent
`patent (cid:9)
`term (cid:9) provisions (cid:9) of 35 (cid:9) U.S.C.
`154(a)(2).
`154(a)(2).
`
`Subject to any disclaimer, the term of (his
`Subject to any disclaimer, the term of this
`patent is exiended or adjusted under 35
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 09/184,921
`(21) Appl. No.: 09/184,921
`
`(22) Filed:
`(22) Filed: (cid:9)
`
`Nov. 2, 1998
`Nov. 2, 1998
`
`Related U.S. Application Data
`Related U.S. Application Data
`
`(63) Continuation of application No. 08/680,504, filed on Jul. 8,
`(63) Continuation of application No. 08/680,504, filed on Jul. 8,
`1996, now Pat. No. 5,832,495.
`1996, now Pat. No. 5,832,495.
`(51)
`....G06F 17/30
`Int. Cl.?.................................
`(51) Int. Cr (cid:9)
`GO6F 17/30
`(52) U.S. Cl ....................................
`707/102;1 707/1
`(52) U.S. Cl. (cid:9)
` 707/102; 707/1
`(58) Field of Search
`..............................
`707/102. 1
`(58) Field of Search (cid:9)
` 707/102, 1
`
`(56)
`(56)
`
`References Cited
`References Cited
`
`U.S. PATENT DOCUMENTS
`U.S. PATENT DOCUMENTS
`
`5,010,500
`4/1991 Makkuni et al..
`4/1991 Makkuni et al..
`5,010,500
`6/1992 Beftel et al ...................
`395/807
`5,119,474
`6/1992 Beitel et al. (cid:9)
`
`5,119,474
`395/807
`6/1992 Trautmian..................... 395/140
`5,121,470
`6/1992 Trautman (cid:9)
`
`5,121,470
`395/140
`6/1992 Kasaharm el at
`............. 395/357
`5,123,088
`6/1992 Kasahara et al. (cid:9)
`
`5,123,088
`395/357
`5/1993 Shimada et al ................ 395/615
`5,210,868
`5/1993 Shimada et al. (cid:9)
`5,210,868
`
`395/615
`8/1993 Reed et al..................... 707/104
`5,241,671
`5,241,671 • 8/1993 Reed et al. (cid:9)
`
`707/104
`
`12/1993
`5,274,758
`12/1993
`5,274,758
`5,278,946
`1/1994
`1/1994
`5,278,946
`5,280,573
`1/1994
`5,280,573
`1/1 994
`5,303,296
`4/1994
`4/1994
`5,303,296
`5,404,506
`5,404,506
`4/1995
`4/1995
`4/1 995
`5,408,655
`4/1995
`5,408,655
`5/1995
`5,414,644
`5/1995
`5,414,644 (cid:9) *
`*
`6/1995
`5,428,774
`6/1995
`5,428,774
`5,461,611
`10/1995
`5,461,611
`10/1995
`2/1996
`5,493,677
`2/1996
`5,493,677
`5/1996
`5,515,490
`5/1996
`5,515,490
`5,608,90f)
`3/1997
`3/1997
`5,608,900
`3/1997
`5,613,909
`5,613,909 (cid:9) * 3/1997
`*
`5,615,112
`3/1997
`5,615,112
`3/1997
`5,617,119
`4/1997
`5,617,119
`4/1997
`5/1997
`*
`5,630,121
`5,630,121 (cid:9) * 5/1997
`5/1997
`*
`5,630,125
`5,630,125 (cid:9) * 5/1997
`10/1997
`5,682,330
`5,682,330
`10/1997
`5,724,605
`3/1998
`5,724,605
`3/1998
`* 11/1998
`5,832,495
`5,832,495 (cid:9) *
`11/1998
`* 2/1999
`5,867,709
`5,867,709 (cid:9) * 2/1999
`* cited by examiner
`* cited by examiner
`
`B3eitel et aL.................... 395/62
`Beitel et al. (cid:9)
` 395/62
`.....
`..... 395/62
`Shimada el alt..
`Shimada et al. (cid:9)
` 395/62
`Kuga et atl ..................
`395/338
`Kuga et al. (cid:9)
` 395/338
`379)/67
`Zucker .........................
`Zucker (cid:9)
` 379/67
`..... 395/01A
`rujisawa et al ..........
`Fujisawa et al. (cid:9)
` 395/604
`Oren et al..................... 395/601
`Oren et al. (cid:9)
` 395/601
`702/t83
`Seaman et al .................
`Seaman et al. (cid:9)
` 702/183
`395/612
`Takahashi ei a]l ..............
`Takahashi et al
` 395/612
`Drake, Ji. et at..
`... ....
`370/4201
`Drake, (cid:9)
`et al. ........... • (cid:9)
`370/420
`..... 3951615
`Balogh ei a]l
`..........
`Balogh et al. (cid:9)
` 395/615
`Buchanan et al............ ... 345/30)2
`Buchanan et al.
` 345/302
`Deckle,e i] al.................)/6 13
`Docktet et al. (cid:9)
` 305/613
`Stclovsky........................ 463/1
`Stetovsky (cid:9)
` 463/1
` 305/615
`Lin ShCag e1a
`3Q5 /615S
`Liu Sheaf; et al. (cid:9)
`...............
` 195 /6 11.
`Briggs el al .............. ...
`395/011
`Briggs et al.
`Braden-IHardet et al.......707/1102
`707/102
`Braden-harder et al. . (cid:9)
`707/103
`Zellweger ....................
`Zellweger (cid:9)
` 707/103
`Seaman el a].l .......... ,364/551
`(i1
`Seaman el al. (cid:9)
` 364/551.01
`Wissnai
`.........................
`58k
`Wissnei (cid:9)
` 305/806
`GLAStman...................... 707/1013
`Gustman (cid:9)
` 707/103
` 707/1
`707/1
`Lang et al .......................
`Lang et al. (cid:9)
`
`Primary Examiner-Wayne Amsbury
`Primary Examiner—Wayne Amsbury
`(74) Attorney, Agent, or Firm- Tlhe Ilecker Law Group
`(74) Attorney, Agent, or Firm—The Hecker Law Group
`(57)
`ABSTRACT
`(57) (cid:9)
`ABSTRACT
`
`The invention catalogues data such ats 1mu][iflICein dlata. A
`The invention catalogues data such as multimedia data. A
`catalogue is a collection of one or more catalogue elements
`catalogue is a collection of one or more catalogue elements
`An index is used to access a catalogue. An element of at
`An index is used to access a catalogue. An element of a
`catalogue has one or more attributes. An attributQ provides
`catalogue has one or more attributes. An attribute provides
`information (hat can be used to search for, answer questions
`information that can be used to search for, answer questions
`about, and navigate through a catalogue, An attribuie of a
`about, and navigate through a catalogue. An attribute of a
`catalogue element can be an element that has attributes. A
`catalogue element can be an element that has attributes. A
`catalogue element attribute that is an element is referred to
`catalogue element attribute that is an element is referred to
`as an attrihute element. Attribute elements anti attrib,utes are
`as an attribute element. Attribute elements and attributes are
`used toi build an index that can be used to facilitate catalogue
`used to build an index that can be used to facilitate catalogue
`access. Within a catalogue, smaller catalogues can hie cre-
`access. Within a catalogue, smaller catalogues can be cre-
`ated by, for example, querying anti user designation,
`ated by, for example, querying and user designation.
`
`18 Claims, 34 I)rawlng Shoocts
`18 Claims, 34 Drawing Sheets
`
`Page 7 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`U.S.
`Patent
`Apr. 3, 2001
`Apr. 3, 2001
`
`US 6 2129527 Bl
`US 6,212,527 Bl
`Sheet 1 of 34 (cid:9)
`Sheet 1 of 34US62,57R
`
`119
`
`116
`
`I/O
`
`VIDEO AMP
`
`CRT
`
`113
`
`114
`
`CPU
`
`VIDEO MEMORY
`
`MAIN MEMORY
`
`1111MINIMOIllr
`
`118
`
`KEYBOARD
`
`111
`MASS STORAGE
`OTJ 111MASS STORAGE
`MOUSE
`MOUSE
`
`115
`
`112
`
`FIG. 1
`FIG. 1
`
`Page 8 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001
`
`Sheet 2 of 34 (cid:9)
`Sheet 2 of 34
`
`US 6,212,527 BI
`US 6,212,527 B1
`
`204
`
`206
`206
`/
`
`210
`210
`
`Phrase
`
`208
`208
`
`214
`214
`
`212
`212
`,
`Proposed
`Thesaural
`Keyword
`Keyword
`
`216
`
`218
`218
`
`220
`220
`
`222 (cid:9)
`222
`
`224
`224
`
`226
`226
`
`FIG. 2A
`FIG. 2A
`
`Page 9 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001
`
`Sheet 3 of 34 (cid:9)
`Sheet 3 of 34
`
`US 6,212,527 BL
`US 6,212,527 B1
`
`Segment
`
`f 204
`2014
`
`204
`
`4 (cid:9) W
`(
`250
`
`Segment
`
`.j
`
`228
`
`w
`
`206
`
`Phrase
`
`232 -
`
`230
`
`218
`
`214
`
`Proposed
`Keyword
`
`210
`/
`
`220
`/
`
`224
`/
`Proposed
`Person
`
`Image/
`Video
`
`y 218
`V /
`
`Person
`rson
`
`234
`
`236
`
`2
`
`Thesaural
`Person
`
`Person
`Information
`
`2206
`
`FIG. 2B
`FIG. 2B
`
`Page 10 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001 (cid:9)
`
`Sheet 4 of 34 (cid:9)
`Sheet 4 of 34
`
`US 6,2129527 RI
`US 6,212,527 B1
`
`280 (cid:9)
`
`282
`
`S2
`Si
`II
`I
`S2
`~
`I
`I (cid:9)
`P4
`P3
`P2 (cid:9)
`SP1T1lP2T2 P3T3 P4T4 P5T5P 6 T6 P7T7
`P5 T5 P6 T6 P7 TI7
`T4
`T3
`T2 (cid:9)
`I
`t
`1 (cid:9)
`/
`/
`( (cid:9)
`( (cid:9)
`268
`262
`264
`260
`268 (cid:9)
`264
`262 (cid:9)
`260 (cid:9)
`
`270
`270 (cid:9)
`
`272
`272
`
`258
`258
`
`T
`1 (cid:9)
`
`266
`266 (cid:9)
`
`S3
`
`284
`
`I3
`TI- Pr; Tn
`Tn- PA Ti
`
`1
`
`274
`274
`
`Pl+P2+P3
`Chapter Segment = P1F
`4+ P5
`P4 + P5
`Chapter Segment = (cid:9)
`+ P2 + P3
`P6 +P7 +... +Pn
`P6+P7+...+Pn
`
`+ 52 + S3
`Testimony Segment =Si
`Testimony Segment = Sl + S2 + S3
`
`General Segment= P1+PN+ P5 +P6 +Pn
`General Segment = PI + P4 + P5 + P6 + Pn
`
`FIG. 2C
`FIG. 2C
`
`Page 11 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Apr. 3, 2001
`Apr. 3, 2001
`
`Sheet 5 of 34 (cid:9)
`Sheet 5 of 34
`
`US 6,212,527 B1
`US 6,212,527 BI
`
`finmen
`Segment
`ID
`ID
`descriptive hmrse
`descriptive phrase
`Eef(phMaseT
`set(phrases)
`
`2
`204
`
`Phrase
`Phrase
`~
`t data 10
`input data ID
`u
`ID
`descriptive phras
`descriptive phrase
`In/Out Timecodes
`In/Out Timecodes
`set(keywords)
`set(keywords)
`set0(mages)
`set(images)
`set (peMons)
`set(persons)
`set(proposed keywords)
`set(proposed keywords)
`set(proposed persons)
`seaproposed persons)
`
`210
`
`IM216
`
`ID
`ID
`LAWe
`Label
`
`Kyoe210
`Keyword
`ID
`ID
`set(es)
`set(tfwes)
`set= um) keywords)
`set(thaaural keywords)
`sel(p ret keywords)
`seaparent keywords)
`set chid 4keywords )
`set(child keywords)
`set (proposed keywords)
`seaproposal keywords)
`
`208
`208
`
`218
`
`206
`206
`e
`
`216
`
`u
`Event
`ID
`ID
`type
`type
`sub-type
`sub-type
`InlOut Timecodes
`In/Out Timecodes
`comment
`comment
`
`Pesn218
`Person
`ID
`ID
`Primary Name
`Primary Name
`Occupation
`Occupation
`Date of Birth
`Date of Birth
`set(propmsed persons)
`set(proposed persons)
`
`222
`222
`
`e
`
`TheaurtalPrsn
`Thesaural Minim
`ID
`ID
`Name
`Name
`Preferred Flag
`Preferred Flag
`
`Thesgural Kcgwor
`Thecaural Keyword
`ID
`ID
`keyword ID
`keyword ID
`Label
`Label
`Language of Choice
`Preferred Flag
`Characteristic
`Characteristic
`
`212
`2122124
`Proposed Keyword
`ID
`Label
`
`214
`
`224
`
`Prgosend Person
`Proposed Person
`ID
`ID
`Name
`Name
`
`Imag / ideo
`Image / Video
`ID
`ID
`IrMut Timecodes
`In/Out Timecodes
`Locator
`Locator
`
`220
`220
`
`Person In formation"
`Person Information
`Person ID
`Person ID
`Person Attribute
`Person Attribute
`
`226
`226
`
`FIG. 2D
`FIG. 2D
`
`Page 12 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3,2001 (cid:9)
`
`Sheet 6 of 34
`Sheet 6 of 34 (cid:9)
`
`US 6,212,527 BI
`US 6,212,527 131
`
`286 NThesaural
`286 -N.. (cid:9)
`Thesaural (cid:9)
`Keyword One
`Keyword One (cid:9)
`
`Thesaural
`Thesaural (cid:9)
`Keyword Two
`Keyword Two (cid:9)
`
`Thesaural
`Thesaural (cid:9)
`Keyword Three
`Keyword Three (cid:9)
`
`Thesaural
`Thesaural
`Keyword Four
`Keyword Four
`
`288
`288
`\
`
`Keyword
`Keyword
`Instance
`Instance
`One
`One
`
`290D
`290C 'N291D
`2900
`290A
`
`291E \
`291E
`291D
`291C
`291C
`291B
`291B
`291Av
`291A
`
`292B
`
`293B0J
`29313
`293A \
`293A
`
`294B0[
`294B (cid:9)
`\ j
`294A
`294A (cid:9)
`
`295B
`295B
`295A
`295A
`
`Keyword
`Keyword
`Instance
`Instance
`Two
`Two
`
`296C
`2960
`296A
`
`297B
`297
`297A \Nt
`297A
`
`FIG. 2E
`FIG. 2E
`
`Page 13 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001
`
`Sheet 7 of 34
`Sheet 7 of 34 (cid:9)
`
`US 6,212,527 BL
`US 6,212,527 B1
`
`I, (cid:9)
`
`
`
`I (cid:9)
`
`302
`302
`
`309
`301
`Questionsr 31
`-11 Questions
`303
`303
`luotionir
`306
`306
`
`308
`308 (cid:9)
`J/
`/
`
`/
`314
`
`305WF--t
`
`305
`
`Exit
`
`318 (cid:9)
`
`310 (cid:9)
`
`320 (cid:9)
`
`/ (cid:9)
`312 (cid:9)
`
`300 (cid:9)
`
`n
`DeeeMege
`Delete/Merge I ( (cid:9) Segment I
`
`316 .
`
`316 -,
`
`~rase
`Save Phrase I (cid:9)
`
`FIG. 3A
`FIG. 3A
`
`Page 14 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001 (cid:9)
`
`Sheet 8 of 34
`Sheet 8 of 34 (cid:9)
`
`US 6,212,527 RI
`US 6,212,527 B1
`
`322 (cid:9)
`322
`
`304A -
`
`~k'tiK
`
`• . • (cid:9)
`
`327 (cid:9)
`
`334A
`tIAA
`
`Ii I
`304A i) 1 1
`
`304
`/
`
`334N
`~AM
`
`I I I
`
`322 / (cid:9)
`
`323 / (cid:9)
`
`324 A (cid:9)
`
`325 11 (cid:9)
`
`326 / (cid:9)
`
`327 /
`
`306
`306
`
`/ 1
`
`FIG. 3B
`FIG. 3B
`
`Page 15 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Apr. 3, 2001
`Apr. 3, 2001 (cid:9)
`
`Sheet 9 of 34
`Sheet 9 of 34 (cid:9)
`
`US 6,212,527 Ri
`US 6,212,527 B1
`
`390
`340
`
`2 (cid:9)
`
`310
`310
`/
`
`rEHkam 346
`mi Er
`EFIEDEF L=Pw]
`=PlPoPCsE1 4
`
`4:1041
`
`392
`342
`,
`
`FIG. 3C
`FIG. 3C
`
`Page 16 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Apr. 3, 2001 (cid:9)
`Apr. 3,2001
`
`Sheet 10 of 34 (cid:9)
`Sheet 10 of 34
`
`US 6,212,527 BL
`US 6,212,527 B1
`
`350A
`
`314
`
`/354
`354
`.
`/ a
`b
`
`b cdef h
`
`d
`e
`f
`
`A
`—
`=
`...
`
`/350C
`j. 350C
`
`1
`
`k mn 0 pq
`
`n
`0
`p
`1
`r
`
`352
`352
`
`354A
`354A -
`
`354B
`354B
`
`354C
`354C -
`
`3540
`354D-
`
`354E
`354E -
`
`354F
`354F'.
`
`350B
`
`I Keyword Alphabetic,
`[Keyword Alphabetical I
`.
`
`Keyword
`Keyword
`
`I
`
`Type
`Type
`
`• war crimes (cid:9)
`war crimes
`• Chasidim (cid:9)
`Chasidirn
`
`• Hasidic Jews (cid:9)
`Hasidic Jews
`
`• Germany (cid:9)
`Germany
`
`• world (cid:9)
`world
`
`he World War 11 (cid:9)
`World Warl1l
`
`356A ..
`• war crimes
`35A
`war crimes
`356B -,
`Jews
`% Jews
`356C
`356C \Jewish religion
`Jewish religion
`3560 -,
`‘ country
`35D
`country
`356E -,
`•• place
`place
`35E
`356F ...
`N..
`36
`
`war
`war
`
`350E
`350E
`
`r 8 t U vwx yz
`
`t
`
`V
`w
`
`y
`
`3500
`350D
`/
`
`<1 t1
`< (cid:9) " I
`
`> V
`
`FIG. 3D
`FIG. 3D
`
`Page 17 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001
`
`Sheet 11 of 34
`Sheet 11 of 34 (cid:9)
`
`US 6,212,527 RI
`US 6,212,527 B1
`
`316
`
`360
`
`360
`
`62
`362
`
`364
`34
`
`36
`366
`
`368370
`368
`
`370
`
`Segment/Notes
`
`Start (cid:9)
`
`End
`
`Keywords (cid:9)
`
`Proposed
`
`MAW W
`I Born Decernber 5, 1924, Ln Lodz ... 01:00:00:OD 01:08:48:21 brothers ihommssisters dating life
`1 (cid:9) Born December 5, 1924, in Lodz... 01:00:00:0001:08:48:21 brothers •homes•sisters dating lite
`37B 2 Family was happy. Parents were ... 01:08:48:21 01:12:49:15 behavior * students
`2 Family was happy. Parents were... 01:08:48:21 01:12:49:15 behavior • students (cid:9)
`
`teachers ' child
`teachers • child
`
`A
`-
`
`3
`
`372
`
`372A
`374A
`374A
`
`374B
`
`374C
`374C
`
`372B
`
`<91
`
`V
`
`FIG. 3E
`FIG. 3E
`
`Page 18 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001 (cid:9)
`
`Sheet 12 of 34
`Sheet 12 of 34 (cid:9)
`
`US 6,212,527 BL
`US 6,212,527 B1
`
`308
`
`2_
`
`382
`382
`
`384
`384
`
`386
`386
`
`388
`388
`
`ww rnr rnE
`l
`D11E
`
`Interviewer
`Interviewer
`
`Videographer
`Videographer
`
`(*)
`
`a
`
`+ ?
`
``3
`
`Pact
`Pact
`T
`
`Other
`Other
`
`CD
`
`FIG. 3F
`FIG. 3F
`
`Page 19 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3,2001
`Apr. 3, 2001 (cid:9)
`
`Sheet 13 of 34
`Sheet 13 of 34 (cid:9)
`
`US 6,212,527 BL
`US 6,212,527 B1
`
`402
`
`404
`
`408
`
`it New Keyword
`o4fom
`y Keyword from Hilitel New Keyword
`Keywords for this Phrase I Type
`
`~
`
`o'
`
`for this Phrase IType
`
`IKeywords
`
`(cid:9)r
`Proposed Item
`Proposed ItemiI
`
`A
`a —
`
`A
`
`V
`418
`
`P
`
`A
`a
`
`< (cid:9)
`
`99
`
`V
`
`<a
`
`<TNT
`
`I>
`
`V
`
`>
`
`-j416
`
`416
`
`Proposed Keyword
`
`I Comment
`
`Keyword Hierarchy
`
`e
`
`410
`
`ei
`
`412
`
`< (cid:9)
`
`oo
`
`Word Used
`
`I Preferred Tenn
`
`< (cid:9)
`
`00 I
`
`A
`a
`
`V
`
`A
`
`a
`.—,
`
`V
`
`>
`
`>
`
`Keyword
`
`Type
`
`< a
`
`1
`
`414
`
`A
`
`a
`
`V
`
`>
`
`FIG. 4
`FIG. 4
`
`Page 20 of 356
`
`MINDGEEK EXHIBIT 1008
`
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001
`
`Sheet 14 of 34 (cid:9)
`Sheet 14 of 34
`
`US 6,212,527 B1
`US 6,212,527 Ri
`
`520
`518
`518 (cid:9)
`520
`6
`516
`d
`1
`1
`/ I
`1
`Did the interviewer appear on cameral ye
`era 0 Yes
`Did the interviewer appear on cam
`and properly introduce him/herself,0
`and properly introduce him/horse f,
`the interviewee, and the interview? 0 N°
`No
`the interviewee, and the Intermew?
`A
`5S2 -,
`522 N.
`se
`
`I1
`
`L
`
`512A\
`512A
`
`502 (cid:9)
`/ (cid:9)
`
`V
`5 8 520
`518
`520
`516
`516
`/ 1
`i
`12_
`[2j
`.
`Did the interviewer ask open-ended
`(:) Yes
`Did the interviewer ask open-ended
`questions, allowing the interview to
`qulestions, allowing the interview to
`5125 -
`51213
`flow?
`
`0 N°
`
`{flow?
`
`522 -
`522 -.,
`N.
`
`H I Fet
`
`A
`
`et
`
`A
`se
`
`V
`
`i ai a
`wEliEll
`
`Segments
`1
`532
`532
`
`534
`534
`
`536
`536
`
`~5W
`Still Prattle V 5°6
`V
`508
`520
`316
`S1g
`sib (cid:9)
`
`i 508 (cid:9) 516 (cid:9)
`520
`J
`./
`ti (cid:9)
`/
`I
`1.510 IL
`Did the interviewer attempt to clari fy 0 Yes
`Did the Interviewer attempt to clarify
`
`details without disrupting the
`details without disrupting the
`C) No
`interview?
`
`Go to Phrase
`
`Co to Lest
`
`512C
`512C
`
`interview?I
`
`522 -,
`522 -\..
`
`FIG. 5
`FIG. 5
`
`Page 21 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`

`

`U.S. Patent (cid:9)
`U.S. Patent
`
`Apr. 3, 2001
`Apr. 3, 2001 (cid:9)
`
`Sheet 15 of 34 (cid:9)
`Sheet 15 of 34
`
`US 6,212,527 BL
`US 6,212,527 B1
`
`(cid:9)/ 602
`
` 604
`pc
`
`606
`
`TC_?ni
`TC_In
`\
`612
`
`610
`•
`nterviewe]
`4.-?
`Interviewer
`\
`N
`A
`—
`616
`614
`Et
`
`TC-I
`TC_In +-7
`+-?
`\
`\
`622
`624
`622
`624
`
`620
`•
`Videg,pher
`Videographer
`\
`A
`—
`626A
`626
`a
`
`<I
`612
`
`64
`
`616
`
`V
`
`L
`
`I>
`630
`
`<
`
`V
`
`>
`640
`
`TC In +-7
`\
`632
`
`634
`
`
`636
`
`Factual
`
`A
`—
`set
`
`TC_In +-1
`\
`\
`644
`642
`644
`642
`
`\
`646
`646
`
`Other
`
`A
`—
`a
`
`<
`
`V
`
`>
`
`<
`
`V
`
`>
`
`A
`a
`
`A a
`
`V
`v
`
`>
`
`<
`
`656
`
`FIG. 6
`FIG. 6
`
`Page 22 of 356
`
`MINDGEEK EXHIBIT 1008
`
`(cid:9)
`(cid:9)
`(cid:9)
`

`

`U.S. Patent
`U.S. Patent (cid:9)
`
`Apr. 3, 2001
`Apr. 3, 2001
`
`Sheet 16 of 34
`Sheet 16 of 34 (cid:9)
`
`US 6,212,527 B1
`US 6,212,527 B1
`
`702
`
` 742
`Item
`,742
`Item
`lactions -*"
`i
`actions
`/174
`antisemnitic actions
`744
`antisemitic actions er
`746 -N. anti-Jewish measures and legislation
`: nti-Jowigh measures and Ieglslation
`7
`antisernitic comments and behavior
`antisemitic comments and behavior
`attacks on Jewish homes
`attacks on Jewish homes
`attacks on synagogues
`attacks on synagogues
`desecration of cemeteries
`desecration of cemeteries
`bystander responses to H-ollocaust
`bystander responses to Hollocaust
`744 deadly actions
`deadly actions
`744 (cid:9)
`Nazi government actions
`Nazi government actions
`violent actions
`violent actions
`742
`amenities
`amenities (cid:9)
`r 742
`canmp personnel
`camp personnel "
`character and behavior
`character and behavior
`
`734
`734
`
`V
`V
`:
`
`10
`1<1 gI
`
`732
`
`704
`
`Unclassified Iterm
`Unclassified Item
`
`A
`A
`
`714
`
`714
`\
`FNew
`New
`
`Jewish nonviolent resistance
`Jewish nonviolent resistance
`Nazi courts
`Nazi courts
`occupations
`occupations
`personal property
`personal property
`
`z 752
`752
`
`A
`A
`
`ft
`_
`
`71