Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 1 of 18
`
`EXHIBIT A
`(Part 1 of 6)
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 2 of 18
`I 1111111111111111 11111 111111111111111 IIIII IIIII 1111111111 111111111111111111
`US008856030B2
`
`c12) United States Patent
`Russek
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,856,030 B2
`Oct. 7, 2014
`
`(54) METHOD, SYSTEMANI> SOFTWARE FOR
`ASSOCIATING ATTRIBUTES WITHIN
`DIGITAL MEDIA PRESENTATIONS
`
`(75)
`
`Inventor: David J. Russek, Maple Glen, PA (US)
`
`(73) Assignee: Sevenecho, LLC, Norristown, PA (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 1841 days.
`
`(21) Appl. No.: 10/819,514
`
`(22) Filed:
`
`Apr. 7, 2004
`
`(65)
`
`Prior Publication Data
`
`US 2004/0199923 Al
`
`Oct. 7, 2004
`
`Related U.S. Application Data
`
`(60)
`
`Provisional application No. 60/460,998, filed on Apr.
`7, 2003.
`
`(51)
`
`(52)
`
`(58)
`
`(2012.01)
`(2012.01)
`(2006.01)
`
`Int. Cl.
`G06Q30/02
`G06Q30/00
`G06F 17130
`U.S. Cl.
`CPC .......... G06F 17/30867 (2013.01); G06Q 30/00
`(2013.01); G06F 17/30265 (2013.01)
`LJSPC ........................................ 705/14.66; 705/319
`Field of Classification Search
`CPC ........................... G06Q 50/01; G06Q 30/0269
`USPC ......................................... 705/14, 14.66, 319
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,119,474 A
`5,586,967 A
`5,604,855 A
`5,625,570 A
`
`6/1992 Beitel et al.
`12/1996 Davis
`2/1997 Crawford
`4/ 1997 Vizireanu
`
`....... 709/228
`
`11/1997 Roach
`5,692,212 A
`3/1998 Weathers
`5,725,472 A
`3/1998 Rogers
`5,734,795 A
`5,751,953 A
`5/1998 Shiels
`5,754,787 A * 5/1998 Dedrick
`5,774,664 A
`6/1998 Hidary
`5,805,784 A
`9/1998 Crawford
`5,848,934 A
`12/1998 Shiels
`5,861,881 A
`1/1999 Freeman
`5,872,927 A
`2/1999 Shiels
`5,913,310 A
`6/1999 Brown
`5,918,603 A
`7/1999 Brown
`5,935,003 A
`8/1999 Stephens
`5,945,988 A
`8/1999 Williams
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`WO
`
`0177939 Al
`
`10/2001
`
`OTHER PUBLICATIONS
`
`Quintana, Y.: "Design of an Object-Oriented Multimedia Database
`for Personalize Multimedia News". Proc. 1996 Canadian Conf. on
`Electrical and Computer Engg., May 26, 1996-May 29, 1996; pp.
`282-285, XP002460458, Calgary, Canada.
`
`Primary Examiner - Donald L. Champagne
`(74) Attorney, Agent, or Firm····· Pepper Hamilton LLP
`
`(57)
`
`ABSTRACT
`
`Disclosed are a system, method and software to associate
`attributes with digital media assets. Digital media contains
`specific assets, such as images, that can be replaced with other
`assets. The system, method and software pem1it the associa(cid:173)
`tion of attributes with specific assets. The association of
`attributes and assets enables the provision of content that is
`enhanced and more impacting for a user.
`
`2 Claims, 25 Drawing Sheets
`
`USER
`
`I
`501
`
`ONLINE
`COMMUNITY
`
`521
`
`STORED USER
`PROFILE
`
`531
`
`541
`
`551
`
`10Tales0000001
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 3 of 18
`
`US 8,856,030 B2
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,977,968 A
`5,987,415 A
`5,999,172 A
`6,029,195 A
`6,078,936 A
`6,088,717 A
`6,120,846 A
`6,135,944 A
`6,175,772 Bl
`6,190,314 Bl
`6,205,472 Bl
`6,222,925 Bl
`6,249,780 Bl
`6,293,904 Bl
`6,306,077 Bl
`6,311,194 Bl
`6,317,127 Bl
`6,330,595 Bl
`6,345,288 Bl
`6,357,042 B2
`6,421,669 Bl
`6,425,825 Bl
`6,466,232 Bl
`6,499,741 B2
`
`11/1999 Le Blanc
`11/1999 Breese
`12/1999 Roach
`2/2000 Herz
`6/2000 Martin
`7/2000 Reed
`9/2000 Hin
`10/2000 Bowman
`1/2001 Kami
`2/2001 Ark
`3/2001 Gilmour
`4/2001 Shiels
`6/2001 Mizokawa
`9/2001 Blazey
`10/2001 Prab
`10/2001 Sheth
`11/2001 Daily
`12/2001 Ullman
`2/2002 Reed
`3/2002 Srin
`7/2002 Gilm
`7/2002 Sitrick
`10/2002 Newell
`12/2002 Yarnazalci
`
`6,513,011 Bl
`6,513 ,069 Bl
`6,520,905 Bl
`6,526,395 Bl
`6,527,700 Bl
`6,529,864 Bl
`6,545,209 Bl
`6,581,037 Bl
`6,585 ,521 Bl
`6,604,091 B2
`7,000,180 B2
`7,162,432 B2
`7,483,871 B2 *
`8,635,649 B2 *
`2001/0049588 A 1
`2002/0013943 Al
`2002/0092019 Al
`2002/0122430 Al
`2002/0159640 Al
`2003/0001880 Al
`2003/0009078 Al
`2003/0036899 Al
`2003/0045957 Al
`2003/0131351 Al
`2003/0142689 Al
`2004/0267816 Al
`
`1/2003 Uwakubo
`1/2003 Abato
`2/2003 Surve
`2/2003 Morris
`3/2003 Manico
`3/2003 Chase
`4/2003 Flannery
`6/2003 Pak
`7/2003 Obrador
`8/2003 Sadakuni
`2/2006 Balthaser
`1/2007 Mascarenhas
`1/2009 Herz
`1/2014 Ward et al.
`12/2001 Bausch et al.
`1/2002 Haberman
`7/2002 Marcus
`9/2002 Haberman
`10/2002 Vaithilinga
`1/2003 Holtz et al.
`1/2003 Fedorovskaya
`2/2003 Leslie et al.
`3/2003 Haberman
`7/2003 Shapira
`7/2003 Haberman
`12/2004 Russek
`
`* cited by examiner
`
`1/1
`725/40
`
`10Tales0000002
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 4 of 18
`
`U.S. Patent
`
`Oct. 7, 2014
`
`Sheet 1 of 25
`
`US 8,856,030 B2
`
`...--
`0 ...-
`
`0:::
`0
`(/) z
`0
`0...
`Cf)
`
`co
`C>
`, -
`
`C)
`C)
`
`w 0:::
`>O
`I- u
`-
`I-
`<t: w
`~ a::
`uo
`
`)
`C)
`...-
`...-
`
`....J 1-
`
`<t: z zw
`(9 z
`1-
`-
`0::: 0
`OU
`
`co
`0
`, -
`
`0 I-w z -w
`u... I-oz oo ~u
`
`a::
`w
`- - -~ -.:r-
`::>v' C)
`(/)
`, -
`- - - z
`0 u
`
`1 0Tales0000003
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 5 of 18
`
`U.S. Patent
`
`Oct. 7, 2014
`
`Sheet 2 of 25
`
`US 8,856,030 B2
`
`U) w
`0U
`wZ
`0W
`-=> >a
`w
`U)
`
`<(
`
`0 w (/)
`~ 1-
`__J w
`<( (/)
`I- ~
`(9
`0
`
`(9 (/)
`zu
`O I
`zo...
`'&.'&.
`co (9
`
`<D
`0
`N
`
`0 z
`::::> (/)
`Ow
`0::: (9
`(9 <(
`w~
`a:: -
`0
`LL
`
`N
`0
`N
`
`0 z
`::::> (/) ow
`0::: (9
`(9 <(
`~ ~ u-
`ca
`~-------,
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`L - -~~ - -
`
`0
`N
`
`::i 0
`I- --(cid:143) (9 ::::,
`
`0 <(
`
`..-
`N
`
`I(cid:173)x w
`
`I-
`
`co
`0
`N
`
`~ N ..-
`
`N
`
`10Tales0000004
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 6 of 18
`
`MUSIC & LYRICS
`
`~
`00
`•
`""d
`~
`~
`
`~ = ~
`
`302
`300 .
`
`r--
`
`INTERNAL
`IMAGES
`AND 304 J\
`EMOTIONS
`
`-
`
`-
`
`i-./'322
`•
`
`r-----------------------------------
`
`-------------------- - ---------- - -------------- -- ----------- - ----------- - ------------------ - ------,
`' 306
`-
`-
`..,
`-
`-
`-
`-
`-
`..,
`I -
`I
`, - - - - - - ,
`- - - - - - . V'
`I
`I
`I
`:
`I
`I
`I
`I
`I
`:
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`:
`I
`I
`I
`I
`I
`I
`I
`I
`:
`I
`I
`I
`I
`I
`I
`I
`I
`:
`I
`:
`~-----
`~-----
`~ - - - - - 1
`~ - - - - - '
`I
`I
`I
`'
`
`PERSONALIZED
`(INTERNAL)
`USER STORY
`
`- - - • • • • • • • • • • - - - - - - • • • • • • I
`
`0
`
`l") ...
`0 ..... ...
`
`~-..l
`N
`
`rJJ =(cid:173)~
`~ .....
`
`~
`0
`~
`N
`Ul
`
`d r::,;.
`00
`00
`Ul
`
`0', = w = co
`
`N
`
`l,
`
`324_____ ~
`s
`w
`I 0·23
`I
`·
`
`I <(
`
`I <i!
`
`-----, ~
`l
`------l
`320 1 ( + ) l ~ ~~::: ~ / -- ---------------------------------------------,_,_ 312
`
`---------------------------------------------------------------------------------------
`
`NEW
`PERSONALIZED
`(INTERNAL)
`USER STORY
`
`NEW
`IMAGES
`AND 310 J\:
`: : .___ _ ___,
`EMOTIONS
`' -
`
`-
`
`FIG. 3
`
`......
`0
`-l
`Q) co
`
`CJ)
`0
`0
`0
`0
`0
`0
`0,
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 7 of 18
`
`U.S. Patent
`
`Oct. 7, 2014
`
`Sheet 4 of 25
`
`US 8,856,030 B2
`
`L1J
`r o
`_. z
`::, L1J
`<( -
`
`LL 0:::: wW
`0 CL X
`L1J
`
`o:::: en wr
`Gz
`G(cid:173)- 0
`0:::: CL
`r
`
`®
`
`®
`
`C)
`N
`C"")
`
`' @
`
`@
`
`@
`
`C)
`C)
`-.:::t"
`
`\
`en
`wwN > - o
`rr-.:::r-
`(..) z
`~~
`WO::: r o
`z 0...
`_a..
`0
`
`0 ww
`N
`(..)
`_J z
`<( w z-
`0 ffi
`en CL
`o::::x
`WW
`CL
`
`w _.
`
`LL
`0
`0::::
`CL
`0::::
`L1J en
`::,
`0
`w
`(..)
`z
`<(
`:r:
`z
`L1J
`
`-.:::t"
`0
`-.:::t"
`
`C)
`N
`C"")
`
`'
`' ®
`
`®
`
`CD
`C)
`""-T
`
`~
`(!)
`tt
`
`10Tales0000006
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 8 of 18
`
`CONTENT
`
`531
`
`~
`00
`•
`""d
`~
`~
`
`~ = ~
`
`590
`s
`SERVER
`
`MODIFIED CONTENT
`STORAGE
`
`551
`
`0
`
`~ ...
`0 ..... ...
`
`~.....:i
`N
`
`~
`
`rJl =(cid:173)~
`""""
`lll
`0
`~
`N
`lll
`
`d r::,;_
`00
`00
`'JI
`
`0', = w = cc
`
`N
`
`USER
`
`s
`501
`
`ONLINE
`COMMUNITY
`
`521
`
`STORED USER
`PROFILE
`
`FIG. 5A
`
`......
`0
`-I
`Q) co
`
`CJ)
`0
`0
`0
`0
`0
`0
`-J
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 9 of 18
`
`528
`
`INTERPRETED EMOTION AND
`OUTSIDE DATA MAPPING
`
`524
`
`TRAVELING
`PROFILE
`MANAGEMENT
`
`PROFILE
`SECURITY
`
`522
`
`FIG. 5B
`
`......
`0
`-I
`Q) co
`
`CJ)
`0
`0
`0
`0
`0
`0
`00
`
`502
`
`AUDIENCE1
`
`EXPERIENCE1
`
`504
`
`500
`
`UP
`MONITOR
`
`UP1
`
`520
`
`ASSET SEQUENCING,
`TIMING AND SECURITY
`
`511
`
`LISTS OF THE PEOPLE ONLINE AND
`THEIR COMMENTS TO BE BROUGHT
`IN AS TRIGGER POINTS
`
`514
`
`DIGITAL ASSET
`REPOSITORY
`
`Udir
`
`I 1/0 MAP ~513
`
`•
`
`GROUP AND
`SOCIAL
`DYNAMICS
`
`518
`
`DIGITAL BASED
`EVOLVING NATURE OF
`STORY (Ai)
`
`516
`
`~
`00
`•
`""d
`~
`~
`
`~ = ~
`
`0
`~ ...
`0 ..... ...
`
`~.....:i
`N
`
`~
`
`rJl =(cid:173)~
`"""" 0-,
`0
`~
`N
`Ul
`
`d r::,;_
`00
`00
`'JI
`
`0', = w = cc
`
`N
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 10 of 18
`
`U.S. Patent
`
`Oct. 7, 2014
`
`Sheet 7 of 25
`
`US 8,856,030 B2
`
`<,
`
`/
`
`'
`
`...I < z
`
`0
`j::
`0
`~ w
`
`(.f) w
`1-
`z
`LL
`LL
`<(
`
`(")
`
`0 c.o
`
`w
`>
`j:: z
`0 u
`
`(!)
`
`N
`0 c.o
`<.
`
`...J <
`u
`0
`en
`
`10Tales0000009
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 11 of 18
`
`ANALYTICAL
`
`702
`
`720 '-"'I QUANTIFY
`
`VERBAL
`PROCESSING
`
`706
`
`INFERENCING
`
`708
`
`VISUALIZATION
`
`FIG. 7
`
`603
`
`COGNITIVE
`
`718
`
`ANALOGY
`
`716
`
`ACQUISITION
`OF NEW
`INFORMATION
`
`SPEECH
`UNDERSTANDING/
`REPRODUCTION
`
`710
`
`714
`
`WRITTEN
`LANGUAGE
`ACQUISITION/
`RECOGNITION
`
`712
`
`......
`0
`-I
`Q) co
`
`CJ)
`0
`0
`0
`0
`0 ......
`0
`
`~
`00
`•
`""d
`~
`~
`
`~ = ~
`
`0
`~ ...
`0 ..... ...
`
`~.....:i
`N
`
`~
`
`rJl =(cid:173)~
`"""" QO
`0
`~
`N
`Ul
`
`d r::,;_
`00
`00
`'JI
`
`0', = w = cc
`
`N
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 12 of 18
`
`602
`
`820
`
`SOCIAL
`
`~
`
`--- \
`
`"'
`
`~ULTIPLE INTERNA~
`NARRATIVE
`PERCEPTION
`IDENTIFICATION
`FRAMEWORK
`(Alter Egos)
`~
`
`'
`
`""
`
`""-/ ~
`
`818
`
`802
`
`GROUPS
`
`804
`
`SOCIAL
`PERCEPTION
`IDENTIFICATION
`F~MEWORK
`~-Egos}
`
`\
`
`806
`
`AFFINITIES &
`TRIAD
`
`808
`
`LEVEL OF
`INVOLVEMENT
`
`_____,/
`
`810
`
`MODES OF
`INTERACTION
`
`814
`
`APT/INEPT
`
`816
`
`(
`
`SOCIAL PERSONAS
`(How people perceive
`
`~==)
`
`RELATIONSHIPS
`
`812
`
`FIG. 8
`
`......
`0
`-I
`Q) co
`
`CJ)
`0
`0
`0
`0
`0 ......
`......
`
`~
`00
`•
`""d
`~
`~
`
`~ = ~
`
`0
`~ ...
`0 ..... ...
`
`~.....:i
`N
`
`~
`
`rJl =(cid:173)~
`"""" 1,0
`0
`~
`N
`Ul
`
`d r::,;_
`00
`00
`'JI
`
`0', = w = cc
`
`N
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 13 of 18
`
`601
`
`....--......
`
`AFFINITY
`
`\
`J
`
`C"Al"'I A I
`
`\jFRIENDSL/
`
`FIG. 9
`
`......
`0
`-I
`Q) co
`
`CJ)
`0
`0
`0
`0
`0 ......
`
`I\)
`
`e •
`00
`•
`""d
`~
`~
`
`~ = ~
`
`0
`
`~ ...
`0 ..... ...
`
`~.....:i
`N
`
`~
`
`rJl =(cid:173)~
`.....
`""""
`0
`0 ....
`
`N
`Ul
`
`d r::,;_
`00
`00
`'JI
`
`0', = w = cc
`
`N
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 14 of 18
`
`U.S. Patent
`
`Oct. 7, 2014
`
`Sheet 11 of 25
`
`US 8,856,030 B2
`
`CREATIVE DIRECTOR
`LISTENS/WATCHES
`CONTENT
`
`1000
`
`TAG TIME INDICES
`WITH AFFINITIES
`
`../' 1010
`
`NO
`
`SUFFICIENT
`TAGGING?
`
`../' 1020
`
`YES
`
`EDIT AFFINITIES
`COALESCE MEANING
`IDENTIFY MAPPING
`
`1030
`
`STORE TAGS
`
`1040
`
`CREATE INTERACTIONS
`
`1050
`
`DEVELOP COLLATERAL
`MATERIALS
`
`1060
`
`FIG. 10
`
`10Tales0000013
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 15 of 18
`
`USER ID
`372915
`
`PASSWORD
`GOFISH
`
`E-MAIL
`SMITH@ISP.NET
`
`USER ID
`372915
`372915
`372915
`
`PROFILE ELEMENT KNOWN/UNKNOWN
`ART
`KNOWN
`BIRDS
`UNKNOWN
`APPLIANCES
`KNOWN
`
`IMPORTANCE
`MEDIUM
`
`LOW
`
`USER ID
`372915
`372915
`372915
`
`PROFILE ELEMENT VALUE
`ART
`ABSTRACT
`ART
`RENAISSANCE
`APPLIANCES
`STOVE
`
`RANK
`3
`7
`5
`
`~
`00
`•
`~
`~
`(""'lo,(cid:173)
`
`(0 = (""to,-
`
`0
`~
`r-t-
`_,---l
`N
`0
`~
`.i;..
`
`r.,J =(cid:173)~
`
`~
`~
`
`1101
`
`1111
`
`1121
`
`~
`N
`
`0 ....
`
`N
`IJ'I
`
`FIG. 11
`
`d
`00
`00
`00
`Ul
`°" Q
`
`~
`0
`e0
`N
`
`.....
`0
`-I
`Ill ro
`
`(J)
`0
`0
`0
`0
`0 .....
`
`.j:>,.
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 16 of 18
`
`U.S. Patent
`
`Oct. 7, 2014
`
`Sheet 13 of 25
`
`US 8,856,030 B2
`
`PERSON
`
`1200
`
`AFFINITY LIST
`GET AFFINITIES
`SET AFFINITIES
`
`1210
`
`PEOPLE GROUP
`
`SET OF PEOPLE
`
`1220
`
`EXPERIENCE
`
`GROUP OF PEOPLE
`RECORDED AFFINITIES
`MEDIA
`
`1240
`
`AFFINITY
`NAME
`DESCRIPTION
`PARENT
`CHILD
`GROUP
`
`1230
`
`RECORDED AFFINITIES
`
`TYPE
`AFFINITY
`
`FIG. 12
`
`10Tales0000015
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 17 of 18
`
`TO/FROM
`NETWORK
`
`TO/FROM
`KEYBOARD
`
`TO/FROM
`TO/FROM
`MONITOR SERIAL PORT DEVICE
`
`ISASLOTS
`,......, ,--
`
`1332 v-
`
`PCI SLOTS
`
`, -
`
`v-'1326
`
`1344
`1340
`1336 I
`~ ~ ~
`1
`
`I j l ~
`
`1/0
`13 ~ CONTROLLER
`
`v-'1308
`
`RAM
`
`~ur 13~
`
`I
`
`1304
`
`, er
`
`t
`
`ROM(cid:173)
`BIOS
`
`1324
`
`1Q1=
`
`CPU
`
`v-'1312
`
`FIG. 13
`
`1300
`_s_
`r<::: __ ::>
`
`1
`
`HARD DRIVE
`
`~
`00
`•
`~
`~
`
`"""' ~ = """'
`
`0
`~
`:"'"
`"--...l
`N
`
`0 ....
`""'
`
`r.,J =(cid:173)~
`~ ....
`....
`""' 0
`
`~
`N
`Ul
`
`d
`00
`00
`00
`'JI
`°' c:.,
`
`~
`0
`c:c
`N
`
`.....
`0
`-I
`Ill ro
`
`(J)
`0
`0
`0
`0
`0 .....
`
`0)
`
`

`

`Case 6:20-cv-00810-ADA Document 73-2 Filed 04/23/21 Page 18 of 18
`
`U.S. Patent
`
`Oct. 7, 2014
`
`Sheet 15 of 25
`
`US 8,856,030 B2
`
`1410 __,,,...
`
`TOOLBAR
`
`J,l
`
`Q
`
`A
`
`0
`
`AUDIO
`
`ST 1
`
`ST 2
`
`IT 1
`
`BACKGROUND 1
`
`BACKGROUND 2
`
`TEXT 1
`
`~ El ./' 1400
`
`./' 1 420
`Ml
`I
`
`fr
`
`2:56
`
`1430
`
`1432
`
`1434
`
`1436
`
`IT 2 t - - - - - - - - - - - - - - - - - - - v 1438
`TEXT2
`
`FIG. 14
`
`10Tales0000017
`
`