Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 1 of 32
`
`Exhibit 8
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 2 of 32
`
`US008549097B2
`
`(12) United States Patent
`Katinsky et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,549,097 B2
`*Oct. 1, 2013
`
`(54) WEBAPPLICATION FOR ACCESSING
`MEDIA STREAMS
`
`(75) Inventors: Steve Katinsky, Los Angeles, CA (US);
`Michael Burress, Venice, CA (US);
`Jefferson Furtado, Galt, CA (US)
`(73) Assignee: Copper Data River LLC, Los Altos,
`CA (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 1551 days.
`This patent is Subject to a terminal dis
`claimer.
`
`(*) Notice:
`
`(21) Appl. No.: 11/514,018
`(22) Filed:
`Aug. 30, 2006
`
`(65)
`
`Prior Publication Data
`US 2006/0288.111A1
`Dec. 21, 2006
`
`Related U.S. Application Data
`(63) Continuation of application No. 10/210.203, filed on
`Jul. 31, 2002, now Pat. No. 7,610,394, which is a
`continuation of application No. 09/187.256, filed on
`Nov. 6, 1998, now Pat. No. 6,452,609.
`
`(2006.01)
`(2006.01)
`(2006.01)
`
`(51) Int. Cl.
`G06F 15/16
`GIB 7085
`GIIB 2/08
`(52) U.S. Cl.
`USPC ......................... 709/217; 709/219; 369/30.08
`(58) Field of Classification Search
`None
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`WO
`
`U.S. PATENT DOCUMENTS
`5,353,401 A 10, 1994 Iizawa et al.
`5,668,788 A * 9/1997 Allison ......................... 345,173
`5,724,595 A
`3, 1998 Gentner ......
`707/5O1
`5,793,366 A
`8, 1998 Mano et al. .
`T15,839
`5,796,945 A
`8, 1998 Tarabella ....
`TO9,219
`5,864,868 A
`1/1999 Contois ................................. 1.1
`5,872,747 A * 2/1999 Johnson ......
`369/30.08
`5,892,915 A * 4/1999 Duso et al. ...
`TO9,219
`5,905,983 A
`5/1999 Inomata et al. ................... 7O7/4
`5,918,213 A * 6/1999 Bernard et al. ...
`705/26.35
`5,953,005 A * 9/1999 Liu ................
`T15,243
`5,969.283 A * 10/1999 Looney et al. .................. 84.609
`5,986,979 A * 1 1/1999 Bickford et al.
`369/30.09
`6,005,563 A * 12/1999 White et al. ...
`715,718
`6,018,768 A *
`1/2000 Ullman et al. .....
`TO9.218
`6,025,841 A
`2/2000 Finkelstein et al.
`... 345,342
`6,133,913 A 10/2000 White et al. .................. 345,327
`(Continued)
`FOREIGN PATENT DOCUMENTS
`WOOO,28396
`5, 1999
`OTHER PUBLICATIONS
`U.S. Appl. No. 12/485,236, filed Jun. 16, 2009, Katinsky et al.
`(Continued)
`Primary Examiner — Azizul Choudhury
`(74) Attorney, Agent, or Firm — Turocy & Watson, LLP
`(57)
`ABSTRACT
`A web page has a player for playing media objects, a
`sequencer which displays a play list that defines an order in
`which media objects are played by the player, and a media
`access area for containing a plurality of graphical icons. Each
`graphical icon representing a media object, and the graphical
`icons can be manipulated by a user to modify the play list. For
`example, the media icons may be dragged to the sequencer to
`add them to the sequencer.
`22 Claims, 19 Drawing Sheets
`
`
`
`Media and Transactions,inc.
`61GG) C air
`File
`Edit view Go Favorites Help! gow XY
`Address
`httpit?05.180,55.240 marina Drop folder FransfeldsooB27 white.htm
`
`as
`
`w
`
`AWERTISING BANNER
`
`topics
`
`People
`
`sites
`
`Search
`
`enternet zone
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 3 of 32
`
`US 8,549,097 B2
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`6,141,010 A 10/2000 Hoyle ........................... 345,356
`6,169,997 B1
`1/2001 Papierniak et al.
`707/5O1
`6,173,317 B1
`1/2001 Chaddha et al. .............. TO9,219
`6,202,155 B1
`3, 2001 Tushie et al.
`6,226,618 B1
`5/2001 Downs et al. ..................... 70.5/1
`6,230,200 B1
`5, 2001 Forecast et al.
`6,243,328 B1
`6/2001 Fenner et al. ......................... 1f1
`6,262,723 B1
`7/2001 Matsuzawa et al.
`345,328
`6,346,951 B1
`2, 2002 Mastronardi ......
`345,716
`6,385,596 B1
`5, 2002 Wiser et al. .
`705/51
`6,441,832 B1
`8, 2002 Tao et al. ....
`715/723
`6,452,609 B1* 9/2002 Katinsky et al.
`715,716
`6,516,323 B1
`2/2003 Kamba ................................. 1f1
`6,519,584 B1
`2/2003 Tognazzini et al. ............... 707/3
`6,587,127 B1
`7/2003 Leeke et al.
`71.5/765
`6,622,171 B2
`9/2003 Gupta et al.
`709,219
`6,748,427 B2
`6/2004 Drosset et al. ................ TO9,219
`7,610,394 B2 10/2009 Katinsky et al.
`2002fO1887.46 A1
`12/2002 Drosset et al.
`7/2003 Katinsky et al.
`2003.01375.31 A1
`12/2006 Katinsky et al.
`2006/02881 11 A1
`
`
`
`OTHER PUBLICATIONS
`International Search Report mailed May 23, 2000 in PCT/US99/
`26258.
`OA mailed Sep. 22, 2004 for U.S. Appl. No. 10/210.203, 24 pages.
`OA mailed Jun. 8, 2005 for U.S. Appl. No. 10/210.203, 25 pages.
`OA mailed Jul. 13, 2006 for U.S. Appl. No. 10/210.203, 24 pages.
`OA mailed Oct. 2, 2008 for U.S. Appl. No. 10/210,203, 22 pages.
`
`Anonymous, “DHTML tool war begins.” Web Techniques, Feb. 1998,
`3(2), 7 pages.
`Bouthillier, “Sychronized W3C Format Is All Smiles,” wysiwyg://
`11/http://www.webtecniques.com/archives/1998/09/bouthillier,
`Sep. 1998, 1-13 and attached.
`“MIDI Made Music Jukebox v6.2.” http://www.hitsquad.com/smm.
`programs/MIDI Made Music Jukebox/, Jan. 22, 1997, 1-3 and
`attached.
`Russell, “Welcome to the Voltage Circuit Simulator (with Java source
`code).”
`http://www.javasoft.com/applets/archive/beta/Voltage/in
`dex.html;
`http://www.javasoft.com/applets/archive/beta/Voltage?
`voltage/voltage.java, Sep. 1995, 1-2: 1-12.
`Haligonian Media, “OS/2 e-Zine,” www.os2site.com/sw?magazine?
`ezine/other/dec96.txt, 1996, 1(14), 1-39.
`Hiang, “Interesting Features in WinAmp.” New Straits Times, Jun.
`23, 1997, 51 pages.
`RealNetworks, Inc., “RealFlash and RealAudio Content Creation
`Guide, Beta 5.0.” RealNetworks, docs.real.com/docs/flshccg.pdf,
`1997, 1-20.
`RealNetworks, Inc., “User Guide for RealPlayer Plus 5.0.”
`RealNetworks, 1997, 1-62.
`Wenham, “Mod Players for OS/2.” 1996, OS/2 e-Zine, www.
`os2ezine.com/vlin 14 modplyrs.htm, 1-5.
`Winamp, “Winamp Player New Features.” http://web.archive.org/
`web. 1998 1202191016/winamp.com/winamp/newfeatures.html 1-4.
`Winamp, “Winamp Player Overview.” http://web.archive.org/web/
`1998 1207050153/winamp.com/winamp?overview.html, 1-3.
`"Sun Delivers Rich Set of Java Media and Communication AIP's.”
`Java, http://www.java. Sun.com/pr/1997/august/pr970806-01.html,
`Aug. 1997, 4 pages.
`
`* cited by examiner
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 4 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 1 of 19
`
`US 8,549,097 B2
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 5 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 2 of 19
`
`US 8,549,097 B2
`
`D Business
`e Entertainment
`NeWS
`a Sports
`
`24
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG.2B
`
`
`
`BusineSS
`O Entertainment
`NeWS
`O Business
`O Clinton
`o Crime
`O Heath
`b Human Interest
`O Live News
`o Nation
`o PoliticS
`o Technology & Science
`O World
`Sports
`
`29
`
`24
`
`
`
`
`
`
`
`
`
`
`
`Business Entertainment Sports
`
`News -- ea
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 6 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 3 of 19
`
`US 8,549,097 B2
`
`
`
`O BusineSS
`O Entertainment
`O NeWS
`O Business
`o Clinton
`o Crime
`O Health
`O Human interest
`O Live NeWS
`O Nation
`o Politics
`Democrats
`3Gore Pushes for IRS Refor
`f5 Joe Kennedy Will Not Seek Re-Election
`Vote Gore in 2000
`Republicans
`3O
`o Technology & Science
`O World
`o Sports
`
`Business Entertainment Sports
`
`News
`
`4O
`?
`
`FIG.2C
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 7 of 32
`
`U.S. Patent
`
`US 8,549,097 B2
`
`
`
`
`
`SM8N ?AIT o
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 8 of 32
`
`U.S. Patent
`
`US 8,549,097 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`a.
`
`EEEEEEEER
`
`8p
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 9 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 6 of 19
`
`US 8,549,097 B2
`
`F.I G. s (613
`
`
`
`Warner Brothers: The Soundtrack from the
`film Midnight in The Garden Of Good & Evil
`Paula Cole: I Don't Want To Wait (Large
`Af 99K)
`f5 David Byrne Miss America
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 10 of 32
`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 10 of 32
`
`U.S. Patent
`
`US 8,549,097 B2
`
`is
`
`£30.:@302
`
`.8393an.808
`
`w‘23.6SE58M*wfimohmUntam2.5ua33:80awmEMEOO©wowxmO583.EE!senom.92.oB2:....m,E:.mEwmmmmmiaga
`
`
`qoayoom8:2:quxoom5822
`03m_\ egg;
`
`
`
`.92..umSEESrcoo_8Es.5“.SEn.
`
`LE;9EngEon_n.
`
`8:22332%ESn.D
`
`.GE
`
`<m..
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 11 of 32
`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 11 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 8 of 19
`
`US 8,549,097 B2
`
`25:00©8meOESEE!22.35
`
`.20....
`
`.53m.n.
`
`36:8n.
`
`
`
`
`
`
`
`00<m0”.mmzz<m02_w_._.mm>o<ozFEba
`
`mmmamEuzo
`
`Gz_._.<HOm
`Eéggaizég
`2530©88m.0:22EE!£253.22..
` .353a3%.
`
`
`00<co“.mmzz<mwz_w_.Em_>o<
`EEEEE
`
`02mn.
`
`.223n.
`
`EE.
`
`£5..
`
`0m;@
`
`\m“
`
`cm
`
`T,
`
`mm!
`GE
`
`Um...6E
`
`
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 12 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 9 Of 19
`
`US 8,549,097 B2
`
`
`
`8 |
`
`22
`
`
`
`4 JosuodS
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 13 of 32
`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 13 of 32
`
`U.S. Patent
`
`m
`
`1mhS
`
`9
`
`US 8,549,097 B2
`
`$1.
`
`5
`
`
`
`\4Ema.oz<m
`
`538:8
`
`02mcm2,mE<ZgoasJn50Omn=>b\©—
`Bow_l_n._%w>o<
`
`m8_qifigefig
`
`\||ll||||||I>IIlI.I|||I|I|IJ
`
`Mmfl®fiq
`
`EEEEEEEIEEE
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 14 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 11 of 19
`
`US 8,549,097 B2
`
`1 Of O
`CONTENT
`DATABASE
`
`1012
`
`INTERFACE
`DATABASE
`
`
`
`1014
`
`USER
`DATABASE
`
`
`
`
`
`WebServer
`APPLICATION
`SERVER
`
`PAGELESS WEB
`SERVER & BROWSER
`COMPONENTS
`
`
`
`
`
`E.
`
`
`
`MEDIA
`SERVERS
`
`as a - or
`
`P as
`
`um autos w
`
`an era
`
`Y
`
`-
`
`won m was am
`
`a
`
`v. --
`
`-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`CLIENT/WEB PAGE
`
`USER
`DATABASE
`DATA SOURCE
`OBJECTS
`
`INTERFACE
`AND CONTENT
`DATASOURCE
`OBJECTS
`
`PROGRAM LOGIC
`DOCUMENT OBJECTS/EVENTS
`EVENT LOGIC
`DATABOUND DHTML OBJECTS
`
`CENT
`MEMORY
`
`
`
`MEDIA
`PLAYER
`OBJECT
`
`FIG 10
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 15 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 12 of 19
`
`US 8,549,097 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ON CLIENT LOAD
`
`ff O2
`
`YES
`
`CREATE
`NEW USER
`NUSER
`DATABASE
`
`1 104
`
`OUERY USER
`DATABASE
`
`f 106
`
`LOAD
`SEOUENCER
`DSO W/USER
`TABS AND
`PLAY LISTS
`
`1108
`
`
`
`GET
`NEW USER
`O
`
`LOAD USER
`SPECIFIC
`SITE
`PRE-LOADS
`
`
`
`WRITE
`COOKE
`WITH
`USER ID
`
`
`
`
`
`
`
`
`
`LOAD SITE
`SPECIFIC
`PRE-OADS
`
`
`
`
`
`GET MICRON
`ACCESS
`TOP TABS
`
`
`
`START
`SPONSOR
`BANNER
`ROTATION
`
`FIG 11
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 16 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 13 Of 19
`
`US 8,549,097 B2
`
`NAVIGATES OUTLINE, DRAGS MICON
`
`OUTLINE
`
`12O2
`
`CLOSE
`OUTLINE
`OPEN
`AT SAME
`LEVEL
`
`
`
`
`
`
`
`
`
`
`
`1204
`
`BLINK
`"RETREVING
`ELEMENT"
`IN RED
`
`12O6
`
`GET SOL
`OUERYDATA
`FROM CLENT
`MEMORY
`
`1208
`
`GENERATE
`SQL OUERY,
`SEND TO
`SERVER
`
`1210
`
`RECEIVE
`RECORDSET
`STORE IN
`CLENT MEMORY
`
`1212
`
`FORMAT, WRITE
`OUTLINE LEVEL
`TO SCREEN
`FROMMEMORY
`
`
`
`
`
`
`
`
`
`MICON
`
`122O
`
`COPY MICON
`TO DRAG LAYER:
`CHANGE COLOR
`ON DRAG
`
`1222
`
`
`
`1224
`
`
`
`MICON
`DRAGGED TO
`SSQUENCE
`
`DRAGGED
`MICON
`DSAPPEARS
`
`1226
`
`APPEND MICON
`RECORD FROM
`MEMORY TO
`SEOUENCER
`DSO
`APPLY USER
`AND TAB IDS
`TO RECORD
`
`1228
`
`
`
`UPDATE USER
`DATABASE
`TABS &
`PLAYLISTS
`
`FIG. 12
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 17 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 14 of 19
`
`US 8,549,097 B2
`
`USER SWITCHES TABS IN SEOUENCER
`13OO
`
`TAB CLICK
`
`13O8
`
`DATASET CHANGE
`RESETS SOURCE
`FOR THE OBJECT
`PLAYER. OBJECT
`PLAYER READY
`TO PLAY FIRST
`CHECKED OBJECT
`
`SEOUENCER DSO
`SUBMIT CHANGES
`N RECORDSET TO
`USER DATABASE
`
`
`
`FILTER DSO
`RECORDSET
`ONNEW TAB ID
`
`
`
`
`
`PLAY LIST
`TABLE BOUND TO
`DSO REWRITES
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG. 13A
`
`USER CHANGES TABS IN SEOUENCER
`1350
`
`1354
`
`PLAY LISTS
`MENUSELECT
`
`
`
`CREATE: fabrane
`DELETE: fabrane
`RENAME: fabrane
`
`FILTER AND
`CHANGE TAB FIELD
`OF SEOUENCER
`DSO RECORDSET
`
`
`
`
`
`
`
`TAB TABLE
`BOUND TO
`DSO REWRITES
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG.L. 13B
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 18 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 15 of 19
`
`US 8,549,097 B2
`
`USER NAVIGATES TABS
`
`
`
`DATABASE
`LOAD TO
`SEOUENCER
`DSO
`
`CREATES
`OR
`EDTS TABS
`
`USER CLICKS
`TAB-LEFT
`BUTTON
`
`USER CLICKS
`TAB-RIGHT
`BUTTON
`
`TAB DSPLAY
`MANAGER
`
`CHECK FOR
`TABS TO THE
`LEFT
`
`CHECK FOR
`TABS TO THE
`RIGHT
`
`SET FIRST TAB -
`FIRST TAB -1
`
`SET LAST TAB -
`LAST TAB - 1
`
`SET LAST TAB TO
`FIRST/LAST TAB
`+1 UNTIL NO
`MORE TABS FIT
`ONAXIS
`
`SET FIRST TAB TO
`LAST/FIRST TAB
`-1 UNTIL NO
`MORE TABS FIT
`ONAXIS
`
`POSITION
`VISIBLE TABS
`
`POSITION
`VISIBLE TABS
`
`1350
`
`RESET TAB
`L/R BUTTONS
`
`FIG. 13C
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 19 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 16 of 19
`
`US 8,549,097 B2
`
`USER PLAYS PLAY LIST
`1400
`
`PAYEYEON
`
`
`
`GEISENSER /*
`JRL'S FROM
`SEOUENCER
`DSO FOR PLAYING
`MEDIA OBJECT
`
`1410
`
`
`
`OBJECT
`PLAYER
`BUFFERS
`STREAM
`
`1402
`
`STOP DEFAULT
`BANNER
`ROTATION
`
`1404 STARTMEDIAOBJECT
`SPECIFIC ROTATION
`(e.g. SOURCE,
`SPONSORBANNERS)
`
`
`
`
`
`
`
`
`
`
`
`
`
`GET
`MEDIA
`TYPE AND
`MAGE
`SigE
`
`
`
`1412
`SIZE >
`DEFAULT
`
`
`
`
`
`1414
`NO
`
`DALOG
`BOX: EXPAND
`DISPLAY
`
`1430
`
`MEDIA OBJECT
`PLAYS
`
`1440
`
`PLAY ENDS
`
`1442
`
`FIND NEXTN NO
`CHECKED
`QECKB9
`
`1444
`
`
`
`SET HIGHLIGHT
`
`1446
`
`LOAD URL
`
`1448
`
`PLAY
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`USE
`DEFAULT
`SIZE
`
`
`
`S SE
`EOUENCER
`DSO CHECK
`FIELD
`
`RESIZE MAGE
`DISPLAY
`
`1416
`
`BOUND DHTML
`
`SEER HE
`
`145O
`
`STOP
`
`
`
`
`
`
`
`1420
`NO
`
`IS
`DISPLAY
`IN HOME
`POSITION
`YES
`
`1452
`
`1422
`
`START DEFAULT
`BANNER
`ROTATION
`
`FIG.14
`
`CENTER
`DISPLAY
`N HOME
`POSION
`
`1424
`
`DONT
`MOVE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 20 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 17 Of 19
`
`US 8,549,097 B2
`
`DRAGGING BANNERS
`
`
`
`
`
`TOUCHING
`IMAGE
`RSELy
`
`s
`
`GET MEDIA
`OBJECT URL FROM
`SEOUENCER DSO
`CURRENT RECORD
`
`
`
`MICON
`BANNER
`DRAGGED
`
`
`
`
`
`
`
`
`
`
`
`PLAYER
`RESUMES
`
`1506
`NO
`
`1510
`
`BANNER
`DSAPPEARS
`
`
`
`
`
`CREATE NEW
`SEOUENCER
`DSO RECORD
`
`152O
`
`COPY USER
`& AB D'S
`TO RECORD
`
`COPY BANNER
`MEDIA OBJECT
`DATATO NEW
`RECORD
`
`NEW DSO
`FIELD UPDATES
`BOUND
`PLAYLIST TABLE
`
`1522
`
`1524
`
`1526
`
`PAUSE
`PLAYER
`
`1530
`
`1532
`
`
`
`
`
`YES
`
`CHANGE
`CURRENTLY
`PLAYING
`HIGHGHT TO RED
`
`PLAY BANNER
`MEDIA OBJECT
`
`AT PLAY END
`CHANGE
`HGHLIGHT BACK
`TO YELLOW
`
`RESTART CURRENT
`
`1540
`
`1542
`
`1544
`
`1546
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 21 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 18 of 19
`
`US 8,549,097 B2
`
`OPENS MICON POP-UP
`
`16O2
`GET SPONSOR OR
`PLAYER POP-UP
`STRING FROM
`SEOUENCER DSO
`CURRENT RECORD
`
`16O4
`
`1606
`
`SHOW
`BUILDING
`MENU
`MESSAGE
`
`PASS
`STRING TO
`POP-UP
`ENGINE
`
`USER
`CLICK
`
`
`
`
`
`
`
`
`
`
`
`161O
`
`1634
`
`PARSE STRING
`SECTION
`
`END OF STRING
`
`
`
`SELECT
`LOWER MENU
`
`
`
`TEST FOR <,
`DATA, >
`
`TEST
`FOR LOWER
`MENU
`LEVE
`
`
`
`
`
`1630 1618
`
`
`
`PARSE DATA
`1632
`
`BUILD MENU
`LEVEL
`
`CREATE MENU
`ITEM
`
`
`- - - - - - - - - - - - - - - - F - - - - - - - - - - - - - - - -
`
`| POP-UP MENU BUILDER
`
`INSERT
`TEXT/GRAPHICS
`
`me a m -
`
`- - - - - - - - -
`
`|
`
`INSERT MENU
`DV
`
`INSERTMENU
`BORDER
`
`OPEN TABLE TAGS
`
`CREATE MENU
`ITEM ROWS
`
`ADD CLOSE
`TABLE TAGS
`
`END OF TEMs
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 22 of 32
`
`U.S. Patent
`
`Oct. 1, 2013
`
`Sheet 19 of 19
`
`US 8,549,097 B2
`
`
`
`
`
`
`
`
`
`
`
`d
`Preview
`Description d
`Info
`> Title
`Source
`Author
`Sponsor d Copyright
`Buy
`Modify Date
`ElmageSize 102 Height x 100 Width
`Details
`Media Type d
`Frame Rated
`
`
`
`
`
`
`
`FIG. 17
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 23 of 32
`
`US 8,549,097 B2
`
`1.
`WEBAPPLICATION FOR ACCESSING
`MEDIA STREAMS
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`This application is a Continuation of U.S. patent applica
`tion Ser. No. 10/210,203, filed Jul. 31, 2002, which is a
`Continuation of U.S. patent application Ser. No. 09/187.256,
`filed Nov. 6, 1998.
`
`BACKGROUND OF THE INVENTION
`
`The present application relates generally to providing
`media streams from Internet sites.
`The WorldWideWeb (WWW) is conventionally conceived
`as a system in which a user navigates between text documents
`on different servers by means of hypertext links. Activating a
`hypertext link causes another page, also composed of textand
`links, to be delivered to the client computer. Thus, on the
`WWW, a user's experience is determined by the order in
`which the user clicks on links.
`In general, non-text objects are treated as illustrations
`placed on text pages. Although WWW standards include an
`open ended specification for handling multimedia files that
`allows media objects to be referenced by hypertext links,
`those references are treated no differently than hypertext links
`to pages and illustrations. Typically, three techniques are used
`to access multimedia files. First, a link can point to a special
`media file that requires a special player program to produce
`the images and Sounds of the media file. Second, the link can
`point to a player program that starts independently of the web
`browser to play the media file. The interface provided by the
`player program controls the media file. Third, the link can
`point to a player program embedded in the page. In this case,
`the user can click on the link to choose which media file to
`play without leaving the page. However, the size of the image
`displayed and the controls available to the user are chosen by
`the web page designer.
`The currently available tools that can be used to synchro
`nize the presentation of multimedia components include pro
`prietary languages. Such as Macromedia's Lingo and Apple's
`HyperCard, and Scripting languages. Such as ECMAScript
`(JavaScript), hi recognition of the difficulty of multimedia
`authoring with the currently available tools, the World Wide
`Web Consortium (W3C) has proposed a new language called
`the Synchronized Multimedia Integration Language (SMIL).
`The WWW was developed for utility in the assembly and
`cross referencing of text content documents with user free
`dom in navigation. On the other hand, multimedia develop
`ment has focused on interactive but canned content with
`limited use options that are defined by the author. Thus,
`multimedia on the web has been subject to conflicting devel
`opmental pressures, and has not developed a coherent presen
`tation format.
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`SUMMARY OF THE INVENTION
`
`In one aspect, the invention is directed to a web page with
`a player for playing media objects, a sequencer which dis
`plays a play list that defines an order in which media objects
`are played by the player, a media access area for containing a
`plurality of graphical icons. Each graphical icon representing
`a media object, and the graphical icons can be manipulated by
`a user to modify the play list.
`Implementations of the invention may include the follow
`ing features. The graphical icon includes an indication of a
`
`60
`
`65
`
`2
`media type of the media object and text describing content of
`the graphical object. Agraphical icon can be dragged from the
`media access area to the sequencer to add the media object
`represented by the graphical icon to the play list. The
`sequencer can display one of multiple play lists, and the user
`may switch between play lists by selecting a tab associated
`with the play list. For each graphic object in the play list, the
`play list box may contain a copy of the graphical icons rep
`resenting the graphical object, a checkbox to control whether
`the player will play the graphic object, and a pop-up menu to
`provide information about the graphic object. The sequencer
`and media access area may be implemented with Scripted
`DHTML. The media access area may include an expandable
`and collapsible outline of Subjects, and the media icons may
`be arranged in lists in the outline. The media access area may
`include a tab for each subject at a top level of the outline, and
`the user can Switch between subjects by selecting a one of the
`tabs. The media access area may display one of a plurality of
`outlines, and the user can switch between outlines by select
`ing a tab. The player may include a control panel and a
`draggable image display window. The image display window
`may include a home button to return the image display win
`dow to a home position on the web page, an image area, a
`handle, a button to hide the image area, and a size lockbutton
`to prevent the image display window from expanding beyond
`a default size. The web page may further include a site-driven
`area to display a banner. The banner may be synchronized
`with the media object being played by the player, and a media
`object may be associated with the banner. The user may
`change the play list to play the media object associated with
`the banner by manipulating the banner. Dragging the banner
`to the sequencer may add the media object associated with the
`banner to the play list, and dragging the banner to the image
`area of the player may play the media object associated with
`the banner. The banner may include a pop-up menu to display
`information about the media object associated with the ban
`.
`In another aspect, the invention is directed to a method of
`operating a web page. Multiple sources of streaming content
`are displayed to a user, and user input is received to select a
`playing order for the Sources of streaming content. The play
`ing order is stored, user input is received to start delivering the
`streaming content to the user, and the streaming content is
`presented to the user in the stored order.
`In another aspect, the invention is directed to an Internet
`site having a first database to store information about a plu
`rality of media objects, a second database to store information
`about how the media objects are to be presented on a web
`page, a third database to store information about a plurality of
`users, and an application server for communicating with a
`client running the web page.
`Advantages of the invention may include one or more of
`the following. The user can locate and control streams of
`multimedia content in real time without accessing different
`web pages or Surrendering control to a media player program.
`A user can define and assemble multiple sequences of media
`objects, particularly sources of streaming content. The user
`can manage a persistent personal collection of media objects
`from a network client. The user can gather additional stream
`ing content while a media object is playing, and can modify
`and create sequences while a media object is playing. The
`user can add and remove media objects from a sequence, can
`deselect media objects to prevent them from playing without
`removing them from a sequence, and can Switch between
`different user defined sequences. New media objects can be
`preloaded into a sequence based on a personal preference or
`interest profile defined by the user. Individual user histories
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 24 of 32
`
`US 8,549,097 B2
`
`3
`(as defined by the order in which a user adds media objects to
`sequences and plays the media objects) can be used to gen
`erate an outline organized by user-defined tabs and dates.
`Users can exchange play lists and player combinations by
`electronic mail.
`The details of one or more embodiments of the invention
`are set forth in the accompanying drawings and the descrip
`tion below. Other features and advantages of the invention
`will become apparent from the description, the drawings, and
`the claims.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`10
`
`15
`
`4
`web page 10 presents the media icons with text and/or graph
`ics to assist the user in determining how to manipulate the
`media icons.
`The pageless Internet site is an inversion of conventional
`web site design, hi conventional web site design the media
`object is the last link in a long chain of pages and links. The
`setting, context, meaning, and relevance of the media object
`are established in hypertext, and the media object is an adorn
`ment for the hypertext. In contrast, in the pageless Internet
`site, the media object is the starting point. The pageless Inter
`net site is media-oriented, as opposed to being text-oriented
`with media annotations, hishort, the principle of organization
`of web page 10 is the relationship between media objects,
`rather than the relationship between pages.
`As shown in FIG. 1, the media access web page 10 has four
`functional areas, including a media icon access panel 12, a
`sequencer 14, an object player 16, and a site-driven area 18.
`The media icon access panel 12 organizes media icons into a
`hierarchical outline or list, and Supports searches for media
`objects. The sequencer 14 allows the user to select media
`icons from the media icon access panel 12, and to create and
`modify one or more user defined play lists. The object player
`16 plays the media objects in the order defined by the play list.
`In addition, the object player 16 can control the play list and
`the individual media objects in the play list. The site-driven
`area 18 presents site-driven graphics synchronized with
`streaming content that responds to user actions and user
`selected content. The graphics can also be media icons rep
`resenting more media objects. The web page 10 can be imple
`mented with JavaScript and HTML 4.0, and can be accessed
`with a web browser, such as Microsoft Internet Explorer 4.0.
`Each of the components of the web page 10 will be described
`in greater detail below.
`The media icon access panel 12 has a series of Subject
`matter tabs 22 arranged along an edge of the panel. To begin
`browsing the content of the site, the user selects one of the
`Subject matter tabs 22, for example, by clicking on it with a
`mouse controlled cursor. As shown in FIG. 2A, clicking on a
`subject matter tab 22 causes the top level of an outline 24 to
`appear as a bulleted list containing bulleted items 26. In
`addition, clicking the Subject matter tabs 22 causes outline
`item tabs 28 to appear at the bottom of the media icon access
`panel 12. Each outline item tab 28 corresponds to one of the
`top level bulleted items 26 in the outline 24.
`As shown in FIG. 2B, clicking on either the text of a
`bulleted item 26 or the corresponding outline item tab 28 at
`the bottom of the media icon access panel 12 will cause the
`next level of the outline to be displayed as a bulleted sublist
`29. Clicking on a bulleted item in a sublist causes the next
`lower level of the outline to be displayed. In order to manage
`large outlines without excessive scrolling, the sections of the
`outline will expand and collapse so that only one item of each
`level of the outline is expanded at a time. For example, FIG.
`2B shows the “News' section of the outline has been
`expanded. Clicking on any bullet at the same level. Such as the
`“Sports' bullet, would expand the outline to show the items in
`that bullet, but would also close the “News' section.
`As shown in FIG. 2C, the lowest level of the outline is a list
`36 of media icons 30. Each media icon 30 represents a media
`object. Each media icon includes a graphic icon32 indicating
`the media type. Such as audio, video, text, executable code,
`graphic, or unknown, of the media object. Each media icon
`also includes accompanying text 34 to briefly explain the
`content of the media object. When a cursor 42 moves over a
`media icon, the media icon is highlighted to indicate that it is
`selectable. Clicking on a media icon 30 does not open another
`level of the outline. Rather, as shown in FIG. 3 A, holding the
`
`FIG. 1 illustrates a media access web page according to the
`present invention.
`FIGS. 2A, 2B, and 2C illustrate the use of a media icon
`access panel from the web page of FIG. 1.
`FIG. 3A-3B illustrate the step of dragging a media icon
`from the access panel to a sequencer from the web page of
`FIG 1.
`FIG. 4 illustrates the sequencer containing several media
`icons.
`FIG. 5 illustrates the use of a media object pop-up menu.
`FIGS. 6A, 6B, and 6C illustrate the manipulation of mul
`tiple play lists by the sequencer.
`FIG. 7 illustrates the object player from the web page of
`FIG 1.
`FIGS. 8A, 8B, 8C and 9A,9B, and 9C illustrate the opera
`tion of the site-driven area from the Internet site of FIG. 1.
`FIG. 10 illustrates a pageless Internet site for generating a
`media access web page.
`FIG. 11 illustrates a method performed when a user con
`tacts a media access web page server.
`FIG. 12 illustrates a method performed when a user inter
`acts with the media icon access panel.
`FIGS. 13A, 13B, and 13C illustrate methods performed
`when a user Switches or changes tabs in the sequencer.
`FIG. 14 illustrates a method performed whena user plays a
`media object from a play list in the sequencer.
`FIG. 15 illustrates a method performed when a user drags
`a banner from the site-driven area.
`FIG. 16 illustrates a method performed when a user acti
`Vates a media icon pop-up menu.
`FIG. 17 illustrates a media icon pop-up menu.
`
`25
`
`30
`
`35
`
`40
`
`45
`
`DETAILED DESCRIPTION OF ILLUSTRATIVE
`EMBODIMENTS
`
`FIG. 1 shows a media access web page 10 generated by an
`Internet site that is particularly Suited for accessing multime
`dia streams. The Internet site is “sequence-oriented’, i.e., the
`user controls the sequence in which multimedia streams are
`presented. In addition, the Internet site is “pageless, in that
`media streams are delivered to the user without the user
`having to navigate to different pages. The media streams may
`be a variety of media types, such as text, audio, images,
`animation, video, executable code, or any combination of
`media types. The Internet site is a media-type neutral system,
`i.e., it treats different media types. Such as audio and video, in
`a similar fashion.
`The building blocks of the Internet site include playable
`media content units, called “media objects', and graphical
`representations, of the media content units called “media
`icons'. The user manipulates the media icons to create an
`individual sequence, i.e., a play list, of media objects. The
`
`50
`
`55
`
`60
`
`65
`
`

`

`Case 1:20-cv-03159-AKH Document 1-8 Filed 04/21/20 Page 25 of 32
`
`US 8,549,097 B2
`
`6
`or media icon access area to a mailbox icon. The media
`objects in the mailbox may later be mailed one or several
`recipients.
`As shown in FIG. 6C, when the addition of a new tab 72
`causes a tab at the opposite end to “fall off the play list box
`44, a triangular corner marker 74 appears to indicate the
`direction in which there are more tabs to view. The user can
`click on the corner markers 74 to cause the tabs to shift left or
`right, as appropriate, to display the next play list tab.
`As shown in FIG. 7, the object player 16 is used to play the
`currently selected media object from the play list 50 in the
`sequencer 14. The object player includes an image display
`window 80 and a control panel 82. The object player 16 can
`use any program that can be embedded in a web page that
`presents media objects. Examples of streaming media pro
`grams that can be embedded are QuickTimeTM, RealMe
`diaTM, and Microsoft Media PlayerTM. Streaming media play
`ers, such as the illustrated RealMedia Player, include the
`control panel features, such as a stop button 100, a pause/play
`button 102, a previous button 104 and a next button 106, a
`vertical-slider control 108 provides audio volume control,
`and a horizontal slider control 110 provides fast forward/
`rewind control and indicates the amount of the stream that has
`been and remains to be played. A display panel 112 presents
`the current status of the media object, e.g., playing or paused,
`and a clock 114 shows the total duration of the multimedia
`object and the elapsed time.
`The next button 106 works with the play list 50 in the
`sequencer 14 to cause the currently playing media object to
`stop and to cause the media object represented by the next
`checked media icon in the play list 50 to start playing. Simi
`larly, the previous button 104