Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 1 of 31 PageID #: 130
`
`Exhibit 6
`
`

`

`USOO7610394B2
`
`(12) United States Patent
`Katinsky et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,610,394 B2
`Oct. 27, 2009
`
`(54) WEBAPPLICATION FOR ACCESSING
`MEDIA STREAMS
`
`(75) Inventors: Steve Katinsky, Los Angeles, CA (US);
`Michael Burress, Venice, CA (US);
`Jefferson Furtado, Galt, CA (US)
`(73) Assignee: Copper Data River LLC, Los Altos,
`CA (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(*) Notice:
`
`(21) Appl. No.:
`
`10/210,203
`
`(22)
`(65)
`
`(63)
`
`(51)
`
`(52)
`
`(58)
`
`(56)
`
`Filed:
`
`Jul. 31, 2002
`
`Prior Publication Data
`US 2003/O137531A1
`Jul. 24, 2003
`
`Related U.S. Application Data
`Continuation of application No. 09/187.256, filed on
`Nov. 6, 1998, now Pat. No. 6,452,609.
`
`Int. C.
`(2006.01)
`G06F 5/16
`(2006.01)
`G6F 3/48
`U.S. Cl. ....................... 709/231: 709/217; 709/219;
`715/763; 715/810; 715/811
`Field of Classification Search ................. 345/716,
`345/727, 760; 709/219, 231, 217; 715/763,
`715/810, 811
`See application file for complete search history.
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,353.401 A * 10/1994
`5,724,595 A
`3, 1998
`5,793,366 A
`8, 1998
`5,796,945 A
`8, 1998
`5,864,868 A *
`1/1999
`
`Iizawa et al. ................ 715,763
`Genter
`Mano et al.
`Tarabella
`Contois ................... TO7 104.1
`
`5/1999 Inomata et al.
`5,905,983 A
`6,005,563 A 12/1999 White et al.
`6,018,768 A
`1/2000 Ullman et al.
`6,025,841 A
`2/2000 Finklestein et al.
`6,133,913 A 10/2000 White et al.
`6,141,010 A 10/2000 Hoyle
`6,169,997 B1
`1/2001 Papierniak et al.
`6,173,317 B1 *
`1/2001 Chaddha et al. ............. TO9,219
`6,202,155 B1* 3/2001 Tushie et al. .................. T26/20
`6,226,618 B1* 5/2001 Downs et al. .................. 705/1
`6,230,200 B1* 5/2001 Forecast et al. ............. TO9,226
`6,262,723 B1
`7/2001 Matsuzawa et al.
`6,346,951 B1
`2/2002 Mastronardi
`
`(Continued)
`OTHER PUBLICATIONS
`
`Wenham, “Mod Players for OS/2.” 1996, OS/2 e-Zine', from www.
`oS2eZine.com/vlin 14/modplyrs.htm, pp. 1-5 as printed.
`
`(Continued)
`Primary Examiner—Aaron Strange
`(74) Attorney, Agent, or Firm Woodcock Washburn LLP
`
`(57)
`
`ABSTRACT
`
`A web page has a player for playing media objects, a
`sequencer which displays a play list that defines an order in
`which media objects are played by the player, and a media
`access area for containing a plurality of graphical icons. Each
`graphical icon representing a media object, and the graphical
`icons can be manipulated by a user to modify the play list. For
`example, the media icons may be dragged to the sequencer to
`add them to the sequencer.
`
`17 Claims, 19 Drawing Sheets
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 2 of 31 PageID #: 131
`
`O
`Media andransactions, Inc.
`Edit yiew Go Favorites Help: Kos Exv O&G, G E
`Fle
`Address
`http:lia05,8055.240imarinsidrop-folderiTransteridso827 wris.htm
`
`5
`
`
`
`
`
`
`
`
`
`
`
`opics
`
`People
`
`sites
`
`Search
`
`ADWERTISING BANNE
`
`
`
`
`
`
`
`is
`
`RealPlayer.
`
`PlayLists
`
`dThe Following Clips are in Your Player
`
`Remove Clear
`
`Unload
`
`2
`
`
`
`entenetzone
`
`
`
`
`
`
`
`6
`
`
`
`
`
`
`
`
`
`

`

`US 7,610,394 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`6,385,596 B1*
`5/2002 Wiser et al. ................... 705/51
`6,441,832 B1*
`8/2002 Tao et al. ....
`... 15,723
`6,519,584 B1* 2/2003 Tognazzini et al. ............ 707/3
`6,587,127 B1 * 7/2003 Leeke et al. ......... ... 715,765
`6,622,171 B2 * 9/2003 Gupta et al. ...
`... 709,231
`2002/018874.6 A1* 12/2002 Drosset et al. .............. TO9,231
`
`
`
`OTHER PUBLICATIONS
`Haligonian Media, “OS/2 e-Zine, vol. 1, No. 14' 1996, from www.
`oS2site.com/SW/magazine?eZine?other/dec96.txt,
`pp.
`1-39 as
`printed.*
`RealNetworks, Inc., “RealFlash and RealAudio Content Creation
`Guide, Beta 5.0, 1997, RealNetworks, from docs.real.com/docs/
`fishccg.pdf, pp. 1-20 as printed.
`RealNetworks, Inc., User Guide for RealPlayer Plus 5.0, 1997,
`RealNetworks, Inc., pp. 1-62.*
`Anonymous, “DHTML Tool War Begins.” Feb. 1998, Web Tech
`niques, vol. 3, ISS. 2, p. 7.
`Hiang, “Interesting Features in WinAmp.” Jun. 23, 1997, New Straits
`Times, p. 51.*
`
`Winamp, “Winamp Player New Features.” from http://web.archive.
`org/web. 1998 1202191016/winamp.com/winamp/newfeatures.html,
`pp. 1-4 of printout.*
`Winamp, “Winamp Player Overview.” from http://web.archive.org/
`web. 1998 1207050153/winamp.com/winamp?overview.html,
`pp.
`1-3 of printout.*
`Anonymous, “DHTML tool war begins.” Web Techniques, Feb. 1998,
`3(2), 7 pages.
`Bouthillier, “Sychronized W3C Format Is All Smiles,” wysiwyg://
`11/http://www.webtechniques.com/archives/1998/09/bouthillier,
`Sep. 1998, 1-13.
`“MIDI Made Music Jukebox v6.2.” http://www.hitsquad.com/smm.
`programs/MIDI Made Music Jukebox/, Jan. 22, 1997, 1-3.
`Russell, “Welcome to the Voltage Circuit Simulator (with Java source
`code).”
`http://www.javasoft.com/applets/archive/beta/Voltage/in
`dex.html;
`http://www.javasoft.com/applets/archive/beta/Voltage?
`voltage/voltage.java, Sep. 1995, 1-2: 1-12.
`"Sun Delivers Rich Set of Java Media and Communication AIP's.”
`Java, http://www.java. Sun.com/pr/1997/august/pr970806-01.html,
`Aug. 1997, 4 pages.
`* cited by examiner
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 3 of 31 PageID #: 132
`
`

`

`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 4 of 31 PageID #: 133
`a
`a
`4e
`aPOQ
`61m
`33
`d
`g
`
`ba
`
`99mnm.m
`
`Pm1l}sm
`
`12mD9a3,g0
`
`cU
`
`BtO.n
`
`emmm072
`
`
` AN.“0U.Emmmzz<moz_m_Em>o<
`
`Hmv_%_n__8>c_%a_omc§o__ou_mfiA235m
`,mUE3823:EE
`
`£333.25:22m%ab._._:9.ns.H8:52:832>sum.2m:1..2.
`
`
`Wm5.;.22288825555.83-3ngaeaammdmBONE:Q392%___aI..IIIImPflW.E59EdiflwGODAUEHV:32;
`
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 2 of 19
`
`US 7,610,394 B2
`
`12 Na
`
`26
`
`Business
`Entertainment
`NeWS
`Sports
`
`24
`
`1-22
`
`FIG.2A
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 5 of 31 PageID #: 134
`
`FIG.2B
`
`
`
`
`
`O Business
`O Entertainment
`O NeWS
`O Business
`O Clinton
`O Crime
`O Health
`b Human interest
`O Live NewS
`O Nation
`O Politics
`o Technology & Science
`O WOrld
`o Sports
`
`24
`
`29
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 3 of 19
`
`US 7.610,394 B2
`
`
`
`O Business
`O Entertainment
`O NeWS
`O Business
`O Clinton
`O Crime
`O Health
`O Human Interest
`O Live NeWS
`O Nation
`O Politics
`Democrats
`CGore Pushes for IRS Refor
`(5 Joe Kennedy Will Not Seek Re-Election
`(5 Vote GOre in 2000
`Republicans
`30
`O Technology & Science
`O World
`o Sports
`
`Business Entertainment Sports
`
`News
`
`?
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 6 of 31 PageID #: 135
`
`FIG.2C
`
`

`

`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 7 of 31 PageID #: 136
`61..m
`7
`2
`63
`
`mU
`
`AN“m88s9820>nU.“.2”.xomm“oz___>>>833.
`
`mm:E3.55900wm82.0.“.o9»vv8:0>2mDamco=mzo
`
`wow8NV0E§mm$223281SoJ
`mmcm.Kwfimhokhcqufi
`.L.«262ms:0v53E50>59m8:09520”.9:.mm.3%S.A«..__n_
`
`ewmmmn,DL28:2:qu-
`
`film9562omM£329,:o10dmeeHeE-hS
`
`082:9“.0
`
`Am
`
`#l.Dmmm.GE
`
`63,mm1"m,
`
`_cmo__n_:.mmImS3020>u0U7cox8.;8mgLi906EP2988mm-836mmm..2$53".956HS
`
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 5 Of 19
`
`US 7,610,394 B2
`
`698999
`
`*/
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`09
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 8 of 31 PageID #: 137
`
`BEOUn}
`
`EEEEE,
`
`-' ', ' , ' | \~gt;
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 6 of 19
`
`US 7,610,394 B2
`
`FIG.6A
`
`Following Clips are in Your Player q
`
`S for IRS Reform
`Of Solar Eclipse: A Rare Spectacle in the Sky
`Y-14
`
`FIG.6B
`
`
`
`72
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`46
`PlayLists d The Following Clips are in Your Player g
`72 - 44
`Quincy Jones introducin
`gTamia:You Put A.
`Z f MoveOn My Heart
`Warner Brothers. The Soundtrack from the
`film Midnight in The Garden Of Good & Evil
`Paula Cole: Don't Want To Wait (Large
`99K)
`7
`Z f David Byrne Miss America
`
`
`
`
`
`d
`
`
`
`PlayLists
`> The Following Clips are in YourPlayer q
`2
`72
`7.
`72
`7.
`2
`(hovies News Technology Olympics Euro
`
`SE
`
`
`
`
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 9 of 31 PageID #: 138
`
`
`
`6
`
`114
`
`00:59.0029.4
`. . . . . . . .
`110
`
`108
`
`

`

`U.S. Patent
`
`
`
`US 7,610,394 B2
`
`
`
`
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 10 of 31 PageID #: 139
`
`
`
`"uÐÁeldlee H
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 8 of 19
`
`US 7,610,394 B2
`
`
`
`
`
`spooei ºl 10 y?[No.s] [-T??
`
`
`
`su?e?uoo @10exa O
`
`
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 11 of 31 PageID #: 140
`
`818
`
`

`

`U.S. Patent
`
`
`
`US 7,610,394 B2
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 12 of 31 PageID #: 141
`
`

`

`U.S. Patent
`
`US 7,610,394 B2
`
`
`
`ETT CEHOS
`
`
`
`||NEAE ONW/8
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 13 of 31 PageID #: 142
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 11 of 19
`
`US 7,610,394 B2
`
`A.1002
`
`PAGELESS WEB
`SERVER & BROWSER
`COMPONENTS
`
`102O
`
`WebServer
`APPLICATION
`SERVER
`
`1025
`
`EE
`
`MEDIA
`SERVERS
`
`101
`010
`CONTENT
`DATABASE
`
`1012
`
`INTERFACE
`DATABASE
`
`1014
`
`USER
`DATABASE
`
`CLIENT/WEB PAGE
`
`USER
`DATABASE
`DATA SOURCE
`OBJECTS
`
`NTERFACE
`AND CONTENT
`DATA SOURCE
`OBJECTS
`
`PROGRAM LOGIC
`DOCUMENT OBJECTS/EVENTS
`EVENT LOGIC
`DATABOUND DHTML OBJECTS
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 14 of 31 PageID #: 143
`
`
`
`
`
`CLENT
`MEMORY
`
`
`
`MEDIA
`PLAYER
`OBJECT
`
`FIG 10
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 12 of 19
`
`US 7,610,394 B2
`
`ON CLIENT LOAD
`
`
`
`YES OUERY USER
`DATABASE
`
`CREATE
`NEW USER
`IN USER
`DATABASE
`
`GET
`NEW USER
`D
`
`
`
`
`
`1106
`
`LOAD
`SEOUENCER
`DSO W/USER
`TABS AND
`PLAY LISTS
`
`1108
`
`LOAD USER
`SPECIFIC
`SITE
`PRE-LOADS
`
`
`
`WRITE
`COOKE
`WITH
`USERD
`
`
`
`
`
`
`
`
`
`LOAD SITE
`SPECIFIC
`PRE-LOADS
`
`
`
`
`
`
`
`GET MICRON
`ACCESS
`TOP TABS
`
`START
`SPONSOR
`BANNER
`ROTATION
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 15 of 31 PageID #: 144
`
`FIG 11
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 13 Of 19
`
`US 7,610,394 B2
`
`NAVIGATES OUTLINE, DRAGS MICON
`
`OUTLINE
`
`12O2
`
`CLOSE
`OUTLINE
`OPEN
`AT SAME
`LEVE
`
`1204
`
`
`
`
`
`
`
`
`
`BLINK
`“RETREVING
`ELEMENT"
`IN RED
`
`12O6
`
`GET SOL
`OUERYDATA
`FROM CLENT
`MEMORY
`
`1208
`
`GENERATE
`SQL OUERY,
`SEND TO
`SERVER
`
`1210
`
`RECEIVE
`RECORDSET
`STORE IN
`CLIENT MEMORY
`
`
`
`
`
`
`
`
`
`
`
`MICON
`
`122O
`
`COPY MICON
`TO DRAG LAYER:
`CHANGE COLOR
`ON DRAG
`
`1222
`
`
`
`1224
`
`MICON
`DRAGGED TO
`SEOUENCER
`
`DRAGGED
`MICON
`DSAPPEARS
`
`1226
`
`APPEND MICON
`RECORD FROM
`MEMORY TO
`SEOUENCER
`DSO
`APPLY USER
`AND TAB IDS
`TO RECORD
`
`1228
`
`
`
`UPDATE USER
`DATABASE
`TABS 8.
`PLAYLISTS
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 16 of 31 PageID #: 145
`
`1212
`
`
`
`FORMAT, WRITE
`OUTLINE LEVE
`TO SCREEN
`FROMMEMORY
`
`FIG. 12
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 14 of 19
`
`US 7,610,394 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`USER SWITCHES TABS INSEOUENCER
`1300
`
`TAB CLICK
`
`1308
`
`DATASET CHANGE
`RESETS SOURCE
`FOR THE OBJECT
`PLAYER. OBJECT
`PLAYER READY
`TO PLAY FIRST
`CHECKED OBJECT
`
`SEOUENCER DSO
`SUBMT CHANGES
`N RECORDSET TO
`USER DATABASE
`
`
`
`FILTER DSO
`RECORDSET
`ONNEW TAB ID
`
`
`
`
`
`PLAY LIST
`TABLE BOUND TO
`DSO REWRITES
`
`FIG. 13A
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 17 of 31 PageID #: 146
`
`
`
`USER CHANGES TABS IN SEOUENCER
`1350
`
`PLAY LISTS
`MENU SELECT
`CREATE: tabrane
`DELETE: tabrane
`RENAME: tabname
`
`FILTER AND
`CHANGE TAB FIELD
`OF SEOUENCER
`DSO RECORDSET
`
`TAB TABLE
`BOUND TO
`DSO REWRITES
`
`FIG. 13B
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 15 of 19
`
`US 7,610,394 B2
`
`USERNAVIGATES TABS
`
`
`
`USER
`DATABASE
`LOAD TO
`SEQUENCER
`
`cEis
`OR
`EDITS TABS
`
`USER CLICKS
`TAB-LEFT
`BUTTON
`
`USER CLICKS
`TAB-RIGHT
`BUTTON
`
`TAB DISPLAY
`MANAGER
`
`CHECK FOR
`TABS TO THE
`LEFT
`
`CHECK FOR
`TABS TO THE
`RIGHT
`
`SET FIRST TAB -
`FIRST TAB - 1
`
`SET LAST TAB =
`LAST TAB +1
`
`SET LAST TAB TO
`FIRST/LAST TAB
`+1 UNTIL NO
`MORE TABS FIT
`ONAXIS
`
`SET FIRST TAB TO
`LAST/FIRST TAB
`-1 UNTINO
`MORE TABS FIT
`ONAXIS
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 18 of 31 PageID #: 147
`
`POSITION
`VISIBLE TABS
`
`POSITION
`VISIBLE TABS
`
`1350
`
`RESETTAB
`LWR BUTTONS
`
`FIG. 13C
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 16 of 19
`
`US 7.610,394 B2
`
`USER PLAYS PLAY LIST
`1400
`
`PLAYBUTTON
`CLICKED
`
`14O6
`
`GET SPONSOR
`SEGE
`DSO FOR PLAYING
`MEDIA OBJECT
`
`1410
`
`
`
`OBJECT
`PLAYER
`BUFFERS
`STREAM
`
`1402
`
`
`
`STOP DEFAULT
`BANNER
`ROTATION
`
`1404 STARTMEDIA OBJECT
`SPECIFIC ROTATION
`(e.g. SOURCE,
`SPONSORBANNERS)
`
`
`
`
`
`
`
`
`
`
`
`
`
`GET
`MEDIA
`TYPE AND
`MAGE
`SIZE
`
`
`
`
`
`1412
`SIZE >
`DEFAULT
`
`1414
`NO
`
`DIALOG
`BOX: EXPAND
`DISPLAY
`2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`CHANGE
`SEOUENCER
`FIELD
`
`BOUND DHTML
`CHECKBOX
`UNCHECKS
`
`1430
`
`MEDIA OBJECT
`
`1440
`
`PLAY ENDS
`
`1442
`
`FIND NEXTNNO
`SE
`HECKBO
`?
`
`STOP
`
`1450
`
`USE
`DEFAULT
`SIZE
`
`
`
`DISPLAY
`
`1416
`
`
`
`
`
`
`
`
`
`
`
`142O
`IS
`DISPLAY Y NO
`IN HOME
`POSITION
`2
`
`YES
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1444
`
`
`
`SET HIGHLGHT
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 19 of 31 PageID #: 148
`
`1446
`
`
`
`LOAD URL
`
`1448
`
`1452
`
`1422
`
`START DEFAULT
`BANNER
`ROTATION
`
`CENTER
`DISPLAY
`IN HOME
`POSITION
`
`1424
`
`FIG. 14
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 17 Of 19
`
`US 7,610,394 B2
`
`DRAGGING BANNERS
`
`
`
`
`
`
`
`MICON
`BANNER
`DRAGGED
`
`TOUCHING
`IMAGE
`DISPLAY
`p
`
`1506
`NO
`
`1510
`
`BANNER
`DSAPPEARS
`
`
`
`
`
`
`
`
`
`CHANGE
`CURRENTLY
`PLAYING
`HGHLGHT TO RED
`
`PLAY BANNER
`MEDIA OBJECT
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 20 of 31 PageID #: 149
`
`ATPLAY END
`CHANGE
`HIGHLIGHT BACK
`TO YELLOW
`
`RESTART CURRENT
`
`GET MEDIA
`OBJECT URL FROM
`SEQUENCER DSO
`CURRENTRECORD
`
`CREATE NEW
`SECRUENCER
`DSO RECORD
`
`152O
`
`COPY USER
`& TAB ID'S
`TO RECORD
`
`1522
`
`COPY BANNER
`MEDIA OBJECT
`DATA TO NEW
`RECORD
`
`
`
`NEW DSO
`FIELD UPDATES
`BOUND
`PLAY STABLE
`
`1524
`
`1526
`
`1540
`
`1542
`
`1544
`
`1546
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 18 of 19
`
`US 7.610,394 B2
`
`OPENS MICON POP-UP
`
`16O2
`
`1604
`
`16O6
`
`
`
`GET SPONSOR OR
`PLAYER POP-UP
`STRING FROM
`SEOUENCER DSO
`CURRENTRECORD
`
`SHOW
`BUILDING
`MENU
`MESSAGE
`
`PASS
`STRING TO
`POP-UP
`ENGINE
`
`
`
`
`
`
`
`1634
`
`SECTION
`
`END OF STRING
`
`
`
`SELECT
`LOWER MENU
`
`TEST FOR <,
`DATA,
`
`
`
`TEST
`FOR LOWER
`MENU
`LEVEL
`
`1630 1618
`
`
`
`PARSE DATA
`
`1632
`
`BUILD MENU
`LEVEL
`
`- - - - - - - - - - - - - - arm - - -
`
`POP-UPMENU BUILDER
`
`INSERT MENU
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 21 of 31 PageID #: 150
`
`INSERT
`TEXT/GRAPHICS
`
`OPENTABLE TAGS
`
`ADD CLOSE
`TABLE TAGS
`
`INSERTMENU
`
`BORDER
`
`CREATE MENU
`
`TEMRows
`
`END OF TEMS
`
`

`

`U.S. Patent
`
`Oct. 27, 2009
`
`Sheet 19 of 19
`
`US 7.610,394 B2
`
`d
`Preview
`Description d
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`info
`Source
`Sponsor D Copyright
`Buy
`Modify Date
`d ImageSize d.
`102 Height x 100 Width
`Details
`Media Type d
`Frame Rated
`
`
`
`
`
`FIG. 17
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 22 of 31 PageID #: 151
`
`

`

`1.
`WEBAPPLICATION FOR ACCESSING
`MEDIA STREAMS
`
`US 7,610,394 B2
`
`2
`the graphical object. Agraphical icon can be dragged from the
`media access area to the sequencer to add the media object
`represented by the graphical icon to the play list. The
`sequencer can display one of multiple play lists, and the user
`may switch between play lists by selecting a tab associated
`with the play list. For each graphic object in the play list, the
`play list box may contain a copy of the graphical icons rep
`resenting the graphical object, a checkbox to control whether
`the player will play the graphic object, and a pop-up menu to
`provide information about the graphic object. The sequencer
`and media access area may be implemented with Scripted
`DHTML. The media access area may include an expandable
`and collapsible outline of Subjects, and the media icons may
`be arranged in lists in the outline. The media access area may
`include a tab for each subject at a top level of the outline, and
`the user can Switch between subjects by selecting a one of the
`tabs. The media access area may display one of a plurality of
`outlines, and the user can switch between outlines by select
`ing a tab. The player may include a control panel and a
`draggable image display window. The image display window
`may include a home button to return the image display win
`dow to a home position on the web page, an image area, a
`handle, a button to hide the image area, and a size lockbutton
`to prevent the image display window from expanding beyond
`a default size. The web page may further include a site-driven
`area to display a banner. The banner may be synchronized
`with the media object being played by the player, and a media
`object may be associated with the banner. The user may
`change the play list to play the media object associated with
`the banner by manipulating the banner. Dragging the banner
`to the sequencer may add the media object associated with the
`banner to the play list, and dragging the banner to the image
`area of the player may play the media object associated with
`the banner. The banner may include a pop-up menu to display
`information about the media object associated with the ban
`.
`In another aspect, the invention is directed to a method of
`operating a web page. Multiple sources of streaming content
`are displayed to a user, and user input is received to select a
`playing order for the Sources of streaming content. The play
`ing order is stored, user input is received to start delivering the
`streaming content to the user, and the streaming content is
`presented to the user in the stored order.
`In another aspect, the invention is directed to an Internet
`site having a first database to store information about a plu
`rality of media objects, a second database to store information
`about how the media objects are to be presented on a web
`page, a third database to store information about a plurality of
`users, and an application server for communicating with a
`client running the web page.
`Advantages of the invention may include one or more of
`the following. The user can locate and control streams of
`multimedia content in real time without accessing different
`web pages or Surrendering control to a media player program.
`A user can define and assemble multiple sequences of media
`objects, particularly sources of streaming content. The user
`can manage a persistent personal collection of media objects
`from a network client. The user can gather additional stream
`ing content while a media object is playing, and can modify
`and create sequences while a media object is playing. The
`user can add and remove media objects from a sequence, can
`deselect media objects to prevent them from playing without
`removing them from a sequence, and can Switch between
`different user defined sequences. New media objects can be
`preloaded into a sequence based on a personal preference or
`interest profile defined by the user. Individual user histories
`(as defined by the order in which a user adds media objects to
`
`CROSS REFERENCE TO RELATED
`APPLICATION
`
`This application is a continuation of U.S. application Ser.
`No. 09/187,256, filed Nov. 6, 1998, now U.S. Pat. No. 6,452,
`609 issued Sep. 17, 2002.
`
`BACKGROUND
`
`The present application relates generally to providing
`media streams from Internet sites.
`The WorldWideWeb (WWW) is conventionally conceived
`as a system in which a user navigates between text documents
`on different servers by means of hypertext links. Activating a
`hypertext link causes another page, also composed of textand
`links, to be delivered to the client computer. Thus, on the
`WWW, a user's experience is determined by the order in
`which the user clicks on links.
`In general, non-text objects are treated as illustrations
`placed on text pages. Although WWW standards include an
`open ended specification for handling multimedia files that
`allows media objects to be referenced by hypertext links,
`those references are treated no differently than hypertext links
`to pages and illustrations. Typically, three techniques are used
`to access multimedia files. First, a link can point to a special
`media file that requires a special player program to produce
`the images and Sounds of the media file. Second, the link can
`point to a player program that starts independently of the web
`browser to play the media file. The interface provided by the
`player program controls the media file. Third, the link can
`point to a player program embedded in the page. In this case,
`the user can click on the link to choose which media file to
`play without leaving the page. However, the size of the image
`displayed and the controls available to the user are chosen by
`the web page designer.
`The currently available tools that can be used to synchro
`nize the presentation of multimedia components include pro
`prietary languages. Such as Macromedia's Lingo and Apple's
`HyperCard, and Scripting languages. Such as ECMAScript
`(JavaScript). In recognition of the difficulty of multimedia
`authoring with the currently available tools, the World Wide
`Web Consortium (W3C) has proposed a new language called
`the Synchronized Multimedia Integration Language (SMIL).
`The WWW was developed for utility in the assembly and
`cross referencing of text content documents with user free
`dom in navigation. On the other hand, multimedia develop
`ment has focused on interactive but canned content with
`limited use options that are defined by the author. Thus,
`multimedia on the web has been subject to conflicting devel
`opmental pressures, and has not developed a coherent presen
`tation format.
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 23 of 31 PageID #: 152
`
`SUMMARY
`
`In one aspect, the invention is directed to a web page with
`a player for playing media objects, a sequencer which dis
`plays a play list that defines an order in which media objects
`are played by the player, a media access area for containing a
`plurality of graphical icons. Each graphical icon representing
`a media object, and the graphical icons can be manipulated by
`a user to modify the play list.
`Implementations of the invention may include the follow
`ing features. The graphical icon includes an indication of a
`media type of the media object and text describing content of
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`

`

`US 7,610,394 B2
`
`3
`sequences and plays the media objects) can be used to gen
`erate an outline organized by user-defined tabs and dates.
`Users can exchange play lists and player combinations by
`electronic mail.
`The details of one or more embodiments of the invention
`are set forth in the accompanying drawings and the descrip
`tion below. Other features and advantages of the invention
`will become apparent from the description, the drawings, and
`the claims.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`5
`
`10
`
`15
`
`4
`The pageless Internet site is an inversion of conventional
`web site design. In conventional web site design the media
`object is the last link in a long chain of pages and links. The
`setting, context, meaning, and relevance of the media object
`are established in hypertext, and the media object is an adorn
`ment for the hypertext. In contrast, in the pageless Internet
`site, the media object is the starting point. The pageless Inter
`net site is media-oriented, as opposed to being text-oriented
`with media annotations. In short, the principle of organization
`of web page 10 is the relationship between media objects,
`rather than the relationship between pages.
`As shown in FIG. 1, the media access web page 10 has four
`functional areas, including a media icon access panel 12, a
`sequencer 14, an object player 16, and a site-driven area 18.
`The media icon access panel 12 organizes media icons into a
`hierarchical outline or list, and Supports searches for media
`objects. The sequencer 14 allows the user to select media
`icons from the media icon access panel 12, and to create and
`modify one or more user defined play lists. The object player
`16 plays the media objects in the order defined by the play list.
`In addition, the object player 16 can control the play list and
`the individual media objects in the play list. The site-driven
`area 18 presents site-driven graphics synchronized with
`streaming content that responds to user actions and user
`selected content. The graphics can also be media icons rep
`resenting more media objects. The web page 10 can be imple
`mented with JavaScript and HTML 4.0, and can be accessed
`with a web browser, such as Microsoft Internet Explorer 4.0.
`Each of the components of the web page 10 will be described
`in greater detail below.
`The media icon access panel 12 has a series of Subject
`matter tabs 22 arranged along an edge of the panel. To begin
`browsing the content of the site, the user selects one of the
`Subject matter tabs 22, for example, by clicking on it with a
`mouse controlled cursor. As shown in FIG. 2A, clicking on a
`subject matter tab 22 causes the top level of an outline 24 to
`appear as a bulleted list containing bulleted items 26. In
`addition, clicking the Subject matter tabs 22 causes outline
`item tabs 28 to appear at the bottom of the media icon access
`panel 12. Each outline item tab 28 corresponds to one of the
`top level bulleted items 26 in the outline 24.
`As shown in FIG. 2B, clicking on either the text of a
`bulleted item 26 or the corresponding outline item tab 28 at
`the bottom of the media icon access panel 12 will cause the
`next level of the outline to be displayed as a bulleted sublist
`29. Clicking on a bulleted item in a sublist causes the next
`lower level of the outline to be displayed. In order to manage
`large outlines without excessive scrolling, the sections of the
`outline will expand and collapse so that only one item of each
`level of the outline is expanded at a time. For example, FIG.
`2B shows the “News' section of the outline has been
`expanded. Clicking on any bullet at the same level. Such as the
`“Sports' bullet, would expand the outline to show the items in
`that bullet, but would also close the “News' section.
`As shown in FIG. 2C, the lowest level of the outline is a list
`36 of media icons 30. Each media icon 30 represents a media
`object. Each media icon includes a graphic icon32 indicating
`the media type. Such as audio, video, text, executable code,
`graphic, or unknown, of the media object. Each media icon
`also includes accompanying text 34 to briefly explain the
`content of the media object. When a cursor 42 moves over a
`media icon, the media icon is highlighted to indicate that it is
`selectable. Clicking on a media icon 30 does not open another
`level of the outline. Rather, as shown in FIG. 3A, holding the
`mouse select button down when a media icon is highlighted
`creates a copy 40 of the selected media icon, in a contrasting
`color. The user can drag the media icon copy 40 with the
`
`FIG. 1 illustrates a media access web page according to the
`present invention.
`FIGS. 2A-2C illustrate the use of a media icon access panel
`from the web page of FIG. 1.
`FIG. 3A-3B illustrate the step of dragging a media icon
`from the access panel to a sequencer from the web page of
`FIG 1.
`FIG. 4 illustrates the sequencer containing several media
`icons.
`FIG. 5 illustrates the use of a media object pop-up menu.
`FIG. 6A-6C illustrate the manipulation of multiple play
`lists by the sequencer.
`25
`FIG. 7 illustrates the object player from the web page of
`FIG 1.
`FIGS. 8A-8C and 9A-9C illustrate the operation of the
`site-driven area from the Internet site of FIG. 1.
`FIG. 10 illustrates a pageless Internet site for generating a
`media access web page.
`FIG. 11 illustrates a method performed when a user con
`tacts a media access web page server.
`FIG. 12 illustrates a method performed when a user inter
`acts with the media icon access panel.
`FIGS. 13 A-13C illustrate methods performed when a user
`Switches or changes tabs in the sequencer.
`FIG. 14 illustrates a method performed whena user plays a
`media object from a play list in the sequencer.
`FIG. 15 illustrates a method performed when a user drags
`a banner from the site-driven area.
`FIG. 16 illustrates a method performed when a user acti
`Vates a media icon pop-up menu.
`FIG. 17 illustrates a media icon pop-up menu.
`
`30
`
`35
`
`40
`
`Case 1:20-cv-01370-UNA Document 1-6 Filed 10/09/20 Page 24 of 31 PageID #: 153
`
`DETAILED DESCRIPTION
`
`45
`
`FIG. 1 shows a media access web page 10 generated by an
`Internet site that is particularly Suited for accessing multime
`dia streams. The Internet site is “sequence-oriented’, i.e., the
`user controls the sequence in which multimedia streams are
`presented. In addition, the Internet site is “pageless, in that
`media streams are delivered to the user without the user
`having to navigate to different pages. The media streams may
`be a variety of media types, such as text, audio, images,
`animation, video, executable code, or any combination of
`media types. The Internet site is a media-type neutral system,
`i.e., it treats different media types. Such as audio and video, in
`a similar fashion.
`The building blocks of the Internet site include playable
`media content units, called “media objects', and graphical
`representations, of the media content units called “media
`icons'. The user manipulates the media icons to create an
`individual sequence, i.e., a play list, of media objects. The
`web page 10 presents the media icons with text and/or graph
`ics to assist the user in determining how to manipulate the
`media icons.
`
`50
`
`55
`
`60
`
`65
`
`

`

`US 7,610,394 B2
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`5
`cursor 42. As shown in FIG. 3B, the media icon copy 40 can
`be dragged out of the media icon access panel 12 and dropped
`into the sequencer 14.
`As shown in FIG. 4, the sequencer 14 includes a play list
`box 44, a play list button 46, and control buttons 48. When the
`copy of the media icon is dragged near the sequencer 14, it
`will Snap into the play list box 44. By dragging media icons
`from the media icon access panel 12 into the sequencer 14, the
`user creates a sequence or play list 50 of media icons repre
`senting a playing order for the media objects associated with
`the media icons. Media objects can also be added to the play
`list 50 by double-clicking on the media icon 30 in the outline
`24. Each element in the play list50 includes the copy 40 of the
`media icon, a checkbox 54, and a pop-up icon 56. The user
`may select one of the media icons 30 in the sequence by
`clicking on it to make it the current media icon52. The current
`media icon 52 is highlighted in yellow and represents the
`media object that is playing, or that will play if a stopped
`player is started. If the number of elements in the play list 50
`exceeds the vertical height of the play list box 44, a scroll bar
`may be created to scroll through the play list.
`The user can modify the play list 50 to arrange the media
`objects into a desired playing order. For example, the user can
`change the order of media icons by dragging the media icon
`copy 40 inside the play list box 44. Clicking on a remove
`button 60 below play list box 44 deletes the current media
`icon, and clicking on a clear button 62 removes all media
`icons from the current play list50. Unchecking the checkbox
`54 to the left of the media icon copy 40 will cause that media
`object to be skipped when the play list is played. This permits
`the user to select a subset of a play list 50 to be played.
`As shown in FIG. 5, additional information about each
`media object is accessible by clicking on the pop-up icon to
`generate a pop-up menu 58. This information will depend on
`the nature of the media object, and can be determined by the
`manager of the Internet site. For example, the pop-up menu
`can display information about image size, media type and
`frame rate.
`As shown in FIG. 6A, the user can create and organize
`multiple play lists by use of the play list button 46. When the
`user clicks on the play list button 46, a pop up menu 70
`appears with four options: Create, Delete, Rename, and Go
`To. The create option adds a play list, the delete and rename
`options remove and rename a play list respectively, and the