Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 1 of 30
`
`Exhibit 1
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 2 of 30
`
`(12) United States Patent
`Katinsky et al.
`
`USOO6452609B1
`(10) Patent No.:
`US 6,452,609 B1
`(45) Date of Patent:
`Sep. 17, 2002
`
`(*) Notice:
`
`(54) WEB APPLICATION FOR ACCESSING
`MEDIA STREAMS
`(75) Inventors: Steve Katinsky, Los Angeles; Michael
`Burress, Venice; Jeffereson Furtado,
`Galt, all of CA (US)
`(73) Assignee: SuperTuner.com, Santa Monica, CA
`(US)
`-
`0
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`(21) Appl. No.: 09/187,256
`1-1.
`(22) Filed:
`Nov. 6, 1998
`(51) Int. Cl." .................................................. G09G 5/00
`(52) U.S. Cl. ................
`345/716. 345/854. 709/219
`(58) Field of Search ................................. 700,231. 219,
`709/228, 229; 345/327, 342, 346, 716,
`719, 723, 727, 733, 854
`References Cited
`U.S. PATENT DOCUMENTS
`
`6,262,723 B1 * 7/2001 Matsuzawa et al. ........ 345/328
`6,346,951 B1
`2/2002 Mastronardi ................ 345/716
`OTHER PUBLICATIONS
`http://java.sun.com/pr/1997/august/pr970806-01.html, Sun
`Delivers Rich Set Of Java Media and Communication APIs,
`Aug. 1997, pp. 1-4.*
`http://www.hitsquad.com/Smm/programs/MIDI Made
`Music Jukebox?, MIDI Made Music Jukebox V6.2, Jan. 22,
`1997, pp. 1-3 & attached.*
`Bouthillier, Synchronized W3C Format Is All Smiles, Sep.
`1998,
`WySiwyg://11/http://www.webtechniques.com/ar
`chives/1998/09/bouthillier, pp. 1-13 & attached.*
`Russell, Welcome to the Voltage Circuit Simulator (with
`Java Source
`code),
`http://www.javasoft.com/applets/
`archive.beta/Voltage/index.html, pp. 1-2, http://www.java
`Soft.com/appletS/archive.beta/Voltage/voltage/voltage.java,
`pp. 1-12, Sep. 1995.
`Anonymous, DHTML tool war begins, Feb. 1998, Web
`Techniques, vol. 3, Issue 2, p.7."
`cited by examiner
`Primary Examiner-Glenton B. Burgess
`Assistant Examiner Bradley Edelman
`(74) Attorney, Agent, or Firm-Fish & Richardson P.C.
`(57)
`ABSTRACT
`3/1998 Gentner ...................... 707/501
`5,724,595 A
`A web page has a player for playing media objects, a
`5,793,366 A 8/1998 Mano et al. ................ 345/329
`Sequencer which displays a play list that defines an order in
`5,796,945 A 8/1998 Tarabella ......
`... 395/2009
`which media objects are played by the player, and a media
`5,864,868 A 1/1999 Contois ...................... 707/104
`acceSS area for containing a plurality of graphical icons.
`5,905,983 A 5/1999 Inomata et al................ 707/4
`CE A 3.
`Wit. et Fa - - - - - - - - -
`- - - 55. Each graphical icon representing a media object, and the
`6025,841. A
`2/2000 Neti al... 345A342
`graphical icons can be manipulated by a user to modify the
`6.133,913 A 10/2000 White et al. .........
`... 345/327
`play list. For example, the media icons may be draged to the
`6,141,010 A * 10/2000 Hoyle .................
`... 345/356
`sequencer to add them to the Sequencer.
`6,169,997 B1 * 1/2001 Papierniak et al. ......... 707/501
`6,226,618 B1
`5/2001 Downs et al. ................. 705/1
`
`28 Claims, 19 Drawing Sheets
`
`(56)
`
`
`
`Media and Transactions, Inc.
`Help || < V × V 0.6G, GC 2 FT d as
`|File
`Edit
`View Go Favorites
`| Address
`http://205,180.55.240 marine/Drop Folder? Transferidso0827white.htm
`
`00000000
`
`ADWERTISING BANNER
`
`a
`w
`
`18
`
`(egld
`RealPlayer.
`
`PlayLists
`
`dThe Following Clips are in YourPlayer g
`
`Topics
`
`People
`
`sites
`
`search
`
`Clear Hide Video Close unload
`
`fe internet zone
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 3 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 1 of 19
`
`US 6,452,609 B1
`
`
`
`Ø
`
`
`
`
`
`HENN\/£ €)NISI LHE ACIV/
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 4 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 2 of 19
`
`US 6,452,609 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG.2B
`
`
`
`
`
`
`
`
`
`24
`
`BusineSS
`O Entertainment
`O NeWS
`• Sports
`
`Business
`O Entertainment
`O NeWS
`O Business
`O Clinton
`O Crime
`o Health
`5 Human interest
`O Live NeWS
`O Nation
`O POliticS
`o Technology & Science
`O World
`Sports
`
`29
`
`24
`
`
`
`
`
`
`
`
`
`Business Entertainment Sports
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 5 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 3 of 19
`
`US 6,452,609 B1
`
`
`
`Sites
`
`Search
`
`People
`Topics
`O BUSineSS
`O Entertainment
`O NeWS
`o BusineSS
`o Clinton
`O Crime
`O Health
`o Human Interest
`O Live NeWS
`O Nation
`O PoliticS
`Democrats
`GGore Pushes for IRS Refor
`(Joe Kennedy Will Not Seek Re-Election
`(Vote GOre in 2000
`Republicans
`-- 30
`o Technology & Science
`O World
`o Sports
`
`Business Entertainment Sports
`
`News
`
`FIG.2C
`
`?
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 6 of 30
`
`U.S. Patent
`
`US 6,452,609 B1
`
`
`
`
`
`SMêN ?A?II o
`
`
`
`W78 T-50/-|
`
`
`
`878 T-50/-|
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 7 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 5 of 19
`
`US 6,452,609 B1
`
`698999#792909
`ÈÈÈÊÊË??È??,
`
`s/
`
`09
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 8 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 6 of 19
`
`US 6,452,609 B1
`
`FIG.6A
`
`72
`
`FIG. 6B
`
`Warner Brothers. TheSoundtrackfor the
`film Midnight in The Garden Of Good & Evil
`Z f Paula Cole: Don't Want To Wait (Large
`99K)
`Z (5 David Byrne Miss America
`
`
`
`74
`
`FIG.7
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 9 of 30
`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 9 of 30
`
`US. Patent
`
`US 6,452,609 B1
`
`«0:0
`
`330:.@302
`
`m*m:m<*03:55«A.
`0*9:meUn38mgm8a35:3“n.%25:00©686OE25:IE!2533.88.m2:...ou,um_t<o
`
`
`
`m1EmammmmficogEacnioomaoIdemmV62“.5822
`ON“m;\
`
` La;2ea;can_u35:mmE53:8_n.SEE$52%28nDas.a”.S“.8225583EEEEE
`
`
`
`<mI.GE
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 10 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 8 of 19
`
`US 6,452,609 B1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`su?e?uoo @ Joex= O
`
`08
`
`㼠91
`
`818
`?H
`
`O8
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 11 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 9 of 19
`
`US 6,452,609 B1
`
`
`CHO V HO-, HEINNV/E|
`
`
`
`
`SONISI LHE AGV 50N||VLOH
`
`
`
`
`
`4 Josu.Ods
`
`
`
`C)
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 12 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 10 0f 19
`
`US 6,452,609 B1
`
`
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 13 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 11 0f 19
`
`US 6,452,609 B1
`
`m met me me sm m sm sess as as
`
`-(---------------
`
`1OO2
`
`? OOO
`
`PAGELESS WEB
`SERVER & BROWSER
`COMPONENTS
`
`1020
`
`1010
`
`CONTENT
`DATABASE
`
`
`
`1012
`
`INTERFACE
`DATABASE
`
`1014
`
`
`
`USER
`DATABASE
`
`WebServer
`APPLICATION
`SERVER
`
`1025
`
`
`
`EEE
`
`MEDIA
`SERVERS
`
`CLIENT/WEB PAGE
`
`USER
`DATABASE
`DATASOURCE
`OBJECTS
`
`INTERFACE
`AND CONTENT
`DATA SOURCE
`OBJECTS
`
`PROGRAM LOGIC
`DOCUMENT OBJECTS/EVENTS
`EVENT LOGIC
`DATABOUND DHTML OBJECTS
`
`CLENT
`MEMORY
`
`
`
`MEDIA
`PLAYER
`OBJECT
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Soo
`
`FIG.10
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 14 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 12 0f 19
`
`US 6,452,609 B1
`
`ON CLIENT LOAD
`
`YES OUERY USER
`DATABASE
`
`CREATE
`NEW USER
`NUSER
`DATABASE
`
`GET
`NEW USER
`D
`
`
`
`11 O6
`
`LOAD
`SEOUENCER
`DSO W/USER
`TABS AND
`PLAY LISTS
`
`1108
`
`LOAD USER
`SPECIFIC
`SITE
`PRE-LOADS
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`WRITE
`CRISE
`
`LOAD STE
`SPECIFIC
`
`GET MICRON
`ACCESS
`
`START
`SPONSOR
`BANNER
`
`FIG 11
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 15 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 13 0f 19
`
`US 6,452,609 B1
`
`NAVIGATES OUTLINE, DRAGS MICON
`
`OUTLINE
`
`MICON
`
`2O2
`
`1220
`
`CLOSE
`OUTLINE
`OPEN
`AT SAME
`LEVEL
`
`COPY MICON
`TO DRAG LAYER:
`CHANGE COLOR
`ON DRAG
`
`1204
`
`1222
`
`1224
`
`
`
`
`
`
`
`
`
`
`
`BLINK
`"RETREIVING
`ELEMENT"
`N RED
`
`12O6
`
`GET SOL
`OUERYDATA
`FROM CLIENT
`MEMORY
`
`1208
`
`GENERATE
`SQL OUERY,
`SEND TO
`SERVER
`
`1210
`
`RECEIVE
`RECORDSET
`STORE IN
`CLIENT MEMORY
`
`1212
`
`FORMAT, WRITE
`OUTLINE LEVEL
`TO SCREEN
`FROMMEMORY
`
`
`
`
`
`
`
`MICON
`DRAGGED TO
`SSQUENCE
`
`DRAGGED
`MICON
`DSAPPEARS
`
`1226
`
`APPEND MICON
`RECORD FROM
`MEMORY TO
`SEOUENCER
`DSO
`APPLY USER
`AND TAB IDS
`TO RECORD
`
`1228
`
`UPDATE USER
`DATABASE
`TABS 8.
`PLAYLISTS
`
`FIG. 12
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 16 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 14 Of 19
`
`US 6,452,609 B1
`
`USER SWITCHES TABS IN SECRUENCER
`1300
`
`TAB CLICK
`
`13O8
`
`DATASET CHANGE
`RESETS SOURCE
`FOR THE OBJECT
`PLAYER. OBJECT
`PLAYER READY
`TO PLAY FIRST
`CHECKED OBJECT
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1302
`
`SEOUENCER DSO
`SUBMIT CHANGES
`IN RECORDSET TO
`USER DATABASE
`
`
`
`FILTER DSO
`RECORDSET
`ONNEW TAB ID
`
`
`
`
`
`PLAY LIST
`TABLE BOUND TO
`DSO REWRITES
`
`FIG. 13A
`
`
`
`USER CHANGES TABS IN SEGUENCER
`1350
`
`PLAY LISTS
`
`CREATE: fabrianne
`DELETE: labrane
`RENAME: fabrane
`
`FILTER AND
`OF SECUENCER
`DSO RECORDSET
`
`FIG.13B
`
`BOUND TO
`DSO REWRITES
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 17 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 15 0f 19
`
`US 6,452,609 B1
`
`USERNAVIGATES TABS
`
`
`
`USER
`DATABASE
`LOAD TO
`SEOUENCER
`DSO
`
`cEis
`OR
`EDITS TABS
`
`USER CLICKS
`TAB-LEFT
`BUTTON
`
`USER CLICKS
`TAB-RIGHT
`BUTTON
`
`AB DISPLAY
`MANAGER
`
`CHECK FOR
`TABS TO THE
`LEFT
`
`CHECK FOR
`TABS TO THE
`RIGHT
`
`SET FIRST TAB =
`FIRST TAB -1
`
`SET LAST TAB =
`LAST TAB - 1
`
`SET LAST TAB To
`FIRST/LAST TAB
`+1 UNTIL NO
`MORE TABS FIT
`ONAXIS
`
`SET FIRST TAB TO
`LAST/FIRST TAB
`-1 UNTIL NO
`MORE TABS FIT
`ONAXIS
`
`POSITION
`VISIBLE TABS
`
`POSITION
`VISIBLE TABS
`
`f350
`
`RESET TAB
`L/R BUTTONS
`
`FIG. 13C
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 18 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 16 0f 19
`
`US 6,452,609 B1
`
`USER PLAYS PLAY LIST
`14OO
`
`PLAYBUTTON
`CLICKED
`
`
`
`OBJECT
`PLAYER
`BUFFERS
`STREAM
`
`1402
`
`
`
`1406
`
`GEISPONSOR
`SESSES
`DSO FOR PLAYING
`MEDIA OBJECT
`1410
`STARTMEDIA OBJECT
`STREEAULT 0SEE,
`(e.g. SOURCE,
`ROTATION
`SPONSORBANNERS)
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`GET
`MEDIA
`TYPE AND
`IMAGE
`SIZE
`
`
`
`1412
`SIZE >
`DEFAULT
`
`
`
`1414
`
`NO
`
`DIALOG
`BOX: EXPAND
`DISPLAY
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`CHANGE
`SECUENCER
`DSO CHECK
`FIELD
`
`1430
`
`MEDIA OBJECT
`PLAYS
`
`1440
`
`1442
`
`FIND NEXT
`
`NO
`
`QECKB9
`
`1444
`
`
`
`SET HIGHLIGHT
`
`1446
`
`1448
`
`PLAY
`
`
`
`
`
`USE
`DEFAULT
`SIZE
`
`RESIZE MAGE
`DISPLAY
`
`1416
`
`
`
`
`
`
`
`
`
`
`
`
`
`IS
`DISPLAY
`IN HOME
`POSITION
`
`YES
`
`1420
`NO
`
`CHECKBOX
`UNCHECKS
`
`1450
`
`1452
`
`1422
`
`START DEFAULT
`BANNER
`ROTATION
`
`FIG. 14
`
`CENTER
`DISPLAY
`IN HOME
`POSITION
`
`1424
`
`DONT
`MOVE
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 19 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 17 of 19
`
`US 6,452,609 B1
`
`DRAGGING BANNERS
`
`
`
`
`
`MICON
`BANNER
`DRAGGED
`
`TOUCHING
`IMAGE
`DISPLAY
`
`
`
`
`
`TOUCHING
`IMAGE
`DISPLAY
`
`YES
`
`1506
`NO
`
`1510
`
`BANNER
`DSAPPEARS
`
`
`
`
`
`
`
`
`
`GET MEDIA
`OBJECT URL FROM
`SEQUENCER DSO
`CURRENT RECORD
`
`
`
`CREATE NEW
`SEOUENCER
`DSO RECORD
`
`152O
`
`COPY USER
`8, TAB ID'S
`TO RECORD
`
`COPY BANNER
`MEDIA OBJECT
`DATATO NEW
`RECORD
`
`NEW DSO
`FIELD UPDATES
`BOUND
`PLAYLIST TABLE
`
`1522
`
`1524
`
`1526
`
`FIG. 15
`
`YES
`
`CHANGE
`CURRENTLY
`PLAYING
`HIGHLIGHT TO RED
`
`PLAY BANNER
`MEDIA OBJECT
`
`AT PLAY END
`CHANGE
`HIGHLIGHT BACK
`TOYELLOW
`
`RESTART CURRENT
`MEDIA OBJECT
`
`1540
`
`1542
`
`1544
`
`1546
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 20 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 18 of 19
`
`US 6,452,609 B1
`
`OPENS MICON POP-UP
`
`16O2
`
`1604
`
`1606
`
`GET SPONSOR OR
`PLAYER POP-UP
`STRING FROM
`SEOUENCER DSO
`CURRENT RECORD
`
`
`
`SHOW
`BUILDING
`MENU
`MESSAGE
`
`PASS
`STRING TO
`POP-UP
`ENGINE
`
`
`
`
`
`
`
`
`
`TEST
`FOR HIGHER
`MENU
`LEVEL
`2
`
`1634
`
`SECTION
`
`END OF STRING
`
`SELECT
`LOWER MENU
`
`
`
`TEST
`FOR LOWER
`MENU
`Ey.
`
`
`
`BUILD MENU
`LEVEL
`
`TEST FOR <,
`DATA,
`
`
`
`1630 f618
`
`PARSE DATA
`
`1632
`
`CREATE MENU
`ITEM
`
`INSERT MENU
`DV
`
`INSERT MENU
`BORDER
`
`INSERT
`TEXT/GRAPHICS
`
`OPENTABLE TAGS
`
`ADD CLOSE
`TABLE TAGS
`
`CREATE MENU
`ITEM ROWS
`
`END OF TEMS
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 21 of 30
`
`U.S. Patent
`
`Sep. 17, 2002
`
`Sheet 19 of 19
`
`US 6,452,609 B1
`
`
`
`
`
`
`
`
`
`d
`Preview
`Description d
`
`
`
`> Title
`info
`d Author
`Source
`Sponsor D Copyright
`Buy
`Modify Date imageSize 102 Height x 100 Width
`Details
`Wedia Types
`Frame Rated
`
`
`
`
`
`FIG.17
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 22 of 30
`
`1
`WEB, APPLICATION FOR ACCESSING
`MEDIA STREAMS
`
`US 6,452,609 B1
`
`2
`play list box may contain a copy of the graphical icons
`representing the graphical object, a checkbox to control
`whether the player will play the graphic object, and a pop-up
`menu to provide information about the graphic object. The
`Sequencer and media access area may be implemented with
`scripted DHTML. The media access area may include an
`expandable and collapsible outline of Subjects, and the
`media icons may be arranged in lists in the outline. The
`media acceSS area may include a tab for each Subject at a top
`level of the outline, and the user can Switch between Subjects
`by Selecting a one of the tabs. The media access area may
`display one of a plurality of outlines, and the user can Switch
`between outlines by Selecting a tab. The player may include
`a control panel and a draggable image display window. The
`image display window may include a home button to return
`the image display window to a home position on the web
`page, an image area, a handle, a button to hide the image
`area, and a size lock button to prevent the image display
`window from expanding beyond a default size. The web
`page may further include a Site-driven area to display a
`banner. The banner may be synchronized with the media
`object being played by the player, and a media object may
`be associated with the banner. The user may change the play
`list to play the media object associated with the banner by
`manipulating the banner. Dragging the banner to the
`Sequencer may add the media object associated with the
`banner to the play list, and dragging the banner to the image
`area of the player may play the media object associated with
`the banner. The banner may include a pop-up menu to
`display information about the media object associated with
`the banner.
`In another aspect, the invention is directed to a method of
`operating a web page. Multiple Sources of Streaming content
`are displayed to a user, and user input is received to Select
`a playing order for the Sources of Streaming content. The
`playing order is Stored, user input is received to start
`delivering the Streaming content to the user, and the Stream
`ing content is presented to the user in the Stored order.
`In another aspect, the invention is directed to an Internet
`Site having a first database to Store information about a
`plurality of media objects, a Second database to Store infor
`mation about how the media objects are to be presented on
`a web page, a third database to Store information about a
`plurality of users, and an application Server for communi
`cating with a client running the web page.
`Advantages of the invention may include one or more of
`the following. The user can locate and control Streams of
`multimedia content in real time without accessing different
`web pages or Surrendering control to a media player pro
`gram. A user can define and assemble multiple Sequences of
`media objects, particularly Sources of Streaming content.
`The user can manage a persistent personal collection of
`media objects from a network client. The user can gather
`additional Streaming content while a media object is playing,
`and can modify and create Sequences while a media object
`is playing. The user can add and remove media objects from
`a Sequence, can deselect media objects to prevent them from
`playing without removing them from a Sequence, and can
`Switch between different user defined sequences. New media
`objects can be preloaded into a Sequence based on a personal
`preference or interest profile defined by the user. Individual
`user histories (as defined by the order in which a user adds
`media objects to Sequences and plays the media objects) can
`be used to generate an outline organized by user-defined tabs
`and dates. Users can exchange play lists and player combi
`nations by electronic mail.
`The details of one or more embodiments of the invention
`are set forth in the accompanying drawings and the descrip
`
`BACKGROUND
`The present application relates generally to providing
`media Streams from Internet Sites.
`The World Wide Web (WWW) is conventionally con
`ceived as a System in which a user navigates between text
`documents on different Servers by means of hypertext linkS.
`Activating a hypertext link causes another page, also com
`posed of text and links, to be delivered to the client com
`puter. Thus, on the WWW, a user's experience is determined
`by the order in which the user clicks on links.
`In general, non-text objects are treated as illustrations
`placed on text pages. Although WWW standards include an
`open ended Specification for handling multimedia files that
`allows media objects to be referenced by hypertext links,
`those references are treated no differently than hypertext
`links to pages and illustrations. Typically, three techniques
`are used to access multimedia files. First, a link can point to
`a special media file that requires a special player program to
`produce the images and Sounds of the media file. Second, the
`link can point to a player program that Starts independently
`of the web browser to play the media file. The interface
`provided by the player program controls the media file.
`Third, the link can point to a player program embedded in
`the page. In this case, the user can click on the link to choose
`which media file to play without leaving the page. However,
`the size of the image displayed and the controls available to
`the user are chosen by the web page designer.
`The currently available tools that can be used to synchro
`nize the presentation of multimedia components include
`proprietary languages, Such as Macromedia's Lingo and
`Apple's HyperCard, and Scripting languages, Such as
`ECMAScript (JavaScript). In recognition of the difficulty of
`multimedia authoring with the currently available tools, the
`World Wide Web Consortium (W3C) has proposed a new
`language called the Synchronized Multimedia Integration
`Language (SMIL).
`The WWW was developed for utility in the assembly and
`croSS referencing of text content documents with user free
`dom in navigation. On the other hand, multimedia develop
`ment has focused on interactive but canned content with
`limited use options that are defined by the author. Thus,
`multimedia on the web has been Subject to conflicting
`developmental preSSures, and has not developed a coherent
`presentation format.
`
`15
`
`25
`
`35
`
`40
`
`45
`
`SUMMARY
`In one aspect, the invention is directed to a web page with
`a player for playing media objects, a Sequencer which
`displays a play list that defines an order in which media
`objects are played by the player, a media access area for
`containing a plurality of graphical icons. Each graphical
`icon representing a media object, and the graphical icons can
`be manipulated by a user to modify the play list.
`Implementations of the invention may include the follow
`ing features. The graphical icon includes an indication of a
`media type of the media object and text describing content
`of the graphical object. A graphical icon can be dragged
`from the media access area to the Sequencer to add the media
`object represented by the graphical icon to the play list. The
`Sequencer can display one of multiple play lists, and the user
`may Switch between play lists by Selecting a tab associated
`with the play list. For each graphic object in the play list, the
`
`50
`
`55
`
`60
`
`65
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 23 of 30
`
`US 6,452,609 B1
`
`3
`tion below. Other features and advantages of the invention
`will become apparent from the description, the drawings,
`and the claims.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 illustrates a media access web page according to
`the present invention.
`FIGS. 2A-2C illustrate the use of a media icon access
`panel from the web page of FIG. 1.
`FIGS. 3A-3B illustrate the step of dragging a media icon
`from the acceSS panel to a Sequencer from the web page of
`FIG. 1.
`FIG. 4 illustrates the Sequencer containing Several media
`icons.
`FIG. 5 illustrates the use of a media object pop-up menu.
`FIGS. 6A-6C illustrate the manipulation of multiple play
`lists by the Sequencer.
`FIG. 7 illustrates the object player from the web page of
`FIG. 1.
`FIGS. 8A-8C and 9A-9C illustrate the operation of the
`site-driven area from the Internet site of FIG. 1.
`FIG. 10 illustrates a pageless Internet Site for generating
`a media acceSS Web page.
`FIG. 11 illustrates a method performed when a user
`contacts a media access web page Server.
`FIG. 12 illustrates a method performed when a user
`interacts with the media icon access panel.
`FIGS. 13 A-13C illustrate methods performed when a
`user Switches or changes tabs in the Sequencer.
`FIG. 14 illustrates a method performed when a user plays
`a media object from a play list in the Sequencer.
`FIG. 15 illustrates a method performed when a user drags
`a banner from the Site-driven area.
`FIG. 16 illustrates a method performed when a user
`activates a media icon pop-up menu.
`FIG. 17 illustrates a media icon pop-up menu.
`DETAILED DESCRIPTION
`FIG. 1 shows a media access web page 10 generated by
`an Internet Site that is particularly Suited for accessing
`multimedia Streams. The Internet Site is “sequence
`oriented’, i.e., the user controls the Sequence in which
`multimedia Streams are presented. In addition, the Internet
`Site is “pageless', in that media Streams are delivered to the
`user without the user having to navigate to different pages.
`The media Streams may be a variety of media types, Such as
`text, audio, images, animation, Video, executable code, or
`any combination of media types. The Internet Site is a
`media-type neutral System, i.e., it treats different media
`types, Such as audio and Video, in a similar fashion.
`The building blocks of the Internet site include playable
`media content units, called “media objects', and graphical
`representations, of the media content units called “media
`icons'. The user manipulates the media icons to create an
`individual Sequence, i.e., a play list, of media objects. The
`web page 10 presents the media icons with text and/or
`graphics to assist the user in determining how to manipulate
`the media icons.
`The pageless Internet Site is an inversion of conventional
`Web Site design. In conventional web site design the media
`object is the last link in a long chain of pages and linkS. The
`Setting, context, meaning, and relevance of the media object
`are established in hypertext, and the media object is an
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`adornment for the hypertext. In contrast, in the pageless
`Internet Site, the media object is the Starting point. The
`pageless Internet Site is media-oriented, as opposed to being
`text-oriented with media annotations. In Short, the principle
`of organization of web page 10 is the relationship between
`media objects, rather than the relationship between pages.
`As shown in FIG. 1, the media access web page 10 has
`four functional areas, including a media icon acceSS panel
`12, a Sequencer 14, an object player 16, and a Site-driven
`area 18. The media icon access panel 12 organizes media
`icons into a hierarchical outline or list, and Supports Searches
`for media objects. The Sequencer 14 allows the user to Select
`media icons from the media icon acceSS panel 12, and to
`create and modify one or more user defined play lists. The
`object player 16 plays the media objects in the order defined
`by the play list. In addition, the object player 16 can control
`the play list and the individual media objects in the play list.
`The Site-driven area 18 presents site-driven graphics Syn
`chronized with Streaming content that responds to user
`actions and user Selected content. The graphics can also be
`media icons representing more media objects. The web page
`10 can be implemented with JavaScript and HTML 4.0, and
`can be accessed with a web browser, Such as Microsoft
`Internet Explorer 4.0. Each of the components of the web
`page 10 will be described in greater detail below.
`The media icon access panel 12 has a Series of Subject
`matter tabs 22 arranged along an edge of the panel. To begin
`browsing the content of the Site, the user Selects one of the
`Subject matter tabS 22, for example, by clicking on it with a
`mouse controlled cursor. AS shown in FIG. 2A, clicking on
`a Subject matter tab 22 causes the top level of an outline 24
`to appear as a bulleted list containing bulleted items 26. In
`addition, clicking the Subject matter tabS 22 causes outline
`item tabS 28 to appear at the bottom of the media icon access
`panel 12. Each outline item tab 28 corresponds to one of the
`top level bulleted items 26 in the outline 24.
`As shown in FIG. 2B, clicking on either the text of a
`bulleted item 26 or the corresponding outline item tab 28 at
`the bottom of the media icon acceSS panel 12 will cause the
`next level of the outline to be displayed as a bulleted Sublist
`29. Clicking on a bulleted item in a sublist causes the next
`lower level of the outline to be displayed. In order to manage
`large outlines without excessive Scrolling, the Sections of the
`outline will expand and collapse So that only one item of
`each level of the outline is expanded at a time. For example,
`FIG. 2B shows the “News' section of the outline has been
`expanded. Clicking on any bullet at the same level, Such as
`the “Sports' bullet, would expand the outline to show the
`items in that bullet, but would also close the “News' section.
`As shown in FIG. 2C, the lowest level of the outline is a
`list 36 of media icons 30. Each media icon 30 represents a
`media object. Each media icon includes a graphic icon 32
`indicating the media type, Such as audio, Video, text, execut
`able code, graphic, or unknown, of the media object. Each
`media icon also includes accompanying text 34 to briefly
`explain the content of the media object. When a cursor 42
`moves over a media icon, the media icon is highlighted to
`indicate that it is selectable. Clicking on a media icon 30
`does not open another level of the outline. Rather, as shown
`in FIG. 3A, holding the mouse select button down when a
`media icon is highlighted creates a copy 40 of the Selected
`media icon, in a contrasting color. The user can drag the
`media icon copy 40 with the cursor 42. As shown in FIG.3B,
`the media icon copy 40 can be dragged out of the media icon
`acceSS panel 12 and dropped into the Sequencer 14.
`AS shown in FIG. 4, the Sequencer 14 includes a play list
`box 44, a play list button 46, and control buttons 48. When
`
`

`

`Case 1:20-cv-03159-AKH Document 1-1 Filed 04/21/20 Page 24 of 30
`
`US 6,452,609 B1
`
`S
`the copy of the media icon is dragged near the Sequencer 14,
`it will Snap into the play list box 44. By dragging media
`icons from the media icon access panel 12 into the Sequencer
`14, the user creates a Sequence or play list 50 of media icons
`representing a playing order for the media objects associated
`with the media icons. Media objects can also be added to the
`play list 50 by double-clicking on the media icon 30 in the
`outline 24. Each element in the play list 50 includes the copy
`40 of the media icon, a checkbox 54, and a pop-up icon 56.
`The user may select one of the media icons 30 in the
`Sequence by clicking on it to make it the current media icon
`52. The current media icon 52 is highlighted in yellow and
`represents the media object that is playing, or that will play
`if a stopped player is started. If the number of elements in
`the play list 50 exceeds the vertical height of the play list box
`44, a Scroll bar may be created to Scroll through the play list.
`The user can modify the play list 50 to arrange the media
`objects into a desired playing order. For example, the user
`can change the order of media icons by dragging the media
`icon copy 40 inside the play list box 44. Clicking on a
`remove button 60 below play list box 44 deletes the current
`media icon, and clicking on a clear button 62 removes all
`media icons from the current play list 50. Unchecking the
`checkbox 54 to the left of the media icon copy 40 will cause
`that media object to be skipped when the play list is played.
`This permits the user to select a subset of a play list 50 to be
`played.
`As shown in FIG. 5, additional information about each
`media object is accessible by clicking on the pop-up icon to
`generate a pop-up menu 58. This information will depend on
`the nature of the media object, and can be determined by the
`manager of the Internet Site. For example, the pop-up menu
`can display information about image size, media type and
`frame rate.
`AS shown in FIG. 6A, the user can create and organize
`multiple play lists by use of the play list button 46. When the
`user clicks on the play list button 46, a pop up menu 70
`appears with four options: Create, Delete, Rename, and Go
`To. The create option adds a play list, the delete and rename
`options remove and rename a play list respectively, and the
`Go To option Switches to a different stored play list. As
`shown in FIG. 6B, each new play list creates an additional
`tab 72 at the top of the play list box. The new play list 50
`may be populated by dragging media icons from the same or
`different branches of the outline 24. The user created play
`lists are similar in function to the favorites or book marks
`web browsers have for web pages. The pop-up menu 70 may
`also include a Play All option which causes every play list
`to be played. In addition, the pop-up menu 70 may include
`a Play Many option which allows the user to Select a group
`of play lists, e.g., by Selecting the play list tabs 72, and to
`play the media objects in the group. The functions of the
`play list button 46 could be accessed by other interactive
`features on the web page.
`The pop-up menu 70 on the play list button 46 may also
`include a mail feature that permits users to Select and
`eXchange play lists. The mail feature may also be invoked by
`a separate button, or by dragging media icons from
`Sequencer or media icon access area to a mailbox icon. The
`media objects in the mailbox may later be mailed one or
`Several receipients.
`As shown in FIG. 6C, when the addition of a new tab 72
`causes a tab at the opposite end to “fall off the play list box
`44, a triangular comer marker 74 appears to indicate the
`direction in which there are more tabs to view. The user can
`click on the comer markers 74 to cause the tabs to shift left
`or right, as appropriate, to display the next play list tab.
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`As shown in FIG. 7, the object player 16 is used to play
`the currently selected media object from the play list 50 in
`the Sequencer 14. The object player includes an image
`display window 80 and a control panel 82. The object player
`16 can use any program that can be embedded in a web page
`that presents media objects. Examples of Streaming media
`programs that can be embedded are QuickTime TM,
`RealMediaTM, and Microsoft Media PlayerTM. Streaming
`media players, such as the illustrated RealMedia Player,
`include the control panel features, such as a stop button 100,
`a pause/play button 102, a previous button 104 and a next
`button 106. a vertical-slider control 108 provides audio
`volume control, and a horizontal slider control 110 provides
`fast forward/rewind control and indicates the amount of the
`Stream that has been and remains to be played. A display
`panel 112 presents the current Status of the media object,
`e.g., playing or paused, and a clock 114 shows the total
`duration of the multimedia object and the elapsed time.
`The next button 106 works with the play list 50 in the
`Sequencer 14 to cause the currently playing media object to
`Stop and to cause the media object represented by the next
`checked media ico