Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 1 of 31
`
`Exhibit 9
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 2 of 31
`
`USOO880583 OB2
`
`(12) United States Patent
`Katinsky et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,805,830 B2
`* Aug. 12, 2014
`
`(54) WEBAPPLICATION FOR ACCESSING
`MEDIA STREAMS
`
`(75) Inventors: Steve Katinsky, Los Angeles, CA (US);
`Michael Burress, Venice, CA (US);
`Jefferson Furtado, Galt, CA (US)
`(73) Assignee: Copper Data River LLC, Las Vegas,
`NV (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 1044 days.
`This patent is Subject to a terminal dis
`claimer.
`
`(*) Notice:
`
`(21) Appl. No.: 12/485,236
`
`(22) Filed:
`
`Jun. 16, 2009
`
`(65)
`
`Prior Publication Data
`US 2009/0319925A1
`Dec. 24, 2009
`
`Related U.S. Application Data
`(60) Division of application No. 10/210,203, filed on Jul.
`31, 2002, now Pat. No. 7,610,394, which is a
`continuation of application No. 09/187.256, filed on
`Nov. 6, 1998, now Pat. No. 6,452,609.
`
`(2006.01)
`
`(51) Int. Cl.
`G06F 7/30
`(52) U.S. Cl.
`USPC ........... 707/732; 707/733; 707/734; 709/217;
`709/218; 709/219; 369/30.08
`(58) Field of Classification Search
`CPC .......... G06F 17/3005; G06F 17/30029; G06F
`17/30026; G06F 17/30023; G06F 17/30053;
`G06F 17/30755; G06F 17/30761; G06F
`17/30769; G06F 17/30772
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,353,401 A 10, 1994 Iizawa et al.
`5,668,788 A
`9, 1997 Allison
`5,724,595 A
`3, 1998 Genter
`5,774,670 A * 6/1998 Montulli ....................... 709,227
`5,793,366 A
`8, 1998 Mano et al.
`5,793,980 A * 8/1998 Glaser et al. .................. TO9,231
`5,796,945 A
`8, 1998 Tarabella
`5,796,952 A * 8/1998 Davis et al. ................... TO9,224
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`WO
`
`O831608 A2 * 3, 1998 ............... HO4H 1.00
`WOOO,28396
`5, 1999
`
`OTHER PUBLICATIONS
`
`“Dynamic argument embedding: preserving state on the WorldWide
`Web.” by Iyengar, A. In: Internet Computing, IEEE (1997). Available
`at: IEEE Xplore.*
`
`(Continued)
`
`Primary Examiner — Daniel Kinsaul
`(74) Attorney, Agent, or Firm — Amin, Turocy & Watson,
`LLP
`
`ABSTRACT
`(57)
`A web page has a player for playing media objects, a
`sequencer which displays a playlist that defines an order in
`which media objects are played by the player, and a media
`access area for containing a plurality of graphical icons. Each
`graphical icon representing a media object, and the graphical
`icons can be manipulated by a user to modify the play list. For
`example, the media icons may be dragged to the sequencer to
`add them to the sequencer.
`
`20 Claims, 19 Drawing Sheets
`
`
`
`Seisatist:33,c,
`
`ea
`RealPlayer,
`
`.------------------
`-
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 3 of 31
`
`US 8,805,830 B2
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`1/1999 Contois
`5,864,868 A
`2f1999 Johnson
`5,872,747 A
`5,892,915 A * 4, 1999 Duso et al. .................... TO9,219
`5,905,983 A
`5, 1999 Inomata et al.
`5,918,213 A
`6, 1999 Bernard et al.
`5,953,005 A
`9, 1999 Liu
`5,969,283 A 10/1999 Looney et al.
`5,986,979 A 11/1999 Bickford et al.
`6,005,563 A 12/1999 White et al.
`6,018,768 A
`1/2000 Ullman et al.
`6,025,841 A
`2/2000 Finklestein et al.
`6,133,913 A 10, 2000 White et al.
`6,141,010 A 10/2000 Hoyle
`6,154,771 A * 1 1/2000 Rangan et al. ................ 709/217
`6,169,997 B1
`1/2001 Papierniak et al.
`6,173,317 B1
`1/2001 Chaddha et al.
`6,201.996 B1* 3/2001 Crater et al. ...................... 7OO/9
`6,202,155 B1
`3, 2001 Tushie et al.
`6,226,618 B1
`5, 2001 Downs et al.
`6,230,200 B1
`5, 2001 Forecast et al.
`6,243,328 B1
`6, 2001 Fenner et al.
`6.243,725 B1* 6/2001 Hempleman et al. ......... 71.5/210
`6.249,795 B1* 6/2001 Douglis ........................ 71.5/210
`6,262,723 B1
`7/2001 Matsuzawa et al.
`6,314,094 B1 * 1 1/2001 Boys ............................. 370,352
`6,346,951 B1
`2, 2002 Mastronardi
`6,385,596 B1
`5, 2002 Wiser et al.
`6,441,832 B1
`8, 2002 Tao et al.
`6,452,609 B1
`9/2002 Katinsky et al.
`6,516,323 B1
`2/2003 Kamba
`6,519,584 B1
`2/2003 Tognazzini et al.
`6,587,127 B1
`7/2003 Leeke et al.
`6,622,171 B2
`9/2003 Gupta et al.
`6,714.931 B1* 3/2004 Papierniak et al. ................... 1f1
`6,748,427 B2
`6, 2004 Drosset et al.
`7,610,394 B2 10/2009 Katinsky et al.
`7/2003 Katinsky et al.
`2003.01375.31 A1
`12/2006 Katinsky et al.
`2006/02881 11 A1
`
`OTHER PUBLICATIONS
`
`“Winamp Version 1.” Screenshots of Winamp v 1.00 (release date:
`Jun. 7, 1997). Available at: www.oldversion.com.*
`
`“Java Applications and Implementations.” by Steele, Guy. In:
`Worlwide Computing and its Applications—WWCA'98 (Mar. 4-5,
`1998). Available at: SpringerLink.*
`OA mailed Sep. 22, 2004 for U.S. Appl. No. 10/210.203, 24 pages.
`OA mailed Jun. 8, 2005 for U.S. Appl. No. 10/210,203, 25 pages.
`OA mailed Jul. 13, 2006 for U.S. Appl. No. 10/210.203, 24 pages.
`OA mailed Oct. 2, 2008 for U.S. Appl. No. 10/210,203, 22 pages.
`OA dated Dec. 9, 2010 for U.S. Appl. No. 1 1/514,018, 28 pages.
`OA dated Jun. 23, 2010 for U.S. Appl. No. 1 1/514,018, 20 pages.
`OA dated Sep. 17, 2012 for U.S. Appl. No. 1 1/514,018, 36 pages.
`Anonymous, “DHTML tool war begins.” Web Techniques, Feb. 1998,
`3(2), 7 pages.
`Bouthillier, “Sychronized W3C Format Is All Smiles,” wysiwyg://
`11/http://www.webtechniques.com/archives/1998/09/bouthillier,
`Sep. 1998, 1-13 and attached.
`“MIDI Made Music Jukebox v6.2.” http://www.hitsquad.com/smm.
`programs/MIDI Made Music Jukebox/, Jan. 22, 1997, 1-3 and
`attached.
`Russell, “Welcome to the Voltage Circuit Simulator (with Java source
`code).”
`http://www.javasoft.com/applets/archive/beta/Voltage/in
`dex.html;
`http://www.javasoft.com/applets/archive/beta/Voltage?
`voltage/voltage.java, Sep. 1995, 1-2: 1-12.
`"Sun Delivers Rich Set of Java Media and Communication AIP's.”
`Java, http://www.java. Sun.com/pr/1997/august/pr970806-01.html,
`Aug. 1997, 4 pages.
`Hiang, “Interesting Features in WinAmp.” Jun. 23, 1997, New Straits
`Times, p. 51.
`Winamp, “Winamp Player New Features.” from http://web.archive.
`org/web. 1998 1202191016/winamp.com/winamp/newfeatures/html.
`pp. 1-4 of printout, (1998).
`Winamp, “Winamp Player Overview.” from http://web.archive.org/
`web. 1998 1207050153/winamp.com/winamp?overview.html,
`pp.
`1-3 of printout, (1998).
`Wenham, “Mod Players for OS/2.” 1996, OS/2 e-Zine', from www.
`oS2ezine.com/vln14/modplyrs.htm, pp. 1-5 as printed.
`Haligonian Media, “OS/2 e-Zine!, vol. 1, No. 14' 1996, from www.
`oS2site.com/SW/magazine?eZine?other/dec96.txt, pp. 1-39 as printed.
`RealNetworks, Inc., “RealFlash and RealAudio Content Creation
`Guide, Beta 5.0, 1997, RealNetworks, from docs.real.com/docs.
`flshccg.pdf, pp. 1-20 as printed.
`RealNetworks, Inc., User Guide for RealPlayer Plus 5.0, 1997,
`RealNetworks, Inc., pp. 1-62.
`International Search Report mailed May 23, 2000 in PCT/US99/
`26258.
`
`* cited by examiner
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 4 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 1 of 19
`
`US 8,805,830 B2
`
`
`
`
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 5 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 2 of 19
`
`US 8,805,830 B2
`
`Business.
`-
`- Etriart
`^- News
`- a Sparts
`
`Business
`
`
`
`-a-
`
`8
`
`25
`
`s
`
`
`
`
`
`FIG.2B
`
`Esiless
`Entertarrest
`ir News
`o Basiress
`Cit
`i Crire
`-i. Health
`e Huna interest
`Live News
`C. Natic-r
`E. Pitics
`Technology & Science
`Wrid
`Sports
`
`Business Entertainment sports
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 6 of 31
`Case 1:20-cv-03159-AKH Document 1—9 Filed 04/21/20 Page 6 of 31
`
`US. Patent
`
`Aug. 12, 2014
`
`Sheet 3 0f 19
`
`US 8,805,830 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`v Bus-MM
`v Emmamment
`W Naive
`.
`a Ewmesa
`a mining?
`a: fi'e-Iréme
`if! fleflfih
`it? Human ilnififéfl
`5:: Live mews
`e .f‘éatiimj‘m
`
`
`
`
`
`
` Vale 3mm 5r: em
`5" Reflubmime
`
`
`Edgy $1 Sriamm
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 7 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 4 of 19
`
`US 8,805,830 B2
`
`saeg=
`
`[sae
`
`
`
`
`
`
`
`
`
`88.9B
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 8 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 5 Of 19
`
`US 8,805,830 B2
`
`
`
`
`
`
`
`§ §§
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 9 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 6 of 19
`
`US 8,805,830 B2
`
`FIG.6A
`
`F.C. SE
`
`
`
`
`
`
`
`
`
`F.G.7
`
`
`
`
`
`outrey are artressengeria: You Fat A.
`88: 8888.338 . .
`.
`.
`.
`gewater steelescirector.
`* Sir: 383rigiit is 38 (383& C 3xxx & Evi
`a
`case: ; 38't was to wait large
`w"ggk.
`gas & East: Byer:bass arxic:
`
`is
`
`is
`
`cocoa:
`
`2.
`- 184
`Jasbi
`E.---
`-:
`
`3.
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 10 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 7 Of 19
`
`US 8,805,830 B2
`
`
`
`
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 11 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 8 of 19
`
`US 8,805,830 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`89-9B
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 12 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 9 Of 19
`
`US 8,805,830 B2
`
`
`
`
`
`
`
`y?
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 13 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 10 of 19
`
`US 8,805,830 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`BHAIWN GO
`
`Yxx
`
`&
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 14 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 11 of 19
`
`US 8,805,830 B2
`
`CEE 888
`asse a
`
`E-A&E ESS w88
`3E 8:8 & 88WSER
`Ki::::S3
`
`-- 3:
`
`inTERFACEl
`33.823.
`
`
`
`33& 3"
`& Fr. C.A.O.8
`SEF'FER
`
`
`
`
`
`-- fai4
`taxis:
`
`centrywes pace
`
`
`
`r:
`88E:A
`SE8 y S.
`
`st
`
`SE:
`A&ESE
`8:: 33
`A38.8f3.
`
`88FE33PACE
`AB8E CONEE-T
`388, S-338
`
`
`
`
`
`E.
`CE.
`6:3E CE3.3°CSEENS:
`E3: 383
`& A808-33 - R.L CE, EC: &
`
`-- : 3:38
`
`3:
`
`w if 36
`
`
`
`EN:
`MEMORY
`
`AESA,
`CE. ECS
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 15 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 12 of 19
`
`US 8,805,830 B2
`
`CEN i 8.
`
`
`
`
`
`f
`
`lege
`
`REATE
`E
`SER
`BN SER
`t.A.&BASE
`
`xix. *
`E.
`:E. iSE3
`se
`
`SE383.3
`38 wiSEF,
`SSA:
`Pt.AY lists
`worry
`o
`iQA SER
`SEF
`S.
`PRExps
`
`
`
`FFE
`CKE
`
`338 ER
`
`3.A.) SEFE
`SEC:
`888-3-8383
`
`serviceron
`SEESS
`
`
`
`
`
`Arts
`FA 33
`
`
`
`FC.
`
`
`
`
`
`
`
`
`
`
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 16 of 31
`Case 1:20-cv-03159-AKH Document 1—9 Filed 04/21/20 Page 16 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 13 of 19
`
`US 8,805,830 B2
`
`”magma oumma mama mmmm
`
`QUTLINE
`
`
`ELEMENT w
`
`‘u-CUQKEQ CTN;
`-
`
`
`”I £33
`.
`T
`.
`.
`
`ESL-GEE
`(3E TUNE
`QFEM ._
`AT e-AME
`
`LEVEL
`
`.— ffifl-e?
`
`‘
`.
`EU.
`REYREJWNG
`ELEMENT"
`
`GET $01.1.
`EU 53’?” ENE.
`mum Sum?
`MEMQH‘T‘
`
`uEMtRfiTE
`SQLGUEHY
`SENDTQ
`SERVER
`
`
`
`8551:3in ~
`HEGQHEEEET
`'~ SYOHE 1H
`3 £1128.va MELMQHT
`
`Fflfitfiflfifi WWTE E
`QUTLENE LEVEL
`TC} STEREEM E
`FHQM MEMQEV
`
`{13C}??? M {SEEM
`TC; 'fllfififi LAVER:
`GHAMGE 2113mm;
`
`GM Eli-EEG
`
`‘ mgmvswmm ;
`
`mama
`
`g
`
`.
`
`
`’ MIC?CTN
`
`~
`tamaumWC, 1....
`
`
`APPENE Mi LEN
`HfiTmTTQ QM
`MEMIDFW 71C)
`SEQUENGER
`E3313 ‘
`QP'EL‘T‘ UEER
`3115531.} 1A3 £1353 .
`
`T13! REGE’QHD
`
`UPHAT‘E “SEE
`TTTTTASE
`TABS 1.33.
`
`FIG. m... 12
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 17 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 14 of 19
`
`US 8,805,830 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`S. S. CHES 88 NSEE ENCE
`o * iado
`3 CC8
`
`
`
`SEC EECE CSC
`8.381 - 3: .
`38 recognise
`S:
`assasawwwassesssssssssssssss
`
`
`
`- 1304
`ritter pse
`
`
`
`
`
`{i} SE
`
`M.
`(ATASE3 Chi M3E
`ESESSR:
`f{{3}E OBJECT .
`s::, .338
`rt. Yet FEACY
`YES
`CHECKER OS.ECT
`
`xxxxxxxxx
`
`xxxxxxxxxxxxxxxxx
`
`
`
`-
`
`- 1306
`8
`- 88:
`TAE Bei
`
`FIG. 13A
`
`use R CHANGESTABS INSEQUENCE
`-- 38:
`- 38&
`FLAY SES
`ite Kai SELECT:
`creare: abname
`fair are
`RENAME:
`
`
`
`
`
`A3 ASE
`8P8
`Oso. REWRITES
`
`
`
`88 SEC: 388x8
`SE RECE-33s.
`
`
`
`
`
`FIG. 3E
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 18 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 15 Of 19
`
`US 8,805,830 B2
`
`
`
`SE
`&E.E.E.S.:
`EAE
`SE}} E-88.
`SC
`
`SENACAS EAESS
`
`SP
`EAES
`O'R
`E33 & A3S
`
`S: 33
`23.
`3883:
`
`3.3EF C3. CKS
`&E
`-
`E3:
`
`E:
`is 8AxR
`
`Circi 30:
`.83 : :-8
`
`six F3
`33 E. E.
`:-
`
`sit. FIBSIIAE e.
`
`AS ---
`
`set Asiae s.
`
`SEE ASEABO
`FRSAS 88
`-
`3
`is
`acfie A8s 8:
`:
`ES
`
`3CS:33
`
`iser *::::: 38, 8.
`EAST FIRSTA8
`-: 8:8: -88.
`McEisfit
`
`E: SBS
`
`- 1388
`338-3
`was
`as
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 19 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 16 of 19
`
`US 8,805,830 B2
`
`33
`
`- 8:3
`it is:
`*AYTON
`{KE:
`
`- 1402
`
`8E.
`83rrERS
`SREA,
`
`...
`
`assponson / 1406
`ES5
`Sex &Y:ES
`EE: , E.EC
`-
`if:
`stor beaut
`Sicific critics
`8A8::R
`38.
`Es:
`SF:SES
`
`
`
`:E3A, Y
`Yea:33
`tA38
`a SE a
`
`
`
`- - -
`*
`^
`CG \,
`& Exx: EXPAN3
`Ngislay
`
`SE:
`
`t
`
`-- .
`
`.
`
`. .
`
`
`
`
`
`Xscreece
`- 430 -
`C-Ah (38.
`SEC Eid:
`coaosser
`ESO CHECK
`3.
`PA's
`FEE
`- 3-3
`PAY ENDS
`
`
`
`
`
`-
`
`-- 3:3:
`Box Hix.
`ki:EX.
`8NE-8EK&
`assesses
`
`- 1843
`
`-F8:XY 3
`X CEEKEE}
`x-i-
`C-888.CXY
`yeSY-34-
`set Highlight
`
`xxx...Soc.ass
`
`
`
`
`
`- 3453
`starr default
`risis
`
`3. P:E:
`
`f:3.
`
`-sie &
`for
`i:SE 3,38
`ESY
`{x : -
`
`
`
`
`
`Y S Y - 430
`ESAY N. F.
`OSE:-
`YESN
`
`
`
`- a
`
`E8:E33.
`ESPAY
`: his
`facsix
`
`FIG. 4
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 20 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 17 Of 19
`
`US 8,805,830 B2
`
`R&E
`
`3. i-ES
`
`^SAbi-Er
`- E -
`^ 8A:
`%3ESSAYY
`? --
`
`Nics
`: : -
`\:8.8/
`
`
`
`*
`
`
`
`
`
`
`
`SE KECi.
`{BE, RFREE
`SEC ENCER SC
`cuRRENT RECORE:
`
`Ritcox
`88.88.
`
`
`
`- 1539
`sanner
`:33:31:38:S
`
`1839
`past
`£8,8833 -
`wa
`...
`3
`- Yay
`Noise-
`^)
`Yes
`se
`
`
`
`
`
`
`
`create new
`SEE:
`So RECORE I
`
`sco
`
`sees
`&AE is
`to Recore
`copy sanner
`EEAE.E.
`33: E. 83E
`
`
`
`
`
`
`
`/ Sii
`
`- $3S
`83
`88:
`ei:. . PATESY
`333-3
`ray S X8E
`
`& Ray Ex.
`2-&G
`r: Grigrisk
`E.8.
`
`y ; Siri
`a
`
`
`
`- 3 3-6
`six -
`RESIAF
`NECA defect"
`
`F.G.
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 21 of 31
`Case 1:20-cv-03159-AKH Document 1—9 Filed 04/21/20 Page 21 of 31
`
`US. Patent
`
`Aug. 12, 2014
`
`Sheet 18 0119
`
`US 8,805,830 B2
`
`EEETTE MECQN 91:12PM?
`
`2 2,
`MW
`GET EEEETEEE TEE ‘
`
`EATER PEP-TEE
`=
`
`
`GURREENW‘ EEEETEE
`
`#161114
`EHEW :
`31:12me
`:-
`
`7 “WWW
`
`[2.1. TEEE.
`
`' ETETTIE TE
`2
`PEEP—UP
`
`ENE-TM:
`
`
`
`
`‘
`
`" TFH‘E" m
`2
`‘AAAAA
`2: TEEE
`
`
`
`ffififiifififiifi .
`‘ TESTFOH 3
`Fflfi LETWER -,
`
`
`
`TEEELT
`2 mm
`TEENTE
`m
`
`
`
` LEVEL 2
`.
`'
`I
`LE‘gEL » »
`
`”‘35
`
`:WTESTEELE
`
`, ;
`:I'T’ETE
`
`
`f': EDPL11E METTU EELLEETT
`.
`‘
`2
`. ................
`
`
`
`TEEEET MEMi-j z‘
`; TTTEET‘TT ETETTTT
`
`
`
`aw
`EEEEEE
`:
`
`
`
`
`
`
`
`—-------TEEE
`-'
`- ' GE‘EEEEE”
`
`
`
`
`TEETTEEAEHTEE
`
`
`
` EEE CLEEE _ s
`
`TABLE mag 5 ................... , ,me
`
`22m222223222222___22_22 22222222__2E2_
`HEM T6
`
`EEEiiiE i
`
`i
`
`1
`1'
`T
`
`ii 5i iiiEE EiE
`
`E
`
`2
`‘
`
`EEEEEETETNE
`>
`. ............................ g
`jEf’VijLN
`
`2"” "W TETE «1
`EATTEE 1:11am
`
`2
`
`.2 TEEE
`
`LETEENU LEVEL
`
`HIGHER MENU
`
`ELTTLE TEEEE
`LEVEL
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 22 of 31
`
`U.S. Patent
`
`Aug. 12, 2014
`
`Sheet 19 Of 19
`
`US 8,805,830 B2
`
`
`
`
`
`88ssip::::
`---x8
`
`
`
`extreme
`
`
`
`
`
`
`
`8 :
`
`exeras:
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 23 of 31
`
`US 8,805,830 B2
`
`1.
`WEBAPPLICATION FOR ACCESSING
`MEDIA STREAMS
`
`CROSS-REFERENCE
`
`This application is a divisional of U.S. patent application
`Ser. No. 10/210,203, filed Jul. 31, 2002, which is a continu
`ation of U.S. application Ser. No. 09/187.256, filed Nov. 6,
`1998, now U.S. Pat. No. 6,452,609, incorporated herein by
`reference in their entireties.
`
`BACKGROUND
`
`The present application relates generally to providing
`media streams from Internet sites.
`The WorldWideWeb (WWW) is conventionally conceived
`as a system in which a user navigates between text documents
`on different servers by means of hypertext links. Activating a
`hypertext link causes another page, also composed of textand
`links, to be delivered to the client computer. Thus, on the
`WWW, a user's experience is determined by the order in
`which the user clicks on links.
`In general, non-text objects are treated as illustrations
`placed on text pages. Although WWW standards include an
`open ended specification for handling multimedia files that
`allows media objects to be referenced by hypertext links,
`those references are treated no differently than hypertext links
`to pages and illustrations. Typically, three techniques are used
`to access multimedia files. First, a link can point to a special
`media file that requires a special player program to produce
`the images and Sounds of the media file. Second, the link can
`point to a player program that starts independently of the web
`browser to play the media file. The interface provided by the
`player program controls the media file. Third, the link can
`point to a player program embedded in the page. In this case,
`the user can click on the link to choose which media file to
`play without leaving the page. However, the size of the image
`displayed and the controls available to the user are chosen by
`the web page designer.
`The currently available tools that can be used to synchro
`nize the presentation of multimedia components include pro
`prietary languages. Such as Macromedia's Lingo and Apple's
`Hypercard, and Scripting languages, such as ECMAScript
`(JavaScript). In recognition of the difficulty of multimedia
`authoring with the currently available tools, the World Wide
`Web Consortium (W3C) has proposed a new language called
`the Synchronized Multimedia Integration Language (SMIL).
`The WWW was developed for utility in the assembly and
`cross referencing of text content documents with user free
`dom in navigation. On the other hand, multimedia develop
`ment has focused on interactive but canned content with
`limited use options that are defined by the author. Thus,
`multimedia on the web has been subject to conflicting devel
`opmental pressures, and has not developed a coherent presen
`tation format.
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`SUMMARY
`
`In one aspect, the invention is directed to a web page with
`a player for playing media objects, a sequencer which dis
`plays a play list that defines an order in which media objects
`are played by the player, a media access area for containing a
`plurality of graphical icons. Each graphical icon representing
`a media object, and the graphical icons can be manipulated by
`a user to modify the play list.
`Implementations of the invention may include the follow
`ing features. The graphical icon includes an indication of a
`
`60
`
`65
`
`2
`media type of the media object and text describing content of
`the graphical object. Agraphical icon can be dragged from the
`media access area to the sequencer to add the media object
`represented by the graphical icon to the play list. The
`sequencer can display one of multiple play lists, and the user
`may switch between play lists by selecting a tab associated
`with the play list. For each graphic object in the play list, the
`play list box may contain a copy of the graphical icons rep
`resenting the graphical object, a checkbox to control whether
`the player will play the graphic object, and a pop-up menu to
`provide information about the graphic object. The sequencer
`and media access area may be implemented with Scripted
`DHTML. The media access area may include an expandable
`and collapsible outline of Subjects, and the media icons may
`be arranged in lists in the outline. The media access area may
`include a tab for each subject at a top level of the outline, and
`the user can Switch between subjects by selecting a one of the
`tabs. The media access area may display one of a plurality of
`outlines, and the user can switch between outlines by select
`ing a tab. The player may include a control panel and a
`draggable image display window. The image display window
`may include a home button to return the image display win
`dow to a home position on the web page, an image area, a
`handle, a button to hide the image area, and a size lockbutton
`to prevent the image display window from expanding beyond
`a default size. The web page may further include a site-driven
`area to display a banner. The banner may be synchronized
`with the media object being played by the player, and a media
`object may be associated with the banner. The user may
`change the play list to play the media object associated with
`the banner by manipulating the banner. Dragging the banner
`to the sequencer may add the media object associated with the
`banner to the play list, and dragging the banner to the image
`area of the player may play the media object associated with
`the banner. The banner may include a pop-up menu to display
`information about the media object associated with the ban
`.
`In another aspect, the invention is directed to a method of
`operating a web page. Multiple sources of streaming content
`are displayed to a user, and user input is received to select a
`playing order for the Sources of streaming content. The play
`ing order is stored, user input is received to start delivering the
`streaming content to the user, and the streaming content is
`presented to the user in the stored order.
`In another aspect, the invention is directed to an Internet
`site having a first database to store information about a plu
`rality of media objects, a second database to store information
`about how the media objects are to be presented on a web
`page, a third database to store information about a plurality of
`users, and an application server for communicating with a
`client running the web page.
`Advantages of the invention may include one or more of
`the following. The user can locate and control streams of
`multimedia content in real time without accessing different
`web pages or Surrendering control to a media player program.
`A user can define and assemble multiple sequences of media
`objects, particularly sources of streaming content. The user
`can manage a persistent personal collection of media objects
`from a network client. The user can gather additional stream
`ing content while a media object is playing, and can modify
`and create sequences while a media object is playing. The
`user can add and remove media objects from a sequence, can
`deselect media objects to prevent them from playing without
`removing them from a sequence, and can Switch between
`different user defined sequences. New media objects can be
`preloaded into a sequence based on a personal preference or
`interest profile defined by the user. Individual user histories
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 24 of 31
`
`US 8,805,830 B2
`
`3
`(as defined by the order in which a user adds media objects to
`sequences and plays the media Objects) can be used to gen
`erate an outline organized by user-defined tabs and dates.
`Users can exchange play lists and player combinations by
`electronic mail.
`The details of one or more embodiments of the invention
`are set forth in the accompanying drawings and the descrip
`tion below. Other features and advantages of the invention
`will become apparent from the description, the drawings, and
`the claims.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`10
`
`15
`
`4
`web page 10 presents the media icons with text and/or graph
`ics to assist the user in determining how to manipulate the
`media icons.
`The pageless Internet site is an inversion of conventional
`web site design. In conventional web site design the media
`object is the last link in a long chain of pages and links. The
`setting, context, meaning, and relevance of the media object
`are established in hypertext, and the media object is an adorn
`ment for the hypertext. In contrast, in the pageless Internet
`site, the media object is the starting point. The pageless Inter
`net site is media-oriented, as opposed to being text-oriented
`with media annotations. In short, the principle of organization
`of web page 10 is the relationship between media objects,
`rather than the relationship between pages.
`As shown in FIG. 1, the media access web page 10 has four
`functional areas, including a media icon access panel 12, a
`sequencer 14, an object player 16, and a site-driven area 18.
`The media icon access panel 12 organizes media icons into a
`hierarchical outline or list, and Supports searches for media
`objects. The sequencer 14 allows the user to select media
`icons from the media icon access panel 12, and to create and
`modify one or more user defined play lists. The object player
`16 plays the media objects in the order defined by the play list.
`In addition, the object player 16 can control the play list and
`the individual media objects in the play list. The site-driven
`area 18 presents site-driven graphics synchronized with
`streaming content that responds to user actions and user
`selected content. The graphics can also be media icons rep
`resenting more media objects. The web page 10 can be imple
`mented with JavaScript and HTML 4.0, and can be accessed
`with a web browser, such as Microsoft Internet Explorer 4.0.
`Each of the components of the web page 10 will be described
`in greater detail below.
`The media icon access panel 12 has a series of Subject
`matter tabs 22 arranged along an edge of the panel. To begin
`browsing the content of the site, the user selects one of the
`Subject matter tabs 22, for example, by clicking on it with a
`mouse controlled cursor. As shown in FIG. 2A, clicking on a
`subject matter tab 22 causes the top level of an outline 24 to
`appear as a bulleted list containing bulleted items 26. In
`addition, clicking the Subject matter tabs 22 causes outline
`item tabs 28 to appear at the bottom of the media icon access
`panel 12. Each outline item tab 28 corresponds to one of the
`top level bulleted items 26 in the outline 24.
`As shown in FIG. 2B, clicking on either the text of a
`bulleted item 26 or the corresponding outline item tab 28 at
`the bottom of the media icon access panel 12 will cause the
`next level of the outline to be displayed as a bulleted sublist
`29. Clicking on a bulleted item in a sublist causes the next
`lower level of the outline to be displayed. In order to manage
`large outlines without excessive scrolling, the sections of the
`outline will expand and collapse so that only one item of each
`level of the outline is expanded at a rime. For example, FIG.
`2B shows the “News' section of the outline has been
`expanded. Clicking on any bullet at the same level. Such as the
`“Sports' bullet, would expand the outline to show the items in
`that bullet, but would also close the “News' section.
`As shown in FIG. 2C, the lowest level of the outline is a list
`36 of media icons 30. Each media icon 30 represents a media
`object. Each media icon includes a graphic icon32 indicating
`the media type. Such as audio, video, text, executable code,
`graphic, or unknown, of the media object. Each media icon
`also includes accompanying text 34 to briefly explain the
`content of the media object. When a cursor 42 moves over a
`media icon, the media icon is highlighted to indicate that it is
`selectable. Clicking on a media icon 30 does not open another
`level of the outline. Rather, as shown in FIG. 3A, holding the
`
`FIG. 1 illustrates a media access web page according to the
`present invention.
`FIGS. 2A, 2B and 2C illustrate the use of a media icon
`access panel from the web page of FIG. 1.
`FIGS. 3A and 3B illustrate the step of dragging a media
`icon from the access panel to a sequencer from the web page
`of FIG. 1.
`FIG. 4 illustrates the sequencer containing several media
`icons.
`FIG. 5 illustrates the use of a media object pop-up menu.
`FIGS. 6A, 6B and 6C illustrate the manipulation of mul
`tiple play lists by the sequencer.
`FIG. 7 illustrates the object player from the web page of
`FIG 1.
`FIGS. 8A, 8B,8C and 9A,9B,9C illustrate the operation of
`30
`the site-driven area from the Internet site of FIG. 1.
`FIG. 10 illustrates a pageless Internet site for generating a
`media access web page.
`FIG. 11 illustrates a method performed when a user con
`tacts a media access web page server.
`FIG. 12 illustrates a method performed when a user inter
`acts with the media icon access panel.
`FIGS. 13A, 13B, and 13C illustrate methods performed
`when a user Switches or changes tabs in the sequencer.
`FIG. 14 illustrates a method performed whena user plays a
`media object from a play list 20 in the sequencer.
`FIG. 15 illustrates a method performed when a user drags
`a banner from the site-driven area.
`FIG. 16 illustrates a method performed when a user acti
`Vates a media icon pop-up menu.
`FIG. 17 illustrates a media icon pop-up menu.
`
`25
`
`35
`
`40
`
`45
`
`DETAILED DESCRIPTION OF ILLUSTRATIVE
`EMBODIMENTS
`
`FIG. 1 shows a media access web page 10 generated by an
`Internet site that is particularly Suited for accessing multime
`dia streams. The Internet site is “sequence-oriented’, i.e., the
`user controls the sequence in which multimedia streams are
`presented. In addition, the Internet site is “pageless, in that
`media streams are delivered to the user without the user
`having to navigate to different pages. The media streams may
`be a variety of media types, such as text, audio, images,
`animation, video, executable code, or any combination of
`media types. The Internet site is a media-type neutral system,
`i.e., it treats different media types. Such as audio and video, in
`a similar fashion.
`The building blocks of the Internet site include playable
`media content units, called “media objects', and graphical
`representations, of the media content units called “media
`icons'. The user manipulates the media icons to create an
`individual sequence, i-e., a play list, of media objects. The
`
`50
`
`55
`
`60
`
`65
`
`

`

`Case 1:20-cv-03159-AKH Document 1-9 Filed 04/21/20 Page 25 of 31
`
`US 8,805,830 B2
`
`6
`or media icon access area to a mailbox icon. The media
`objects in the mailbox may later be mailed one or several
`recipients.
`As shown in FIG. 6C, when the addition of a new tab 72
`causes a tab at the opposite end to “fall off the play list box
`44, a triangular corner marker 74 appears to indicate the
`direction in which there are more tabs to view. The user can
`click on the corner markers 74 to cause the tabs to shift left or
`right, as appropriate, to display the next play list tab.
`As shown in FIG. 7, the object player 16 is used to play the
`currently selected media object from the play list 50 in the
`sequencer 14. The object player includes an image display
`window 80 and a control panel 82. The object player 16 can
`use any program that can be embedded in a web page that
`presents media objects. Examples of streaming media pro
`grams that can be embedded are QuickTimeTM, RealMe
`diaTM, and Microsoft Media PlayerTM. Streaming media play
`ers, such as the illustrated RealMedia Player, include the
`control panel features, such as a stop button 100, a pause/play
`button 102, a previous button 104 and a next button 106. a
`vertical-slider control 108 provides audio volume control,
`and a horizontal slider control 110 provides fast forward/
`rewind control and indicates the amount of the stream that has
`been and remains to be played. A display panel 112 presents
`the current status of the media object, e.g., playing or paused,
`and a clock 114 shows the total duration of the multimedia
`object and the elapsed time.
`The next button 106 works with the play list 50 in the
`sequencer 14 to cause the currently playing media object to
`stop and to cause the media object represented by the next
`checked media icon in the play list 50 to start playing. Simi
`larly, the previous button 104 causes the currently playing
`media object to stop and causes the media object represented
`by the previous checked media icon in the play list 50 to start
`playing. When a new media object starts playing, it is high
`lighted in yellow as the current media icon. If there is no
`checked media icon in the play list before the current media
`icon, the previous button 104 is dimmed, and if there is no
`checked media icon is the play list after the current media
`icon, the next button 106 is dimmed.
`The image display window 80 includes a handle 90, an
`image size lockbutton 92, a window shade button 94, and an
`image swap button 96. The image display window 80 has a
`home position in