`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 1 of 56 Page ID #:101
`
`
`
`
`EXHIBIT 4
`EXHIBIT 4
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 2 of 56 Page ID #:102
`6886 8210100211 “We“ 1'4 FillllllillliiifllIllillifillllllil11111111111111“
`
`US010362130B2
`
`(12) United States Patent
`US 10,362,130 B2
`(10) Patent N0.:
`
` Thang et al. (45) Date of Patent: *Jul. 23, 2019
`
`
`(54) APPARATUS AND METHOD FOR
`PROVIDING STREAMING CONTENTS
`
`(71) ApplicantszElectronics and Telecommunications
`Research Institute, Daejeon (KR);
`INDUSTRY-UNIVERSITY
`COOPERATION FOUNDATION
`KOREA AEROPSACE .
`UNIVERSITY: GOYaHg-Sls
`GyeonggI-do (KR)
`(KR)
`D .
`T
`C
`Th
`;
`ang,
`ong
`ruong
`aejeon
`Jin Young Lee, Daejeon (KR); Seong
`Jun Bae, Daejeon (KR); Jung Won
`Kang, Daejeon (KR); Soon Heung
`Jung, Daejeon (KR); Sang Taick Park,
`Daejeon (KR); Won Ryu, Daejeon
`(KR); Jae Gon Kim, Goyang-si (KR)
`
`l
`
`t
`nven ors:
`
`(72)
`
`(51)
`
`Int. Cl.
`G06F 15/16
`H04L 29/08
`
`(2006.01)
`(2006.01)
`(Continued)
`
`(52) US. Cl.
`CPC
`
`H04L 67/2804 (2013.01); H04L 29/06027
`(2013.01); H04L 47/30 (2013.01);
`(Continued)
`(58) Field of Classification Search
`CPC ........... H04N 21/2401; H04N 21/2353; H04N
`21/23805; H04N 21/44004;
`.
`(Continued)
`References Cited
`
`(56)
`
`U.S. PATENT DOCUMENTS
`
`75512565 B1
`7,552,228 B2
`
`3/2009 cragm}
`6/2009 Parasnls et a1.
`
`(73) Assignee:
`
`IDEAHUB INC., Seoul (KR)
`
`(Continued)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`pJatSelg llsselxiengedoc: adjusted under 35
`~
`~
`~
`(
`) y
`ays~
`This patent is subject to a terminal dis-
`claimer.
`
`EP
`JP
`
`FOREIGN PATENT DOCUMENTS
`1302869 A1
`4/2003
`2005020588 A
`1/2005
`(Continued)
`
`OTHER PUBLICATIONS
`
`(21) Appl. No.: 15/069,443
`
`(22)
`
`Filed:
`
`Mar. 14, 2016
`
`(65)
`
`Prior Publication Data
`
`US 2016/0198013 A1
`
`Jul. 7, 2016
`
`“3GPP TS 26.cde V1.0.0, 3rd Generation Partnership Project;
`Technical Specification Group Services and System Aspects Trans-
`parent end-to-end Packet-switched Streaming Service (PSS); Pro-
`gressive Download and Dynamic Adaptive Streaming over HTTP
`(3GP-DASH) (Release 10)”, Aug. 2010, Valbonne, France.
`.
`(Continued)
`
`Related US. Application Data
`(63) Continuation of application No. 13/811,376, filed as
`application No. PCT/KR2011/005357 on Jul. 20,
`2011, now Pat. No. 9,325,258.
`C t'
`( on lnue )
`Foreign Application Priority Data
`
`(30)
`
`Jul. 19, 2011
`
`(KR) ........................ 10-2011-0071671
`
`Primary Examiner 7 Zarni Maung
`S4) Aliornfijt/aAgenl, or Firm i Wllham Park &
`550°” es
`'
`ABSTRACT
`(57)
`A method and apparatus for an adaptive Hypertext Transfer
`Protocol (HTTP) streaming service using metadata of con-
`tent are provided. The metadata may include a minBuiTer-
`(Continued)
`
`100
`
`l 0
`
`CLIENT
`
`
`
`
`METADATA 120
`
`130
`PROCESS METADATA
`
`
`REQUEST FRAGMENT 140
`
`
`TRANSMIT FRAGMENT 150
`
`145
`
`
`
`
`
`
`
`SERVER
`
`
`PARSE CON TENT
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 3 of 56 Page ID #:103
`Case 8:21-cv-00211 Document 1—4 Filed 01/29/21 Page 3 of 56 Page ID #:103
`
`US 10,362,130 B2
`
`Page 2
`
`Time attribute indicating a minimum amount of initially
`buffered media content. Aterminal may receive content from
`a server before playback of the content, and may bulfer the
`.
`.
`content by at least the minimum amount. The metadata may
`include a range attribute that designates a range of a target
`indicated by a Uniform Resource Locator (URL). The
`terminal may receive bytes designated by the range attribute
`f
`the URL and ma
`la back the content usin the
`r0“?
`,
`y P y
`g
`recelVed bytes
`
`6 Claims, 6 Drawing Sheets
`
`(60)
`
`Related US. Application Data
`.
`.
`.
`.
`Prov1s1onal app11cat10n No. 61/434,036, filed on Jan.
`19, 2011, provisional application No. 61/417,931,
`~
`~
`~
`~
`21133131142120‘7‘503 201Ofiprowlséongfigphcaml. Noi
`.
`a.
`,
`e
`0n
`0“
`,
`, Pmmmna
`app11cat10n NO. 61/405,674, filed on Oct. 22, 2010,
`provisional application No. 61/390,328, filed on Oct.
`.
`.
`.
`.
`6, 2010, provisional application No. 61/380,277, filed
`on Sep.
`6,
`2010,
`prov1s1onal
`app11cat10n . No.
`61/375,262,
`filed On Aug. 20, 2010, prOVISIOnal
`app11cat10n No. 61/366,203, filed on Jul. 21, 2010,
`provisional application No. 61/365,860, filed on Jul.
`20 2010.
`5
`
`8,533,310 132
`85355360 B2
`8,645,562 B2
`8,909,805 B2
`9,264,069 B2
`9,281,847 B2
`9,319,448 132 *
`9,325,558 B2
`9’467’493 B2
`2002/0105951 A1
`2003/0093790 A1
`2003/0236912 A1
`2004/0064577 A1
`2004/0208120 A1
`2005/0005308 A1
`2005/0076136 A1
`2005/0102371 A1
`2005/0193408 A1
`2005/0193425 A1
`2005/0203927 A1
`ggggégggggfi :3
`2006/0109856 A1
`2006/0218143 A1
`2006/0235883 A1
`2006/0251093 A1
`388338823333) :1
`2007/0033292 A1
`2007/0033515 A1
`2007/0033521 A1
`2007/0033533 A1
`2007/0038612 A1
`2007/0044010 A1
`
`2008/0034424 A1
`2008/0050096 A1
`2008/0126943 A1
`2008/0155602 A1
`2008/0172441 A1
`2008/0222244 A1
`2008/0313227 A1
`2009/0157859 A1
`2009/0185040 A1
`2009/0217354 A1
`2009/0300204 A1
`2010/0011274 A1*
`2010/0107090 A1
`2010/0169303 A1
`2010/0174823 A1
`2010/0217887 A1 *
`2010/0235472 A1
`2010/0235528 A1
`2010/0262618 A1
`2011/0080940 A1
`2011/0093492 A1
`2011/0096828 A1
`2011/0119394 A1
`2011/0185058 A1
`2011/0231519 A1
`2011/0231569 A1
`381383331733 :1
`2011/0302618 A1
`2011/0307545 A1
`2012/0013746 A1
`
`9/2013 Huang et 31.
`“2014 Erase et 3L
`2/2014 Thang et a1.
`12/2014 Thang et a1.
`2/2016 Watson et 31.
`3/2016 Stockhammer et a1.
`4/2016 Chen et 31~
`4/2016 Thang """"""""" H04L 65/4092
`10/2016 Thang et 31'
`8/2002 Hannuksela et a1.
`5/2003 Logan et a1.
`12/2003 Klemets et a1.
`4/2004 Dahlin et a1.
`10/2004 Shenoi
`1/2005 Logan et a1.
`4/2005 Cho et a1.
`5/2005 Aksu
`9/2005 Sull et al.
`9/2005 Sull et 31.
`9/2005 Sull et al.
`1333882 ifliet 31~
`1
`1 ey et a .
`5/2006 Deshpande
`9/2006 Najork
`10/2006 Krebs
`11/2006 Curcio et al.
`u
`e
`.
`53883 (31111111113331.
`2/2007 Sull et 31.
`2/2007 Sull et 3.1
`2/2007 sun et 31.
`2/2007 $1111
`2/2007 Sull et a1.
`2/2007 Sull et a1.
`
`H03M 13/2789
`714/752
`
`2/2008 Overcash et a1.
`2/2008 Ryu
`5/2008 Parasnis et a1.
`6/2008 Collet et a1.
`7/2008 Speicher et a1.
`9/2008 Huang et a1.
`12/2008 Shafton et a1.
`6/2009 Morris
`7/2009 Yang et a1.
`8/2009 Blum
`12/2009 Zhang et a1.
`1/2010 Stockhammer
`4/2010 Hearst et a1.
`7/2010 Biderman et a1.
`7/2010 Huang
`............... H04L 1/0041
`8/2010 Bouazizi
`709/231
`9/2010 Sood et al.
`9/2010 Bocharov et a1.
`10/2010 Hedinsson et al.
`4/2011 Bocharov et al.
`4/2011 Sull et 31.
`4/2011 Chen et a1.
`5/2011 Wang et a1.
`7/2011 Priddle et 31.
`9/2011 Luby et a1.
`9/2011 Luby et a1.
`3/383 £33 2% :1
`12/2011 Odlund et a1.
`12/2011 Bouazizi
`1/2012 Chen et a1.
`
`51
`
`(
`
`)
`
`(200601)
`(2011.01)
`(2011.01)
`(383383)
`(
`~
`)
`(2013.01)
`(2006.01)
`(2011.01)
`(2011 01)
`'
`
`I t Cl
`'
`n '
`H04L 29/06
`H04N 21/24
`H04N 21/44
`gzjg jgjggj‘:
`H04L 12/835
`G06F 12/00
`H04N 21/235
`H04N 21/238
`(52) U-S- 0-
`CPC ........ H04L 65/4092 (2013.01); H04L 65/602
`(2013.01); H04L 65/604 (2013.01); H04L
`65/608 (2013.01). H04L 65/80 (2013 01).
`’
`'
`’
`’
`H04N 21/2401 (2013.01) H04N 21/2402
`(201301); H04N 21/44004 (201301); H04N
`21/6543 (2013.01); H04N 21/6547 (2013.01);
`H04N 21/2353 (2013.01); H04N 21/23805
`(201301)
`,
`,
`,
`(58) Fleld 0f ClaSSIficatlon Search
`CPC ........... H04N 21/6543; H04N 21/2402; H04N
`21/6547; H04N 21/23439; H04N 21/235;
`H04N 21/2358; H04N 21/236; H04N
`”2381; H04N 21/26258; H04N
`.
`.
`21/2662; HQ4N 21/43
`See app11cat10n file for complete search h1story.
`
`(56)
`
`References Cited
`
`2012/0016965 A1*
`
`1/2012 Chen ................ H04N21/23439
`709/219
`
`US. PATENT DOCUMENTS
`
`333333; 33
`7:823:055 B2
`8,201,204 132
`8,209,609 132
`8,230,343 B2
`8,365,271 B2
`8,468,145 B2
`
`133833 331;;23151.
`10/2010 Sull et ,1.
`6/2012 Connery et 31.
`6/2012 Dunton et 31,
`7/2012 Logan et a1.
`1/2013 Blum et a1.
`6/2013 Fedorynski et a1.
`
`2012/0023155 A1
`2012/0023249 A1
`2012/0023251 A1
`2012/0042050 A1
`2012/0042091 A1
`2012/0124179 A1
`2012/0185570 A1
`2012/0233345 A1
`2012/0284371 A1
`2012/0317305 A1
`
`1/2012 Myers et a1.
`1/2012 Chen et a1.
`1/2012 Pyle et al.
`2/2012 Chen et a1.
`2/2012 McCarthy et a1.
`5/2012 Cappio et a1.
`7/2012 Bouazizi et a1.
`9/2012 Hannuksela
`11/2012 Begen et a1.
`12/2012 Einarsson et a1.
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 4 of 56 Page ID #:104
`Case 8:21-cv-00211 Document 1—4 Filed 01/29/21 Page 4 of 56 Page ID #:104
`
`US 10,362,130 B2
`
`Page 3
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`KR
`KR
`WO
`WO
`
`1020050075633 A
`1020080108568 A
`03073768 A1
`2011038032 A2
`
`7/2005
`12/2008
`9/2003
`3/2011
`
`2013/0007223 A1*
`
`2013/0042100 A1
`
`1/2013 Luby ................ H04N 21/23106
`_
`_
`709/219
`2/2013 Boua21z1 et al.
`
`2013/0182643 A1
`2013/0117413 A1
`2013/0191550 A1
`2013/0254631 A1
`2013/0262567 A1
`2013/0286879 A1
`2013/0290492 A1
`2013/0298170 A1
`2014/0137168 A1
`2014/0258861 A1
`2015/0172348 A1
`2015/0280965 A1
`
`7/2013 Pazos et a1.
`5/2013 Kaneko
`7/2013 Hannuksela
`9/2013 Luby et 31.
`10/2013 Walker et al.
`10/2013 Elarabawy et al.
`10/2013 Elarabawy et 3L
`11/2013 Elarabawy et a1.
`5/2014 TakAhaShl et 31'
`9/2014 Baldwm
`6/2015 Lohmar et a1.
`10/2015 Kervadec
`
`2018/0159909 A1
`
`6/2018 Huang
`
`FOREIGN PATENT DOCUMENTS
`
`JP
`JP
`KR
`KR
`
`2005071318 A
`2008259001 A
`1020050000490 A
`1020050055820 A
`
`3/2005
`10/2008
`1/2005
`6/2005
`
`OTHER PUBLICATIONS
`
`.
`.
`.
`“Universal Mobile Telecommunications System; LTE; Transparent
`end-to-end Packet-sw1tched Streaming Serv1ce (PSS); Protocols
`and codecs (3GPP TS 26.234 version 9.3.0 Release 9),” ETSI TS
`126 234, V9.3.0, Jun. 2010, pp. 1-184, ETSI, France.
`“Use cases for Rel-10 Adaptive HTTP Streaming”, 3GPP TSG-
`SA4#60, Qualcomm Incorporated, Aug. 16-20, 2010, Erlangen,
`Germany.
`Thomas Stockhammer et a1., “Information technologyiMPEG
`t
`t hn 1
`-
`P t6' D
`-
`da t'
`tr
`-
`Sysems ec ooglesi a?
`'
`yuan?” {1 Pwe S emulg 9V“
`HTTP (DASH)”, International Organization for Standardization,
`
`ISO/IEC CD 23001-6, Oct. 15, 2010, Guangzhou, China.
`Ying Chen et a1., “Response to the CfP 0n HTTP Streaming:
`Adaptive Video Streaming based on AVC,” International Drganisa-
`tion for Standardisation, Jul. 2010, pp1-20, ISO/IEC JTCl/SC29/
`WGll, MPEG2010/MI7909, Qualcomm Incorporated, Geneva, Swit-
`zerland
`
`* cited by examiner
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 5 of 56 Page ID #:105
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 5 of 56 Page ID #:105
`
`U.S. Patent
`
`Jul. 23, 2019
`
`Sheet 1 0f 6
`
`US 10,362,130 B2
`
`FIG. 1
`
`100
`
`110
`
`CLIENT
`
`SERVER
`
`
`
`
`
`
`
`METADATA 120
`
`
`
`PROCESS METADATA
`
`
`REQUEST FRAGMENT 140
`
`PARSE CONTENT
`
`
`TRANSMIT FRAGMENT 150
`
`
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 6 of 56 Page ID #:106
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 6 of 56 Page ID #:106
`
`U.S. Patent
`
`Jul. 23, 2019
`
`Sheet 2 0f 6
`
`US 10,362,130 B2
`
`FIG. 2
`
`General info
`
`Content info, live or VoD, length,
`etc.
`
`data fragments
`
`QOS-related info
`
`Alternatives: quality and
`characteristics
`
`Cllent request
`- Client-based
`
`- Server—based
`- Distributed
`
`Data mapping info
`
`Mapping alternative to physical
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 7 of 56 Page ID #:107
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 7 of 56 Page ID #:107
`
`U.S. Patent
`
`Jul. 23, 2019
`
`Sheet 3 of 6
`
`US 10,362,130 B2
`
`
`
`
`
`Emma“.Epfiémxaw“Exam
`
`mwm
`
`‘“
`
`mu
`
`“
`
`‘.
`
`:EEH
`
`mat
`
`
`
`
`
`‘iiiiiiiiiiiz‘55:i:i=5:i:i=5:55:55::i=5:i:i=5:i:i=5:iiiiiiiiii,
`
`wszmfidxfi
`
`mnewumfimmd
`
`mummfiwfiw
`
`
`
`
`
`
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 8 of 56 Page ID #:108
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 8 of 56 Page ID #:108
`
`U S. Patent
`
`Jul. 23, 2019
`
`Sheet 4 0f 6
`
`US 10,362,130 B2
`
`FIG. 4
`
`Stream of TS packet
`
`
`
`First TS packet of
`new fragment
`
`Offset=l
`
`
`
`TS packet with
`PCR field
`
`
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 9 of 56 Page ID #:109
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 9 of 56 Page ID #:109
`
`US. Patent
`
`Jul. 23,2019
`
`Sheet 5 of6
`
`US 10,362,130 B2
`
`FIG. 5
`
`100
`
`TRANSCEIVER
`
`CONTROLLER
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 10 of 56 Page ID #:110
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 10 of 56 Page ID #:110
`
`U.S. Patent
`
`Jul. 23, 2019
`
`Sheet 6 of 6
`
`US 10,362,130 B2
`
`
`
`am.,i.9%.:
`
`wmy?“
`
`
`
`”germamymmfimm“fl...“zmugfimflm3M
`
`mfmfifw
`
`Eggs“um?“
`
`WHERE?+flag
`
`fikfiQfiwmfi
`
`
`
`”firefly,“fiaflmfim
`
`Afiwfigmy;3Smmw
`
`
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 11 of 56 Page ID #:111
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 11 of 56 Page ID #:111
`
`US 10,362,130 B2
`
`1
`APPARATUS AND METHOD FOR
`PROVIDING STREAMING CONTENTS
`
`TECHNICAL FIELD
`
`The present invention relates to a technology for provid-
`ing streaming content, and more particularly, to an apparatus
`and method for providing media content using adaptive
`streaming.
`
`1 0
`
`BACKGROUND ART
`
`15
`
`Streaming is one of schemes for transmitting and playing
`back multimedia content such as sounds, moving images,
`and the like. A client may play back content while receiving
`the content through the streaming.
`An adaptive streaming service refers to providing a
`streaming service employing a communication scheme with
`a request of a client and a response of a server in response 20
`to the request.
`The client may request a media sequence suitable for an
`environment of the client
`(for example, a transmission
`channel of the client), using the adaptive streaming service.
`The server may provide a media sequence matched to the 25
`request of the client among media sequences with various
`qualities that are included in the server.
`The adaptive streaming service may be provided based on
`various protocols.
`A Hypertext Transfer Protocol (HTTP) adaptive stream- 30
`ing service refers to an adaptive streaming service provided
`based on an HTTP protocol. A client of the HTTP adaptive
`streaming service may receive content from a server using
`the HTTP protocol, and may transmit a request associated
`with a streaming service to the server.
`
`35
`
`DISCLOSURE OF INVENTION
`
`Technical Goals
`
`40
`
`An aspect of the present invention provides an apparatus
`and method that may designate a minimum amount of
`initially buffered media during playback of content.
`Another aspect of the present
`invention provides an
`apparatus and method that may receive bytes within a 45
`specific range from a target indicated by a Uniform Resource
`Locator (URL), and may play back content.
`
`Technical Solutions
`
`50
`
`According to an aspect of the present invention, there is
`provided a method by which a client provides media content
`including one or more periods, the method including: receiv-
`ing metadata of the media content from a server, the meta-
`data including a minBulferTime attribute indicating a mini- 55
`mum amount of initially buffered media content that is
`required to ensure playout of the media content; receiving
`the media content from the server, and buffering the received
`media content by at least the minimum amount; and playing
`back the media content.
`
`60
`
`The metadata may be a Media Presentation Description
`(MPD) of the media content.
`The minBulferTime attribute may indicate the minimum
`amount of the initially buffered media content
`that
`is
`required to ensure playout of the media content when the 65
`media content is continuously delivered at or above a value
`of a bandwidth attribute of the metadata.
`
`2
`
`Each of the periods may include one or more represen-
`tations of the media content. Each of the representations may
`be a structured collection of one or more media components
`within a period.
`The bandwidth attribute may be an attribute of each of the
`representations.
`The bandwidth attribute may describe a minimum band-
`width of a hypothetical constant bitrate channel over which
`each of the representations are able to be continuously
`delivered after the client buffers each of the representations
`for at least minBufferTime.
`
`Each of the representations may include one or more
`segments.
`According to another aspect of the present invention,
`there is provided a terminal for providing media content
`including one or more periods, the terminal including: an
`access engine to receive metadata of the media content, to
`receive the media content from the server, and to buffer the
`received media content by at
`least a minimum amount
`indicated by a minBulferTime attribute, the metadata includ-
`ing the minBulferTime attribute indicating the minimum
`amount of initially buffered media content that is required to
`ensure playout of the media content; and a media engine to
`receive the media content from the access engine, and to
`play back the media content.
`According to still another aspect of the present invention,
`there is provided a method by which a client provides media
`content including one or more periods, the method includ-
`ing: receiving metadata of the media content from a server,
`the metadata including a Uniform Resource Locator (URL)
`attribute and a range attribute; receiving bytes designated by
`the range attribute from a URL indicated by the URL
`attribute; and playing back the media content using the
`received bytes.
`The bytes designated by the range attribute may designate
`segments of the media content.
`The range attribute may indicate multiple byte ranges.
`The bytes may be received by a partial HTTP GET
`command for the URL instructed by the byte range.
`According to yet another aspect of the present invention,
`there is provided a terminal for providing media content
`including one or more periods, the terminal including: an
`access engine to receive metadata of the media content, and
`to receive bytes designated by a range attribute from a URL
`indicated by a URL attribute, the metadata including the
`URL attribute and the range attribute; and a media engine to
`play back the media content using the received bytes.
`The bytes designated by the range attribute may designate
`segments of the media content.
`The range attribute may indicate multiple byte ranges.
`The bytes may be received by a partial HTTP GET
`command for the URL instructed by the byte range.
`According to a further aspect of the present invention,
`there is provided a method by which a client processes
`content including one or more intervals, the method includ-
`ing: receiving metadata of an interval of the content from a
`server; processing the metadata and sending, to the server, a
`request for a fragment suitable for the interval based on the
`processed metadata; and receiving the fragment from the
`server.
`
`The content may be content on demand, or live content.
`The metadata may include general information, and the
`general information may include a general description of the
`content, and a general description of the interval.
`The general description of the content may include at least
`one of a duration and a start time.
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 12 of 56 Page ID #:112
`Case 8:21-cv-OO211 Document 1-4 Filed 01/29/21 Page 12 of 56 Page ID #:112
`
`US 10,362,130 B2
`
`3
`The metadata may include Quality of Service (QoS)
`information, and the QoS information may describe char-
`acteristics of each of alternatives of the content.
`
`The characteristics may include at least one of a bitrate,
`a resolution, and a quality.
`Each of the alternatives may be physical, or Virtual.
`The fragment may be selected based on information of the
`alternatives.
`
`The metadata may include mapping information, and the
`mapping information may describe locations to retrieve the
`content.
`
`10
`
`The metadata may include content-level information, and
`interval-level information, and all computations for deciding
`alternatives and resolving locations may be performed by
`the server.
`
`The request may define an order value of the fragment in
`the interval, and a start time of the fragment in the interval.
`The metadata may include content-level
`information,
`interval-level
`information, and QoS information, and all
`computations for deciding alternatives and resolving loca-
`tions may be distributed and performed by the client and the
`server.
`
`The request may include one of an order value of an
`alternative that appears in the QoS information based on the
`order value, values of adaptation operators that appear in the
`QoS information, and values of resources that appear in the
`QoS information.
`The adaptation operators may include at least one of a
`number of scalable audio layers to be discarded, a number
`of temporal layers of a scalable video to be discarded, a
`number of spatial layers of a scalable video to be discarded,
`a number of quality layers of a scalable video to be dis-
`carded, and a number of priority layers of a scalable video
`to be discarded.
`
`A type of the resources may include at least one of an
`average bitrate of the alternative, a vertical resolution of the
`alternative, a horizontal resolution of the alternative, and a
`frame rate of the alternative.
`
`information,
`The metadata may include content-level
`interval-level information, QoS information, and mapping
`information, and all computations for deciding alternatives
`and resolving locations may be performed by the client.
`The request may include at least one of a parameter for
`Moving Picture Experts Group-2 Transport Stream
`(MPEG-2 TS) boundary, a parameter for International Orga-
`nization for Standardization (ISO) media file boundary, and
`parameters for a file considered as a raw byte-sequence.
`The metadata may be physically separated into content-
`level information, interval-level information, QoS informa-
`tion, and mapping information, and linking of related parts
`of the content-level information, the interval-level informa-
`tion, the QoS information, and the mapping information may
`be performed by reference.
`According to a further aspect of the present invention,
`there is provided a method by which a server provides
`content including one or more intervals, the method includ-
`ing: transmitting metadata of an interval of the content to a
`client; receiving a request for a fragment from the client, the
`fragment being selected based on the metadata and being
`suitable for the interval; parsing the content, and extracting
`a data part suitable for the fragment; and transmitting the
`fragment to the client.
`According to a further aspect of the present invention,
`there is provided a client for processing content including
`one or more intervals, the client including: a transceiver to
`receive metadata of an interval of the content from a server,
`to send, to the server, a request for a fragment suitable for the
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`interval, and to receive the fragment from the server; and a
`controller to process the metadata, and to select the fragment
`suitable for the interval based on the processed metadata.
`
`Effect of the Invention
`
`According to embodiments of the present invention, it is
`possible to designate a minimum amount of initially bulf—
`ered media during playback of content.
`Additionally, according to embodiments of the present
`invention,
`it is possible to receive bytes within a specific
`range from a target indicated by a Uniform Resource Loca-
`tor (URL), and to play back content.
`
`BRIEF DESCRIPTION OF DRAWINGS
`
`FIG. 1 is a diagram illustrating categories of signaling
`information according to an embodiment of the present
`invention.
`
`FIG. 2 is a diagram illustrating categories of signaling
`information according to an embodiment of the present
`invention.
`
`FIG. 3 is a diagram illustrating a hierarchy of content
`division and levels of signaling information according to an
`embodiment of the present invention.
`FIG. 4 is a diagram illustrating detection of virtual bound-
`aries in a Moving Picture Experts Group-2 Transport Stream
`(MPEG-2 TS) according to an embodiment of the present
`invention.
`
`FIG. 5 is a diagram illustrating a configuration of a client
`100 according to an embodiment of the present invention.
`FIG. 6 is a diagram illustrating a configuration of a client
`100 according to an embodiment of the present invention.
`
`BEST MODE FOR CARRYING OUT THE
`INVENTION
`
`Reference will now be made in detail to embodiments of
`
`the present invention, examples of which are illustrated in
`the accompanying drawings, wherein like reference numer-
`als refer to the like elements throughout. The embodiments
`are described below in order to explain the present invention
`by referring to the figures.
`A Dynamic Adaptive Streaming over HTTP (DASH) may
`specify formats that enable 1) transferring of media content
`from an HTTP server to an HTTP client, and 2) caching of
`content by standard HTTP cashes.
`FIG. 1 is a signal flowchart illustrating a content process-
`ing method according to an embodiment of the present
`invention.
`
`A media component may be an encoded version of
`individual media types, such as audios, videos, or timed
`texts that have specific attributes, for example bandwidths,
`languages, or resolutions.
`Media content may be a set of media components having
`a common timeline, for example audios, videos, or timed
`texts. Additionally, media components may have relation-
`ships showing how to present the media components as
`programs or movies (for example, individually, jointly, or
`mutually exclusive).
`Media content and content may be used as interchange-
`able terms.
`
`A media presentation may be a structured collection of
`data used to establish bounded or unbounded presentation of
`media content including consecutive media components.
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 13 of 56 Page ID #:113
`Case 8:21-cv-00211 Document 1—4 Filed 01/29/21 Page 13 of 56 Page ID #:113
`
`US 10,362,130 B2
`
`5
`In other words, the media presentation may be a struc-
`tured collection of data enabling access to a DASH client in
`order to provide a streaming service to a user.
`A Media Presentation Description (MPD) may be a for-
`malized description of a media presentation.
`The media presentation may include possible updates of
`the MPD, and may be described by the MPD.
`Content may be content on demand, or live content.
`The content may be divided into one or more intervals. In
`other words, the content may include one or more intervals.
`Intervals may be interchangeable with periods. The term
`period may be used as a term of 3rd Generation Partnership
`Project (3GPP) adaptive HTTP streaming.
`A period may be an interval of a media presentation.
`Consecutive sequences of all periods may form a media
`presentation.
`In other words, the media presentation may include one or
`more periods.
`One or more intervals may be a basic unit. One or more
`intervals may be described by signaling metadata. In other
`words, metadata may describe each of the one or more
`intervals.
`
`The metadata may be an MPD.
`The MPD may define a format to notify resource identi-
`fiers for segments. The MPD may provide a context regard-
`ing resources identified in the media presentation. The
`resource identifiers may be HTTP-Uniform Resource Loca-
`tors (URLs). URLs may be restricted by a byte range
`attribute.
`
`Each interval may be divided into fragments.
`Fragments may be interchangeable with segments. The
`term segment may be used as a term of 3GPP adaptive HTTP
`streaming.
`A segment may refer to an entity body of a response to an
`HTTP/ 1.1 GET request for an HTTP-URL, for example as
`defined in RFC 2616, (or a GET request for a part indicated
`by a byte range). The metadata may include a URL attribute,
`and a range attribute. A client may receive bytes designated
`by the range attribute from a URL indicated by the URL
`attribute. In other words, the bytes may be received by a
`partial HTTP GET command for the URL instructed by the
`byte range. The bytes designated by the range attribute may
`represent the above-described segment.
`The range attribute may indicate multiple byte ranges.
`The client may play back media content using the
`received bytes (namely, the segment).
`A sub-segment may refer to a smallest unit in segments
`that may be indexed by a segment index in a segment level.
`Two or more sets of fragments corresponding to a single
`interval may exist. Each of the sets may be called an
`alternative.
`
`An alternative may be interchangeable with a represen-
`tation (or an expression).
`Each period may include one or more groups.
`Each group may include one or more representations of
`the same media content.
`
`The representation may refer to a structured collection of
`one or more media components in a single period.
`An MPD (or an MPD element) may provide descriptive
`information that enables a client to select one or more
`
`representations.
`A Random Access Point (RAP) may be a specific location
`in a media segment. The RAP may be identified as a location
`in which playback may be started continuously from a
`location of the RAP using only information included in a
`media segment.
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`Each representation may be formed of one or more
`segments. In other words, a representation may include one
`or more segments.
`An MPD may be a document including metadata required
`to a DASH client to form appropriate HTTP-URLs in order
`to 1) access segments and to 2) provide a user with a
`streaming service. The HTTP-URLs may be absolute or
`relative.
`
`The MPD may be an Extensible Markup Language
`OiML)-document.
`The MPD may include an MPD element. The MPD may
`include only a single MPD element.
`A client 100 may be a DASH client.
`The DASH client may be compatible with a client speci-
`fied in RFC 2616.
`
`The DASH client may typically use an HTTP GET
`method or an HTTP partial GET method, as specified in
`RFC 2616, to access segments or parts of segments.
`A server 110 may perform hosting on DASH segments.
`The server 110 may be compatible with a server specified in
`RFC 2616.
`
`In operation 120, the client 100 may receive, from the
`server 110, 1) metadata of content, or 2) metadata of a
`specific interval of the content. In other words, the server
`110 may transmit, to the client 100, 1) the metadata of the
`content, or 2) the metadata of the specific interval of the
`content. The specific interval may indicate a currently pro-
`cessed interval among one or more intervals forming the
`content.
`
`In operation 130, the client 100 may process the metadata
`of the specific interval.
`In operation 140, the client 100 may send a request for a
`fragment to the server 110. The client 100 may request the
`server 110 to transmit fragments suitable for the specific
`interval based on the processed metadata. In other words, the
`requested fragments may be selected based on the metadata.
`In operation 145, in several cases, the server may need to
`parse content (for example, a Moving Picture Experts Group
`(MPEG) layer 4 (MP4) file for Scalable Video Coding
`(SVC)), and to extract a data part suitable for the requested
`fragment.
`In operation 150, the server 110 may transmit, to the client
`100, a fragment suitable for each request from the client 100.
`The client 100 may receive the fragment from the server.
`Subsequently, the entire process may be executed from
`the beginning.
`In other words, operation 120 may be
`repeated on the next interval to the specific interval.
`The client 100 may play back content using fragments
`received when operations 120 through 150 are repeated.
`FIG. 2 is a diagram illustrating categories of signaling
`information according to an embodiment of the present
`invention.
`
`The signaling information (namely, metadata) may be
`divided into the following categories 1) through 4):
`1) General information 210: includes common description
`of content, and general description of each interval, such as
`a duration, and a start time.
`2) Quality of Service (QoS) information 220: describes
`characteristics of each alternative, such as a bitrate, a reso-
`lution, and a quality. In other words, the QoS information
`describes characteristics of each of alternatives of content.
`
`(namely, created in
`An alternative may be physical
`advance), or may be virtual (namely, to be created on the
`fly). Based on information of alternatives, the client may
`select a fragment of an appropriate alternative. Accordingly,
`adaptivity to contexts of terminals and networks may be
`supported.
`
`
`
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 14 of 56 Page ID #:114
`Case 8:21-cv-00211 Document 1-4 Filed 01/29/21 Page 14 of 56 Page ID #:114
`
`US 10,362,130 B2
`
`7
`3) Mapping information 230: describes locations to
`retrieve content. Depending on specific cases, different
`alternatives may have the same or different locations.
`4) Client request 240: this type of signaling information
`may conform to a format of HTTP 1.1 request message. As
`shown in FIG. 1, parameters requested by the client may be
`derived from the information of categories 1) through 3).
`Objectives of signaling are in the following 1) through 4):
`1)
`Support
`for
`different media
`storage/delivery
`approaches:
`the signaling information may be general
`enough to support
`typical cases (also various cases) of
`storage and delivery, such as MPEG-2 Transport Stream
`(TS), MP4 file including Advanced Video Coding (AVC)/
`SVC alternatives. Additionally, multi-channel