Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 1 of 25 Page ID #:32
`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 1 of 25 Page ID #:32
`
`
`
`
`EXHIBIT 1
`EXHIBIT 1
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 2 of 25 Page ID #:33
`6886 8210100211 “c“mem 1'1 Flililllllllllllfliflllllll'lllfllllllllllIlflfilllfllfllllllll‘llfifll
`
`US010270830B2
`
`(12) United States Patent
`US 10,270,830 B2
`(45) Date of Patent:
`Apr. 23, 2019
`Thang et al.
`
`(10) Patent No.:
`
`(54) APPARATUS AND METHOD FOR
`PROVIDING STREAMING CONTENT USING
`REPRESENTATIONS
`
`(71) Applicant: Electronics and Telecommunications
`Research Institute, Daejeon (KR)
`
`21/23439 (2013.01), H04N 21/25825
`(2013.01), H04N 21/6125 (2013.01),
`(Continued)
`(58) Field of Classification Search
`None
`
`See application file for complete search history.
`
`(72)
`
`Inventors: Truong Cong Thang, Daejeon (KR);
`Jin Young Lee, Daejeon (KR)
`
`(56)
`
`(73) Assignee:
`
`Ideahub, Seoul (KR)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`8,806,615 B2
`8,914,835 B2
`
`8/2014 Ahuja et a1.
`12/2014 Chen et a1.
`
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`(21) Appl. No.: 16/168,933
`
`(22)
`
`Filed:
`
`Oct. 24, 2018
`
`(65)
`
`Prior Publication Data
`
`US 2019/0058746 A1
`
`Feb. 21, 2019
`
`Related US. Application Data
`
`(63) Continuation of application No. 15/834,702, filed on
`Dec. 7, 2017, now Pat. No. 10,122,780, which is a
`(Continued)
`
`(30)
`
`Foreign Application Priority Data
`
`Mar. 16, 2011
`Mar. 16, 2012
`
`(KR) ........................ 10-2011-0023271
`(KR) ........................ 10-2012-0026862
`
`(51)
`
`Int. Cl.
`G06F 15/16
`H04L 29/06
`H04N 21/84
`H04N 21/2343
`H04N 21/258
`
`(2006.01)
`(2006.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(Continued)
`
`(52) US. Cl.
`CPC ........ H04L 65/601 (2013.01); H04L 65/4084
`(2013.01); H04L 65/602 (2013.01); H04N
`
`CN
`EP
`
`101589625 A
`2 224 732 A1
`
`11/2009
`9/2010
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`“HTTP Streaming: Media presentation data model”, 3GPP TSG-
`SA4 #56, Sophia Antipolis, France, Nov. 9-13, 2009 (13 pages in
`English).
`
`(Continued)
`
`Primary Examiner 7 Melvin H Pollack
`(74) Attorney, Agent, or Firm 7 NSIP Law
`
`(57)
`
`ABSTRACT
`
`A method and apparatus for an adaptive Hypertext Transfer
`Protocol (HTTP) streaming service using metadata of media
`content are provided. The media content may include a
`sequence of one or more periods. Each of the periods may
`include one or more representations. The metadata may
`include information used to describe a relationship between
`the representations, and include information for terminals
`having different display bit depth.
`
`35 Claims, 5 Drawing Sheets
`
`MPD
`PERIOD
`
`ADAPTATION SET
`REPRESENTATION
`SEGMENT
`
`
`
`
`SEGMENT
`
`
`
`
`
`
`REPRESENTATION
`
`
`ADAPTATlON SET
`
`PERIOD
`
`
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 3 of 25 Page ID #:34
`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 3 of 25 Page ID #:34
`
`US 10,270,830 B2
`
`Page 2
`
`Related US. Application Data
`
`continuation of application No. 14/004,644, filed as
`application No. PCT/KR2012/001922 on Mar. 16,
`2012, now Pat. No. 9,860,293.
`
`2016/0239749 A1
`2016/0269461 A9
`2017/0142180 A1
`
`8/2016 Peredriy et a1.
`9/2016 Thang et a1.
`5/2017 McGowan et a1.
`
`FOREIGN PATENT DOCUMENTS
`
`(51)
`
`Int. Cl.
`H04N 21/845
`H04N 21/61
`H04N 21/8543
`
`(2011.01)
`(2011.01)
`(2011.01)
`
`(52) us. Cl
`CPC ......... H04N 21/84 (2013.01); H04N 21/8456
`(2013.01); H04N 21/8543 (2013.01)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`8,935,249
`8,966,106
`9,037,502
`9,176,984
`9,319,448
`9,473,476
`9,497,290
`9,531,779
`9,558,282
`9,607,655
`9,646,352
`9,652,559
`9,716,736
`9,729,830
`9,762,635
`9,838,450
`9,872,329
`9,917,874
`9,961,388
`9,978,023
`2005/0071755
`2006/0047779
`2006/0174315
`2008/0002776
`2009/0141895
`2010/0266042
`2011/0050727
`2011/0081083
`2011/0123115
`2011/0307545
`2013/0185398
`
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`B2
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`
`1/2015 Traub et a1.
`2/2015 Wang et a1.
`5/2015 Mikkelsen et a1.
`11/2015 Hull et a1.
`4/2016 Chen et a1.
`10/2016 Raju et a1.
`11/2016 Furbeck et a1.
`12/2016 Pantos et a1.
`1/2017 Biderman et a1.
`3/2017 Bloch et a1.
`5/2017 McClements, IV
`5/2017 Byrne et a1.
`7/2017 Harrison
`8/2017 May, Jr. et a1.
`9/2017 Sebastian et a1.
`12/2017 McGowan
`1/2018 Kimmich et a1.
`3/2018 Luby et a1.
`5/2018 Harrison et a1.
`5/2018 Levin et a1.
`3/2005 Harrington et a1.
`3/2006 Deshpande
`8/2006 Kim et a1.
`1/2008 Borer et a1.
`6/2009 Anderson et a1.
`10/2010 K00 et a1.
`3/201 1 Mukawa
`4/2011 Lee et a1.
`5/2011 Lee et a1.
`12/2011 Bouazizi
`7/2013 Thang et a1.
`
`JP
`KR
`KR
`KR
`W0
`W0
`
`2002-335519 A
`10-2004-0025994 A
`10-2006-0087793 A
`10-0687730 B1
`WO 2008/049446 A1
`WO 2010/082786 A2
`
`11/2002
`3/2004
`8/2006
`2/2007
`5/2008
`7/2010
`
`OTHER PUBLICATIONS
`
`3rd Generation Partnership Project, “Progressive Download and
`Dynamic Adaptive Streaming over HTTP (3GP-DASH)”, 3GPP TS
`26.247 V1.0.0, Release 10, 4DVANCED LTE, 2010, pp. 1-35.
`Christian Timmerer, et a1., “HTTP Streaming of MPEG Media,”
`Proceedings of Streaming Day, Sep. 2010 (4 pages, in English).
`Huawei Technologies C0., Ltd. “Partial Representation Manage-
`ment”. 3GPP Draft; 3rd Generation Partnership Project (3GPP).
`3GPP TSG-SA4 Meeting #60 S4-100642. XP050638790. Aug.
`16-20, 2010. (3 pages, in English).
`“3rd Generation Partnership Project; Technical Specification Group
`Services and System Aspects Transparent end-to-end Packet-
`switched Streaming Service (PSS); Progressive Download and
`Dynamic Adaptive Streaming over HTTP (3GP-DASH)(Re1ease
`10).” 3rd Generation Partnership Project (3GPP). 3GPP TS 26.cde.
`V1.0.0 (Aug. 2010). XP050442029. Aug. 25, 2010. (34 pages, in
`English).
`“Information TechnologyiDynamic Adaptive Streaming over HTTP
`(DASH)7Part 1: Media presentation description and segment
`format” of ISO/IEC DIS 23009-1. Aug. 30, 2011 (134 pages, in
`English).
`International Search Report dated Oct. 4, 2012 in counterpart
`International Application No. PCT/KR2012/001922 (5 pages,
`in
`Korean, with complete English translation).
`Chinese Office Action dated Jan. 25, 2016, in counterpart Chinese
`Application No. 2012800135277 (10 pages, in Chinese).
`ETSI “Universal Mobile Telecommunications System (UMTS);
`LTE, Transparent end-to-end Packet-switched Streaming Service
`(PSS); Protocols and codecs,” European Telecommunications Stan—
`dards Institute, (3GPP TS 26.234 version 9.3.0 Release 9). Jun.
`2010, France, pp. 1-186 (In English).
`3GPP “3rd Generation Partnership Project; Technical Specification
`Group Services and System Aspects Transparent end-to-end Packet-
`switched Streaming Service (PSS); Progressive Download and
`Dynamic Adaptive Streaming over HTTP (3GP-DASH),” 3GPP
`Organizational Partners, (Release 10) Aug. 2010, France, pp. 1-34
`(In English).
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 4 of 25 Page ID #:35
`Case 8:21-cv-OO211 Document 1-1 Filed 01/29/21 Page 4 of 25 Page ID #:35
`
`U.S. Patent
`
`Apr. 23, 2019
`
`Sheet 1 of 5
`
`US 10,270,830 B2
`
`FIG. 1
`
`PERIOD
`
`ADAPTATION SET
`
`REPRESENTATION
`
`SEGMENT
`
`SEGMENT
`
`
`
`REPRESENTATION
`
`ADAPTATION SET
`
`PERIOD
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 5 of 25 Page ID #:36
`Case 8:21-cv-OO211 Document 1-1 Filed 01/29/21 Page 5 of 25 Page ID #:36
`
`U.S. Patent
`
`Apr. 23, 2019
`
`Sheet 2 of 5
`
`US 10,270,830 B2
`
`FIG. 2
`
`200
`
`2 10
`
`TERMINAL
`
`SERVER
`
`
`METADATA 220
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`PROCESS METADATA
`
`230
`
`REQUEST FOR SEGMENT 240
`
`245
`
`PARSE MEDIA
`
`SEGMENT 250
`
`PERFORM DECODING
`AND RENDERING
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 6 of 25 Page ID #:37
`Case 8:21-cv-OO211 Document 1-1 Filed 01/29/21 Page 6 of 25 Page ID #:37
`
`U.S. Patent
`
`Apr. 23, 2019
`
`Sheet 3 of 5
`
`US 10,270,830 B2
`
`FIG. 3
`
`GENERAL INFO
`
`CONTENT INFO, LIVE OR VOD,
`LENGTH, ETC.
`
`PHYSICAL DATA FRAGMENTS
`
`QoS-RELATED INFO
`ALTERNATIVES: QUALITY
`AND CHARACTERISTICS
`
`CLIENT REQUEST
`' CLIENT-BASED
`' SERVER-BASED
`. DISTRIBUTED
`
`DATA MAPPING INFO
`
`MAPPING ALTERNATIVE TO
`
`

`

`O.tmm1t2a8P
`
`m3,U2mr.DM
`
`C0U
`
`%«b.v.Umrm
`
`
`
`
`
`amt/3-9252005328ms0%qm>mqfi<>mEZ"1q<>mmezHazm_MAE/EH7:am1..9_mmo;
`
`
`
`e
`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 7 of 25 Page ID #:38
`112O
`
`U40ade87:h
`
`,mU
`
`%m#.0m%mm,a2P9
`
`
`
`
`
`
`
`m9%E7:ozamfizShela/Ema?EEuzuSu
`
`Mflm>§<zmm5<m87:mod_mmFZmEQ/QEm5mnmmmm
`
`
`
`
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 8 of 25 Page ID #:39
`Case 8:21-cv-OO211 Document 1-1 Filed 01/29/21 Page 8 of 25 Page ID #:39
`
`U.S. Patent
`
`Apr. 23, 2019
`
`Sheet 5 of 5
`
`US 10,270,830 B2
`
`m.Umm
`
`0mm3m
`
`Snipe$32$53
`
`
`
`:580mm:mZGZmflaw:
`
`
`
`02:2:+flow:QZmEOmmV
`
`Emfid
`
`<H<Q<Hm2
`
`
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 9 of 25 Page ID #:40
`Case 8:21-cv-OO211 Document 1-1 Filed 01/29/21 Page 9 of 25 Page ID #:40
`
`US 10,270,830 B2
`
`1
`APPARATUS AND METHOD FOR
`PROVIDING STREAMING CONTENT USING
`REPRESENTATIONS
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`This application is a Continuation of US. application Ser.
`No. 15/834,702, filed on Dec. 7, 2017 which is a Continu-
`ation of US. application Ser. No. 14/004,644, filed on Sep.
`11, 2013, now US. Pat. No. 9,860,293 B2 issued on Jan. 2,
`2018 which is a National Stage of International Application
`No. PCT/KR2012/001922, filed Mar. 16, 2012 and pub-
`lished as WO 2012/125006 on Sep. 20, 2012, which claims
`the benefit under 35 USC 119(a) and 365(b) of Korean
`Patent Application No. 10-2012-0026862, filed on Mar. 16,
`2012 and Korean Patent Application No. 10-2011-0023271,
`filed on Mar. 16, 2011, the entire disclosures of which are
`incorporated herein by reference for all purposes.
`
`TECHNICAL FIELD
`
`The present invention relates to a technology for provid-
`ing streaming content, and more particularly, to an apparatus
`and method for providing media content using a represen-
`tation of the media content.
`
`BACKGROUND ART
`
`Streaming is one of schemes for transmitting and playing
`back multimedia content such as sounds, moving images,
`and the like. A client may play back content while receiving
`the content through the streaming.
`An adaptive streaming service refers to providing a
`streaming service using a communication scheme with a
`request of a client and a response of a server in response to
`the request.
`The client may request a media sequence suitable for an
`environment of the client
`(for example, a transmission
`channel of the client), using the adaptive streaming service.
`The server may provide a media sequence matched to the
`request of the client among media sequences with various
`qualities that are included in the server.
`The adaptive streaming service may be provided based on
`various protocols. A Hypertext Transfer Protocol (HTTP)
`adaptive streaming service refers to an adaptive streaming
`service provided based on an HTTP. A client of the HTTP
`adaptive streaming service may receive content from a
`server using the HTTP, and may transmit a request associ-
`ated with a streaming service to the server.
`
`DISCLOSURE OF INVENTION
`
`Technical Goals
`
`An aspect of the present invention provides an apparatus
`and method that may play back media content using repre-
`sentations including accessibility information.
`Another aspect of the present
`invention provides an
`apparatus and method that may play back media content
`using information used to describe a relationship between
`representations of the media content.
`Still another aspect of the present invention provides an
`apparatus and method that may play back media content
`using information of different representations for terminals
`having different display bit depths.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`Technical Solutions
`
`According to an aspect of the present invention, there is
`provided a method for providing media content, the method
`including: receiving metadata of media content, the meta-
`data including one or more periods; accessing segments of
`the media content based on information provided by the
`metadata; and decoding and rendering data of the media
`content that is included in the segments, wherein each of the
`periods includes one or more representations of the media
`content, and wherein each of the representations includes
`information used to support disabled users who have diffi-
`culties in perceiving the media content.
`A media component of each of the representations may be
`enhanced to cope with a problem of a disabled user, and
`enhancement of the media component may include at least
`one of adjustment of a contrast and adjustment of a colour.
`The information included in each of the representations
`may indicate an intended use of each of the representations,
`and the intended use may include at least one of a sign
`language, a subtitle, a caption, and a description.
`The information included in each of the representations
`may indicate an attribute providing a reference to an external
`Moving Picture Experts Group (MPEG)-21 Digital
`ltem
`Adaptation (DIA).
`According to another aspect of the present invention,
`there is provided a method for providing media content,
`including: receiving metadata of media content, the meta-
`data including one or more periods; accessing segments of
`the media content based on information provided by the
`metadata; and decoding and rendering data of the media
`content that is included in the segments, wherein each of the
`periods includes one or more representations of the media
`content, and wherein the metadata includes an attribute
`describing a relationship between the representations.
`A first representation among the representations may
`include an attribute indicating a list of a part of the repre-
`sentations, and may be used together with a representation
`among the part of the representations.
`The first representation may be a representation used for
`audio description.
`Each of the part of the representations may be a repre-
`sentation used for a video component.
`A first representation among the representations may
`include an attribute indicating a list of a part of the repre-
`sentations.
`
`A representation among the part of the representations
`may be replaced by the first representation.
`According to still another aspect of the present invention,
`there is provided a method for providing media content,
`including: receiving metadata of media content, the meta-
`data including one or more periods; accessing segments of
`the media content based on information provided by the
`metadata; and decoding and rendering data of the media
`content that is included in the segments, wherein each of the
`periods includes one or more representations of the media
`content, and wherein each of the representations includes a
`bit depth attribute used to select different representations for
`terminals having different display bit depths.
`The bit depth attribute may indicate a number of bits used
`to represent a luma/chroma sample of visual content.
`According to yet another aspect of the present invention,
`there is provided a terminal including: an access engine to
`receive metadata of media content, to receive segments of
`the media content based on information provided by the
`metadata, and to decode data of the media content that is
`included in the segments, the metadata including one or
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 10 of 25 Page ID #:41
`Case 8:21-cv-OO211 Document 1-1 Filed 01/29/21 Page 10 of 25 Page ID #:41
`
`US 10,270,830 B2
`
`3
`more periods; and a media engine to receive the data of the
`media content from the access engine, and to output the
`media content, wherein each of the periods includes one or
`more representations of the media content, and wherein each
`of the representations includes information used to support
`disabled users who have difficulties in perceiving the media
`content.
`
`According to a further aspect of the present invention,
`there is provided a terminal including: an access engine to
`receive metadata of media content, to receive segments of
`the media content based on information provided by the
`metadata, and to decode data of the media content that is
`included in the segments, the metadata including one or
`more periods; and a media engine to receive the data of the
`media content from the access engine, and to output the
`media content, wherein each of the periods includes one or
`more representations of the media content, and wherein the
`metadata includes an attribute describing a relationship
`between the representations.
`According to a further aspect of the present invention,
`there is provided a terminal including: an access engine to
`receive metadata of media content, to receive segments of
`the media content based on information provided by the
`metadata, and to decode data of the media content that is
`included in the segments, the metadata including one or
`more periods; and a media engine to receive the data of the
`media content from the access engine, and to output the
`media content, wherein each of the periods includes one or
`more representations of the media content, and wherein each
`of the representations includes a bit depth attribute used to
`select different representations for terminals having different
`display bit depths.
`
`Effect of the Invention
`
`According to embodiments of the present invention, it is
`possible to play back media content using representations
`including accessibility information.
`Additionally, according to embodiments of the present
`invention, it is possible to play back media content using
`information used to describe a relationship between repre-
`sentations of the media content.
`
`Furthermore, according to embodiments of the present
`invention, it is possible to play back media content using
`information of different representations for terminals having
`different display bit depths.
`
`BRIEF DESCRIPTION OF DRAWINGS
`
`FIG. 1 is a diagram illustrating a Dynamic Adaptive
`Streaming over HTTP (DASH) high-level data model.
`FIG. 2 is a signal flowchart illustrating a content process-
`ing method according to an embodiment of the present
`invention.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`FIG. 3 is a diagram illustrating categories of signaling
`information according to an embodiment of the present
`invention.
`
`55
`
`FIG. 4 is a diagram illustrating a hierarchy of content
`division and levels of signaling information according to an
`embodiment of the present invention.
`FIG. 5 is a diagram illustrating a configuration of a
`terminal according to an embodiment of the present inven-
`tion.
`
`BEST MODE FOR CARRYING OUT THE
`INVENTION
`
`Reference will now be made in detail to embodiments of
`
`the present invention, examples of which are illustrated in
`
`60
`
`65
`
`4
`
`the accompanying drawings, wherein like reference numer-
`als refer to the like elements throughout. The embodiments
`are described below in order to explain the present invention
`by referring to the figures.
`The entire document “Dynamic Adaptive Streaming over
`HTTP (DASH)7Part 1: Media presentation description and
`segment format” of ISO/IEC DIS 23009-1 published on
`Aug. 30, 2011, will be cited as references in the present
`application, and will used to describe the following embodi-
`ments.
`
`Hereinafter, embodiments of the present invention will be
`further described with reference to the accompanying draw-
`ings, however, there is no limitation to the embodiments of
`the present invention. Like reference numerals refer to the
`like elements throughout.
`The terms “specify,” “indicate,” and “mean” used herein
`may have the same meaning. Additionally, the terms “Uni-
`form Resource Locator ([IRL)” and “Uniform Resource
`Identifier (URI)” used herein may have the same meaning,
`and may be interchangeable.
`When indexes for a specific element are from 1 to N, or
`from 0 to N, the number of specific elements may be one or
`more. N may be an integer equal to or greater than 0.
`Hereinafter, examples of terms used in embodiments will
`be described.
`
`DASH may specify formats that enable 1) delivery of
`media content from an HTTP server to an HTTP client,
`and enable 2) caching of content by standard HTTP
`cashes. The formats may include, for example, an
`Extensible Markup Language C(ML) format, or a
`binary format.
`Media content may be a single media content period, or
`a contiguous sequence of media content periods. Here-
`inafter, media content, media, and content may be used
`as interchangeable terms. Media content may be a set
`of media content components having a common time-
`line, for example audios, videos, or timed texts. Addi-
`tionally, media components may have relationships on
`how the media components may be presented (for
`example, individually, jointly, or mutually exclusive) as
`programs or movies. Media content may be content on
`demand, or live content.
`Content may be divided into one or more intervals. In
`other words, the content may include one or more intervals.
`Hereinafter, an interval and a period may be used as inter-
`changeable terms. The term period may be used as a term in
`3rd Generation Partnership Project (3GPP) adaptive HTTP
`streaming. In other words, a period may be an interval of a
`media presentation. A continuous sequence of all periods
`may constitute the media presentation.
`One or more intervals may be a basic unit. One or more
`intervals may be described by signaling metadata. In other
`words, metadata may describe each of the one or more
`intervals. The metadata may be a Media Presentation
`Description (MPD) that will be described later.
`A media content component may be a continuous com-
`ponent of media content with an assigned media com-
`ponent
`type. A media content component may be
`encoded individually into a media stream. A media
`component may be an encoded version of individual
`media types, such as audios, videos, or timed texts with
`specific attributes, for example bandwidths, languages,
`or resolutions.
`
`A media stream may be an encoded version of a media
`content component
`A media component type may be a single type of media
`content, such as audio, video, or text.
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 11 of 25 Page ID #:42
`Case 8:21-cv-OO211 Document 1-1 Filed 01/29/21 Page 11 of 25 Page ID #:42
`
`US 10,270,830 B2
`
`5
`A media presentation may be a collection of data used to
`establish a bounded or unbounded presentation of
`media content. The media presentation may be a col-
`lection of data that is accessible to a DASH client to
`
`provide a streaming service to a user. An MPD may be
`described by an MPD. The media presentation may be
`a collection of data that is accessible to a DASH client
`
`to provide a streaming service to a user.
`An MPD may be a formalized description for a media
`presentation to provide a streaming service. The MPD
`may be a document containing metadata required by a
`DASH client,
`to provide a user with a streaming
`service, and to construct appropriate HTTP-URLs to
`access segments. The media presentation may be
`described by an MPD including possible updates of the
`MPD.
`
`An MPD may be a document containing metadata
`requested to a DASH client to construct appropriate HTTP-
`URLs in order to 1) access segments and to 2) provide a user
`with a streaming service. The HTTP-URLs may be absolute
`or relative. The MPD may be an XML-document.
`The MPD may define a format to announce resource
`identifiers for segments. The MPD may provide a context for
`identified resources within the media presentation. The
`resource identifiers may be HTTP-URLs. URLs may be
`restricted by a byte range attribute.
`A period may be an interval of a media presentation. A
`continuous sequence of all periods may constitute the
`media presentation. In other words, the media presen-
`tation may include one or more periods. Alternatively,
`the media presentation may include a sequence of one
`or more periods.
`Arepresentation may be a collection and encapsulation of
`one or more media streams in a delivery format, and
`may be associated with descriptive metadata. The rep-
`resentation may be a structured collection of one or
`more media components within a single period. In
`other words, the representation may be one of altema-
`tive choices of a complete set or subset of media
`content components forming media content during a
`defined period. The representation may include one or
`more media streams.
`
`Arepresentation may start at a beginning point of a period
`(namely, a period including the representation), and may
`continue to an ending point of the period.
`A representation may be one of alternative choices of the
`media content or a subset of the media content typically
`differing by the encoding choice, for example by a bitrate, a
`resolution, a language, a codec, and the like.
`An MPD (or an MPD element) may provide descriptive
`information that enables a client to select one or more
`
`representations.
`Hereinafter, a representation and a media representation
`may be used as interchangeable terms.
`Two or more sets of segments corresponding to a single
`interval may exist. Each of the sets may be called a repre-
`sentation, or an alternative.
`A segment may be a smallest addressable unit in an MPD
`with a defined format. Hereinafter, a segment and a
`media segment may be used as interchangeable terms.
`Each interval may be divided into segments. Hereinafter,
`a segment and a fragment may be used as interchangeable
`terms. The term segment may be used as a term of 3GPP
`adaptive HTTP streaming.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`A segment may mean an entity body of a response to an
`HTTP/1.1 GET request for an HTTP-URL, for example as
`defined in RFC 2616, (or a GET request for a part indicated
`by a byte range).
`A terminal may play back media content using received
`bytes (namely, a segment).
`A sub-segment may mean a smallest unit within segments
`that may be indexed by a segment index at a segment
`level.
`
`A sub-representation may be a part of a representation
`described in an MPD that is present in the entire period.
`A Random Access Point (RAP) may be a specific location
`in a media segment. The RAP may be identified as a
`location in which playback may be started continuously
`from a location of the RAP using only information
`included in a media segment.
`The DASH may provide a media-streaming model for
`delivery of media content. A client may exclusively control
`a session of the delivery. Clients may request data using the
`HTTP protocol from standard web servers that do not have
`DASH-specific capabilities. Accordingly, the DASH stan-
`dard may focus on data formats used to provide a DASH
`media presentation.
`A collection of encoded and deliverable versions of media
`
`content, and an appropriate description of the versions may
`form a media presentation. Media content may include one
`or more contiguous media content periods in time. Each
`media content period may include one or more media
`content components,
`for example audio components in
`various languages and a video component. A media content
`component type may be assigned to each media content
`component, and may include, for example, audio or video.
`Each media content component may have one or more
`encoded versions. An encoded version of a media content
`
`component may be referred to as a “media stream.” Each
`media stream may inherit attributes of media content used to
`encode media content, a media content period, or a media
`stream. Additionally, to each media stream, properties of an
`encoding process, such as sub-sampling, codec parameters,
`encoding bitrate, and the like, may be assigned. Accordingly,
`metadata may be relevant for static and dynamic selection of
`media content components and media streams.
`FIG. 1 is a diagram illustrating a DASH high-level data
`model.
`
`A DASH may be based on a hierarchical data model, as
`shown in FIG. 1.
`
`A DASH media presentation may be described by an
`MPD document. The MPD may describe a sequence of
`periods in time. The sequence of the periods may form a
`media presentation. A period may typically represent a
`media content period during which a consistent set of
`encoded versions of media content is available. In other
`
`words, during a single period, bitrates, languages, captions,
`subtitles, and the like, may not be changed.
`A period may include one or more adaptation sets. An
`adaptation set may represent a set of interchangeable
`encoded versions of one or more media content components.
`For example, an adaptation set for a main video component,
`and a separate adaptation set for a main audio component
`may exist. For example, when there are other available
`materials, for example captions or audio descriptions, the
`other available materials may each have a separate adapta-
`tion set.
`
`An adaptation set may include one or more representa-
`tions. A representation may describe a deliverable encoded
`version of one or more media content components. A
`representation may include one or more media streams. A
`
`

`

`Case 8:21-cv-00211 Document 1-1 Filed 01/29/21 Page 12 of 25 Page ID #:43
`Case 8:21-cv-OO211 Document 1-1 Filed 01/29/21 Page 12 of 25 Page ID #:43
`
`US 10,270,830 B2
`
`7
`single representation within an adaptation set may be suf-
`ficient to render the media content components includeded
`in the single representation. Typically, a client may switch
`from one representation to another representation during a
`period,
`in order to adapt to network conditions or other
`factors. The client may also ignore representations that rely
`on codecs or other rendering technologies that are not
`supported by the client, or that are otherwise unsuitable.
`Within a representation, the content may be divided in
`time into segments. In other words, the representation may
`include one or more segments. A segment may be a basic
`unit of data that is advertised in an MPD. A URL may be
`provided for each segment. The providing of the URL may
`indicate that a segment is the largest unit of data that may be
`retrieved with a single HTTP request. The MPD may include
`a byte range of the URL, with the URL. Accordingly, the
`segment may be included in a byte range of other larger
`resources.
`
`Hereinafter, a relationship between components of the
`above-described data model will be described.
`
`An MPD may include a sequence of one or more periods.
`Each of the periods may include one or more adaptation
`sets. When an adaptation set includes one or more
`media content components, each of the media content
`components may be individually defined.
`Each of the adaptation sets may include one or more
`representations.
`Each of the representations may include one or more
`sub-representations.
`Each of the representations may include one or more
`segments.
`Segments may include media data, and/or metadata to
`access, decode, and present media content including the
`segments.
`Adaptation sets, representations and sub-representations
`may share common attributes and elements.
`Each of the segments may include one or more subseg-
`ments.
`
`An MPD document indicating an MPD may include an
`element “MPD.”
`
`The following Table 1 shows an XML schema of MPD.
`
`TABLE 1
`
`<?Xml version=“l.0” encoding=“UTF-8”?>
`<Xs:schema targetNaInespace=“urn:mpeg:DASH:schema:MPD:20ll”
`attributeFormDefault=“unqualified”
`elementFormDefault="qualified”
`xmlns:Xs=“http://www.w3.org/2001/XMLSchema”
`xmlns :Xlink=“http ://www.w3 .org1999/Xlink”
`xmlns=“urn:mpeg:DASH:schema:MPD:20ll”>
`<Xs:import namespace=“http ://www.w3.org/1999/Xlink”
`schemaLocation=“http ://www.w3 .orgl 999/Xlink.xsd”/>
`<Xs :annotation>
`<Xs:appinfo>Media Presentation Description</Xs:appinfo>
`<Xs:documentation xml:lang=“en”>
`This Schema defines the Media Presentation Description for
`MPEG-DASH.
`</Xs:documentation>
`</Xs :annotation>
`<!-- MPD: main element -->
`<Xs:element naIne=“MPD” type=“MPDtype”/>
`</Xs :schema>
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`Table 1 shows an initial part of the XML schema of the
`MPD. The initial part may include namespace and other
`definitions.
`
`65
`
`A mechanism for referencing remote elements from a
`local MPD may be defined. A subset of World Wide Web
`
`8
`Consortium (W3C) XLINK simple links may be defined,
`consisting of l) restricted syntax and semantics, and 2) a
`processing model.
`XLINK attributes used in a part of ISO/IEC 23009 are
`provided as follows:
`“xlink:type” may define a type of W3C XLINK that is
`being used.
`“xlink:href” may identify a remote element using a URI,
`as defined in IETF RFC 3986.
`
`“xlink:show” may define a desired behaviour of a remote
`element once dereferenced from within an MPD, as
`defined in W3C XLINK.
`
`“xlink:actuate” may define a desired timing of derefer-
`encing a remote element from within an MPD, as
`defined in W3C XLINK.
`
`The following Table 2 shows an XML schema of XLINK.
`
`TABLE 2
`
`<?Xml version=‘l.0’ encoding=‘UTF-8’?>
`<Xs:schema xmlns:xs=“http://www.w3.orgZOOI/XMLSchema”
`targetNames 3ace=“http://www.w3.org1999/Xlink”
`xmlns :Xlink=“http ://www.w3 .org1999/Xlink”>
`<Xs:attribute name=“type” type=“XS:token” fixed=“simple”/>
`<Xs:attribute name=“href” type=“Xlink:hrenype”/