`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 1 of 24 Page ID #:57
`
`
`
`
`EXHIBIT 2
`EXHIBIT 2
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 2 of 24 Page ID #:58
`68898121'W'002“ “we“ 1'2 Fllllllllllllfifllllfillllillfllllfillll“11111101111100
`
`US010313414B2
`
`(12) United States Patent
`US 10,313,414 B2
`(45) Date of Patent:
`Jun. 4, 2019
`Thang et al.
`
`(10) Patent No.:
`
`(54) APPARATUS AND METHOD FOR
`PROVIDING STREAMING CONTENT USING
`REPRESENTATIONS
`
`(71) Applicant: Electronics and Telecommunications
`Research Institute, Daejeon (KR)
`
`(72)
`
`Inventors: Truong Cong Thang, Daejeon (KR);
`Jin Young Lee, Daejeon (KR)
`
`(73) Assignee:
`
`Ideahub, Seoul (KR)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(58) Field of Classification Search
`CPC . H04L 65/601; H04L 65/4084; H04L 65/602;
`H04N 21/23439; H04N 21/25825;
`(Continued)
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`8,782,268 B2*
`
`7/2014 Pyle ............... H04N21/234327
`709/219
`
`8,806,615 B2
`
`8/2014 Ahuja et a1.
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`(21) Appl. No.: 16/229,092
`
`(22)
`
`Filed:
`
`Dec. 21, 2018
`
`(65)
`
`Prior Publication Data
`
`US 2019/0132374 A1
`
`May 2, 2019
`
`Related US. Application Data
`
`(63) Continuation of application No. 16/168,933, filed on
`Oct. 24, 2018, which is a continuation of application
`(Continued)
`
`(30)
`
`Foreign Application Priority Data
`
`Mar. 16, 2011
`Mar. 16, 2012
`(51)
`Int Cl
`'
`'
`G06F 15/16
`H04L 29/06
`
`(KR) ........................ 10-2011-0023271
`(KR) ........................ 10-2012-0026862
`
`(2006.01)
`(2006.01)
`
`.
`(Continued)
`
`(52) U-S- C1-
`CPC ........ H04L 65/601 (2013.01); H04L 65/4084
`(2013.01); H04L 65/602 (2013.01);
`(Continued)
`
`200
`
`mm
`
`CN
`EP
`
`101589625 A
`2 224 732 A1
`
`11/2009
`9/2010
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`“HTTP Streaming: Media presentation data model”, 3GPP TSG-
`SA4 #56, Sophia Antipolis, France, Nov. 9-13, 2009 (13 pages in
`English).
`
`(Continued)
`.
`.
`.
`Primary Exammer 7 Melvm H Pollack
`(74) Attorney, Agent, or Firm 7 NSIP Law
`
`ABSTRACT
`(57)
`Amethod and apparatus for an adaptive Hypertext Transfer
`Protocol (HTTP) streaming service using metadata of media
`content are provided. The media content may include a
`.
`.
`sequence of one or more periods. Each of the periods may
`.
`.
`include one or more representations. The metadata may
`include information used to describe a relationship between
`the representations, and include information for terminals
`having different display bit depth.
`
`30 Claims, 5 Drawing Sheets
`
`210
`
`METADATA 220
`
`
`
`
`AND RENDERING
`
`
`REQUEST FOR SEGMENT 240
`
`SEGMENT 250
`
`
`
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 3 of 24 Page ID #:59
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 3 of 24 Page ID #:59
`
`US 10,313,414 B2
`
`Page 2
`
`Related US. Application Data
`
`No. 15/834,702, filed on Dec. 7, 2017, now Pat. No.
`10,122,780, which is a continuation of application
`No. 14/004,644,
`filed as application No. PCT/
`KR2012/001922 on Mar. 16, 2012, now Pat. No.
`95860293
`
`(2011.01)
`(2011.01)
`(201101)
`(201101)
`(2011.01)
`(2011.01)
`
`(51)
`
`(56)
`
`Int. Cl.
`H04N 21/8543
`H04N 21/61
`H04N 21/845
`H04N 21/258
`H04N 21/2343
`H04N 21/84
`(52) US. Cl.
`CPC . H04N 21/23439 (2013.01); H04N 21/25825
`(2013.01); H04N 21/6125 (2013.01); H04N
`21/84 (2013.01); H04N 21/8456 (2013.01);
`H04N 21/8543 (2013.01)
`(58) Field of Classification Search
`CPC ............... H04N 21/6125; H04N 21/84; H04N
`21/8456; H04N 21/8543
`USPC .......................................................... 709/219
`See application file for complete search history.
`,
`References Clted
`U.S. PATENT DOCUMENTS
`
`12/2014 Chen et a1.
`8,914,835 B2
`1/2015 Traub et a1.
`8,935,249 B2
`2/2015 Wang et a1.
`8,966,106 B2
`5/2015 Mikkelsen et 31~
`9,037,502 132
`9’160’779 B2 * 10/2015 Cherlan """""""" H04L 65/605
`3:332:53 E; *
`1$3812 3:11 et a1.
`H04N 21/23439
`9,319,448 B2
`4/2016 Chennetal. """"
`9:369:687 132*
`6/2016 Braness ........... G11B 20/00086
`9,467,493 B2 >x< 10/2016 Thang ................. H04L 65/4084
`9,473,476 B2
`10/2016 Raju et al.
`9,497,290 132 *
`11/2016 Furbeck .............. H04L 65/1083
`
`9,531,579 B2 * 12/2016 Willig ..........
`H04L 65/1016
`9,531,779 B2
`12/2016 Pantos et a1.
`9,558,282 B2
`“2017 Biderman et 3L
`9,607,655 BZ
`”017 1310911 6t 31~
`9,621,610 B2 *
`4/2017 Gabln ................. H04L 65/4084
`9’646’352 B2
`5/2017 McClements, IV
`9,652,559 B2
`5/2017 Byrne et al.
`9661 104 132*
`572017 Furbeck .............. H04L 65/4084
`9:699:486 132*
`7/2017 Kwon ............ H04N21/234327
`9,716,736 B2
`7/2017 Harrison
`............. H04N 7/17318
`9,729,830 132 *
`8/2017 May, Jr.
`9,756,364 B2 *
`9/2017 Ha ................... H04N21/23439
`9,762,635 B2
`9/2017 Sebastian et a1.
`9,781,188 B2 *
`10/2017 Lee .................. H04N 21/23439
`9,813,472 132*
`11/2017 HUTSt
`~~~~~~~~~~~~~~~~~ H04N 7/17336
`9,838,450 32
`12/2017 McGowan
`9,860,573 B2 *
`1/2018 KWOH. .............. H04N 21/23439
`333%? 33*
`$3813 51111151311011 et a1. H04N21/23106
`9,961,388 B2
`5/2018 Harrlsonetal
`9:967:598 B2 >x<
`5/2018 Ha ..................... H04N 21/2402
`9,978,023 B2
`5/2018 Levin et 31.
`
`10,032,485 132 *
`7/2018 Ahsan ..........
`
`3/2005 Harrington et a .
`2005/0071755 A1
`2006/0047779 A1
`3/2006 Deshpande
`
`G11B 20/10
`
`2006/0174315 A1
`2008/0002776 A1
`2009/0141895 A1
`2010/0266042 A1
`igfigggfigg :1
`2011/0123115 A1
`2011/0179185 A1*
`
`2011/0307545 A1
`2013/0182643 A1*
`2013/0185398 A1
`2016/0239749 A1
`2016/0269461 A9
`2017/0142180 A1
`2019/0075179 A1*
`
`8/2006 Kim et a1.
`1/2008 Borer et al.
`6/2009 Anderson et a1.
`10/2010 K00 6t 31~
`431/5811 fifgy;
`5/2011 Lee et al.
`7/2011 Wang .................. H04L 65/4084
`709/231
`
`12/2011 Bouazizi
`7/2013 Pazos .................. H04L 65/4076
`7/2013 Than et al
`370/328
`8/2016 Peredgriy et a1.
`9/2016 Thang et a1.
`5/2017 McGowan et a1.
`3/2019 Thang ................. H04L 67/2804
`
`FOREIGN PATENT DOCUMENTS
`_
`10-238250335230291 :
`10-2006-0087793 A
`10-0687730 Bl
`082810883182 2;
`
`1538822;
`8/2006
`2/2007
`7/2810
`
`£1;
`KR
`KR
`$8
`
`OTHER PUBLICATIONS
`ETSI “Universal Mobile Telecommunications System (UMTS);
`LTE; Transparent end-to-end Packet-switched Streaming Service
`(PSS); Protocols and codecs,” European Telecommunications Stan-
`dards Institute, (3GPP TS 26.234 version 9.3.0 Release 9). Jun.
`2010, France, pp. 1-186 (In English).
`3rd Generation Partnership Project, “Progressive Download and
`Dynamic Adaptive Streaming over HTTP (3GP-DASH)”, 3GPP TS
`26.247 v1.0.0, Release 10, 4DVANCED LTE, 2010, pp. 1—35.
`3GPP “3rd Generation Partnership Project; Technical Specification
`Group Services and System Aspects Transparent end-to-end Packet-
`switched Streaming Service (PSS); Progressive Download and
`Dynamic Adaptive $363111ng over HTTP (KW-DASH)” 3GPP
`Organizational Partners, (Release 10) Aug. 2010, France, pp. 1-34
`(In English)
`Christian Timmerer, et a1., “HTTP Streaming of MPEG Media,”
`Proceedings of Streaming Day, Sep. 2010 (4 pages, in English).
`Huawei Technologies C0., Ltd. “Partial Representation Manage-
`ment”. 3GPP DRAFT; 3rd Generation Partnership Project (3GPP).
`3GPP TSG-SA4 Meeting #60 s4—100642. XP050638790. Aug.
`1640, 2010. (3 pages, in English).
`“3rd Generation Partnershi Pro'ect' Technical S ecification Grou
`.
`P
`J
`7
`P
`P
`Serv1ces and System Aspects Transparent end-to-end Packet-
`switched Streaming Service (PSS); Progressive Download and
`Dynamic Adaptive Streaming over HTTP (3GP-DASH)(Re1ease
`10).” 3rd Generation Partnership Project (3GPP). 3GPP TS 26.cde.
`V1.0.0 (Aug. 2010). XP050442029. Aug. 25, 2010. (34 pages, in
`English).
`“Information TechnologyiDynamjc Adaptive Streaming over HTTP
`(DASH)7Part 1: Media presentation description and segment
`format” of ISO/IEC DIS 23009—1. Aug. 30, 2011 (134 pages, in
`English).
`International Search Report dated Oct. 4, 2012 in counterpart
`Internatlonal Appllcatlon N0. PCT/KR2012/001922 (5 pages, 1n
`Korea-n, With complete English tm-IISlatiOIl).
`Chinese Office Action dated Jan. 25, 2016, in counterpart Chinese
`Application No. 2012800135277 (10 pages, in Chinese).
`
`* cited by examiner
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 4 of 24 Page ID #:60
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 4 of 24 Page ID #:60
`
`U.S. Patent
`
`Jun. 4, 2019
`
`Sheet 1 of 5
`
`US 10,313,414 132
`
`FIG. 1
`
`PERIOD
`
`ADAPTATION SET
`
`REPRESENTATION
`
`SEGMENT
`
`SEGMENT
`
`
`
`REPRESENTATION
`
`ADAPTATION SET
`
`PERIOD
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 5 of 24 Page ID #:61
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 5 of 24 Page ID #:61
`
`U.S. Patent
`
`Jun. 4, 2019
`
`Sheet 2 of 5
`
`US 10,313,414 132
`
`FIG. 2
`
`200
`
`210
`
`
`‘
`METADATA 220
`
`
`
`
`REQUEST FOR SEGMENT 240
`
` 245
`
`PARSE MEDIA
`
`SEGMENT 250
`
`
`
`PERFORM DECODING
`AND RENDERING
`
`
`
`
`
`260
`
`O.
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 6 of 24 Page ID #:62
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 6 of 24 Page ID #:62
`
`U.S. Patent
`
`Jun. 4, 2019
`
`Sheet 3 of 5
`
`US 10,313,414 132
`
`FIG. 3
`
`QOS-RELATED INFO
`
`CLIENT REQUEST
`
`310
`
`
`GENERAL INFO
`
`CONTENT IN F0, LIVE OR VOD,
`LENGTH, ETC.
`
`
`
`
`
`
`
`ALTERNATIVES: QUALITY
`AND CHARACTERISTICS
`
`
`
`
`‘ CLIENT—BASED
`‘ SERVER-BASED
`‘ DISTRIBUTED
`
`
`
`
`
`DATA MAPPING INFO
`
`
`MAPPING ALTERNATIVE TO
`PHYSICAL DATA FRAGMENTS
`
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 7 of 24 Page ID #:63
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 7 of 24 Page ID #:63
`
`U.S. Patent
`
`n.HJ
`
`4,
`
`1
`
`m
`
`US 10,313,414 B2
`
`«meo87:
`
`
`mo;Ape/592320053200
`meqm>mqé<>mmeE"q<>MmezHEm_q<>mmezfl5H90%:Am
`
`
`
`
`
`
`
`v.Umm
`
`fH_0.n4mu
`5tmmFZmzmv/Efi
`
`82Hmoo
`
`
`
`
`
`9%S7:UZEQE
`
`$22725?®EflM>F<ZMMHA<E
`
`
`
`
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 8 of 24 Page ID #:64
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 8 of 24 Page ID #:64
`
`U.S. Patent
`
`Jun. 4, 2019
`
`Sheet 5 of 5
`
`US 10,313,414 132
`
`m.Umm
`
`0mm3m
`
`92503%:$53
`
`$38
`
`<H<Q<Hm2
`
`
`
`
`
`59280mm:Beam3%:
`
`07:25+$32szmzommv
`
`
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 9 of 24 Page ID #:65
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 9 of 24 Page ID #:65
`
`US 10,313,414 B2
`
`1
`APPARATUS AND METHOD FOR
`PROVIDING STREAMING CONTENT USING
`REPRESENTATIONS
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`This application is a Continuation of US. application Ser.
`No. 16/168,933, filed on Oct. 24, 2018, which is a Continu-
`ation of US. application Ser. No. 15/834,702, filed on Dec.
`7, 2017, now US. Pat. No. 10,122,780 B2, issued on Nov.
`6, 2018, which is a Continuation of US. application Ser. No.
`14/004,644, filed on Sep. 11, 2013, now US. Pat. No.
`9,860,293 B2, issued on Jan. 2, 2018, which is a National
`Stage of
`International Application No. PCT/KR2012/
`001922, filed Mar. 16, 2012 and published as WC 2012/
`125006 on Sep. 20, 2012, which claims the benefit under 35
`USC 119(a) and 365(b) of Korean Patent Application No.
`10-2012-0026862,
`filed on Mar. 16, 2012, and Korean
`Patent Application No. 10-2011-0023271, filed on Mar. 16,
`2011, the respective entire disclosures of all of the above are
`incorporated herein by reference for all purposes.
`
`TECHNICAL FIELD
`
`The present invention relates to a technology for provid-
`ing streaming content, and more particularly, to an apparatus
`and method for providing media content using a represen-
`tation of the media content.
`
`BACKGROUND ART
`
`Streaming is one of schemes for transmitting and playing
`back multimedia content such as sounds, moving images,
`and the like. A client may play back content while receiving
`the content through the streaming.
`An adaptive streaming service refers to providing a
`streaming service using a communication scheme with a
`request of a client and a response of a server in response to
`the request.
`The client may request a media sequence suitable for an
`environment of the client
`(for example, a transmission
`channel of the client), using the adaptive streaming service.
`The server may provide a media sequence matched to the
`request of the client among media sequences with various
`qualities that are included in the server.
`The adaptive streaming service may be provided based on
`various protocols. A Hypertext Transfer Protocol (HTTP)
`adaptive streaming service refers to an adaptive streaming
`service provided based on an HTTP. A client of the HTTP
`adaptive streaming service may receive content from a
`server using the HTTP, and may transmit a request associ-
`ated with a streaming service to the server.
`
`DISCLOSURE OF INVENTION
`
`Technical Goals
`
`An aspect of the present invention provides an apparatus
`and method that may play back media content using repre-
`sentations including accessibility information.
`Another aspect of the present
`invention provides an
`apparatus and method that may play back media content
`using information used to describe a relationship between
`representations of the media content.
`Still another aspect of the present invention provides an
`apparatus and method that may play back media content
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`using information of different representations for terminals
`having different display bit depths.
`
`Technical Solutions
`
`According to an aspect of the present invention, there is
`provided a method for providing media content, the method
`including: receiving metadata of media content, the meta-
`data including one or more periods; accessing segments of
`the media content based on information provided by the
`metadata; and decoding and rendering data of the media
`content that is included in the segments, wherein each of the
`periods includes one or more representations of the media
`content, and wherein each of the representations includes
`information used to support disabled users who have diffi-
`culties in perceiving the media content.
`A media component of each of the representations may be
`enhanced to cope with a problem of a disabled user, and
`enhancement of the media component may include at least
`one of adjustment of a contrast and adjustment of a colour.
`The information included in each of the representations
`may indicate an intended use of each of the representations,
`and the intended use may include at least one of a sign
`language, a subtitle, a caption, and a description.
`The information included in each of the representations
`may indicate an attribute providing a reference to an external
`Moving Picture Experts Group (MPEG)-21 Digital
`ltem
`Adaptation (DIA).
`According to another aspect of the present invention,
`there is provided a method for providing media content,
`including: receiving metadata of media content, the meta-
`data including one or more periods; accessing segments of
`the media content based on information provided by the
`metadata; and decoding and rendering data of the media
`content that is included in the segments, wherein each of the
`periods includes one or more representations of the media
`content, and wherein the metadata includes an attribute
`describing a relationship between the representations.
`A first representation among the representations may
`include an attribute indicating a list of a part of the repre-
`sentations, and may be used together with a representation
`among the part of the representations.
`The first representation may be a representation used for
`audio description.
`Each of the part of the representations may be a repre-
`sentation used for a video component.
`A first representation among the representations may
`include an attribute indicating a list of a part of the repre-
`sentations.
`
`A representation among the part of the representations
`may be replaced by the first representation.
`According to still another aspect of the present invention,
`there is provided a method for providing media content,
`including: receiving metadata of media content, the meta-
`data including one or more periods; accessing segments of
`the media content based on information provided by the
`metadata; and decoding and rendering data of the media
`content that is included in the segments, wherein each of the
`periods includes one or more representations of the media
`content, and wherein each of the representations includes a
`bit depth attribute used to select different representations for
`terminals having different display bit depths.
`The bit depth attribute may indicate a number of bits used
`to represent a luma/chroma sample of visual content.
`According to yet another aspect of the present invention,
`there is provided a terminal including: an access engine to
`receive metadata of media content, to receive segments of
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 10 of 24 Page ID #:66
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 10 of 24 Page ID #:66
`
`US 10,313,414 B2
`
`3
`the media content based on information provided by the
`metadata, and to decode data of the media content that is
`included in the segments, the metadata including one or
`more periods; and a media engine to receive the data of the
`media content from the access engine, and to output the
`media content, wherein each of the periods includes one or
`more representations of the media content, and wherein each
`of the representations includes information used to support
`disabled users who have difficulties in perceiving the media
`content.
`
`According to a further aspect of the present invention,
`there is provided a terminal including: an access engine to
`receive metadata of media content, to receive segments of
`the media content based on information provided by the
`metadata, and to decode data of the media content that is
`included in the segments, the metadata including one or
`more periods; and a media engine to receive the data of the
`media content from the access engine, and to output the
`media content, wherein each of the periods includes one or
`more representations of the media content, and wherein the
`metadata includes an attribute describing a relationship
`between the representations.
`According to a further aspect of the present invention,
`there is provided a terminal including: an access engine to
`receive metadata of media content, to receive segments of
`the media content based on information provided by the
`metadata, and to decode data of the media content that is
`included in the segments, the metadata including one or
`more periods; and a media engine to receive the data of the
`media content from the access engine, and to output the
`media content, wherein each of the periods includes one or
`more representations of the media content, and wherein each
`of the representations includes a bit depth attribute used to
`select different representations for terminals having different
`display bit depths.
`
`Effect of the Invention
`
`According to embodiments of the present invention, it is
`possible to play back media content using representations
`including accessibility information.
`Additionally, according to embodiments of the present
`invention, it is possible to play back media content using
`information used to describe a relationship between repre-
`sentations of the media content.
`
`Furthermore, according to embodiments of the present
`invention, it is possible to play back media content using
`information of different representations for terminals having
`different display bit depths.
`
`BRIEF DESCRIPTION OF DRAWINGS
`
`FIG. 1 is a diagram illustrating a Dynamic Adaptive
`Streaming over HTTP (DASH) high-level data model.
`FIG. 2 is a signal flowchart illustrating a content process-
`ing method according to an embodiment of the present
`invention.
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`FIG. 3 is a diagram illustrating categories of signaling
`information according to an embodiment of the present
`invention.
`
`60
`
`FIG. 4 is a diagram illustrating a hierarchy of content
`division and levels of signaling information according to an
`embodiment of the present invention.
`FIG. 5 is a diagram illustrating a configuration of a
`terminal according to an embodiment of the present inven-
`tion.
`
`65
`
`4
`BEST MODE FOR CARRYING OUT THE
`INVENTION
`
`Reference will now be made in detail to embodiments of
`
`the present invention, examples of which are illustrated in
`the accompanying drawings, wherein like reference numer-
`als refer to the like elements throughout. The embodiments
`are described below in order to explain the present invention
`by referring to the figures.
`The entire document “Dynamic Adaptive Streaming over
`HTTP (DASH)7Part 1: Media presentation description and
`segment format” of ISO/IEC DIS 23009-1 published on
`Aug. 30, 2011, will be cited as references in the present
`application, and will used to describe the following embodi-
`ments.
`
`Hereinafter, embodiments of the present invention will be
`further described with reference to the accompanying draw-
`ings, however, there is no limitation to the embodiments of
`the present invention. Like reference numerals refer to the
`like elements throughout.
`The terms “specify,” “indicate,” and “mean” used herein
`may have the same meaning. Additionally, the terms “Uni-
`form Resource Locator (URL)” and “Uniform Resource
`Identifier (URI)” used herein may have the same meaning,
`and may be interchangeable.
`When indexes for a specific element are from 1 to N, or
`from 0 to N, the number of specific elements may be one or
`more. N may be an integer equal to or greater than 0.
`Hereinafter, examples of terms used in embodiments will
`be described.
`
`DASH may specify formats that enable 1) delivery of
`media content from an HTTP server to an HTTP client,
`and enable 2) caching of content by standard HTTP
`cashes. The formats may include, for example, an
`Extensible Markup Language C(ML) format, or a
`binary format.
`Media content may be a single media content period, or
`a contiguous sequence of media content periods. Here-
`inafter, media content, media, and content may be used
`as interchangeable terms. Media content may be a set
`of media content components having a common time-
`line, for example audios, videos, or timed texts. Addi-
`tionally, media components may have relationships on
`how the media components may be presented (for
`example, individually, jointly, or mutually exclusive) as
`programs or movies. Media content may be content on
`demand, or live content.
`Content may be divided into one or more intervals. In
`other words, the content may include one or more intervals.
`Hereinafter, an interval and a period may be used as inter-
`changeable terms. The term period may be used as a term in
`3rd Generation Partnership Project (3GPP) adaptive HTTP
`streaming. In other words, a period may be an interval of a
`media presentation. A continuous sequence of all periods
`may constitute the media presentation.
`One or more intervals may be a basic unit. One or more
`intervals may be described by signaling metadata. In other
`words, metadata may describe each of the one or more
`intervals. The metadata may be a Media Presentation
`Description (MPD) that will be described later.
`A media content component may be a continuous com-
`ponent of media content with an assigned media com-
`ponent
`type. A media content component may be
`encoded individually into a media stream. A media
`component may be an encoded version of individual
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 11 of 24 Page ID #:67
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 11 of 24 Page ID #:67
`
`US 10,313,414 B2
`
`5
`media types, such as audios, Videos, or timed texts with
`specific attributes, for example bandwidths, languages,
`or resolutions.
`
`A media stream may be an encoded version of a media
`content component
`A media component type may be a single type of media
`content, such as audio, Video, or text.
`A media presentation may be a collection of data used to
`establish a bounded or unbounded presentation of
`media content. The media presentation may be a col-
`lection of data that is accessible to a DASH client to
`
`provide a streaming service to a user. An MPD may be
`described by an MPD. The media presentation may be
`a collection of data that is accessible to a DASH client
`
`to provide a streaming service to a user.
`An MPD may be a formalized description for a media
`presentation to provide a streaming service. The MPD
`may be a document containing metadata required by a
`DASH client,
`to provide a user with a streaming
`service, and to construct appropriate HTTP-URLs to
`access segments. The media presentation may be
`described by an MPD including possible updates of the
`MPD.
`
`An MPD may be a document containing metadata
`requested to a DASH client to construct appropriate HTTP-
`URLs in order to 1) access segments and to 2) provide a user
`with a streaming service. The HTTP-URLs may be absolute
`or relative. The MPD may be an XML-document.
`The MPD may define a format to announce resource
`identifiers for segments. The MPD may provide a context for
`identified resources within the media presentation. The
`resource identifiers may be HTTP-URLs. URLs may be
`restricted by a byte range attribute.
`A period may be an interval of a media presentation. A
`continuous sequence of all periods may constitute the
`media presentation. In other words, the media presen-
`tation may include one or more periods. Alternatively,
`the media presentation may include a sequence of one
`or more periods.
`Arepresentation may be a collection and encapsulation of
`one or more media streams in a delivery format, and
`may be associated with descriptive metadata. The rep-
`resentation may be a structured collection of one or
`more media components within a single period. In
`other words, the representation may be one of altema-
`tive choices of a complete set or subset of media
`content components forming media content during a
`defined period. The representation may include one or
`more media streams.
`
`Arepresentation may start at a beginning point of a period
`(namely, a period including the representation), and may
`continue to an ending point of the period.
`A representation may be one of alternative choices of the
`media content or a subset of the media content typically
`differing by the encoding choice, for example by a bitrate, a
`resolution, a language, a codec, and the like.
`An MPD (or an MPD element) may provide descriptive
`information that enables a client to select one or more
`
`representations.
`Hereinafter, a representation and a media representation
`may be used as interchangeable terms.
`Two or more sets of segments corresponding to a single
`interval may exist. Each of the sets may be called a repre-
`sentation, or an alternative.
`A segment may be a smallest addressable unit in an MPD
`with a defined format. Hereinafter, a segment and a
`media segment may be used as interchangeable terms.
`
`6
`Each interval may be divided into segments. Hereinafter,
`a segment and a fragment may be used as interchangeable
`terms. The term segment may be used as a term of 3GPP
`adaptive HTTP streaming.
`A segment may mean an entity body of a response to an
`HTTP/ 1.1 GET request for an HTTP-URL, for example as
`defined in RFC 2616, (or a GET request for a part indicated
`by a byte range).
`A terminal may play back media content using received
`bytes (namely, a segment).
`A sub-segment may mean a smallest unit within segments
`that may be indexed by a segment index at a segment
`level.
`
`A sub-representation may be a part of a representation
`described in an MPD that is present in the entire period.
`A Random Access Point (RAP) may be a specific location
`in a media segment. The RAP may be identified as a
`location in which playback may be started continuously
`from a location of the RAP using only information
`included in a media segment.
`The DASH may provide a media-streaming model for
`delivery of media content. A client may exclusively control
`a session of the delivery. Clients may request data using the
`HTTP protocol from standard web servers that do not have
`DASH-specific capabilities. Accordingly, the DASH stan-
`dard may focus on data formats used to provide a DASH
`media presentation.
`A collection of encoded and deliverable versions of media
`
`content, and an appropriate description of the versions may
`form a media presentation. Media content may include one
`or more contiguous media content periods in time. Each
`media content period may include one or more media
`content components,
`for example audio components in
`various languages and a video component. A media content
`component type may be assigned to each media content
`component, and may include, for example, audio or video.
`Each media content component may have one or more
`encoded versions. An encoded version of a media content
`
`component may be referred to as a “media stream.” Each
`media stream may inherit attributes of media content used to
`encode media content, a media content period, or a media
`stream. Additionally, to each media stream, properties of an
`encoding process, such as sub-sampling, codec parameters,
`encoding bitrate, and the like, may be assigned. Accordingly,
`metadata may be relevant for static and dynamic selection of
`media content components and media streams.
`FIG. 1 is a diagram illustrating a DASH high-level data
`model.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`A DASH may be based on a hierarchical data model, as
`shown in FIG. 1.
`
`A DASH media presentation may be described by an
`MPD document. The MPD may describe a sequence of
`periods in time. The sequence of the periods may form a
`media presentation. A period may typically represent a
`media content period during which a consistent set of
`encoded versions of media content is available. In other
`
`words, during a single period, bitrates, languages, captions,
`subtitles, and the like, may not be changed.
`A period may include one or more adaptation sets. An
`adaptation set may represent a set of interchangeable
`encoded versions of one or more media content components.
`For example, an adaptation set for a main video component,
`and a separate adaptation set for a main audio component
`may exist. For example, when there are other available
`materials, for example captions or audio descriptions, the
`other available materials may each have a separate adapta-
`tion set.
`
`55
`
`60
`
`65
`
`
`
`Case 8:21-cv-00211 Document 1-2 Filed 01/29/21 Page 12 of 24 Page ID #:68
`Case 8:21-cv-OO211 Document 1-2 Filed 01/29/21 Page 12 of 24 Page ID #:68
`
`US 10,313,414 B2
`
`5
`
`7
`An adaptation set may include one or more representa-
`tions. A representation may describe a deliverable encoded
`version of one or more media content components. A
`representation may include one or more media streams. A
`single representation within an adaptation set may be suf-
`ficient to render the media content components included in
`the single representation. Typically, aclient may switch from
`one representation to another representation during a period,
`in order to adapt to network conditions or other factors. The
`client may also ignore representations that rely on codecs or
`other rendering technologies that are not supported by the
`client, or that are otherwise unsuitable.
`Within a representation, the content may be divided in
`time into segments. In other words, the representation may 15
`include one or more segments. A segment may be a basic
`unit of data that is advertised in an MPD. A URL may be
`provided for each segment. The providing of the URL may
`indicate that a segment is the largest unit of data that may be
`retrieved witha single HTTP request. The MPD may include 20
`a byte range of the URL, with the URL. Accordingly, the
`segment may be included in a byte range of other larger
`resources.
`
`8
`Table 1 shows an initial part of the XML schema of the
`MPD. The initial part may include namespace and other
`definitions.
`A mechanism for referencing remote elements from a
`local MPD may be defined. A subset of World Wide Web
`Consortium (W3C) XLINK Simple links may be defined,
`consisting 0f 1) restricted syntax and semantics, and 2) a
`processing model.
`XLINK attributes used in a part Of ISO/IEC 23009 are
`10 provided as f0110W53
`“Xlinkztype” may define a type of W3C XLINK that is
`being used.
`“xlinkzhref” may identify a remote element using a URI,
`as defined in IETF RFC 3986.
`“xlinkzshow” may define a desired behaviour of a remote
`element once dereferenced from within an MPD, as
`defined in W3C XLINK.
`“xlinkzactuate” may define a desired timing of derefer-
`encing a remote element from within an MPD, as
`defined in W3C XLINK.
`The following Table 2 shows anXML schema of XLINK.
`
`TABLE 2
`Hereinafter, a relationship between components of the
`,
`,
`above-described data model will be described.
`<?Xml vers10n:'1.0' encoding:’UTF-8'?>
`.
`.
`<Xs:schema xmlns:Xs:”http://www.w3.orgZOOI/XMLSchema”
`An MPD may Inelude a sequence Of one 01' more peI'lOdS.
`targetNamespace="http://www.w3.org/1999/X1ink”
`Each of the periods may include one or more adaptation
`xmlns:Xlink:”http://www.w3.org/1999/X1ink”>
`sets. When an adaptation set includes one or more
`<Xs:attribute name:”type” type:”XS:token