throbber
STETEWNT
`
`I, the~un$e£signedw rasidimg at afa>HGfiYAKU'CE§TER.IRC.,IMita
`
`ME Bldg.?F, 3w13~12 Mita, Minatomku, Tokym lfiSwGOVE, Japan,
`
`dm balieve that I am sufficiantly proficient in xaading and
`
`writing both Sayanase and English, and déclaxa that I have
`
`@repaxed the English txanslatiens af JF2G12~263811
`
`and
`
`J?2613~9Q23?? and that said.tran$1atian.are true and corraet
`
`ta the best uf my knawladg% anfl belief:
`
`Dated this 23rd day of February, 2015
`
`1/
`Name: /1/,
`
`ff
`V/
`“/L)‘;
`Masahiko Minamimato
`
`.
`
`Genaral Manager
`
`

`

`30,
`
`01
`
`Jr
`.,).L,u
`
`C1,}
`
`{Inventor}
`
`{Address}
`
`c/o Sony Corpora ion
`
`l~7~i, KOH&H,
`
`Minatomku, Tokyo
`
`[Name
`
`Kazushi SATO
`
`{fpplicanu
`
`E13 No“;
`
`000002185
`
`{Name}
`
`Fony COLpOI&thD
`
`{Agenifi
`
`E1D Nc.§
`
`1000121“1
`
`[Af;:orney§
`
`[Name }
`
`Yoshio INAMOTO
`
`EnsviqrndAgent]
`
`[ID No.}
`
`100121111
`
`EALt.,rney§
`
`[11ame3
`
`{TEL}
`
`[Contact
`
`Iakashi NISHlKAwA
`
`
`
`{Lpplication Fees]
`
`{Prepayment No E
`
`005094
`
`[Amount Paid]
`
`15,000 yet
`
`{List of Document Attacheuci}
`
`{Name of Focument}
`
`Specification
`
`[Name of Locument}
`
`[Name OL‘ 2
`
`Q‘w“irm,1L}
`
`I
`
`
`
`[Name 0: Document}
`
`DrdwiLIS
`
`
`
`10
`
`‘n_J U1.
`
`20
`
`xx
`
`(I!
`
`30
`
`

`

`[General P
`
`Attorney No.1
`
`{General P
`
`Attorney $0.}
`
`9708842
`
`0705257
`
`

`

`(A21
`
`dG DEVICE AND METHOD
`
`The present disclosure relates to an ima;eU)
`L;
`processing device and method, and more b3rticularly, an
`
`image processing i.vice and method which are capable of
`
`supgressing a reduction in coding efficiency.
`
`
`
`
`
`I)
`
`l
`
`0
`
`(j‘:
`
`(j‘:
`
`1‘.J
`
`In rec:ent ye3rs,
`
`ior the purpose of digitaiizihg
`
`image information and transmitting and acc1rmlating
`
`infarmation at high efficiency at that time, devices that
`
`compress and encode images by using image informatioiw
`
`speci‘ic redundancy em;loying a coding scheme that
`
`performs compress*or through an orthogonal
`
`transform suc:
`
`
`
`as a disgrete cosine transform and motitn compensation
`
`have been spr-ad. As such a coding sche.¢ for example
`
`there is Movint Pictu e Experts Group (MERGE.
`
`C)
`
`{0003]
`
`Particularly, MPEG 9
`
`(TSJ/TPC 13818"?)
`
`is a
`
`standard tlat is defined as a geaer.impuroos- image
`{L P. ?
`
`scheme, and covers interlaced scan images,
`
`progressive scan images, s”3ndard resolution images, and
`7—.
`1“
`
`high def'nition images.
`
`
`
`
`or example, MPEG 2 is currently
`
`being widely used for a wide range of agolicatioas such
`
`as arohtssi<qal use and consumer use. Using the
`I) 0 ;3 ’D 3 ’D V
`<_ O:3 ’U H (D U) (I) H. O :5
`
`for example,
`
`in the case or an
`
`
`
`1.; S (D H, i4 S3) 0 (D CL
`
`scan image of 3 standard resolutior having 720
`
`x 480 pintis,
`a coding amount
`(bit rate) or
`4 Mbps to 8
`1“ (it)
`? (‘5 O U;
`DJ ._.
`,__J ocatn.d, Eurther, using the MPEG 2 compressior
`
`

`

`the
`
`Z)
`
`10
`
`allocated. Thus, it is possible to
`N.x.-
`
`ampression rate and an excellent
`
`image quality”
`
`[000 ]
`
` MLEG 2 is mainly intended for high definition
`
`
`coding suitable to: broadcasting but does not sipport a
`
`codino scheme raving a coding amount
`
`(bit rate)
`
`lOVJI
`
`MPEG 1,
`
`that is,
`
`a codingchene of a hi
`
`comcression rate. With the sgoread oi mobile terminals,
`
`the need tor s1c1 a coding schsmn is C013 idered to be
`
`increased in the future, and thus an MPEG 4 coding scheme
`1
`
`has been stanctardized‘
`
`l; conneC1tion with an image
`
`coding scheme, an inteIrationai standard thereof has b.
`
`
`approved as ISO/13C 14496—2 in December, 1998
`
`{0005]
`
`Further,
`
`in recent years, standardi7ation of a
`
`stanfiard such as H.2”L (International Telecommunication
`
`Unio: Telecommunicatio I1 Standardization Sector Qé/
`
`’“J C“
`
`Vi/eo Gating E pert Group (IlUwT Q6/l6 TCEG),
`I:I.I
`4.
`_
`'
`1
`.
`’U c a O o m (D 0
`ior Viceo conference has been
`
`for the
`
`image :oM
`
`conducted. H.26L eotrres a larger computation amount
`
`‘or coding and decoding than i: an eXistiig coding scheme
`
`[\) (j‘:
`
`
`sueh as MPEG 2 or MPEG 4, but is known to implement
`
`Qo
`
`k
`ill (Ila/37‘
`
`dng etticiencg.
`
`Pu ther, currently, as one of
`
`activities of MPEG 4, standardization of inco.p(“a ing
`
`even a function that is not supported in H.26L and
`
`imclemeniing higher coding e“ti citncv based on H,26T has
`
`been berrormed as a Joint Model of Enhanced_Compression
`
`Video Coding.
`
`

`

`(I!
`
`SPBSllEBWQOO
`
`[0006]
`
`Us a ScandafidLSRlIon schedule, an interracicial
`
`standsrd Jailed ii 264 and M‘EG”- PartiO Advanced Video
`
`Coding, ner€iiafter
`
`referr_ed to as AVG) has bee IL
`
`5
`
`established
`
`
`
`March, 2003
`
`[ JO.)"]
`
`Furrhermore, as an extension of H.264/AVC, Fidelity
`
`Range LXteJSlOJ
`
`(EPEXC)
`
`including an encoding tool
`
`necessary for professional use such as RFB or 4:2:2 or
`
`10
`
`4:4:4 or 8x8 DCT and a Quantization matrix whi3h are
`
`
`if,fliled in MJEfi—Z las bee; stalcardzed in February,
`
`2005. As a
`
`esult,
`
`the H 764/AJC
`
`has beeome a cgding
`
`s<3hehe capable of also
`1
`1
`W G i. ,J.
`
`in a momi_e
`
`expressing a film noise
`
`and is being used in a wide range of
`
`»4
`included
`
`
`15 Dollations SUlCh as a Blu—Ray Disc (a trademark),
`
`
`
`in regen: years,
`
`there is an increasing
`
`[JOJS]
`
`However,
`
`
`
`need for fur:hjr high compression rate coding capable of
`
`compressing an image of about 4000 x 2000
`
`
`
`.s which
`
`20
`
`ar
`
`four times as high as a hi gl1——de?inition image or
`
`wdefinitigz image
`
` _imited
`
`transmission
`
`en T .l_|_.
`
`nment
`
`such as the liiter.netu
`
`ITI ,,\
`lo
`
`this
`
`end, an improvement
`
`in codiig efficiency has been
`
`
`under cont'i nuous review by/ideo Mo _ig Expert Gro up
`
`25
`
`
`(VCEG) under ITU-T,
`
`i0009]
`
`In this redar , currenth,
`
`in order to further
`
`improve cor ing effiCienC.y to be higher than in the IVC,
`
`stand li2itIon of a coding scheme called High
`
`
`
`
`
`30 V”deo Coding (HEVC)
`
`1&8 been beingr onducted by Joint
`
`Collaboration Teammvideo Coding ICmMW‘ which is a uoiit
`
`

`

`
`
`(see NonmPatent Doctwent l).
`
`Z)
`
`[3010]
`
`GeIierally,
`
`in the HEVC,
`
`information that is
`
`transmitted “ r1om an encodin
`
`LQ
`
`rile to a decoding side
`
`n clUdes syntax element s for P slices and B slices,
`{.1 :5 r‘ (D “i
`"Te N O "a
`res lete Q Ft 0 DJ
`
`is, syntax ele=,ments
`
`'1 C) H n) (D
`
`that
`C
`
`(I)
`
`S). 0)
`
`10
`
`well as syntaxes for 1 slice:.
`
`[0011]
`
`Neahwhile a still picture profile serving as a
`
`profile for using the Hivt as a still image codec has
`
`(D (u :5
`
`oroposjd (for exlmnl- sea NonmPatent Document 2)”
`
`{0‘O ,_\ 2'l
`
`since the still picture profile is a profile for
`|__ *5 (2
`encoding and dec d’
`
`still images, when this prorile is
`
`applied,
` related t tie intermscreen
`
`"G a O 03655 Br, unnecessary.
`
`{Prior Art Documents]
`‘
`[NonwEatent Documents]
`
`I“III.
`
`NonmE‘atent Document 1] Benjamin Bross, WoOEJin Han,
`
`Jens—Rainer Ohm, Gary J. Sullivarl, Thomas Wiegsnd, "Iigh
`
`[\) (j:
`
`eifio
`
`8," JC
`
`Codino J
`
`‘iiicalio- l raft
`
`Team 3n Video
`
`TCl/SC2f3/ACll, 10th Meeting: Stock 1H0 m, SE, 11 20 Jnlv
`
`2012
`
`[Honwflutent Docuiei‘ z] Kemal Ugur, Jani Leinema, Misra
`xrr~_ -nq3'—I,/
`"On still picture profile," JC'JL_ --JUU;
`
`Haniuksela,
`
`

`

`Joint Collaborative Team on Video Logiro (JCT VC) of ITUM
`
`T SGlG WEB and ESQ/T C JTCl/SCZg/WGlllOth Meeting:
`
`
`
`Z)
`
`Howe‘vfer,
`
`in the case of the methor disclosed in
`
`p-s
`Hoanatent Docam~nt 2, coitrol on the syntax elements
`
`related to the intermscreen process is not pech<3rmed
`
`10
`
`Thus,
`
`the coding eff1c1ency is "iteny to Be lowered since
`
`ur1necessary information is thalsmlf-ed.
`
`:--1 0015]
`
`The present disclosure was made in light of the
`
`for,u01ng, and it is desirable to be caeable of
`
`sun ress1ng a reductioi in coding efficiency.
`
`[Means for aolvinc the Problems}
`
`A; aspect of the present technology lies in a1
`
`image processinc device,
`
`including:
`
`a TQrTElCTqu unit
`
`that restricts a value of a syntax element re ated to an
`
`transmitting unit rtat transmits the syntax element
`
`4_
`
`having the value restricted by the restricting unit.
`
`
`
`[\) (j‘:
`
`The restricting unit may /esigna.te O as a value of
`
`s1b laypr of a video uarameter set
`
`(VPS) and a value of a
`
`svntax element sps max sub layers minusl related to a sub
`
`

`

`The restricting unit further omits designation or a
`
`syntax element Profi le?r e—sentFlag related to calling of a
`
`profile tier level
`
`(profile tier level)
`
`in tie video
`
`barameter set and the sequence parameter set.
`
`The restricting unit in a video parameter may set
`a. a
`
`m d
`
`,3
`
`(:D
`
`(D
`(v95), m .y dasiVnate a protil
`
`m rr
`
`
`1IL
`the syntaz element vps max sub Meyers minusl related to
`
`lO
`
`the sub laver, and may designate a profile tier level
`
`(0,79s max sub layers minusl)
`
`(profile
`
` H (D a
`
`(D <.‘ (D ___.
`
`.4
`
`(J,vps max sub layers minusl)),
`
`311d in a sequence
`
`
`
`(protile tier level
`(J,V)), may designate the value
`
`
`
`(1,0)
`
`
`
`()1
`
`(I)
`
`The restricting unit may /es grate 0 as a value 0
`
`J'?1
`
`a syntax elejnt “Us num_nrd pdtdmztzrb related to a
`
`erence decoder in t
`
`:5
`
`a video parameter set
`
`The restricting unit may /es grate 0 as a value of
`
`a syntax element restricied ref sic lists flag related t
`
`a y sJ_ice: and a B slice in a sequente parameter set
`
`(SPD).
`
`The restricting unit may designate u as a value of
`
`a syntax element num_short
`
`term rs: pic sets related to a
`
`
`
`

`

`(“f {D "1:3
`
`,_J :5
`
`EU
`
`In :T' O a (‘1’
`D
`
`O C)
`
`(,0
`
`segue.Ce pa1:ameter set
`
`(FPS).
`
`
`
`The restricting unit may /esignate U as a value of
`
`a syntax el;m;nt long term_ ref pics present flag related
`
`to a long :erm in a se:1uence parameter: set
`
`(SP8)
`
`0 O [\) tr;
`
`nI
`The restricting unit may designate a as a value of
`
`a syntax alemeat svs temporal_mvp_ehable_flag related to
`
`a motion vector in a sequence parameter se
`
`t
`
`Z)
`
`10
`
`
`
`The res.riCtinq unit may designate O or 1 as a
`
`iex_ 10 _default_act'Je
`value of a syntax ele:/ent num_rer
`._.
`n
`minusl relatad to Lu and a valu: Oi a syntax element
`
`num ref idx l
`
`default_active minusl related to mi
`
`in a
`
`pictire parameter set
`
`(PPS).
`
`[QOZG]
`
`The restricting unit may designate u as a value of
`.J
`a syntax e;_ement scaling_list_pred_mode_flag related to a
`
`,(.
`.rediC t_en mode of a SCaling list of a scaling list
`
`(scaling list data ()) called by a sequence parameter set
`
`(515) and a picture parameter sst
`
`(PPS), and may
`
`designate O or i as a value of a syntax element
`
` s<:aling_ list _pred_matrix_id_
`
`in
`
`TO "4 G) r)
`
`.,_. Q ('1 a; 0 5
`
`matrix of the scaling list.
`
`The restrictin' unit may ’eS'gnate a var ue
`
`indicating an I slice as a value of a syntax element
`
`slice type related to a slj_Ce t_gpe in a slice header
`,M.
`N
`,(A,
`,
`\\
`(elite neadei a);u
`
`{0028]
`
`y-<
`The restricting unit may designate DR_W_TI or
`
`

`

`DR NMLP as a syntax element nal_unitlt7pe related to a
`
`Z)
`
`10
`
`The image processing device mav further include an
`
`eicoding unit that encodes image data using the syntax
`
`element having the value restricttd my the restristinc
`
`un"
`
`[0030]
`
`The image processing device mav fur her include a
`
`determining unit that ce e:rmi nes a profile of the image
`
`tin unit restricts the value of
`
`the syntax element relate d to the iitermimage process
`
`w1en the dete1mlnlna uniit de te1mines that the coodi_nr
`
`~ 4:
`\
`..
`3:,
`.
`'
`:-,'
`.
`.
`..'I.
`\
`.
`,
`\—
`1
`,
`1;:
`'.~ A
`1
`~
`N
`.
`process is periormec based on the prolile ior encoc' ig.
`
`the still image“
`
`
`
`.0031]
`
`Further, an aspect of the przasecnt
`
`t€CWQ)7)gy
`
`lies
`
`in an image processing method,
`
`izcluding: restricting a
`
`value of a syntax element re ated to an inter—image
`
`rrocess wash a codi he groces s is "erforrmed based on a
`
`profile for encoding a still image; and transnmitting the
`
`syntax element having the restricted value.
`
`[\) (j‘:
`
`uncther aspect of the present
`.1
`including:
`
`image progessia‘ device,
`
`technology lies in an
`l
`a receivin' unit that
`
`:5
`Eu
`m n.__x
`receives a transmitted cyn::x :iame t; and an analyzing
`
`unit that analyzes the S'ntaz element related to an
`
`
`
`intereimage process rec bred by the receiving unit in a
`
`state in which a value or the syatar element is
`
`
`
`restricted when a :oeii no prQCass is
`
`ed based on a
`
`

`

`Z)
`
`l0
`
`[\) (j‘:
`
`ll
`
`profile for encodinc a still image.
`
`The imaae processing device may further include a
`
`decoding unit that decodes encoded data obtai_ned by
`D :3 D
`0) L4] :5 Q (‘t O (/2 <1 3' (T Q) ><J D
`5.1) 5 k<1 N @ 0y
`excoding image 0. g; ('1 g;
`
`(‘t
`
`i;
`
`the analyzing unit.
`
`E‘OO34|
`
`The im
`
`DJ
`
`(D
`
`’73 H O k1 (D U} (A: [.4 5 L0
`
`oeVice may rurthsr include a
`
`detITlfilfig utxit that dete rmlqts whetier or not
`
`the value
`
`of the sjntaX element related to the .iitenwimage process
`
`. “eiaed by the rec:eivihg unit
`is properly restriced
`
`v'
`when the co oing process is pe ormwo oased on the profile
`
`
`
`uncther aspect or the present
`
`technology lies in an
`
`image progesfino mtthod,
`
`including:
`
`receiving a
`
`transmittei syztax element; and analyziha the receited
`
`syntax element related to an intermimage process in a
`
`state in which a value of the syntax element is
`
`restric2ed when a coding J-Odess is peer£<)rmed based on a
`
`profile for encoding a still image“
`
`E0036]
`
`P k1 Q 6 “j C (‘1 O 5.1)
`
`g: (/2 "Tfi
`
`Q ('1 O ”h the preLSGflt teeth“lJoj,
`
`a
`
`value of a syntax element related to an inter—image
`L
`,_J Q
`
`process is restricted when a sodir
`
`process is ferrormed
`
`based on a prorile
`
`or awnoding a still image; and the
`
`syita: element haviig tl: restricted val.ue is transmitted”
`
`EOOB/J
`
`According to another aspect of the present
`
`technology,
`
`a transmitted syntaX element is regeived; and
`
`the syntaX el_ement related to an Litermibag process
`
`

`

`12
`
`being received is analyzed in a state in which a van
`
`the syntax element is restricted when a coding pros ss is
`
`perfgrmed based on a prefile for enc ding a sti
`
`l image .,
`
`
`
`{Ef?ects of the _EninantLarfi
`
`Z)
`
`10
`
`resent disclos‘nre, it is possible
`According to the
`»‘
`—
`r
`A
`~
`1
`»'z-
`3
`I
`~/ V a »
`4 w’“‘
`"~ ~-
`-
`to encore ann icLOGc an image. Partieul ari',
`L is
`
`possijla to JQLULGL° a reduction in coding affigieacy.
`
`{Sriet Description of Drawiings
`
`1....1
`
`Fig.
`
`l is a diaagram for describing an exemplary
`
`cenfigura‘ion of a c’dirvg unit,
`
`Pig.
`
`2 is a diagrm for describing a tile.
`
`Fig,
`
`3 if a diagram r
`
`profile tier level
`
`(iretile tier EEVZE).
`
`Fig.
`
`4 is a diaagram illustrating an exemm'“rv video
`
`[arameter set
`
`(V;
`
`(/3
`
`A is a diagram illus rating an exemp=.ary
`
`seguente gar meter set
`
`(SP8).
`
`Fig.
`
`6 is a diagram illustrating an eiema'ary
`
`sequence parameter set
`
`(SP8),
`
`subsecidently to Fig. 3.
`
`3..
`Tulustrating a1wot.::r exemplary
`
`Fig.
`
`8 is a diagram illustrating another exemplary
`
`[\) (j‘:
`
`video parameter set
`
`(VPS)
`
`Pig.
`
`9 is a diagram illustratin'
`4..
`
`sequence parameter set
`
`(SP8).
`
`Fig. 10 is a diagram i
`
`
`
`aIwther
`
`sequence parameter set
`
`(SP8), subsequentlv to Fig. 9.
`
`Fi‘u ii is a diagran illustratin' still another
`4..
`
`exemplary video parameter set
`
`(VPs).
`
`

`

`Fig.
`
`1C is a diagram
`
`.‘
`.1
`.
`.._ .L. ..
`"I
`I
`:
`
`us trating
`
`sequence ma’amete
`
`is a diagram
`
`another
`
`paramete
`
`I 83
`
` , subsegu Ginqtly LO
`
`
`
`Dictire parameter set
`
`(PPS)
`
`diagram illustrating an
`
`is a
`
`
`
`set
`
`(PPS)
`
`diagram
`
`scaling list
`
`data (scaling list
`
`\\
`4.».
`Qde (/i.
`
`Fi
`
`u 17 is a diagram
`
`
`
`
`s.ma ntics of
`
`istrating an exemplary
`m
`matrix Q
`
`and a
`
`(Mat
`
`
`rixit).
`
`19 is a diagram
`
`ustrating another exemplary
`
`scaling list
`
`20
`
`Fig.
`A
`‘
`A
`slice neadei
`.
`
`W ©
`
`is a diagram
`/~."=
`.
`..
`,.
`\Slice header
`
`(scaling_list_data (
`
`w1..14...}-
`J
`)4
`H'.
`H)
`:11ill
`
`strating an exemg lary
`
` ing an
`
`slice header
`
`, subsequently to Fig. Zu.
`
`t
`
`H
`
`._
`.. .'.
`.
`,v.‘
`m
`sue equently to
`
`,
`
`”ustrating
`
`an exem%'*ry
`
`s'ice
`
`
`
`al'ocation t aal unit type.
`
`is a diagram
`
`for
`
`ie,'r1biqg an exemplary
`
`Region of
`
`(ROI)
`
`region.
`
`exemplary
`
`toriigirati'
`
`block
`
`diagram
`illustrating an
`-s
`1a.1
`f an imm
`ce codiig
`
`n O
`
`U / \,
`
`Q
`
`di
`
`agr
`
`am illustrating an
`
`lO
`
`[\) U
`
`

`

`14
`
`_‘l.'
`exemplary mai: configiration of a ”ossless encoding utit.
`
` is a flowchart for describing an exemfil
`
`Z)
`
` dlow
`flowchart for descri ing an exemciary flow
`
`
`
`
`rt for describing an exemolarv
`
`subsegu
`
`Fig. 30 is a flowchart for describing an
`
`flow a vnta/ el.ement setting process”
`1)
`Fig. 3l is a block diagram illustrating another
`
`10
`
`exemrtlary contignration ot an image coding device.
`
`flowchart for describing another
`
`exemolary liov of a coding process”
`
`Fig“ 33 is a flowchart for describing another
`
`:zemplary flow of a coding process, subsequently to Fig.
`
`32.
`
`Fig“ 34 is a block dieg‘ram illns trating an
`
`exemplary main t)rti nration of a; image CCudqu dewi3e‘
`
`Fig. 35 is a block diagram illustrating an
`
`:zemplary ma n ontio_TUT€ ition or a =os-less de,od ing nnii;.
`
`
`owchart for describing an o emolar;
`
`Eig. 36 is =
`
`flow of a djcoding process.
`
`flowchart tor describing an eXcTr ary
`
`
`
`;low or a decocing process,
`
`('D
`
`subs
`
`quently to Fig. 36 .
`
`[\) (j‘:
`
`Fid. 38 is a flowchart for describing an exemrtlary
`
`
`
`flow or a syntax element analysis :rocess.
`
`Fig, 3.
`
`18 a bl<ol diagram illustrating another
`
`eyeuplary configuration of an image decoding device.
`
`Fig. 40 is a block diag am il'ustTat ng another
`
`exemplary configuration oF a lossless decodiing unit.
`
`flowchart ior d3scribing another
`
`
`
`
`

`

`Z)
`
`10
`
`(j‘:
`
`C)
`
`[\) (j‘:
`
`(j‘:
`
`xemc
`
`i‘
`C: J.
`
`y
`
`»—
`7
`4: 1
`,1. 4.0% Q .
`
`
`
`a de
`coding process.
`a(J. flowchart
`1.. L._4 L532
`rlow of a decoci
`
`for describing another
`,_
`, ~ubveoterllv to
`
`J)
`43 is a flowchart
`
`
`for desc;
`_.it:ing an e”
`
`e mp la r
`
`\".2
`
`
`
`‘low 0.
`
`a syntax element inspection pr
`
`ocess.
`
`Fig. 44 is a diagram illustrating
`
`an BXGIflpl' ar},
`
`multiwview image codingschemew
`
`Fir, 45 is
`
`a diagram illustrating an exemplary main
`
`configuration of a multiwview image
`1
`
`coding
`
`device to
`
`which the present technology is
`.1
`Flt u
`
`46 is
`
`a
`
`diagram illus
`
`
`
`a T5 "Gplied.
`
`a.
`configuration of multimview imar
`
`e decoding device LO
`
`trating an exemplary main
`ii
`
`wiich the prest.ent
`i- Q
`Fig. 47 ”s
`
`(J.
`
`technology is
`
`ustrat‘
`d agram ill
`
`sca able image
`
`oding scheme
`
`Fig" 43 is a diagram for descr-
`
`
`
`
`
`Hg an BXGIflplEIV
`
` ibing an exemplar}
`
`coding,
`
`a diagram for de
`
`cribing an
`
`exemplary
`
`scalable coding.
`(p
`
`I_I_
`
`a diagram for
`
`descr
`
`scalable coding of a fignal to noise
`
`
`emplarg/
`
`ibing an
`4..
`ratio.
`
`Fig.
`
`i_ng an exemplary
`:1 ii a diagram illustr ati
`
`main
`
`deifigara ti on of a sea
`
`lable image coding device to which
`
`the pre:ent technolo)gv is applied“
`1:",u/
`
`_)
`r7}'i0.
`
`is a
`
`diagram i
`
`ting ‘an
`
`e )1c; 1",lr1.
`
`lsry ma
`
`in
`
`J
`“onTiodration of
`
`a b
`'alatle
`
`J
`moii n; device to
`
`L<
`which the present technclogv i
`
`Fig.
`
`block diagram
`
`illustr
`
`ating an
`
`exemplary
`
`LOLllN1ldtl’n of a
`
`computer‘
`
`dia
`
`ram illus
`
`

`

`[c configira
`
`iion Of a telev1_sj.on device.
`
`
`
`block diagrar il ustrating an
`
`
`
`
`
`55 is a
`
`schemat i
`
`Fig” 56 is a
`
`is a
`
`schemati
`
`Fin.” ., 58
`
`Z)
`
`10
`
`c configura;1en of a mobile telektone
`
`block C1agtam illustrating an
`
`
`
`exemplary schemat1
`c con?igura:1<3n of a
`
`"1 11<11
`recordin’/reproduc
`
`device.
`
`block die tam illustrating an
`
`‘:1en of an 1maaging dev i:ce.
`
`block diagram illustrating
`
`
`91
`
`O Q..0
`
`
`‘inc.
`
`\) >)
`
`>) O— 'JL8
`
`
`
`block diagram illustrating
`
`utilization
`
`e of scalable cocing.
`
`:T fD :1
`
`Q rt— 1..
`
`L__J
`
`1.. N D) r‘ 1..
`
`block diagram illustt1at1_ng Still
`:5 D X (l) d ”1 ._. r9
`
`r3
`:f scara31e coding.
`
`
`Out the invention]
`
`Herelnsr‘er,
`
`1mode-3
`
`(hereinafter, refer:
`
`@ CL
`
`iments“ ) of
`
`carrying
`
`be described.
`
`The diacriotiwt will
`
`ercoi
`v
`N j. l i
`
`Poll
`
`owing order.
`
`0. Overview
`
`1” First emb
`
`cdiment
`
`coding device)
`
`N . Second
`
`embodiment
`
`coding device)
`
`U)
`
`. Third emb
`
`odiment
`
`(image
`
`ecoding device)
`
`[\) (j:
`
`a Fourth en
`boriment
`
`(image decoding ievice)
`
`enb
`
`ima
`
`ediment
`
`(mul‘iwview image codi mg device
`
`ge :-<-d1ng dev13e)
`
`0. Sixth emb
`
`odiment
`
`(scaiable image coiing dev1,e
`
`and
`
`scalable image
`
`decoding devi ce)
`
`7“ Seventh e
`
`mbgdiment
`
`

`

`17
`
`9. Apelicatin
`
`examples of scalable
`
`Vi8l/7/\
`
`<Coding
`
`cheme>
`
`Z)
`
`10
`
`
` inafter,
`
`t
`
`be he present
`
`des criéed in connect
`
`coding and decoding
`
`ion with an application to image
`.2
`A
`'r'fiT'x
`oi a HhVL scheme.
`
`EOOM ]
`
`/\ Q 0. E4.
`
`H :3
`
`('f D"
`
`\V
`
`:5 LiZV 5 H r‘t‘
`a<;
`.
`l
`(1 sch
`
`eme,
`
`a hierarchical structure based
`
`on a macrrob ock and
`
`a sub macrobiock is defined. However,
`
`a macrrob (L
`
`is not optimal
`
`£0
`
`a larie
`
`an U_tra Higi
`
`Definition (UM
`
`(4000
`
`mg as a target of a
`
`
`
`generat_ 3n
`
`coding scheme,
`
`[0043]
`
`hdd,
`
`
`
`i
`WT=M 4-“,
`A Cu is arse r
`.
`7‘7
`\
`\
`‘
`’
`(GTE), and the “u is
`
`in the H?VC schrmr,
`:14 a
`,_
`
`(D Q.
`illustrat
`
`4..
`
`a coding
`.
`
`;_i
`
`'rrig4:
`
`.
`A.‘
`J.
`'I
`.
`i
`.
`eieirec. LO ab (3.
`
`coding tree blocK
`
`area of an image
`
`
`
`picti_e unit Adder 'aKing the same role of a mac.okiock in
`
`fixed to a size of 16 x 16
`
`ize 0”
`pixels, but a si
`
`10331181:
`
`1-5.
`
`not iixed and
`
`F\)
`
`(j‘:
`
`designated in image
`
`C OITLU T
`
`essicn information in each
`
`For example,
`
`a
`
`coding unit
`
`(LCU)
`
`$1.allest coding unit
`
`a CU are specified
`
`:5
`
`1.4n
`
`g,
`
`sequence parameter s
`
`et
`
`(SP3)
`
`G)
`idclud d in encoded data to
`
`0e output.
`
`

`

`18
`
`1
`.,
`J
`.
`”r
`.
`.,-.
`Km
`in set in & range lfi W iCh 83C!
`
`divided into figs havino a smaller size‘
`
`1; the example
`
`3
`
` is l28, and a largest
`[1
`scalable depth is J.
`
`;;s
`
`f‘.
`
`dfi_vided into CUs having a size or N x N servino as tLe
`
` hierarchy that is onewlevel
`
`lower when a value of
`
`split_flag is "la"
`
`10
`
`[004/]
`
`Further,
`
`
`a CU is divided in predict on units (PUs)
`
`that are arras (:artial areas of an image or a piC"ure
`
`UJiL> serving as processing units of intra or inter
`
`j
`t at
`
`prediction, and divided into transform units (TUs)
`Q H m w H m p) U}
`T Q fl F m l...‘ p H m p) 0
`
`N o
`
`f an image of a oigture unit)
`
`serving as proc.ssi1g units of
`
`looorl tr an;3forn.
`
`Currently,
`
`in the
`
`V” scheme, 16 x 16
`
`
`
` m m g\
`
`orthogonal
`
`transforms as well as 4
`
`X
`
`4 and 8
`
`X
`
`8 can be
`
`llSEd
`
`{0048]
`
`n the case of the coding scheme in which a CU is
`
`defined, and various kinds of processes are performed in
`
`units or CUs s1oh as the EEVC
`
`a Ticrcblosk in the
`
`
`1
`-»
`TT
`T
`—
`u,
`\.
`~
`~»
`~
`\,
`\
`~~f
`1
`1 ~
`-
`VvC scLe n1e can he considered to correspond to an hCu, and
`-
`1
`4
`/.~
`1.
`u.‘
`“A.
`'
`\
`V w‘fl
`.,
`1
`-,
`,~\
`,
`1»
`a»
`-
`a bloc
`\Lub bloc‘) can be con;iceled to corresponc LO a
`
`
`
`CU, Further,
`c1 (‘1
`c.Aeme can be considered to correspond to a PU. Here,
`
`a motion oomgensation block in the AVG
`
`since a CU has a bieranchical str1ct11..e,
`
`a size or an LCD
`
`or a topmost la/tr is commonly set to be lar’er than a
`
`macrob'ock in th: “7C scheme, Ear examgol’,
`
`such as
`
`12o nixels.
`
`[\) U
`
`1‘.J
`
`

`

`[0049]
`
`Tliugz, hereinafter, an TCU is assumed to inclACe a
`IV 7'l
`(
`_..
`
`is assumed to
`
`macrolock in the AVG scheme, and a
`r.
`l.
`include a block (sub block)
`
`Z)
`
`in the AVG scheme.
`In other
`s
`1’:L
`Hello15'
`{D '1 Q r": E—J. ’5 r1— :—‘ 5
`in the in L‘)
`
`
`
`indicates an arritrary cartial area in a picture, ane,
`
`for example,
`
`a size, shape, and Characteristics of a
`
`block are not
`
`limited“
`
`In other words,
`
`a w
`
`includes an ar itrary area (a processiig uiit
`
`SVCh as
`
`m
`
`10
`
`TU,
`
`a PU, an SC
`
`\‘
`
`U,
`
`a CU, an LOU,
`
`or a sliie, Of course,
`
`I’D (I)
`a "block" inglud.
`
`a macrcblock,
`a sub block,
`Q} H,_J \1
`
`other
`
`”art al area (processing unit) as well. When it is
`
`necessarv to limit a size,
`
`a processing unit, or
`
`_t will be approdiiatrlj desc:rib:d.
`
`<Mode selection>
`
`Meanwhile,
`
`in the AV“ and the WC ccd'ng schemes,
`
`ii order to achieve higher coding efficiency, it is
`__.
`to select an apprdariate predict.ion n10d_.
`
`important
`
`(‘5
`F”
`As an eXamIQle oi such a selection mataod, "her- is
`
`a method implemented in reference software (Opened at
`
`
`
`H.”f /MPEG—4 AVC called a _joint model
`
`(JM;.
`
`[\) (j‘:
`
`in the JM, it is possible to select two mode
`
`
`
`cost function values related to the respective prediction
`
`modes Mode are calculated, and a predicticn node having a
`
`smallest cost function value is se
`
`
`
`

`

`[\) C)
`
`mode for a correkppondi_ng block or a corresponding
`
`macrroblock
`
`r--: O 53]
`
`Z)
`
`A cost function in the hi:3h Ciomplexity mode is
`_‘
`
`represented as in the follOLVing Eormn1a (l):
`
`Hatiemitical Formula 1]
`._
`Cost<Mode E Q) = D + A*R
`
`...
`
`(l)
`
`{0055]
`
`Here, Q indicates a universa“ set of a candidate
`\
`mode ‘01 engoding a corresponding current block or a
`
`macroblccli, and D indicates dirierential energy between a
`S 3" xi,- :5
`
`deCoded image and an input
`
`ima
`
`(.2
`
`fD :3 Q Q
`
`d
`
`performed in a corresponding [:rediction mode.
`
`A
`
`irci cates Lagrange's undetermined multiplier given is a
`
`unction o? a quantization parameter.
`
`R indicates a
`
`total coding amount
`
`including an orthogonal transform
`
`cceffi.Ciient when encoding is performed in a corresponding
`
`H s O m T (D |)
`
`
`5: O M Q m V
`
`l. l“c O 1“, o
`r
`L
`'er to Jerrorm encooind in the
`
`nigh complexity mode,
`
`iC is necessary to perform a
`
`iemporary encoding process once by all candidate m<3des
`
`in
`
`order to calculate the parameters D and R, and thus a
`
`[\) (j‘:
`
`larger cowpitat on amou1t is reqi’iredu
`
`[0057]
`
`A cost function in
`
`
`low complexity mode is
`
`reprehented by the following Formula (2):
`
`[1058]
`
`[Mathematical Eormnla 2]
`
`dost<flcda e Q) = D + QEzgiant(flP‘*HefiderBit
`
`.1.
`
`(2)
`
`

`

`[\) H
`
`[0059]
`
`Here,
`
`D
`
`licates i’fferenc’al energy between
`
`i!)
`
`predicted image and an input
`
`image uriiike the high
`
`complexity mode. QPZFLantVQP)
`
`is given as a function of
`4..
`parameter QP, and HeaderBit indicates a
`
`Z)
`
` a guantiza
`
`coding amount related to infaimaton belonging to a
`
`header such as a motion vector or a mode including no
`
`10
`
`In other WOEdC,
`
`in the low camplexity mode, it is
`
`necessary to perform a oredicti on process for respective
`
`candidate m‘des, but since up to a decoded image is not
`
`necessary, it is unnecessary to perform up
`
`o a coding
`
`proces.. Thus, it can be iM l_emented with a computation
`
`amount smaller than that in the high complexity mode.
`
`Meanwhile,
`
`in ti: HEVC,
`
`a tile illustrated in Big.
`
`2 is specified as a unit of a para
`
`addition to a slice specified in the AVL.
`
`[006 2]
`
`4 4
`
`_ v
`
`p.
`
`5,
`
`:T
`
`{13 :5 l- Iis
`
`in
`
`m
`3..
`q_:j_;g
`
`of each tile are designated in
`
`image comp:ession inforznati
`
`and a decoding process can
`
`be independently performed on each tile.
`
`[\) (j‘:
`
`[Ofl63]
`
`<Stil : picture p'r‘of': :e>
`
`Further,
`
`in NonmPatent Document 2,
`
`the still
`
`pic.tu e prorile serving as the profile for using the h.VC
`
`as the still image codec is proposed“
`
`H)v~ver, generally,
`
`in the H3RIC,
`
`information that
`
`

`

`[\) [\3
`
`is transmitted from an encoding side to a decoding side
`
`includes syntax elements ior P slices and B slices,
`
`that
`
`is, swit
`
`elements related to an interwscreen proce5s as
`
`well as syntaxes for 1 slices,
`
`Z)
`
`[@065]
`
`bin<3e the still picture profile is the profile for
`
`exicoding and decoding still images, when this profile is
`
`
`
`applied,
`
`the above~ escrlbed syntax elements relatsd to
`
`the intermscreen presess are unnecessary,
`
`tte coding
`
`10
`
`etficiency is likely to ye lowered SlMIe unnecessary
`
`information is transmitted.
`
`[0066]
`
`In this regard,
`
`in the present
`
`Ft
`
`ecnnology, when the
`
`:odfl ng process is Oerform d t:a5t.ed on the profile f r
`
`exicoding the still imades, values 0
`
`svntax elements
`
`re ated to the inter“image process are restricted, and
`
`transn1ission of unnecessary information is suppressed.
`.1.
`As a result, it is possible to suppress a reduction in
`
`”eeific examples Oi
`
`the restriction will oe
`
`<O—l: Restriction of syntax element related
`
`to sub
`
`[\) (j‘:
`
`(A) C)
`
`Fig.
`
`a is a diagram illustrating an exemplary
`_‘lI
`syntax of a profile tier level
`
`(pro’ ile tier level())
`
`i1
`
`the HEVC. Numbers at the left end are given as line
`
`nu1bers ror description and not inclueed in an actna
`
`l...
`
`s'nta31 Similar v, numbers at the left end illustrated
`
`ii rigs.
`
`4
`
`to 23 which will be desejibed below ar- given
`
`

`

`(
`
`[\)
`
`as line numbers for description of figures and not
`
`actually included in
`
`iU
`
`syntax.
`
`A SVhtax element general profile_idc shown in a 5_
`‘1 H m H
` fit 6 6
`th line in the profile tf
`ofile_tier level())
`
`illustrated in Pic.
`
`3 specifies that a profile of a
`
`sequence (surreht sequence) or a processing tarqe; is a
`
`10
`
`p
`The profile tier level (profile tier_nevel()) of
`
`Fifi.
`
`3 is called my a "video parameter set
`
`(1P5:
`
`parameter set
`
`(Vic)
`
`in the ILVC. Figs,
`
`5 and o are
`
`diagrams illustrating an exemplary sequence parameter set
`
`(JFJ)
`
`in th? HEVd.
`
`
`
`Tnlustrated in Fig. 4,
`
`in the video parameter
`
`set
`
`(VPS),
`
`a protile tier level
`
`(Urotile tier level())
`
`in
`
`in the sequence parameter set
`D Q G) H
`x O
`r—4 (D e (D :—‘
`
`_.l
`
`L__J G)
`
`('1 {.1 (D H,
`
`3...!
`
`(0P0),
`x
`
`I»
`
`L4
`
`.3
`
`the profile tier
`
`('1 :3‘
`
`line is called”
`
`(j‘:
`
`C)
`
`[\) (j‘:
`
`:icture profi e,
`
`Here, Wien encoding is performed based Oh the still
`i
`l_l u < o k
`(_
`6 H U) D 0 fi (1) m T O H Cu |___I
`hear -
`
`depth (which
`
`14
`("f
`is also referreu o as a "sub laver")u In other worms,
`wl.'
`syntax elements related to the sub layer arp unnecessary.
`
`
`
`

`

`l\) .1;
`
`pictlre p10ofile is seeci:ie:d by the Sihta: element
`1.4 C). Q
`
`1... (T)
`gene1al p1ofi"
`
`T)
`
`1-::3 LI)
`y be designated as a value of a
`
`paramete1 vps max SD) layers mlAUSl
`
`(a 0”th line) 1elated
`
`to the gut: layer in the video par ameter 58L (YPS) oi hig,
`
`Z)
`
`sps max sub layers Wirusl
`
`(1 3—1d lint) 1el1ted Lo the
`
`10
`
`in Othe” wc1c:
`
`profile is the still
`
`
`sps_maX_ sub_laye18_minusl (ti: omrd line)
`
`relatec
`
`As a resuit, it is possible t prevent LrheCGSbarv
`
`Gertiens 01 t1: profile tier level
`
`(p10file_tie1 lemiel())
`
`=n othe1 w<31ds, it is 001Vl e to
`fIOh being read.
`"
`-
`3
`1
`-
`-1
`-.-
`1
`..
`.
`>1
`-1
`‘
`1.
`.
`i
`.
`.
`..
`-1
`.5
`-. A-
`p1event an ineredse in a lOad edus ed my the Leading an
`
`[\) (j‘:
`
`’73 (1; H. (1; e (‘1 r9 r1 r12
`
`D Q U!
`
`1.; r1
`
`kC
`
`’73 O U 0) L4] rr 1. r9
`
`to suppresr a 1eduction
`
`Fu1the1, as a 1esult, it is unnecessa1y to Ciahge
`
` the syntaXes of
`
`

`

`[\) (j‘:
`
`"rvvl()),
`
`
`the vifieo parameter :et
`
`(VET),
`
`and the seguense parameter set
`
`(VFW), and it is possibie
`
` .
`
`. 1.,“ 'I
`‘
`.
`,t
`f:
`'. i
`"A
`—
`‘
`,
`—
`-'
`.
`»»»»»»
`compatibili
`v With an en:oder and a decoder or a reiat,d
`
`Z)
`
`art that do not suono t the sti
`
`implemented by hardware,
`
`ther- ar- cases in whict it is
`
`10
`
`t
`diffitul, to update the syntax.
`
`A decrease in syntax
`
`compatiailiiy is litely ”0 reduce versatility. However,
`
`as desgribed above, when the values 0
`
`the syntax eiement
`
`
`
`are restricted by tie semantics, it is possible to
`
`maintain syntax compatibility anc prevent a reduction in
`
`versatility.
`
`[0078]
`
`Further, since the syntax compatibility is
`
`maiitained as described above,
`
`it is possible to easily
`
`aoplv a common syntax even to both encoding of stilt
`
`images and encoding of moving images, and thus it if
`
`Tossijla to easily implement an encoder and a recoder
`
`that process both a still image and a moving image
`
`through a common circuit.
`
`In other words, it car
`
`contribute to a size reduction or a device, suppression
`
`[\) (j‘:
`
`of an increase in cost, and the lire.
`
`«0“2: Restriction of syitax element related to
`
`Here, it is not
`
`1
`.
`1..
`impoSSible to implement sue: a
`
`restrigtion by changing the syntax.
`
`

`

`[\)
`
`(3“
`
`set
`
`(VP?) 0:
`
`the sequence parame e; set
`
`
`
`(SP8),
`
`a value of
`
`
`
`a syntax elam:nt
`
`:refilea PresentIiaj rel.ated to t};
`
`the time of the calling is consistentlv l.
`
`
`
`[0081]
`
`1.Ii
`
`4‘
`1'10 ('
`'he: words, it is redundant
`
`to transmit this
`
`
`
`syntax element, Further, an if statement of a 2mnd li_ne
`
`10
`
`',__.u
`of the prefi. e tier level (utotile tier level()) 0:
`'3.J
`
`is unnetlasary as well.
`
`(lie.
`
`I; this regard,
`
`the syntax of the pr file tier
`
`_evel (ptefile tier levelxi) of Fig,
`
`3 may he changed as
`
`in a1 example illustrated in Fig, 7,
`
`the syntax of the
`
`video parameter set
`
`(VPS) of Fig.
`
`4 may be (:hanged as in
`
`an example illustrated in liq” 8, and the syntax of the
`
`(j‘:
`
`C)
`
`l
`
`Lu
`
`(profile tier level()) may be designated by designating
`O “3 H L<I
`(/1 5 \‘f 9) ><J
`m ".1 35 (“l 3 Q) L: wubLayersMinusl related to
`,_2 e
`
`the sub layer as in the example: oi Fifi.
`
`7
`
`(a i—st ill
`
`
`
`
`
`[\) (j‘:
`
`lig.
`
`8
`
`(a 7—th line)i and Fig.
`
`K)
`
`(a 5—th line) without
`
`desigrw.Ling the synta:< element ProfilelresentFlagl
`
`PtofilePresentFlag may be omitted‘
`
`

`

`"-1
`
`[\)
`
`.---1 Q C) m (’1 L_.
`
`
`
`As a result, it is poossible to prevent transmission
`
`of an inaeee”sarv [arameter and su:"ress a reduction in
`
`J
`:Odi n0 efficiency. Further, it is possible to suppress
`
`an j.1’1(_,l.<3as€: load of ti: process of reading the
`
`proti
`
`e tier levei
`
`(profile ti;r_lev.l()) which is caused
`
`bv the reading of ’mle unhe L:esssary 1: statemzrt.
`
`In other words
`
`tte value of the svntaX
`
`
`
`Prciti_e:resentFlag related to the cal
`
`tier level may have to be iixed to l.
`
`[0087:
`
`<Om3: Restriction of syntaX element
`
`H ill ('1 \I. 0..
`
`F1 0
`
`(D
`
`(T E—J. O
`
`.0 x78
`L...|‘_>
`
`
`
`In the above method, when the syntax element
`/
`max sub 'ayers minisl related to the sub layer is encoded,
`‘0 (D H by O [K a CL
`a setti p-s
`rr 0 64 fl)
`
`1g
`
`x-‘-- Q, U}
`1‘
`
`after detectiiig lA"UYmd+lOl
`
`as to whether or not encoding is performed based on the
`
`still picture profile in a subsequent profile tier "eve
`
`(profilemtiermlevti(>).
`
`[0088]
`
`In this regard,
`
`

This document is available on Docket Alarm but you must sign up to view it.


Or .

Accessing this document will incur an additional charge of $.

After purchase, you can access this document again without charge.

Accept $ Charge
throbber

Still Working On It

This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.

Give it another minute or two to complete, and then try the refresh button.

throbber

A few More Minutes ... Still Working

It can take up to 5 minutes for us to download a document if the court servers are running slowly.

Thank you for your continued patience.

This document could not be displayed.

We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.

Your account does not support viewing this document.

You need a Paid Account to view this document. Click here to change your account type.

Your account does not support viewing this document.

Set your membership status to view this document.

With a Docket Alarm membership, you'll get a whole lot more, including:

  • Up-to-date information for this case.
  • Email alerts whenever there is an update.
  • Full text search for other cases.
  • Get email alerts whenever a new case matches your search.

Become a Member

One Moment Please

The filing “” is large (MB) and is being downloaded.

Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.

Your document is on its way!

If you do not receive the document in five minutes, contact support at support@docketalarm.com.

Sealed Document

We are unable to display this document, it may be under a court ordered seal.

If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.


Access Government Site

We are redirecting you
to a mobile optimized page.





Document Unreadable or Corrupt

Refresh this Document
Go to the Docket

We are unable to display this document.

Refresh this Document
Go to the Docket