`
`I, the~un$e£signedw rasidimg at afa>HGfiYAKU'CE§TER.IRC.,IMita
`
`ME Bldg.?F, 3w13~12 Mita, Minatomku, Tokym lfiSwGOVE, Japan,
`
`dm balieve that I am sufficiantly proficient in xaading and
`
`writing both Sayanase and English, and déclaxa that I have
`
`@repaxed the English txanslatiens af JF2G12~263811
`
`and
`
`J?2613~9Q23?? and that said.tran$1atian.are true and corraet
`
`ta the best uf my knawladg% anfl belief:
`
`Dated this 23rd day of February, 2015
`
`1/
`Name: /1/,
`
`ff
`V/
`“/L)‘;
`Masahiko Minamimato
`
`.
`
`Genaral Manager
`
`
`
`30,
`
`01
`
`Jr
`.,).L,u
`
`C1,}
`
`{Inventor}
`
`{Address}
`
`c/o Sony Corpora ion
`
`l~7~i, KOH&H,
`
`Minatomku, Tokyo
`
`[Name
`
`Kazushi SATO
`
`{fpplicanu
`
`E13 No“;
`
`000002185
`
`{Name}
`
`Fony COLpOI&thD
`
`{Agenifi
`
`E1D Nc.§
`
`1000121“1
`
`[Af;:orney§
`
`[Name }
`
`Yoshio INAMOTO
`
`EnsviqrndAgent]
`
`[ID No.}
`
`100121111
`
`EALt.,rney§
`
`[11ame3
`
`{TEL}
`
`[Contact
`
`Iakashi NISHlKAwA
`
`
`
`{Lpplication Fees]
`
`{Prepayment No E
`
`005094
`
`[Amount Paid]
`
`15,000 yet
`
`{List of Document Attacheuci}
`
`{Name of Focument}
`
`Specification
`
`[Name of Locument}
`
`[Name OL‘ 2
`
`Q‘w“irm,1L}
`
`I
`
`
`
`[Name 0: Document}
`
`DrdwiLIS
`
`
`
`10
`
`‘n_J U1.
`
`20
`
`xx
`
`(I!
`
`30
`
`
`
`[General P
`
`Attorney No.1
`
`{General P
`
`Attorney $0.}
`
`9708842
`
`0705257
`
`
`
`(A21
`
`dG DEVICE AND METHOD
`
`The present disclosure relates to an ima;eU)
`L;
`processing device and method, and more b3rticularly, an
`
`image processing i.vice and method which are capable of
`
`supgressing a reduction in coding efficiency.
`
`
`
`
`
`I)
`
`l
`
`0
`
`(j‘:
`
`(j‘:
`
`1‘.J
`
`In rec:ent ye3rs,
`
`ior the purpose of digitaiizihg
`
`image information and transmitting and acc1rmlating
`
`infarmation at high efficiency at that time, devices that
`
`compress and encode images by using image informatioiw
`
`speci‘ic redundancy em;loying a coding scheme that
`
`performs compress*or through an orthogonal
`
`transform suc:
`
`
`
`as a disgrete cosine transform and motitn compensation
`
`have been spr-ad. As such a coding sche.¢ for example
`
`there is Movint Pictu e Experts Group (MERGE.
`
`C)
`
`{0003]
`
`Particularly, MPEG 9
`
`(TSJ/TPC 13818"?)
`
`is a
`
`standard tlat is defined as a geaer.impuroos- image
`{L P. ?
`
`scheme, and covers interlaced scan images,
`
`progressive scan images, s”3ndard resolution images, and
`7—.
`1“
`
`high def'nition images.
`
`
`
`
`or example, MPEG 2 is currently
`
`being widely used for a wide range of agolicatioas such
`
`as arohtssi<qal use and consumer use. Using the
`I) 0 ;3 ’D 3 ’D V
`<_ O:3 ’U H (D U) (I) H. O :5
`
`for example,
`
`in the case or an
`
`
`
`1.; S (D H, i4 S3) 0 (D CL
`
`scan image of 3 standard resolutior having 720
`
`x 480 pintis,
`a coding amount
`(bit rate) or
`4 Mbps to 8
`1“ (it)
`? (‘5 O U;
`DJ ._.
`,__J ocatn.d, Eurther, using the MPEG 2 compressior
`
`
`
`the
`
`Z)
`
`10
`
`allocated. Thus, it is possible to
`N.x.-
`
`ampression rate and an excellent
`
`image quality”
`
`[000 ]
`
` MLEG 2 is mainly intended for high definition
`
`
`coding suitable to: broadcasting but does not sipport a
`
`codino scheme raving a coding amount
`
`(bit rate)
`
`lOVJI
`
`MPEG 1,
`
`that is,
`
`a codingchene of a hi
`
`comcression rate. With the sgoread oi mobile terminals,
`
`the need tor s1c1 a coding schsmn is C013 idered to be
`
`increased in the future, and thus an MPEG 4 coding scheme
`1
`
`has been stanctardized‘
`
`l; conneC1tion with an image
`
`coding scheme, an inteIrationai standard thereof has b.
`
`
`approved as ISO/13C 14496—2 in December, 1998
`
`{0005]
`
`Further,
`
`in recent years, standardi7ation of a
`
`stanfiard such as H.2”L (International Telecommunication
`
`Unio: Telecommunicatio I1 Standardization Sector Qé/
`
`’“J C“
`
`Vi/eo Gating E pert Group (IlUwT Q6/l6 TCEG),
`I:I.I
`4.
`_
`'
`1
`.
`’U c a O o m (D 0
`ior Viceo conference has been
`
`for the
`
`image :oM
`
`conducted. H.26L eotrres a larger computation amount
`
`‘or coding and decoding than i: an eXistiig coding scheme
`
`[\) (j‘:
`
`
`sueh as MPEG 2 or MPEG 4, but is known to implement
`
`Qo
`
`k
`ill (Ila/37‘
`
`dng etticiencg.
`
`Pu ther, currently, as one of
`
`activities of MPEG 4, standardization of inco.p(“a ing
`
`even a function that is not supported in H.26L and
`
`imclemeniing higher coding e“ti citncv based on H,26T has
`
`been berrormed as a Joint Model of Enhanced_Compression
`
`Video Coding.
`
`
`
`(I!
`
`SPBSllEBWQOO
`
`[0006]
`
`Us a ScandafidLSRlIon schedule, an interracicial
`
`standsrd Jailed ii 264 and M‘EG”- PartiO Advanced Video
`
`Coding, ner€iiafter
`
`referr_ed to as AVG) has bee IL
`
`5
`
`established
`
`
`
`March, 2003
`
`[ JO.)"]
`
`Furrhermore, as an extension of H.264/AVC, Fidelity
`
`Range LXteJSlOJ
`
`(EPEXC)
`
`including an encoding tool
`
`necessary for professional use such as RFB or 4:2:2 or
`
`10
`
`4:4:4 or 8x8 DCT and a Quantization matrix whi3h are
`
`
`if,fliled in MJEfi—Z las bee; stalcardzed in February,
`
`2005. As a
`
`esult,
`
`the H 764/AJC
`
`has beeome a cgding
`
`s<3hehe capable of also
`1
`1
`W G i. ,J.
`
`in a momi_e
`
`expressing a film noise
`
`and is being used in a wide range of
`
`»4
`included
`
`
`15 Dollations SUlCh as a Blu—Ray Disc (a trademark),
`
`
`
`in regen: years,
`
`there is an increasing
`
`[JOJS]
`
`However,
`
`
`
`need for fur:hjr high compression rate coding capable of
`
`compressing an image of about 4000 x 2000
`
`
`
`.s which
`
`20
`
`ar
`
`four times as high as a hi gl1——de?inition image or
`
`wdefinitigz image
`
` _imited
`
`transmission
`
`en T .l_|_.
`
`nment
`
`such as the liiter.netu
`
`ITI ,,\
`lo
`
`this
`
`end, an improvement
`
`in codiig efficiency has been
`
`
`under cont'i nuous review by/ideo Mo _ig Expert Gro up
`
`25
`
`
`(VCEG) under ITU-T,
`
`i0009]
`
`In this redar , currenth,
`
`in order to further
`
`improve cor ing effiCienC.y to be higher than in the IVC,
`
`stand li2itIon of a coding scheme called High
`
`
`
`
`
`30 V”deo Coding (HEVC)
`
`1&8 been beingr onducted by Joint
`
`Collaboration Teammvideo Coding ICmMW‘ which is a uoiit
`
`
`
`
`
`(see NonmPatent Doctwent l).
`
`Z)
`
`[3010]
`
`GeIierally,
`
`in the HEVC,
`
`information that is
`
`transmitted “ r1om an encodin
`
`LQ
`
`rile to a decoding side
`
`n clUdes syntax element s for P slices and B slices,
`{.1 :5 r‘ (D “i
`"Te N O "a
`res lete Q Ft 0 DJ
`
`is, syntax ele=,ments
`
`'1 C) H n) (D
`
`that
`C
`
`(I)
`
`S). 0)
`
`10
`
`well as syntaxes for 1 slice:.
`
`[0011]
`
`Neahwhile a still picture profile serving as a
`
`profile for using the Hivt as a still image codec has
`
`(D (u :5
`
`oroposjd (for exlmnl- sea NonmPatent Document 2)”
`
`{0‘O ,_\ 2'l
`
`since the still picture profile is a profile for
`|__ *5 (2
`encoding and dec d’
`
`still images, when this prorile is
`
`applied,
` related t tie intermscreen
`
`"G a O 03655 Br, unnecessary.
`
`{Prior Art Documents]
`‘
`[NonwEatent Documents]
`
`I“III.
`
`NonmE‘atent Document 1] Benjamin Bross, WoOEJin Han,
`
`Jens—Rainer Ohm, Gary J. Sullivarl, Thomas Wiegsnd, "Iigh
`
`[\) (j:
`
`eifio
`
`8," JC
`
`Codino J
`
`‘iiicalio- l raft
`
`Team 3n Video
`
`TCl/SC2f3/ACll, 10th Meeting: Stock 1H0 m, SE, 11 20 Jnlv
`
`2012
`
`[Honwflutent Docuiei‘ z] Kemal Ugur, Jani Leinema, Misra
`xrr~_ -nq3'—I,/
`"On still picture profile," JC'JL_ --JUU;
`
`Haniuksela,
`
`
`
`Joint Collaborative Team on Video Logiro (JCT VC) of ITUM
`
`T SGlG WEB and ESQ/T C JTCl/SCZg/WGlllOth Meeting:
`
`
`
`Z)
`
`Howe‘vfer,
`
`in the case of the methor disclosed in
`
`p-s
`Hoanatent Docam~nt 2, coitrol on the syntax elements
`
`related to the intermscreen process is not pech<3rmed
`
`10
`
`Thus,
`
`the coding eff1c1ency is "iteny to Be lowered since
`
`ur1necessary information is thalsmlf-ed.
`
`:--1 0015]
`
`The present disclosure was made in light of the
`
`for,u01ng, and it is desirable to be caeable of
`
`sun ress1ng a reductioi in coding efficiency.
`
`[Means for aolvinc the Problems}
`
`A; aspect of the present technology lies in a1
`
`image processinc device,
`
`including:
`
`a TQrTElCTqu unit
`
`that restricts a value of a syntax element re ated to an
`
`transmitting unit rtat transmits the syntax element
`
`4_
`
`having the value restricted by the restricting unit.
`
`
`
`[\) (j‘:
`
`The restricting unit may /esigna.te O as a value of
`
`s1b laypr of a video uarameter set
`
`(VPS) and a value of a
`
`svntax element sps max sub layers minusl related to a sub
`
`
`
`The restricting unit further omits designation or a
`
`syntax element Profi le?r e—sentFlag related to calling of a
`
`profile tier level
`
`(profile tier level)
`
`in tie video
`
`barameter set and the sequence parameter set.
`
`The restricting unit in a video parameter may set
`a. a
`
`m d
`
`,3
`
`(:D
`
`(D
`(v95), m .y dasiVnate a protil
`
`m rr
`
`
`1IL
`the syntaz element vps max sub Meyers minusl related to
`
`lO
`
`the sub laver, and may designate a profile tier level
`
`(0,79s max sub layers minusl)
`
`(profile
`
` H (D a
`
`(D <.‘ (D ___.
`
`.4
`
`(J,vps max sub layers minusl)),
`
`311d in a sequence
`
`
`
`(protile tier level
`(J,V)), may designate the value
`
`
`
`(1,0)
`
`
`
`()1
`
`(I)
`
`The restricting unit may /es grate 0 as a value 0
`
`J'?1
`
`a syntax elejnt “Us num_nrd pdtdmztzrb related to a
`
`erence decoder in t
`
`:5
`
`a video parameter set
`
`The restricting unit may /es grate 0 as a value of
`
`a syntax element restricied ref sic lists flag related t
`
`a y sJ_ice: and a B slice in a sequente parameter set
`
`(SPD).
`
`The restricting unit may designate u as a value of
`
`a syntax element num_short
`
`term rs: pic sets related to a
`
`
`
`
`
`(“f {D "1:3
`
`,_J :5
`
`EU
`
`In :T' O a (‘1’
`D
`
`O C)
`
`(,0
`
`segue.Ce pa1:ameter set
`
`(FPS).
`
`
`
`The restricting unit may /esignate U as a value of
`
`a syntax el;m;nt long term_ ref pics present flag related
`
`to a long :erm in a se:1uence parameter: set
`
`(SP8)
`
`0 O [\) tr;
`
`nI
`The restricting unit may designate a as a value of
`
`a syntax alemeat svs temporal_mvp_ehable_flag related to
`
`a motion vector in a sequence parameter se
`
`t
`
`Z)
`
`10
`
`
`
`The res.riCtinq unit may designate O or 1 as a
`
`iex_ 10 _default_act'Je
`value of a syntax ele:/ent num_rer
`._.
`n
`minusl relatad to Lu and a valu: Oi a syntax element
`
`num ref idx l
`
`default_active minusl related to mi
`
`in a
`
`pictire parameter set
`
`(PPS).
`
`[QOZG]
`
`The restricting unit may designate u as a value of
`.J
`a syntax e;_ement scaling_list_pred_mode_flag related to a
`
`,(.
`.rediC t_en mode of a SCaling list of a scaling list
`
`(scaling list data ()) called by a sequence parameter set
`
`(515) and a picture parameter sst
`
`(PPS), and may
`
`designate O or i as a value of a syntax element
`
` s<:aling_ list _pred_matrix_id_
`
`in
`
`TO "4 G) r)
`
`.,_. Q ('1 a; 0 5
`
`matrix of the scaling list.
`
`The restrictin' unit may ’eS'gnate a var ue
`
`indicating an I slice as a value of a syntax element
`
`slice type related to a slj_Ce t_gpe in a slice header
`,M.
`N
`,(A,
`,
`\\
`(elite neadei a);u
`
`{0028]
`
`y-<
`The restricting unit may designate DR_W_TI or
`
`
`
`DR NMLP as a syntax element nal_unitlt7pe related to a
`
`Z)
`
`10
`
`The image processing device mav further include an
`
`eicoding unit that encodes image data using the syntax
`
`element having the value restricttd my the restristinc
`
`un"
`
`[0030]
`
`The image processing device mav fur her include a
`
`determining unit that ce e:rmi nes a profile of the image
`
`tin unit restricts the value of
`
`the syntax element relate d to the iitermimage process
`
`w1en the dete1mlnlna uniit de te1mines that the coodi_nr
`
`~ 4:
`\
`..
`3:,
`.
`'
`:-,'
`.
`.
`..'I.
`\
`.
`,
`\—
`1
`,
`1;:
`'.~ A
`1
`~
`N
`.
`process is periormec based on the prolile ior encoc' ig.
`
`the still image“
`
`
`
`.0031]
`
`Further, an aspect of the przasecnt
`
`t€CWQ)7)gy
`
`lies
`
`in an image processing method,
`
`izcluding: restricting a
`
`value of a syntax element re ated to an inter—image
`
`rrocess wash a codi he groces s is "erforrmed based on a
`
`profile for encoding a still image; and transnmitting the
`
`syntax element having the restricted value.
`
`[\) (j‘:
`
`uncther aspect of the present
`.1
`including:
`
`image progessia‘ device,
`
`technology lies in an
`l
`a receivin' unit that
`
`:5
`Eu
`m n.__x
`receives a transmitted cyn::x :iame t; and an analyzing
`
`unit that analyzes the S'ntaz element related to an
`
`
`
`intereimage process rec bred by the receiving unit in a
`
`state in which a value or the syatar element is
`
`
`
`restricted when a :oeii no prQCass is
`
`ed based on a
`
`
`
`Z)
`
`l0
`
`[\) (j‘:
`
`ll
`
`profile for encodinc a still image.
`
`The imaae processing device may further include a
`
`decoding unit that decodes encoded data obtai_ned by
`D :3 D
`0) L4] :5 Q (‘t O (/2 <1 3' (T Q) ><J D
`5.1) 5 k<1 N @ 0y
`excoding image 0. g; ('1 g;
`
`(‘t
`
`i;
`
`the analyzing unit.
`
`E‘OO34|
`
`The im
`
`DJ
`
`(D
`
`’73 H O k1 (D U} (A: [.4 5 L0
`
`oeVice may rurthsr include a
`
`detITlfilfig utxit that dete rmlqts whetier or not
`
`the value
`
`of the sjntaX element related to the .iitenwimage process
`
`. “eiaed by the rec:eivihg unit
`is properly restriced
`
`v'
`when the co oing process is pe ormwo oased on the profile
`
`
`
`uncther aspect or the present
`
`technology lies in an
`
`image progesfino mtthod,
`
`including:
`
`receiving a
`
`transmittei syztax element; and analyziha the receited
`
`syntax element related to an intermimage process in a
`
`state in which a value of the syntax element is
`
`restric2ed when a coding J-Odess is peer£<)rmed based on a
`
`profile for encoding a still image“
`
`E0036]
`
`P k1 Q 6 “j C (‘1 O 5.1)
`
`g: (/2 "Tfi
`
`Q ('1 O ”h the preLSGflt teeth“lJoj,
`
`a
`
`value of a syntax element related to an inter—image
`L
`,_J Q
`
`process is restricted when a sodir
`
`process is ferrormed
`
`based on a prorile
`
`or awnoding a still image; and the
`
`syita: element haviig tl: restricted val.ue is transmitted”
`
`EOOB/J
`
`According to another aspect of the present
`
`technology,
`
`a transmitted syntaX element is regeived; and
`
`the syntaX el_ement related to an Litermibag process
`
`
`
`12
`
`being received is analyzed in a state in which a van
`
`the syntax element is restricted when a coding pros ss is
`
`perfgrmed based on a prefile for enc ding a sti
`
`l image .,
`
`
`
`{Ef?ects of the _EninantLarfi
`
`Z)
`
`10
`
`resent disclos‘nre, it is possible
`According to the
`»‘
`—
`r
`A
`~
`1
`»'z-
`3
`I
`~/ V a »
`4 w’“‘
`"~ ~-
`-
`to encore ann icLOGc an image. Partieul ari',
`L is
`
`possijla to JQLULGL° a reduction in coding affigieacy.
`
`{Sriet Description of Drawiings
`
`1....1
`
`Fig.
`
`l is a diaagram for describing an exemplary
`
`cenfigura‘ion of a c’dirvg unit,
`
`Pig.
`
`2 is a diagrm for describing a tile.
`
`Fig,
`
`3 if a diagram r
`
`profile tier level
`
`(iretile tier EEVZE).
`
`Fig.
`
`4 is a diaagram illustrating an exemm'“rv video
`
`[arameter set
`
`(V;
`
`(/3
`
`A is a diagram illus rating an exemp=.ary
`
`seguente gar meter set
`
`(SP8).
`
`Fig.
`
`6 is a diagram illustrating an eiema'ary
`
`sequence parameter set
`
`(SP8),
`
`subsecidently to Fig. 3.
`
`3..
`Tulustrating a1wot.::r exemplary
`
`Fig.
`
`8 is a diagram illustrating another exemplary
`
`[\) (j‘:
`
`video parameter set
`
`(VPS)
`
`Pig.
`
`9 is a diagram illustratin'
`4..
`
`sequence parameter set
`
`(SP8).
`
`Fig. 10 is a diagram i
`
`
`
`aIwther
`
`sequence parameter set
`
`(SP8), subsequentlv to Fig. 9.
`
`Fi‘u ii is a diagran illustratin' still another
`4..
`
`exemplary video parameter set
`
`(VPs).
`
`
`
`Fig.
`
`1C is a diagram
`
`.‘
`.1
`.
`.._ .L. ..
`"I
`I
`:
`
`us trating
`
`sequence ma’amete
`
`is a diagram
`
`another
`
`paramete
`
`I 83
`
` , subsegu Ginqtly LO
`
`
`
`Dictire parameter set
`
`(PPS)
`
`diagram illustrating an
`
`is a
`
`
`
`set
`
`(PPS)
`
`diagram
`
`scaling list
`
`data (scaling list
`
`\\
`4.».
`Qde (/i.
`
`Fi
`
`u 17 is a diagram
`
`
`
`
`s.ma ntics of
`
`istrating an exemplary
`m
`matrix Q
`
`and a
`
`(Mat
`
`
`rixit).
`
`19 is a diagram
`
`ustrating another exemplary
`
`scaling list
`
`20
`
`Fig.
`A
`‘
`A
`slice neadei
`.
`
`W ©
`
`is a diagram
`/~."=
`.
`..
`,.
`\Slice header
`
`(scaling_list_data (
`
`w1..14...}-
`J
`)4
`H'.
`H)
`:11ill
`
`strating an exemg lary
`
` ing an
`
`slice header
`
`, subsequently to Fig. Zu.
`
`t
`
`H
`
`._
`.. .'.
`.
`,v.‘
`m
`sue equently to
`
`,
`
`”ustrating
`
`an exem%'*ry
`
`s'ice
`
`
`
`al'ocation t aal unit type.
`
`is a diagram
`
`for
`
`ie,'r1biqg an exemplary
`
`Region of
`
`(ROI)
`
`region.
`
`exemplary
`
`toriigirati'
`
`block
`
`diagram
`illustrating an
`-s
`1a.1
`f an imm
`ce codiig
`
`n O
`
`U / \,
`
`Q
`
`di
`
`agr
`
`am illustrating an
`
`lO
`
`[\) U
`
`
`
`14
`
`_‘l.'
`exemplary mai: configiration of a ”ossless encoding utit.
`
` is a flowchart for describing an exemfil
`
`Z)
`
` dlow
`flowchart for descri ing an exemciary flow
`
`
`
`
`rt for describing an exemolarv
`
`subsegu
`
`Fig. 30 is a flowchart for describing an
`
`flow a vnta/ el.ement setting process”
`1)
`Fig. 3l is a block diagram illustrating another
`
`10
`
`exemrtlary contignration ot an image coding device.
`
`flowchart for describing another
`
`exemolary liov of a coding process”
`
`Fig“ 33 is a flowchart for describing another
`
`:zemplary flow of a coding process, subsequently to Fig.
`
`32.
`
`Fig“ 34 is a block dieg‘ram illns trating an
`
`exemplary main t)rti nration of a; image CCudqu dewi3e‘
`
`Fig. 35 is a block diagram illustrating an
`
`:zemplary ma n ontio_TUT€ ition or a =os-less de,od ing nnii;.
`
`
`owchart for describing an o emolar;
`
`Eig. 36 is =
`
`flow of a djcoding process.
`
`flowchart tor describing an eXcTr ary
`
`
`
`;low or a decocing process,
`
`('D
`
`subs
`
`quently to Fig. 36 .
`
`[\) (j‘:
`
`Fid. 38 is a flowchart for describing an exemrtlary
`
`
`
`flow or a syntax element analysis :rocess.
`
`Fig, 3.
`
`18 a bl<ol diagram illustrating another
`
`eyeuplary configuration of an image decoding device.
`
`Fig. 40 is a block diag am il'ustTat ng another
`
`exemplary configuration oF a lossless decodiing unit.
`
`flowchart ior d3scribing another
`
`
`
`
`
`
`Z)
`
`10
`
`(j‘:
`
`C)
`
`[\) (j‘:
`
`(j‘:
`
`xemc
`
`i‘
`C: J.
`
`y
`
`»—
`7
`4: 1
`,1. 4.0% Q .
`
`
`
`a de
`coding process.
`a(J. flowchart
`1.. L._4 L532
`rlow of a decoci
`
`for describing another
`,_
`, ~ubveoterllv to
`
`J)
`43 is a flowchart
`
`
`for desc;
`_.it:ing an e”
`
`e mp la r
`
`\".2
`
`
`
`‘low 0.
`
`a syntax element inspection pr
`
`ocess.
`
`Fig. 44 is a diagram illustrating
`
`an BXGIflpl' ar},
`
`multiwview image codingschemew
`
`Fir, 45 is
`
`a diagram illustrating an exemplary main
`
`configuration of a multiwview image
`1
`
`coding
`
`device to
`
`which the present technology is
`.1
`Flt u
`
`46 is
`
`a
`
`diagram illus
`
`
`
`a T5 "Gplied.
`
`a.
`configuration of multimview imar
`
`e decoding device LO
`
`trating an exemplary main
`ii
`
`wiich the prest.ent
`i- Q
`Fig. 47 ”s
`
`(J.
`
`technology is
`
`ustrat‘
`d agram ill
`
`sca able image
`
`oding scheme
`
`Fig" 43 is a diagram for descr-
`
`
`
`
`
`Hg an BXGIflplEIV
`
` ibing an exemplar}
`
`coding,
`
`a diagram for de
`
`cribing an
`
`exemplary
`
`scalable coding.
`(p
`
`I_I_
`
`a diagram for
`
`descr
`
`scalable coding of a fignal to noise
`
`
`emplarg/
`
`ibing an
`4..
`ratio.
`
`Fig.
`
`i_ng an exemplary
`:1 ii a diagram illustr ati
`
`main
`
`deifigara ti on of a sea
`
`lable image coding device to which
`
`the pre:ent technolo)gv is applied“
`1:",u/
`
`_)
`r7}'i0.
`
`is a
`
`diagram i
`
`ting ‘an
`
`e )1c; 1",lr1.
`
`lsry ma
`
`in
`
`J
`“onTiodration of
`
`a b
`'alatle
`
`J
`moii n; device to
`
`L<
`which the present technclogv i
`
`Fig.
`
`block diagram
`
`illustr
`
`ating an
`
`exemplary
`
`LOLllN1ldtl’n of a
`
`computer‘
`
`dia
`
`ram illus
`
`
`
`[c configira
`
`iion Of a telev1_sj.on device.
`
`
`
`block diagrar il ustrating an
`
`
`
`
`
`55 is a
`
`schemat i
`
`Fig” 56 is a
`
`is a
`
`schemati
`
`Fin.” ., 58
`
`Z)
`
`10
`
`c configura;1en of a mobile telektone
`
`block C1agtam illustrating an
`
`
`
`exemplary schemat1
`c con?igura:1<3n of a
`
`"1 11<11
`recordin’/reproduc
`
`device.
`
`block die tam illustrating an
`
`‘:1en of an 1maaging dev i:ce.
`
`block diagram illustrating
`
`
`91
`
`O Q..0
`
`
`‘inc.
`
`\) >)
`
`>) O— 'JL8
`
`
`
`block diagram illustrating
`
`utilization
`
`e of scalable cocing.
`
`:T fD :1
`
`Q rt— 1..
`
`L__J
`
`1.. N D) r‘ 1..
`
`block diagram illustt1at1_ng Still
`:5 D X (l) d ”1 ._. r9
`
`r3
`:f scara31e coding.
`
`
`Out the invention]
`
`Herelnsr‘er,
`
`1mode-3
`
`(hereinafter, refer:
`
`@ CL
`
`iments“ ) of
`
`carrying
`
`be described.
`
`The diacriotiwt will
`
`ercoi
`v
`N j. l i
`
`Poll
`
`owing order.
`
`0. Overview
`
`1” First emb
`
`cdiment
`
`coding device)
`
`N . Second
`
`embodiment
`
`coding device)
`
`U)
`
`. Third emb
`
`odiment
`
`(image
`
`ecoding device)
`
`[\) (j:
`
`a Fourth en
`boriment
`
`(image decoding ievice)
`
`enb
`
`ima
`
`ediment
`
`(mul‘iwview image codi mg device
`
`ge :-<-d1ng dev13e)
`
`0. Sixth emb
`
`odiment
`
`(scaiable image coiing dev1,e
`
`and
`
`scalable image
`
`decoding devi ce)
`
`7“ Seventh e
`
`mbgdiment
`
`
`
`17
`
`9. Apelicatin
`
`examples of scalable
`
`Vi8l/7/\
`
`<Coding
`
`cheme>
`
`Z)
`
`10
`
`
` inafter,
`
`t
`
`be he present
`
`des criéed in connect
`
`coding and decoding
`
`ion with an application to image
`.2
`A
`'r'fiT'x
`oi a HhVL scheme.
`
`EOOM ]
`
`/\ Q 0. E4.
`
`H :3
`
`('f D"
`
`\V
`
`:5 LiZV 5 H r‘t‘
`a<;
`.
`l
`(1 sch
`
`eme,
`
`a hierarchical structure based
`
`on a macrrob ock and
`
`a sub macrobiock is defined. However,
`
`a macrrob (L
`
`is not optimal
`
`£0
`
`a larie
`
`an U_tra Higi
`
`Definition (UM
`
`(4000
`
`mg as a target of a
`
`
`
`generat_ 3n
`
`coding scheme,
`
`[0043]
`
`hdd,
`
`
`
`i
`WT=M 4-“,
`A Cu is arse r
`.
`7‘7
`\
`\
`‘
`’
`(GTE), and the “u is
`
`in the H?VC schrmr,
`:14 a
`,_
`
`(D Q.
`illustrat
`
`4..
`
`a coding
`.
`
`;_i
`
`'rrig4:
`
`.
`A.‘
`J.
`'I
`.
`i
`.
`eieirec. LO ab (3.
`
`coding tree blocK
`
`area of an image
`
`
`
`picti_e unit Adder 'aKing the same role of a mac.okiock in
`
`fixed to a size of 16 x 16
`
`ize 0”
`pixels, but a si
`
`10331181:
`
`1-5.
`
`not iixed and
`
`F\)
`
`(j‘:
`
`designated in image
`
`C OITLU T
`
`essicn information in each
`
`For example,
`
`a
`
`coding unit
`
`(LCU)
`
`$1.allest coding unit
`
`a CU are specified
`
`:5
`
`1.4n
`
`g,
`
`sequence parameter s
`
`et
`
`(SP3)
`
`G)
`idclud d in encoded data to
`
`0e output.
`
`
`
`18
`
`1
`.,
`J
`.
`”r
`.
`.,-.
`Km
`in set in & range lfi W iCh 83C!
`
`divided into figs havino a smaller size‘
`
`1; the example
`
`3
`
` is l28, and a largest
`[1
`scalable depth is J.
`
`;;s
`
`f‘.
`
`dfi_vided into CUs having a size or N x N servino as tLe
`
` hierarchy that is onewlevel
`
`lower when a value of
`
`split_flag is "la"
`
`10
`
`[004/]
`
`Further,
`
`
`a CU is divided in predict on units (PUs)
`
`that are arras (:artial areas of an image or a piC"ure
`
`UJiL> serving as processing units of intra or inter
`
`j
`t at
`
`prediction, and divided into transform units (TUs)
`Q H m w H m p) U}
`T Q fl F m l...‘ p H m p) 0
`
`N o
`
`f an image of a oigture unit)
`
`serving as proc.ssi1g units of
`
`looorl tr an;3forn.
`
`Currently,
`
`in the
`
`V” scheme, 16 x 16
`
`
`
` m m g\
`
`orthogonal
`
`transforms as well as 4
`
`X
`
`4 and 8
`
`X
`
`8 can be
`
`llSEd
`
`{0048]
`
`n the case of the coding scheme in which a CU is
`
`defined, and various kinds of processes are performed in
`
`units or CUs s1oh as the EEVC
`
`a Ticrcblosk in the
`
`
`1
`-»
`TT
`T
`—
`u,
`\.
`~
`~»
`~
`\,
`\
`~~f
`1
`1 ~
`-
`VvC scLe n1e can he considered to correspond to an hCu, and
`-
`1
`4
`/.~
`1.
`u.‘
`“A.
`'
`\
`V w‘fl
`.,
`1
`-,
`,~\
`,
`1»
`a»
`-
`a bloc
`\Lub bloc‘) can be con;iceled to corresponc LO a
`
`
`
`CU, Further,
`c1 (‘1
`c.Aeme can be considered to correspond to a PU. Here,
`
`a motion oomgensation block in the AVG
`
`since a CU has a bieranchical str1ct11..e,
`
`a size or an LCD
`
`or a topmost la/tr is commonly set to be lar’er than a
`
`macrob'ock in th: “7C scheme, Ear examgol’,
`
`such as
`
`12o nixels.
`
`[\) U
`
`1‘.J
`
`
`
`[0049]
`
`Tliugz, hereinafter, an TCU is assumed to inclACe a
`IV 7'l
`(
`_..
`
`is assumed to
`
`macrolock in the AVG scheme, and a
`r.
`l.
`include a block (sub block)
`
`Z)
`
`in the AVG scheme.
`In other
`s
`1’:L
`Hello15'
`{D '1 Q r": E—J. ’5 r1— :—‘ 5
`in the in L‘)
`
`
`
`indicates an arritrary cartial area in a picture, ane,
`
`for example,
`
`a size, shape, and Characteristics of a
`
`block are not
`
`limited“
`
`In other words,
`
`a w
`
`includes an ar itrary area (a processiig uiit
`
`SVCh as
`
`m
`
`10
`
`TU,
`
`a PU, an SC
`
`\‘
`
`U,
`
`a CU, an LOU,
`
`or a sliie, Of course,
`
`I’D (I)
`a "block" inglud.
`
`a macrcblock,
`a sub block,
`Q} H,_J \1
`
`other
`
`”art al area (processing unit) as well. When it is
`
`necessarv to limit a size,
`
`a processing unit, or
`
`_t will be approdiiatrlj desc:rib:d.
`
`<Mode selection>
`
`Meanwhile,
`
`in the AV“ and the WC ccd'ng schemes,
`
`ii order to achieve higher coding efficiency, it is
`__.
`to select an apprdariate predict.ion n10d_.
`
`important
`
`(‘5
`F”
`As an eXamIQle oi such a selection mataod, "her- is
`
`a method implemented in reference software (Opened at
`
`
`
`H.”f /MPEG—4 AVC called a _joint model
`
`(JM;.
`
`[\) (j‘:
`
`in the JM, it is possible to select two mode
`
`
`
`cost function values related to the respective prediction
`
`modes Mode are calculated, and a predicticn node having a
`
`smallest cost function value is se
`
`
`
`
`
`[\) C)
`
`mode for a correkppondi_ng block or a corresponding
`
`macrroblock
`
`r--: O 53]
`
`Z)
`
`A cost function in the hi:3h Ciomplexity mode is
`_‘
`
`represented as in the follOLVing Eormn1a (l):
`
`Hatiemitical Formula 1]
`._
`Cost<Mode E Q) = D + A*R
`
`...
`
`(l)
`
`{0055]
`
`Here, Q indicates a universa“ set of a candidate
`\
`mode ‘01 engoding a corresponding current block or a
`
`macroblccli, and D indicates dirierential energy between a
`S 3" xi,- :5
`
`deCoded image and an input
`
`ima
`
`(.2
`
`fD :3 Q Q
`
`d
`
`performed in a corresponding [:rediction mode.
`
`A
`
`irci cates Lagrange's undetermined multiplier given is a
`
`unction o? a quantization parameter.
`
`R indicates a
`
`total coding amount
`
`including an orthogonal transform
`
`cceffi.Ciient when encoding is performed in a corresponding
`
`H s O m T (D |)
`
`
`5: O M Q m V
`
`l. l“c O 1“, o
`r
`L
`'er to Jerrorm encooind in the
`
`nigh complexity mode,
`
`iC is necessary to perform a
`
`iemporary encoding process once by all candidate m<3des
`
`in
`
`order to calculate the parameters D and R, and thus a
`
`[\) (j‘:
`
`larger cowpitat on amou1t is reqi’iredu
`
`[0057]
`
`A cost function in
`
`
`low complexity mode is
`
`reprehented by the following Formula (2):
`
`[1058]
`
`[Mathematical Eormnla 2]
`
`dost<flcda e Q) = D + QEzgiant(flP‘*HefiderBit
`
`.1.
`
`(2)
`
`
`
`[\) H
`
`[0059]
`
`Here,
`
`D
`
`licates i’fferenc’al energy between
`
`i!)
`
`predicted image and an input
`
`image uriiike the high
`
`complexity mode. QPZFLantVQP)
`
`is given as a function of
`4..
`parameter QP, and HeaderBit indicates a
`
`Z)
`
` a guantiza
`
`coding amount related to infaimaton belonging to a
`
`header such as a motion vector or a mode including no
`
`10
`
`In other WOEdC,
`
`in the low camplexity mode, it is
`
`necessary to perform a oredicti on process for respective
`
`candidate m‘des, but since up to a decoded image is not
`
`necessary, it is unnecessary to perform up
`
`o a coding
`
`proces.. Thus, it can be iM l_emented with a computation
`
`amount smaller than that in the high complexity mode.
`
`Meanwhile,
`
`in ti: HEVC,
`
`a tile illustrated in Big.
`
`2 is specified as a unit of a para
`
`addition to a slice specified in the AVL.
`
`[006 2]
`
`4 4
`
`_ v
`
`p.
`
`5,
`
`:T
`
`{13 :5 l- Iis
`
`in
`
`m
`3..
`q_:j_;g
`
`of each tile are designated in
`
`image comp:ession inforznati
`
`and a decoding process can
`
`be independently performed on each tile.
`
`[\) (j‘:
`
`[Ofl63]
`
`<Stil : picture p'r‘of': :e>
`
`Further,
`
`in NonmPatent Document 2,
`
`the still
`
`pic.tu e prorile serving as the profile for using the h.VC
`
`as the still image codec is proposed“
`
`H)v~ver, generally,
`
`in the H3RIC,
`
`information that
`
`
`
`[\) [\3
`
`is transmitted from an encoding side to a decoding side
`
`includes syntax elements ior P slices and B slices,
`
`that
`
`is, swit
`
`elements related to an interwscreen proce5s as
`
`well as syntaxes for 1 slices,
`
`Z)
`
`[@065]
`
`bin<3e the still picture profile is the profile for
`
`exicoding and decoding still images, when this profile is
`
`
`
`applied,
`
`the above~ escrlbed syntax elements relatsd to
`
`the intermscreen presess are unnecessary,
`
`tte coding
`
`10
`
`etficiency is likely to ye lowered SlMIe unnecessary
`
`information is transmitted.
`
`[0066]
`
`In this regard,
`
`in the present
`
`Ft
`
`ecnnology, when the
`
`:odfl ng process is Oerform d t:a5t.ed on the profile f r
`
`exicoding the still imades, values 0
`
`svntax elements
`
`re ated to the inter“image process are restricted, and
`
`transn1ission of unnecessary information is suppressed.
`.1.
`As a result, it is possible to suppress a reduction in
`
`”eeific examples Oi
`
`the restriction will oe
`
`<O—l: Restriction of syntax element related
`
`to sub
`
`[\) (j‘:
`
`(A) C)
`
`Fig.
`
`a is a diagram illustrating an exemplary
`_‘lI
`syntax of a profile tier level
`
`(pro’ ile tier level())
`
`i1
`
`the HEVC. Numbers at the left end are given as line
`
`nu1bers ror description and not inclueed in an actna
`
`l...
`
`s'nta31 Similar v, numbers at the left end illustrated
`
`ii rigs.
`
`4
`
`to 23 which will be desejibed below ar- given
`
`
`
`(
`
`[\)
`
`as line numbers for description of figures and not
`
`actually included in
`
`iU
`
`syntax.
`
`A SVhtax element general profile_idc shown in a 5_
`‘1 H m H
` fit 6 6
`th line in the profile tf
`ofile_tier level())
`
`illustrated in Pic.
`
`3 specifies that a profile of a
`
`sequence (surreht sequence) or a processing tarqe; is a
`
`10
`
`p
`The profile tier level (profile tier_nevel()) of
`
`Fifi.
`
`3 is called my a "video parameter set
`
`(1P5:
`
`parameter set
`
`(Vic)
`
`in the ILVC. Figs,
`
`5 and o are
`
`diagrams illustrating an exemplary sequence parameter set
`
`(JFJ)
`
`in th? HEVd.
`
`
`
`Tnlustrated in Fig. 4,
`
`in the video parameter
`
`set
`
`(VPS),
`
`a protile tier level
`
`(Urotile tier level())
`
`in
`
`in the sequence parameter set
`D Q G) H
`x O
`r—4 (D e (D :—‘
`
`_.l
`
`L__J G)
`
`('1 {.1 (D H,
`
`3...!
`
`(0P0),
`x
`
`I»
`
`L4
`
`.3
`
`the profile tier
`
`('1 :3‘
`
`line is called”
`
`(j‘:
`
`C)
`
`[\) (j‘:
`
`:icture profi e,
`
`Here, Wien encoding is performed based Oh the still
`i
`l_l u < o k
`(_
`6 H U) D 0 fi (1) m T O H Cu |___I
`hear -
`
`depth (which
`
`14
`("f
`is also referreu o as a "sub laver")u In other worms,
`wl.'
`syntax elements related to the sub layer arp unnecessary.
`
`
`
`
`
`l\) .1;
`
`pictlre p10ofile is seeci:ie:d by the Sihta: element
`1.4 C). Q
`
`1... (T)
`gene1al p1ofi"
`
`T)
`
`1-::3 LI)
`y be designated as a value of a
`
`paramete1 vps max SD) layers mlAUSl
`
`(a 0”th line) 1elated
`
`to the gut: layer in the video par ameter 58L (YPS) oi hig,
`
`Z)
`
`sps max sub layers Wirusl
`
`(1 3—1d lint) 1el1ted Lo the
`
`10
`
`in Othe” wc1c:
`
`profile is the still
`
`
`sps_maX_ sub_laye18_minusl (ti: omrd line)
`
`relatec
`
`As a resuit, it is possible t prevent LrheCGSbarv
`
`Gertiens 01 t1: profile tier level
`
`(p10file_tie1 lemiel())
`
`=n othe1 w<31ds, it is 001Vl e to
`fIOh being read.
`"
`-
`3
`1
`-
`-1
`-.-
`1
`..
`.
`>1
`-1
`‘
`1.
`.
`i
`.
`.
`..
`-1
`.5
`-. A-
`p1event an ineredse in a lOad edus ed my the Leading an
`
`[\) (j‘:
`
`’73 (1; H. (1; e (‘1 r9 r1 r12
`
`D Q U!
`
`1.; r1
`
`kC
`
`’73 O U 0) L4] rr 1. r9
`
`to suppresr a 1eduction
`
`Fu1the1, as a 1esult, it is unnecessa1y to Ciahge
`
` the syntaXes of
`
`
`
`[\) (j‘:
`
`"rvvl()),
`
`
`the vifieo parameter :et
`
`(VET),
`
`and the seguense parameter set
`
`(VFW), and it is possibie
`
` .
`
`. 1.,“ 'I
`‘
`.
`,t
`f:
`'. i
`"A
`—
`‘
`,
`—
`-'
`.
`»»»»»»
`compatibili
`v With an en:oder and a decoder or a reiat,d
`
`Z)
`
`art that do not suono t the sti
`
`implemented by hardware,
`
`ther- ar- cases in whict it is
`
`10
`
`t
`diffitul, to update the syntax.
`
`A decrease in syntax
`
`compatiailiiy is litely ”0 reduce versatility. However,
`
`as desgribed above, when the values 0
`
`the syntax eiement
`
`
`
`are restricted by tie semantics, it is possible to
`
`maintain syntax compatibility anc prevent a reduction in
`
`versatility.
`
`[0078]
`
`Further, since the syntax compatibility is
`
`maiitained as described above,
`
`it is possible to easily
`
`aoplv a common syntax even to both encoding of stilt
`
`images and encoding of moving images, and thus it if
`
`Tossijla to easily implement an encoder and a recoder
`
`that process both a still image and a moving image
`
`through a common circuit.
`
`In other words, it car
`
`contribute to a size reduction or a device, suppression
`
`[\) (j‘:
`
`of an increase in cost, and the lire.
`
`«0“2: Restriction of syitax element related to
`
`Here, it is not
`
`1
`.
`1..
`impoSSible to implement sue: a
`
`restrigtion by changing the syntax.
`
`
`
`[\)
`
`(3“
`
`set
`
`(VP?) 0:
`
`the sequence parame e; set
`
`
`
`(SP8),
`
`a value of
`
`
`
`a syntax elam:nt
`
`:refilea PresentIiaj rel.ated to t};
`
`the time of the calling is consistentlv l.
`
`
`
`[0081]
`
`1.Ii
`
`4‘
`1'10 ('
`'he: words, it is redundant
`
`to transmit this
`
`
`
`syntax element, Further, an if statement of a 2mnd li_ne
`
`10
`
`',__.u
`of the prefi. e tier level (utotile tier level()) 0:
`'3.J
`
`is unnetlasary as well.
`
`(lie.
`
`I; this regard,
`
`the syntax of the pr file tier
`
`_evel (ptefile tier levelxi) of Fig,
`
`3 may he changed as
`
`in a1 example illustrated in Fig, 7,
`
`the syntax of the
`
`video parameter set
`
`(VPS) of Fig.
`
`4 may be (:hanged as in
`
`an example illustrated in liq” 8, and the syntax of the
`
`(j‘:
`
`C)
`
`l
`
`Lu
`
`(profile tier level()) may be designated by designating
`O “3 H L<I
`(/1 5 \‘f 9) ><J
`m ".1 35 (“l 3 Q) L: wubLayersMinusl related to
`,_2 e
`
`the sub layer as in the example: oi Fifi.
`
`7
`
`(a i—st ill
`
`
`
`
`
`[\) (j‘:
`
`lig.
`
`8
`
`(a 7—th line)i and Fig.
`
`K)
`
`(a 5—th line) without
`
`desigrw.Ling the synta:< element ProfilelresentFlagl
`
`PtofilePresentFlag may be omitted‘
`
`
`
`"-1
`
`[\)
`
`.---1 Q C) m (’1 L_.
`
`
`
`As a result, it is poossible to prevent transmission
`
`of an inaeee”sarv [arameter and su:"ress a reduction in
`
`J
`:Odi n0 efficiency. Further, it is possible to suppress
`
`an j.1’1(_,l.<3as€: load of ti: process of reading the
`
`proti
`
`e tier levei
`
`(profile ti;r_lev.l()) which is caused
`
`bv the reading of ’mle unhe L:esssary 1: statemzrt.
`
`In other words
`
`tte value of the svntaX
`
`
`
`Prciti_e:resentFlag related to the cal
`
`tier level may have to be iixed to l.
`
`[0087:
`
`<Om3: Restriction of syntaX element
`
`H ill ('1 \I. 0..
`
`F1 0
`
`(D
`
`(T E—J. O
`
`.0 x78
`L...|‘_>
`
`
`
`In the above method, when the syntax element
`/
`max sub 'ayers minisl related to the sub layer is encoded,
`‘0 (D H by O [K a CL
`a setti p-s
`rr 0 64 fl)
`
`1g
`
`x-‘-- Q, U}
`1‘
`
`after detectiiig lA"UYmd+lOl
`
`as to whether or not encoding is performed based on the
`
`still picture profile in a subsequent profile tier "eve
`
`(profilemtiermlevti(>).
`
`[0088]
`
`In this regard,
`
`