Petition for Inter Partes Review of USP 10,218,995
`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`
`)
`)
`)
`)
`)
`
`
`
`
`
`
`
`
`
`In re Inter Partes Review of:
`U.S. Patent No. 10,218,995
`Issued: February 26, 2019
`Application No.: 14/692,138
`Filing Date: April 21, 2015
`
`For: Moving Picture Encoding System, Moving Picture Encoding Method,
`Moving Picture Encoding Program, Moving Picture Decoding System,
`Moving Picture Decoding Method, Moving Picture Decoding Program,
`Moving Picture Reencoding System, Moving Picture Reencoding
`Method, Moving Picture Reencoding Program
`
`
`
`PETITION FOR INTER PARTES REVIEW
`OF U.S. PATENT NO. 10,218,995
`
`
`
`
`
`
`
`
`
`
`

`

`
`
`Petition for Inter Partes Review of USP 10,218,995
`
`TABLE OF CONTENTS
`
`I.
`INTRODUCTION ........................................................................................... 1
`IDENTIFICATION OF CHALLENGES (37 C.F.R. §42.104(b)) .................. 1
`II.
`III. BACKGROUND ............................................................................................. 2
`A.
`’995 Patent (Ex.1001) ........................................................................... 2
`1.
`Technical Background ................................................................ 2
`2.
`Brief Description ......................................................................... 4
`Prosecution History ............................................................................... 8
`B.
`POSITA ............................................................................................... 10
`C.
`Claim Construction ............................................................................. 10
`D.
`IV. Ground 1: Phek, Segall, Martins, and He Render Obvious Claims 1-6
`and 8-11 ......................................................................................................... 10
`A.
`Prior Art ............................................................................................... 10
`1.
`Phek ........................................................................................... 10
`2.
`Segall ......................................................................................... 12
`3. Martins ...................................................................................... 14
`4.
`He .............................................................................................. 15
`5.
`Combining Phek, Segall, Martins, and He ................................ 18
`a.
`Obvious based on Segall to Encode/Decode Phek’s
`Base and (First) Enhancement Layer Streams at the
`Same Spatial Resolution ................................................. 19
`Obvious based on Segall to Implement a Second
`Enhancement Layer in Phek’s System for Spatial
`Scalability ....................................................................... 23
`
`b.
`
`i
`
`

`

`B.
`
`C.
`D.
`E.
`
`Petition for Inter Partes Review of USP 10,218,995
`
`c.
`
`d.
`
`e.
`
`Obvious based on Segall to Multiplex/Demultiplex
`Phek’s Base and Enhancement Layer Bitstreams ........... 26
`Obvious based on Martins to Downscale Phek’s
`Super-Resolution Enlarged Reference Pictures ............. 29
`Obvious based on He to Selectively Apply
`Phek’s/Martin’s Super-Resolution (and
`Downscaling) Loop Filter ............................................... 34
`Claim 2 ................................................................................................ 39
`1.
`[2.P] ........................................................................................... 39
`2.
`[2.1] ........................................................................................... 40
`3.
`[2.2] ........................................................................................... 44
`4.
`[2.3] ........................................................................................... 46
`5.
`[2.4] ........................................................................................... 51
`6.
`[2.5.i] ......................................................................................... 56
`7.
`[2.5.ii] ........................................................................................ 61
`8.
`[2.6] ........................................................................................... 68
`9.
`[2.7] ........................................................................................... 72
`Claims 3-4 Limitations Correspondence to Claim 2 Limitations ....... 72
`Claim 11 .............................................................................................. 73
`Claim 1 ................................................................................................ 74
`1.
`[1.P] ........................................................................................... 74
`2.
`[1.1] ........................................................................................... 76
`3.
`[1.2] ........................................................................................... 77
`4.
`[1.3] ........................................................................................... 81
`5.
`[1.4] ........................................................................................... 82
`
`ii
`
`

`

`Petition for Inter Partes Review of USP 10,218,995
`
`F.
`
`6.
`[1.5] ........................................................................................... 86
`[1.6.i] ......................................................................................... 87
`7.
`[1.6.ii] ........................................................................................ 87
`8.
`[1.6.iii] ....................................................................................... 88
`9.
`[1.6.iv] ....................................................................................... 90
`10.
`[1.7] ........................................................................................... 91
`11.
`Claim 5 ................................................................................................ 91
`1.
`[5.P] ........................................................................................... 91
`2.
`[5.1] ........................................................................................... 91
`3.
`[5.2] ........................................................................................... 92
`4.
`[5.3] ........................................................................................... 94
`5.
`[5.4] ........................................................................................... 94
`Claim 6 ................................................................................................ 95
`1.
`[6.P] ........................................................................................... 95
`2.
`[6.1] ........................................................................................... 95
`Claims 8-9 Limitations Correspondence to Claim 1 Limitations ....... 96
`H.
`Claim 10 .............................................................................................. 97
`I.
`V. GROUND 2: Phek, Segall, Martins, He, and Wang Render Obvious
`Claim 7 ........................................................................................................... 98
`A.
`Prior Art ............................................................................................... 98
`1. Wang ......................................................................................... 98
`2.
`Phek-Segall-Martins-He-Wang............................................... 101
`Claim 7 .............................................................................................. 102
`
`G.
`
`B.
`
`iii
`
`

`

`Petition for Inter Partes Review of USP 10,218,995
`
`1.
`[7.P] ......................................................................................... 102
`[7.1] ......................................................................................... 102
`2.
`[7.2] ......................................................................................... 103
`3.
`[7.3] ......................................................................................... 104
`4.
`[7.4] ......................................................................................... 104
`5.
`VI. THE BOARD SHOULD REACH THE MERITS ...................................... 105
`A.
`Advanced Bionics Favors Institution ................................................. 105
`B. General Plastic Favors Institution .................................................... 105
`C.
`Fintiv Favors Institution .................................................................... 106
`VII. MANDATORY NOTICES UNDER 37 C.F.R. § 42.8(a)(1) ...................... 107
`A.
`Real Party-In-Interest ........................................................................ 107
`B.
`Related Matters .................................................................................. 107
`C. Grounds for Standing ........................................................................ 108
`D.
`Counsel and Service Information ...................................................... 108
`E.
`IPR Fee .............................................................................................. 109
`VIII. CONCLUSION ............................................................................................ 109
`
`iv
`
`

`

`Petition for Inter Partes Review of USP 10,218,995
`
`TABLE OF ABBREVIATIONS
`Abbreviation
`
`Term
`
`super-resolution and downscaling loop
`filter
`
`SR-D filter
`
`signal-to-noise ratio
`
`bitstream
`
`output bitstream
`
`input bitstream
`
`SNR
`
`BTS
`
`OBTS
`
`IBTS
`
`minimum sum of absolute differences
`
`MINSAD
`
`power saving factor
`
`scalable video coding
`
`PSF
`
`SVC
`
`
`
`
`
`
`v
`
`

`

`Petition for Inter Partes Review of USP 10,218,995
`
`TABLE OF AUTHORITIES
`
` Page(s)
`
`CASES
`Advanced Coding Technologies LLC v. Apple Inc.,
`No. 2:24-cv-00572-JRG (E.D. Tex.) ................................................................ 107
`Advanced Coding Technologies LLC v. Google LLC,
`No. 2:24-cv-00353-JRG (E.D. Tex.) ................................................................ 107
`Ericsson Inc. v. Intellectual Ventures I LLC,
`IPR2014-00527, Paper 41, 11 (PTAB May 18, 2015) ......................................... 1
`Ford Motor Co. v. Neo Wireless LLC,
`IPR2023-00763, Paper 28 (PTAB Mar. 22, 2024) ........................................... 106
`KSR Int’l Co. v. Teleflex Inc.,
`550 U.S. 398 (2007) .....................................................................................passim
`Samsung Elecs. Co., Ltd. v. Advanced Coding Techs. LLC,
`IPR2024-00372, Paper 9 (PTAB Jul. 18, 2024) ............................................... 106
`Vivendum Prod. Sols., Inc. v. Rotolight Ltd.,
`IPR2023-01218, Paper 12 (PTAB Apr. 19, 2024) ........................................... 106
`
`
`
`vi
`
`

`

`Petition for Inter Partes Review of USP 10,218,995
`
`Exhibit
`
`EXHIBIT LIST
`
`Description
`
`1001
`1002
`
`1003
`1004
`1005
`
`1006
`
`1007
`
`1008
`1009
`1010
`
`1011
`1012
`
`1013
`
`1014
`1015
`1016
`
`1017
`1018
`
`U.S. Patent No. 10,218,995 to Sakazume (“the ’995 Patent”)
`Excerpts from the Prosecution History of the ’995 Patent (“the
`’995 Patent File History”)
`Declaration and Curriculum Vitae of Dr. Clifford Reader
`[reserved]
`English Translation of Japanese Patent Publication No.
`2007316161 A with Translation Certificate (“Phek”)
`Segall et al., Spatial Scalability Within the H.264/AVC Scalable
`Video Coding Extension; IEEE Transactions on Circuits &
`Systems for Video Tech., Vol. 17, No. 9, September 2007
`(“Segall”)
`Martins et al., A Unified Approach to Restoration, Deinterlacing
`and Resolution Enhancement in Decoding MPEG-2 Video,
`IEEE Transactions on Circuits & Systems for Video Tech., Vol.
`12, No. 9, September 2002 (“Martins”)
`U.S. Patent Application Publication No. 2008/0137753 (“He”)
`U.S. Patent No. 5,886,736 (“Chen”)
`Schwarz et al., Overview of the Scalable Video Coding Extension
`of the H.264/AVC Standard, IEEE Transactions on Circuits
`& Systems for Video Tech., Vol. 17, No. 9, September 2007
`(“Schwarz”)
`U.S. Patent Application Publication No. 2009/0154567 (“Lei”)
`Park et al., Super-Resolution Image Reconstruction: A Technical
`Overview, IEEE Signal Processing Magazine, pp. 21-36,
`May 2003 (“Park”)
`English Machine Translation of Japanese Patent Publication
`No. 2008053848 (“Hatanaka”)
`U.S. Patent Application Publication No. 2010/0165077 (“Yin”)
`U.S. Patent Application Publication No. 2009/0257664 (“Kao”)
`U.S. Patent Application Publication No. 2009/0046995
`(“Kanumuri”)
`U.S. Pat. 6,470,051 (“Campisano”)
`U.S. Patent Application Publication No. 2006/0013306 (“Kim”)
`
`vii
`
`

`

`1019
`
`1020
`1021
`1022
`
`1023
`
`1024
`1025
`1026
`1027
`1028
`1029
`1030
`
`1031
`
`1032
`1033
`
`1034
`1035
`1036
`1037
`
`1038
`
`1039
`
`Petition for Inter Partes Review of USP 10,218,995
`
`Lu et al., Mechanisms of MPEG Stream Synchronization, ACG
`SIGCOMM Computer Communication Review, Vol. 24, Issue
`1, pp. 57-67 (January 1994) (“Lu”)
`U.S. Patent Publication No. 2003/0021345 (“Brusewitz”)
`U.S. Patent Publication No. 2003/0021347 (“Lan”)
`EE|Times, How Video Compression Works (Aug. 6, 2007),
`available at https://www.eetimes.com/how-video-
`compressionworks
`(retrieved Dec. 26, 2023) (“EETimes”)
`Bier, Introduction to Video Compression, Berkeley Design
`Tech., Inc. (October 2005), available at
`https://www.bdti.com/MyBDTI/pubs/20051024_GSPx05_Vide
`o_Intro.pdf (retrieved Dec. 30, 2023) (“Bier”)
`U.S. Patent No. 7,379,496 (“Holcomb”)
`U.S. Patent Publication No. 2008/0043832 (“Barkley”)
`U.S. Patent No. 6,173,013 (“Suzuki”)
`[reserved]
`[reserved]
`Declaration of June Ann Munford
`Ely, MPEG Video Coding: A Simple Introduction, EBU Technical
`Review (Winter 1995) (“Ely”)
`Japanese Patent Publication No. 2007316161 A with English
`Machine Translation
`ITU-T Recommendation H.264 (11/07)
`Karczewicz et al., The SP- and SI-Frames Design for
`H.264/AVC, IEEE TRANSACTIONS ON CIRCUITS AND
`SYSTEMS FOR VIDEO TECHNOLOGY, v.13 (July 2003)
`ISO/IEC 11172-2: 1993 (E) (MPEG1 Video)
`ISO/IEC 13818-2: 2000 (E) (MPEG2/H.262 Video )
`ITU-T Recommendation H.263 (02/98)
`Reader, Intraframe and Interframe Adaptive Transform Coding,
`Efficient Transmission of Pictorial Information, SPIE v.66, 108
`(1975)
`Reader, MPEG4: Coding for Content, Interactivity, and Universal
`Accessibility, Optical Engineering 35(1), 104 (January
`1996)
`Reader, MPEG Patents, in MPEG Video Compression Standard,
`
`viii
`
`

`

`Petition for Inter Partes Review of USP 10,218,995
`
`1040
`
`1041
`
`1042
`1043
`1044
`1045
`
`Chapter 16, at 357-362 (Mitchell et al ed.) (1996)
`Radha et al., The MPEG-4 Fine-Grained Scalable Video Coding
`Method for Multimedia Streaming Over IP, IEEE Transactions
`on Multimedia, v.3, 53 (March 2001)
`H.264 / MPEG-4 Part 10 White Paper, January 31, 2003
`(downloaded
`from https://github.com/yistLin/H264-Encoder/
`blob/1cdaf090b63642932ed726b102ed2cf80908edbb/doc
`/H.264%20%3A%20MPEG-
`4%20Part%2010%20White%20Paper.pdf on Jan. 5, 2024)
`ISO/IEC 14496-2: 2004 (MPEG4)
`ISO/IEC 13818-2: 1996 (MPEG2)
`EP 1811786 to Wang (“Wang”)
`Third Amended Docket Control Order
`
`
`
`
`ix
`
`

`

`[1.P]
`[1.1]
`
`[1.2]
`
`[1.3]
`
`[1.4]
`
`[1.5]
`
`[1.6.i]
`[1.6.ii]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`LIST OF CHALLENGED CLAIM ELEMENTS
`
`Claim 1
`
`A moving picture encoding system comprising:
`a first encoder configured to work on a subsequence of a sequence
`of moving pictures with a standard resolution to implement a first
`combination of processes for an encoding and a decoding to
`create a first sequence of encoded bits and a set of decoded
`pictures with the standard resolution;
`a first super-resolution enlarger configured to work on the
`subsequence of the sequence of moving pictures with the
`standard resolution to implement an interpolation of pixels with
`a first enlargement to create a set of super-resolution enlarged
`pictures with a first resolution higher than the standard resolution;
`a first resolution converter configured to work on the set of super-
`resolution enlarged pictures to implement a process for a first
`resolution conversion to create a set of super-resolution enlarged
`and converted pictures with a standard resolution;
`a second super-resolution enlarger configured to acquire the set
`of decoded pictures with the standard resolution from the first
`encoder to work on the sequence of decoded pictures to
`implement an interpolation of pixels with a second enlargement
`to create a set of super-resolution enlarged decoded pictures with
`a second resolution higher than the standard resolution;
`a second resolution converter configured to work on the set of
`super-resolution enlarged decoded pictures to implement a
`process for a second resolution conversion to create a set of super-
`resolution enlarged and converted decoded pictures with a
`standard resolution; and
`a second encoder configured to:
`have the set of super-resolution enlarged and converted pictures
`from the first resolution converter as a set of encoding target
`pictures, the set of decoded pictures from the first encoder as a
`set of first reference pictures, and the set of super-resolution
`
`x
`
`

`

`[1.6.iii]
`
`[1.6.iv]
`
`[1.7]
`
`[2.P]
`[2.1]
`
`[2.2]
`
`[2.3]
`
`[2.4]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`enlarged and converted decoded pictures from the second
`resolution converter as a set of second reference pictures,
`select one of the set of first reference pictures and the set of
`second reference pictures to create reference picture selection
`information to identify the set of selected reference pictures to
`implement a second process for encoding to create a second
`sequence of encoded bits based on the set of encoding target
`pictures and the set of selected reference pictures, and
`implement a third process for encoding for the reference picture
`selection information to create a sequence of encoded bits of the
`reference picture selection information,
`wherein the set of encoding target pictures, the set of first
`reference pictures, and the set of second reference pictures have
`the same value in spatial resolution.
`Claim 2
`A moving picture decoding system comprising:
`a demultiplexer configured to work on a sequence of input
`encoded bits
`to
`implement a process for a prescribed
`demultiplexing to out- put at least a first and a second sequence
`of encoded bits;
`a first decoder configured to acquire the first sequence of encoded
`bits obtained with a standard resolution at the demultiplexer to
`implement thereon a process for a prescribed first decoding to
`create a sequence of decoded pictures with a standard resolution;
`a first super-resolution enlarger configured to acquire the
`sequence of decoded pictures created with a standard resolution
`at the first decoder to work on the sequence of decoded pictures
`to implement an interpolation of pixels with a first enlargement
`to create a sequence of super-resolution enlarged decoded
`pictures with a first resolution higher than a standard resolution;
`a first resolution converter configured to acquire the sequence of
`super-resolution enlarged decoded pictures created at the first
`super-resolution enlarger to work on the sequence of super-
`resolution enlarged decoded pictures to implement a process for
`a prescribed resolution conversion to create a sequence of super-
`resolution decoded pictures with a standard resolution;
`
`xi
`
`

`

`[2.5.i]
`
`[2.5.ii]
`
`[2.6]
`
`[2.7]
`
`[3.P]
`[3.1]
`
`[3.2]
`
`[3.3]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`a second decoder configured to acquire the second sequence of
`encoded bits obtained with a standard resolution at the
`demultiplexer as a set of decoding targets, the sequence of
`decoded pictures created with the standard resolution at the first
`decoder as a set of first reference pictures, and the sequence of
`super-resolution decoded pictures created with the standard
`resolution at the first resolution converter as a set of second
`reference pictures, and
`select one of the set of first reference pictures and the set of
`second reference pictures based on reference picture selection
`information to implement a combination of processes for a
`prescribed prediction and a prescribed second decoding being a
`decoding with an extension of the standard resolution, to create
`a sequence of super-resolution pictures decoded with the
`standard resolution based on the set of decoding targets and the
`set of selected reference pictures; and
`a second resolution converter configured to acquire the
`sequence of decoded pictures with the standard resolution from
`the first decoder to work on the sequence of decoded pictures
`to implement an interpolation of pixels with the second
`enlargement to create a sequence of enlarged decoded pictures
`with a high resolution as a second resolution higher than the
`standard resolution,
`wherein the set of decoding targets, the set of first reference
`pictures, and the set of second reference pictures have the same
`value in spatial resolution.
`Claim 3
`A moving picture decoding method comprising:
`a step of implementing a process for a prescribed demultiplexing
`on a sequence of input encoded bits, outputting at least a first and
`a second sequence of encoded bits;
`a step of acquiring the first sequence of encoded bits obtained
`with a standard resolution through the process for the prescribed
`demultiplexing, implementing thereon a process for a prescribed
`first decoding, creating a sequence of decoded pictures with the
`standard resolution;
`a step of acquiring the sequence of decoded pictures created
`with the standard resolution through the process for the
`
`xii
`
`

`

`[3.4]
`
`[3.5.i]
`
`[3.5.ii]
`
`[3.6]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`prescribed first decoding, working on the sequence of decoded
`pictures to implement an interpolation of pixels with a first
`enlargement, creating a sequence of super-resolution enlarged
`decoded pictures with a first resolution higher than the standard
`resolution;
`a step of acquiring the sequence of super-resolution enlarged
`decoded pictures created through the process for the prescribed
`super-resolution enlargement working on the sequence of super-
`resolution enlarged decoded pictures to implement a process for
`a first resolution conversion, creating a sequence of super-
`resolution decoded pictures with a standard resolution;
`a step of acquiring the second sequence of encoded bits obtained
`with a standard resolution through the process for the prescribed
`demultiplexing as a set of decoding targets, the sequence of
`decoded pictures created with the standard resolution through the
`process for the prescribed first decoding as a set of first reference
`pictures, and the sequence of super-resolution decoded pictures
`created with the standard resolution through the process for the
`prescribed resolution conversion as a set of second reference
`pictures, and
`selecting one of the set of first reference pictures and the set of
`second reference pictures based on reference picture selection
`information to implement a combination of processes for a
`prescribed prediction and a prescribed second decoding being a
`decoding with an extension of the standard resolution, based on
`the set of decoding targets and the set of selected reference
`pictures to create a sequence of super-resolution pictures
`decoded with the standard resolution;
`and
`a step of acquiring the sequence of decoded pictures created
`with the standard resolution through the process for the
`prescribed first decoding working on the sequence of decoded
`pictures to implement an interpolation of pixels with the second
`enlargement, creating a sequence of enlarged decoded pictures
`with a high resolution as a second resolution higher than the
`standard resolution,
`
`xiii
`
`

`

`[3.7]
`
`[4.P]
`
`[4.1]
`
`[4.2]
`
`[4.3]
`
`[4.4]
`
`[4.5.i]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`wherein the set of decoding targets, the set of first reference
`pictures, and the set of second reference pictures have the same
`value in spatial resolution.
`Claim 4
`A recording medium storing a moving picture decoding program
`comprising a non-transitory computer-readable medium
`configured to have a computer execute:
`a step of implementing a process for a prescribed demultiplexing
`on a sequence of input encoded bits, outputting at least a first and
`a second sequence of encoded bits;
`a step of acquiring the first sequence of encoded bits obtained
`with a standard resolution through the process for the prescribed
`demultiplexing, implementing thereon a process for a prescribed
`first decoding, creating a sequence of decoded pictures with the
`standard resolution;
`a step of acquiring the sequence of decoded pictures created
`with the standard resolution through the process for the
`prescribed first decoding, working on the sequence of decoded
`pictures to implement an interpolation of pixels with a first
`enlargement, creating a sequence of super-resolution enlarged
`decoded pictures with a first resolution higher than the standard
`resolution;
`a step of acquiring the sequence of super-resolution enlarged
`decoded pictures created through the process for the prescribed
`super- resolution enlargement working on the sequence of super-
`resolution enlarged decoded pictures to implement a process for
`a first resolution conversion, creating a sequence of super-
`resolution decoded pictures with a standard resolution;
`a step of acquiring the second sequence of encoded bits obtained
`with a standard resolution through the process for the prescribed
`demultiplexing as a set of decoding targets, the sequence of
`decoded pictures created with the standard resolution through
`the process for the prescribed first decoding as a set of first
`reference pictures, and the sequence of super-resolution
`decoded pictures created with the standard resolution through
`the process for the prescribed resolution conversion as a set of
`second reference pictures, and
`
`xiv
`
`

`

`[4.5.ii]
`
`[4.6]
`
`[4.7]
`
`[4.8]
`
`[4.9]
`
`[5.P]
`
`[5.1]
`
`[5.2]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`selecting one of the set of first reference pictures and the set of
`second reference pictures based on reference picture selection
`information to implement a combination of processes for a
`prescribed prediction and a prescribed second decoding being a
`decoding with an extension of the standard resolution, based on
`the set of decoding targets and the set of selected reference
`pictures to create a sequence of super-resolution pictures
`decoded with the standard resolution; and
`a step of acquiring the sequence of decoded pictures created with
`the standard resolution through the process for the prescribed
`first decoding, working on the sequence of decoded pictures to
`implement an
`interpolation of pixels with
`the second
`enlargement creating a sequence of enlarged decoded pictures
`with a high resolution as a second resolution higher than the
`standard resolution,
`wherein the first resolution is different from the second
`resolution,
`wherein the standard resolution of the second sequence of
`encoded bits is the same as the standard resolution of the super-
`resolution decoded pictures,
`and wherein the set of decoding targets, the set of first reference
`pictures, and the set of second reference pictures have the same
`value in spatial resolution.
`Claim 5
`The moving picture encoding system according to claim 1,
`wherein the first super-resolution enlarger comprises:
`a positioner configured to work in a processing for super-
`resolution enlargement, on a combination of a base picture
`constituting a base therein and one or more observation pictures
`to be based on, to make a positioning to pixel positions of a
`desirable high resolution, for an interval-unequal sampling to
`create nonhomogeneous high resolution pictures;
`an interpolator configured to work on nonhomogeneous high
`resolution pictures created at the positioner, to implement a
`process for a prescribed nonhomogeneous interpolation to create
`interpolated pictures with a desirable high resolution;
`
`xv
`
`

`

`[5.3]
`
`[5.4]
`
`[6.P]
`
`[6.1]
`
`Claim 7
`[7.P]
`
`[7.1]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`an estimated picture creator configured to acquire interpolated
`pictures created at the interpolator, to implement thereon a
`process for a prescribed reconstruction to create estimated
`pictures with a desirable resolution; and
`a repetition determiner configured to acquire a nonhomogeneous
`high
`resolution picture
`from
`the positioner
`and
`a
`nonhomogeneous estimated picture from the estimated picture
`creator, for employment of the acquired pictures to follow a
`prescribed determination method to determine whether or not a
`repetition of the processing for super-resolution enlargement is
`necessary, and work depending on a result thereof, to operate as
`the repetition is necessary, to provide the interpolator with
`information for a control to continue the processing, and operate
`as the repetition is unnecessary, to provide the estimated picture
`creator with information for a control to output a set of estimated
`pictures with a high
`resolution after
`super-resolution
`enlargement.
`
`Claim 6
`The moving picture encoding system according to claim 1,
`further comprising
`a multiplexer configured to operate complying with a prescribed
`syntax structure to multiplex the first sequence of encoded bits
`from the first encoder, the second sequence of encoded bits from
`the second encoder, and information on encoding parameters of
`respective types used in the encoding at the first encoder and the
`encoding at the second encoder.
`
`The moving picture encoding system according to claim 1,
`further comprising:
`a first accumulation buffer configured to work in a course before
`the first encoder and the first super-resolution enlarger, to
`accumulate subsequences of the sequence of moving pictures
`with the standard resolution;
`
`xvi
`
`

`

`[7.2]
`
`[7.3]
`
`[7.4]
`
`[8.P]
`[8.1]
`
`[8.2]
`
`[8.3]
`
`[8.4]
`
`[8.5]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`a second accumulation buffer configured to work in a course
`between the first encoder and the second encoder, to accumulate
`sets of decoded pictures from the first encoder;
`an accumulation controller configured to work for detections of
`buffer accumulation amounts at the first accumulation buffer, the
`second accumulation buffer, the first encoder, and the second
`encoder, to control the buffer accumulation amounts; and
`a code rate controller configured to work on bases of the
`detections of buffer accumulation amounts at the accumulation
`controller, to control code rates at the first encoder and the second
`encoder.
`
`Claim 8
`A moving picture encoding method comprising:
`a step of implementing a first combination of processes for an
`encoding and a decoding on a sequence of moving pictures with
`a standard resolution, creating a first sequence of encoded bits
`and a set of decoded pictures with the standard resolution;
`a step of implementing an interpolation of pixels with a first
`enlargement on the sequence of moving pictures with the
`standard resolution, creating a set of super-resolution enlarged
`pictures with a first resolution higher than a standard resolution;
`a step of implementing a process for a first resolution conversion
`on the set of super-resolution enlarged pictures, creating a set of
`super-resolution enlarged and converted pictures with a standard
`resolution;
`a step of acquiring the set of decoded pictures with the standard
`resolution to work on the sequence of decoded pictures to
`implement an interpolation of pixels with a second enlargement
`to create a set of super-resolution enlarged decoded pictures with
`a second resolution higher than the standard resolution;
`a step of working on the set of super-resolution enlarged decoded
`pictures to implement process for a second resolution conversion
`to create a set of super-resolution enlarged and converted
`decoded pictures with a standard resolution; and
`
`xvii
`
`

`

`[8.6.i]
`[8.6.ii]
`
`[8.6.iii]
`
`[8.6.iv]
`
`[8.7]
`
`[9.P]
`
`[9.1]
`
`[9.2]
`
`[9.3]
`
`Petition for Inter Partes Review of USP 10,218,995
`
`a step of:
`having the set of super-resolution enlarged and converted pictures
`as a set of encoding target pictures, the set of decoded pictures as
`a set of first reference pictures, and the set of super-resolution
`enlarged and converted decoded pictures as a set of second
`reference pictures,
`selecting one of the set of first reference pictures and the set