IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`Fatih M. Ozluturk
`In re Patent of:
`9,154,699 Attorney Docket No.: 39843-0078IP1
`U.S. Patent No.:
`October 6, 2015
`
`Issue Date:
`Appl. Serial No.: 14/586,297
`
`Filing Date:
`December 30, 2014
`
`Title:
`METHOD AND APPARATUS TO CORRECT BLUR IN ALL OR
`PART OF A DIGITAL IMAGE BY COMBINING PLURALITY
`OF IMAGES
`
`
`Mail Stop Patent Board
`Patent Trial and Appeal Board
`U.S. Patent and Trademark Office
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`
`PETITION FOR INTER PARTES REVIEW OF UNITED STATES PATENT
`NO. 9,154,699 PURSUANT TO 35 U.S.C. §§ 311–319, 37 C.F.R. § 42
`
`
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`TABLE OF CONTENTS
`
`I. 
`
`THE ’699 PATENT ....................................................................................... 1 
`A.  Overview ................................................................................................... 1 
`B.  Prosecution History ................................................................................... 1 
`II.  REQUIREMENTS FOR IPR ....................................................................... 1 
`A.  Standing .................................................................................................... 1 
`B.  Challenge and Relief Requested ............................................................... 2 
`C.  Level of Ordinary Skill in the Art ............................................................. 3 
`D.  Claim Construction ................................................................................... 3 
`III.  APPLICATION OF PRIOR ART ............................................................... 6 
`A.  1A: Kitamura and Suh render obvious claims 1, 3, 5, 9, 11, and 13 ........ 7 
`B.  1B: Kitamura, Suh, and Manabe render obvious claims 2, 6, 8, 10, 14,
`and 16 ...................................................................................................... 39 
`C.  1C: Kitamura, Suh, and Noriyuki render obvious claims 7 and 15 ........ 45 
`D.  1D: Kitamura and Noriyuki render obvious claims 17, 19, 22, 24, 26,
`and 29 ...................................................................................................... 52 
`E.  1E: Kitamura, Noriyuki, and Manabe render obvious claims 18, 21, 23,
`25, 28, and 30 .......................................................................................... 60 
`F.  1F: Kitamura, Noriyuki, and Suh render obvious claims 20 and 27 ...... 62 
`G.  2A-2D: Kitamura, Suh, and Manabe render obvious claims 1-6, 8-14,
`and 16, Kitamura, Suh, Manabe, and Noriyuki render obvious claims 7
`and 15, Kitamura, Noriyuki, and Manabe render obvious claims 17-19,
`21-26, and 28-30, and Kitamura, Noriyuki, Manabe, and Suh render
`obvious claims 20 and 27 ........................................................................ 64 
`IV.  PTAB DISCRETION SHOULD NOT PRECLUDE INSTITUTION .... 68 
`V. 
`PAYMENT OF FEES ................................................................................. 72 
`VI.  CONCLUSION ............................................................................................ 72 
`VII.  MANDATORY NOTICES UNDER 37 C.F.R § 42.8(a)(1) ..................... 73 
`A.  Real Party-In-Interest Under 37 C.F.R. § 42.8(b)(1) .............................. 73 
`B.  Related Matters Under 37 C.F.R. § 42.8(b)(2) ....................................... 73 
`C.  Lead And Back-Up Counsel Under 37 C.F.R. § 42.8(b)(3) ................... 73 
`D.  Service Information ................................................................................ 73 
`
`
`
`
`i
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`EXHIBITS
`
`SAMSUNG-1001 U.S. Patent No. 9,154,699 to Ozluturk (“the ’699 Patent”)
`
`SAMSUNG-1002 Excerpts from the Prosecution History of the ’699 Patent (“the
`Prosecution History”)
`
`SAMSUNG-1003 Declaration of Dr. Irfan Essa
`
`SAMSUNG-1004 Reserved
`
`SAMSUNG-1005 U.S. Patent Publication No. 2001/0022860 to Kitamura
`(“Kitamura”)
`
`SAMSUNG-1006 U.S. Patent No. 6,977,687 to Suh (“Suh”)
`
`SAMSUNG-1007 U.S. Patent Publication No. 2005/0018927 to Manabe
`(“Manabe”)
`
`SAMSUNG-1008 Certified Translation of Japanese Patent Publication No.
`2002057933 (“Noriyuki”)
`
`SAMSUNG-1009 Unopposed Motion for Extension of Time to Move, Answer,
`or Otherwise Respond to Plaintiff’s Complaint (Clear
`Imaging Research, LLC v. Samsung Electronics Co. Ltd.,
`2:19-cv-326-JRG (E.D. Tex. Oct. 15, 2019))
`
`SAMSUNG-1010 Reserved
`
`SAMSUNG-1011 Reserved
`
`SAMSUNG-1012 Excerpt of The New Oxford American Dictionary (Second
`Edition, 2005)
`
`SAMSUNG-1013 Reserved
`
`SAMSUNG-1014 Reserved
`
`ii
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`SAMSUNG-1015 U.S. Patent No. 6,809,759 to Chiang
`
`SAMSUNG-1016 U.S. Patent No. 7,369,161 to Easwar
`
`SAMSUNG-1017
`
`Joseph Guzman, “Fauci says second wave of coronavirus is
`‘inevitable’”, TheHill.com (Apr. 29, 2020), available at:
`https://thehill.com/changing-america/resilience/natural-
`disasters/495211-fauci-says-second-wave-of-coronavirus-is
`SAMSUNG-1018 Peter Wells, et al. “Texas puts reopening on hold in face of
`new Covid-19 outbreak”, Financial Times (June 25, 2020),
`available at https://www.ft.com/content/e35f3148-a797-4e6e-
`bf7a-1a7ce3181e97
`SAMSUNG-1019 Order Granting Joint Motion to Amend the Docket Control
`Order and Time for Claim Construction Expert Disclosures
`(Clear Imaging Research, LLC v. Samsung Electronics Co.
`Ltd., 2:19-cv-326-JRG (E.D. Tex. June 12, 2020))
`SAMSUNG-1020 Email to Clear Imaging counsel dated February 10, 2020
`SAMSUNG-1021 Email from Clear Imaging counsel dated July 3, 2020
`SAMSUNG-1022 Stipulation by Samsung
`SAMSUNG-1023 Reserved
`SAMSUNG-1024 P.R. 4-3 Joint Claim Construction and Prehearing Statement
`(Clear Imaging Research, LLC v. Samsung Electronics Co.
`Ltd., 2:19-cv-326-JRG (E.D. Tex. July 23, 2020))
`SAMSUNG-1025 Plaintiff’s Disclosure of Asserted Claims and Infringement
`Contentions Pursuant to Patent Local Rules (Clear Imaging
`Research, LLC v. Samsung Electronics Co. Ltd., 2:19-cv-326-
`JRG (E.D. Tex. Jan. 14, 2020))
`
`
`
`
`
`
`iii
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`Samsung petitions for Inter Partes Review (“IPR”) of claims 1-30 (“the
`
`Challenged Claims”) of U.S. Patent No. 9,154,699 (“the ’699 Patent”).
`
`I.
`
`THE ’699 PATENT
`A. Overview
`The ’699 Patent relates to a method and apparatus for use in a digital
`
`imaging device for correcting image blur in digital images by combining a
`
`plurality of captured images to create a combined photographic image such that a
`
`main subject is blur free and other areas are blurred. SAMSUNG-1001, Abstract,
`
`12:48-55. SAMSUNG-1003, [0010].
`
`B.
`Prosecution History
`In the only office action, the claims were rejected on the ground of
`
`nonstatutory double patenting over claims 1-30 of U.S. Patent No. 8,630,484.
`
`SAMSUNG-1002, 77-81. The applicant filed a terminal disclaimer and the
`
`application was allowed. Id., 18, 48.
`
`II. REQUIREMENTS FOR IPR
`A.
`Standing
`Samsung certifies that the ’699 Patent is available for IPR. This petition is
`
`being filed within one year of service of a complaint against Samsung in the
`
`Eastern District of Texas. SAMSUNG-1009. Samsung is not barred or estopped
`
`from requesting this review.
`
`1
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`B. Challenge and Relief Requested
`Samsung requests cancellation of the Challenged Claims on the following
`
`grounds. Additional explanation and support for each ground is set forth in Dr.
`
`Irfan Essa’s declaration (SAMSUNG-1003).
`
`Ground
`1A
`1B
`1C
`1D
`1E
`1F
`2A
`2B
`
`2C
`2D
`
`Claims
`1, 3-5, 9, 11-13
`2, 6, 8, 10, 14, 16
`7, 15
`17, 19, 22, 24, 26, 29
`18, 21, 23, 25, 28, 30
`20, 27
`1-6, 8-14, 16
`7, 15
`
`17-19, 21-26, 28-30
`20, 27
`
`§103(a) References
`Kitamura and Suh
`Kitamura, Suh, and Manabe
`Kitamura, Suh, and Noriyuki
`Kitamura and Noriyuki
`Kitamura, Noriyuki, and Manabe
`Kitamura, Noriyuki, and Suh
`Kitamura, Suh, and Manabe
`Kitamura, Suh, Manabe, and
`Noriyuki
`Kitamura, Noriyuki, and Manabe
`Kitamura, Noriyuki, Manabe, and
`Suh
`
`The following table summarizes the prior art basis for each reference with
`
`respect to an assumed Critical Date of March 25, 2004.1 Each reference qualifies
`
`as prior art:
`
`
`1 Although the ’699 Patent lists a March 25, 2004 provisional application, Patent
`
`Owner does not contend that the ’699 Patent is entitled to the provisional date.
`
`SAMSUNG-1025.
`
`2
`
`

`

`
`
`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`Reference
`
`Date
`
`Basis
`
`Kitamura
`
`Suh
`
`Manabe
`
`Noriyuki
`
`Published 9/20/2001
`
`§102(a), §102(b), and §102(e)
`
`Filed 10/7/1998
`
`Filed 7/22/2003
`
`§102(e)
`
`§102(e)
`
`Published 2/22/2002
`
`§102(a), §102(b)
`
`
`
`C. Level of Ordinary Skill in the Art
`A person of ordinary skill in the art (“POSITA”) as of the Critical Date
`
`would have had at least a Bachelor’s Degree in an academic area emphasizing
`
`electrical engineering, computer science, or a similar discipline, and at least two
`
`years of experience related to imaging technologies. Superior education could
`
`compensate for a deficiency in work experience, and vice-versa. SAMSUNG-
`
`1003, [0006].
`
`D. Claim Construction
`Unless otherwise noted, terms should be given their plain meaning, but
`
`Petitioner reserves the right to respond to any constructions offered by Patent
`
`Owner or the Board. Samsung is not waiving any arguments concerning
`
`indefiniteness or claim scope.
`
`3
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`1.
`“processor … configured to” (claims 9, 24)
`Petitioner advances ordinary meaning of these phrases in this proceeding;
`
`however, a question exists regarding whether they should be interpreted under 35
`
`U.S.C. §112, ¶6 (“112/6”). Williamson v. Citrix Online, LLC, 792 F.3d 1339, 1346
`
`(Fed. Cir. 2015). The absence of the word “means” creates a rebuttable presumption
`
`that 112/6 does not apply. Phillips v. AWH Corp., 415 F.3d 1303, 1311 (Fed. Cir.
`
`2005). In district court, the parties dispute whether the presumption should be
`
`rebutted. Although claim construction arguments are not yet final, Petitioner may
`
`argue in district court that 112/6 applies and these claims are indefinite.
`
`SAMSUNG-1024, 47-49. However, Patent Owner contends that 112/6 doesn’t
`
`apply. Id.
`
`Because the dispute in district court remains unresolved and because
`
`Petitioner cannot raise indefiniteness here, Petitioner relies on the presumption in
`
`this proceeding and applies prior art to these claims’ ordinary meaning consistent
`
`with Patent Owner’s litigation position. Id. Petitioner will promptly inform the
`
`Board of any district court developments related to these claims’ definiteness.
`
`Further, when determining validity, claim terms need to only be construed to
`
`“resolve the controversy.” Wellman, Inc. v. Eastman Chem. Co., 642 F.3d 1355,
`
`1361 (Fed. Cir. 2011). Because this proceeding lacks arguments/evidence rebutting
`
`the presumption, the presumption should stand and the Board should forego
`
`4
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`construction absent Patent Owner advocating for 112/6’s application. If Patent
`
`Owner does not endorse a 112/6 construction, no controversy exists regarding
`
`112/6’s application. Indeed, the presumption holds when neither party presents
`
`argument/evidence to rebut it. HTC America, Inc. v. Virginia Innovation Sciences,
`
`Inc., IPR2017-00872, Paper 11, 9; Dick v. New York Life Ins. Co., 359 U.S. 437, 443
`
`n.3 (1959); Am. Hoist & Derrick Co. v. Sowa & Sons, Inc., 725 F.2d 1350, 1358
`
`(Fed. Cir. 1984).
`
`Finally, any district court claim construction ruling is reviewable by the
`
`Federal Circuit, and yet, denial of institution is non-appealable. Thus, for this claim
`
`construction theory, congressional intent is best served through institution,
`
`particularly considering that institution would involve prior art consideration against
`
`Patent Owner’s claim construction.
`
`Therefore, in this proceeding, these claim phrases should be given their
`
`ordinary meaning.
`
`2.
`“designating … a main subject” (claims 1, 9, 17, and 24)
`Petitioner has asserted in the co-pending district court proceeding that
`
`limitations of the form “designating … a main subject” should be construed to
`
`mean “identifying an object to use as a reference point for aligning images to
`
`correct blur.” SAMSUNG-1024, 42-43. The specification of the ’699 Patent
`
`5
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`supports this construction. See id.; SAMSUNG-1001, 10:52-11:2 (“the reference
`
`point for aligning the higher speed images is … the [designated] subject itself.”).
`
`The present Petition addresses this claim language according to this
`
`construction (see Grounds 2A-2D), as well as according to Patent Owner’s
`
`proposed interpretation that “No construction necessary” (see Grounds 1A-1F).
`
`SAMSUNG-1024, 42-43. Previous cases have made clear that PTAB rules do not
`
`prohibit Petitioner from addressing the prior art under alternative claim
`
`constructions. See, e.g., 10X Genomics v. Bio-Rad Labs, IPR2020-00086, Paper 8,
`
`18-22 (PTAB April 27, 2020); Western Digital Corp. v. SPEX Techs., Inc.,
`
`IPR2018-00084, Paper 14, 12 (PTAB Apr. 25, 2018). In fact, the Board has
`
`previously endorsed this approach, stating that “judicial efficiency will be
`
`enhanced by allowing Petitioner to rely upon a claim construction that Patent
`
`Owner is relying upon in the related district court litigation to assert infringement
`
`of the challenged patent.” 10X Genomics, 19.
`
`III. APPLICATION OF PRIOR ART
`As detailed below, this petition shows a reasonable likelihood that Samsung
`
`will prevail with respect to claims 1-30 of the ’699 Patent.
`
`6
`
`

`

`A.
`
`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`1A: Kitamura and Suh render obvious claims 1, 3, 5, 9, 11, and 13
`1. Kitamura describes combining digital images2
`Kitamura, in the field of digital cameras, describes combining “a plurality of
`
`images” into a composite image. SAMSUNG-1005, Abstract. “[I]mage
`
`information from the CCD 102 [purple in FIG. 3, infra] is stored in the primary
`
`memory 103,” dotted brown lines. Id., [0035], FIG. 1. The camera includes
`
`“image processor 104” (green) controlled by controller 305 (dotted green lines),
`
`and a slot for “recording medium 108 [brown].” Id., [0028]; see [0034], [0036];
`
`SAMSUNG-1003, [0017]-[0022].
`
`
`2 Petitioner incorporates the entirety of the discussions of Kitamura, Suh, and the
`
`combination thereof, presented in Sections III.A.1-III.A.3, into Grounds 1A-1F.
`
`7
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`
`
`Kitamura (SAMSUNG-1005), Detail of FIG. 3 (annotated)
`
`A user provides input (dotted blue lines) to Kitamura’s controller via the
`
`operation panel (blue), which has “operation buttons” with which “a photographer
`
`selects a multiplex image sensing mode.” SAMSUNG-1005, [0029], [0033],
`
`[0035], FIG. 3. Images are displayed on “an image display unit 111 comprising a
`
`liquid crystal display (LCD)” (red). Id., [0029]; SAMSUNG-1003, [0022]-[0023].
`
`8
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`
`
`
`
`Kitamura (SAMSUNG-1005), Detail of FIG. 2 (annotated)
`
`Kitamura’s camera “combin[es] sensed images to obtain an excellent
`
`composite image.” SAMSUNG-1005, [0003]. “[I]mage sensing conditions” are
`
`“modified for each image sensing when sensing a plurality of images.” Id., [0034].
`
`In “‘blur control’ mode, the focus position is changed,” and “images are sensed”
`
`and “combined,” generating a composite image. Id., [0034], [0041]. The
`
`photographer approves the composite image or requests generation of a new
`
`composite image. See id., [0012], [0035]-[0036], [0041]-[0043], [0062], FIG. 3;
`
`SAMSUNG-1003, [0024].
`
`In “blur control” mode, images 500, 501 (red in FIG. 6, infra) are
`
`“photographed at slightly shifted focus positions,” where “image 500 has a focused
`
`background ‘B’, and image 501 has a focused foreground ‘A’.” SAMSUNG-1005,
`
`[0060]-[0061]. The images are combined into “composite images” 502, 503
`
`9
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`(purple), where “the foreground ‘A’ is focused and the background ‘B’ is more
`
`strongly blurred than the image 501.” Id., [0061]. “[I]mage 502 has a slightly
`
`blurred background ‘B,’” and in image 503, “background ‘B’ has an enhanced blur
`
`condition.” Id., [0062]. “[I]f the photographer likes the image,” it “is saved on the
`
`recording medium 108 [brown].” Id, [0062]; SAMSUNG-1003, [0025].
`
`
`
`
`
`Kitamura (SAMSUNG-1005), Detail of FIG. 6 (annotated)
`
`10
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`Suh describes a digital camera having a touch screen LCD
`viewfinder
`Suh, in the field of digital cameras, describes a “digital still camera” that
`
`2.
`
`“allows a user to take a picture with a certain focused position by moving a focus
`
`to a desirable position of the subject.” SAMSUNG-1006, Abstract. Suh’s camera
`
`has “photoelectric converting unit 20 [purple in FIG. 1, infra] for generating
`
`electric signals corresponding to the image generated by the lens,” and “LCD unit
`
`40 [red].” Id., 2:15-20. The LCD unit includes “LCD screen 42 for displaying the
`
`image and a touch screen 44 for moving the focus position according to the user’s
`
`selection,” where “[t]he active area of the LCD screen 42 is covered by the touch
`
`screen.” Id., 2:21-25; SAMSUNG-1003, [0032]-[0033].
`
`
`
`
`
`Suh (SAMSUNG-1006), Detail of FIG. 1 (annotated)
`
`11
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`The photoelectric converting unit transmits image signals to “the image
`
`signal processing unit,” green, which “generates image data,” “stores the image
`
`data in the frame memory unit,” dotted brown lines, and “transmits the image data
`
`to the LCD unit 40 to display[] the image.” SAMSUNG-1006, 3:4-12. That is,
`
`Suh’s LCD unit displays a preview of a scene being photographed, before a picture
`
`is taken. See FIG. 2, showing display of the preview before photographing.
`
`SAMSUNG-1003, [0033].
`
`A mark (blue in FIG. 3, infra) displayed on Suh’s LCD “represents the focus
`
`position of the LCD unit 40.” SAMSUNG-1006, 2:56-57. The user “moves the
`
`mark 100 using … the touch screen 44” to “move the focus position anywhere on
`
`the [displayed] image.” Id., 2:60-63. In FIG. 3, “initially the car located at the
`
`center of the LCD unit 40 is focused.” Id., 3:14-16. The user “relocate[s] the mark
`
`100 … to a person,” green, and “the final picture [is] focused on the person.” Id.,
`
`3:19-23. When the user moves the mark, a “focus control unit 80 [dotted green
`
`lines in FIG. 1, supra] controls the image signal processing unit 70 in order to
`
`display the relocated mark 100 on the LCD unit 40,” the focus is adjusted
`
`“corresponding to the mark,” and “the picture is taken.” Id., 3:24-27, 4:5-13. By
`
`allowing a user to “relocate a focus point to a desirable position of a subject,” “a
`
`user can take a picture having a certain position focused.” Id., 4:20-23;
`
`SAMSUNG-1003, [0035]-[0039].
`
`12
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`
`
`Suh (SAMSUNG-1006), Detail of FIG. 3 (annotated)
`
`3.
`
`The combination of Kitamura and Suh yields a digital
`camera having a touch sensitive, LCD-based viewfinder
`A POSITA would have found it obvious to modify Kitamura’s image
`
`display unit such that the LCD displays preview images of a scene to be
`
`photographed, as taught by Suh. See SAMSUNG-1005, [0029], [0035], [0041];
`
`SAMSUNG-1006, 2:14-25, 3:8-11, FIG. 3. Kitamura’s image display unit also is
`
`modified to include a touch screen over the LCD. See SAMSUNG-1005, [0029],
`
`[0035], [0041]; SAMSUNG-1006, 2:21-25, 2:60-63, 3:19-22, 4:36-37. A mark is
`
`displayed on the LCD, and the user “relocate[s] the mark 100 through … the touch
`
`screen” to “move the focus position anywhere on the image displayed” on the LCD
`
`to designate a subject. SAMSUNG-1006, 2:61-63, 3:19-23; SAMSUNG-1005,
`
`[0029], [0035], [0041], [0061]-[0062]; SAMSUNG-1003, [0041]-[0052].
`
`13
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`4.
`Claim 1
`[1pre] “A method comprising:”
`In the combination, Kitamura teaches a method. See SAMSUNG-1005,
`
`[0003] (“a method for combining sensed images to obtain an excellent composite
`
`image”), [0014] (“a method for preparing a composite image in an image sensing
`
`device”), [0027]-[0031], [0035]-[0037], [0041], [0061]-[0062], [0079]-[0081],
`
`FIG. 10, claim 8; SAMSUNG-1003, [0016]-[0031].
`
`[1.1] “displaying an image in a viewfinder;”
`In the combination, Kitamura teaches displaying an image in an image
`
`display unit: “an image display unit 111 comprising a liquid crystal display
`
`(LCD).” SAMSUNG-1005, [0029]; FIG. 2, infra; FIG. 3 (reproduced in [1.3],
`
`infra). “The prepared composite image is displayed on the display unit 111.” Id.,
`
`[0035]; see [0041], [0053]; SAMSUNG-1003, [0022].
`
`Kitamura (SAMSUNG-1005), Detail of FIG. 2 (annotated)
`
`
`
`14
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`Also in the combination, Suh describes displaying an image in a
`
`viewfinder. Suh’s digital camera includes “an LCD unit 40 for displaying the
`
`image.” SAMSUNG-1006, 2:13-20. The LCD unit 40, in red in FIG. 1, infra,
`
`includes “a LCD screen 42 for displaying the image and a touch screen 44.” Id.,
`
`2:21-24. Suh’s LCD unit 40 (including the LCD screen 42 and the touch screen
`
`44) is a viewfinder because an image of a subject to be photographed is displayed
`
`on the LCD. See SAMSUNG-1006, 3:1-4:19, FIG. 2; see 3:1-11 (“The
`
`photoelectric converting unit 20 generates electrical signals corresponding to the
`
`image formed by the lens/lens driving unit 10 and transmits the signals to the
`
`image signal processing unit 70, which generates image data” that is “transmit[ted]
`
`… to the LCD unit 40 to display[] the image.”), 3:13-14, 4:33-35, 5:14-15, FIG. 2;
`
`SAMSUNG-1003, [0032]-[0033]
`
`15
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`
`
`Suh (SAMSUNG-1006), Detail of FIG. 1 (annotated)
`
`A POSITA would have found it obvious to modify Kitamura’s image
`
`display unit 111 to function as a viewfinder, and to include a touch screen, based
`
`on Suh’s teachings of an LCD unit that acts as a viewfinder. See SAMSUNG-
`
`1005, [0035]; SAMSUNG-1006, 2:21-25, 3:1-14. Kitamura’s modified camera is
`
`illustrated in the following figure. The LCD of Kitamura’s image display unit 111
`
`displays an image, e.g., of a scene to be photographed. See SAMSUNG-1006, 3:1-
`
`14, 4:33-35. Image signals from the CCD (purple) are stored in Kitamura’s
`
`primary memory 103 (dotted brown lines; see SAMSUNG-1005, [0028], [0035],
`
`[0037]) and transmitted to the LCD, consistent with the functioning of Suh’s LCD
`
`unit 40. See SAMSUNG-1006, 3:8-12 (image data from the photoelectric
`
`16
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`converting unit is stored “in the frame memory unit 50 and transmit[ted] … to the
`
`LCD unit 40”). The “active area of the LCD screen” is “covered by [a] touch
`
`screen” “for moving the focus position according to the user’s selection.”
`
`SAMSUNG-1006, 2:24-25; see 2:60-63, 3:19-22, 4:36-37; SAMSUNG-1003,
`
`[0041]-[0042].
`
`Kitamura (SAMSUNG-1005), Detail of FIG. 3, modified based on Suh
`
`A POSITA would have been motivated to configure Kitamura’s LCD to
`
`function as a viewfinder to improve the ease of use of Kitamura’s camera and to
`
`
`
`17
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`enhance the ergonomics of taking photographs. SAMSUNG-1005, [0029], [0035],
`
`[0041]; SAMSUNG-1006, 2:14-25, 3:8-11, FIG. 3. With an LCD-based
`
`viewfinder, a user does not need to hold the camera to his eye to look through a
`
`finder window (see SAMSUNG-1005, [0029]) to view the scene to be
`
`photographed. Rather, the user views the scene displayed on the LCD, allowing
`
`the user to hold the camera in a more convenient position. This modification
`
`makes the camera easier to operate and more comfortable to hold. Furthermore, a
`
`POSITA would have been motivated to integrate a touch screen into Kitamura’s
`
`image display unit to provide users with an avenue for direct interaction with
`
`displayed images, which is an intuitive and straightforward way to provide input.
`
`See SAMSUNG-1006, 2:21-25, 2:60-63, 3:19-22, 4:36-37. SAMSUNG-1003,
`
`[0043]-[0044].
`
`A POSITA would have expected success because Kitamura’s camera
`
`already includes an LCD for image display. See SAMSUNG-1005, [0029]. A
`
`POSITA also would have expected success given that Kitamura’s camera includes
`
`features involved in having an LCD function as a viewfinder, such as a memory for
`
`storing image data and an image processor. See SAMSUNG-1006, 2:25-31;
`
`SAMSUNG-1005, [0028]-[0030], [0035], [0037]). A POSITA also would have
`
`expected success because the LCD of Suh’s digital camera operates as a
`
`viewfinder, and because Suh demonstrates use of a touch screen in the context of a
`
`18
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`digital camera. See SAMSUNG-1006, 2:14-25, 3:8-11, FIG. 3; SAMSUNG-1003,
`
`[0045].
`
`[1.2] “receiving user input, by the viewfinder, designating a main subject in
`the image;”
`In the combination, Suh describes receiving user input, by the viewfinder.
`
`The user touching the touch screen to move the displayed mark is user input
`
`provided through the viewfinder and received by the viewfinder. See SAMSUNG-
`
`1006, 2:21-24 (“The LCD unit 40 comprises … a touch screen 44 for moving the
`
`focus position according to the user’s selection.”), 2:60-63 (“If a user moves the
`
`mark 100 using … the touch screen 44, the user can move the focus position
`
`anywhere on the image displayed on the LCD unit 40.”), 5:4-5 (“a touch screen
`
`allowing a user to relocate the mark on the display screen,” “wherein the touch
`
`screen is established on a camera body”), 2:33-35, 3:16-21, 4:36-37, 5:17-19;
`
`SAMSUNG-1003, [0033], [0035]-[0037].
`
`Also in the combination, Suh’s user input designates a main subject in the
`
`image. “The user may relocate the mark 100 through … the touch screen 44 to a
`
`non-center position of the LCD unit 40, for example, to a person of FIG. 3.
`
`Accordingly, the final picture will be focused on the person.” SAMSUNG-1006,
`
`3:19-22; see FIG. 3. The user’s relocation of the mark to the person designates the
`
`person as the main subject in the image. See 4:20-21 (“since a user can relocate a
`
`focus point to a desirable position of a subject, a user can take a picture having a
`
`19
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`certain position focused”), 2:60-63, 4:5-9, Abstract; SAMSUNG-1003, [0035]-
`
`[0037].
`
`A POSITA would have found it obvious to incorporate, into Kitamura’s
`
`digital camera, the ability to receive user input, by the viewfinder, designating a
`
`main subject in the image, based on the teachings of Suh. In this implementation,
`
`Kitamura’s image processor 104 and controller 305 are modified to implement
`
`functionality of Suh’s focus control unit 80 and image signal processing unit 70.
`
`See SAMSUNG-1006, 3:24-27; SAMSUNG-1006, 3:24-27. A mark that
`
`“represents the focus position of the” image display unit is displayed on
`
`Kitamura’s LCD. SAMSUNG-1006, 2:56-57. The user, touching the touch
`
`screen, “moves the mark … [to] move the focus position anywhere on the image,”
`
`thereby designating a main subject. SAMSUNG-1006, 2:60-63. Upon receiving
`
`the user input, the relocated mark is displayed, the focus of Kitamura’s camera is
`
`adjusted, and a picture is taken focused on the user-designated main subject. See
`
`SAMSUNG-1006, 3:24-4:13; SAMSUNG-1003, [0046]-[0048].
`
`A POSITA would have found it obvious to apply Suh’s approach to user
`
`designation of a main subject in the context of Kitamura’s blur control mode. In
`
`this implementation, the user touches the touch screen of Kitamura’s modified
`
`viewfinder to move a displayed mark over the ‘A’ in the image in the LCD of the
`
`viewfinder to designate the ‘A’ as the main subject. See SAMSUNG-1006, 2:56-
`
`20
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`63; SAMSUNG-1005, [0061]. Kitamura’s camera takes multiple images, with one
`
`of the images focused on the ‘A,’ and a composite image is generated such that the
`
`‘A’ is focused. See SAMSUNG-1005, [0061]; SAMSUNG-1003, [0049].
`
`A POSITA would have been motivated to incorporate, into Kitamura’s
`
`camera, the ability to receive user input, by the viewfinder, designating a main
`
`subject, as taught by Suh, to implement a flexible approach to designating a
`
`subject. Allowing a user the flexibility to designate a main subject anywhere in the
`
`camera’s field of view facilitates generation of a combined image that is focused
`
`on a subject of interest to the user. See SAMSUNG-1005, [0061]. A POSITA
`
`would have been motivated to implement an approach in which user input is
`
`provided by relocating a displayed mark to provide visual feedback indicating the
`
`user-designated subject. SAMSUNG-1003, [0050].
`
`A POSITA would have expected success in enabling a user to designate a
`
`subject of interest given the general applicability of Kitamura’s blur control
`
`process to combining images for which “the focus position is changed.”
`
`SAMSUNG-1005, [0034]. A POSITA also would have expected success given
`
`that Kitamura’s processor is able to receive user input. See SAMSUNG-1005,
`
`[0036], FIG. 3; SAMSUNG-1003, [0050].
`
`21
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
` [1.3] “capturing a plurality of photographic images at a recording medium,
`wherein the plurality of photographic images include the designated main
`subject;”
`In the combination, Kitamura’s digital camera includes “a CCD 102 as an
`
`image sensing element for photoelectric converting an optical image.”
`
`SAMSUNG-1005, [0028]; see [0037], FIGS. 1 and 3. Kitamura’s CCD 102, in
`
`purple in FIG. 3, infra, is a recording medium. The ’699 Patent makes clear that
`
`a charge coupled device (CCD), such as Kitamura’s CCD 12, is a recording
`
`medium. See SAMSUNG-1001, 3:61-63 (“In digital cameras, the recording
`
`medium is typically a dense arrangement of light sensors, such as a Charge-
`
`Coupled Device (CCD) or a CMOS sensor.”); SAMSUNG-1003, [0018].
`
`22
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`
`
`
`Kitamura (SAMSUNG-1005), Detail of FIG. 3 (annotated)
`
`Also in the combination, Kitamura teaches capturing a photographic
`
`image at the recording medium: “the photographer views the desired
`
`photographic scene (object) through the finder window 105, then presses the
`
`shutter button 106 … [T]he object image is photoelectrically converted by the
`
`CCD 102, and the image sensing operation is performed.” SAMSUNG-1005,
`
`23
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`[0037]; see [0011], [0014], [0028]. Also in the combination, Kitamura describes
`
`capturing a plurality of photographic images at the recording medium:
`
`“[I]mages 500 and 501 are images … photographed at slightly shifted focus
`
`positions.” SAMSUNG-1005, [0061]. Kitamura’s images 500, 501, red in FIG. 6,
`
`infra, are a plurality of photographic images. See [0034]-[0035] (“The image
`
`sensing conditions which are modified for each image sensing when sensing a
`
`plurality of images.”), [0011], [0014], [0040]-[0041]; SAMSUNG-1003, [0018],
`
`[0024]-[0026].
`
`
`
`Kitamura (SAMSUNG-1005), Detail of FIG. 6 (annotated)
`
`Kitamura’s plurality of photographic images (images 500, 501) include
`
`the designated main subject (‘A’): “The scene [of images 500, 501] was
`
`photographed with the letter ‘A’ as the foreground and the letter ‘B’ as the
`
`background.” SAMSUNG-1005, [0061]. As shown in FIG. 6, supra, the plurality
`
`24
`
`

`

`Attorney Docket No. 39843-0078IP1
`IPR of U.S. Patent No. 9,154,699
`of photographic images include the main subject (the ‘A,’ green). SAMSUNG-
`
`1003, [0026]-[0027].
`
`[1.4] “combining