350 m37
`SR
`7/20/76
`397,065
`XR
`United States Patent (19)
`Bayer
`
`3,971,065
`(11)
`(45) July 20, 1976
`
`(54) COLOR IMAGING ARRAY
`(75) Inventor: Bryce E. Bayer, Rochester, N.Y.
`73 Assignee: Eastman Kodak Company,
`Rochester, N.Y.
`Mar. 5, 1975
`22 Filed:
`(21) Appl. No.: 555,477
`
`ABSTRACT
`.
`57
`A sensing array for color imaging includes individual
`luminance- and chrominance-sensitive elements that
`are so intermixed that each type of element (i.e., ac
`cording to sensitivity characteristics) occurs in a re
`peated pattern with luminance elements dominating
`the array. Preferably, luminance elements occur at
`every other element position to provide a relatively
`high frequency sampling pattern which is uniform in
`tWO perpendicular directions (e.g., horizontal and ver
`52 U.S. C. ............................ 358/41; 350/162 SF;
`tical). The chrominance patterns are interlaid there
`350/3.358/4
`with and fill the remaining element positions to pro
`51 Int. Cl'........................................... H04N 9/24
`vide relatively lower frequencies of sampling.
`58 Field of Search ................... 358/44, 45, 46, 47,
`358/48; 350/317, 162 SF; 315/169 TV In a presently preferred implementation, a mosaic of
`References Cited
`As with a sistian Fai's
`56)
`UNITED STATES PATENTS
`broad range of light sensitivity, the distribution of
`2,446,791
`8/1948 Schroeder............................. 358/44
`filter types in the mosaic being in accordance with the
`2,508,267
`5/1950 Kasperowicz......................... 358/44
`above-described patterns.
`2,884,483
`4/1959 Ehrenhaft et al..........
`... 358/44
`3,725,572
`4/1973 Kurokawa et al..................... 358/46
`Primary Examiner-George H. Libman
`Attorney, Agent, or Firm--George E. Grosser
`
`11 Claims, 10 Drawing Figures
`
`
`
`
`
`
`
`
`
`
`
`N
`N
`
`4.n N
`
`W
`N
`
`N
`N
`N
`
`P
`
`1.
`
`e Y
`
`1.
`
`N
`
`y : sY e
`
`Y
`
`a
`
`1.
`
`1.
`
`W
`
`N
`
`N
`Y
`
`r
`
`-
`
`2 2.
`2 9 5. g E.
`2. 2. 2
`
`
`
`
`
`N
`
`s
`
`W
`
`Ya
`
`w
`
`W
`
`N
`
`N
`N
`W
`
`N
`W
`
`N
`w
`
`N
`
`N
`
`N
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`"...-s,
`
`-
`
`N NN N
`
`X
`
`W
`
`N a.3. Y
`
`eN W1.N MN eN
`
`N 2 Y
`
`a s
`a 6. eN a
`N NN N ta ta a
`
`APPLE v. RED.COM
`
`Page 1 of 10
`
`Apple Ex. 1016
`
`

`

`U.S. Patent July 20, 1976
`
`Sheet 1 of 4
`
`3,971,065
`
`
`
`APPLE v. RED.COM
`
`Page 2 of 10
`
`Apple Ex. 1016
`
`

`

`U.S. Patent July 20, 1976
`
`Sheet 2 of 4
`
`3,971,065
`
`
`
`
`
`
`
`
`
`Z %% 8 2%i
`s
`A/G 24
`
`A/G 2A
`
`A/G 2C
`
`APPLE v. RED.COM
`
`Page 3 of 10
`
`Apple Ex. 1016
`
`

`

`US. Patent
`
`July 20, 1976
`
`Sheet 3 of 4
`
`3,971,065
`
`
`
`§
`
`\\
`
`/
`
`
`
`.G.NQXKIE
`
`.~\\\\\\x\\\\\\\:
`
`,lll
`'.\\\\\
`l§
`I/Alxxx
`\\\\7
`
`\\\\\
`
`I
`
`\\\\\\§w
`
`43x360.NE
`
`QIm.
`
`1”
`
`\\
`
`NW
`
`i.
`\\
`
`1"?|~§~§§~gfldem I
`aa\\.7
`QA\\\
`IAll
`All?“
`\\\\‘
`/4.f/Iy
`\\\\\
`
`I
`
`‘ APPLE V. REDCOM
`
`Page 4 of 10
`
`‘ Apple EX.{1016 .
`
`APPLE v. RED.COM
`
`Page 4 of 10
`
`Apple Ex. 1016
`
`
`
`

`

`U.S. Patent
`
`July 20, 1976
`
`Sheet 4 of 4
`
`3,971,065
`
`
`
`APPLE v. RED.COM
`
`Page 5 of 10
`
`Apple Ex. 1016
`
`

`

`1.
`
`10
`
`15
`
`COLOR IMAGING ARRAY
`BACKGROUND OF THE INVENTION
`1. Field of the Invention
`The invention relates to imaging devices and, in par
`ticular, to color image sensors.
`2. Description Relative to the Prior Art
`Color image sensors of various types have been pro
`posed for and used in video cameras. To avoid optical
`complexity and problems with image registration, it is
`highly desirable that color image sensing occur at a
`single imaging site, e.g., at a single planar photosensi
`tive array. Difficulty is encountered with such “single
`site' color imaging, however, because at least three
`distinct types of color information must be extracted in
`order to represent a color image in video signal form.
`One known approach to providing a single-site color
`sensing device utilizes a single image sensor of broad
`wavelength sensitivity and a cooperating filter disc
`which passes a series of color filters through the image
`beam in a repeating sequence. The filter interpositions
`are synchronized to image scanning, a filter typically
`being interposed during an entire field scan. Devices
`operating in this manner are said to produce a "field
`25
`sequential' color signal. One problem with this ap
`proach is that the resulting signal presents the extracted
`color image information in a time order which is radi
`cally different from the time order of the standard
`NTSC video signal. A further disadvantage is that some
`30
`of the color image information (e.g., blue image infor
`mation if a blue basic color vector is utilized) tends to
`be disproportionately detailed and hence wasteful of
`sensor capacity in consideration of the response char
`35
`acteristics of the human visual system.
`Certain other proposed approaches to achieving sin
`gle-site color image sensing call for the use of striped
`color filters superposed on a single image sensor. One
`such type of image sensor utilizes filter grids which are
`angularly superimposed on one another (see U.S. Pat.
`40
`No. 3,378,633). As a result of image scanning, such
`image sensors produce a composite signal wherein
`chrominance information is represented in the form of
`modulated carrier signals. Such apparatus may be
`adapted to produce signals in the NTSC format or, if
`45
`desired, the color image information can be separated
`by frequency domain techniques. In practice, however,
`it has proven difficult to produce such sensors econom
`ically, particularly where detailed image information is
`50
`required.
`Striped filters which transmit a repeating sequence of
`three or more spectral bands have also been proposed
`for use in color imaging. With this arrangement, the
`filters are typically aligned vertically and scanning of
`the image is performed horizontally. In effect, elemen
`55
`tal sample areas are defined along the filter stripes.
`With this arrangement, it will be appreciated, sampling
`for a given color is not uniform for horizontal and verti
`cal directions. Additionally, the sampling patterns
`which result tend to provide a disproportionate quan
`60
`tity of information regarding basic color vectors to
`which the eye has less resolving power, e.g., "blue'
`information relative to "green' information.
`Another approach to color imaging which has been
`proposed is the "dot' scanning system, as discussed in
`U.S. Pat. No. 2,683,769 to Banning. That approach
`generally utilizes spectrally selective sensor elements
`which are arranged in triads (red, green, and blue ele
`
`3,971,065
`2
`ments, respectively). However, in U.S. Pat. No.
`2,755,334, also to Banning, a repeated arrangement of
`four element groupings (red-, green-, blue-, and white
`sensitive elements, respectively) is described. Such
`approaches to color imaging have not been of practical
`significance, in part because of the cost of fabricating
`the number of individual elements which are required
`to provide image information having adequate detail.
`In summary, while color imaging devices having a
`single imaging site are desirable to minimize optical
`and registration problems and to provide a more rug
`ged camera structure, video camera manufacturers
`generally resort to splitting the image beam and provid
`ing multiple image scanners in order to achieve a satis
`factory type and quality of color video signal.
`SUMMARY OF THE INVENTION
`Color imaging is effected by a single imaging array
`composed of individual luminance and chrominance
`sensing elements that are distributed according to type
`(sensitivity) in repeating interlaid patterns, the lumi
`nance pattern exhibiting the highest frequency of oc
`currence - and therefore the highest frequency of
`image sampling - irrespective of direction on the ar
`ray.
`In providing for a dominance of luminance sampling,
`recognition is taken of the human visual system's rela
`tively greater ability to discern luminance detail. By
`arranging the luminance elements of the color image
`sensing array to occur at every other array position, a
`dominance of luminance elements is achieved in a
`pattern which has the special advantage of uniformity
`in two orthogonal directions (e.g., horizontal and verti
`cal). Moreover, by so intermixing three types of ele
`ments (luminance, and first and second chrominance)
`that luminance elements occur, at every other array
`position, and first and second chrominance elements
`alternate with such luminance elements in respective.
`alternate rows of the array, there is provided a lumi
`nance-dominated sampling which is uniform for all
`three color vectors in two orthogonal directions. Cer
`tain desirable sampling attributes which result from the
`special uniformities of such arrangements are discussed
`in the detailed description below.
`Preferably, to produce an element array according to
`the invention, a solid state sensor array of broad wave
`length sensitivity is provided with a superposed filter
`mosaic. Filters of the mosaic are arranged in one-to
`one registration with elements of the sensor array and
`have light passing characteristics in accordance with
`the above-described interlaid pattens. Filters which are
`selectively transparent in the green region of the spec
`trum are preferably employed in producing luminance
`type elements, and filters which are selectively trans
`parent in the red and blue spectral regions, respec
`tively, are preferably employed in producing chromi
`nance-type elements. (The term “luminance' is herein
`used in a broad sense to refer to the color vector which
`is the major contributor of luminance information. The
`term "chrominance" refers to those color vectors other
`than the luminance color vectors which provide a basis
`for defining an image.)
`In an important alternative for implementation of the
`invention, three interlaid patterns, (a green-, a red-,
`and a blue-sensitive element pattern) are so arranged
`that green-sensitive elements (serving to detect lumi
`nance) occur at every other array position, with red
`sensitive elements alternating with such green-sensitive
`
`20
`
`65
`
`APPLE v. RED.COM
`
`Page 6 of 10
`
`Apple Ex. 1016
`
`

`

`15
`
`25
`
`30
`
`3,971,065
`3.
`4
`and uniform in two orthogonal directions (e.g., hori
`elements in alternate rows - as in the case for the
`presently preferred implementation. In the remaining
`zontal and vertical), as is readily seen from FIG. 1B.
`element positions, however, blue-sensitive elements
`FIGS. 2A, 2B, and 2C illustrate the advance over
`alternate with red-sensitive elements to produce a lumi
`certain prior art by means of the invention. Referring to
`nance-dominated image sampling having a dispropor
`FIGS. 2A, 2B, and 2C, the distance between rows of
`tion in the chrominance samples favoring red over
`elements in the horizontal and vertical directions is
`blue. With this arrangement, sampling rates for all
`shown for the luminance pattern 2 (FIG. 1A), and for
`prior art striped element patterns (e.g., as would exist
`three basic color vectors are adjusted respective of the
`where a vertically striped filter is superposed on a sen
`acuity of the human visual system. That is, blue detail,
`sor array). Luminance pattern 2 (FIG. 2A) is seen to
`10
`to which the human visual has least resolution, is sam
`provide uniform sampling in the horizontal and vertical
`pled the least frequently . . . green detail, to which the
`human visual system is most responsive, is sampled
`directions, whereas the striped patterns of FIGS. 2B
`most frequently.
`and 2C do not. (Note: FIG. 2B shows a striped arrange
`ment having a numerically similar luminance element
`It will be appreciated from the foregoing that with
`population, and FIG. 2C shows a striped filter of the
`selectively sensitized elements cooperating in interlaid
`type having alternating stripes for each of three basic
`sampling patterns according to the invention, image
`color vectors.) For each row and column of elements,
`information is extracted with an efficient use of sensing
`the FIG. 2A luminance elements (and hence luminance
`elements because relative image sampling rates, by
`samples) occur at regular intervals. Moreover, by
`color, are in effect adjusted respective of the character
`20
`means of the invention, not only the luminance pattern,
`istics of human visual response. Moreover, with the
`but all other patterns (4 and 6, FIG. 1A) of a sensor
`uniformities of such interlaid sampling patterns, desir
`according to the invention become regular and uniform
`able sampling attributes are achieved for a plurality of
`in two orthogonal directions.
`sensing element types (color sensitivities) cooperating
`The preferred luminance pattern as especially desir
`in a color imaging device.
`able sampling qualities which result from the uniform
`The invention is described with reference to the
`ity and orientation thereof. Of the possible patterns
`drawings, wherein:
`including only half of the element positions of a sub
`FIG. 1A is an exploded pictorial representation
`stantially rectangular array, the preferred pattern is the
`showing preferred sensing element patterns for practic
`one that affords the largest useful region of frequency
`ing the invention;
`space, i.e., considering all directions on the array, the
`FIG. 1B is a pictorial representaion corresponding to
`minimum Nyquist limit is largest. Moreover, because of
`FIG. 1A;
`the orientation of the preferred pattern to the major
`FIGS. 2A, 2B, 2C, and 2D are patten representations
`axes, this usable region proves more extensive in the
`teaching a sampling characteristic of preferred forms of
`horizontal and vertical directions . . . those directions
`the invention;
`35
`where the human visual system is said to have greatest
`FIG. 3A is a cross-sectional representation, in part, of
`resolving power.
`a row of sensing elements in accordance with a pre
`To further explain these sampling qualities, reference
`ferred implementation of the invention;
`is made to FIG. 2D, where the sampling frequencies
`FIG. 3B is a cross-sectional representation, in part, of
`and harmonics for the preferred luminance patten are
`a row of sensing elements adjacent the row represented
`graphically illustrated in frequency space. By virtue of
`40
`in FIG. 3A;
`uniformity of the preferred luminance sampling pat
`FIG. 4 is a perspective representation showing a basic
`tern, the horizontal and vertical sampling rates are
`arrangement of elements for a camera system accord
`equal. The Nyquist or usable frequency region, i.e., the
`ing to the invention;
`region including frequencies closer to the origin than to
`FIG. 5 is a diagrammatic representation generally in
`the sampling frequencies, is located in a substantially
`block form illustrating signal processing arrangements
`square portion of the frequency space (indicated by a
`for use in conjunction with sensing arrays according to
`dashed line) having its diagonals aligned with the hori
`the invention; and
`zontal and vertical directions (hence extending further
`FIG. 6 is a planar view of another embodiment of the
`in those directions).
`invention.
`Referring now to FIGS. 3A and 3B, a preferred imag
`Referring now to FIGS. 1A and 1B, there is shown a
`ing apparatus for implementing the invention employs
`set of three sensor patterns 2, 4, and 6, respectively,
`a solid state imaging array 20 of the CCD type com
`which are interlaid to form an image sampling array 8,
`prised of individual sensor elements (e.g., element 22
`each such pattern corresponding to a different basic
`extending between the dashed lines of FIG. 3A). A
`color vector. The pattern 2 (hereinafter referred to as
`filter mosaic 24 is superposed on imaging array 20,
`the luminance pattern) has the highest element popula
`which mosaic includes individual filters (e.g., filter 26)
`tion, and is made up of luminance-sensitive elements
`in one-to-one registration with individual sensor ele
`(denoted Y), which are arranged at every other ele
`ments of the array (e.g., the element 22). Individual
`ment position. With this pattern, it will be appreciated,
`filters of mosaic 24, forming a filter mosaic over the
`luminance elements (and hence luminance samples)
`array 20, are of the selectively transmitting type, and
`occur at half of the element positions of the array and
`are arranged in patterns as described above. The letters
`are uniformly distributed over the entire array. First
`G, R, B on individual filters of mosaic 24 (FIGS. 3A
`and second chrominance patterns 4 and 6 alternate
`and 3B) serve to indicate green, red, and blue light
`with the luminance pattern in alternate rows, respec
`transmission characteristics, respectively, as would be
`tively, to provide a composite sampling array devoid of
`employed according to the presently preferred form of
`65
`overlapping. As a result of this arrangement, sampling
`the invention. Filters selectively transmissive to light in
`of an image, for all three basic color vectors (i.e., lumi
`the green region of the spectrum are utilized in produc
`nance, first and second chrominance), is symmetrical
`ing luminance-sensitive elements, and red and blue
`
`60
`
`45
`
`50
`
`55
`
`APPLE v. RED.COM
`
`Page 7 of 10
`
`Apple Ex. 1016
`
`

`

`:
`
`30
`
`35
`
`40.
`
`3,971,065
`S.
`6
`elements. Through this arrangement, image sampling is
`transmitting filters are used for producing first and
`coordinated to closely match the response of the
`second chrominance-sensitive elements.
`;
`: , , ,
`A selectively sensitive, color imaging element, such
`human visual system; however, it will be appreciated
`as element 26, is formed by each one of filters 24 in
`that separating and storing red and blue image informa
`combination with a corresponding array sensor (for
`tion becomes more complicated when the red and blue
`element 26 the sensor denoted 22). It will be appreci
`patterns differ. . . .
`.
`.
`. . .
`.
`. .
`.
`. .
`. .
`.
`. . .
`.
`. .
`. .
`ated, however, that an array according to the invention
`The invention has been described in detail with par
`might also be formed of sensors having selective wave
`ticular. respect to implementations thereof, but it will
`length sensitivity; or by use of lenticular filters separate
`be appreciated that variations and modifications can be
`from an array of sensor elements, which filters selec
`effected within the spirit and scope of, the invention.
`tively limit the wavelengths of light arriving at
`For example, a variety of sensors might be employed,
`individ
`including the sensors of CCD or CID imaging arrays.
`ual elements of such array.
`3.
`Referring to FIG.4, a color imaging array 30 accord
`Moreover, color-sensitive elements for use in the in
`ing to the invention, is shown in a simplified camera,
`vention may have inherent selective sensitivity or may
`incorporate filters either adjacent to or removed from a.
`environment. Image information from individual rows:
`15.
`broad-wavelength-range sensor, which filters selec
`of the array, such as a row 32, is transferred to a shift
`register 34 (generally formed "on board” the imaging
`tively limit the range of sensitivity for individual sen
`chip) in response to signals from an interrogating appa
`sors. Also, while the invention is cast in the environ
`ratus such as a line scan clock 36. Such operation is
`ment of a camera utilization, it has other uses, for ex
`well known, and apparatus for performing same is de
`ample, in connection with a display device.
`20
`scribed in literature and patents regarding CCD arrays.
`What is claimed is:
`-
`It is also generally known to process the output signal
`1. A color imaging device comprising an array of
`of the register by means of a circuit 38. Using color
`light-sensitive elements, which array includes at least
`imaging arrays according to the invention, however,
`(1) a first type of element sensitive to a spectral region
`corresponding to luminance, (2) a second type of ele
`information for the various base color vectors is inter
`25,
`ment sensitive to one spectral region corresponding to
`spersed as a result of the intermixed sensitivities of the
`color array elements. Accordingly, a switching network
`chrominance, and (3) a third type of element sensitive
`40 is provided to separate the image signal sequence to
`to a different spectral region corresponding to chromi
`a usable form, for example, to parallel green, red, and
`nance, the three types of elements occurring in repeat
`blue video signals.
`ing patterns which are such that over at least a major
`portion of said array luminance-type elements occur at
`In such form, the signals are conveniently converted
`every other element position along both of two orthog
`to NTSC format using a conversion matrix of 2. This is
`especially convenient if the number of rows in the array
`onal directions of said array.
`corresponds to the number of visible lines in a field
`2. A device in accordance with claim wherein said
`scan (approximately 250) or the number of visible lines
`luminance-type elements are sensitive in the green
`in a frame (approximately 500) comprised of inter
`region of the spectrum, and the two types of chromi
`nance elements are sensitive in the red and blue regions
`laced fields.
`A simplified diagram for a switching network 30 is
`of the spectrum, respectively.
`-
`shown in FIG. 5. Sample and hold units 50 and 52 are
`3. An array in accordance with claim 1 wherein the
`employed in alternating operation to separate out, re
`elements are arranged in a substantially rectangular
`spectively, green information and the chrominance
`pattern and the two chrominance types of sensors alter
`nate with the luminance sensors in alternate rows, re
`information. The latter alternates between red and blue
`spectively, of the rectangular pattern.
`with each successive row of the array. Since red infor
`4. A color image sensor comprising:
`mation and blue information is received on an alternat
`', a. a substantially planar array of solid state light-sen
`ingrow basis, such information is stored in a register 54
`45
`for an entire row and shifted out serially as the next
`sitive elements; and
`b. a filter mosaic made up of individual filter ele
`row's luminance information arrives.
`ments which are superposed in one-to-one registry
`To maintain the same output channels for red infor
`on said light-sensitive elements, said mosaic being
`mation and blue information, irrespective of row,
`comprised of a first type offilter element having a
`switching means 56 alternates the output connection
`from the register with each row of output information.
`luminance transparency characteristic, a second
`An important alternative set of patterns for imple
`type of filter element having a transparency char
`menting color imaging arrays according to the inven
`acteristic different from that of said first type, and
`a third type offilter element having a transparency
`tion is shown in FIG. 6. The luminance (green) pattern,
`having elements denoted by a "G', assumes every
`characteristic different from that of said first and
`other array position. A red pattern, having elements
`second types, such filter elements being arranged
`in repeating patterns respective of type with the
`denoted by an "R", alternates with luminance elements
`luminance filters occurring at every other array
`(denoted "B") in alternate rows, and red elements also
`position in two perpendicular directions through
`alternate with blue elements in filling the remaining
`element positions. By this arrangement, blue elements
`out substantially the entire imaging area of the
`contribute only one-eighth of the element population.
`SeSOT,
`... a recognition of the human visual system's relatively
`5. A sensor according to claim 4 wherein the first
`type filters are arranged at every other array position,
`limited ability to discern blue detail. Red detail, to
`which the human visual system is more responsive, is
`and said second and third type filters alternate with the
`sampled at a higher rate than for blue detail by virtue of
`'first type filters in respective alternate rows of the ar
`65
`the relatively greater population of red-sensitive ele
`ray.
`ments. Luminance detail, to which the human eye is
`6. A sensor according to claim 4 wherein the first
`most responsive, is sampled by the largest population of
`type filters occur at every other array position, and the
`
`60.
`
`SO
`
`55
`
`t
`
`APPLE v. RED.COM
`
`Page 8 of 10
`
`Apple Ex. 1016
`
`

`

`element.
`
`m
`
`.
`
`5
`
`15
`
`3,971,065
`7
`8
`third type filters occur in alternate rows at every fourth
`elements, one second-type element, and one third-type
`position, the second type filters occurring at all remain
`ing positions, whereby a hierarchy of distributed sam
`9. A video image sensor according to claim 8 wherein
`pling populations is provided.
`said first-type elements within the individual groups are
`7. A sensor according to claim 6 wherein the first
`aligned in a common diagonal direction.
`type of filter transmits for the green spectral range, the
`10. A video image sensor according to claim 9
`second type of filter transmits for the red spectral
`wherein said first-type element is sensitive to the green
`range, and the third type of filter transmits for the blue
`region of the spectrum, the second-type element is
`spectral range.
`sensitive to the red region of the spectrum, and the
`8. A video image sensor comprising a first type of 10
`third-type element is sensitive to the blue region of the
`element sensitive to a luminance region of the spec
`spectrum.
`trum, and a second and a third type of element sensitive
`11. An image sensor according to claim 8 wherein
`to respective different chrominance regions of the
`individual first-, second-, and third-type elements are
`spectrum, said sensor, over substantially the entire
`comprised of a broad spectrum photoresponsive device
`imaging area thereof, having such elements arranged as
`with a spectrally selective filter superposed in registry
`a mosaic of individual groups of four neighboring ele
`ments in a generally square configuration, which
`therewith.
`groups each include two diagonally-arranged first-type
`
`k
`
`k
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`i
`
`*s-sery re
`
`APPLE v. RED.COM
`
`Page 9 of 10
`
`Apple Ex. 1016
`
`

`

`UNITED STATES PATENT OFFICE
`CERTIFICATE OF CORRECTION
`3,97l,065
`PATENT NO. :
`July 20, 1976
`DATED
`Bryce E. Bayer
`NVENTOR(S) :
`It is Certified that error appears, in the above-identified patent and that said Letters Patent
`are hereby Corrected as shown below:
`
`Column 5, lines 56-60: Change sentence to read: --A red
`pattern, having elements denoted by an "R", alternates
`With blue elements (denoted "B") in alternate rows, and
`red elements fill the remaining element positions. --
`eigned and Sealed this
`Fifth Day of September 1978
`
`SEAL
`
`Attest:
`
`RUTH C. MASON
`Attesting Officer
`
`DONALD W. BANNER
`Commissioner of Patents and Trademarks
`
`
`
`
`
`)
`
`O
`
`APPLE v. RED.COM
`
`Page 10 of 10
`
`Apple Ex. 1016
`
`