Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 1 of 37
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 1 of 37
`
`
`
`
`
`
`EXHIBIT E
`
`
`EXHIBIT E
`
`
`
`

`

`(12) United States Patent
`Sailus et al.
`
`USOO6873.336B1
`(10) Patent No.:
`US 6,873,336 B1
`(45) Date of Patent:
`Mar. 29, 2005
`
`(54) COMPUTER SOFTWARE PRODUCT AND
`METHOD FOR ORGANIZING AND
`MANIPULATING OF IMAGES
`
`(75) Inventors: Andrew Sailus, Brockport, NY (US);
`Kenneth D. Corby, Rochester, NY
`(US); Carl A. Testa, Rochester, NY
`(US); Leanne M. CapoZZi, Ontario, NY
`(US); Allen K. Tsaur, Shanghai (CN);
`Dale F. McIntyre, Rochester, NY (US)
`(73) Assignee: Eastman Kodak Company, Rochester,
`NY (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C 154(b) by 426 days
`a --
`
`(*) Notice:
`
`(21) Appl. No.: 09/641,102
`(22) Filed:
`Aug. 17, 2000
`(51) Int. Cl. .................................................. G09G 5/00
`(52) U.S. Cl. ........................ 345/581; 34.5/589; 34.5/619
`(58) Field of Search ................................. 345/581,582,
`34.5/589, 619, 620; 358/302, 403
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`5,506,946 A * 4/1996 Bar et al. ................... 345/600
`5,633,733 A 5/1997 Miyazawa
`5,666.215 A 9/1997 Fredlund et al.
`5,680,223 A 10/1997 Cooper et al.
`5,684610 A 11/1997 Brandestini et al.
`5,696,850 A 12/1997 Parulski et al.
`5,703,701. A 12/1997 Yamamoto et al.
`
`
`
`1/1998 Dwyer et al.
`5,706,457 A
`5,751,451 A 5/1998 Ogoshi et al.
`5,754,308 A 5/1998 Lopresti et al.
`5,760,916 A 6/1998 Dellert et al.
`5,760,917 A 6/1998 Sheridan
`5,764,368 A 6/1998 Shibaki et al.
`5,764870 A 6
`2 - 2
`f1998 Manico et al.
`5,768,444 A 6/1998 Nishimura
`5,778,109 A
`7/1998 Morigami
`5,786,904 A 7/1998 Narita
`5,799,113 A
`8/1998 Lee ............................ 382/256
`5,799.219 A 8/1998 Moghadam et al.
`5,801,856 A 9/1998 Moghadam et al.
`5,828.461. A 10/1998 Kubo et al.
`5,838,457 A 11/1998 Umemoto
`5.841,885. A 11/1998 Neff et al.
`5,862.297 A : 1/1999 Timmermans
`5,864,411 A 1/1999 Norris ........................ 358/527
`5,926.288 A 7/1999 Dellert et al.
`5.937,107 A
`8/1999 KaZami et al.
`5,949,551 A 9/1999 Miller et al.
`* cited by examiner
`Primary Examiner Matthew C. Bella
`Assistant Examiner-G. F. Cunningham
`(74) Attorney, Agent, or Firm-Frank Pincelli
`(57)
`ABSTRACT
`
`A computer Software product and method of organizing and
`manipulating a plurality of images captured in a variety of
`different circumstances and over a period of time. The
`images can be automatically manipulated So as to improve
`the Visual appeal between imageS. The Software product
`allows a user to Select imageS for placement into at least one
`OU
`grOup.
`
`8 Claims, 25 Drawing Sheets
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 2 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 1 of 25
`
`US 6,873,336 B1
`
`14
`
`ORGANIZE
`
`ShP PLACE
`ORDER
`
`8
`
`SCAN
`
`PROCESS
`MAGE
`
`STORAGE
`
`16
`
`20
`
`PROCESS MAGNG
`PRODUCTS
`
`23
`
`24
`
`CUSTOMER
`REVIEW
`
`SORAGE
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 3 of 37
`
`26
`
`FULF ORDERS
`
`RETURN ORDERS
`
`30
`
`RE-ORDER
`
`25.
`
`28
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 2 of 25
`
`US 6,873,336 B1
`
`40
`
`CUSTOMER
`COLLECTS PRINTS
`
`42
`
`46
`
`GROUP
`MAGES
`
`YES
`
`
`
`CUSTOMER
`ORDERS KT
`
`
`
`48
`
`Ear
`
`NO
`
`CUSOMER PUS
`PRINTS8, SEPARATORS
`NSHIPPING BOX
`
`
`
`44
`
`CUSOMER PACES
`ENVELOPES OR OOSE
`IMAGES IN SHIPPING BOX
`
`284
`
`USOMER PACES
`RE iN GROUPS
`
`CUSTOMER FLS
`OUT ORDER FORM
`
`86
`
`28O
`
`customer PLACES
`MAGES IN SEPARATORS
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 4 of 37
`
`282
`
`CUSTOMER LABELs
`SEPARATORS
`
`CUSOMERSHPS
`OR CARRESTO
`SERVICE PROVIDER
`
`288
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 3 of 25
`
`US 6,873,336 B1
`
`
`
`sy
`CUSTOMER INSTRUCTIONS
`
`THIS KIT INCLUDES:
`
`PRE-PRINTED LABELS
`
`CONTAINER 1\ 54
`PRINT COUNTESTIMATING TOOL N 54
`
`ENVELOPES 1 \-54
`
`ORDER SHEET --
`INSTRUCTION CARD -Nus
`GETTING ORGANIZED --
`
`STEP #1
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 5 of 37
`
`FIG. 3
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 4 of 25
`
`US 6,873,336 B1
`
`PRE-PRINTED LABEL
`PROVIDED AFTER 1ST ORDERFLLED
`CAN BE USED INSEAD OF MANUALLY
`COMPLETING ORDER CARD
`50
`
`
`
`ORDER CARD
`
`|||||
`
`NAME: JOE SAMPLE
`ADDRESS:
`123 MAN STREET
`ANYTOWN, NY14624
`TELEPHONE NUMBER: (543) 555-1515
`NAME III DIL E-MAIL ADDRESS, JSORRCOM
`ADDRESS ID
`YOUR WEBACCOUNT # JSAMPLEGKODAK.COM
`TELEPHONE NUMBER
`E-MAIL ADDRESS
`UPLOAD TO ACCOUNTREPRINTS
`IMAGE QTY SIZE
`
`IMAGE CD
`PLACE ALLON CD
`
`ALBUM (S)
`ALBUM (S) IN ORDER
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 6 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 5 of 25
`
`US 6,873,336 B1
`
`
`
`
`
`
`
`(MOEG HEXOLIS NOHYWBOHNIINITOOOV EOWT3) NOLLYWHOHNIINTIOQOY
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 7 of 37
`
`EEE
`
`89
`
`||||||||||||||||||||||
`
`Z?
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 6 of 25
`
`US 6,873,336 B1
`
`
`
`FIG 6B
`
`INSTRUCTION CARD
`
`|
`Griffith
`
`VACATION 1999
`
`86
`
`FOLDERNAME (ENTERALL SPACES)
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 8 of 37
`
`

`

`Mar. 29, 2005
`
`Sheet 7 of 25
`
`US 6,873,336 B1
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 9 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 8 of 25
`
`US 6,873,336 B1
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 10 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 9 of 25
`
`US 6,873,336 B1
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 11 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 10 of 25
`
`US 6,873,336 B1
`
`
`
`Label:What would you tike to name
`this group of pictures?
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 12 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 11 of 25
`
`US 6,873,336 B1
`
`
`
`3
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 13 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 12 of 25
`
`US 6,873,336 B1
`
`
`
`
`
`
`
`
`
`
`
`S&S
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 14 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 13 of 25
`
`US 6,873,336 B1
`
`Container for
`Labels
`
`
`
`Container for
`index Cards
`
`
`
`Indexing
`
`
`
`Expandable
`Foldiers
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 15 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 14 of 25
`
`US 6,873,336 B1
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 16 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 15 of 25
`
`US 6,873,336 B1
`
`
`
`ON
`ON
`ON
`were
`
`.9
`d
`s
`D
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 17 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 16 of 25
`
`US 6,873,336 B1
`
`Á º
`
`
`
`666), UO||BOBA
`
`||||||||||||||||||||
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 18 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 17 of 25
`
`US 6,873,336 B1
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 19 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 18 of 25
`
`US 6,873,336 B1
`
`tn
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 20 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 19 of 25
`
`US 6,873,336 B1
`
`
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 21 of 37
`
`s
`D
`s
`d
`
`C
`8.
`wa g
`s
`8. A
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 20 of 25
`
`US 6,873,336 B1
`
`
`
`A stack of
`photographic
`prints
`
`Print count
`estimating
`tool
`
`- 272
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 22 of 37
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 21 of 25
`
`US 6,873,336 B1
`
`
`
`292
`
`322
`292
`
`322
`292
`
`322
`292
`
`322
`2.
`
`CUSTOMER ORDER FORM
`
`TYPES OF GOODS SERVICES
`Oy HARD COPY OUTPUT
`HIll ALBUMPAGES
`O|| NUMBER OF IMAGES PER PAGE
`LIH
`DOUBLESIDE
`DIII
`SEZE OF IMAGE
`III
`AUTO SELECT
`DHII
`ALSAME SIZE PER PAGE
`|NORDER PROVIDED
`
`HARD COPY PRINT
`NUMBER OF PRINTS
`
`| DSA. OUTPUT
`| ON LINE
`COMPUTER DISK
`O SPECIALTY PRODUCT
`
`CUSTOMERNAME, ADDRESS, E-MAIL, PHONE NUMBER
`
`METHOD OF PAYMENT
`
`SEND TO:
`A) CUSTOMER
`B) THIRD PARTY ADDRESS
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 23 of 37
`
`324 - - 1376GH
`
`|
`
`FIG. 21
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 22 of 25
`
`US 6,873,336 B1
`
`354
`
`Fig. 22
`
`SP
`
`Customer
`Order
`
`300
`
`332
`
`352
`
`333
`
`4
`Order Customer Machine
`D
`Readable LE
`Code
`
`
`
`340
`
`364
`
`High Speed
`Dual Sided
`Scanner
`
`Output Device
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 24 of 37
`
`362 N
`
`
`
`Data Storage
`Memory Device
`
`Image
`Data
`Manager
`
`Central
`Computer
`
`342
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 23 of 25
`
`US 6,873,336 B1
`
`
`
`370 \
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 25 of 37
`
`FIG. 23A
`
`372
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 24 of 25
`
`US 6,873,336 B1
`
`370
`
`381
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 26 of 37
`
`383
`
`385
`
`FIG. 23B
`
`374
`
`

`

`U.S. Patent
`
`Mar. 29, 2005
`
`Sheet 25 of 25
`
`US 6,873,336 B1
`
`Fig. 24
`
`
`
`Order Scan Kit here...
`
`last name
`
`first name
`
`address 1
`C
`address2
`
`phone number
`
`email address
`
`city
`
`State
`
`Zip Code
`Label Categories
`
`Picture Quantity to Scan
`
`Mom
`Birthday
`Christmas
`Easter
`Vacation
`Other...
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 27 of 37
`
`

`

`US 6,873,336 B1
`
`1
`COMPUTER SOFTWARE PRODUCT AND
`METHOD FOR ORGANIZING AND
`MANIPULATING OF IMAGES
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`U.S. Ser. No. 09/640,642, filed concurrently herewith, of
`Carl A. Testa, Andrew Sailus, Kenneth D. Corby, Leanne M.
`Capozzi, Dale F. McIntyre and Joseph A. Manico, entitled
`“A PRODUCT AND METHOD FOR ORGANIZING AND
`SEARCHING DIGITAL IMAGES”;
`U.S. Ser. No. 09/641,030 filed concurrently herewith, of
`Leanne M. Capozzi, Andrew Sailus, Kenneth D. Corby, Carl
`A. Testa and Dale F. McIntyre, entitled “AKIT FOR USE IN
`ORGANIZING IMAGES”;
`U.S. Ser. No. 09/640,807 filed concurrently herewith, of
`Kenneth D. Corby, Andrew Sailus, Carl A. Testa, Leanne M.
`Capozzi and Dale F. McIntyre, entitled “METHOD APPA
`RATUS AND SYSTEM FOR ORGANIZING CAPTURED
`DIGITAL IMAGES”;
`U.S. Ser. No. 09/640,949, filed concurrently herewith, of
`Andrew Sailus, Kenneth D. Corby, Carl. A. Testa and
`Leanne M. Capozzi entitled “A SYSTEM FOR DETER
`MINING THE COSTS OF GOODS AND SERVICES
`25
`THAT HAVE BEEN ORGANIZED.
`
`15
`
`FIELD OF THE INVENTION
`The present invention relates to the organizing of images.
`In particular to a method, System and apparatus for auto
`matically organizing a large number of images that may be
`obtained from a variety of different Sources.
`BACKGROUND OF THE INVENTION
`For years consumerS have been taking pictures. Up until
`recently most pictures were produced as hard copy prints.
`These prints were taken at various personal and professional
`occasions, often having great Sentimental value to the taker
`and the people associated therewith. Often these pictures
`would be taken and viewed shortly thereafter. Due to the
`relatively inexpensive nature of taking photographs, people
`have often taken many photographs over the years. While
`Some attempts have been made in trying to organize the
`images and pictures taken by consumers, often due to the
`extensive amount of pictures taken, the photographic prints
`are Stored into various containerS Such as shoe boxes in
`random fashion. Thus, over the course of many years, people
`often Store hundreds of pictures in boxes where the images
`are not placed in any particular order or organization. While
`Some attempts have been made to allow organization of
`newly captured images, very little has been done with regard
`to Stored hardcopy print images. They are simply Stored in
`Shoeboxes. Typically, the only thing available for Sorting and
`organizing of these images is for the consumer to go through
`the pile of Stored pictures and manually place individual
`pictures into photo albums. This is a difficult and arduous
`process. Thus, little headway is usually made in organizing
`these photographic prints. Further, there is no easy way of
`organizing the past prints with new prints that are taken.
`Typically, images must be Sorted with respect to the time
`frame to which they are taken. There is no easy way of being
`able to Sort and organize images that have been taken over
`an extended period of time or from a variety of Sources, for
`example, multiple rolls of film. In addition, there is no easy
`way for organizing images from different types of Sources,
`Such as, digital images that are Stored on line, in cameras,
`photographic prints etc.
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 28 of 37
`
`2
`Thus, there is a need to provide a method and System for
`the organizing of images by consumer.
`SUMMARY OF THE INVENTION
`In accordance with one aspect of the present invention
`there is provided a method of manipulating a plurality of
`images captured in a variety of different circumstances and
`over a period of time,
`organizing the images in accordance with a predetermined
`criteria;
`automatically manipulating the plurality of images So as
`to improve the Visual appeal between Said plurality of
`images by providing a common look among Said plu
`rality of images, and
`placing the images in a product in accordance with the
`predetermined criteria.
`In accordance with Still another aspect of the present
`invention there is provided a computer Software product
`which when loaded onto a computer will cause the computer
`to, organize a plurality of images into pre-Selected grouping,
`the computer program doing a best fit for grouping of the
`images with respect to a Selected product.
`These and other aspects, objects, features and advantages
`of the present invention will be more clearly understood and
`appreciated from a review of the following detailed descrip
`tion of the preferred embodiments and appended claims, and
`by reference to the accompanying drawings.
`BRIEF DESCRIPTION OF THE DRAWINGS
`In the detailed description of the preferred embodiments
`of the invention presented below, reference is made to the
`accompanying drawings in which:
`FIG. 1 is flow chart of a system made in accordance with
`the present invention;
`FIG. 2 is a flow chart of one of the steps in the system of
`FIG. 1;
`FIG. 3 illustrates an instruction sheet for use in a kit made
`in accordance with the present invention;
`FIG. 4 illustrates an order form (card) for use in a kit made
`in accordance with the present invention;
`FIG. 5 illustrates a modified order form for use in a kit
`made in accordance with the present invention;
`FIG. 6A illustrates an instruction form for use in a kit
`made in accordance with the present invention;
`FIG. 6B illustrates a sheet having paired sticker icons;
`FIG. 7 illustrates a container and an organization folder
`for use in a kit made in accordance with the present
`invention;
`FIG. 8 illustrates a modified kit made in accordance with
`the present invention;
`FIG. 9 illustrates another kit made in accordance with the
`present invention;
`FIG. 10 illustrates another modified kit made in accor
`dance with the present invention;
`FIG. 11 illustrates yet another modified kit made in
`accordance with the present invention;
`FIG. 12 illustrates the container of the kit of FIG. 11 in the
`closed position;
`FIG. 13 illustrates still another kit made in accordance
`with the present invention;
`FIG. 14 illustrates a modified kit similar to the kit of FIG.
`13 also made in accordance with the present invention;
`FIG. 15 illustrates a label that maybe used in the practice
`of the present invention;
`
`

`

`3
`FIG. 16 illustrates the label of FIG. 15 placed on a print;
`FIG. 17a-d illustrates a modified container in various
`positions for holding hard copy documents which is
`designed to mate with a Scanner;
`FIG. 18 illustrates a carrier for holding a hard copy
`document for feeding of the document into an automatic
`feed Scanner;
`FIG. 19 illustrates a modified carrier for holding a hard
`copy document for feeding of the document into an auto
`matic feed Scanner;
`FIG. 20 illustrates a tool for measuring the number of
`document to be Scanned;
`FIG. 21 illustrates yet another customer order form made
`in accordance with the present invention;
`FIG. 22 illustrates a block diagram of a system for
`ordering of goods and Services in accordance with the
`present invention;
`FIGS. 23A and 23B illustrate a plan view of an album
`page ordered in accordance with the present invention; and
`FIG. 24 is a plan view of a display Screen on a display
`device.
`
`15
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`Referring to FIG. 1 there is illustrated a flow chart of the
`various Steps in a System for organizing images in accor
`dance with the present invention. The first Step 14 comprises
`the obtaining and organizing of the images. The images may
`be obtained from a variety of different sources. The images
`may be obtained by digital Scanning of hard copy documents
`Such as photographic prints, film negatives, document draw
`ings etc. A Second Source from which images can be
`obtained may be from digital Sources Such as digital
`cameras, photo CDS, computer diskS, E-mail and on-line
`SOUCCS.
`After the appropriate images have been obtained, they are
`organized. If the images are in the form of hard copy prints
`they can be digitally Scanned So as to obtain a digital record
`of the images and then organized. An automatic Scanner
`such as described in co-pending U.S. Ser. No. 09/641,103
`filed concurrently herewith entitled “Digital Scanner”, of
`Kenneth D. Corby et al. which is hereby incorporated by
`reference. However, if the hardcopy prints are organized in
`groups (categories) by the customer prior to Scanning, the
`Scanning can proceed more efficiently and minimize fiber
`organization down the line thus Significantly reducing the
`cost to organize the images. In addition the Scanning proceSS
`may be used to provide instructional and additional infor
`mation to be implemented or associated with the hard copy
`images. Various methods by which these hard copy prints
`may be organized will be discussed in further detail later
`herein.
`The next Step 16, after the images have been obtained and
`organized, is for a customer to place an order for goods
`and/or Services as desired. The output goods and/or Services
`can take a variety of forms, for example but not by way of
`limitation, CDS having images, photo-album pages, images
`uploaded to the Internet for access by customer and third
`parties, reprints, creative gifts, Such as T-shirts, mugs etc.
`wherein personal images are placed or for any other Service
`or product that might be deemed appropriate. These orders
`may be placed by the customer at a variety of locations and
`by various manners. For example, they can be placed by
`Simply filling out a form or by a retail representative taking
`the customer order personally or by having the order
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 29 of 37
`
`US 6,873,336 B1
`
`4
`obtained at the same time images are being Scanned.
`Additionally, orders may be placed over the Internet, by
`phone or by any other appropriate means as will be dis
`cussed later on herein.
`At Step 18, the digital images of the imageS provided at
`step 14 are obtained by a service provider. The digital
`images may be obtained by Scanning of the hard copy prints,
`Slides, negatives, and other memorabilia, received over the
`Internet or obtained from other digital memory devices
`having digital images. A more detailed description on how
`the images in Step 18 may be obtained is also discussed later
`herein.
`After the obtainment of the image data at Step 18, at Step
`20 the images are processed in accordance with the customer
`order. This includes the digital manipulation of the digital
`images and/or the obtainment of associated information.
`Some examples, but not by way of limitation, would be,
`red-eye removal, auto-grouping, texturing, adding of content
`and meta-data and then Sent to digital Storage at Step 22.
`After Step 22, the digital images may be sent to for
`producing of a product or Service at Step 23 or Sent in digital
`form for later use by the service provider and/or for allowing
`the customer to have access at Step 24. For example, at Step
`24, the digital Storage image may be reviewed by the
`customer or a professional for determining whether or not
`additional customization is required. For example, Such
`review may be accomplished by providing to the customer
`with a proofing Set of the proposed products to be produced
`and allowing the customer to make final Selections as to the
`goods and/or services to be ordered. After review by the
`customer the digital data can be sent to Storage at Step 25.
`At Step 26, the ordered goods and/or Services are then
`produced or provided in accordance with the order instruc
`tions and any additional instructions obtained during any
`review that may have taken place. AS previously discussed,
`the final output can take a variety of forms and will be
`discussed in greater detail later herein.
`At Step 28, the customer receives the ordered the output
`goods and/or Services. The organized Supplied Source docu
`ments are also returned to the customer.
`At Step 30, the customer may then place an additional
`order or reorder of the images that have been Stored at Step
`22. Because the images have been Stored in digital format,
`the ordering and/or reorganizing of the images may be
`enabled in a quick and efficient manner.
`In order to better understand the present invention, each
`of the above Steps will now be discussed in greater detail.
`Referring to step 14, various methods are available for
`obtaining of images. AS previously discussed, the initial
`imageS provided may be hard copy prints/documents which
`come in a variety of different forms or the images may be
`provided in digital (electronic) form. Also during this phase,
`personal data for entering of these orders may be obtained,
`for example, the name, phone number, address of the cus
`tomer and method of payment. If payment is to be by credit
`card, a credit card number may also be provided. A customer
`billing account may be established or confirmed. Once, the
`customer has established and decided on what is to be
`ordered and what images are going to be obtained from the
`desired Sources, the next Step would be to organize the
`images.
`Referring to FIG. 2, there is illustrated a flow chart of the
`organizational Step 14. In the first Step 40, a customer
`gathers the desired images. In the particular embodiment
`illustrated, the customer may gather hard copy prints, Such
`as photographic prints, and organizing according to desired
`
`

`

`S
`categories. However it is to be understood that the customer
`is not limited to providing of hard copy prints, and the
`images may be provided in a variety of different formats. For
`example but not by way of limitation, film, compact disc,
`camera memory card, digitally over a communication net
`work. However, for the sake of simplicity in describing the
`present invention, the following discussion will be directed
`a System wherein the imageS provided in the form of hard
`copy prints that are capable of being digitally Scanned.
`In the illustrated method, the next step 42 would be for the
`customer to group the hard copy images into desired clas
`sifications (categories) at Step 42. This grouping at this point
`while not necessary may prove very useful in minimizing
`cost and later organization by the customer. Preferably the
`images are grouped in the order in which they will be
`Scanned. The customer need not provide this grouping if it
`is of no interest to the customer. After the customer has
`completed the desired grouping, if any, the hard copy prints
`are placed into a shipping box at Step 44 and delivered to a
`Service provider. The Service provider could simply be a
`retail establishment in the business of providing photofin
`ishing Services.
`If the customer desires to group the images into desired
`categories, the customer would obtain a customer's orga
`nizing kit at Step 46. This may be done by ordering the kit
`through the mail, over the phone, over the Internet or simply
`picking up a customer order kit at a retail establishment. If
`the kit is ordered from the internet, a simple Hyper Text
`Markup Language (HTML) form can be provided which
`permits the customer to input content specific to that cus
`tomer which are to be printed on labels that are delivered
`with the kit. FIG. 24 illustrates an example of a screen
`display that could be electronically transmitted to the user.
`AS illustrated the user can order the desired categories from
`list 402 or even customize personal categories by the Selec
`tion of the “Other” category in list 402. After customers
`receive the kit labels that are provided in the kit, the
`customer may add other valuable information Such as the
`“who”, “what”, “when” and “why” related to the images.
`These labels may be preprinted with common categories or
`left blank for the customer to provide customized categories
`by writing in the desired information. This added informa
`tion allows the customer to organize and easily Search for
`Specific imageS when this informational data is Saved with
`the images.
`At step 48 the customer receives the kit and at step 50, the
`customer places the images in the desired groups which may
`be established by the customer and/or selected from a
`plurality of predefined categories Such as Stickers.
`FIGS. 3-20, there is illustrated various kits and parts of
`kits that may be used in organizing images and for ordering
`of related goods and/or Services.
`Referring to FIG. 3 there is illustrated a customer instruc
`tion sheet (form) 52 for use in a kit in accordance with the
`present invention. The instruction sheet includes various
`types of information 54 printed thereon. For example, the
`information 54 can include what is included in the kit. In the
`particular embodiment illustrated, the kit may include pre
`printed labels, a container, envelopes, order sheets, order
`form and an image instruction form. While in the particular
`embodiment illustrated, the instructions would typically be
`provided on a hard copy document, the instructions may be
`provided in an audio or visual format.
`FIG. 4 illustrates an order form 56 that would be used in
`ordering goods and/or Services with respect to the images
`being Submitted. As can be seen, the order form 56 includes
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,873,336 B1
`
`6
`an area 58 whereby identifying information of the customer
`may be placed herein. Such information may include, but
`not by way of limitation, name, address, telephone number
`and e-mail address. In the particular embodiment illustrated,
`an order form 56 may be provided with a pre-printed label
`60 having the same human readable information, but in
`addition, includes a machine readable barcode 62 which can
`be used by order Scanning equipment for automatically
`obtaining the personal information of the customer in a
`quick and efficient manner. The order form 56 includes an
`additional area for providing instructions as to what is to be
`done with the digital images that are obtained. In the
`particular embodiment illustrated, four options are provided
`for. The first option 64 is to upload the images to an e-mail
`Storage account. A Second option 66 is for ordering of hard
`copy prints of the images. An appropriate Space is provided
`for identifying the quantity and Size of the hard copy prints.
`It is of course understood that any desired format may be
`used for ordering an image of any particular type and size.
`Third option 68 allows for the images to be provided on a
`CD (compact disc) product whereby all or some of the
`images may be placed. The CD may be a new or existing
`CD. The last option 70 is for ordering album pages of the
`imageS. Option 70 may include simply placing the images in
`the album pages in the order that they were organized in the
`organizing kit. It is of course understood that any desired
`types of goods and/or Services may be provided.
`Referring to FIG. 5, it is a modified order form 72. The
`order form 72 is similar to that order form 56 with like
`numerals indicating like parts and operations. In this
`embodiment the order form 72 includes the ability for
`providing instructions in a machine readable form So that it
`can be Scanned and automatically implemented. In
`particular, the instructions may be provided on a computer
`Storage medium Such as a floppy disk Submitted with the
`order form 72. Additionally the instruction software may be
`located at a designated E-Mail address which can be
`addressed over the internet or other communication net
`work. Instructions may be provided, as discussed later
`herein, by a Software program provided by the Service
`provider to the customer such that the instructions will be in
`a format that can be Scanned and associated with the images
`provided therewith.
`Referring to FIG. 6A, there is illustrated an image instruc
`tion form 74. The image instruction form 74, in the embodi
`ment illustrated, is designed to be Scanned for obtaining the
`information thereon. The form 74 is preferably placed in
`front of a Single hard copy print or group of hard copy prints
`that are to be Scanned. The image instruction form 74 has a
`machine readable code 76 that provides meta-data regarding
`the image or images that follow. In the particular embodi
`ment illustrated, the code 76 would State that the images are
`associated with “vacation 1999'. The code 76 may take a
`variety of machine readable forms, for example: a bar code,
`two dimensional code, or even a color which is representa
`tive of a code. This information would be associated with
`grouped images that follow. AS illustrated, a human readable
`text 77 of what is present in code 76 is also provided for the
`convenience of the customer and also serves as a check on
`what the code 77 will provide. The instruction form 74 also
`has a location 78 whereby an event or other personal
`information can be associated there with. For example, a
`pre-printed Sticker form 80, as illustrated by FIG. 6B, may
`be provided having a plurality of sticker icons 82, 83, 84
`each indicating a particular event. For example, the Sticker
`icons 82 indicate that the image is to be associated with a
`birthday, sticker icon 83 is associated with a holiday such as
`
`Case 6:20-cv-06263-FPG Document 1-5 Filed 04/23/20 Page 30 of 37
`
`

`

`US 6,873,336 B1
`
`15
`
`40
`
`45
`
`50
`
`25
`
`7
`Christmas, and Sticker icon 84 is associated with a place
`Such as a theme park. These icons may have been obtained
`from a theme park or other place that has pre-registered with
`the Service provider the icon and what it is to be associated
`with the icon. Icon Stickers have meta-data associated with
`them including but not limited to information Such as
`Statistics related to the park, Statistics related to specific rides
`like the roller coaster, park location etc. Pre-printed labels
`representing common data would be linked So that all
`asSociated images would end up in a common location or
`folder. Thus when the icon is Scanned, preprogrammed
`information may be associated with the image or images. It
`is of course to be understood that the Sticker icons may be
`asSociated with a variety of different events, individuals, or
`places not illustrated. A Single event icon will be placed on
`the instruction form and that meta-data will be associated
`with the images that follow the instruction card. The icon is
`of Such a nature that it can be read during Scanning and or
`automatically associated with an image.
`The image instruction form 74 of FIG. 6A also includes
`writing areas 86, 88 and 89 for providing of information that
`can be read by either a human or a machine and added as
`meta-data with regard to the images that follow. A Single
`letter is handwritten into each block of these writing areas
`86, 88, and 89. When the image instruction form 74 is
`Scanned prior to the group of hardcopy prints, commonly
`available Software can be employed to convert the hand
`written letters of writing areas 86, 88, and 89 into ASCII
`characters for Storage as meta-data associated with the
`Scanned hardcopy prints. This Software technique is called
`optical character recognition (OCR) and is