I lllll llllllll Ill lllll lllll lllll lllll lllll 111111111111111111111111111111111
`US007173651Bl
`
`c12) United States Patent
`Knowles
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 7,173,651 Bl
`Feb.6,2007
`
`(54) APPARATUS AND SYSTEM FOR PROMPT
`DIGITAL PHOTO DELIVERY AND
`ARCHIVAL
`
`(76)
`
`Inventor: Andrew T. Knowles, 521 W. Aycock
`St., Raleigh, NC (US) 27608
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`5,768,633 A * 6/1998 Allen et al. ................. 396/310
`9/1998 Hull
`5,806,005 A
`5,852,722 A * 12/1998 Hamilton .................... 709/221
`5,861,918 A
`1/1999 Anderson
`5,864,684 A *
`1/1999 Nielsen ...................... 709/206
`5,917,542 A
`6/1999 Moghadam
`5,966,446 A * 10/1999 Davis .......................... 380/25
`5,974,401 A * 10/1999 Enomoto et al.
`........... 396/310
`12/1999 Steinberg
`6,006,039 A
`
`(21) Appl. No.: 09/324,249
`
`(22) Filed:
`
`Jun.2, 1999
`
`(Continued)
`
`Primary Examiner-Aung Moe
`
`Related U.S. Application Data
`
`(57)
`
`ABSTRACT
`
`(60) Provisional application No. 60/087,745, filed on Jun.
`2, 1998.
`
`(51)
`
`Int. Cl.
`H04N 51225
`(2006.01)
`H04N 51232
`(2006.01)
`(52) U.S. Cl. ................................. 348/207.1; 348/211.2
`(58) Field of Classification Search ............. 348/207.1,
`348/207.11, 211.1-211.6, 211.14, 143, 14.01,
`348/14.04, 14.12, 552, 231.99, 333.02, 333.11,
`348/211.11, 206, 204, 203; 455/517, 557,
`455/556.1, 66.1, 566, 419; 396/2, 297, 310;
`709/203-204, 206-207, 219, 238; 707/3,
`707/10
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`11/1989 Morris
`4,884,132 A
`5/1997 Parulski
`5,633,678 A
`9/1997 Parulski
`5,666,159 A
`5,689,642 A * 11/1997 Harkins et al . ............. 709/207
`5,712,679 A
`1/1998 Coles
`3/1998 Purdy
`5,726,660 A
`5,734,903 A * 3/1998 Saulpaugh et al . ......... 709/238
`5,737,491 A * 4/1998 Allen et al. .............. 348/211.3
`5,760,916 A * 6/1998 Dellert et al. . . . . . . . . . . . 348/211.11
`5,760,917 A * 6/1998 Sheridan ..................... 396/429
`
`The invention comprises a wireless camera apparatus and
`system for automatic capture and delivery of digital image
`"messages" to a remote system at a predefined destination
`address. Initial transmission occurs via a wireless network,
`and the apparatus process allows the simultaneous capture of
`new messages while transmissions are occurring. The des(cid:173)
`tination address may correspond to an e-mail account, or
`may correspond to a remote server from which the image
`and data can be efficiently processed and/or further distrib(cid:173)
`uted. In the latter case, data packaged with the digital
`message is used to control processing of the message at the
`server, based on a combination of pre-defined system and
`user options. Secured Internet access to the server allows
`flexible user access to system parameters for configuration
`of message handling and distribution options, including the
`option to build named distribution lists which are down(cid:173)
`loaded to the wireless camera. For example, configuration
`data specified on the server may be downloaded to the
`wireless camera to allow users to quickly specify storage
`and distribution options for each message, such as archival
`for later retrieval, forwarding to recipients in a distribution
`list group, and/or immediate presentation to a monitoring
`station for analysis and follow-up. The apparatus and system
`is designed to provide quick and simple digital image
`capture and delivery for business and personal use.
`
`5 Claims, 18 Drawing Sheets
`
`150---\ 150--\
`16Q-,\
`
`170-_/
`
`196
`
`--110·
`
`UNIFIED PATENTS INC.
`EX1001
`Page 1 of 28
`
`

`
`US 7,173,651 Bl
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`6,009,336 A * 12/1999 Harris et al. ................ 455/566
`6,018,774 A
`1/2000 Mayle
`6,023,345 A *
`212000 Bloomfield ................. 358/402
`6,037,991 A *
`3/2000 Thro et al. .................. 348/443
`3/2000 Mattes
`6,038,295 A
`6,104,430 A *
`8/2000 Fukuoka ..................... 348/552
`6,166,729 A * 12/2000 Acosta et al ................ 709/219
`6,167,283 A * 12/2000 Korpela et al. ............. 455/525
`6,167,469 A * 12/2000 Safai et al. .............. 348/211.3
`1/2001 Coles
`6,181,373 Bl
`6,181,954 Bl
`1/2001 Monroe
`6,223,190 Bl*
`4/2001 Aihara et al. ............... 348/552
`9/2001 Dowdy et al. ......... 348/231.99
`6,295,082 Bl *
`
`6,381,592 Bl*
`6,396,537 Bl *
`6,427,078 Bl*
`6,642,959 Bl
`6,657,702 Bl*
`6,715,003 Bl *
`2001/0022618 Al*
`2001/0029178 Al *
`2002/0057340 Al*
`2002/0122061 Al*
`200210167 595 Al *
`2003/0025808 Al
`2003/0142215 Al
`* cited by examiner
`
`412002 Reuning ...................... 707/10
`.............. 348/239
`512002 Squilla et al.
`712002 Wilska et al. ............ 348/14.02
`11/2003 Arai
`12/2003 Chui et al. .................. 396/429
`3/2004 Safai ........................... 710/33
`9/2001 Ward et al. ................. 348/552
`10/2001 Criss et al.
`................. 455/419
`512002 Fernandez et al ........... 348/143
`912002 Martin, Jr. et al.
`......... 345/762
`11/2002 Patel et al. . ............. 348/211.3
`212003 Parulski
`7/2003 Ward
`
`UNIFIED PATENTS INC.
`EX1001
`Page 2 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 1 of 18
`
`US 7,173,651 Bl
`
`150-~ 150-~
`\
`\
`
`160-\
`
`\
`
`170
`
`E3D
`D
`D
`I
`'-~-140
`
`130
`
`260
`
`196
`
`''-194
`
`~-192
`...______,\_~- 11 0
`
`\
`
`1~~120
`
`DD D/~-1ao
`
`~-260
`
`100
`
`110'
`
`FIG. 1
`
`UNIFIED PATENTS INC.
`EX1001
`Page 3 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 2 of 18
`
`US 7,173,651 Bl
`
`~210
`
`.. /~220
`
`I
`
`I
`I
`I
`
`Camera
`
`Memory
`
`/
`
`110
`
`DSP
`
`-
`
`Interface
`
`/
`
`I
`260~~_)
`
`MP
`
`Comm
`
`/
`/ -
`I--+--+-\""-, .........
`\,~250
`
`\
`I
`\
`\
`\
`1~~240
`
`FIG. 2
`
`UNIFIED PATENTS INC.
`EX1001
`Page 4 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 3 of 18
`
`US 7,173,651 Bl
`
`310
`
`1~-312
`
`•
`
`3BR2BA
`ALL
`FAMILY
`MANSE
`BB
`JBOB
`JDOE
`JDOE2
`JEFF
`REGAN
`TB
`CUSTOM
`HOLD
`
`FIG. 3
`
`•
`
`,,
`G
`G
`G
`G
`N xxx.xxx.xxx.xxx
`N XXX.XXX.XXX.XXX
`N XXX.XXX.XXX.XXX
`N XXX.XXX.XXX.XXX
`N XXX.XXX.XXX.XXX
`N xxx.xxx.xxx.xxx
`N xxx.xxx.xxx.xxx
`s
`s
`
`(-4
`192---
`
`e~< 194
`
`~)
`
`FIG. 4
`
`198 t SEND LAST
`G._,_1--~194- j8
`
`200 -
`
`TO nv1QPltl CLASS
`
`'Y
`
`.. ~ 190
`
`192-/
`
`FIG. 5
`
`UNIFIED PATENTS INC.
`EX1001
`Page 5 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 4of18
`
`US 7,173,651 Bl
`
`320
`
`Account ID
`Password
`Account Name
`Contact Name
`
`Billing Address
`
`xxxxxx
`pppppppp
`
`ReMax NC
`Joe King
`
`100 Atlantic Blvd
`Suite 100
`Charlotte, NC 27999
`
`Camera ID
`Dial ID
`Active from
`Active to
`Direct/Server(D/S)
`
`yyy. yyy. yyy. yyy
`zzz.zzz.zzzz
`MMDDYY
`MMDDYY
`s
`
`321
`I~
`322
`I~
`323
`I/~
`324
`
`I/
`
`325
`I~
`
`326
`~
`327
`I~
`328
`I~
`329
`330
`~
`
`I/~~
`
`FIG. 7
`
`UNIFIED PATENTS INC.
`EX1001
`Page 6 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 5of18
`
`US 7,173,651 Bl
`
`Address Book for XXXXXX@YYYY.COM
`
`(~341
`,)
`
`I""'
`
`People
`IALL
`I
`Nickname
`TB
`jbob
`BB
`Jdoe
`Jdoe2
`reg an
`jeff
`
`.I Groups
`
`"~ 352
`
`Address
`baker1@aol.com
`baker@aol .com
`bb@aol.com
`jdoe@aol .com
`Ja _ doe@aol .com
`nr2@aol.com
`jsmith@aol.com
`
`(-354
`.~-j 1
`
`f-----
`
`f-----
`
`f-----
`
`Edit Del
`0
`f-----
`0
`0
`0
`0
`0
`0
`
`f-----
`
`f-----
`
`f-----
`
`340
`
`View:
`View by Group:
`I Add New Entry
`Full Name
`Tammy Baker
`Jim Baker
`Bill Blass
`John Doe
`Jane Doe
`Nan Regan
`Jeff Smith
`j
`I
`342--/
`
`t I
`
`344-j
`
`t /
`
`346-/
`
`/
`
`348-) 350 J
`
`FIG. 8
`
`UNIFIED PATENTS INC.
`EX1001
`Page 7 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 6of18
`
`US 7,173,651 Bl
`
`EditNiew Address Book Entry
`
`Save I
`
`Entry Name: Jeff Smith
`
`Jeff
`Smith
`jeff
`jsmith@aol.com
`N
`
`N
`919.888.8888
`
`/ ~362
`
`/ ~364
`
`366
`
`360
`
`Z:\images\epic\
`
`" ~-~367
`
`First name
`Last name
`Nickname
`e-mail
`Reply OK (Y/N)
`e-mail2
`Reply OK (Y/N)
`Work Phone
`Home Phone
`Fax Number
`Mobile Phone
`Path
`Mailing Address
`Address2
`City
`Zip
`Birthday
`
`FIG. 9
`
`UNIFIED PATENTS INC.
`EX1001
`Page 8 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 7of18
`
`US 7,173,651 Bl
`
`Address Book for XXXXXX@YYYY.COM
`
`~)341
`
`372
`
`370
`
`View:
`I Add New Entry
`I Group Name
`3br2ba
`All
`family
`manse
`
`People
`
`Groups
`
`3 74
`
`Edit Del
`~ 0
`~ 0
`~ 0
`~ 0
`
`376_J
`
`378_J
`
`L-380
`
`FIG. 10
`
`UNIFIED PATENTS INC.
`EX1001
`Page 9 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 8of18
`
`US 7,173,651 Bl
`
`Edit Group
`
`Group Name:
`
`Non-Members
`
`390
`
`jim baker (baker@ao
`John doe Udoe@aol.
`jane doe ua_doe@a
`Jeff Smith Usmith@a
`
`.-------- \ 392
`I manse ~
`I Add >> I
`::rwrn.n.:w $8. k.$dl?~ ~~< ...
`
`Group Members
`.A.
`Bill Blass (bb@ao
`I <<Remove I :N~bl~~98.:~:(r/~@:r::
`
`I Delete Group I 1 - - - - - - - - - - -1
`
`Done
`
`T
`
`394-J 396-J
`
`398-J 396'-J
`
`FIG. 11
`
`UNIFIED PATENTS INC.
`EX1001
`Page 10 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 9of18
`
`US 7,173,651 Bl
`
`START
`
`NO
`
`Register
`
`Wait for
`Interface
`Signal
`
`402
`
`404
`
`406
`
`408
`
`412
`
`Get Image
`
`414
`
`418
`
`420~~
`
`Format
`
`Save Msg;
`423~~ Mark to
`Send
`
`424-
`
`Invoke
`Transmit If
`Inactive
`
`Mark Last
`Msg. To
`Send
`
`410
`
`Audio
`
`416
`
`Save MSG;
`Mark to
`Hold
`
`~422
`
`426
`
`YES
`
`Issue
`Warning
`
`428
`
`FIG. 12
`
`UNIFIED PATENTS INC.
`EX1001
`Page 11 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 10 of 18
`
`US 7,173,651 Bl
`
`404~
`
`Register
`
`YES
`
`432
`
`434
`
`NO
`
`Register
`with
`Network
`
`436
`
`Contact
`Server
`
`438
`
`Receive
`Server
`Updates
`
`Return
`
`FIG. 13
`
`UNIFIED PATENTS INC.
`EX1001
`Page 12 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 11 of 18
`
`US 7,173,651 Bl
`
`412 ~\~/ Get Image
`
`416~ /
`
`Audio
`
`440
`
`Signal
`Camera
`
`450~"~/
`
`Display
`Prompt
`
`Compress
`Image
`
`452~\~/
`
`Record
`Msg.
`
`444
`
`Display
`
`454 ~, / Play Back
`~ Message
`
`Return
`
`FIG. 14
`
`NO
`
`YES
`
`Return
`
`FIG. 15
`
`UNIFIED PATENTS INC.
`EX1001
`Page 13 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 12 of 18
`
`US 7,173,651 Bl
`
`460
`
`461
`
`462
`
`464
`
`466'
`
`467
`
`468
`
`470
`
`472
`
`474
`
`YES
`
`Custom
`
`466
`
`Format
`
`Move
`Header
`
`Move
`Recipient
`Code
`
`Custom
`
`Move
`Address
`
`Move Image
`
`NO
`
`NO
`
`Move Audio
`
`Move EOM 1------
`
`Return
`
`FIG. 16
`
`UNIFIED PATENTS INC.
`EX1001
`Page 14 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 13 of 18
`
`US 7,173,651 Bl
`
`Custom
`
`YES
`
`NO
`
`482~~
`
`Ask User to
`Enter
`Address
`
`Ask to Enter
`488 ~~ Class
`
`484
`
`Display
`Address
`
`490
`
`Display
`Class
`
`485~~
`
`NO
`
`492~~
`
`NO
`
`YES
`
`486
`
`YES
`
`Save As
`Delivery
`Address
`
`Return
`
`494
`
`Save As
`Class
`
`Return
`
`FIG. 17
`
`UNIFIED PATENTS INC.
`EX1001
`Page 15 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 14 of 18
`
`US 7,173,651 Bl
`
`500
`
`Transmit
`
`510
`
`514
`
`516
`
`NO
`>----"--------I
`
`Establish Circuit
`to Server
`
`512
`
`Point to First
`Message
`
`YES
`
`Transmit to
`Server
`
`522
`
`520
`
`524
`
`Transmit as
`IP
`
`Delete If No
`Error
`
`528
`
`NO
`
`Close
`Circuit
`
`530
`
`Return
`
`FIG. 18
`
`UNIFIED PATENTS INC.
`EX1001
`Page 16 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 15 of 18
`
`US 7,173,651 Bl
`
`532
`
`HEADER
`\
`I
`I
`'~-534
`
`RECIPIENT/ADDR
`I
`I
`\
`
`IMAGE
`\
`\
`\
`'~-53s
`
`AUDIO
`
`FIG. 19
`
`UNIFIED PATENTS INC.
`EX1001
`Page 17 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 16 of 18
`
`US 7,173,651 Bl
`
`542 ~, /
`
`'~/
`
`Process
`
`544 -,,~/
`
`Receive+
`Save
`Message
`
`548
`
`552
`
`556
`
`Get IP
`Address
`
`Format and
`>-'---------~ Transmit to
`Recipient
`
`Build
`Recipient
`List
`
`Return
`
`550
`
`554
`
`Format and
`Transmit to
`558 ~,/ Each
`Recipient
`
`Return
`
`FIG. 20
`
`UNIFIED PATENTS INC.
`EX1001
`Page 18 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 17 of 18
`
`US 7,173,651 Bl
`
`570~
`
`Update
`
`NO
`
`Return
`
`572
`
`574
`
`576
`
`578
`
`580
`
`Receive
`Query From
`Camera
`
`Resolve
`Addresses
`
`Transmit
`Data to
`Camera
`
`Save
`Download
`Date
`
`Return
`
`FIG. 21
`
`UNIFIED PATENTS INC.
`EX1001
`Page 19 of 28
`
`

`
`U.S. Patent
`
`Feb.6,2007
`
`Sheet 18 of 18
`
`US 7,173,651 Bl
`
`586
`
`Reply
`
`588
`
`590
`
`594
`
`596
`
`598
`
`Receive
`Message
`Reply
`
`Respond
`>--'-~---91 "Account I nva I id" i---------1 Return
`"Try Elsewhere"
`
`YES
`
`YES
`
`Reformat+
`Transmit to
`Camera
`
`Archive
`Reply for X
`Days
`
`Return
`
`FIG. 22
`
`UNIFIED PATENTS INC.
`EX1001
`Page 20 of 28
`
`

`
`US 7,173,651 Bl
`
`1
`APPARATUS AND SYSTEM FOR PROMPT
`DIGITAL PHOTO DELIVERY AND
`ARCHIVAL
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`This application claims the benefit of U.S. Provisional
`Application number 60/087,745 filed on Jun. 2, 1998.
`
`FIELD OF THE INVENTION
`
`The present invention relates to digital cameras and
`particularly to digital cameras which include a radio fre(cid:173)
`quency (RF) transceiver for transmitting digital photos to a
`remote destination according to user preferences.
`
`BACKGROUND OF THE INVENTION
`
`Digital cameras are increasingly popular, which popular(cid:173)
`ity is due in part to their elimination of processing delays
`involved with conventional film-based photography. With a
`digital camera, one does not have to shoot an entire roll of
`film and send it to a processor for development before seeing
`the resulting photograph. Instead, one cam immediately
`download a digital image to a computer and display the
`photograph, or in some instances link the digital camera to
`a TV monitor to display the photograph. Another attractive
`feature of digital cameras is that the digital images they
`create, after being stored on a computer, can be forwarded to 30
`others via e-mail or can be incorporated into other electronic
`documents, including Internet web pages.
`However, the process of connecting the digital camera to
`a computer and then downloading images to the computer
`for storage and viewing can be complicated. Some digital 35
`camera manufacturers have attempted to make this process
`easier by including in the camera a standard format 3.5 inch
`floppy disk drive for storing digital images so that the
`images can be easily accessed by computers with similar
`disk drives. Others provide flash card memory which can 40
`store a high number of images, or provide an infrared (IR)
`port for transferring images to a computer.
`Even with these features, the image transfer cannot be
`begun until the digital camera (or storage device) is physi(cid:173)
`cally connected to a computer, or in the case of digital 45
`cameras and computers which include IR transceivers these
`must be located in close proximity before a transfer can be
`made. For many users, this process is confusing and detracts
`from the usefulness of the device. When a user wishes to
`view or share access to a digital photo quickly, this delay and
`manual transfer process can be both inconvenient and frus(cid:173)
`trating.
`Another potential problem with current digital cameras is
`that they generally require creation of a database of images
`on a home or office computer, which often has limited
`accessibility, is unsecured, and is infrequently backed up.
`With the growing popularity of Internet accessible software
`programs, and "network computers" which include little or
`no data storage, there is a need for a networked image
`storage and archival service which provides secure, reliable,
`and universally accessible image storage services. Such a
`service would allow shared access to and transfer of images
`by family or business groups in a format which would
`greatly enhance the ability to categorize and sort each image
`by time, date, and occasion, and which would at the same
`time greatly reduce the possibility of losing important
`images. The Fujifilm company is known to offer an Internet
`
`2
`archival service in connection with conventional film pro(cid:173)
`cessing, but there is no known similar service for digital
`photos.
`When compressed, a color digital image is typically !OK
`bytes or more in size, and transmission of such an image
`requires from 10 to more than 30 seconds, depending on
`wireless modem transmission rates. Cellular service provid(cid:173)
`ers typically charge for total circuit connection time or, in
`the case of wireless data services providers, for the amount
`10 of data transferred, and it is therefore advantageous to
`reduce the required connection time to perform a file transfer
`or the amount of data to be transferred. One way to do this
`is to compress the file before transmission. But even when
`a file is to be sent to multiple recipients one would not want
`15 to initiate multiple calls in order to transfer the file to each
`recipient, even if the file is compressed. It would be ben(cid:173)
`eficial to have a system which allowed one to forward an
`image file, with distribution instructions, to a central reposi(cid:173)
`tory, and known that the repository would then save and/or
`20 automatically distribute the image file according to prior
`user instructions, without incurring another expensive wire(cid:173)
`less transfer.
`Digital cameras which include the ability to effect a
`wireless RF image transfer are not known to be currently
`25 marketed in the United States. A search of issued U.S.
`Patents has revealed U.S. Pat. No. 4,884,132 to Morris et al,
`which provides a "personal security unit" which includes a
`digital image sensor, a cellular transmitter, a window aligned
`with the image sensor, and which transmits digital informa(cid:173)
`tion identifying the hand-held unit to a remote cellular
`receiving station where all cellular communications
`received from the personal security units are recorded.
`Morris states that the recorded data can be accessed at a later
`time if a crime is reported.
`Another known device is disclosed in U.S. Pat. No.
`5,712,679 to Coles which discloses a security system with a
`method for locatable portable electronic camera image trans(cid:173)
`mission to a remote receiver. This device provides the means
`to transmit a video image along with device identifying
`information and position coordinate information to a remote
`receiver. Coles states that the transmission may be accom(cid:173)
`plished by cellular radio and is received by a remote receiver
`where the image may be displayed or printed by facsimile.
`
`SUMMARY OF THE INVENTION
`
`The present invention comprises a wireless digital camera
`device (also referred to herein as a wireless device) includ(cid:173)
`ing a processor, RF communications device (modem),
`50 memory, and digital cameras which is configured to transmit
`a digital data message, including at least a digital image, an
`account ID, and a recipient code, across a combined wireless
`and wired network to a host system at a predefined Internet
`Protocol (IP) address. The portable apparatus is pro-
`55 grammed to minimize the number of user inputs required for
`operation in order to operate much like other automatic
`cameras, providing "aim and shoot" operation. While it is
`presently possible to assemble a portable device which can
`transfer data files, including image files, to a destination
`60 computer by using readily available commercial products,
`such as a portable computer, camera, and cellular modem,
`such a system requires user input to configure and initialize,
`including a destination phone number for modem dialing or
`a host IP or e-mail address to send the image to. The present
`65 invention provides a simple wireless photo delivery system
`which requires minimal user inputs for successful configu(cid:173)
`ration and operation.
`
`UNIFIED PATENTS INC.
`EX1001
`Page 21 of 28
`
`

`
`US 7,173,651 Bl
`
`3
`In order to simplify the wireless camera apparatus set up
`and operation, the present invention provides a user-friendly
`means to customize operational features of the camera.
`Many computer users today have access to web sites on the
`Internet, and are familiar with the process of interacting with
`programs and forms posted on Internet web sites. In one
`embodiment of the present invention, a digital camera
`service server provides a means for users to define distri(cid:173)
`bution nicknames and custom operation options, and auto(cid:173)
`matically downloads these custom operational parameters to
`the wireless camera whenever they are updated.
`In order for an e-mail system to resolve e-mail addresses
`into IP addresses it is necessary for a user device to have
`access to a domain name server (DNS) resolver. This
`exchange of messages between the remote device and the 15
`DNS at time of message delivery is eliminated in one
`embodiment of the present invention by having e-mail
`addresses resolved into their corresponding IP addresses by
`the digital camera service server (subsequently referred to
`herein as the server) prior to downloading these IP addresses 20
`with address nicknames to the wireless camera device. This
`enables embodiments of the wireless camera device which
`contain a wireless packet data communications device such
`as a Cellular Digital Packet Data (CDPD) modem to con(cid:173)
`struct and send messages directly to the Internet recipient's
`known IP address in a protocol format known to those of
`ordinary skill in the art, such as TCP, Simple Mail Transfer
`(SMTP),
`Internet Message Access Protocol
`Protocol
`(IMAP), Multipurpose Internet Mail Extensions (MIME),
`Serial Line Internet Protocol (SLIP), Point to Point (PPP), or 30
`Post Office Protocol (POP) without reference to a DNS
`resolver.
`Wireless device users may wish to maintain control over
`who can send messages to them, in order to avoid paying for
`unwanted message transmissions. Another aspect of the
`present invention allows messages generated by the wireless
`device to be formatted so that the message origin address
`appears as a server address. This causes all message replies
`to be routed to the server, which receives and filters all
`replies addressed to the wireless device and only forwards
`messages which are from approved sources and in appro(cid:173)
`priate formats to the wireless device.
`There is then a need to provide an apparatus and system
`which will allow for effortless transfer of a message includ(cid:173)
`ing a digital image, an account identifier, and an optional
`recipient code, across a combined wireless/wired network to
`a host device at a pre-defined IP address. One aspect of the
`invention provides a digital camera service server host
`device at the pre-defined IP address which can store portions
`of the message, and/or forward select portions of the mes(cid:173)
`sage and digital image to one or more recipients associated
`with a message recipient code.
`In the case where the delivery IP address corresponds to
`a server, the data message may be stored at the server for
`later access or may be immediately forwarded to one or
`more IP addresses that corresponds to a recipient code
`included in the data message. When an image is to be sent
`to multiple recipients, it is much more economical to only
`incur one transmission from the wireless camera device
`across the wireless communications link to the server, and 60
`then forwarded the image to each intended recipient through
`a conventional wire-line or fiber optic network.
`In one embodiment of the present invention, an account is
`established on the server which corresponds to at least one
`wireless camera device. This server may be a private system 65
`accessible only via a private network, or may be connected
`to the Internet and be configured to allow wireless device
`
`4
`users to access the server by using commonly available
`world wide web browsers. In either case the server is
`preferably remotely accessible in order to establish or update
`account parameters, or to access previously transmitted
`digital images and or responses thereto. In the preferred
`system, each server account is password protected for access
`only by authorized users. Authorized users may update their
`server accounts to establish recipient codes, or nicknames,
`and associate these codes with one or more destination
`10 e-mail addresses, IP addresses, phone numbers (for delivery
`of audio messages), or storage destinations (such as a server
`path name), thereby creating nicknames for the purpose of
`controlling how messages will be archived and/or distrib-
`uted to individuals or groups.
`When certain account parameters, such as nicknames, are
`changed on the server, they are automatically flagged to be
`downloaded in a list to the wireless camera device the next
`time the wireless device contacts the server. Alternately, the
`wireless device may be progranimed to get a fresh copy of
`account parameters, or portions thereof, upon each new
`connection to the server. This nickname list is viewable in a
`scrollable window on the wireless camera device, providing
`a quick means for selecting who a particular data message is
`to be sent to, without concern for entering an e-mail or IP
`25 address.
`For example, a camera used who is employed as a Realtor
`may define both business nicknames and personal nick(cid:173)
`names. Business nicknames may include codes based on
`property attributes (a 3BR2BA code for all customers who
`are currently looking for a house with at least three bed(cid:173)
`rooms and two baths) or may include codes for different
`communities or property price ranges. Finance companies
`could also use the wireless camera to automatically create a
`photo of the collateral property, as required in many states,
`35 and simultaneously send the photo to the loan processor and
`to an archive file.
`Other potential uses for the invention include (i) photo(cid:173)
`advertisements-for example, camera can be used by sales
`agents to send pictures to a list of current clients, to an office
`40 webmaster, print shops, etc., or to save photos in a pre(cid:173)
`defined server directory; (ii) jorunalists could use the system
`to submit late breaking news pictures; (iii) insurance adjust(cid:173)
`ers-photo with claim or file numbers can be mailed directly
`to the home office or saved in a pre-defined server directory
`45 associated with the file; (iv) police-photos of accident
`site/crime scene can be captured and archived; and (v) a
`holiday photo system where the camera can be rented while
`on vacation in order to have photos automatically e-mailed
`to a printing service, or to a list of friends/relatives with
`50 whom you want to share trip events.
`In the preferred embodiment, the invention comprises a
`battery powered wireless camera device, including a digital
`camera for creating a digital image, a memory for storing
`digital images, a delivery IP address, and a list of nicknames,
`55 an RF communications device connected to the wireless
`device, and processor means for transmitting a message to
`the delivery IP address via the communications device.
`Backup memory in the form of a removable disk or memory
`card may be provided in some embodiments for message
`storage with or without message transmission. The message
`includes an account ID, a recipient code (nickname), and at
`least one digital image created by the digital camera. As
`further described in the Detailed Description section of this
`disclosure, in some embodiments, the message may include
`message origination date, time, a message classification
`indicator, digital audio recordings, and/or location coordi(cid:173)
`nates, and in some instances may not include a digital image.
`
`UNIFIED PATENTS INC.
`EX1001
`Page 22 of 28
`
`

`
`5
`The delivery IP address may be saved in the wireless
`camera device memory in response to input commands
`entered at a device user interface, input commands entered
`remotely via the communications device, or input com(cid:173)
`mands during manufacture of the wireless device. The RF
`communications device may be a circuit-switched data
`modem or packet data modem, and may respectively estab(cid:173)
`lish a switched connection through the Public Switched
`Telephone Network (PSTN) to the server or to a host device
`and router system at a particular phone number from which 10
`messages are transmitted to the destination IP address, or
`may transmit the message directly through a cellular service
`provider digital packet network connection, such as CDPD,
`to the destination IP address through an Internet connection.
`In alternate embodiments, the wireless camera includes a 15
`microphone interface for recording audio messages to be
`transmitted in a digital format with messages. In such
`embodiments where the interface includes a microphone, a
`voice recognition module may be used to translate spoken
`messages into operational commands. For example, the 20
`wireless apparatus may be activated to record a spoken
`nickname, address, or alphanumeric identifier for associa(cid:173)
`tion with the message, process this recording with the voice
`recognition module, and then include the character output of
`the voice recognition module as a nickname, e-mail address, 25
`classification or message field in the next message transmis(cid:173)
`sion. Other interface means may include a bar code scanner,
`or numeric or alphanumeric keypad.
`Another embodiment is configured to function as an
`enhanced digital phone that includes a digital camera. Other 30
`embodiments include an optional global positioning system
`(GPS) unit for capturing location data that may then be
`included in the message. Yet another embodiment of the
`invention includes a data port which is connected directly to
`the communications device so that the wireless camera 35
`device can be used as a portable RF modem for external
`devices which are connected to the data port from time to
`time.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a high level diagram of the photo delivery
`system of the present invention.
`FIG. 2 is a block diagram of the wireless device.
`FIG. 3 shows a representative user configuration table for
`the wireless device.
`FIG. 4 shows a representative recipient selection view of
`the wireless device interface means.
`FIG. 5 shows a representative mode selection view of the
`wireless device interface means.
`FIG. 6 shows a representative classification selection
`view of the wireless device interface means.
`FIG. 7 shows a representative account configuration
`record on the server of the present invention.
`FIG. 8 shows a server interface means display of account
`recipient information.
`FIG. 9 shows a server interface means display of repre(cid:173)
`sentative individual recipient information.
`FIG. 10 shows a server interface means display of rep- 60
`resentative group information.
`FIG. 11 shows a server interface means display for editing
`representative group information.
`FIG. 12 shows a process flow chart for one embodiment
`of the wireless camera device of the present invention.
`FIG. 13 shows a process flow chart of the register process
`of FIG. 12.
`
`55
`
`US 7,173,651 Bl
`
`6
`FIG. 14 shows a process flow chart of the get image
`process of FIG. 12.
`FIG. 15 shows a process flow chart of the audio recording
`process of FIG. 12.
`FIG. 16 shows a process flow chart of the format process
`of FIG. 12.
`FIG. 17 shows a process flow chart of the custom input
`process of FIG. 16.
`FIG. 18 shows a process flow chart of the transmit process
`of the preferred embodiment wireless camera device.
`FIG. 19 shows a data format for data transmitted from the
`wireless camera device to the server of the preferred
`embodiment.
`FIG. 20 shows a process flow chart of how the server
`processes messages received from a wireless camera device.
`FIG. 21 shows a process flow chart for how the server
`responds to wireless camera device queries.
`FIG. 22 shows a process flow chart for how the server
`responds to messages addressed to a wireless camera device.
`
`DETAILED DESCRIPTION
`
`As will be understood from reading and understanding the
`following more detailed description, the present invention
`includes a wireless digital camera apparatus, and in the
`preferred embodiment includes the digital camera apparatus
`as part of a digital photo delivery system, which system also
`includes a server that is accessible through the Internet for
`user updates. Each user of such system has an assigned
`server account ID and password which is required in order
`to update account parameters and access messages stored on
`the server although in some embodiments user may desig(cid:173)
`nate that certain images may be stored in a public area from
`which they may be freely accessed or linked to. This photo
`delivery system 100 is shown in FIG. 1 as including a
`wireless camera apparatus 110, which transmits and receives
`messages via a radio network 120. The radio network 120
`can be any data-capable airlink (such as GSM, TDMA,
`CDMA), or wireless data network such as CDPD, or may be
`40 a short range radio link such as an in-building network or a
`radio link between the wireless device and other devices via
`a standard protocol such as the Bluetooth Specification
`sponsored by Ericsson, IBM, Intel, No