I IIIII IIIIIIII Ill lllll lllll lllll lllll lllll lllll lllll lllll 111111111111111111
`US008612294Bl
`
`c12) United States Patent
`Treyz et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,612,294 Bl
`Dec. 17, 2013
`
`(54) HANDHELD COMPUTING DEVICE
`SYSTEMS
`
`(75)
`
`Inventors: G. Victor Treyz, Sunnyvale, CA (US);
`Susan M. Treyz, Sunnyvale, CA (US)
`
`(73) Assignee: Vengte Software AG Limited Liability
`Company, Wilmington, DE (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 2599 days.
`
`(21) Appl. No.: 10/431,196
`
`(22) Filed:
`
`May 7, 2003
`
`5,424,524 A
`5,424,727 A
`5,455,823 A
`5,550,358 A *
`5,640,002 A
`5,648,768 A
`5,664,110 A
`5,664,231 A
`
`............... 235/462
`
`6/1995 Ruppert et al.
`6/1995 Shieh
`10/1995 Noreen et al.
`8/1996 Tait et al ....................... 235/380
`6/ 1997 Ruppert et al.
`7/1997 Bouve ........................... 340/988
`9/1997 Green et al.
`.................... 705/26
`9/1997 Postman et al.
`.............. 395/893
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`
`9/2000
`1035485 A2
`11/2000
`1054335 A2
`(Continued)
`
`.............. G06F 17/60
`.............. G06F 17/60
`
`OTHER PUBLICATIONS
`
`Related U.S. Application Data
`
`Selected web pages from the Stop & Shop website (URL http://www.
`stopandshop.com/), as printed from the Internet on Feb. 7, 2000.
`
`(63) Continuation of application No. 09/501,053, filed on
`Feb. 9, 2000, now Pat. No. 6,587,835.
`
`(51)
`
`(52)
`
`(58)
`
`(56)
`
`Int. Cl.
`G06Q 30/00
`U.S. Cl.
`USPC .................... 705/14.62; 705/14.64; 705/26.1;
`705/27.1
`
`(2012.01)
`
`Field of Classification Search
`USPC .............. 705/14, 26, 14.62, 14.64, 26.1, 27.1
`See application file for complete search history.
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,558,300 A
`5,047,614 A
`5,054,569 A
`5,058,044 A
`5,243,645 A *
`5,250,789 A
`5,287,266 A
`5,303,393 A
`5,351,187 A
`
`12/1985 Goldman ................... 340/286.1
`9/1991 Bianco .......................... 235/385
`10/ 1991 Scott et al.
`10/1991 Stewart
`............ 379/211.02
`9/1993 Bissell et al.
`10/1993 Johnsen ........................ 235/383
`2/ 1994 Malec et al.
`4/1994 Noreen et al.
`9/ 1994 Hassett
`
`(Continued)
`
`Primary Examiner - Donald L. Champagne
`
`ABSTRACT
`(57)
`A system is provided in which a handheld computing device
`may be used to provide a user with shopping assistance ser(cid:173)
`vices. A shopping assistance service may allow a user to
`obtain directory information for a shopping mall. A user may
`use the handheld computing device to handle shopping lists.
`The handheld computing device may display promotional
`material based on the shopping lists. Thehandheldcomputing
`device may be used to obtain information on products being
`sold in a store. Products may be purchased using wireless
`financial transactions. Reminders and other messages may be
`sent to the handheld computing device. The location of the
`handheld computing device may be monitored. Services may
`be provided to the user based on the location of the handheld
`computing device. The handheld computing device may
`communicate with communications equipment in retail
`establishments using a local wireless link.
`
`24 Claims, 118 Drawing Sheets
`
`ESTABLISH LOCAL WIRELESS
`COMMUNICATIONS LINK
`
`1100
`
`USE HANDHELD COMPUTING DEVICE TO
`PAY FOR GAS, TOLL, PARKING LOT FEE,
`FOOD AT DRIVE-THROUGH RESTAURANT,
`ETC.
`
`1102
`
`MAINTAIN RECORDS OF FINANCIAL
`TRANSACTION
`
`1104
`
`GENERATE EXPENSE REPORT
`
`1106
`
`Twitter Exhibit 1022
`Twitter, Inc. v. BlackBerry Ltd.
`Page 00001
`
`

`

`US 8,612,294 Bl
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,679,943 A *
`5,684,462 A
`5,689,245 A
`5,694,116 A
`5,729,619 A
`5,767,795 A
`5,794,164 A
`5,794,207 A
`5,837,982 A
`5,857,201 A
`5,859,779 A
`5,905,246 A
`5,931,878 A
`5,948,040 A
`5,949,345 A
`5,952,941 A
`5,955,970 A
`5,959,577 A
`5,970,469 A
`5,970,474 A
`5,977,908 A
`5,979,757 A
`5,995,898 A
`6,009,363 A
`6,014,634 A
`6,035,280 A
`6,091,956 A
`6,101,483 A
`6,104,315 A
`6,111,521 A
`6,111,539 A
`6,131,067 A
`6,148,212 A
`6,154,658 A
`6,163,270 A
`6,169,955 Bl
`6,185,541 Bl
`6,199,045 Bl
`6,199,753 Bl
`6,233,506 Bl
`6,246,997 Bl
`6,263,265 Bl
`6,278,362 Bl
`6,292,786 Bl
`6,317,718 Bl
`6,330,499 Bl
`6,453,259 Bl
`6,477,563 Bl*
`6,490,443 Bl
`6,505,106 Bl
`6,571,279 Bl
`6,574,603 Bl
`6,587,835 Bl*
`6,609,050 B2
`6,711,474 Bl*
`6,925,444 Bl
`6,954,735 Bl
`RE39,736 E *
`7,257,426 Bl*
`2001/0001145 Al
`2001/0014868 Al
`2001/0032130 Al
`2001/0033225 Al
`2001/0044321 Al*
`2002/0046117 Al*
`2002/0049523 Al
`2006/0142913 Al
`
`........... 707/104
`
`10/1997 Schultz et al ............ 235/472.02
`11/ 1997 Gold
`11/1997 Noreen et al.
`12/1997 Kojima
`3/1998 Puma
`6/ 1998 Schaphorst
`8/ 1998 Beckert et al.
`8/1998 Walker et al.
`11/ 1998 Fujioka
`1/1999 Wright, Jr. et al.
`1/ 1999 Giordano et al.
`5/1999 Fajkowski ..................... 235/375
`8/1999 Chapin
`9/1999 DeLorme et al.
`9/ 1999 Beckert et al.
`9/ 1999 Mardirossian
`9/1999 Ando et al.
`9/ 1999 Fan et al.
`10/1999 Scroggie et al. ................ 705/14
`10/1999 LeRoy et al.
`................... 705/27
`11/1999 Nichols .................... 342/357.08
`11/1999 Tracy et al .................... 235/383
`11/ 1999 Tuttle
`12/1999 Beckert et al.
`1/2000 Scroggie et al. ................ 705/14
`3/2000 Christensen .................... 705/14
`7/2000 Hollenberg ................... 455/456
`8/2000 Petrovich et al. ............... 705/26
`8/2000 Volkel et al.
`8/2000 Mulder et al.
`8/2000 Mannings et al.
`10/2000 Girerd et al.
`11/2000 Park et al.
`11/2000 Caci
`12/2000 Silverman
`1/2001 Fultz
`2/2001 Scroggie et al. ................ 705/14
`3/2001 Giniger et al.
`3/2001 Tracy et al .................... 235/375
`5/2001 Obradovich et al.
`6/2001 Cybul et al. ..................... 705/27
`7/2001 Fera
`8/2001 Yoshikawa et al.
`9/2001 Deaton et al. ................... 705/14
`11/2001 Fano
`12/2001 Chou et al.
`9/2002 Infiesto
`11/2002 Kawamura et al. ........... 709/202
`12/2002 Freeny
`1/2003 Lawrence et al.
`5/2003 Herz et al.
`6/2003 Dickson et al.
`7/2003 Treyz et al ................. 705/14.64
`8/2003 Li
`3/2004 Treyz et al ........................ 701/1
`8/2005 McCollom et al.
`10/2005 Djupsjobacka et al.
`7/2007 Morrill, Jr ....................... 705/44
`8/2007 Witkowski et al. ........ 455/569.2
`5/2001 Barnett et al.
`. ................. 705/14
`8/2001 Herz eta!. ...................... 705/14
`10/2001 Gabos et al.
`10/2001 Razavi et al.
`............... 455/556
`11/2001 Ausems et al.
`4/2002 Marion ........................... 705/14
`4/2002 Diaz et al.
`6/2006 Coffee
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`WO
`WO
`WO
`
`1087318 A2
`WO 97/50045
`WO 98/21713
`WO 98/38589
`
`3/2001
`12/1997
`5/1998
`9/1998
`
`.............. G06F 17 /60
`.............. G06F 15/16
`
`.............. G06F 17 /60
`
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`
`W0-9909374
`WO 99/57670
`WO 00/43912
`W0-0041529
`W000/45511
`W0-0052984
`WO 00/70504
`W0-0072463
`WO 01/20526 Al
`WO 01/20527 Al
`WO O 1/27831 Al
`W0-0143364
`
`2/1999
`11/1999
`7/2000
`7/2000
`8/2000
`9/2000
`11/2000
`11/2000
`3/2001
`3/2001
`4/2001
`6/2001
`
`.............. G06F 19/00
`.............. G06F 17/30
`
`H03J 1/00
`
`.............. G06F 17/30
`
`.............. G06F 17/60
`.............. G06F 17/60
`.............. G06F 17/60
`
`OTHER PUBLICATIONS
`
`Selected web pages from the Mall of America website (URL http://
`www.mallofamerica.com/), as printed from the Internet on Feb. 7,
`2000.
`"Shop Till You Drop With Your Wireless Phone or PDA," ZDNET PC
`Magazine, as printed from the Internet on Jan. 31, 2000.
`"Safeway Go One-on-One With Their Customers and the 'Virtual
`Shop Assistant'," press release of Symbol Technologies, dated Jan.
`17, 2000.
`"Malls Get Tech Savvy," by Justin Bachman, ABCNEWS .com, dated
`Dec. 28, as printed from the Internet Feb. 1, 2000.
`"LodgeNet/LookSmart Portal Page Goes 'Live' Across U.S.," press
`release of LodgeN et Entertainment Corporation, dated Dec. 9, 1999.
`"Mall Giant Catches E-commerce Bug," by Margaret Kane, ZDNet
`News, dated Nov. 4, 1999.
`"Palm Point of Sale System Offered," Internet.com Corp., dated Oct.
`5, 1999.
`"Minneapolis Regal Hotel Wires Guest With Cyberoom," press
`release dated Jun. 24, 1999.
`"Cyberoom Announces Strategic Partnerships With Compaq and
`Lucent Technologies," press release of Cyberoom, dated Jun. 22,
`1999.
`"Mobile Computing Solution Enables Express Curbside Hotel
`Check-In,"press release of Symbol Technologies, Inc., dated Jun. 22,
`1999.
`"Sony's Digital Path Leads to Record Stores," by Beth Lipton Krigel,
`CNET News.com, dated Jun. 9, 1999.
`"Teens Entering the Virtual Mall," by Margaret Kane, ZDNet News,
`dated Jun. 1, 1999.
`"LodgeNet Rolls Out 'Next Generation' Graphical User Interface to
`Hotel Customers," press release ofLodgeNet Entertainment Corpo(cid:173)
`ration, dated May 6, 1999.
`"Net Fridge Comes in From the Cold," by Tom Dunlap, CNET
`News.com, dated Feb. 25, 1999.
`"The Coolest Internet Appliance" by Leander Kahney, Wired News,
`dated Feb. 12, 1999.
`"IBM and Safeway Create Enjoyable Grocery Shopping Experi(cid:173)
`ence," copyright dated 1999 International Business Machines Cor(cid:173)
`poration.
`"Microwave Madness," Wired News, dated Sep. 10, 1998.
`"Why Wait in Line When You Can Shop On-line?," by Liz Weiss,
`CNN.com, dated Sep. 26, 1995.
`"Let the Directory Do the Walking: Electronic Footsteps Lead Shop(cid:173)
`pers Through Del Amo Mall", Chain Store Age Executive with Shop(cid:173)
`ping Center Age, V. 65 No. 11, p. l 16(a), Nov. 1989.
`"Clarion AutoPC 310C Owners Manual", Copyright dated 1998
`Clarion Co. Ltd., (1998), pp. 1-174.
`"Clarion Corporation website", Pages from the website, printed from
`the internet,(Dec. 28, 1999), pp. 1-25.
`"Final Office Action", U.S. Appl. No. 10/769,384, (Nov. 17, 2009),
`10 pages.
`"Non-Final Office Action", U.S. Appl. No. 10/769,384, (Mar. 31,
`2009), 9 pages.
`"OnStar.RTM website", Pages from the website printed on Jan. 10,
`2000, 10 pages.
`"Restriction Requirement", U.S. Appl. No. 12/130,889, (Mar. 5,
`2010), 8 pages.
`
`Page 00002
`
`

`

`US 8,612,294 Bl
`Page 3
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`"The Ultimate Spy Gear----Chapter 9: Putting a Tail on Someone",
`ZDNet printed from the internet, (Jan. 4, 2000), 5 pages.
`Moeller, Mark "AutoPC Power: A Look at the First Year With Auto
`PC with Microsoft", Windows CE Power Magazine, Available at
`<http://www. pocketpclife.corn/issuesprint/issuel 99912/
`autopc1299.html>, (Dec. 29, 1999), 4 pages.
`"Non Final Office Action", U.S. Appl. No. 10/769,384, (Oct. 6,
`2010), 7 pages.
`"Non Final Office Action", U.S. Appl. No. 12/130,889, (Aug. 17,
`2010), 17 pages.
`"Restriction Requirement", U.S. Appl. No. 12/130,889, (Jun. 18,
`2010), 6 pages.
`
`Fano,Andrew E., "Shopper's Eye: Using Location basedFilteringfor
`a Shopping Agent in the Physical World," Agents '98, pp. 416-421,
`1998.
`Notice of Allowance on U.S. Appl. No. 12/130,889, mailed Jul. 9,
`2013.
`Non-Final Office Action on U.S. Appl. No. 11/137,962, mailed Aug.
`3, 2005.
`Fax Communication from the United States Patent and Trademark
`Office with a Restriction Requirement on U.S.Appl. No. 09/501,053,
`faxed Jul. 10, 2002.
`Notice of Allowance on U.S. Appl. No.09/501,053, mailed Mar. 25,
`2003.
`Final Office Action on U.S. Appl. No. 12/130,889, mailed Jan. 20,
`2011.
`
`* cited by examiner
`
`Page 00003
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 1 of 118
`
`US 8,612,294 Bl
`
`1-z
`WW
`2 a:
`I- 0
`a: I(cid:173)
`<( (/)
`a..
`w
`0
`
`::)
`
`1-(cid:173)z
`~
`~ (/)
`w a:
`~--" \
`
`0
`WZw
`200
`QO:: -
`I I- >
`,ow
`zwo
`w
`
`_J
`
`-
`
`z
`0
`~ (/)
`
`(/)
`<.(
`(9
`
`~I
`
`w a: ow _Q
`>-
`0:: > wO
`(/) a: a..
`
`1-(cid:173)z
`<.(
`I
`0 a:
`w
`2
`
`N
`.,....
`
`I
`
`N
`(')
`
`N
`
`\
`
`0
`N
`
`'\
`
`<.(
`
`1-w
`::s::: a:
`2 a:
`w
`a..
`::)
`(/)
`
`_J
`_J
`<.(
`2
`
`(9 z -a..
`
`a..
`0
`I
`(/)
`
`.
`(9
`u.
`
`Page 00004
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 2 of 118
`
`US 8,612,294 Bl
`
`42
`
`12
`
`COMPUTER
`
`HANDHELD
`COMPUTING
`DEVICE
`
`IN-HOME
`ELECTRONIC
`DEVICE
`\.
`28
`
`HOME
`
`COMMUNICATIONS
`NETWORK
`
`32
`
`54
`
`STORE, MALL, OR OTHER
`ESTABLISHMENT
`
`ORDER
`FULFILLMENT
`FACILITY
`
`30
`
`AUTOMOBILE
`PERSONAL
`COMPUTER
`
`44
`
`48
`
`RETAILER
`EQUIPMENT
`
`COMPUTER
`
`SERVICE
`PROVIDER
`
`34
`
`46
`
`~52
`
`36 38
`
`HANDHELD
`COMPUTING ~ 12
`DEVICE
`
`FIG. 2
`
`Page 00005
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 3 of 118
`
`US 8,612,294 Bl
`
`PROVIDE USER AND OTHER
`PARTIES WITH OPPORTUNITY
`TO CREATE SHOPPING LISTS
`
`'sa
`
`PROVIDE USER AND OTHER
`PARTIES WITH OPPORTUNITY
`TO MAKE FINANCIAL
`COMMITMENT TOWARDS
`PURCHASE OF PRODUCT OR
`SERVICE
`
`"--so
`
`ALLOW MANUFACTURERS,
`STORES, AND OTHER
`ENTITIES TO PROVIDE
`BENEFIT TO USER
`
`~62
`
`FIG. 3
`
`Page 00006
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 4 of 118
`
`US 8,612,294 Bl
`
`PROCESSOR
`
`I MICROPROCESSOR J 66
`
`DIGITAL
`SIGNAL
`PROCESSOR
`
`~70
`
`l.._68
`
`STORAGE
`
`74~ RAM I 76J ROM I
`
`78joTHERI
`
`4
`6
`l)
`
`2
`7
`I-'
`
`DISPLA y
`
`l(CD I 84_...... TOUCH
`
`SCREEN
`
`82
`
`~
`0
`8
`L.J
`
`86
`
`KEYS OR
`COMMUNICATIONS AND I/OJ PORT]
`OTHER
`C....go
`_ 94 92
`WIRELESS COMMUNICATIONS
`CIRCUITRY (TRANSMITTERS,
`RECEIVERS, ANTENNAS, ETC.)
`
`IR
`TRANSMITTER/
`RECEIVER
`96~
`
`-
`
`ACCESSORIES/
`EXPANSION
`
`100-
`
`EXPANSION
`SLOT
`
`MEDIA
`.../ DRIVES
`102
`
`WIRELESS
`COMMUNICATIONS
`CIRCUITRY
`
`--104
`
`106
`
`OTHER
`ACCESSORIES AND
`ATTACHMENTS
`
`8
`8
`IJ
`
`9 8
`)
`
`OTHER COMPONENTS
`114
`I
`I CLOCK 1110 MICROPHONE
`AND
`SPEAKER
`
`I BATTERY l
`FIG. 4
`
`112
`
`116
`
`/
`VIBRATION
`UNIT
`
`10
`8
`
`l/
`
`Page 00007
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 5 of 118
`
`US 8,612,294 Bl
`
`118
`
`DISPLAY
`
`126 OD c:::{124 :;;oo 120
`
`126
`
`122
`
`FIG. 5
`
`Page 00008
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 6 of 118
`
`US 8,612,294 Bl
`
`12.
`
`DISPLAY
`
`130
`
`128
`
`132
`
`CONTROL
`CIRCUITRY
`
`SPEAKER
`
`134
`
`136
`
`COMMUNICATIONS
`CIRCUITRY AND
`ACCESSORIES
`
`USER INPUT
`INTERFACE (E.G., ON(cid:173)
`SCREEN KEYBOARD,
`KEYBOARD, TOUCH
`SCREEN, TOUCH PAD,
`KEYS, MICROPHONE,
`POINTING DEVICE,
`ETC.)
`
`FIG. 6
`
`Page 00009
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 7 of 118
`
`US 8,612,294 Bl
`
`PROVIDE USER WITH OPPORTUNITY TO
`SEND AND RECEIVE E-MAIL, TELEPHONE
`CALLS, VOICE MAIL, PAGING MESSAGES,
`DATA SERVICE FEEDS, INCLUDING TEXT,
`GRAPHICS, AUDIO, AND VIDEO
`
`138
`/
`
`USER
`RECEIVES
`MESSAGE
`,,
`PRESENT
`MESSAGE TO
`USER
`
`'-140
`
`USER SENDS
`OR FORWARDS
`MESSAGE
`
`PROVIDE
`MESSAGE TO
`RECIPIENT
`
`'-142
`
`FIG. 7
`
`Page 00010
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 8 of 118
`
`US 8,612,294 Bl
`
`148
`
`LINK ESTABLISHED
`
`~144
`SEND BUSINESS CARD j
`
`I
`~146
`RECEIVE
`~-------'
`
`FIG. 8
`
`Page 00011
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 9 of 118
`
`US 8,612,294 Bl
`
`150
`
`,-154
`
`GRAPHIC
`LOGO
`
`156
`
`152
`_.I
`
`NAME, ADDRESS,
`TELEPHONE, FAX,
`AND E-MAIL
`INFORMATION
`
`,,,--158
`
`STORE IN BUSINESS
`CARD FILE
`
`FIG. 9
`
`Page 00012
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 10 of 118
`
`US 8,612,294 Bl
`
`160
`
`J
`
`PROVIDE USER WITH
`OPPORTUNITY TO PROVIDE
`FINANCIAL INFORMATION TO
`HANDHELD COMPUTING
`DEVICE
`
`PROVIDE USER WITH OPPORTUNITY TO
`USE FINANCIAL INFORMATION IN
`PURCHASING PRODUCTS AND
`SERVICES IN STORE OR ELSEWHERE
`(E.G., IN TRANSACTIONS IN
`AMUSEMENT PARK, SHOPPING MALL,
`MERCHANT, VENDING MACHINE, ETC.)
`
`FIG. 10
`
`Page 00013
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 11 of 118
`
`US 8,612,294 Bl
`
`164)
`
`THANKS FOR SHOPPING
`WITH US
`
`YOUR TOTAL PURCHASE
`TODAY WAS $156.07
`
`166
`
`/
`
`SAVE IN
`EXPENSE
`REPORT
`
`SAVE IN
`FINANCIAL
`PLANNER
`
`~170
`
`FIG. 11
`
`Page 00014
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 12 of 118
`
`US 8,612,294 Bl
`
`PROVIDE USER WITH OPPORTUNITY
`TO PURCHASE ELECTRONIC TICKET
`
`-...._172
`
`PROVIDE ELECTRONIC TICKET TO
`HANDHELD COMPUTING DEVICE ~174
`
`PROVIDE USER WITH OPPORTUNITY
`TO USE HANDHELD COMPUTING
`DEVICE TO PROVIDE ELECTRONIC
`TICKET TO TICKET COLLECTOR
`
`'"""-176
`
`FIG. 12
`
`Page 00015
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 13 of 118
`
`US 8,612,294 Bl
`
`12
`
`HANDHELD
`COMPUTING
`
`DEVICE r 180
`
`.... 178
`,------...L _____ l
`
`---
`
`WIRELESS
`TRANSMITTER/
`RECEIVER
`
`COMPUTER
`
`182
`
`184
`
`MERCHANT OR
`SERVICE PROVIDER
`L ____________ _J
`
`FIG. 13
`
`Page 00016
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 14 of 118
`
`US 8,612,294 Bl
`
`r'-..._ 12
`
`HANDHELD
`COMPUTING
`DEVICE
`
`y196 194
`
`/
`
`LOCAL WIRELESS
`TRANSMITTER/
`RECEIVER
`
`198
`
`REMOTE WIRELESS
`TRANSMITTER/
`RECEIVER
`
`190
`
`SERVICE
`PROVIDER
`
`SERVER
`
`188
`
`LOCAL
`WIRELESS
`TRANSMITTER/
`RECEIVER
`
`186
`
`\
`
`COMPUTER
`
`200
`202 / -204
`
`...,L'_ -
`
`-
`
`-,
`
`I
`I
`I
`L ________ J
`ORDER FULFILLMENT
`FACILITY
`
`----, r-
`1 ,~ - ' - - - -~
`l···i COMPUTER
`I
`
`I COMPUTER
`
`LMERCHANf\
`\
`, 184
`178
`
`I LMERCHANf\
`\
`, 184
`178
`
`I
`
`HANDHELD
`COMPUTING
`DEVICE
`r---12
`~ - - -~
`
`FIG. 14
`
`Page 00017
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 15 of 118
`
`US 8,612,294 Bl
`
`r,.....12
`
`HANDHELD
`COMPUTING
`DEVICE
`
`206
`
`206
`
`206
`
`SERVICE PROVIDER
`r - - - - - - ,
`I COMPUTER I
`I ~ - r - - - - - ' "'
`
`LOCAL
`WIRELESS
`TRANSMITTER/
`RECEIVER
`
`LOCAL
`WIRELESS
`TRANSMITTER/
`RECEIVER
`
`LOCAL
`WIRELESS
`TRANSMITTER/
`RECEIVER
`
`,--
`
`224
`
`\
`\
`222
`
`226
`
`r - - - - - - - - - --1 - - - - - - r - - - - -
`1 COMPUTER
`11 COMPUTER I I COMPUTER II COMPUTER
`I
`: MERCHANT' ijERCHANT JI
`218
`214:
`1
`1
`LOCAL
`:
`LOCAL
`I
`I
`I
`210-
`210-
`I WIRELESS
`I
`208 : WIRELESS
`I
`208
`I TRANSMITTER/ I
`I TRANSMITTER/ I
`I RECEIVER
`I 220
`I RECEIVER
`:
`
`-
`LKIOSK- - T, -
`-216
`
`FIG. 15
`
`~ERCHANT- 1 _,
`/
`212/
`
`Page 00018
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 16 of 118
`
`US 8,612,294 Bl
`
`STORE
`
`234
`
`TRANSMITTER
`/ RECEIVER
`
`STORE
`
`230
`
`238
`
`FIG. 16
`
`Page 00019
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 17 of 118
`
`US 8,612,294 Bl
`
`AISLE 1
`
`AISLE 2
`
`244
`
`240
`
`STORE
`
`COVERAGE
`FROM FIRST
`WIRELESS
`TRANSMITTER/
`RECEIVER
`
`COVERAGE
`FROM SECOND
`WIRELESS
`TRANSMITTER/
`RECEIVER
`
`FIG. 17
`
`Page 00020
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 18 of 118
`
`US 8,612,294 Bl
`
`GPS
`SATELLITES
`
`246
`
`(rl)
`1 1
`
`252 ?
`
`HANDHELD
`COMPUTING
`DEVICE
`
`BASE
`STATION
`
`GPS RECEIVER
`
`12
`
`250
`
`248
`
`FIG. 18
`
`Page 00021
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 19 of 118
`
`US 8,612,294 Bl
`
`12
`
`/
`HANDHELD
`COMPUTING
`DEVICE
`
`.
`.
`
`12
`r
`
`HANDHELD
`COMPUTING
`DEVICE
`
`256
`
`258
`
`COMMUNICATIONS
`EQUIPMENT
`
`~
`;256
`
`260
`
`262
`
`COMMUNICATIONS NETWORK
`(E.G., THE INTERNET)
`
`SERVICE PROVIDER
`
`264
`
`SERVER
`
`266
`
`FIG. 19
`
`Page 00022
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 20 of 118
`
`US 8,612,294 Bl
`
`ALLOW USER TO ESTABLISH LOCAL
`WIRELESS COMMUNICATIONS LINK
`BETWEEN HANDHELD COMPUTING
`DEVICE AND COMMUNICATIONS
`EQUIPMENT
`
`268
`-'
`
`USE COMMUNICATIONS EQUIPMENT TO
`COMMUNICATE WITH SERVICE
`PROVIDER OVER A REMOTE
`COMMUNICATIONS LINK
`
`270
`l./
`
`FIG. 20
`
`Page 00023
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 21 of 118
`
`US 8,612,294 Bl
`
`ORDER FULFILLMENT
`FACILITY
`
`282
`
`278
`
`SERVER
`
`STORE
`
`I SERVER r-:; 274
`\
`
`12
`)
`HANDHELD
`COMPUTING
`DEVICE
`
`286
`
`BAR CODE
`~~
`SCANNER OR
`RFID UNIT
`"--2a4
`276
`
`COMPUTER
`
`272
`
`HOME, OFFICE, ETC.
`
`FIG. 21
`
`Page 00024
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 22 of 118
`
`US 8,612,294 Bl
`
`288
`
`NEW ITEM:
`
`/290
`
`BLUE COTTON SWEATER (MED.)
`
`ADD TO LIST?
`
`~ ~
`
`~-----294
`
`292
`
`VIEW CURRENT LIST
`
`296
`
`.____ __ v_E_s_-_M_v_1_TE_M_s_o_N_L v __ ~I
`I YES - MY ITEMS AND GIFT ITEMS LJga
`
`FIG. 22
`
`Page 00025
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 23 of 118
`
`US 8,612,294 Bl
`
`~300
`
`MY LIST
`
`302
`
`/
`
`$57 BLUE COTTON SWEATER (MED.)
`STORE: THE GAP
`
`I ORDER NOW
`
`304
`
`FIG. 23
`
`Page 00026
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 24 of 118
`
`US 8,612,294 Bl
`
`CURRENT LIST
`
`~308
`
`$57 BLUE COTTON SWEATER (MED.)
`STORE: THE GAP FOR: SELF
`
`306
`
`310
`~
`ADD TO CART
`
`$24 STRIPED CHILDREN'S PULLOVER (SMALL)
`STORE: THE LIMITED FOR: SARAH
`
`ADD TO CART
`
`$18 BLACK DINNER PLATES (8)
`STORE: CRATE & BARREL FOR: THE SMITHS
`
`ADD TO CART
`
`FIG. 24
`
`Page 00027
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 25 of 118
`
`US 8,612,294 Bl
`
`PROVIDE USER WITH
`OPPORTUNITY TO ADD
`ITEM TO LIST IN STORE V
`
`312
`
`USER ADDS ITEM
`TO LIST
`
`PROVIDE USER WITH
`OPPORTUNITY TO BUY
`ITEM
`
`314
`l-/
`
`USER ORDERS
`ITEMS USING
`HANDHELD
`COMPUTING
`DEVICE
`
`USER ORDE RS
`ITEM USIN G
`PERSONA L
`COMPUTE R
`
`w
`
`',
`
`FULFILL ORDER
`
`3 16
`L/
`
`FIG. 25
`
`Page 00028
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 26 of 118
`
`US 8,612,294 Bl
`
`PROVIDE USER WITH
`OPPORTUNITY TO
`IDENTIFY ITEM,
`CATEGORY OF ITEM,
`318
`MANUFACTURER, ETC. ~
`
`w
`
`PROVIDE USER WITH
`INFORMATION AND
`SERVICES RELATED TO
`ITEM, CATEGORY,
`MANUFACTURER,ETC.
`
`3 20
`V
`
`FIG. 26
`
`Page 00029
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 27 of 118
`
`US 8,612,294 Bl
`
`ITEM:
`
`SONY KR27W
`
`322
`
`.--/324
`
`27" COLOR TELEVISION ~
`
`326
`
`342
`')
`
`COMPARE
`PRICES
`
`~344
`
`CHECK
`STOCK
`
`334__.,
`
`REVIEWS
`
`" 336
`
`ADVERTISEMENT
`
`r-330
`
`_-328
`
`,-338
`
`WARRANTY
`INFORMATION
`
`REQUEST
`BROCHURE
`
`CUSTOMER
`COMMENTS
`
`r-332
`
`~340
`
`FINANCING
`INFORMATION
`
`VIEW VIDEO
`
`FIG. 27
`
`Page 00030
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 28 of 118
`
`US 8,612,294 Bl
`
`346
`
`PRICE COMPARISON
`
`ITEM:
`
`~348
`
`SONY KR27W
`
`27" COLOR TELEVISION
`
`350
`
`BUY.COM
`
`$239.99
`
`YAHOO! ELECTRONICS
`
`I ORDER NOW h
`$241-00 I ORDER NOW I
`
`- - - - -
`
`352
`
`J & R MUSIC WORLD $229.00
`
`ORDER NOW
`
`354
`
`SEARS 244 WEST STREET
`BOSTON.MA
`$240.00
`
`DIRECTIONS µ56
`
`CALL NOW 1)58
`
`CIRCUIT CITY 123 MAIN STREET
`CAMBRIDGE, MA
`$242.00
`
`/356
`
`DIRECTIONS I
`
`CALL NOW lJ58
`
`FIG. 28
`
`Page 00031
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 29 of 118
`
`US 8,612,294 Bl
`
`360
`
`PRODUCT INFORMATION
`AND SERVICES
`
`VIEW BY MANUFACTURER ~362
`
`VIEW BY PRODUCT TYPE
`
`r 364
`.__ __________ _,
`G
`
`SEARCH I
`
`\
`
`366
`
`\__ 368
`
`FIG. 29
`
`Page 00032
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 30 of 118
`
`US 8,612,294 Bl
`
`~370
`
`MANUFACTURERS
`
`372
`........._r--.
`
`AIWA
`
`CLARION
`
`COMPAQ
`
`INFINITY
`
`PANASONIC
`
`SONY
`
`FIG. 30
`
`Page 00033
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 31 of 118
`
`US 8,612,294 Bl
`
`----374
`
`PRODUCT CATEGORIES
`
`~ ~78
`AUD IO~
`
`376
`
`COMMUNICATIONS
`
`HOUSEWARES
`
`PHOTOGRAPHY
`
`j LO(O )OGO j
`
`V IDEO~
`~ '378
`
`ADVERTISEMENT
`
`~380
`
`FIG. 31
`
`Page 00034
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 32 of 118
`
`US 8,612,294 Bl
`
`382
`
`SEARCH RESULTS FOR
`"SONY TV"
`
`384
`
`SONY KV9PT50 $295.66 I VIEW INFO k
`SONY KV9PT60 $316.50 I VIEW INFO~
`
`386
`
`SONY KV32V68 $1099.99 I VIEW INFO~
`386a
`
`SONY TELEVISIONS
`
`\388
`
`I VIEW INFO I
`~
`390
`
`FIG. 32
`
`Page 00035
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 33 of 118
`
`US 8,612,294 Bl
`
`392
`
`SONY TELEVISIONS
`
`394
`v
`
`VIDEO
`
`INFORMATION ON SONY
`TELEVISIONS
`
`396
`
`FIG. 33
`
`Page 00036
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 34 of 118
`
`US 8,612,294 Bl
`
`400
`~ SONY KV32V68 $1099.99
`402 -...__..
`- IN STOCK NOW -
`
`404
`\.
`
`408
`\._
`
`412
`'-
`
`VIDEO
`
`SPECIFICATIONS
`
`398
`
`406
`l,)
`
`ORDER NOW
`
`REQUEST
`BROCHURE
`
`410
`
`SAVE
`INFORMATION
`
`REQUEST SALES
`ASSISTANCE
`
`414
`../
`
`FIG. 34
`
`Page 00037
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 35 of 118
`
`US 8,612,294 Bl
`
`USER TRAVELS
`TO RETAIL
`ESTABLISHMENT
`
`ESTABLISH LOCAL
`COMMUNICATIONS LINK
`WITH HANDHELD
`COMPUTING DEVICE
`
`__..,416
`
`DISPLAY OPTION FOR USER
`INDICATING THAT SHOPPING
`ASSISTANCE APPLICATION IS
`AVAILABLE
`
`USER SELECTS
`OPTION
`
`INVOKE
`SHOPPING
`ASSISTANCE L./420
`APPLICATION
`
`FIG. 35
`
`Page 00038
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 36 of 118
`
`US 8,612,294 Bl
`
`IDENTIFY ITEM IN STORE /422
`
`,,
`
`INVOKE SHOPPING
`ASSISTANCE APPLICATION
`
`./424
`
`ALLOW USER TO OBTAIN
`INFORMATION AND ACCESS
`SERVICES ASSOCIATED WITH ITEM
`
`L/426
`
`FIG. 36
`
`Page 00039
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 37 of 118
`
`US 8,612,294 Bl
`
`WELCOME TO SUNRISE MALL
`
`WHAT'S NEW
`
`~430
`
`GENERAL
`INFORMATION
`
`432
`_,/
`
`436
`/
`
`428
`
`DIRECTORY ~ 34
`
`MAP
`
`.__ ___ ___,
`
`440
`)
`
`.___s_P-EC~IA_L_s___.l438
`
`STORE AND
`PRODUCT LOCATOR
`
`ADVERTISEMENT
`
`442
`/
`
`FIG. 37
`
`Page 00040
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 38 of 118
`
`US 8,612,294 Bl
`
`WHAT'S NEW
`
`ADVERTISEMENT L
`
`.___~~~~~~~~____. 448
`
`450
`
`456
`
`460
`
`MONDAY
`MEET WITH TRACY SMITH
`AT BEST BOOKS -- 2 PM
`
`452--1 SET REMINDER I I MORE INFO j
`
`454
`
`446
`
`KIDS PLAY FREE AT KIDSPORTS
`LOWER LEVEL WEST 3:00 - 4:00 PM
`
`~ SET REMINDER I
`
`458
`
`HEAR A PREVIEW OF JOE JET'S
`NEW ALBUM
`4:30 AT MUSIC TOWN
`
`J SET REMINDER I
`
`I MORE INFO lJ64
`
`462
`
`eszr-466
`
`FIG. 38
`
`Page 00041
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 39 of 118
`
`US 8,612,294 Bl
`
`GENERAL INFORMATION
`
`MALL HOURS
`
`~470
`
`MONDAY -- FRIDAY 9 - 9:30
`SATURDAY 9 - 10
`SUNDAY 10 - 8
`
`468
`
`ADVERTISEMENT
`
`472
`LJ
`
`(._,474
`CONTACT us I
`
`FIG. 39
`
`Page 00042
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 40 of 118
`
`US 8,612,294 Bl
`
`478
`
`ART
`
`476
`
`DIRECTORY
`
`480
`
`BOOKS
`
`CLOTHING - CHILDREN'S ~ I LOGO I
`
`CLOTHING- MEN'S I LOGO 11 LOGO 11 LOGO I
`CLOTHING - WOMEN'S I LOGO 11 LOGO 11 LOGO I
`DEPARTMENT STORES I LOGO I
`ELECTRONICS I LOGO I
`ENTERTAINMENT I LOGO 11 LOGO I
`
`FOOD - FAST FOOD I LOGO 11 LOGO 11 LOGO I
`FOOD - REST AU RANTS I LOGO I
`FOOD - SPECIAL TY I LOGO I
`
`GIFTS
`
`HEAL TH I LOGO I
`MORE
`r482
`
`FIG. 40
`
`Page 00043
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 41 of 118
`
`US 8,612,294 Bl
`
`484
`
`SHOES
`
`'--~~A_o_v_E_R_T_is_E_M_E_N_T~~---'~486
`
`STORE
`
`CLARK'S
`
`EASY SPIRIT
`
`488
`
`JOHNSTON & MURPHY
`
`NATURALIZER
`
`PAYLESS
`
`WALKING ALL OVER
`
`LOCATION
`
`490
`
`1E I MAP L
`4W I MAP~
`3N I MAP I
`3N I MAP I
`4E I MAP I
`4E I MAP I
`
`FIG. 41
`
`Page 00044
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 42 of 118
`
`US 8,612,294 Bl
`
`494
`
`MAP AND
`DIRECTIONS TO
`PAYLESS
`
`496
`
`~ YOU ARE HERE (1ST LEVEL)
`®
`
`ESCALATOR --
`
`..-- 500
`
`498
`
`/
`
`PAYLESS
`
`(2ND LEVEL)
`
`FIG. 42
`
`Page 00045
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 43 of 118
`
`US 8,612,294 Bl
`
`DIRECTIONS TO
`PAYLESS SHOES
`
`1. GO STRAIGHT TOWARDS FOUNTAIN
`
`502
`
`/
`........
`
`2. TURN LEFT AND PROCEED FOR 50 FEET
`
`3. PAYLESS IS ON THE RIGHT
`
`FIG. 43
`
`Page 00046
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 44 of 118
`
`US 8,612,294 Bl
`
`CLARK'S
`
`PROMOTIONAL MATERIAL
`
`506
`V
`
`508
`INFORMATION ON STORE HOURS, V
`LOCATION, ETC.
`
`504
`
`SPECIAL OFFERS
`
`510
`/
`
`FIG. 44
`
`Page 00047
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 45 of 118
`
`US 8,612,294 Bl
`
`512
`
`MAP
`
`51
`
`~
`
`/YOU ARE HERE
`
`®
`
`STORE
`
`STORE
`
`STORE
`
`STORE
`
`STORE
`
`STORE
`
`STORE I LOGO I
`\
`'-516
`
`STORE STORE
`
`SKATING RINK
`
`ZOOM OUT r 518
`
`FIG. 45
`
`Page 00048
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 46 of 118
`
`US 8,612,294 Bl
`
`SPECIALS
`
`520
`
`r522
`
`$5 OFF ANY PURCHASE OVER $30 AT OLD
`NAVY IF YOU RESPOND NOW
`
`,,.--, 524
`
`SUPERCUTS
`$15 SHAMPOO AND HAIRCUT IF YOU MAKE
`AN APPOINTMENT NOW
`
`r'526
`
`CALIFORNIA GRILLE
`$10 OF LUNCH FOR TWO IF YOU RESERVE
`NOW
`
`8--528
`
`FIG. 46
`
`Page 00049
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 47 of 118
`
`US 8,612,294 Bl
`
`530
`
`SEARCH FOR A STORE
`
`~532
`
`BY NAME
`
`....__~~~~__,t-,,534
`
`BY TYPE
`
`.___~~~~___._!v_,L-,.--536
`
`BY LOCATION
`
`....__~~~~__._!v_,t-538
`
`SEARCH FOR A PRODUCT
`
`BY NAME
`
`....__~~~~__,r-542
`
`540
`
`BY TYPE
`
`BY LOCATION
`
`.___~~~~___._!v__.t-544
`~~~~~~lv ....... r-'546
`
`SEARCH r 548
`
`1
`
`FIG. 47
`
`Page 00050
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 48 of 118
`
`US 8,612,294 Bl
`
`PROVIDE USER WITH OPPORTUNITY V 550
`TO SEARCH FOR DESIRED
`PRODUCTS, SERVICES, AND STORES
`
`DISPLAY INFORMATION TO USER
`
`,,
`
`PROVIDE USER WITH OPPORTUNITY
`TO RESPOND TO INFORMATION
`
`~552
`
`- 554
`
`FIG. 48
`
`Page 00051
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 49 of 118
`
`US 8,612,294 Bl
`
`PROVIDE USER WITH MESSAGES
`WHEN USER IS IN PROXIMITY OF
`MERCHANT
`
`J56
`
`PROVIDE USER WITH
`MESSAGES WHEN USER IS
`558
`IN LOCAL WIRELESS
`COMMUNICATIONS WITH L/
`MALL OR OTHER ENTITY
`
`PROVIDE USER
`WITH
`NOTIFICATIONS
`FROM MERCHANT v
`
`560
`
`, ir
`
`PROVIDE USER WITH
`REMINDERS FROM
`LOCAL MERCHANTS
`
`/562
`
`PROVIDE USER WITH E-MAIL V
`AND OTHER MESSAGES
`
`564
`
`FIG. 49
`
`Page 00052
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 50 of 118
`
`US 8,612,294 Bl
`
`MESSAGES FROM NEARBY MERCHANTS
`
`I
`
`ADVERTISEMENT
`
`I jLoGoj
`
`SPECIALS
`
`jLoGol
`
`jLoGol
`
`jLoGol
`
`NOTIFICATIONS FROM LOCAL MERCHANTS
`
`jLoGoj
`
`I MESSAGE I
`
`REMINDERS FROM LOCAL MERCHANTS
`
`ILOGOI
`
`I MESSAGE I
`
`E-MAIL MESSAGES
`YOU HAVE IT] UNREAD MESSAGES
`
`68
`5
`_/
`
`570
`_/
`
`5 72
`-lJ
`
`574
`/
`
`--
`
`576
`V
`.,,
`
`FIG. 50
`
`Page 00053
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 51 of 118
`
`US 8,612,294 Bl
`
`1 578
`./
`
`STOP!
`
`DID YOU KNOW THAT ALL MEN'S
`SUITS ARE HALF PRICE AT
`MEN'S WEARHOUSE
`
`LOWER LEVEL ACROSS
`FROM THE SKATING RINK
`
`FIG. 51
`
`Page 00054
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 52 of 118
`
`US 8,612,294 Bl
`
`rsao
`r
`
`CALIFORNIA GRILLE
`
`WE HAVE AMPLE SEATING
`AVAILABLE ON THE TERRACE
`
`FIG. 52
`
`Page 00055
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 53 of 118
`
`US 8,612,294 Bl
`
`ALERT USER TO MESSAGE FROM
`NEARBY MERCHANT
`
`582
`_./
`
`USER DOES
`NOT
`RESPOND
`
`584
`)
`
`USER
`RESPONDS
`586
`\ ,,
`
`CANCEL
`ALERT
`
`DISPLAY
`MESSAGE
`FOR USER
`
`FIG. 53
`
`Page 00056
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 54 of 118
`
`US 8,612,294 Bl
`
`ALERT USER TO SPECIAL
`AVAILABLE AT MALL OR OTHER
`FACILITY
`
`588
`J
`
`USER DOES
`NOT
`RESPOND
`
`590
`J
`
`1f'
`
`CANCEL
`ALERT
`
`USER
`RESPONDS
`
`592
`\
`,.
`DISPLAY
`INFORMATION ON
`SPECIAL TO USER
`
`FIG. 54
`
`Page 00057
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 55 of 118
`
`US 8,612,294 Bl
`
`.,,,,- 594
`
`/
`
`SPECIAL TODAY
`
`2 FOR 1
`PIZZA SLICES
`
`AT MAMA'S PIZZERIA
`
`IN THE FOOD COURT
`
`IF PURCHASED BEFORE NOON
`
`FIG. 55
`
`Page 00058
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 56 of 118
`
`US 8,612,294 Bl
`
`596
`
`EARLY BIRD SPECIAL
`
`$10 OFF ANY CLOTHING
`PURCHASE TODAY AT
`OLD NA VY OVER $30
`IF YOU RESPOND TO THIS OFFER
`BY 1:00 PM
`
`RESPOND NOW
`- - - - - -~
`
`f/598
`J
`
`REMIND ME LATER I
`
`~600
`
`FIG. 56
`
`Page 00059
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 57 of 118
`
`US 8,612,294 Bl
`
`602
`
`CHARGE$ 1 (NONREFUNDABLE)
`TO HOLD MY $10 COUPON
`AT OLD NAVY UNTIL 9:30 PM
`
`I
`CHARGE MY SUNRISE ACCOUNT
`~--------------'
`
`~604
`
`CHARGE MY CREDIT CARD v 606
`OR DEBIT CARD
`
`FIG. 57
`
`Page 00060
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 58 of 118
`
`US 8,612,294 Bl
`
`ALERT USER TO
`AVAILABILITY OF SPECIAL
`
`08
`6
`./
`
`USER INDICATES
`INTEREST IN SP ECIAL
`'r
`
`DISPLAY
`INFORMATION ON
`SPECIAL TO USER /610
`
`USER RESPOND S TO SPECIAL
`
`V
`
`PROVIDE USER WITH
`OPPORTUNITY TO
`MAKE FINANCIAL
`COMMITMENT
`
`l/612
`
`MMITMENT
`USER MAKES CO
`"'
`614
`PROVIDE USER WITH BENEFIT /
`OF SPECIAL
`
`FIG. 58
`
`Page 00061
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 59 of 118
`
`US 8,612,294 Bl
`
`616
`
`CONFIRMATION
`
`TO REDEEM
`YOUR $10 OFF SPECIAL
`AT OLD NAVY, PLEASE
`PROVIDE THE FOLLOWING
`CODE AT CHECK OUT
`TODAY BY 9:30 PM:
`
`KHV73X ...--
`
`618
`
`~620
`I
`.__ ___ __.
`
`SAVE IT
`
`FIG. 59
`
`Page 00062
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 60 of 118
`
`US 8,612,294 Bl
`
`622
`
`YOUR PHOTOGRAPHS ARE
`READY AT FRIENDLY FOTO !
`
`VIEW PREVIEWS l,s24
`
`PAY NOW
`
`' 626
`
`E-MAIL TO
`A FRIEND
`
`PAY NOW AND
`MAIL TO HOME
`
`(
`628
`
`/632
`
`ADVERTISEMENT
`
`FIG. 60
`
`Page 00063
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 61 of 118
`
`US 8,612,294 Bl
`
`TO: MR. & MRS. SMITH
`
`FROM: WONDER KIDS CHILD CARE
`
`PLEASE COME TO CHECK ON
`SARAH AT YOUR EARLIEST
`CONVENIENCE
`
`THANK YOU
`
`ADVERTISEMENT
`
`FIG. 61
`
`Page 00064
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 62 of 118
`
`US 8,612,294 Bl
`
`634
`
`YOUR TABLE IS
`READY AT ALFREDO'S
`
`636
`V
`
`ADVERTISEMENT
`
`FIG. 62
`
`Page 00065
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 63 of 118
`
`US 8,612,294 Bl
`
`ALLOW USER TO
`REQUEST
`NOTIFICATION BY
`MERCHANT
`
`L/638
`
`USER REQUESTS NOTIFICATION
`
`MERCHANT SENDS
`NOTIFICATION TO USER l/640
`
`Ir
`
`PROVIDE USER WITH
`OPPORTUNITY TO RESPOND
`TO NOTIFICATION AND TAKE
`OTHER ACTIONS
`
`v642
`
`FIG. 63
`
`Page 00066
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 64 of 118
`
`US 8,612,294 Bl
`
`/644
`
`/
`
`REMINDER
`
`YOU HAVE A $ 5 COUPON
`
`FOR OLD NAVY
`
`THAT EXPIRES IN 2 HOURS
`
`FIG. 64
`
`Page 00067
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 65 of 118
`
`US 8,612,294 Bl
`
`646
`
`REMINDER ~648
`
`YOU HAVE DINNER RESERVATIONS
`
`AT ALFREDO'S AT 8:00 PM
`
`'--~v_i_E\N~M_E_N_u~___.}3
`
`50
`
`CALL ALFREDO'S
`
`]3s2
`
`'--~~-M_A_P~~----'~
`
`54
`
`656
`/
`
`7
`
`ADVERTISEMENT
`
`FIG. 65
`
`Page 00068
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 66 of 118
`
`US 8,612,294 Bl
`
`658
`
`662
`
`/
`
`REMINDER
`
`TOY STORY 2
`
`~660
`
`STARTS IN 20 MINUTES
`
`LEAVE TIME TO
`
`PURCHASE REFRESHMENTS
`
`AT THE THEATRE
`
`PRESENT THIS COUPON FOR
`50 ¢ OFF A LARGE SODA
`
`CODE
`
`
`'--~~~~-'~ ....... 664
`
`l
`
`
`
`FIG. 66
`
`Page 00069
`
`

`

`U.S. Patent
`
`Dec. 17, 2013
`
`Sheet 67 of 118
`
`US 8,612,294 Bl
`
`ALLOW USER TO
`REQUEST
`REMINDER _ __.,,.. 666
`
`USER REQUESTS REMINDER
`
`w
`
`668
`
`~
`
`PROVIDE USER
`WITH REMINDER
`
`FIG. 67