(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2003/0060240 A1
`Graham et al.
`(43) Pub. Date:
`Mar. 27, 2003
`
`US 2003OO60240A1
`
`(54) WIRELESS MOBILE IMAGE MESSAGING
`(76) Inventors: Tyrol R. Graham, Seattle, WA (US);
`Eric J. Hull, Seattle, WA (US);
`Jonathan O. Nelson, Kirkland, WA
`(US)
`Correspondence Address:
`SCHWABE, WILLIAMSON & WYATT, P.C.
`10260 SW GREENBURG ROAD
`SUTE 820
`PORTLAND, OR 97223 (US)
`(21) Appl. No.:
`10/255,860
`(22) Filed:
`Sep. 25, 2002
`Related U.S. Application Data
`(60) Provisional application No. 60/325,094, filed on Sep.
`25, 2001.
`
`Publication Classification
`(51) Int. Cl." .......................... H04M 11/10; H04M 1/00;
`HO4B 1/38
`(52) U.S. Cl. ........................... 455/566; 455/550; 455/412
`
`(57)
`
`ABSTRACT
`
`Non-verbal communications between users of wireless
`mobile devices are facilitated using image messages. An
`image message may e.g. convey information about the
`Sender user, in particular, current information about the
`Sender user. In one aspect, a user may select an image
`message category, and Select an image message among the
`image messages of the Selected image message category for
`transmission, to quickly, efficiently and graphically convey
`(current) information about the user. The process may be
`performed to form a mixed media message. Received image
`message to convey current information may be aged via time
`and/or color displayS.
`
`
`
`X
`
`|
`
`MOBILE
`DEVICE
`
`400
`
`-
`
`412
`
`422
`
`410
`
`Wireless .
`Interface
`unit
`
`H
`
`-H-
`
`Illuminator \
`
`0.
`
`Haptic
`Interface
`
`452
`
`454.
`
`456
`
`Input/Output
`Interface
`
`434
`
`436
`458
`
`Keypad
`
`460
`
`Infrared
`O /
`
`448
`
`GOOGLE EXHIBIT 1023
`Google LLC v. BlackBerry Ltd.
`IPR2017-00912
`
`Page 1 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 1 of 15
`
`US 2003/0060240 A1
`
`
`
`Wireless Network
`
`
`
`
`
`O MOBILE
`
`DEVICE
`(FIG. 4)
`
`O MOBILE
`
`DEVICE
`(FIG. 4)
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Seruer
`Computer
`(FIG. 3)
`
`
`
`Wide Area
`Network/Local
`Area Nettuork
`(FIG. 2)
`
`
`
`Server
`Computer
`(FIG. 3)
`
`
`
`
`
`
`
`Fig.1
`
`Page 2 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 2 of 15
`
`US 2003/0060240 A1
`
`220,
`
`22
`
`210
`
`ROUTER
`
`
`
`
`
`
`
`
`
`WIDE
`AREA
`NETWORK
`(WAN)
`
`230
`
`210
`ROLITER
`
`210
`
`240
`
`T
`ROTER
`
`220.
`
`REMOTE
`COMPTER
`
`
`
`220d
`
`240
`
`REMOTE
`COMPUTER
`
`200
`
`Fig.2
`
`Page 3 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 3 of 15
`
`US 2003/0060240 A1
`
`U()(U See
`
`
`
`
`
`Image Message
`Server
`
`
`
`
`
`
`
`
`
`
`
`network
`interface
`unit
`
`input/output
`interface
`
`hard disk
`drive
`
`338
`
`
`
`
`
`video
`display
`adapter
`
`318
`
`314
`
`Fig.3
`
`Page 4 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003. Sheet 4 of 15
`
`US 2003/0060240 A1
`
`C D
`
`MOBILE
`DEVICE
`
`CPLI
`
`412
`
`422
`
`Input/Output
`Interface
`
`410
`
`Wireless
`Interface
`unit
`
`b
`
`Ho
`
`
`
`
`
`Haptic
`Interface
`
`Audio
`
`452
`
`454
`
`Display
`
`456
`
`y
`
`Page 5 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 5 of 15
`
`US 2003/0060240 A1
`
`
`
`systs
`S&s 4 'A' AAA
`
`CHANGE IMAGE?
`ACTION LOCATION MOOD SYMBOL
`
`Fig. 5
`
`Page 6 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 6 of 15
`
`US 2003/0060240 A1
`
`800
`Nu/
`
`
`
`501"
`
`XCXCX
`s2SRSSSSSS
`Q&s
`
`Fig. 6
`
`Page 7 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 7 of 15
`
`US 2003/0060240 A1
`
`1000
`-N-/
`
`1010
`
`1015
`
`1020
`
`1025
`
`Image Message
`
`Action Image
`
`Location Image
`
`--
`
`
`
`1030
`
`1035
`
`1040
`
`Mood Image
`Identifier
`
`Symbol Image +
`Identifier
`
`Time
`
`H
`
`1045
`
`Fig. 7
`
`Page 8 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 8 of 15
`
`US 2003/0060240 A1
`
`1100
`
`N/
`
`
`
`
`
`
`
`
`
`
`
`Display Selectable
`Images
`
`1110
`
`Select Images From
`Categories
`
`Include Identifiers of
`Selected Images in Image
`Message
`
`Send Image Message To
`Other User
`
`1120
`
`1130
`
`1140
`
`Fig. 8
`
`Page 9 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 9 of 15
`
`US 2003/0060240 A1
`
`
`
`
`
`
`
`
`
`
`
`1200
`
`1205
`
`Receive Message
`
`Images
`Included?
`
`Parse Message
`
`Retrieve/Regenerate
`luded I
`Included Images
`
`NO
`
`Display Regenerated
`Images
`
`Fig. 9
`
`Page 10 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 10 of 15 US 2003/0060240A1
`
`
`
`Image Message Server
`Receives Image
`Messages From users
`
`update PAL LIST?
`
`pdate Other
`USer?
`
`Image Server
`Automatically Sends
`Requestor updated
`Image Messages For
`Every Member Of PAL
`LIST
`
`Image Server
`Automatically Sends
`Requestor updated
`Image Message For
`Other User
`
`Fig. 10
`
`Page 11 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 11 of 15 US 2003/0060240A1
`
`U.
`
`
`
`
`
`Image Message Server
`Receives Image Message
`From User
`
`710
`
`720
`
`
`
`Member Of
`nabled PAL LIST2
`
`To Other
`Ser?
`
`NO
`
`
`
`730
`
`740
`
`YES
`
`YES
`
`
`
`
`
`Image Server
`Automatically Sends
`Image Message To
`Every Member Of
`Enabled PAL LIST
`
`Image Server Sends
`Image Message To
`Other ser
`
`
`
`
`
`Store Image
`Message For
`Later lise
`
`750
`
`760
`
`Fig.11
`
`Page 12 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003 Sheet 12 of 15 US 2003/0060240 A1
`
`
`
`Facilitate TextInput
`
`1202
`
`
`
`1204
`
`
`
`Image Input?
`
`Facilitate Image
`Input
`
`1208
`
`1210
`
`1200
`
`Figure 12
`
`Page 13 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003. Sheet 13 of 15 US 2003/0060240 A1
`
`
`
`1304
`
`Figure 13b
`
`Page 14 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003. Sheet 14 of 15 US 2003/0060240A1
`
`
`
`C - 5 : ...,
`-- 3:5.
`
`Figure 13d
`
`Page 15 of 29
`
`

`

`Patent Application Publication Mar. 27, 2003. Sheet 15 of 15
`
`US 2003/0060240 A1
`
`
`
`Page 16 of 29
`
`

`

`US 2003/0060240 A1
`
`Mar. 27, 2003
`
`WIRELESS MOBILE IMAGE MESSAGING
`
`RELATED APPLICATION
`0001. The present application is the non-provisional
`application of provisional application No. 60/325,094 filed
`Sep. 25, 2001, and titled “Method and Apparatus for Com
`municating Image Messages between Users of Mobile
`Devices', and claims priority to Said provisional application.
`The Specification of the provisional application is hereby
`fully incorporated by reference.
`
`FIELD OF THE INVENTION
`0002 The present invention relates to mobile communi
`cation devices, and more specifically, the invention relates to
`Sending and receiving image messages between users of
`mobile devices.
`
`BACKGROUND OF THE INVENTION
`0003. Since their introduction, the number of services
`and features for cellular telephones has steadily increased
`while the cost of ownership and operation has decreased. At
`first, these mobile telecommunication devices operated on
`analog wireleSS networks that enabled Voice communication
`and Simple paging features. Later, digital wireleSS networks
`were introduced for cellular telephones to provide more
`advanced features for Voice and data communication, Such
`as encryption, caller identification and transmitting and
`receiving short message Service (SMS) text messages. More
`recently, Some cellular telephones enable the browsing of
`web pages on the Internet or other on-line Services.
`0004. The functionality of cellular telephones continues
`to increase. Some cellular telephones incorporate many of
`the features originally provided for in handheld electronic
`devices, Such as personal digital assistants (PDAS). Rela
`tively simple PDA features Such as keeping a list of contacts,
`a calendar, appointments, and the like have been generally
`integrated into recent cellular telephone models.
`0005 Along with the increased services and features, it is
`common for individuals to own a cellular telephone and use
`it for daily communications. Individuals are no longer
`restricting the use of their cellular telephone to Strictly
`busineSS or emergency calls. They are talking with their
`friends about what they are currently doing, what they are
`listening to on the radio, watching on television, Viewing on
`the World Wide Web, and the like. The user may want tell
`their friends what they are current doing and experiencing,
`and to know what their friends are doing, all without having
`to make numerous phone calls.
`0006. However, unlike desktop computers, laptop com
`puters and PDA, cellular telephones typically have limited
`input capabilities. That is, inputs typically have to be made
`through a limited number of inputs keys, e.g. through a
`12-key numeric keypad. Thus, a great need exists to enable
`the rich functionalities, Such as non-verbal conversing with
`users of other cellular telephones, to be consumable in an
`efficient and friendly manner under the context of limited
`input keys.
`
`mobile devices, Such as cellular telephones, using image
`messages. The image message may e.g. convey information
`about the Sender users. In particular, the image message may
`convey current information about the Sender users.
`0008. In one aspect, the invention is directed towards
`facilitating a user of a wireleSS mobile device in efficiently
`Selecting an image message category, and Selecting an image
`message among the image messages of the Selected image
`message category for transmission, to quickly, efficiently
`and graphically convey information about the user, in par
`ticular, current information about the user.
`0009. The image message system may include image
`message categories Such as a location image message cat
`egory, a mood image message category, an activity image
`message category, a random image message category, and So
`forth.
`0010. In another aspect, the invention is directed towards
`Sending the image message in a reduced bandwidth con
`Sumption manner, by Sending an identifier of the image
`message. A recipient employing a wireleSS mobile device
`equipped with the invention may locally retrieve and render
`the image message based on the image message identifier
`provided.
`0011. In yet another aspect, the invention is directed
`towards tracking and indicating for a user of a wireleSS
`mobile device, image messages Sent/received, and the
`amount of time Since the image messages have been Sent/
`received.
`0012. In yet another aspect, the invention is directed
`towards, determining an illuminable input key correspond
`ing to a Sender of an image message, and illuminating the
`corresponding illuminable input key to indicate receipt of an
`image message from the corresponding Sender user.
`0013 In various embodiments, different colors may also
`be employed to indicate an age of a received image message
`from the corresponding Sender.
`0014.
`In yet another aspect, the invention is directed
`towards requesting and receiving updates to received image
`messages to update current information about Sender users.
`0015. In yet another aspect, the invention is directed
`towards the employment of mixed media messages in com
`munications. A mixed media message includes text and
`images. A mixed media message may also further include
`audio, Video and messages of other media types.
`0016. In various embodiments, a mixed media message is
`Sent in a full text form, with the images being replaced by
`their textual equivalents. In various embodiments, the tex
`tual equivalents may be identified as having equivalent
`images. Resultantly, the received message may be rendered
`in a full text form (with images replaced by their textual
`equivalents) or a mixed media form (with the images
`restored), depending on the capabilities of the receiving
`wireleSS mobile device, e.g., legacy devices verSuS devices
`incorporated with the present invention.
`
`SUMMARY OF THE INVENTION
`0007. The invention is directed to towards facilitating
`non-verbal communications between users of wireleSS
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0017 FIG. 1 is a schematic diagram that shows an
`exemplary System overview;
`
`Page 17 of 29
`
`

`

`US 2003/0060240 A1
`
`Mar. 27, 2003
`
`FIG. 2 is a schematic diagram that illustrates an
`0.018
`exemplary System overview in which local area networks
`and a wide area network are interconnected by routers,
`0.019
`FIG. 3 is a schematic diagram that shows an
`exemplary Server,
`0020 FIG. 4 is a schematic diagram that illustrates an
`exemplary mobile device;
`0021
`FIG. 5 is a schematic diagram illustrating an
`exemplary embodiment of a mobile device arranged in an
`image message edit mode,
`0022 FIG. 6 is a schematic diagram illustrating an
`exemplary embodiment of a mobile device arranged in a
`received image message mode,
`0023 FIG. 7 is a schematic diagram illustrating an
`exemplary image message reporting System format;
`0024 FIG. 8 is a flow chart illustrating a process for
`Selecting images and Sending the Selected images in a
`message to other users,
`0025 FIG. 9 is a flow chart illustrating a process for
`receiving and displaying images from other users,
`0.026
`FIG. 10 is a flow chart showing a process for
`polling for image messages from at least one other member
`of a list; and
`0.027
`FIG. 11 is a flow chart illustrating a process for
`broadcasting image message updates to every other member
`of a list, in accordance with the invention.
`0028 FIG. 12 is a flow chart illustrating a process for
`communication between users of wireleSS mobile Stations
`using mixed media messages.
`0029 FIGS. 13a-13a illustrate a number of example
`Screen Snapshots for the communication process of FIG. 12.
`0030 FIG. 14 illustrates an example mixed media mes
`Sage format, in accordance with one embodiment.
`
`DETAILED DESCRIPTION OF EMBODIMENTS
`OF THE INVENTION
`0031. The present invention includes facilitating non
`Verbal communications between users of wireleSS mobile
`devices, using image messages.
`0032. In the following description, various aspects of the
`present invention will be described. However, it will be
`apparent to those skilled in the art that the present invention
`may be practiced with only Some or all aspects of the present
`invention. For purposes of explanation, Specific numbers,
`materials and configurations are set forth in order to provide
`a thorough understanding of the present invention. However,
`it will be apparent to one skilled in the art that the present
`invention may be practiced without the Specific details. In
`other instances, well-known features are omitted or simpli
`fied in order not to obscure the present invention.
`0.033
`Parts of the description will be presented in wire
`leSS mobile telephony terms, Such as data, flag, transmit,
`receive, and So forth, consistent with the manner commonly
`employed by those skilled in the art to convey the Substance
`of their work to others skilled in the art. As well understood
`by those skilled in the art, these quantities take the form of
`electrical, magnetic, or optical Signals capable of being
`
`Stored, transferred, combined, and otherwise manipulated
`through electrical and/or optical components of a processor
`and its Subsystems.
`0034 Part of the descriptions will employ various abbre
`viations, including but are not limited to:
`
`PSTN
`SMS
`
`Public Switching Telephony Network
`Short Message Service
`
`0035 Various operations will be described as multiple
`discrete Steps in turn, in a manner that is most helpful in
`understanding the present invention, however, the order of
`description should not be construed as to imply that these
`operations are necessarily order dependent. In particular,
`these operations need not be performed in the order of
`presentation.
`0036) The phrase “in one embodiment” is used repeat
`edly. The phrase generally does not refer to the same
`embodiment, however, it may. The terms “comprising,
`“having and “including” are Synonymous, unless the con
`text dictates otherwise.
`
`Exemplary System/Environment
`0037. With reference to FIG. 1, an exemplary system in
`which the invention operates includes wireleSS mobile
`devices 400 (hereinafter simply mobile devices), wireless
`network 110, gateway 115, wide area network (WAN)/local
`area network (LAN) 200 and one or more server computers
`300.
`0038 Mobile devices 400 are coupled to wireless net
`work 110 and are described in more detail in conjunction
`with FIG. 4 and FIG. 5. Generally, mobile devices 400
`include any device capable of connecting to a wireleSS
`network Such as wireless network 110. Such mobile devices
`include cellular telephones, Smart phones, pagers, radio
`frequency (RF) devices, infrared (IR) devices, citizen band
`radios (CBS), integrated devices combining one or more of
`the preceding devices, and the like. Mobile devices 400 may
`also include other devices that have a wireleSS interface Such
`as PDAS, handheld computers, personal computers, multi
`processor Systems, microprocessor-based or programmable
`consumer electronics, network PCs, wearable computers,
`and the like.
`0039 Wireless network 110 transports information to and
`from mobile devices capable of wireleSS communication.
`Wireless network 110 may include both wireless and wired
`components. For example, wireleSS network 110 may
`include wireless cellular sites (not shown) that are coupled
`to another wired telephone network. Typically, a cellular site
`carries communication to and from cellular telephones,
`pagers, and other mobile devices, and the wired telephone
`network carries communication to landline telephones, long
`distance communication links, and the like.
`0040 Wireless network 110 is coupled to WAN/LAN
`through gateway 115. Gateway 115 routes information
`between wireless network 110 and WAN/LAN 200. For
`example, a user using a mobile device may browse the
`Internet by calling a certain number or tuning to a particular
`frequency. Upon receipt of the number, wireleSS network
`
`Page 18 of 29
`
`

`

`US 2003/0060240 A1
`
`Mar. 27, 2003
`
`110 is configured to pass information between the wireless
`device and gateway 115. Gateway 115 translates requests for
`web pages from mobile devices into hypertext transfer
`protocol (HTTP) messages, which may then be sent to
`resources coupled to WAN/LAN 200. Gateway 115 may also
`translate responses to Such messages into a protocol com
`patible with the requesting mobile device. Additionally,
`Gateway 115 may be used to translate exchanges of other
`types of messages, e.g., SMS (short message Service) mes
`sages, between mobile devices 400 that are facilitated by
`resources (servers) coupled to WAN/LAN 200.
`0041) Typically, WAN/LAN 200 transmits information
`between computing devices as described in more detail in
`conjunction with FIG. 2. One example of a WAN is the
`Internet, which connects millions of computers over a host
`of gateways, routers, Switches, hubs, and the like. An
`example of a LAN is a network used to connect computers
`in a single office. A WAN may connect multiple LANs.
`Server computers 300 are coupled to WAN/LAN 200
`through communication mediums. Server computers 300
`provide access to information and Services as described in
`more detail in conjunction with FIG. 3.
`0.042
`FIG. 2 shows another exemplary system in which
`the invention operates in which a number of local area
`networks (“LANs”) 220, and wide area network (“WAN”)
`230 interconnected by routers 210. Routers 210 are inter
`mediary devices on a communications network that expedite
`message delivery. On a single network linking many com
`puters through a mesh of possible connections, a router
`receives transmitted messages and forwards them to their
`correct destinations over available routes. On an intercon
`nected set of LANs including those based on differing
`architectures and protocols-, a router acts as a link between
`LANS, enabling messages to be sent from one to another.
`Communication links within LANs typically include twisted
`wire pair, fiber optics, or coaxial cable, while communica
`tion links between networks may utilize analog telephone
`lines, full or fractional dedicated digital lines including T1,
`T2, T3, and T4, Integrated Services Digital Networks
`(ISDNs), Digital Subscriber Lines (DSLs), wireless links, or
`other communications links known to those skilled in the art.
`0.043
`Furthermore, computers, such as remote computer
`240, and other related electronic devices can be remotely
`connected to either LANs 220 or WAN 230 via a modem
`and temporary telephone link. The number of WANs,
`LANS, and routers in FIG.2 may be increased or decreased
`without departing from the Spirit or Scope of this invention.
`As such, it will be appreciated that the Internet itself may be
`formed from a vast number of Such interconnected net
`Works, computers, and routers and that an embodiment of
`the invention could be practiced over the Internet without
`departing from the Spirit and Scope of the invention.
`0044) The media used to transmit information in com
`munication links as described above illustrates one type of
`computer-readable media, namely communication media.
`Generally, computer-readable media includes any media that
`can be accessed by a computing device. Computer-readable
`media may include computer Storage media, communication
`media, or any combination thereof.
`0.045 Communication media typically embodies com
`puter-readable instructions, data Structures, program mod
`ules, or other data in a modulated data Signal Such as a
`
`carrier wave or other transport mechanism and includes any
`information delivery media. The term "modulated data Sig
`nal” means a Signal that has one or more of its characteristics
`Set or changed in Such a manner as to encode information in
`the Signal. By way of example, communication media
`includes wired media Such as twisted pair, coaxial cable,
`fiber optics, wave guides, and other wired media and wire
`leSS media Such as acoustic, RF, infrared, and other wireleSS
`media.
`0046) The Internet has recently seen explosive growth by
`Virtue of its ability to link computers located throughout the
`world. As the Internet has grown, so has the WWW. Gen
`erally, the WWW is the total set of interlinked hypertext
`documents residing on HTTP (hypertext transport protocol)
`servers around the world. Documents on the WWW, called
`pages or Web pages, are typically written in HTML (Hyper
`text Markup Language), or Some other markup language,
`identified by URLs (Uniform Resource Locators) that
`Specify the particular machine and pathname by which a file
`can be accessed, and transmitted from Server to end user
`using HTTP. Codes, called tags, embedded in an HTML
`document associate particular words and images in the
`document with URLS So that a user can access another file,
`which may literally be halfway around the world, at the
`preSS of a key or the click of a mouse. These files may
`contain text (in a variety of fonts and styles), graphics
`images, movie files, media clips, and Sounds as well as Java
`applets, ActiveX controls, or other embedded Software pro
`grams that execute when the user activates them. A user
`visiting a Web page also may be able to download files from
`an FTP site and Send messages to other users via email by
`using links on the Web page.
`0047 Server computer 300, as described in regard to
`FIG. 3, is a computer connected to a network and having
`Storage facilities for Storing hypertext documents for a
`WWW site, running administrative software (WWW server)
`for handling requests for the Stored hypertext documents and
`enabling a facility (image message server) to handle image
`based messages communicated between mobile devices.
`The server computer 300 may include many more compo
`nents than those shown in FIG. 3. However, the components
`shown are Sufficient to disclose an illustrative embodiment
`for practicing the present invention.
`0048. As shown in FIG. 3 server computer 300 is con
`nected to WAN/LAN 200, or other communications net
`work, via network interface unit 310. Network interface unit
`310 includes the circuitry for connecting WWW server 330
`and image message server 336 to WAN/LAN 200, and is
`constructed for use with various communication protocols
`including TCP/IP and WAP. Typically, network interface
`unit 310 is a card contained within server computer 300.
`0049 Server computer 300 also includes processing unit
`312, Video display adapter 314, and a mass memory, all
`connected via buS 322. The mass memory generally includes
`RAM 316, ROM 332, and one or more permanent mass
`Storage devices, Such as hard disk drive 328, a tape drive,
`CD-ROM/DVD-ROM drive 326, and/or a floppy disk drive.
`The mass memory Stores operating System 320 for control
`ling the operation of server computer 300. This component
`may comprise a general purpose Server operating System
`such as UNIX, LINUXTM, or Microsoft WINDOWS NTE).
`Basic input/output system (“BIOS")318 is also provided for
`controlling the low-level operation of server computer 300.
`
`Page 19 of 29
`
`

`

`US 2003/0060240 A1
`
`Mar. 27, 2003
`
`0050. The mass memory as described above illustrates
`another type of computer-readable media, namely computer
`Storage media. Computer Storage media may include volatile
`and nonvolatile, removable and non-removable media
`implemented in any method or technology for Storage of
`information, Such as computer readable instructions, data
`Structures, program modules or other data. Examples of
`computer storage media include RAM, ROM, EEPROM,
`flash memory or other memory technology, CD-ROM, digi
`tal versatile disks (DVD) or other optical Storage, magnetic
`cassettes, magnetic tape, magnetic disk Storage or other
`magnetic Storage devices, or any other medium which can be
`used to Store the desired information and which can be
`accessed by a computing device.
`0051. The mass memory also stores program code and
`data for providing a WWW site and managing image mes
`Sages. More Specifically, the mass memory Stores applica
`tions including WWW server 330 and image message server
`336. Generally, image message Server 336 includes instruc
`tions for facilitating the communication of image based
`messages communicated between mobile devices. WWW
`server 330 includes computer executable instructions which,
`when executed on server computer 300, generate WWW
`browser displays, including performing the logic described
`elsewhere in the Specification.
`0.052 Server computer 300 also comprises input/output
`interface 324 for communicating with external devices, Such
`as a mouse, keyboard, Scanner, or other input devices not
`shown in FIG. 3. Likewise, server computer 300 may
`further comprise additional mass Storage facilities Such as
`CD-ROM/DVD-ROM drive 326 and hard disk drive 328.
`Hard disk drive 328 is utilized by server computer 300 to
`Store, among other things, applications, databases, and data
`used by WWW server 330 and image message server 336.
`0.053 Image message server 336 may include a library or
`database of predetermined images that are organized by
`categories and one or more lists of preselected users desig
`nated to receive Selected images. Additionally, image mes
`Sage Server 336 may incorporate facilities for handling
`image messages that are included in SMS messages and
`wireless protocols, such as WAP.
`0054 FIG. 4 shows an exemplary mobile device 400,
`according to one embodiment of the invention. In one
`embodiment, mobile device 400 is a cellular telephone that
`is arranged to Send and receive messages. In particular,
`mobile device 400 may be arranged to send and receive SMS
`messages that can include data representing an image. Of
`course, other messaging Services that can include data
`representing an image may also be employed with mobile
`device 400.
`0055 Mobile device 400 may include many more com
`ponents than those shown in FIG. 4. However, the compo
`nents shown are Sufficient to disclose an illustrative embodi
`ment for practicing the present invention. AS shown in the
`figure, mobile device 400 includes processing unit 412,
`memory 448, RAM 416, ROM 432, operating system 420,
`image message application 430, programs 434, data Storage
`436, bios 418, power 426, input/output interface 424, wire
`less interface unit 410, illuminator 450, haptic interface 452,
`audio 454, display 456, keypad 458 and infrared input/
`output 460.
`0056 Mobile device 400 may connect to WAN/LAN
`200, or other communications network, via wireless inter
`
`face unit 410. Wireless interface unit 410 includes circuitry
`for connecting mobile device 400 to wireless network 110,
`and is constructed for use with various communication
`protocols including TCP/IP and WAP Wireless interface
`unit 410 may include a radio layer (not shown) that is
`arranged to Send and receive radio frequency communica
`tions. Typically, wireless interface unit 410 connects mobile
`device 400 to other mobile devices, via a telecommunica
`tions carrier or Service provider. Also, wireleSS interface unit
`410 may be arranged to communicate with other mobile
`devices without assistance from a carrier or Service provider.
`For example, wireleSS interface unit 410 may Support a
`wireless protocol such as IEEE 802.11b and the like for
`communicating directly with other mobile devices.
`0057 Mass memory 448 generally includes RAM 416,
`ROM 432, and one or more data storage units 436. The mass
`memory Stores operating System 420 for controlling the
`operation of mobile device 400. It will be appreciated that
`this component may comprise a general purpose operating
`system such as a version of UNIX, LINUXTM, or Microsoft
`WINDOWS(R). Basic input/output system (“BIOS") 418 is
`also provided for controlling the low-level operation of
`mobile device 400.
`0058. The mass memory as described above illustrates
`another type of computer-readable media, namely computer
`Storage media. Computer Storage media may include volatile
`and nonvolatile, removable and non-removable media
`implemented in any method or technology for Storage of
`information, Such as computer readable instructions, data
`Structures, program modules or other data. Examples of
`computer storage media include RAM, ROM, EEPROM,
`flash memory or other memory technology, CD-ROM, digi
`tal versatile disks (DVD) or other optical Storage, magnetic
`cassettes, magnetic tape, magnetic disk Storage or other
`magnetic Storage devices, or any other medium which can be
`used to Store the desired information and which can be
`accessed by a computing device.
`0059. The mass memory also stores application code and
`data used by mobile device 400. More specifically, the mass
`memory Stores image message application 430, and pro
`grams 434. Image message application 430 may be loaded
`into memory 448 and run under control of operating System
`420. Also, programs 434 may include computer executable
`instructions which, when executed by mobile device 400,
`transmit and receive WWW pages, e-mail, audio, video, and
`enable telecommunication with another user of another
`mobile device.
`0060 Mobile device 400 also comprises input/output
`interface 424 for communicating with external devices, Such
`as a headset, or other input or output devices not shown in
`FIG. 4. Data storage 436 can be utilized by mobile device
`400 to Store, among other things, programs 434, image
`message application 436, databases and/or libraries of
`images, lists and other data. Keypad 458 may be any input
`device arranged to receive input from a user. For example,
`keypad 458 may include a push button numeric dial, or a
`keyboard. Keypad 458 may also include command buttons
`that are associated with Selecting and Sending images. Dis
`play 456 may be a liquid crystal display (LCD), gas plasma,
`light emitting diode (LED), or any other type of display used
`with a mobile device. Display 456 may also include a touch
`Sensitive Screen arranged to receive input from an object
`
`Page 20 of 29
`
`

`

`US 2003/0060240 A1
`
`Mar. 27, 2003
`
`Such as a Stylus or a digit from a human hand. Additionally,
`infrared input/output 460 may be used to send and receive
`infrared commands to/from other devices.
`0061 Power Supply 426 provides power to mobile device
`400. A rechargeable or non-rechargeable battery may be
`used to provide power. The power may also be provided by
`an external power Source, Such as an AC adapter or a
`powered docking cradle that Supplements and/or recharges a
`battery.
`0.062. As shown, mobile device 400 includes illuminator
`450, haptic interface 452, and audio interface 454. Illumi
`nator 450 may remain active for specific periods of time or
`in response to events. For example, when illuminator 450 is
`active, it may backlight the buttons on keypad 459 and stay
`on while the mobile device is powered. Also, illuminator
`450 may backlight these buttons in various patterns when
`particular actions are performed, Such as Selecting or Send
`ing imageS. These patterns may be predetermined or ran
`dom,