Twitter Exhibit 1043
`Twitter, Inc. v. BlackBerry Ltd.
`Page 00001
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 1 0f 16
`
`US 2002/0046084 A1
`
`Figure 1
`System Overview
`‘4 1
`
`/ ’0
`
`GPS Satellites
`
`AM/FM and TV
`
`audio broadcasts
`
`(RDS/RBDS, Band Ill,
`L-Band, S~Band, etc.)
`
`
`Digital Audio
`Broadcasts
`
`
`
`
`GPS Receiver
`
`\‘ E50
`
`Gateway Communication Unit
`
`
`
`
`
`
`
`
`
`Remotely Programmable
`Cpu,
`
`Memory Multimedia/Navigation Device
`Narrowband
`
`
`
`Receivers
`08,
`$0
`
`
`Apps,
`
`Storage
`
`
`
`
`Cellular
`AMPS, CDMA, iDEN,
`
`GSM, TDMA
`
`
`
`FM
`
`Subcarrier
`L-Band, S-Band
`
`
`
`
`Satellite
`
`
`
`
`lntemet Gateway
`User and broadcast data
`
`
`and services
`
`
`30
`
`60
`
`Wireless
`LAN, erA,
`Bluetooth,
`
`etc.
`
`‘/0
`
`
`Narrowband
`
` Wideband
`
`
`
`
`Remote Programming Devices
`Computers, PDAs, Telephones, etc.
`
`Page 00002
`
`Page 00002
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 2 0f 16
`
`US 2002/0046084 A1
`
`Figure 2
`Vehicle Multimedia Receiver
`
`
`
`Microphone
`
`
`5 90
`
`On/Off,
`volume.
`other
`
`ms ....wm._.~.,_..v.._~_,m__w
`
`Tu ner
`
`Hierarchical
`Channel
`display
`
`,_
`
`Soft Action
`Button labels
`
`-
`
`l 7 A
`Selected Channel Display
`ROW 0f
` lf audio channel then
`
`show station call letters,
`{77'
`Action buttons
`
`'71
`format, frequency and
`_L
`
`=
`i7)\
`other programming
`
`‘
`information including
`(Li
`
`- Soft Preset
` advertising logos
`
`Button labels
`........... 4’70 _/_"?a _L?0 __,_/‘
`
`
`FWDW ~m_s..__
`
`Channel
`
`selector
`erA
`
`' ©\0 CL) Q g) Q2
`
`'
`1&6
`
`
`
`:66 :5655 ‘66 ’66
`
`
`Row of
`
`Presetbuttons
`
`57‘"
`)
`
`L)
`
`Page 00003
`
`Page 00003
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 3 0f 16
`
`US 2002/0046084 A1
`
`Figure 3
`Internet Gateway Network
`
`\
`
`
`
`.3
`k// W‘
`I
`
`4——_>
`
`Cellular
`AMPS, CDMA,
`iDEN, GSM,
`TDMA, other
`
`}
`/ 95 a
`
`FM
`Subcarrier
`
`\
`
`
`Satellite
`L—Band, S-
`Band, other
`I95? 6,
`
`_/ ,go
`
`3’0
`
`Firewall
`
`Central Gateway
`Servers
`
`Session Servers
`
`IW
`300
`Advertiser
`Broadcaster
`Customer Ada ye Customer
`
`databases
`databases
`Profiler
`databases
`
`
`”g
`
`% % eta
`
`
` lnternet Gateway
`
`
` Wireless
`
`
`
`
`ConleryConverters Real time
`
`
`
`data cache Data
`
`Streaming Personal
`
`Navigation
`
`Information Services
`Services
`
`
`
`
`I ‘l a
`
`
`
`Internet Web Servers -
`User
`
`News, stocks, weather,
`configuration
`
`
`email, etc.
`
`
`
`Page 00004
`
`Page 00004
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 4 of 16
`
`US 2002/0046084 A1
`
`thvre V
`
`3%
`
`Seam
`5m“
`3w Radio
`J 5
`
`»
`
`Button Cluster
`Conh’oHe-r
`
`112v
`
`I
`
`I
`DC to DC
`Converter
`No Cable Harness
`
`5W“?
`
`Stereo AF In
`
`t
`
`3
`
`m AF 0‘“ Stereo AF Amp
`
`)
`(POM ‘ 53525
`a)“. Z
`
`Mono AF In
`
`
`
`3 13—
`
`iDUBase-T Enet
`
`330
`
`m
`
`IDE HD
`
`
`
`3“,; H StereuAFln
`3‘“
`
`Functional Block Diagram
`
`tho
`
`6.5” TFT Panel
`
`0
`
`—.,3aa
`
`Page 00005
`
`Page 00005
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 5 0f 16
`
`US 2002/0046084 A1
`
`Figure 5
`Sample Web Configuration Elements
`
`Audio Channels
`
`Data/Information Channels
`
`Preset Selections
`
`'
`
`Music
`E Rock
`
`mus
`WNEW
`KSLX
`KOLD
`KROK
`
`E 3322
`
`KSAN
`IE wom.
`WIND
`KJAZ
`
`.
`Country
`
`Egg
`KNIX
`[E Cwnel
`KOOL 95
`0133 'al
`KLAS
`
`IE
`Ki? Talk
`
`News
`
`WABC
`Ki CNN
`KNOW
`KFYI
`CNET
`
`E Sports
`
`ESPN
`E NFL Today
`KTAR
`Political
`
`KRAP
`
`TV
`
`ABC
`CBS
`CNN
`NBC
`FOX
`E; ESPN
`MTV
`VH1
`
`'
`Dlrecwry
`IS Personal
`Boss
`Mom
`Doctor
`
`Food
`E McD's
`[E TacoBell
`[E PizzaHut
`IHOP
`
`IE Fuel
`{21 Shell
`(
`global
`xxon
`BMW
`Mohamla
`AAA
`
`IE Help
`
`t#1~
`PI?
`“and:
`PWS°§£~
`
`
`
`
`
`.
`
`.
`_
`_
`Z
`Mymm W5
`Collecuon.
`
`Recorded
`CD
`FE MP3
`[E HitMe...
`IE ThatDon't...
`
`InIonmfion
`
`Stocks vwoo
`Weather -— Wf’l
`Phoenix
`Chicago
`IE Honolulu
`
`Page 00006
`
`Page 00006
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 6 0f 16
`
`US 2002/0046084 A1
`
`mmiw
`
`“wow
`
`26swomb
`
`
`
`um:wqfimoam
`
`.3398
`
`OZ
`
`mm?
`
`a:3:meHo£0058Sofia
`
`853$meHow
`
`
`
`5.80.soswomflo:
`
`F3»3i
`
`60:3Song063swév
`
`
`
`2.80"280:8me:5
`
`
`
`mSQE$5“.onQ;
`
`:oEmomQ55833B5%an.w.0v
`
`30mmG830283
`
`wasa:
`
`b2
`
`6E33:5539w
`
`Q9333Ho.“
`
`OZ
`
`
`
`oz2&onExam:
`
`
`
`»%montage?“60:00
`
`5m:95¢@02888353
`
`Page 00007
`
`Page 00007
`
`
`
`
`
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 7 0f 16
`
`US 2002/0046084 A1
`
`
`
`
`
`bot—ow3xatoningHOUE®>CHEM
`
`5.925550
`
`9532
`
`c<wcomE,,mG
`
`
`
`magnifies03on
`
`mzom@88on3383“
`
`“892585
`
`
`
`
`
`mm
`
`
`
`Page 00008
`
`Page 00008
`
`
`
`
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 8 0f 16
`
`US 2002/0046084 A1
`
`.85%on
`
`a:
`
`mfimmoam8wa
`
`in.MR,t
`
`1111%,Ai
`
`
`
`DHWH.@358anH25
`
`mooaohoofioa\586E
`
`év
`
`.1anQ6,
`
`/manor:
`
`
`
`400mZOHEAEZMORZHAnliiliniulllil.:0...e\
`
`
`
`/HERSQEOHL.
`
`11,65v.
`
`.SQ
`
`1
`a.
`
`,V.
`
`,2.t,
`
`L
`
`\
`
`mocfimooom\y
`
`Page 00009
`
`85$on
`
`Page 00009
`
`
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 9 0f 16
`
`US 2002/0046084 A1
`
`3@5250
`
`“0003/
`
`300:8
`
`«30womb
`
`0000200
`
`33J,
`
`80??80¢00000
`
`00009»80¢0m000
`
`“0008/
`
`000:2,80¢
`
`088$?00
`
`
`
`00w000:9,80000
`
`00mg00$50305
`
`EHBE00
`
`{Eu
`
`Page 00010
`
`Page 00010
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 10 0f 16
`
`US 2002/0046084 A1
`
`.uoh.
`
`cocmgofi:~35
`
`20.530
`
`3E825r0PBucky
`
`Homqnmnnm
`
`new8326
`
`OZFEXM
`
`consume?“
`
`mwohsce
`
`EnoEEX‘02
`
`00v
`
`Page 00011
`
`Page 00011
`
`
`
`
`
`

`

`Patent Application Publication
`
`Apr. 18, 2002 Sheet 11 0f 16
`
`US 2002/0046084 A1
`
`
`
`MOQZmC/$58me
`
`25328@588Sm:n8nonwounoZ
`
`
`
`Em:so33%dwconmwwm“muswum
`
`2%:5$3mam;
`
`,4.1
`
`cm8830SHawsfim98m3a
`
`091w.J
`
`........u--1------:--i----------------
`
`.1Soncognac?“80¢
`
`
`
`5338:63“353%
`
`Eon:EEEHEE89¢83802
`
`
`
`:osmmbmagEmmoom
`
`Page 00012
`
`Page 00012
`
`

`

`Patent Application Publication
`
`MOQZmC/2mmeMmmD
`
`$08308830hasB633%
`
`32:3808How@6onm
`
`ooflllllllllllllllllllllllllllllllllllllllll.Y
`-S-------2--memammmmmmm:
`\3@83sz855m:0m
`
`
`
`\83@235on530m
`
`
`
`
`
`M1maozficgmagma:when:.«o50383qu
`
`r..
`
`mweS..........MmV............................vW.33252
`305.680m.no@0mecmgumBno».J
`
`e
`
`61f02
`
`S
`
`6400/20
`
`1A
`
`
`
`m.wEEwQ:Escou<
`
`U2w\
`
`4\w:9L
`
`1.....t....................................
`
`Page 00013
`
`Page 00013
`
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 13 0f 16
`
`US 2002/0046084 A1
`
`OZ
`
`HomD
`
`$930.5.8Eng
`
`8Sun?»@30Z
`
`EEGSamoa
`
`“85>@fioZ
`
`sofimoowEm:we
`
`09:2:33835
`
`$239»
`
`€35.53
`
`ions?
`
`60:36£820womb
`
`889mm85mam:
`
`.08:weEm:buoZ
`
`
`
`20:82”My1“moo
`
`
`
`9E:“85>
`
`
`
`£80:808Ho28
`
`308m5a:no
`
`Page 00014
`
`Page 00014
`
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 14 0f 16
`
`US 2002/0046084 A1
`
`
`
`"g
`q)
`CD
`8
`«‘3
`g
`5
`”a“,
`1 2
`'5
`u
`
`m
`m
`w
`
`«is;
`'1
`a
`S
`ct:
`m
`'0
`q
`o
`”3
`
`j”
`’7
`
`:b
`i
`L+
`
`Page 00015
`
`Ba
`
`: a D
`
`:3
`
`“C
`B
`E—‘
`g
`.
`94
`ED
`5 :5
`<1)
`VJ
`.2
`>
`‘D
`
`D 3
`
`5C0
`
`Page 00015
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 15 0f 16
`
`US 2002/0046084 A1
`
`
`
`
`
`@8meUmEEwEO889mm
`
`\aai
`
`1;: a®>®EH®HOH#366
`Hoofiom
`
` I
`5m:82mm
`
`
`Page 00016
`
`Page 00016
`
`

`

`Patent Application Publication Apr. 18, 2002 Sheet 16 0f 16
`
`US 2002/0046084 A1
`
`womb@502me
`
`®ofl\
`
` n:Mom:380%
`
`wow,
`
`DHHum:5E820m
`
`Page 00017
`
`Page 00017
`
`
`
`

`

`US 2002/0046084 A1
`
`Apr. 18, 2002
`
`REMOTELY CONFIGURABLE MULTIMEDIA
`ENTERTAINMENT AND INFORMATION SYSTEM
`WITH LOCATION BASED ADVERTISING
`
`BACKGROUND OF THE INVENTION
`
`[0001] As wireless communication systems have become
`more popular, the demand for services has increased. How-
`ever,
`the cost of services still remains high for many
`individual subscribers for service. Some network providers
`have offered services through the use of prepaid services.
`Although the use of such services prevents overspending by
`a user, the user ultimately must incur the cost of the usage
`of the network. Accordingly, there is a need for alternative
`service offerings of network providers to enable usage on the
`network.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0002] FIG. 1 shows a block diagram of a system over-
`view.
`
`[0003] FIG. 2 shows a block diagram of a vehicle multi-
`media receiver.
`
`[0004] FIG. 3 shows a system diagram of an internet
`gateway network.
`
`[0005] FIG. 4 is a block diagram of one presently pre-
`ferred hardware platform.
`
`[0006]
`ments.
`
`FIG. 5 illustrates sample Web configuration ele-
`
`[0007] FIG. 6 is a flow chart of the update information
`flow of the location based advertising of the invention,
`where FIG. 6(A) is a first half of the flow chart, and FIG.
`6(B) is a second half of the flow chart.
`
`[0008] FIG. 7 illustrates one presently preferred informa-
`tion pool used with the invention.
`
`[0009] FIG. 8 is a flow chart showing the choosing of an
`advertisement.
`
`[0010]
`tisement.
`
`FIG. 9 is a flow chart showing obtaining an adver-
`
`[0011] FIG. 10 is a ladder diagram showing a user initi-
`ated update request.
`
`[0012] FIG. 11 is a ladder diagram showing a vendor
`initiated update request.
`
`[0013] FIG. 12 is a flow chart showing the shopping list
`feature of the invention.
`
`[0014]
`update.
`
`FIG. 13 is a flow chart showing a user originated
`
`[0015] FIG. 14 is a flow chart showing a system origi-
`nated update.
`
`[0016] FIG. 15 is a flow chart showing the process of
`selecting a user.
`
`DETAILED DESCRIPTION OF THE
`PRESENTLY PREFERRED EMBODIMENTS OF
`THE INVENTION
`
`and information system 10. The invention offers information
`enriched audio broadcasts, personalized information ser-
`vices,
`integrated access to personal and recorded data,
`enhanced navigation services and other software expandable
`services in a vehicle through the use of a wireless Internet
`connection to an enabling Internet gateway network. As
`shown in FIG. 1, the invention consists of (1) a remotely
`programmable, microcomputer
`controlled multimedia
`device 20 in a vehicle with a wireless IP address for Internet
`
`access, (2) an Internet gateway network 30 that provides
`programming, information and Internet access to the mul-
`timedia device 20, and (3) one or more remote programming
`devices 40.
`
`[0018] The multimedia device 20 includes a computer 50
`that preferably runs an operating system and series of
`applications that control the operation of the device 20. A
`user operates an application by tuning to a “channel” in
`keeping with the known radio paradigm and its user friendly
`operations. The two types of channels preferably available
`are audio broadcasts (e.g., AM, FM, TV, digital, Internet
`audio broadcasts and recorded material) and personal infor-
`mation services (e.g., navigation, email, traffic alerts, etc.).
`Channels are organized in a hierarchy 158 so any one can be
`easily selected on screen (see FIG. 2). Audio broadcast
`channels 42 are organized by the format of the broadcast
`(i.e., country, rock,
`talk, etc.) and not by the band or
`frequency of the station. The listener configures the organi-
`zation of the channels through a remote device 40 via the
`Internet gateway network 30.
`
`[0019] The Internet gateway network 30 is designed to
`transmit and receive critical
`information to and from a
`
`multimedia device 20 in the vehicle 184 (FIG. 3). Informa-
`tion transmitted preferably includes broadcaster identifica-
`tion that allows the multimedia device 20 to tune to stations
`
`by their formats, direct Internet access for streaming audio
`broadcasts and other Internet content, broadcast advertising
`database lookup for direct response to advertisements heard
`in a vehicle, navigation services, delayed digital personal-
`ized broadcasts, personal
`information event notices, and
`application downloads to create new personal information
`channels.
`
`[0020] Remote programmable devices 40, such as a com-
`puter connected to the Internet 60, are used to download
`information from the Internet gateway network 30 to the
`multimedia device 20 in the vehicle 184. From a remote
`
`device 40, a user can customize the way audio broadcasts
`and personal information service channels are organized in
`the vehicle’s multimedia device 20, can request new per-
`sonal information services be downloaded from the Internet
`
`gateway 30 to the multimedia device 20, and can retrieve
`information from the gateway 30 that he has stored there
`from the vehicle 184. The user can also access his custom
`
`profile and billing information records.
`
`[0021] FIG. 1 shows many possible wireless communi-
`cation methods between the vehicle device and the gateway.
`As those skilled in the art will appreciate,
`the methods
`illustrated in FIG. 1 are meant to be representative and do
`not reflect all possible wireless communication methods that
`may be employed.
`
`[0017] Referring to the drawings, where like elements
`receive like reference numerals throughout, the invention
`generally is a computer controlled multimedia entertainment
`
`It is thus an object of the invention to allow any
`[0022]
`AM, FM, TV audio, or digital audio broadcast or any
`Internet audio broadcast to be easily selected by format (i.e.,
`
`Page 00018
`
`Page 00018
`
`

`

`US 2002/0046084 A1
`
`Apr. 18, 2002
`
`country, classical, news, rock, talk, etc.) in a vehicle. The
`user will not need to know the band or frequency of any
`station to select a broadcast as all types of broadcasts are
`simply ordered by format. The multimedia device 20 will
`make the appropriate band and frequency selection when a
`listener selects a station hierarchically organized under a
`format category.
`
`It is also an object of the invention to automatically
`[0023]
`tune to comparable station formats when a vehicle travels
`out of an area where the existing stations are known to the
`listener.
`
`It is a further object of the invention that, when a
`[0024]
`vehicle travels out of an area such that a currently broadcast
`program fades out, to automatically tune to another station
`or recorded broadcast playing the same program or at least
`the same program type.
`
`It is yet a further object of the invention to remotely
`[0025]
`configure the multimedia device 20 using an Internet gate-
`way network 30 database to download information about all
`the audio formats and audio broadcasters (e.g., AM/FM/TV/
`DAB/Internet) possible in a geographic area. The user will
`choose to show on the radio only those formats and stations
`he/she desires, blocking out from view all unwanted formats
`and stations.
`
`It is yet a further object of the invention to add new
`[0026]
`information services (e.g., email, stock quotes,
`personal
`interactive audio games, etc.) to the multimedia device 20
`from a wireless Internet connection 60 by downloading
`applications. Such services are called personal information
`or data channels in keeping with radio nomenclature as their
`applications can be used by simply selecting them as you
`would an audio channel in the main menu or with a preset
`button.
`
`It is still another object of the invention to remotely
`[0027]
`configure the system 10 using an Internet gateway network
`30 database to present all the personal information services
`available to the user (i.e., navigation, email, stock quotes,
`etc.). The user may select only those services he/she desires
`to use in the vehicle 184.
`
`It is still another object of the invention to allow
`[0028]
`event driven personal information services to verbalize time
`specific (e.g., your stock hits new high) or location specific
`(e.g.,
`traffic incident warning) information using speech
`synthesis.
`
`It is still another object of the invention to allow
`[0029]
`recorded compressed audio files and other large data files to
`be downloaded into the multimedia device 20 from a high
`speed local area 70 wireless receiver 72. Such downloads
`may occur at the listener’s home or business, or at desig-
`nated resale locations for such types of data (e.g., record
`stores, gas stations, etc.).
`
`It is still another object of the invention to allow
`[0030]
`previously recorded audio broadcasts (usually talk or news
`oriented programming) to be played back at desired times by
`recording such broadcasts at a network location and then
`transmitting these files over a wireless Internet cellular
`connection 80 at off peak hours to the vehicle 184. Since talk
`broadcasts result in small compressed files,
`they can be
`easily dribbled over a relatively slow speed wide band
`connection without long delays.
`
`It is still another object of the invention to save
`[0031]
`enhanced information about selected broadcasts with the
`
`press of a button. The information is wirelessly transmitted
`to a server on the Internet gateway network 30 that can be
`later retrieved from the user’s home or office computer with
`an Internet connection and web browser.
`
`It is still another object of the invention to allow the
`[0032]
`selection of live and recorded audio material by format in a
`vehicle as well as select information services (i.e., phone
`book, navigation, etc.) by using a combination of a hierar-
`chical menu along with presets that chose a broadcast station
`or run a selected service application. Selection can be done
`by pressing directional and preset buttons or by using voice
`navigation.
`
`It is another object of the invention to present a
`[0033]
`unique configuration of the system 10 for any number of
`users so that each user will see only their preferred radio
`stations and information services when they select
`their
`profile at the multimedia device 20.
`
`is another object of the invention to allow
`It
`[0034]
`accommodated devices such as notebook computers, PDAs
`and cellular phones to wirelessly download personal infor-
`mation (i.e., phone numbers, addresses, to-do lists, etc.) into
`the multimedia device 20.
`
`It is yet another object of the invention to allow
`[0035]
`phone numbers and addresses downloaded from accommo-
`dated devices to be used for navigation and for direct calling.
`
`It is yet another object of the invention to allow
`[0036]
`purchases to be made of an advertised on air product with
`the touch of a button.
`
`It is still another object of the invention to listen to
`[0037]
`advertising customized for listener preferences when play-
`ing recorded broadcast programs.
`
`It is still another object of the invention to provide
`[0038]
`navigation services from the Internet gateway network 30 so
`maps can remain accurate as they can be centrally updated
`when highway changes occur.
`
`It is still another object of the invention to provide
`[0039]
`navigation services from the Internet gateway 30 so that
`vehicle positions reported by in vehicle GPS devices can be
`used by personal information services to provide location
`dependent alerts to the driver.
`
`It is still another object of the invention to allow
`[0040]
`input of destination addresses for navigation routing from
`phone numbers or names by doing reverse address lookups
`from an Internet gateway 30 server and then automatically
`entering the returned address for the destination.
`
`It is still another object of the invention to allow
`[0041]
`input of destination addresses for navigation routing from
`enhanced advertisements that include location information
`in a data sidecast.
`
`[0042] These and other features and advantages of the
`invention will become apparent to those skilled in the art
`upon a review of the following detailed description of the
`presently preferred embodiments of the invention, when
`viewed in conjunction with the appended drawings.
`
`[0043] Following is a description of the system 10 com-
`ponents and configuration.
`
`Page 00019
`
`Page 00019
`
`

`

`US 2002/0046084 A1
`
`Apr. 18, 2002
`
`[0044] Multimedia Device 20
`
`[0045] As FIGS. 1 and 2 show, the multimedia device 20
`consists of a computer 50 preferably having a microproces-
`sor and memory 90, and storage devices 92 that contain and
`run an operating system and applications to control and
`communicate with four onboard receivers: (1) a software
`controlled multi-band AM, FM, TV audio and digital audio
`broadcast receiver 100; (2) a GPS receiver 110 that continu-
`ously reports the vehicle’s longitude, latitude and altitude;
`(3) one or more high-speed, narrow band wireless transceiv-
`ers 120 for fast transmission and reception of large amounts
`of data from accommodated devices; and (4) a wide band
`wireless Internet addressable gateway transceiver 130 to
`receive Internet protocol based audio broadcasts, new appli-
`cations known as information or data channels, and con-
`figuration data from a gateway network 30 created to service
`the multimedia devices 20. The in-vehicle wireless gateway
`transceiver 130 can also send information to the gateway
`network 30 such as requests for navigation data, advertise-
`ment responses, purchase requests, etc. The multimedia
`device 20 also controls attached conventional multimedia
`
`storage equipment such as a CD/DVD player 140 or cassette
`player (not shown). Sound is output through an industry
`standard amplifier 150 and speakers 152. Amicrophone 154
`allows for voice recognition commands to be given and
`received by the multimedia device 20.
`
`[0046] The multimedia device 20 preferably also contains
`and controls one or more digital storage devices 92 to which
`real-time broadcasts can be digitally recorded. The storage
`devices 92 may be hard drives, flash disks, or other auto-
`motive grade storage media. The same storage devices 92
`can also preferably store digital data that
`is wirelessly
`transferred to the vehicle in faster than real time mode.
`
`Examples of such digital materials are MP3 audio files or
`nationally syndicated radio shows that can be downloaded
`from the gateway network 30 and played back when desired
`rather than when originally broadcast.
`
`[0047] As FIG. 2 shows, the multimedia device also uses
`a LCD, LED or similar suitable display screen 160 for an
`automotive environment to present information to the user
`and to control the multimedia device 20. Controls shown on
`
`the LCD in FIG. 2 are one possible embodiment for control
`types and location. Those skilled in the art will appreciate
`that control types and locations may vary in different imple-
`mentations of the invention.
`In one presently preferred
`embodiment, for example, the display screen 160 includes a
`51/2 inch 640x480, 216 color VGA LCD display 168. In an
`alternate embodiment, the display can display as little as two
`lines of text, whereas an upper limit of the screen display
`168 can be as large as the intended application may dictate.
`
`tuner 164 and preset
`[0048] The channel selector 162,
`button 166 controls shown in FIG. 2 allow the user to
`
`broadly navigate all the channels of audio broadcasts and
`information services available on the multimedia device 20.
`
`The channel selector 162 allows a user to manually access
`and select any of the audio and information channels avail-
`able by browsing through them (up, down, forward, back) in
`a hierarchical tree.
`
`[0049] A display 158 of a portion of the hierarchical tree
`is shown on the screen display 168.
`
`[0050] The root of the tree, the leftmost part, preferably
`contains major categories of channels. Possible types of
`
`talk, TV
`major channel categories could include music,
`audio, recorded audio, personalized directory services and
`information services. As is explained in detail below, the
`user can configure the presentation of major categories and
`subcategories so that he/she sees only those categories of
`interest.
`
`[0051] Under each major channel category, there are pref-
`erably subcategories. To see these subdivisions,
`the user
`would select the desired major category by pressing the up
`or down channel selector buttons 162a and then press the
`forward button 162b when the category desired is high-
`lighted. The user could then see all the channels available
`under that subcategory in similar fashion and select any of
`them to play.
`
`[0052] For example, under the category of music channels,
`commercial audio broadcasts could be subdivided into 30+
`
`radio industry standard formats (e.g., blues, classical,
`county, dance, jazz, rock, sports,
`talk, etc.). To hear a
`particular country music radio station in a particular geo-
`graphic area, a user would select the “Music” category by
`pressing the up or down channel selector buttons 162a and
`then press the forward channel selector 162b when posi-
`tioned on “Music.” Next, the user would use the up or down
`channel selector buttons 162a to highlight “Country” and
`would then press the forward button 162b. The user would
`then see all the country music channels available in that
`specific area. Moving the channel selector 162 up or down
`over each channel preferably causes each audio station to
`play.
`
`[0053] Once a user has moved forward in the hierarchical
`tree,
`the subcategory or channels displayed will remain
`visible until the user presses the back channel selection
`button 162b that moves the user back up the tree one level.
`For example, to move back from country broadcasts to select
`other music formats, the user would press the back button
`162b and then select another music format. The multimedia
`
`device 20 may be preferably configured so that the last
`hierarchical display and selection the user made is presented
`when the device is next turned on.
`
`[0054] Preset buttons 166 on the display screen 160 are
`user configurable buttons that allow the user to select any
`one channel, group of channels or even channels from
`different categories that can be played or displayed with the
`press of a single button. For example, a user could configure
`a preset button 166 to simply play a favorite country station
`when pressed. The user could also configure a preset button
`166 to display all the country stations in a specific area. The
`user could even configure a preset button 166 to display their
`favorite blues, country and rock stations at one time on one
`screen display 168. Once these groups of channels are
`displayed, the user can play the radio stations by using the
`channel selector buttons 166. Apreset button 166 can also be
`assigned to any personal information channel application.
`For example, assigning a new channel (application) that
`shows all hospitals in an area would result in a map showing
`the nearest hospitals to the vehicle’s current position when
`the preset is pushed. User defined labels 170 for preset
`buttons 166 preferably appear on the screen 168 above the
`preset buttons 166 to indicate their purpose.
`
`[0055] The tuner control 164 shown in FIG. 2 flattens the
`hierarchical tree. Rather than having to step through catego-
`ries and subcategories to play a channel, by turning the tuner
`
`Page 00020
`
`Page 00020
`
`

`

`US 2002/0046084 A1
`
`Apr. 18, 2002
`
`control 164 the user can play each channel one after the
`other in the order they appear in the hierarchy 158. If a user
`has configured the device to show only a few categories of
`channels, this allows fast sequencing through a channel list.
`Pressing the tuner control 164 preferably causes the device
`to scan through the channels as a traditional radio would do,
`playing a few seconds of each station before moving to the
`next in the hierarchy 158.
`
`[0056] Computer programs running in the multimedia
`device 20 control the action buttons 172 shown in FIG. 2.
`
`Action buttons labels 174 and purposes may change from
`program to program. A button’s label 174 indicates its
`current function. Some examples of action buttons 172
`could be: “INFO” to save extended information on some-
`
`thing that is being broadcast (e.g., the Internet web address
`of a band currently playing); “CALL” to call a phone
`number from an advertisement; “NAV” to navigate to an
`address from an electronic address book; or “BUY” to
`purchase an item currently being advertised.
`
`[0057] A microphone input 176 on the face of the display
`160 allows users to control the multimedia device 20 ver-
`
`bally rather than through the control buttons. Key word
`recognition software allows the user to make the same
`channel selections that could be made from any of the button
`controls. Audio feedback through speech synthesis allows
`the user to make selections and hear if any other actions are
`required. Software or hardware based voice recognition and
`speech synthesis may be used to implement this feature.
`
`[0058]
`
`Internet Gateway Network 30
`
`[0059] FIG. 3 shows a system drawing of the Internet
`Gateway Network 30. The Internet gateway network 30
`preferably consists of standard Internet TCP/IP protocol
`communications equipment 180 and computers 182 that
`serve multiple functions. The gateway 30 is designed to
`provide wireless Internet access to the multimedia device 20
`in the vehicle 184, enhance regular audio broadcasts with
`extended information, and provide personalized broadcast,
`information and applications to the vehicle 184.
`
`[0060] The gateway 30 serves as an Internet Service
`Provider to vehicles 184 through various forms of wireless
`transmission 186. Cellular access is expected to provide the
`initial form of wireless transmission with satellite transmis-
`
`sions to follow. In some implementations, requests from the
`vehicle 184 may come through the cellular network 186a
`while responses may be routed through FM sub-carriers
`186b or faster satellite networks 186C. Wireless session
`
`servers 210 are preferably dedicated to maintaining connec-
`tions with the rest of the gateway network 30 no matter what
`form of transmission is used.
`
`[0061] To insure adequate throughput to vehicles 184, the
`gateway network 30 will cache most requested Internet data
`in a real time data cache 190, as well as convert retrieved
`Internet content through content converts 192 for appropri-
`ate display or verbalization on the multimedia device 20.
`Dedicated streaming data servers 188 will be used to broad-
`cast personalized audio broadcasts to the vehicle 184, as
`well as rebroadcast other Internet audio broadcasts.
`
`[0062] The Internet gateway network 30 also maintains a
`database management system to control several important
`system databases. The gateway 30 provides a broadcaster
`relational database 194 containing information about all
`
`AM, FM and TV analog audio broadcasts that can be
`received in a vehicle 184 within the host nation of the
`
`gateway network 30 (e.g., radio station call letters, program-
`ming format, frequency assignment, program listing, etc.).
`Related databases (not shown) may maintain similar infor-
`mation for new digital broadcasters such as satellite radios
`who transmit over large geographic areas and for interna-
`tional Internet audio broadcasts. Information in the database
`
`concerning constantly changing program listings (e.g., song
`play lists, etc.) are preferably continuously updated through-
`out a day.
`
`[0063] Advertising databases 196 provide information
`about advertisements (e. g., advertiser name, ad content, time
`of ad run, etc.) that are inserted into real-time radio broad-
`casts and into digital personalized broadcasts.
`In one
`embodiment of the system 10, when a user wishes to
`purchase a product or get more information about a product
`while in the vehicle 184, the user can press a “BUY” or
`“INFO” button on the multimedia device 20, which trans-
`mits to the gateway network 30 the location of his vehicle
`184 (GPS derived), the date and time of the button press, and
`the channel selected. The advertised item is then looked up
`in the database 196, and the user is charged for its delivery
`or is sent more information about the product. In an alter-
`native embodiment, enhanced advertising information for
`short periods of time may be pushed to the multimedia
`device 20 from the gateway 30 at set intervals. Only those
`ads offering immediate purchase or additional information
`will preferably show indicators for these actions.
`
`[0064] User profile databases 198 contain information
`about the user’s system preferences (e.g., channels selected),
`billing information and a purchasing interest profile. Infor-
`mation in advertising databases can be compared against a
`user’s purchasing interest profile through an adaptive pro-
`filer 200 so that advertisements inserted into delayed per-
`sonalized digital broadcasts mesh with that
`individual’s
`buying interests. If there are multiple users on one account
`(e.g., family members) then each user will preferably have
`a unique profile in the user database 198.
`
`[0065] Users are also allocated storage space on the gate-
`way’s servers for their own use. Enhanced live or recorded
`broadcasts that contain information the user may want to
`reference later (e.g., the web address of the band currently
`playing) allow the listener to press a button on the multi-
`media device 20 to transmit and store that information on
`
`their user pages on the gateway 30.
`
`[0066] The gateway 30 also provides navigation services
`through a dedicated computer 202 to the vehicle 184. The
`vehicle 184 provides location information from its GPS
`receiver 110 (FIG. 2) to the gateway 30, and the gateway 30
`in turn provides mapping services to the vehicle showing
`travel routes or locations of interest. Coupled with the
`advertising database 196, drivers can see map locations
`related to recent advertisements and get navigation guidance
`to these locations. For example, the driver could get direc-
`tions to the nearest chain restaurant whose commercial just
`played offering a lunch special.
`
`[0067] The gateway 30 also transmits other software
`applications to the vehicle 184 for use in the multimedia
`device 20. These applications are referred to as channels and
`comprise the personal information services of the system 10
`(navigation, email, etc.). T