(19) United States
`(12) Patent Application Publication (10) pub. NO.: US 200410263479 A1
`Dec. 30,2004
`(43) Pub. Date:
`Shkolnikov
`
`(54) ACTIVE KEYBOARD SYSTEM FOR
`HANDHELD ELECTRONIC DEVICES
`
`(76) ~
`
`~
`
`~~~k shkolnikov, o a k ill, VA (US)
`t
`~
`~
`~
`
`~
`
`Correspondence Address:
`Richard C. Litman
`LITMAN LAW OFFICES, LTD.
`P.O. Box 15035
`Arlington, VA 22215 (US)
`
`(21) Appl. No.:
`
`101895,967
`
`(22) Filed:
`
`Jul. 22, 2004
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 101320,529,
`filed on Dec. 17, 2002.
`
`(60) Provisional application No. 601342,382, filed on Dec.
`27, 2001.
`
`Publication Classification
`
`(51) Int. CL7 ....................................................... G09G 5/00
`(52) U.S. C1. .............................................................. 3451169
`~
`:
`
`
`(57)
`
`ABSTRACT
`
`An active keyboard system includes a processor, a memory,
`and a display communicatively connected to one another.
`The system includes input means for inputting data and
`commands into the system. The input means include at least
`one selector, and a plurality of keys. Active keyboard system
`software is stored on the memory and is configured to
`dynamically present available choices on the display
`grouped to effect unambiguous selection of the available
`choices through use of the input means. The active keyboard
`system software includes presentation code and filter code.
`The presentation code includes step or scroll resolution code
`to enable scrolling, and grid presentation code to organize
`available choices on a visual grid and provide the visual grid
`to the display. The grid presentation code configures the
`visual grid with one or more panes each configured as a
`matrix with a plurality of columns and plurality of rows.
`
`Parrot Ex. 1009
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 1 of 47
`
`Fig. I
`
`

`
`First
`Selector
`216 - .
`
`b
`
`Second
`Selector
`218 -
`
`Keys
`
`220 -
`
`›
`
`b
`
`2
`2 Q)
`E
`a
`5 tn
`tn a
`0
`2
`e
`
`214 -
`
`Display
`
`I
`
`I
`
`I
`
`I
`
`7 2 7 0
`
`b
`
`-
`-
`
`-
`-
`Grid -
`-
`-
`-
`-
`
`212
`-
`
`L
`
`Fig. 2
`
`

`
`U S E R I N P U T
`Thumb Stick
`(First Selector)
`
`Motion S ens ors
`(Second Selector)
`
`I
`I .0 1
`I
`1
`J - " I
`
`FILTER
`Sliding Zero
`
`+
`
`Adaptive Thresholds
`
`Buffers
`and
`Timers
`
`f
`
`4
`
`Calibration
`
`364 1
`
`All
`Hardware
`Status
`and
`Motion
`
`w
`
`
`
`L
`Q)
`
`C - -
`U-
`U)
`Q)
`
`2
`o
`LL -
`CU
`c
`L
`Q)
`C
`X
`W
`
`Step Motion
`I u
`User Actions
`
`7
`
`Active
`Applicatio n
`
`\368
`
`4
`
`User Input
`
`Application
`State
`
`+
`
`366 --\,
`
`al-
`
`Step or Scroll Resolution
`i
`
`Grid Presentation
`
`L - a
`CU
`u
`a
`.-
`0-
`C rn
`0 .- -
`a
`a
`a+--+ Grid Popula t ~ o n
`
`PRESENTATION
`
`Sounds
`
`Feedback
`
`Feedback
`
`Fig. 3
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 4 of 47
`
`US 200410263479 A1
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 5 of 47
`
`US 200410263479 A1
`
`4624
`
` START:^^^^^
`ESTABLISHED
`
`,
`
`t
`FOR PROCESSING
`
`Fig. 4B
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 6 of 47
`
`US 200410263479 A1
`
`Fig. 56
`
`Fig. 5A
`
`Fig. 5C
`
`Fig. 5D
`
`Fig. 5E
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 7 of 47
`
`US 200410263479 A1
`
`Fig. 6A
`
`Fig. 6B
`
`1/ 100
`Fig. 6C
`
`100 ,!J
`Fig. 6D
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 8 of 47
`
`US 200410263479 A1
`
`Fig. 7
`
`

`
`Patent A
`
`VOICE [L] GUARD 0
`
`Fig. 8
`
`

`
`Fig. 9
`
`

`
`240
`
`Fig. 10
`Fig. 10
`
`
`
`
`
`5.8:.>E.=nu:o=_.___._§.§.U8.upSE2.8.E3.5cm~c§\=~35c>~
`
`

`
`Starting Point
`
`Y
`Viewed area
`
`Device Returned to the "Middle" -
`
`Highlight stays, Grid moves to the left - Viewed area
`- Viewed area \
`Device tilted left - Highlight moves left - Viewed area
`
`Device tilted left - Highlight moves left
`
`Fig. I 1
`
`

`
`Starting Point
`
`Device
`Returned to the
`"Middle" -
`Highlight stays,
`Grid moves to
`the left
`
`- Viewed area
`
`Device tilted left -
`Highlight moves left
`
`Viewed area
`
`Y
`
`Viewed area
`
`Device tilted left -
`Highlight moves left
`
`Viewed area
`Device Returned to the "Middle" -
`Highlight stays, Grid moves to the left
`
`viewed area
`
`Fig. 12
`
`

`
`Down
`
`Right
` eft
`Fig. 13
`
`

`
`Down
`
`Right
` eft
`Fig. 14
`
`

`
`Sun Mon Tue Wed Thu Fri Sat
`
`Device tilted left-
`Highlight moves left,
`Shadow stays
`
`J
`
`Y
`Viewed area
`Device Returned to the "Middle" -
`Shadow catches up with the Highlight It
`
`-----
`
`Device tilted left-
`Highlight moves left,
`Shadow stavs
`
`Fig.
`
`

`
`Tilt Angle Or
`
`Reference
`
`Acceleration T
`First Threshold *
`Ze ro t
`Second Threshold *
`I If the average of the next N values
`
`When the Tilt Angle gets over the
`first threshold, the "Algorithm"
`collects the next N tilt values
`
`is over the Seco'nd Threshold,
`Highlight moves over the Grid
`
`First Threshold
`Refe rence
`Ze ro
`
`When the tilt angle is over the
`threshold, n o moves are allowed.
`Fig. 16
`
`established when the
`device is powered on
`/ o r waked up
`
`t Reference Zero is
`I
`
`If device is within
`these limits - n o
`decision is made
`
`The "Middle"
`After every move the
`device has t o be
`returned into the middle
`so the next move can
`be made
`
`

`
`x
`
`Calculate SUM ( X I , ... Xm)
`of the nextm values
`
`d
`
`
`
`Tilt Angle Or
`Acceleration f
`
`First Threshold A
`Reference
`Zero
`Second Threshold B
`
`Fig. I 7
`
`

`
`. rr 4 - - New Zero will be in
`
`When the tilt angle averages of the
`last M moves are consistently
`"skewed" as shown by dotted line . . .
`I.
`- - +
`
`rr.
`
`... the Reference Zero is being updated
`as shown below
`
`Device
`
`/
`/
`
`the middle between
`tilt averages
`
`Automatic reset after period of inactivity
`Enforced reset by the push of a button
`Sound confirmation for each move. Different for
`LeWRight from UpiDown, and from Side Key
`Adjusts Reference Zero based on the position of the
`optional "Bubble"
`
`Fig. 18
`
`Left Tilt Average
`
`Reference Zero
`
`Right Tilt Average
`
`New Reference Zero
`
`Additional
`features:
`
`

`
`Adapt-ive Thresholds
`Adaptive thresholds: e.g, the user is using backspace
`too often, too many jumps to get to the letter, etc. -
`threshold is lowered (increased)
`Different thresholds to move back and forward
`
`No Thresholds
`
`Fig. 19
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 21 of 47
`
`US 200410263479 A1
`
`

`
`416
`
`418
`
`Second Selector
`(X-Y-Z Sensors)
`
`420
`
`I
`I
`I
`
`I
`I
`I
`
`I
`I
`
`Optiona'l
`! Additional External ;
`:>422
`Sensors
`:---------------------------I
`
`I
`I
`I
`
`I
`I
`I
`
`Fig. 21
`
`

`
`436
`
`430
`
`.44443333444.4
`
`440
`
`)6
`
`438
`
`Fig. 22
`Fig. 22
`
`
`
`
`
`5.8:.>E.=nu:o=_.___._§.§.U8.upSE2.8.83.3cm~c§\=~35c>~
`
`

`
`I
`
`------ 1
`Second
`1
`Selector
`I
`
`I
`
`I
`
`Display
`
`I
`
`User's hand rotates the
`device around this axis
`A
`
`I
`
`Two sets of sensors
`
`Forces
`
`the user
`
`applied by /
`.* : 22 , .;
`
`Forces
`applied by
`the vehicle
`
`I
`
`*
`
`Forces
`pplied by
`the user
`
`I
`
`Fig. 23
`
`

`
`User
`
`/
`
`Differential Signal
`doubles the user
`input and cancels the
`vehicle component
`
`may be wireless if
`the second sets of
`sensors is external
`
`Fig. 24
`
`

`
`Vehicle movement
`results in "sliding"
`motion
`
`To Motion
`Software
`
`User input is
`rotational
`movement
`over vertical or
`horizontal axis
`
`A
`
`I
`# - - - - - - _ _ I - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`I
`I
`I
`I
`I
`I
`I I
`I
`I
`
`I
`I
`
`I
`I
`
`I ,
`
`I
`
`TWO sets of j
`I
`identical
`j
`sensors,
`I
`oppositely
`directed and
`separated by j
`j
`space in all
`three
`dimensions j
`
`I I
`
`I
`1
`I
`I
`I
`I
`I
`
`I
`1
`
`i
`
`I
`
`, - _ - _ - - _ _ - - - -
`Optional i
`Signal f
`Equalizer I
`
`Fig. 25
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 27 of 47
`
`US 200410263479 A1
`
`

`
`490
`
`492
`
`Fig. 27A
`Fig. 27A
`
`Fig. 27B
`Fig. 273
`
`
`
`
`
`5.8:.>E.=nu:o=_.___._§.§.U8.upSE2.8.33.3cm~c§\=~35c>~
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 29 of 47
`
`US 200410263479 A1
`
`Fig. 28
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 30 of 47
`
`US 200410263479 A1
`
`Fig. 29
`
`

`
`Patent Application Publication Dec. 30,2004 Sheet 31 of 47
`
`US 200410263479 A1
`
`Fig. 30
`
`

`
`Fingers
`
`-.---.
`
`Thumb
`
`/-<- ,J
`
`I.
`
`Fig. 31
`
`

`
`
`
`
`
`5.8:.>E.=nu:o=_.___._§.§.U8.upSE9.8.83.5cm~c§\=~35c>~
`
`Fig. 32
`Fig; 32
`
`

`
`Smith, Kathy
`
`Smith, Quentin
`Smyth, Jenny
`Smyth, Kjle U.
`Smyth, Leo
`
`New h t r y
`
`S~UQGQ a letter
`end get there
`in a single
`coicca,
`
`/
`
`Fig.
`
`

`
`Tilt Left
`
`9"
`
`Select
`
`Fig. 34
`
`Select any
`name with
`a side key
`
`

`
`Tilt Left
`---
`. - --.
`-:--
`
`,"d_
`
`I+
`
`Tilt Right
`
`< Address Phone :,
`S I ~ & L M k
`
`Mike @w o lk
`Mike@ home
`Mike@hotmail
`Mike@cellphone
`
`\
`
`I
`
`Fig. 35
`
`Select with
`a side key
`
`

`
`Selectwith
`
`'
`
`Fig. 36
`
`Tilt Right
`,>
`pf-- - - - "-dpk
`,/..I ,~ /-rJ')
`" *'
`; '. 9 rnfittl; %J&hh@
`*+*-;
`smith, .Jgn& +
`+ a,-p "S "I.$,$
`-6;" s,s,q@k g! 4
`\, Orn&@h ~ ~ a n e ~ ~ ~ ~ )
`Tilt up / down to scroll
`
`+ &- sn$iteWJezn&&gj
`
`Tilt Left
`
`Jul 04'01 Y:OOam
`<Inconling Missed>
`<~!J@>:D B3g
`smite John
`Smite Jane
`Smith John
`Smith Jane
`Smyth John
`\ Smyth Jane
`
`,
`
`

`
`,.Tilt Left
`
`Address Phone>
`%TI&& aY%m
`
`Fig. 37
`
`

`
`From Call History
`
`'k Geoming Outgoing
`
`- "m
`' S m i k e ~ o h L
`
`Select with
`a side liey
`
`Dia 1
`Save ,
`Block Q J -
`
`11 Details )
`
`Dialing
`777 555 7878
`
`Fig. 38
`
`e
`
`a
`
`1
`
`4 Email Address *
`" 8 m - a a m
`" 7 9 7 S B r n
`Main Offke
`" satellite Office
`.. Gdbile
`Home
`
`0
`Q
`, O n
`
`

`
`John's Birthday
`
`Meeting
`Banner
`0 0 0 0
`
`2
`2
`9
`8
`15 16
`
`
`
`5
`4
`3
`10 11 12
`17 18 19
`
`Address
`Soak
`
`V H i ~ l l t
`
`DO\\ n
`
`Fig. 39
`
`

`
`Thumb
`Joystick
`Functions
`
`Left Click
`
`Right Click
`
`Double
`Click
`
`Ctrl Click
`
`Fig. 40
`
`

`
`
`
`
`
`IV6LI7€9Z0/17002Sf]L17J0Z17199‘lSI700?‘O9'33(l“0!199!I‘l“d“0!W3!lddV1“919d
`
`
`
`
`
`
`
`
`
`N
`j
`‘Efilwine Heighgs
`
`s
`
`
`
`I
`-._V
`ficornwgll
`_ my
`
`Q;
`.
`_
`‘c%r‘s“e
`JE:=:19::e5" 5 M p
`x,‘-i;,,.
`I’
`V
`-
`‘ti
`-_
`
`Rm:1’.
`62003 n-iapquastmfn. lnc.; ©2003 GDT_ Inc."
`
`
`
`Fig. 41
`
`‘F
`
`
`
`

`
`Optional Zoom
`In/Out with 3 axis
`senso r
`
`Wa ypo int
`\
`
`Start
`
`End
`
`/ Menu
`
`Down v
`
`Rotated to show
`landscape pages
`
`Cursor 7
`
`Left ? T Right
`
`Fig. 42
`
`

`
`Full area of the
`map I web page
`before zoomi
`
`Area seen on the
`PDA after
`zooming in,
`cursor moves
`with the screen
`and stays in the
`center
`
`Fig. 43
`
`

`
`. .
`b VIEW CART I WtSH US1 I
`
`Hello. Sign in to get ~~etsonalized I-eco~n~nendations.
`
`Stalt here.
`
`:& &A I
`
`Side Keys assigned to thq
`most used functions
`
`TY pe
`COPY
`Paste
`More
`
`11 1 Featured Stores
`[I / Accessories
`
`1 rafl
`
`I K.2 ---%
`
`/I I Jewelrv &
`
`Watches
`
`I
`i Books Top Seyers--'
`
`/
`
`Side bars
`controlled by
`motion sensor
`
`Cursor
`controlled by
`Thumb Joystick
`Central push
`button emulates
`mouse clicks
`
`- -
`
`Fig. 44
`
`

`
`Cursorcontrolled by Thumb Joystick
`
`I
`
`Side Keys
`
`Type
`COPY
`Paste
`-More
`
`Side bars controlled by motion sensor
`Fig. 45
`
`

`
`-a
`
`D
`V Aim and Fire by Thumb
`
`Move by Tilt
`Move Left, Right, Forward, Back
`Zoom In/Out (with 3D sensor)
`
`Fig. 46
`
`

`
`Dec. 30,2004
`
`ACTIVE KEYBOARD SYSTEM FOR HANDHELD
`ELECTRONIC DEVICES
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This application is a continuation-in-part of U.S.
`patent application Ser. No. 101320,529, filed Dec. 17, 2002,
`which claims the benefit of U.S. Provisional Patent Appli-
`cation Ser. No. 601342,382, filed Dec. 27, 2001, each of
`which are incorporated herein by reference.
`
`BACKGROUND OF THE INVENTION
`
`[0002] 1. Field of the Invention
`
`[0003] The present invention generally relates to handheld
`data entry devices and, more particularly to an active key-
`board system for handheld electronic devices. The active
`keyboard system dynamically presents available choices on
`a display grouped to effect unambiguous selection of the
`available choices through use of input means, thereby pro-
`viding users of handheld electronic devices with a consistent
`set of techniques to perform all commonly used functions
`including entering alphanumeric text and data into the
`device using only one hand.
`
`[0004] 2. Description of the Related Art
`
`[0005] Portable electronic devices are rapidly becoming
`smaller while their capabilities are continually increasing.
`Shrinking size has limited the ability of the user to physi-
`cally manipulate the keyboard in order to input information
`into the electronic device and access information from the
`device. Some electronic devices have been produced with
`miniature keyboards, but these have proven difficult to use
`and the keys are too small for fast entry of data with the
`fingers. Using normal size keys for a complete keyboard
`limits how small a device can be due to the necessary width
`of the keyboard. Some companies have created normal size
`keyboards that break into overlapping pieces when the
`computer is not in use, but even then the device must still be
`relatively large.
`
`[0006] Today many electronic devices are small enough to
`fit into the palm of the hand. With such small size it would
`be desirable to be able to quickly enter data, or to navigate
`the Internet with one hand, where that one hand not only
`supports the device but is also able to quickly enter data or
`commands using all five digits. A device for quickly and
`efficiently entering data, including full text, with a limited
`number of keys, such as that provided by the present
`invention, is needed in order to fully utilize the power of
`these small electronic devices.
`
`[0007] The prior art has shown several methods of data
`entry using a limited number of full size keys. One such
`method is the "multi-tap" method. This method involves
`using twelve or more keys with several letters or symbols
`assigned to each key. The user taps each key until the desired
`letter appears on the device's display. This system allows the
`user to input complete text messages using a limited number
`of keys, but it is a time consuming system due to the
`excessive number of keystrokes and timeouts required, it has
`no Internet browsing capability, and it forces the user to shift
`the position of his fingers from key to key, further reducing
`keystroke efficiency.
`
`[0008] Another method of inputting data using a limited
`number of keys are the systems described in U.S. Pat. No.
`5,818,437, issued Oct. 6, 1998 to Dale L. Grover et al., and
`U.S. Pat. No. 6,011,554, issued Jan. 4, 2000 to Martin T.
`.
`.
`.
`
`King et al. These systems also assign each key a plurality of
`values, but eliminate the need to press each key multiple
`times. The user simply presses eachdesired key once and the
`computer attempts to decipher what word the user intended
`to input out of the several possible words which could be
`formed from the several letters on each key. If the computer
`comes up with the wrong word the user can scroll through
`a number of other possibilities. These systems are effective
`in reducing the number of keystrokes as compared to the
`multi-tap method. They cannot, however, be used to input
`uncommon words and names due to a limited vocabulary,
`they have no application to Internet browsing, and they
`cannot be used without the user changing finger position on
`the keys.
`[0009] U.S. Pat. No. 5,854,624, issued Dec. 29, 1998 to
`Jeffrey A. Grant, is an example of a pocket-sized interface
`for Internet browsing. The Grant '624 device uses a touch
`sensitive switch and several keys to allow a user to interface
`with the Internet. While the Grant '624 device does function
`to allow a user to navigate the Internet, it shows no way of
`entering data such as text and numbers, and is not designed
`for one hand operation.
`[0010] U.S. Pat. No. 6,164,853, issued Dec. 26, 2000 to
`Lisa L. Foote, is also relevant in that it discloses an ergo-
`nomic housing for a handheld device. The Foote device fits
`over a standard electronic device such as a remote control
`and allows the user to comfortably operate such a device
`using only one hand. The Foote device does not, however
`disclose any method for quickly entering a variety of data,
`nor show any method of navigating the Internet.
`[0011] Additional relevant art includes U.S. patent appli-
`cation Publication No. 200210060699 A l , published May
`23, 2002 for Giovanni D'Agostinin (character input device
`based on a two-dimensional movement sensor); U.S. patent
`application Publication No. 200210163504 A l , published
`Nov. 7, 2002 for Matthew G. Pallakoff (hand held device
`that supports fast text typing); U.S. patent application Pub-
`lication No. 200310036362 A l , published Feb. 20,2003 for
`Joshua R. Buesseler et al. (interchangeable cover for a
`mobile communications device) ; and U.S. patent applica-
`tion Publication No. 200310048262 Al, published Mar. 13,
`2003 for Charles Wu et al. (method and apparatus for
`navigation, text input, and phone dialing).
`
`[0012] Additional related art includes U.S. patent appli-
`cation Publication No. 200310052861 Al, published Mar.
`20, 2003 for Jiang Peng (portable communication device
`with detachable joystick and method therefore); U.S. patent
`application Publication No. 200410012566 A l , published
`Jan. 22, 2004 for Gary R. Bradski (intuitive mobile device
`interface to virtual spaces); and U.S. patent application
`Publication No. 200410018863 Al, published Jan. 29, 2004
`for G. Eric Engstrom et al. (personalization of mobile
`electronic devices using smart accessory covers).
`[0013] Additional related art includes U.S. Pat. No. 4,891,
`777, issued Jan. 2, 1990 to James M. Lapeyre (single hand
`keyboard arrays providing alphanumeric capabilities from
`twelve keys); U.S. Pat. No. 5,187,480, issued Feb. 16,1993
`to Ronald H. Thomas et al. (symbol definition apparatus);
`
`

`
`Dec. 30,2004
`
`U.S. Pat. No. 5,332,322 issued Jul. 26, 1994 to Thomas L.
`Gambaro (ergonomic thumb-actuable keyboard for a hand-
`grippable device); U.S. Pat. Nos. 5,471,042 and 5,565,671,
`issued Nov. 28, 1995 and Oct. 15, 1996, respectively, to
`David Kirkeby et al. (handheld data entry terminal having
`dual trigger switches); U.S. Pat. No. 5,612,719, issued Mar.
`18, 1997 to Ernest H. Beernik et al. (gesture sensitive
`buttons for graphical user interfaces): U.S. Pat. No. 5,666,
`113, issued Sep. 9, 1997 to James D. Logan (system for
`using a touchpad input device for cursor control and key-
`board emulation); and U.S. Pat. No. 5,703,623, issued Dec.
`30,1997 to Malcolm G. Hall et al. (smart orientation sensing
`circuit for remote control).
`
`[0014] Additional related art includes U.S. Pat. No. 5,736,
`976, issued Oct. 6, 1998 to Nina T. Cheung (computer data
`entry apparatus with hand motion sensing and monitoring);
`U.S. Pat. No. 5,808,567 issued Sep. 15, 1998 to Seth R.
`McCloud (apparatus and method of communicating using
`three digits of a hand); and U.S. Pat. No. 5,931,873, issued
`Aug. 3, 1998 to James M. Cisar (programmable mobile
`device with thumb wheel).
`
`[0015] Additional related art includes U.S. Pat. No. 6,052,
`070, issued Apr. 18,2000 to Seppo Kivella et al. (method for
`forming a character string, an electronic communication
`device and a charging unit for charging the electronic
`communication device); U.S. Pat. No. 6,067,358, issued
`May 23,2000 to Alan H. Grant (ergonomic cellular phone);
`U.S. Pat. No. 6,104,317, issued Aug. 15, 2000 to Jerry
`Panagrossi (data entry device and method); U.S. Pat. No.
`6,201,554, issued Mar. 13,2001 to Robert M. Lands (device
`control apparatus for hand-held data processing); and U.S.
`Pat. No. 6,243,080, issued Jun. 5, 2001 to Anders L. Molne
`(touch-sensitive panel with selector).
`
`[0016] Additional related art includes U.S. Pat. No. 6,347,
`290, issued Feb. 12, 2002 to Joel F. Bartlett (apparatus and
`method for detecting and executing positional and gesture
`commands corresponding to movement of handheld com-
`puting device); U.S. Pat. No. 6,392,640, issued May 21,
`2002 to Craig A. Will (entry of words with thumbwheel by
`disambiguation); U.S. Pat. No. 6,400,376, issued Jun. 4,
`2002 to Mona Singh et al. (display control for hand-held
`data processing device); U.S. Pat. No. 6,437,709, issued
`Aug. 20, 2002 to Qi Hao (keyboard and thereof input
`method); U.S. Pat. No. 6,466,198, issued Oct. 15, 2002 to
`David Y. Feinstein (view navigation and magnification of a
`hand-held device with a display); and U.S. Pat. No. 6,567,
`101, issued May 20,2003 to Keith C. Thomas (system and
`method utilizing motion input for manipulating a display of
`data).
`
`[0017] Additional related art includes U.S. Pat. No. 6,573,
`883 issued Jun. 3, 2003 to Joel F. Bartlett (method and
`apparatus for controlling a computing device with gestures);
`U.S. Pat. No. 6,603,420, issued Aug. 5, 2003 to Jin Lu
`(remote control device with motion based control for
`receiver volume, channel selection, or other parameters);
`U.S. Pat. No. 6,611,255, issued Aug. 26, 2003 to Jason T.
`Griffin et al. (hand-held electronic device with a keyboard
`optimized for use with the thumbs); U.S. Pat. No. 6,641,482,
`issued Nov. 4,2003 to Iwao Masuyama et al. (portable game
`apparatus with acceleration sensor and information storage
`medium storing a game program); U.S. Pat. No. 6,683,599,
`issued Jan. 27, 2004 to Robert A. Shepherd (keypads style
`
`input device for electrical device); and U.S. Pat. No. 6,690,
`358, issued Feb. 10,2004 to Alan E. Kaplan (display control
`for hand-held device).
`
`[0018] Additional related art includes European Patent
`Application Publication No. EP 0 735 514 Al, published in
`October 1996, Great Britain Patent Application Publication
`No. GB 2 193 023 A, published in January 1988, World
`International Patent Organization (WIPO) Patent Applica-
`tion Publication No. WO 021073995 Al, published in Sep-
`tember 2002, European Patent Application Publication No.
`EP 1 271 288 A2, published in January 2003, and WIPO
`Patent Application Publication No. WO 031015379, pub-
`lished in February 2003.
`
`[0019] None of the above inventions and patents, taken
`either singly or in combination, is seen to describe the
`instant invention as claimed. cl SUMMARY OF THE
`INVENTION
`
`[0020] The present invention is an active keyboard system
`for handheld electronic devices. The active keyboard system
`dynamically presents available choices on a display grouped
`to effect unambiguous selection of the available choices
`through use of input means, thereby providing users of
`handheld electronic devices with a consistent set of tech-
`niques to perform all commonly used functions including
`entering alphanumeric text and data into the system using
`only one hand. The active keyboard system includes a
`processor, a memory, and a display communicatively con-
`nected to one another. The system includes input means for
`inputting data into the system that include at least one
`selector and a plurality of keys. Active keyboard system
`software is stored on the memory and is configured to
`dynamically present available choices on the display
`grouped to effect unambiguous selection of the available
`choices through use of the input means.
`
`[0021] The active keyboard system software includes pre-
`sentation code and filter code. The presentation code
`includes step or scroll resolution code to enable scrolling,
`and grid presentation code to organize available choices on
`a visual grid and provide the visual grid to the display. The
`presentation code displays a selection pointer controlled by
`one of the selectors at a time. The grid presentation code
`configures the visual grid with one or more panes each
`configured as a matrix with a plurality of columns and
`plurality of rows. The pane(s) may be configured as a matrix
`with three columns and four rows, a matrix with one column
`and a plurality of rows, etc. The pane(s) may be clear,
`transparent, translucent, andlor opaque.
`
`[0022] The visual grid includes a plurality of cells and the
`grid presentation code may have grid population code to
`populate each of the cells with an alphanumeric character, a
`symbol, a music note, an icon, text, an ideogram, or a
`logogram. The presentation code may have application
`adapter code to translate transactions between application
`and presentation code, sound code to provide an audio
`announcement for a selected choice, an audio confirmation
`for completion of an action or an alarm for failure to
`complete an action, and feedback code to enhance user
`interaction with the system.
`
`[0023] The filter code is configured to separate an inten-
`tional user motion input from accidental motion. Filter code
`may have external forces filter code to separate user input
`
`

`
`Dec. 30,2004
`
`from undesired effects of external forces, step motion code
`to translate user intentions into precise movement of a
`pointer over the grid, and to allow readjustment of the
`system between steps, sliding zero code to allow the user to
`change hislher position while operating the device, adaptive
`threshold code to optimize operator interaction with the
`system via feedback, andlor calibration code to effect user
`and application preferences.
`
`[0024] The keys may be configured to be operated by
`fingers without obstructing the display. The active keyboard
`system may be configured with a single selector or plural
`selectors. Aselector may be a wheel, a track ball, a joystick,
`a rocker pad, a touch pad, a selector switch, a toggle switch,
`a key button, an N-state button, or an N-state selector
`configured to be operated by a thumb or other finger.
`
`[0025] Alternatively or in addition to a thumblfinger oper-
`ated selector(s), the active keyboard system may have selec-
`tor(~) configured to interpret motion of the system as an
`input. Such a selector may be a set of one, two, or three
`movement sensors configured to sense motion in different
`substantially orthogonal dimensions. The movement selec-
`tor(~) may include two or more sets of movement sensors
`configured to filter out effects of undesired movement of the
`system by external forces.
`
`[0026] The active keyboard system may be configured to
`achieve ambidextrous use by providing a partial or full
`duplication of the input means on the system or by allowing
`the user to rotate, reattach, slide, or move system parts. The
`keys may be configured to inhibit unintentional engagement.
`
`[0027] The active keyboard system may be configured as
`a cellular phone, a personal digital assistant, a global posi-
`tioning receiving device, a remote control, a computer
`mouse, a pager, a walkie-talkie, a scanner, a multi-meter,
`etc., and may be configured to effect browsing on the
`Internet with a single pointer.
`
`[0028] Accordingly, it is a principal aspect of the invention
`to provide an active keyboard system including a processor,
`a memory communicatively connected to the processor, a
`display communicatively connected to the processor, input
`means for inputting data into the system, the input means
`including at least one selector, a plurality of keys, and active
`keyboard system software stored on the memory. The active
`keyboard system software is configured to dynamically
`present available choices on the display grouped to effect
`unambiguous selection of the available choices through use
`of the input means.
`
`[0029]
`It is an aspect of the invention to provide improved
`elements and arrangements thereof in an active keyboard
`system for handheld electronic devices for the purposes
`described which is inexpensive, dependable and fully effec-
`tive in accomplishing its intended purposes.
`
`[0030] These and other aspects of the present invention
`will become readily apparent upon further review of the
`following specification and drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0031] FIG. 1 is front perspective view of an active
`keyboard system configured as a cellular phone for left
`handed use according to the present invention.
`
`[0032] FIG. 2 is a block diagram of an active keyboard
`system according to the present invention.
`[0033] FIG. 3 is a block diagram of the active keyboard
`system software according to the present invention.
`[0034] FIG. 4A is a flow diagram indicating the effect of
`tilt movement of an active keyboard system according to the
`present invention.
`[0035] FIG. 4B is a flow diagram indicating the effect of
`tilt movement of an active keyboard system according to the
`present invention.
`[0036] FIG. 5A is a top view of a button assembly selector
`according to the present invention.
`[0037] FIG. 5B a cross sectional view of the button
`assembly selector shown in FIG. 5A.
`[0038] FIG. 5C is a cross sectional view of a roller ball
`selector according to the present invention.
`[0039] FIG. 5D is a perspective view of a touch pad
`selector according to the present invention.
`[0040] FIG. 5E is a cross sectional view of a joystick
`selector according to the present invention.
`[0041] FIG. 6A is a functional view of the button assem-
`bly selector shown in FIG. 5A.
`[0042] FIG. 6B is a functional view of the roller ball
`selector shown in FIG. 5B.
`[0043] FIG. 6C is a functional view of the touch pad
`selector shown in FIG. 5D.
`[0044] FIG. 6D is a top view of the joystick selector
`shown in FIG. 5E.
`[0045] FIG. 7 is a perspective view of an active keyboard
`system device equipped with a movement sensor selector
`according to the present invention.
`[0046] FIG. 8 is a front perspective view of an active
`keyboard system with the display showing columns of
`selection pointers according to the present invention.
`[0047] FIG. 9 is a front view of a computer screen with a
`shaded portion representing the portion of a page viewed on
`a display of an active keyboard system according to the
`present invention.
`[0048] FIG. 10 is an expanded view of a multi-pane grid
`of an active keyboard system according to the present
`invention.
`[0049] FIG. 11 is a functional view of step motion of an
`active keyboard system according to the present invention.
`[0050] FIG. 12 is a functional view of step motion of an
`active keyboard system according to the present invention.
`[0051] FIG. 13 is a front view of a map image on a display
`of an active keyboard system according to the present
`invention.
`[0052] FIG. 14 is a functional view of a zoom in process
`on a map image on a display of an active keyboard system
`according to the present invention.
`[0053] FIG. 15 is functional view of a step implementa-
`tion of a calendar on a display of an active keyboard system
`according to the present invention.
`
`

`
`Dec. 30,2004
`
`[0054] FIG. 16 is a functional diagram of step motion of
`an active keyboard system according to the present inven-
`tion.
`[0055] FIG. 17 is a flow chart of step motion of an active
`keyboard system according to the present invention.
`[0056] FIG. 18 is a functional diagram of sliding zero
`code of active keyboard system software according to the
`present invention.
`[0057I FIG- 19 is a f~nctional diagram of adaptive thresh-
`old code of active keyboard system software according to
`the present invention.
`[0058] FIG. 20 is a functional diagram illustrating a
`virtual bubble of an active keyboard system according to the
`present invention.
`
`[0059] FIG. 21 is an active keyboard system with optional
`external sensors according to the present invention.
`
`[0060] FIG. 22 is an active keyboard system with an
`external motion compensator according to the present inven-
`tion.
`
`[0061] FIG. 23 is a functional diagram of an active
`keyboard system with two external sensors according to the
`present invention.
`
`[0062] FIG. 24 is a functional diagram of circuitry for use
`with an active keyboard system according to the present
`invention.
`
`[0063] FIG. 25 is a functional diagram illustrating noise
`cancellation code of active keyboard system software uti-
`lizing two oppositely directed sensors according to the
`present invention.
`
`Lo0641 FIGS- 26A, 26B3 and 26C are three examples of
`active keyboard systems according to the present invention.
`
`[0065] FIGS. 27A and 27B are two examples of sleeves
`for use with an active keyboard System according to the
`present invention.
`
`[0066] FIG. 28 is a display screen image for dialing with
`an active keyboard system according to the Present inven-
`tion.
`
`[0067] FIG. 29 is a display screen image for typing with
`an active keyboard system according to the Present inven-
`tion.
`
`[0068] FIG. 30 is a functional diagram illustrating move-
`ment amongst grid pane layers on an active keyboard system
`according to the present invention.
`
`[0069] FIG. 31 is a functional illustration of the grip of an
`active keyboard system according to the present invention,
`
`[0070] FIG. 32 is a functional illustration of an active
`keyboard system equipped with movement sensors accord-
`ing to the present invention.
`
`[00711 FIG. 33 is a functional dia