US007039879B2
`
`(12) United States Patent
`Bergsten et a].
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 7,039,879 B2
`*May 2, 2006
`
`(54) METHOD AND APPARATUS FOR
`SCROLLABLE CROSS-POINT NAVIGATION
`IN A USER INTERFACE
`
`75
`(
`)
`
`_
`Inventors‘
`
`~
`
`--
`
`~
`_
`mg 6E)’ Per
`
`(73) Assignee: Nokia Corporation, Espoo (Fl)
`
`( * ) Notice:
`
`Subject' to any disclaimer,‘ the term of this
`patent 15 extended or adjusted under 35
`USC 154(b) by 591 days,
`
`This patent is subject to a terminal dis-
`claimer.
`
`5,059,965 A * 10/1991 Geiser ................. .. 340/995.23
`5,283,560 A *
`2/1994 Bartlett
`..... .. 345/729
`5,485,175 A
`1/1996 Suzuki ........... ..
`395/156
`5,677,708 A * l0/l997 Matthews et a1.
`345/684
`5,751,369 A
`5/l998 Harrison et a1. .... ..
`348/552
`5,815,155 A
`9/1998 Wolfston .................. .. 345/357
`
`FOREIGN PATENT DOCUMENTS
`
`W0
`WO 00/79374 Al
`>1< Cited by examiner
`
`12/2000
`
`Primary ExamineriKristine Kincaid
`Assistant ExamineriPeng Ke
`(74) Attorney, Agent, or Firm4Cohen; Pontani; Lieberman
`& Pavane
`
`(21) Appl. No.: 09/893,850
`
`(57)
`
`ABSTRACT
`
`(22) Filed:
`
`Jun- 28, 2001
`_
`_
`_
`Pnor Pubhcatlon Data
`Us 2003/0001907 A1
`Jan 2’ 2003
`
`(65)
`
`(51) Int_ CL
`(200601)
`G06F 9/00
`(52) us. Cl. .................... .. 715/853; 715/763; 715/725;
`715/841; 715/843
`(58) Field of Classi?cation Search ...... .. 713/719A722;
`345/853 763 725 841*843. 725/44 45
`’
`’
`’
`725/416 47 52’ 61’
`See application ?le for Complete Search h’isto’ry ’
`'
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`Method and apparatus for controlling an electronic device
`by navigating through a hierarchy of groups of commands
`While continuously providing the current location and path
`in the hierarchical structure. A displayed scrollable cross
`point navigation image has tWo bars; each containing panels
`corresponding to a separate folder, etc. At the intersection of
`the bars is displayed the current loWest level and the next
`upper level, if any- The next higher level is Shown in an
`adjoining panel on a ?rst bar; the next higher level in a next
`adjoining Pane1 on that bar’ until there are no funher higher
`levels to display; at Which point the remaining upper-most
`level folders are displayed. The second bar displays sub
`folders or settings Within the folder in the focus panel.
`Moving in the folder hierarchy causes the panels in the ?rst
`bar to shift to display all intervening levels through the top
`level.
`
`4,241,521 A * 12/1980 Dufresne .................. .. 434/112
`
`20 Claims, 9 Drawing Sheets
`
`a?
`
`3 (a
`
`26
`
`52
`COW‘, EMMM-IE 5; W
`
`
`,/ L__l COLUMN
`F ---- 77: OF SUB- OBJECT
`5? x4 2
`W~HL _ _ 5 p _ A FIELDS
`:- -—> SELECT
`
`~ _ _ _ / G2.
`I
`‘Ibx :-
`7 7 7 7 7 13”“
`i g
`0
`41‘ r7\- 1‘ _ “ ' ‘1 O
`
`1. - _ _ _ _ J U
`
`5'6 “'i
`
`59
`
`BACKGROUND PICTURE
`cg TV; GRAPHICS, etc.
`
`0
`‘727
`é
`ROW OF
`11-1
`‘t3 ‘if OBJECT 1,7
`‘L 91
`I {FEED 111m FOCUS »
`FIELDS
`1 ~~ *7“
`1
`
`Q
`
`k“‘““" ’““"‘Tl"-""lf ' ' " _ ——‘."“____.'.‘"__'_'
`777 7 7 7! \———-—~—1 777 77777‘ “77777777 ‘7777777 ‘7:117
`
`mHNFORMATmN TEXT AREA ,
`Q 5,,
`1 N l
`I
`
`4,
`
`34
`[
`
`1
`
`l
`1
`l
`
`1
`1
`1
`
`Page 1 of 16
`
`SONY EXHIBIT 1007
`
`

`

`U.S. Patent
`
`May 2, 2006
`
`Sheet 1 0f 9
`
`US 7,039,879 B2
`
`m
`1
`
`26 K
`
`/-"~~
`32
`
`User
`Interface
`
`'\
`
`24
`Input
`device
`
`f 22
`
`34 \
`Graphics +_,
`Interaction
`_* interpreter A generator
`
`/_ 16
`
`CID _ /~ 14
`/~ Content
`G'rapmcs
`20
`da!a base
`irbrary
`‘~15’!
`
`1" CID
`U! Objects F
`‘in?ame
`W
`
`w Exigrna?y
`18
`supplred data
`
`12
`
`5am» I
`
`Page 2 of 16
`
`

`

`U.S. Patent
`
`May 2, 2006
`
`Sheet 2 0f 9
`
`US 7,039,879 B2
`
`
`
`3. am
`
`Yul @\ , 0“ 0.0
`
`00 Q bwgoépw “5 n ..... L
`
`
`
`
`
`h, 2238 will} L
`
`BREE/2% E 9
`
`S 556 5 g :0
`5 26¢ 0, w
`
`2:; $58 92 SB 1
`
`
`
`. a 55 cm: 222553;
`
`N $50K
`
`
`
`
`
`WEDGE @5239; St! I - - 1
`
`n S
`
`G M i O
`m .1
`
`
`
`3 rll |..\ I; JIIL i
`
`Page 3 of 16
`
`

`

`U.S. Patent
`U.S. Patent
`
`May 2, 2006
`May 2, 2006
`
`Sheet 3 0f 9
`Sheet 3 0f 9
`
`US 7,039,879 B2
`US 7,039,879 B2
`
`
`
`Page 4 0f 16
`
`Page 4 of 16
`
`

`

`U.S. Patent
`U S. Patent
`
`May 2, 2006
`May 2, 2006
`
`Sheet 4 0f 9
`Sheet 4 0f 9
`
`US 7,039,879 B2
`US 7,039,879 B2
`
`
`
`Page 5 0f 16
`
`Page 5 of 16
`
`

`

`U S. Patent
`U.S. Patent
`
`May 2, 2006
`May 2, 2006
`
`Sheet 5 0f 9
`Sheet 5 0f 9
`
`US 7,039,879 B2
`US 7,039,879 B2
`
`
`
`Page 6 0f 16
`
`Page 6 of 16
`
`

`

`U.S. Patent
`U.S. Patent
`
`May 2, 2006
`May 2, 2006
`
`Sheet 6 0f 9
`Sheet 6 0f 9
`
`US 7,039,879 B2
`US 7,039,879 B2
`
`
`
`Page 7 0f 16
`
`Page 7 of 16
`
`

`

`U.S. Patent
`U.S. Patent
`
`May 2, 2006
`May 2, 2006
`
`Sheet 7 0f 9
`Sheet 7 0f 9
`
`US 7,039,879 B2
`US 7,039,879 B2
`
`
`
`Page 8 0f 16
`
`Page 8 of 16
`
`

`

`U.S. Patent
`
`May 2, 2006
`
`Sheet 8 0f 9
`
`US 7,039,879 B2
`
`31
`
`3%
`
`(
`/
`9‘ 3
`‘” FIG
`URE 8
`
`Page 9 of 16
`
`

`

`U.S. Patent
`U.S. Patent
`
`May 2, 2006
`May 2, 2006
`
`Sheet 9 0f 9
`Sheet 9 0f 9
`
`US 7,039,879 B2
`US 7,039,879 B2
`
`w w
`
`50
`
`amumn
`
`Page 10 0f 16
`
`Page 10 of 16
`
`

`

`US 7,039,879 B2
`
`1
`METHOD AND APPARATUS FOR
`SCROLLABLE CROSS-POINT NAVIGATION
`IN A USER INTERFACE
`
`FIELD OF THE INVENTION
`
`The present invention relates to a method and apparatus
`for selecting or adjusting services or settings of an electronic
`device on a display of the electronic device.
`
`BACKGROUND OF THE INVENTION
`
`2
`key, sub-sub-?elds (F21-1, F210, F211, F212, F213, etc.)
`corresponding to the sub-?eld (F2) positioned at the inter
`section of the tWo bars are then displayed on the vertical bar,
`as shoWn in FIG. 2b of the patent publication. In actual use,
`Words descriptive of, for example, instruction categories or
`actual instructions to be transmitted to the electronic device
`are displayed to the user, not merely letters and numbers.
`Such listing and selection of sub- and sub-sub-?elds can go
`doWn to as many levels as is necessary to provide the user
`With a desired selection of options. To navigate upWard
`through the levels, a second prede?ned navigation key is
`depressed by the user, and, as a result, the visual content of
`the appropriate bar is changed to re?ect a change in ?eld
`level.
`Although the user interface disclosed in PCT Patent
`Publication No. WO 00/65429 is fully able to permit a user
`to satisfactorily navigate among a plurality of possible
`instructions or device settings arranged in a plurality of
`groups, sub-groups, sub-sub-groups, etc., it may be some
`What dif?cult for a user to determine Where in the menu
`hierarchy of possible instructions and groups of instructions
`he currently is so that he can easily navigate to another
`desired available electronic device instruction or setting, or
`group of such instructions or settings. This difficulty arises
`because only tWo levels of groups (or ?elds) are simulta
`neously displayed to the user. Whenever a group, sub-group,
`etc. is selected, the appropriate bar is overwritten by the
`sub-entries in the selected group or sub-group. Thus, no map
`is displayed shoWing generally Where in the hierarchy of
`groups, sub-groups, etc. the user currently is located. As a
`result, a user unfamiliar With the hierarchy of the groups
`may be forced to randomly press the navigation buttons
`repeatedly, thereby navigating up, doWn and/ or through the
`levels, until he has found the desired instruction or group of
`instructions, or a group of instructions or an instruction that
`is familiar to the user to enable him to navigate to the
`instruction or group of instructions actually desired.
`
`SUMMARY OF THE INVENTION
`
`The present invention provides a method and apparatus
`for controlling, adjusting and/or setting of electronic devices
`and appliances controlled by remote control devices, such as
`Wireless and pointing devices, or also voice-controlled
`devices. The invention alloWs the user to navigate through a
`hierarchy of groups of commands or selections While con
`tinuously providing the user With information as to Where
`the user is currently located in the hierarchical structure of
`groups so that navigation through the groups and individual
`selections is simpli?ed.
`Suitable electronic devices and appliances to be con
`trolled include, for example, television sets, satellite receiv
`ers, set-top boxes, cable television controllers, computers,
`household equipment, telephones, mobile phones, personal
`digital assistants, DVD players, CD players, VCRs, stereo
`equipment, etc., especially appliances provided With user
`interfaces such as display screens for interaction With remote
`control and other key pad devices.
`In accordance With the present invention, a scrollable
`cross-point navigation image is displayed on a user interface
`display to select a feature by combining tWo object ?elds.
`TWo bars are displayed, each bar containing a plurality of
`panels, With each panel displaying a separate folder or
`particular setting. The tWo bars are positioned so that the
`bars overlap in a single focus panel. Preferably, the tWo bars
`are siZed, shaped and positioned so as not to completely
`obscure the entirety of the display. As a result, a user can
`
`The conventional means of selection of services on or
`adjustment of settings of electronic devices, including, for
`example, a TV, set-top box, DVD player, VCR, domestic
`appliance, and other similar devices, typically has the dis
`advantage of covering the entire area of the device’s display
`and also typically requires a signi?cant number of key
`depressions until the desired selection is shoWn and is
`selected. This selection process is a signi?cant problem for
`many users of such electronic devices, including disabled
`persons and those Who are unfamiliar With setting electronic
`devices, are fearful of adjusting such devices, have no
`patience to deal With the user interface Which is often
`complex, or Who do not Want to spend the time and effort
`reading the device’s operational manual. Such device opera
`tional manuals, if actually supplied With the device (Which
`is not alWays the case), are typically someWhat incompre
`hensible due either to their technical complexity, the com
`plexity of the technical language used, their over-simplicity,
`their bad Writing style, or their unavailability in the user’s
`native language.
`Additionally, remote control devices, such as those used
`With televisions, DVD players, VCRs, etc., have a large
`number of keys, and the design of the key pads for each
`device is typically different for different manufacturers of
`like devices and even different for different devices of like
`manufacturers.
`There is thus a need for an electronic device user interface
`that is simple for a user to operate Without the need to study
`an incomprehensible Written user’s manual.
`One such user interface that solves the aforementioned
`problems is disclosed in PCT Patent Publication No. WO
`00/65429. In accordance With that user interface, a display
`on or associated With the electronic device presents to the
`user a pair of intersecting cross-point navigation bars. At
`least one of these bars is scrollable, and each bar displays
`one or more object ?elds. By selectively scrolling one or
`both of the bars, one at a time, by pressing appropriate
`buttons on the electronic device or its remote controller, the
`user positions a particular object ?eld, or selection, at the
`point Where the tWo bars intersect. When the user depresses
`a “select” button, the displayed object ?eld is selected, and
`either a bar of the display transforms to the selected sub
`?eld, or the electronic device performs the action corre
`sponding to the displayed object ?eld selected, thereby
`adjusting or setting the electronic device in the desired
`manner. By pressing another button When a particular object
`?eld is at the intersection of the tWo bars, the level of the
`object ?eld displayed in the entire corresponding bar is
`changed so that the user is given a group of choices that fall
`under the selected object ?eld category. Thus, for example,
`if the vertical bar has six object ?elds (A, B, C, D, E, and F),
`the horiZontal bar Will shoW sub-?elds corresponding to the
`object ?eld positioned at the intersection of the tWo bars
`(F-l, F0, F1, F2, F3, etc.), as shoWn in FIG. 2a ofthe patent
`publication. If the user depresses a prede?ned navigation
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Page 11 of 16
`
`

`

`US 7,039,879 B2
`
`3
`vieW the tWo bars, and can also vieW any programming or
`other information that is also being presented on the display.
`The instructions, settings and/or selections that are avail
`able for selection by the user to adjust or set the electronic
`device are arranged in an associated database in one or more
`levels of groups (sub-groups, sub-sub-groups, etc.) so that
`settings, etc. of a similar nature are in the same group, With
`the top most level being the most general, and the loWest
`most level being particular instructions. In betWeen the top
`and bottom levels, there may be sub-levels Which organize
`the contents of the database. The items in each level are
`linked to one or more items in immediately higher or loWer
`levels, if any, to form a tree-like hierarchical structure.
`When a user initially activates the user interface feature of
`the electronic device by entering the appropriate command
`on an input device, the user interface appears on a display on
`or associated With the electronic device being controlled.
`The focus panel displays (1) the user’s current loWest level
`in the hierarchical structure of groups of settings or selec
`tions and (2) the next higher level, if any. The next higher
`level, if any, is shoWn in an adjoining panel on the horizontal
`bar, the next higher level, if any, is shoWn in a next adjoining
`panel on the horizontal bar, and so on until there are no
`further higher levels to display, at Which point the remaining
`upper-most level folders are displayed in the panels on the
`horizontal bar. In the panels of the vertical bar are sub
`folders, if any, or individual settings, if any, that are Within
`the folder appearing in the focus panel, that is, such sub
`folders or settings that are of the same level as the user’s
`current loWest level in the hierarchical structure appearing in
`the focus panel. As the user descends doWn the folder
`hierarchy, the panels in the horizontal bar shift to the right
`and panels identifying levels betWeen the current level and
`the top most level are displayed. As the user ascends through
`the folder hierarchy, the panels in the horizontal bar shift to
`the left. To navigate up or doWn folder levels and to select
`a particular folder at any level, the user employs the input
`device to cause the bars, one at a time, to scroll up, doWn,
`left and right to cause a particular panel to be shifted into the
`focus panel and thereby navigate through the various levels
`of the hierarchical structure of groups of settings or selec
`tions. When the focus panel is positioned at a desired folder,
`the user selects it With the input device. If a particular
`ultimate setting or instruction Within a folder, sub-folder,
`etc., is selected by the user, the electronic device is
`instructed to perform the function of that setting or instruc
`tion. To move upWard in the hierarchy to one of the folders
`shoWn in the horizontal bar to the right of the focus panel,
`the user simply uses the input device to scroll the horizontal
`bar as desired.
`The user interface, thus, alWays displays the user’s current
`location in the hierarchical structure and the path of the
`folder, sub-folder, and sub-sub-folder, etc., that the user
`descended through to get to the current location. Because
`this folder path information is continuously displayed to the
`user, navigation through the folder structure and the instruc
`tions or settings Within that structure is immediately appar
`ent and simple Without the need for a user’s manual explain
`ing the structure of the folder structure.
`Other objects and features of the present invention Will
`become apparent from the folloWing detailed description
`considered in conjunction With the accompanying draWings.
`It is to be understood, hoWever, that the draWings are
`intended solely for purposes of illustration and not as a
`de?nition of the limits of the invention, for Which reference
`should be made to the appended claims.
`
`4
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`In the draWings, Wherein like reference numerals delin
`eate similar elements throughout the several vieWs:
`FIG. 1 is a schematic block diagram illustrating one
`embodiment of means used to accomplish a apparatus in
`accordance With the present invention;
`FIG. 2 is a schematically diagram of a preferred embodi
`ment of a user interface in accordance With the present
`invention; and
`FIGS. 3, 4, 5, 6, 7, 8, and 9 shoW one embodiment ofthe
`present invention at various different stages of operation.
`
`DETAILED DESCRIPTION OF THE
`PRESENTLY PREFERRED EMBODIMENTS
`
`FIG. 1 is a schematic block diagram of one embodiment
`of an apparatus 10 in accordance With the present invention,
`comprising a UI objects database 12, a graphics library 14,
`a graphics generator 16, an externally supplied data means
`18, a content database 20, an interaction interpreter 22, an
`input device 24, and a user interface 26.
`The input device 24 is any means that can be employed by
`a user to enter commands to control the user interface 26 and
`can be any of a number of manual controllers, such as, for
`example, a hand-held remote control With a keypad for a
`television set-top box, a keyboard for a PC, a remote
`controlled computer mouse, or a control panel With a keypad
`for a microWave oven. When a user Wants to change a setting
`of the interface 26, the input device 24 is manipulated, such
`as by the depressing of keypad buttons, to transmit a signal
`to the interaction interpreter 22. Preferably, as Will become
`more apparent from the discussion beloW, the input device
`has directional keys (up, doWn, right, and left) and a “select”
`key Which a user can depress to provide a selection com
`mand. The input device 24 may instead and/or also comprise
`means for detecting and interpreting spoken commands of
`the user. A spoken command device Would for example,
`include a microphone, a data processor, a database contain
`ing vocabulary data, and speech recognition softWare to
`recognize voice commands of a user to the electronic device
`An interaction interpreter 22 interprets signals received
`from the input device 24 and sends the corresponding
`instruction to a graphics generator 16. The interaction inter
`preter 22 transforms commands from the input device 24 to
`actions provided by the graphics generator 16.
`The content database 20 contains information, and groups
`or folders of information Which can be presented on the user
`interface 26, Which is preferably a screen, such as a televi
`sion screen, monitor or ?at panel display, such as liquid
`crystal or a plasma display. Samples of such information
`could be, for example, names of object ?elds containing
`sub-object ?elds or ?nite objects and help-texts that are
`presented to a user upon entry by the use of the appropriate
`commands. An object ?eld is the name of a class or group
`of settings, sub-?elds of settings, or sub-sub-?elds of set
`tings, etc. An example of an object ?eld is the category or
`group, “Films”. A ?nite object is a direct setting of a feature
`for the electronic device. An example of a ?nite object is the
`particular ?lm, “Die Hard”. All material in the content
`database 20 can be altered and/or edited by a content
`provider, such as the original equipment manufacturer of the
`electronic device, or the service provider of material pre
`sented to the user and controlled through the user interface
`26. Such a service provider Would include a cable television
`company that transmits television programming, movies and
`other entertainment to a user. In addition, if desired, some or
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Page 12 of 16
`
`

`

`US 7,039,879 B2
`
`5
`all of the material in the content database may be altered
`and/or edited by the user. For example, a user may Want to
`delete certain television stations that are not of interest, the
`user may Want to rename folders, or the user may Want to
`add additional objects, folders, subfolders, etc. Such added
`material might include bookmarks or shortcuts to Web pages
`or locally stored content (such as folders, documents, video
`?les, music ?les, etc. on a memory hard drive), control
`settings to a connected device at the user’s location (such as
`a CD, DVD or video tape player/recorder), etc.
`Externally supplied data 18 represents any content that is
`in the content database 20 from any source.
`The UI objects database 12 contains types of graphical
`objects that can be presented on the user interface 26. The UI
`objects database 12 supplies a graphics library 14 With
`generic representations of the types of graphical objects. The
`graphics library 14 contains functions to manipulate the UI
`objects in the interface 26. The graphics library 14 supplies
`the graphics generator 16 With speci?c instances from the UI
`objects database 12.
`The graphic generator 16 controls the graphical presen
`tation of the user interface 26 as Well as manipulation
`accomplished by a user. The graphics generator 16 performs
`actions signaled by the interaction interpreter 22 through
`collecting content from the content database 20 and by
`merging the content With the graphics library 14 and deliv
`ering presentation of a desired action to the user interface 26.
`The user interface 26 presents feedback of any action
`performed by a user of the interface 26.
`FIG. 2 schematically illustrates a user interface 26 in
`accordance With one embodiment of the present invention.
`The user interface 26 has tWo intersecting bars, preferably,
`a vertical bar 32 and a horiZontal bar 34. The bars 32, 34 are
`preferably perpendicular to one another and are positioned
`proximate edges of the display area of the user interface 26
`so that obstruction by the bars is minimized of any back
`ground picture 36, such as a television program, graphics,
`etc. Although the bars 32, 34 are shoWn as being positioned
`proximate the left and bottom edges of the user interface,
`alternatively, they may be at any other location, such as free
`?oating at any location in the background picture 36, or may
`be positioned along adjacent edges of the user interface. In
`addition, although bars 32, 34 are shoWn as being linear in
`shape, they may assume any shape, such as, for example,
`curved into tWo circular or oval lines. Each of the bars 32,
`34 is comprised of a plurality of panels, With vertical bar
`comprising panels 54, 30, 42, 44, 46, 48 and 52, and With
`horiZontal bar comprising panels 51, 30, 41, 43, 45, 47 and
`49. Each bar 32, 34 may comprise more or feWer panels, as
`desired. The tWo bars, 32, 34 intersect With a common panel,
`focus panel 30. Although the panels are shoW as being
`substantially rectangular in shape, they may assume any
`shape, such as square, oval, round, hexagonal, etc. Each of
`the panels preferably has one or more areas on Which
`appears textual information and/or graphics. For example,
`each panel of the vertical bar 32 has a smaller upper area 62
`and a larger central area 60. Similarly, each panel of the
`horiZontal bar 34 has a smaller loWer area 62 and a larger
`central area 60. The focus panel 30, Which is the panel Where
`the vertical bar 32 and the horizontal bar 34 intersect,
`preferably has a larger central area 6011, a smaller loWer area
`62a, and a smaller upper area 62b. The areas 60, 60a, 62,
`62a, and 62b of the panels are used to display the textual
`information and/or graphics, as discussed beloW. The user
`interface 26 preferably also has an information ?eld 38
`positioned beloW the horiZontal bar 34 Where additional
`information can optionally be displayed. Finally, the user
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`interface 26 preferably displays a plurality of possible
`navigation commands, shoWn as up, doWn, left and right
`arroWs 55, 56, 57, 58 and a “Select” command 59. Although
`the navigation commands are shoWn as directed arroWs 55,
`56, 57, 58, they may also be depicted as Words or other
`pictures, such as pointing ?sts. The navigation and “Select”
`commands may be continuously displayed and highlighted
`When the user selects a particular command With the input
`device 24, or, alternatively, only displayed When a user
`actually selects that command. Although the command
`graphics 55, 56, 57, 58, 59 are shoW in the upper right ofthe
`user interface 26, they may be in any position. Preferably,
`the command graphics 55, 56, 57, 58, 59 are omitted entirely
`from the display at all times. HoWever, if the user interface
`is a mouse, the display command graphics, such as those
`shoWn, enable selection by the user of a command by
`clicking With the mouse’s pointer on the appropriate com
`mand graphic 55, 56, 57, 58, 59. Additional, ifthe display is
`a touch screen, command graphics may be displayed so that
`touching by the user of the appropriate graphic selects that
`command for execution.
`The various portions of the bars 32, 34, any text or
`graphics on the bars 32, 34, and the commands 55, 56, 57,
`58, 59, and are preferably suitably colored or shaded to
`contrast appropriately against the background picture 36 and
`other elements of the displayed information on the user
`interface 26 so that the user can easily discern all of the
`displayed information.
`In operation, a user initially activates the user interface
`feature of the electronic device by entering the appropriate
`command on the input device 24. Thereupon, the user
`interface 26 appears on the appropriate display on or asso
`ciated With the electronic device. For certain electronic
`devices Where information of interest is continuously
`shoWn, such as entertainment programming on a television
`monitor, for example, it is desirable that the user interface 26
`only appear When the user Wants to change a setting of the
`television. For other electronic devices Where the associated
`display does not provide any other information, such as, for
`example, a microWave oven, the user interface 26 might be
`continuously displayed.
`All possible instructions, settings and/or selections avail
`able to the user to adjust or set the electronic device are
`arranged in the content database 20 in one or more levels of
`groups (sub-groups, sub-sub-groups, etc.) so that settings,
`etc. of a similar nature are in the same group. The items of
`a ?rst level are very general. In a second level, the items are
`more detailed than in the ?rst level, but are still someWhat
`general. In a third level, the items are even more detailed
`than in the second level. And so on. The items are linked
`according to their contents. This means that an item of the
`?rst level is linked to one or more items of the second level.
`Additionally, an item of the second level is linked to one or
`more items of the third level. And so on. Thus, With this
`linking structure, the items are arranged in a tree-like
`manner or hierarchical structure With any branch of the tree
`constituting a further level. Since, as discussed above, the
`user and/or the service provider may alter and/or edit the
`groups shoW at the various levels, a folder in one particular
`level, for example, may have more or feWer sub-groups,
`sub-sub-groups, etc. than other folders in that same level.
`Additionally, it is also possible that the user and/or service
`provider may Want a particular ultimate selection or device
`command that is frequently used (and Which one might
`expect to be relegated only to a sub-sub-group) to be
`positioned With folders at the highest level, for example.
`
`Page 13 of 16
`
`

`

`US 7,039,879 B2
`
`7
`As discussed in detail below with reference to FIGS. 3 to
`9 in which a particular embodiment is shown, the user’s
`current location within the folder hierarchy is continuously
`displayed to the user in the horizontal bar 34. The focus
`panel 30 displays (1) the user’s currently selected lowest
`level in the hierarchy in area 6211 and (2) the next higher
`level, if any, in the area 62b. As the user descends into the
`folder hierarchy, the next higher level, if any, is shown in
`panel 41, the level above the level shown in panel 41 is
`shown in panel 43, and so on to the right across horizontal
`bar 34 until there are no further higher levels to display, at
`which point the remaining upper-most level folders are
`displayed in the panels on the horizontal bar 34. As the user
`descends down the folder hierarchy, the panels in the hori
`zontal bar 34 shift to the right and panels identifying levels
`between the current level and the top most level are dis
`played. As the user ascends through the folder hierarchy, the
`panels in the horizontal bar 34 shift to the left. To navigate
`up or down folder levels and to select a particular folder at
`any level, the user employs the input device 24 to activate
`“up”, “down”, “left”, “right” and “SELECT” commands
`which cause the bars 32, 34 to scroll in the selected
`direction, as indicated in FIG. 2) to cause a particular panel
`to be shifted into the focus panel 30. In the panels of the
`vertical bar 32 are sub-folders, if any, or individual settings,
`if any, that are within the folder appearing in area 6211 of
`focus panel 30, that is, such sub-folders or settings that are
`of the same level as the user’s current lowest level in the
`hierarchical structure appearing in area 62b of the focus
`panel 30.
`To more fully understand the present invention, one
`embodiment of the present invention is shown in operation
`in FIGS. 3 to 9, in which the numbering of the various
`elements has been simpli?ed relative to FIG. 2. In this
`particular embodiment, the electronic device is a television
`with a cable television set-top box and the user interface is
`used to select a particular entertainment program from
`among a plurality of possible entertainment programs. The
`present invention is not restricted to such an electronic
`device, and, as stated above can be used in conjunction with
`many other types of electronic devices.
`Referring initially to FIG. 3, horizontal bar 34 is com
`prised of six panels 51, 30, 41, 43, 45 and 47. In the lower
`areas 62 of the panels is text describing the name of the
`folder, group or ?eld represented by the respective panels.
`The horizontal panels depict folders of categories of possible
`entertainment programming available to the user. Although
`all of the panels show the generic titles, “Folder A”,
`“Folder”, etc., except panel 41 which reads “Film”, in actual
`operation the other panels would depict titles of other
`entertainment programming categories, such as, for
`example, “network television programming”, “music
`video”, “channel programming guide”, “intemet”, etc.
`Rather than or in addition to text, graphics may be depicted
`on the panels, such as, for example, a movie projector for
`“Film”, a television set for “network television program
`ming”, etc. The vertical bar 32 is comprised of seven panels
`54, 30, 42, 44, 46, 48 and 52. These vertical panels depict
`sub-groups, bookmarks or selections, if any, collected in the
`folder identi?ed in area 6211 of focus panel 30. Although all
`of these panels except panel 30 are blank in FIG. 3, in actual
`operation, each panel would display a title or graphic
`representative of its contents. The bars 32, 34 are positioned
`proximate edges of the display so that a great proportion of
`the current programming 36 is visible. Information ?eld 38
`is blank in FIG. 3, but in practice would display relevant
`information, such as the date and time, the status of the
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`8
`electrical device, error messages, a short help message, etc.
`which are associated with the folder or bookmark identi?ed
`in area 62b of focus panel 30.
`As shown in FIG. 3, the positioning of the bars 32, 34 is
`preferably selected so as to minimize obstruction of a
`background picture 36 that is being shown on the display. In
`FIGS. 4 to 9 the background picture 36 is omitted merely to
`simplify the Figures, although in practice the background
`picture, if any, would be displayed.
`In this example, the user wants to view a “Film”, the panel
`for which is to the right of focus panel 30. Consequently, the
`user uses the input device 24 to enter the “right” command
`once, as shown by the highlighted right arrow 58. The
`horizontal bar 34 shifts one position so that the focus panel
`30 now shows “Film” in area 6211, as shown in FIG. 4. The
`vertical bar now shows in