IPR No.: IPR2016-00500
`Patent No. 7,864,163
`
`EXHIBIT 1002
`
`

`
`Portable Electronic Device, Method, And Graphical User
`
`Interface For Displaying Structured Electronic Documents
`
`RELATED APPLICATIONS
`
`[0001]
`
`This application claims priority
`
`to U.S. Provisional Patent Application Nos.
`
`60/879,469, "Portable Multifunction Device,"
`
`filed January 8, 2007; 60/879,253, "Portable
`
`Multifunction Device,"
`
`filed January 7, 2007; and 60/824,769,
`
`"Portable Multifunction
`
`Device," filed September 6, 2006. All of these applications are incorporated by referenced
`
`herein in their entirety.
`
`[0002]
`
`This application
`
`is related
`
`to the following applications:
`
`(1) U.S. Patent
`
`Application No. 10/188,182, "Touch Pad For Handheld Device," filed July 1, 2002; (2) U.S.
`
`Patent Application No. 10/722,948, "Touch Pad For Handheld Device," filed November 25,
`
`2003; (3) U. S. Patent Application No. 10/643,256,
`
`"Movable Touch Pad With Added
`
`Functionality,"
`
`filed August
`
`18, 2003;
`
`(4) U.S. Patent Application No. 10/654,108,
`
`"Ambidextrous Mouse,"
`
`filed September
`
`2, 2003;
`
`(5) U.S. Patent Application No.
`
`10/840,862, "Multipoint Touchscreen,"
`
`filed May 6, 2004; (6) U.S. Patent Application No:
`
`10/903,964,
`
`"Gestures For Touch Sensitive
`
`Input Devices,"
`
`filed July 30,2004;
`
`(7) U.S.
`
`Patent Application No. 11/038,590,
`
`"Mode-Based Graphical User Interfaces For Touch
`
`Sensitive Input Devices" filed January 18, 2005; (8) U.S. Patent Application No. 11/057,050,
`
`"Display Actuator,"
`
`filed February 11, 2005; (9) U.S. Provisional Patent Application No.
`
`60/658,777,
`
`"Multi-Functional Hand-Held Device," filed March 4, 2005; (10) U.S. Patent
`
`Application No. 11/367,749, "Multi-Functional Hand-Held Device," filed March 3, 2006; and
`
`(11) U.S. Provisional Patent Application No.
`
`, (attorney docket number
`
`P4969USP1/63266-5109PR),
`
`"Portable Electronic Device, Method, And Graphical User
`
`Interface For Displaying
`
`Inline Multimedia Content",
`
`filed June __
`
`, 2007. All of these
`
`applications are incorporated by reference herein in their entirety.
`
`TECHNICAL FIELD
`
`[0003]
`
`The disclosed embodiments relate generally to portable electronic devices, and
`
`more particularly,
`
`to portable electronic devices that display structured electronic documents
`
`such as web pages on a touch screen display.
`
`P4974USP1, 63266-5114-PR
`
`1
`
`

`
`BACKGROUND
`
`[0004]
`
`As portable electronic devices become more compact, and the number of
`
`functions performed by a given device increase,
`
`it has become a significant challenge
`
`to
`
`design a user interface that allows users to easily interact with a multifunction device. This
`
`challenge
`
`is particular significant
`
`for handheld portable devices, which have much smaller
`
`screens
`
`than desktop or laptop computers. This situation
`
`is unfortunate because
`
`the user
`
`interface
`
`is the gateway through which users receive not only content but also responses
`
`to
`
`user actions or behaviors,
`
`including user attempts to access a device's
`
`features,
`
`tools, and
`
`functions. Some portable communication devices (e.g., mobile telephones, sometimes called
`
`mobile phones, cell phones, cellular telephones, and the like) have resorted to adding more
`
`pushbuttons,
`
`increasing the density of push buttons, overloading
`
`the functions of pushbuttons,
`
`or using complex menu systems to allow a user to access, store and manipulate data. These
`
`conventional user interfaces often result in complicated key sequences and menu hierarchies
`
`that must be memorized by the user.
`
`[0005]
`
`Many conventional
`
`user
`
`interfaces,
`
`such as those
`
`that
`
`include physical
`
`pushbuttons, are also inflexible. This is unfortunate because it may prevent a user interface
`
`from being configured and/or adapted by either an application running on the portable device
`
`or by users. When coupled with the time consuming requirement
`
`to memorize multiple key
`
`sequences and menu hierarchies, and the difficulty
`
`in activating a desired pushbutton, such
`
`inflexibility
`
`is frustrating to most users.
`
`[0006]
`
`In particular,
`
`it 1s slow and tedious
`
`to navigate m structured
`
`electronic
`
`documents
`
`(e.g., web pages) m portable
`
`electronic devices with small screens using
`
`conventional
`
`input devices (e.g., 5-way toggle switches). Moreover,
`
`it is cumbersome
`
`to
`
`control and view multimedia content within such documents on portable electronic devices.
`
`[0007]
`
`Accordingly,
`
`there
`
`is a need
`
`for portable electronic devices with more
`
`transparent and intuitive user interfaces
`
`for viewing and navigating
`
`structured electronic
`
`documents and multimedia
`
`content within such documents. Such interfaces
`
`increase
`
`the
`
`effectiveness, efficiency and user satisfaction with activities
`
`like web browsing on portable
`
`electronic devices.
`
`P4974USP1, 63266-5114-PR
`
`2
`
`

`
`SUMMARY
`
`[0008]
`
`The above deficiencies and other problems associated with user interfaces for
`
`portable devices are reduced or eliminated by the disclosed portable multifunction device. In
`
`some embodiments,
`
`the device has a touch-sensitive display ( also known as a "touch screen")
`
`with a graphical user interface
`
`(GUI), one or more processors, memory and one or more
`
`modules, programs or sets of instructions
`
`stored
`
`in the memory
`
`for performing multiple
`
`functions.
`
`In some embodiments,
`
`the user interacts with the GUI primarily
`
`through finger
`
`contacts and gestures on the touch-sensitive
`
`display. In some embodiments,
`
`the functions
`
`may include telephoning, video conferencing, e-mailing,
`
`instant messaging, blogging, digital
`
`photographing,
`
`digital videoing, web browsing, digital music playing, and/or digital video
`
`playing. Instructions
`
`for performing
`
`these functions may be included
`
`in a computer program
`
`product configured for execution by one or more processors.
`
`[0009]
`
`In one aspect of the invention, a computer-implemented method, for use in
`
`conjunction with a portable electronic device with a touch screen display, comprises:
`
`displaying at least a portion of a structured electronic document on the touch screen display,
`
`wherein the structured electronic document comprises a plurality of boxes of content;
`
`detecting a first gesture at a location on the displayed portion of the structured electronic
`
`document; determining a first box in the plurality of boxes at the location of the first gesture;
`
`and enlarging and substantially centering the first box on the touch screen display.
`
`[0010]
`
`In another aspect of the invention, a graphical user interface on a portable
`
`electronic device with a touch screen display comprises: at least a portion of a structured
`
`electronic document, wherein the structured electronic document comprises a plurality of
`
`boxes of content. In response to detecting a first gesture at a location on the portion of the
`
`structured electronic document, a first box in the plurality of boxes at the location of the first
`
`gesture is determined and the first box is enlarged and substantially centered on the touch
`
`screen display.
`
`[0011]
`
`In another aspect of the invention, a portable electronic device comprises: a
`
`touch screen display, one or more processors, memory, and one or more programs. The one
`
`or more programs are stored in the memory and configured
`
`to be executed by the one or more
`
`processors. The one or more programs include instructions for displaying at least a portion of
`
`a structured electronic document on the touch screen display, wherein the structured
`
`electronic document comprises a plurality of boxes of content. The one or more programs
`
`P4974USP1, 63266-5114-PR
`
`3
`
`

`
`also include: instructions for detecting a first gesture at a location on the displayed portion of
`
`the structured electronic document; instructions for determining a first box in the plurality of
`
`boxes at the location of the first gesture; and instructions for enlarging and substantially
`
`centering the first box on the touch screen display.
`
`[0012]
`
`In another aspect of the invention, a computer-program product comprises a
`
`computer readable storage medium and a computer program mechanism embedded therein.
`
`The computer program mechanism comprises instructions, which when executed by a
`
`portable electronic device with a touch screen display, cause the device: to display at least a
`
`portion of a structured electronic document on the touch screen display, wherein the
`
`structured electronic document comprises a plurality of boxes of content; to detect a first
`
`gesture at a location on the displayed portion of the structured electronic document; to
`
`determine a first box in the plurality of boxes at the location of the first gesture; and to
`
`enlarge and substantially center the first box on the touch screen display.
`
`[0013]
`
`In another aspect of the invention, a portable electronic device with a touch
`
`screen display comprises: means for displaying at least a portion of a structured electronic
`
`document on the touch screen display, wherein the structured electronic document comprises
`
`a plurality of boxes of content; means for detecting a first gesture at a location on the
`
`displayed portion of the structured electronic document; means for determining a first box in
`
`the plurality of boxes at the location of the first gesture; and means for enlarging and
`
`substantially centering the first box on the touch screen display.
`
`[0014]
`
`The disclosed embodiments
`
`allow users to more easily view and navigate
`
`structured electronic documents and multimedia content within such documents on portable
`
`electronic devices.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0015]
`
`For a better understanding
`
`of
`
`the aforementioned
`
`embodiments
`
`of
`
`the
`
`invention as well as additional embodiments
`
`thereof,
`
`reference
`
`should be made
`
`to the
`
`Description of Embodiments below, in conjunction with the following drawings in which like
`
`reference numerals refer to corresponding parts throughout the figures.
`
`[0016]
`
`Figures
`
`IA and
`
`lB are block diagrams
`
`illustrating portable multifunction
`
`devices with touch-sensitive displays in accordance with some embodiments.
`
`P4974USP1, 63266-5114-PR
`
`4
`
`

`
`[0017)
`
`Figure 2 illustrates a portable multifunction device having a touch screen in
`
`accordance with some embodiments.
`
`[0018]
`
`Figure 3 illustrates an exemplary user
`
`interface
`
`for unlocking
`
`a portable
`
`electronic device in accordance with some embodiments.
`
`[0019]
`
`Figures 4A and 4B
`
`illustrate
`
`exemplary user
`
`interfaces
`
`for a menu of
`
`applications on a portable multifunction device in accordance with some embodiments.
`
`[0020]
`
`Figures
`
`5A-5M
`
`illustrate
`
`exemplary
`
`user
`
`interfaces
`
`for a browser m
`
`accordance with some embodiments.
`
`[0021]
`
`Figures 6A-6C are
`
`flow diagrams
`
`illustrating
`
`a process
`
`for displaying
`
`structured electronic documents such as web pages on a portable electronic device with a
`
`touch screen display in accordance with some embodiments.
`
`[0022]
`
`Figures 7 A- 7F illustrate exemplary user interfaces
`
`for playing an item of
`
`inline multimedia content in accordance with some embodiments.
`
`[0023]
`
`Figure 8 is a flow diagram
`
`illustrating
`
`a process
`
`for displaying
`
`inline
`
`multimedia content on a portable electronic device with a touch screen display in accordance
`
`with some embodiments.
`
`DESCRIPTION OF EMBODIMENTS
`
`[0024]
`
`Reference will now be made in detail to embodiments, examples of which are
`
`illustrated
`
`in the accompanying drawings.
`
`In the following detailed description, numerous
`
`specific details are set forth in order to provide a thorough understanding of the present
`
`invention. However,
`
`it will be apparent
`
`to one of ordinary skill in the art that the present
`
`invention may be practiced without
`
`these specific details. In other instances, well-known
`
`methods, procedures, components, circuits, and networks have not been described in detail so
`
`as not to unnecessarily obscure aspects of the embodiments.
`
`[0025]
`
`It will also be understood
`
`that, although the terms first, second, etc. may be
`
`used herein to describe various elements, these elements should not be limited by these terms.
`
`These terms are only used to distinguish one element from another. For example, a first
`
`gesture could be termed a second gesture, and, similarly, a second gesture could be termed a
`
`first gesture, without departing from the scope of the present invention.
`
`P4974USP1, 63266-5114-PR
`
`5
`
`

`
`[0026]
`
`The terminology used in the description of the invention herein is for the
`
`purpose of describing particular embodiments only and is not intended to be limiting of the
`
`invention. As used in the description of the invention and the appended claims, the singular
`
`forms "a", "an" and "the" are intended to include the plural forms as well, unless the context
`
`clearly indicates otherwise.
`
`It will also be understood
`
`that the term "and/or" as used herein
`
`refers to and encompasses any and all possible combinations of one or more of the associated
`
`listed items.
`
`It will be further understood
`
`that the terms "comprises" and/or "comprising,"
`
`when used in this specification, specify the presence of stated features, integers, steps,
`
`operations, elements, and/or components, but do not preclude the presence or addition of one
`
`or more other features, integers, steps, operations, elements, components, and/or groups
`
`thereof.
`
`[0027]
`
`Embodiments
`
`of a portable multifunction
`
`device, user
`
`interfaces
`
`for such
`
`devices,
`
`and associated
`
`processes
`
`for using
`
`such devices
`
`are described.
`
`In some
`
`embodiments,
`
`the device is a portable communications device such as a mobile telephone that
`
`also contains other functions, such as PDA and/or music player functions.
`
`[0028]
`
`The user interface may include a physical click wheel in addition to a touch
`
`screen or a virtual click wheel displayed on the touch screen. A click wheel
`
`is a user(cid:173)
`
`interface device that may provide navigation commands based on an angular displacement of
`
`the wheel or a point of contact with the wheel by a user of the device. A click wheel may
`
`also be used to provide a user command corresponding
`
`to selection of one or more items, for
`
`example, when the user of the device presses down on at least a portion of the wheel or the
`
`center of the wheel. Alternatively, breaking contact with a click wheel image on a touch
`
`screen surface may indicate a user command corresponding
`
`to selection. For simplicity, in the
`
`discussion that follows, a portable multifunction device that includes a touch screen is used as
`
`an exemplary embodiment.
`
`It should be understood, however,
`
`that some of the user
`
`interfaces and associated processes may be applied
`
`to other devices, such as personal
`
`computers and laptop computers,
`
`that may include one or more other physical user-interface
`
`devices, such as a physical click wheel, a physical keyboard, a mouse and/or a joystick.
`
`[0029]
`
`The device supports a variety of applications, such as a telephone application,
`
`a video conferencing application, an e-mail application, an instant messaging application, a
`
`blogging application, a digital camera application, a digital video camera application, a web
`
`P4974USP1, 63266-5114-PR
`
`6
`
`

`
`browsing
`
`application,
`
`a digital music player application,
`
`and/or a digital video player
`
`application.
`
`[0030]
`
`The various applications
`
`that may be executed on the device may use at least
`
`one common physical user-interface device, such as the touch screen. One or more functions
`
`of the touch screen as well as corresponding
`
`information displayed on the device may be
`
`adjusted and/or varied from one application to the next and/or within a respective application.
`
`In this way, a common physical architecture
`
`(such as the touch screen) of the device may
`
`support the variety of applications with user interfaces that are intuitive and transparent.
`
`[0031]
`
`The user interfaces may include one or more soft keyboard embodiments. The
`
`soft keyboard
`
`embodiments may
`
`include
`
`standard
`
`(QWERTY)
`
`and/or non-standard
`
`configurations of symbols on the displayed icons of the keyboard, such as those described in
`
`U.S. Patent Applications 11/459,606, "Keyboards For Portable Electronic Devices," filed July
`
`24, 2006, and 11/459,615, "Touch Screen Keyboards For Portable Electronic Devices," filed
`
`July 24, 2006, the contents of which are hereby incorporated by reference. The keyboard
`
`embodiments may include a reduced number of icons ( or soft keys) relative to the number of
`
`keys in existing physical keyboards, such as that for a typewriter. This may make it easier for
`
`users to select one or more icons in the keyboard, and thus, one or more corresponding
`
`symbols. The keyboard embodiments may be adaptive. For example, displayed
`
`icons may
`
`be modified in accordance with user actions, such as selecting one or more icons and/or one
`
`or more corresponding symbols. One or more applications on the portable device may utilize
`
`common and/or different keyboard embodiments. Thus, the keyboard embodiment used may
`
`be tailored to at least some of the applications.
`
`In some embodiments, one or more keyboard
`
`embodiments may be tailored
`
`to a respective user. For example, one or more keyboard
`
`embodiments may be
`
`tailored
`
`to a respective
`
`user based on a word usage history
`
`(lexicography,
`
`slang,
`
`individual usage) of the respective user.
`
`Some of the keyboard
`
`embodiments may be adjusted to reduce a probability of a user error when selecting one or
`
`more icons, and thus one or more symbols, when using the soft keyboard embodiments.
`
`[0032]
`
`Attention is now directed towards embodiments of the device. Figures IA and
`
`IB are block diagrams
`
`illustrating portable multifunction devices 100 with touch-sensitive
`
`displays 112 in accordance with some embodiments. The touch-sensitive
`
`display 112 is
`
`sometimes called a "touch screen" for convenience, and may also be known as or called a
`
`touch-sensitive
`
`display system. The device 100 may include a memory 102 (which may
`
`P4974USP1, 63266-5114-PR
`
`7
`
`

`
`include one or more computer readable storage mediums), a memory controller 122, one or
`
`more processing units (CPU's) 120, a peripherals
`
`interface 118, RF circuitry 108, audio
`
`circuitry 110, a speaker 111, a microphone 113, an input/output
`
`(I/0) subsystem 106, other
`
`input or control devices 116, and an external port 124. The device 100 may include one or
`
`more optical
`
`sensors 164.
`
`These components may communicate
`
`over one or more
`
`communication buses or signal lines 103.
`
`[0033]
`
`It should be appreciated
`
`that the device 100 is only one example of a portable
`
`multifunction device 100, and that the device 100 may have more or fewer components
`
`than
`
`shown, may combine
`
`two or more components, or a may have a different configuration or
`
`arrangement of the components. The various components shown in Figures
`
`lA and lB may
`
`be implemented
`
`in hardware,
`
`software or a combination of both hardware and software,
`
`including one or more signal processing and/or application specific integrated circuits.
`
`[0034]
`
`Memory 102 may include high-speed
`
`random access memory and may also
`
`include non-volatile memory,
`
`such as one or more magnetic disk storage devices,
`
`flash
`
`memory devices, or other non-volatile solid-state memory devices. Access to memory 102 by
`
`other components of the device 100, such as the CPU 120 and the peripherals
`
`interface 118,
`
`may be controlled by the memory controller 122.
`
`[0035]
`
`The peripherals
`
`interface 118 couples the input and output peripherals of the
`
`device to the CPU 120 and memory 102. The one or more processors 120 run or execute
`
`various software programs and/or sets of instructions
`
`stored
`
`in memory 102 to perform
`
`various functions for the device 100 and to process data.
`
`[0036]
`
`In some embodiments,
`
`the peripherals
`
`interface 118, the CPU 120, and the
`
`memory controller 122 may be implemented on a single chip, such as a chip 104. In some
`
`other embodiments,
`
`they may be implemented on separate chips.
`
`[0037]
`
`The RF (radio frequency) circuitry 108 receives and sends RF signals, also
`
`called electromagnetic
`
`signals. The RF circuitry 108 converts electrical
`
`signals
`
`to/from
`
`electromagnetic
`
`signals
`
`and communicates with communications
`
`networks
`
`and other
`
`communications devices via the electromagnetic
`
`signals. The RF circuitry 108 may include
`
`well-known circuitry for performing
`
`these functions,
`
`including but not limited to an antenna
`
`system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital
`
`signal processor, a CODEC chipset, a subscriber
`
`identity module (SIM) card, memory, and so
`
`P4974USP1, 63266-5114-PR
`
`8
`
`

`
`forth. The RF circuitry 108 may communicate with networks, such as the Internet, also
`
`referred to as the World Wide Web (WWW), an intranet and/or a wireless network, such as a
`
`cellular telephone network, a wireless
`
`local area network (LAN) and/or a metropolitan area
`
`network (MAN), and other devices by wireless communication. The wireless communication
`
`may use any of a plurality of communications
`
`standards, protocols
`
`and technologies,
`
`including but not limited to Global System for Mobile Communications
`
`(GSM), Enhanced
`
`Data GSM Environment
`
`(EDGE), wideband code division multiple access (W-CDMA), code
`
`division multiple
`
`access
`
`(CDMA),
`
`time division multiple
`
`access
`
`(TDMA), Bluetooth,
`
`Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.1 la, IEEE 802.1 lb, IEEE 802.llg
`
`and/or IEEE
`
`802.lln), voice over Internet Protocol (VoIP), Wi-MAX, a protocol for email (e.g., Internet
`
`message access protocol (IMAP) and/or post office protocol (POP)), instant messaging (e.g.,
`
`extensible messaging and presence protocol (XMPP), Session Initiation Protocol for Instant
`
`Messaging and Presence Leveraging Extensions
`
`(SIMPLE), and/or Instant Messaging and
`
`Presence Service
`
`(IMPS)), and/or Short Message Service
`
`(SMS)), or any other suitable
`
`communication protocol,
`
`including communication protocols not yet developed as of the
`
`filing date of this document.
`
`[0038)
`
`The audio circuitry 110, the speaker 111, and the microphone 113 provide an
`
`audio interface between a user and the device 100. The audio circuitry 110 receives audio
`
`data from the peripherals
`
`interface 118, converts the audio data to an electrical signal, and
`
`transmits
`
`the electrical signal to the speaker 111. The speaker 111 converts the electrical
`
`signal to human-audible
`
`sound waves. The audio circuitry 110 also receives electrical signals
`
`converted by the microphone 113 from sound waves. The audio circuitry 110 converts the
`
`electrical signal to audio data and transmits the audio data to the peripherals
`
`interface 118 for
`
`processing. Audio data may be retrieved from and/or transmitted
`
`to memory 102 and/or the
`
`RF circuitry 108 by the peripherals
`
`interface 118. In some embodiments,
`
`the audio circuitry
`
`110 also includes a headset jack ( e.g. 212, Figure 2). The headset jack provides an interface
`
`between
`
`the audio circuitry 110 and removable audio
`
`input/output peripherals,
`
`such as
`
`output-only headphones or a headset with both output ( e.g., a headphone for one or both ears)
`
`and input (e.g., a microphone).
`
`[0039]
`
`The 1/0 subsystem 106 couples
`
`input/output peripherals on the device 100,
`
`such as the touch screen 112 and other input/control devices 116, to the peripherals
`
`interface
`
`118. The 1/0 subsystem 106 may include a display controller 156 and one or more input
`
`P4974USP1, 63266-5114-PR
`
`9
`
`

`
`controllers 160 for other input or control devices. The one or more input controllers 160
`
`receive/send
`
`electrical
`
`signals
`
`from/to other
`
`input or control devices 116. The other
`
`input/control devices 116 may include physical buttons (e.g., push buttons, rocker buttons,
`
`etc.), dials, slider switches,
`
`joysticks,
`
`click wheels,
`
`and so forth.
`
`In some alternate
`
`embodiments,
`
`input controller(s) 160 may be coupled to any (or none) of the following: a
`
`keyboard,
`
`infrared port, USB port, and a pointer device such as a mouse. The one or more
`
`buttons
`
`( e.g., 208, Figure 2) may include an up/down button for volume control of the
`
`speaker 111 and/or the microphone 113. The one or more buttons may include a push button
`
`( e.g., 206, Figure 2). A quick press of the push button may disengage a lock of the touch
`
`screen 112 or begin a process that uses gestures on the touch screen to unlock the device, as
`
`described
`
`in U.S. Patent Application
`
`11/322,549,
`
`"Unlocking
`
`a Device by Performing
`
`Gestures on an Unlock Image," filed December 23, 2005, which is hereby incorporated by
`
`reference. A longer press of the push button (e.g., 206) may tum power to the device 100 on
`
`or off. The user may be able to customize a functionality of one or more of the buttons. The
`
`touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.
`
`[0040]
`
`The touch-sensitive
`
`touch screen 112 provides an input interface and an output
`
`interface between
`
`the device and a user. The display controller 156 receives and/or sends
`
`electrical signals from/to the touch screen 112. The touch screen 112 displays visual output
`
`to the user. The visual output may include graphics, text, icons, video, and any combination
`
`thereof (collectively
`
`termed "graphics").
`
`In some embodiments,
`
`some or all of the visual
`
`output may correspond
`
`to user-interface objects, further details of which are described below.
`
`[0041]
`
`A touch screen 112 has a touch-sensitive
`
`surface, sensor or set of sensors that
`
`accepts input from the user based on haptic and/or tactile contact. The touch screen 112 and
`
`the display controller 156 ( along with any associated modules and/or sets of instructions
`
`in
`
`memory 102) detect contact ( and any movement or breaking of the contact) on the touch
`
`screen 112 and converts the detected contact into interaction with user-interface objects (e.g.,
`
`one or more soft keys, icons, web pages or images) that are displayed on the touch screen. In
`
`an exemplary embodiment,
`
`a point of contact between a touch screen 112 and the user
`
`corresponds
`
`to a finger of the user.
`
`[0042]
`
`The touch screen 112 may use LCD (liquid crystal display)
`
`technology, or
`
`LPD (light emitting polymer display) technology, although other display technologies may be
`
`used in other embodiments. The touch screen 112 and the display controller 156 may detect
`
`P4974USP1, 63266-5114-PR
`
`10
`
`

`
`contact and any movement or breaking
`
`thereof using any of a plurality of touch sensing
`
`technologies now known or later developed,
`
`including but not limited to capacitive, resistive,
`
`infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or
`
`other elements for determining one or more points of contact with a touch screen 112.
`
`[0043]
`
`A touch-sensitive display in some embodiments of the touch screen 112 may
`
`be analogous
`
`to the multi-touch
`
`sensitive
`
`tablets described
`
`in the following U.S. Patents:
`
`6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and/or 6,677,932 (Westerman),
`
`and/or U.S. Patent Publication 2002/0015024Al,
`
`each of which is hereby
`
`incorporated by
`
`reference. However, a touch screen 112 displays visual output from the portable device 100,
`
`whereas touch sensitive tablets do not provide visual output.
`
`[0044]
`
`A touch-sensitive display in some embodiments of the touch screen 112 may
`
`be as described
`
`in the following applications:
`
`(1) U.S. Patent Application No. 11/381,313,
`
`"Multipoint Touch Surface Controller,"
`
`filed May 2, 2006; (2) U.S. Patent Application No.
`
`10/840,862, "Multipoint Touchscreen,"
`
`filed May 6, 2004; (3) U.S. Patent Application No.
`
`10/903,964, "Gestures For Touch Sensitive Input Devices,"
`
`filed July 30, 2004; (4) U.S.
`
`Patent Application No. 11/048,264, "Gestures For Touch Sensitive
`
`Input Devices,"
`
`filed
`
`January 31, 2005; (5) U.S. Patent Application No. 11/038,590, "Mode-Based Graphical User
`
`Interfaces For Touch Sensitive
`
`Input Devices,"
`
`filed January 18, 2005; (6) U.S. Patent
`
`Application No. 11/228,758, "Virtual Input Device Placement On A Touch Screen User
`
`Interface," filed September 16, 2005; (7) U.S. Patent Application No. 11/228,700, "Operation
`
`Of A Computer With A Touch Screen Interface," filed September 16, 2005; (8) U.S. Patent
`
`Application No. 11/228,737,
`
`"Activating Virtual Keys Of A Touch-Screen Virtual
`
`Keyboard,"
`
`filed September 16, 2005; and (9) U.S. Patent Application No. 11/367,749,
`
`"Multi-Functional Hand-Held Device,"
`
`filed March 3, 2006. All of these applications are
`
`incorporated by reference herein.
`
`[0045]
`
`The touch screen 112 may have a resolution
`
`in excess of 100 dpi.
`
`In an
`
`exemplary embodiment,
`
`the touch screen has a resolution of approximately 160 dpi. The user
`
`may make contact with the touch screen 112 using any suitable object or appendage, such as
`
`a stylus, a finger, and so forth. In some embodiments,
`
`the user interface
`
`is designed to work
`
`primarily with finger-based contacts and gestures, which are much less precise than stylus(cid:173)
`
`based
`
`input due to the larger area of contact of a finger on the touch screen. In some
`
`P4974USP1, 63266-5114-PR
`
`11
`
`

`
`embodiments,
`
`the device translates the rough finger-based
`
`input into a precise pointer/cursor
`
`position or command for performing
`
`the actions desired by the user.
`
`[0046]
`
`In some embodiments,
`
`in addition to the touch screen, the device 100 may
`
`include a touchpad (not shown) for activating or deactivating particular functions.
`
`In some
`
`embodiments,
`
`the touchpad
`
`is a touch-sensitive
`
`area of the device that, unlike
`
`the touch
`
`screen, does not display visual output. The touchpad may be a touch-sensitive
`
`surface that is
`
`separate from the touch screen 112 or an extension of the touch-sensitive
`
`surface formed by
`
`the touch screen.
`
`[0047]
`
`In some embodiments,
`
`the device 100 may include a physical or virtual click
`
`wheel as an input control device 116. A user may navigate among and interact with one or
`
`more graphical objects (henceforth referred to as icons) displayed in the touch screen 112 by
`
`rotating the click wheel or by moving a point of contact with the click wheel ( e.g., where the
`
`amount of movement of the point of contact is measured by its angular displacement with
`
`respect to a center point of the click wheel). The click wheel may also be used to select one or
`
`more of the displayed icons. For example, the user may press down on at least a portion of
`
`the click wheel or an associated button. User commands and navigation commands provided
`
`by the user via the click wheel may be processed by an input controller 160 as well as one or
`
`more of the modules and/or sets of instructions
`
`in memory 102. For a virtual click wheel, the
`
`click wheel and click wheel controller may be part of the touch screen 112 and the display
`
`controller 156, respectively. For a virtual click wheel,
`
`the click wheel may be either an
`
`opaque or semitransparent object that appears and disappears on the touch screen display in
`
`response
`
`to user interaction with the device. In some embodiments, a virtual click wheel is
`
`displayed on the touch screen of a portable multifunction device and operated by user contact
`
`with the touch screen.
`
`[0048]
`
`The device 100 also includes a power system 162 for powering
`
`the various
`
`components. The power system 162 may include a power management system, one or more
`
`power sources ( e.g., battery, alternating current (AC)), a recharging system, a power failure
`
`detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting
`
`diode (LED)) and any other components associated with the generation, management and
`
`distribution of power in portable devices.
`
`[0049]
`
`The device 100 may also include one or more optical sensors 164. Figures IA
`
`and IB show an optical sensor coupled to an optical sensor controller 158 in 1/0 subsystem
`
`P4974USP1, 63266-5114-PR
`
`12
`
`

`
`106. The optical sensor 164 may include charge-coupled device (CCD) or complementary
`
`metal-oxide semiconductor
`
`(CMOS) phototransistors.
`
`The optical sensor 164 receives
`
`light
`
`from the environment, projected
`
`thro