PTO/AlA/14 (03-13)
`Approved for use through 01/31/2014. OMB 0651-0032
`US. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number
`I
`
`PMOROOBBA
`
`I—
`
`Application Data Sheet 37 CFR 1.76
`
`EFS Web 2.2.6
`
`Application Information:
`-
`-
`METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR NAVIGATING BETWEEN
`Title of the Invention
`VISUAL COMPONENTS
`Attorney DocketNumber Small Entity Status Claimed
`Application Type
`Nonprovisional
`
`.
`.
`Title of Invention
`
`METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR NAVIGATING BETWEEN VISUAL
`COMPONENTS
`
`The application data sheet is part of the provisional or nonprovisional application for which it is being submitted. The following form contains the
`bibliographic data arranged in a format specified by the United States Patent and Trademark Office as outlined in 37 CFR 1.76.
`This document may be completed electronically and submitted to the Office in electronic format using the Electronic Filing System (EFS) or the
`document may be printed and included in a paper filed application.
`
`
`Secrecy Order 37 CFR 5.2
`Portions or all of the application associated with this Application Data Sheet may fall under a Secrecy Order pursuant to
`El 37 CFR 5.2 (Paper filers only. Applications that fall under Secrecy Order may not be filed electronically.)
`
`Inventor Information:
`
`Inventor
`
`1
`
`Legal Name
`
`_-
`Residence Information (Select One) © us Residency 0 Non us Residency 0 Active us Military Service
`
`Raleigh Country of Residence I US State/Province
`
`
`Mailing Address of Inventor:
`
`Address 1
`
`712 Latta Street
`
`
`Address 2
`
`City
`
`Raliegh
`
`State/Province
`
`NC
`
`Inventor
`Inventors Must Be Listed - Additional
`All
`generated within this form by selecting the Add button.
`
`Information blocks may be
`
`Correspondence Information:
`
`Enter either Customer Number or complete the Correspondence Information section below.
`For further information see 37 CFR1.33(a).
`
`D An Address is being provided for the correspondence Information of this application.
`
`Customer Number
`
`92045
`
`EmailAddress
`
`pcaldwelI@thecaldwellfirm.com
`
`VVVVVV H
`
`V VVVVVVVV
`
`VVVVVVVVVV H
`
`V VVVVV
`
`IX
`
`Total Number of Drawing Sheets (if any) _ Suggested Figure for Publication (if any) -
`
`MICROSOFT CORP. EX. 1019
`Page 1 of 76
`
`

`

`PTO/AIA/14 (03-13)
`Approved for use through 01/31/2014. OMB 0651-0032
`U.S. Patent and Trademark Office; US. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`_
`_
`Application Data Sheet 37 CFR 1.76
`
`
`Attorney Docket Number
`PMOROOSSA
`_
`_
`Application Number
`
`.
`.
`Title of Invention
`
`METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR NAVIGATING BETWEEN VISUAL
`COMPONENTS
`
`Publication Information:
`
`|:| Request Early Publication (Fee required at time of Request 37 CFR 1.219)
`
`Request Not to Publish. I hereby request that the attached application not be published under
`35 U.S.C. 122(b) and certify that the invention disclosed in the attached application has not and will not be the
`subject of an application filed in another country, or under a multilateral international agreement, that requires
`
`publication at eighteen months after filing.
`
`Representative Information:
`
`Representative information should be provided for all practitioners having a power of attorney in the application. Providing
`this information in the Application Data Sheet does not constitute a power of attorney in the application (see 37 CFR 1.32).
`Either enter Customer Number or complete the Representative Name section below. If both sections are completed the customer
`Number will be used for the Representative Information during processing.
`
`0 US Patent Practitioner 0 Limited Recognition (37 CFR 11.9)
`6) Customer Number
`Please Select One:
`Customer Number
`
`Domestic Benefit/National Stage Information:
`This section allows for the applicant to either claim benefit under 35 U.S.C. 119(e), 120, 121, or 365(0) or indicate
`National Stage entry from a PCT application. Providing this information in the application data sheet constitutes the
`specific reference required by 35 U.S.C. 119(9) or 120, and 37 CFR 1.78.
`
`Prior Application Status
`
`Pending
`
`Application Number
`Continuity Type
`Prior Application Number
`Filing Date (YYYY-MM-DD)
`Continuation in part of 2010-08-26 12868767
`
`
`
`
`
`EFS Web 2.2.6
`
`2010-11-30
`
`Prior Application Status
`
`Pending
`
`Continuation in part of
`
`12955993
`
`Additional Domestic Benef't/National Stage Data may be generated within this form
`by selecting the Add button.
`
`Foreign Priority Information:
`
`MICROSOFT CORP. EX. 1019
`Page 2 of 76
`
`

`

`PTO/AIA/14 (03-13)
`Approved for use through 01/31/2014. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`_
`_
`Application Data Sheet 37 CFR 1.76
`
`
`Attorney Docket Number
`PMOR0088A
`_
`_
`Application Number
`
`.
`.
`Title of Invention
`
`METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR NAVIGATING BETWEEN VISUAL
`COMPONENTS
`
`This section allows for the applicant to claim priority to a foreign application. Providing this information in the application data sheet
`
`
`
`Application Number
`
`Additional Foreign Priority Data may be generated Within this form by selecting the
`Add button.
`
`constitutes the claim for priority as required by 35 U.S.C. 119(b) and 37 CFR 1.5_5(d). When priority is claimed to a foreign application
`that is eligible for retrieval under the priority document exchange program (PDX)' the information will be used by the Office to
`automatically attempt retrieval pursuant to 37 CFR 1.55(h)(1) and (2). Under the PDX program, applicant bears the ultimate
`responsibility for ensuring that a copy of the foreign application is received by the Office from the participating foreign intellectual
`property office, or a certified copy of the foreign priority application is filed, within the time period specified in 37 CFR 1.55(g)(1).
`
`EFS Web 2.2.6
`
`Statement under 37 CFR 1.55 or 1.78 for AIA (First Inventor to File) Transition
`Applications
`
`|:|
`
`This application (1) claims priority to or the benefit of an application filed before March 16, 2013 and (2) also
`contains, or contained at any time, a claim to a claimed invention that has an effective filing date on or after March
`16, 2013.
`
`Authorization to Permit Access:
`
`|:| Authorization to Permit Access to the Instant Application by the Participating Offices
`
`|f checked, the undersigned hereby grants the USPTO authority to provide the European Patent Office (EPO),
`the Japan Patent Office (JPO), the Korean Intellectual Property Office (KIPO), the World Intellectual Property Office (WIPO),
`and any other intellectual property offices in which a foreign application claiming priority to the instant patent application
`is filed access to the instant patent application. See 37 CFR 1.14(c) and (h). This box should not be checked if the applicant
`does not wish the EPO, JPO, KIPO, WIPO, or other intellectual property office in which a foreign application claiming priority
`to the instant patent application is filed to have access to the instant patent application.
`
`In accordance with 37 CFR 1.14(h)(3), access will be provided to a copy of the instant patent application with respect
`to: 1) the instant patent application—as—filed; 2) any foreign application to which the instant patent application
`claims priority under 35 U.S.C. 119(a)—(d) if a copy of the foreign application that satisfies the certified copy requirement of
`37 CFR 1.55 has been filed in the instant patent application; and 3) any US. application—as—filed from which benefit is
`sought in the instant patent application.
`
`In accordance with 37 CFR 1.14(c), access may be provided to information concerning the date 0 ffiling this Authorization.
`
`MICROSOFT CORP. EX. 1019
`Page 3 of 76
`
`

`

`PTO/AIA/14 (03-13)
`Approved for use through 01/31/2014. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`_
`_
`Application Data Sheet 37 CFR 1.76
`
`
`Attorney Docket Number
`PMOROOSSA
`_
`_
`Application Number
`
`METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR NAVIGATING BETWEEN VISUAL
`.
`.
`COMPONENTS
`Title of Invention
`
`
`Applicant Information:
`
`Providing assignment information in this section does not substitute for compliance with any requirement of part 3 of Title 37 of CFR
`to have an assignment recorded by the Office.
`
`O Assignee
`
`0 Legal Representative under 35 U.S.C. 117
`
`0 Joint Inventor
`
`
`
`0 Person to whom the inventor is obligated to assign. 0 Person who shows sufficient proprietary interest
`
`If applicant is the legal representative, indicate the authority to file the patent application, the inventor is:
`
` Name of the Deceased or Legally Incapacitated Inventor:
`
`If the Applicant is an Organization check here.
`D
`
`Mailing Address Information For Applicant:
`
`
`
`State/Province
`
`Postal Code
`
`Fax Number
`
`1
`Applicant
`If the applicant is the inventor (or the remaining joint inventor or inventors under 37 CFR 1.45), this section should not be completed.
`The information to be provided in this section is the name and address of the legal representative who is the applicant under 37 CFR
`1.43; or the name and address of the assignee, person to whom the inventor is under an obligation to assign the invention, or person
`who othen/vise shows sufficient proprietary interest in the matter who is the applicant under 37 CFR 1.46. If the applicant is an
`applicant under 37 CFR 1.46 (assignee, person to whom the inventor is obligated to assign, or person who othenNise shows sufficient
`proprietary interest) together with one or more joint inventors, then the joint inventor or inventors who are also the applicant should be
`identified in this section.
`
`
`EFS Web 2.2.6
`
`Phone Number
`
`Email Address
`
`Additional Applicant Data may be generated within this form by selecting the Add button.
`
`Non-Applicant Assignee Information:
`
`Providing assignment information in this section does not subsitute for compliance with any requirement of part 3 of Title 37 of CFR to
`have an assignment recorded by the Office.
`
`MICROSOFT CORP. EX. 1019
`Page 4 of 76
`
`

`

`PTO/AIA/14 (03-13)
`Approved for use through 01/31/2014. OMB 0651-0032
`U.S. Patent and Trademark Office; US. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Application Data Sheet 37 CFR 1.76
`
`Attorney Docket Number PMOROOSSA
`
`_
`_
`Application Number
`
`METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR NAVIGATING BETWEEN VISUAL
`.
`.
`COMPONENTS
`Title of Invention
`
`
`1
`Assignee
`
`
`Complete this section only if non-applicant assignee information is desired to be included on the patent application publication in
`accordance with 37 CFR 1.215(b). Do not include in this section an applicant under 37 CFR 1.46 (assignee, person to whom the
`inventor is obligated to assign, or person who othenivise shows sufficient proprietary interest), as the patent application publication will
`include the name of the applicant(s).
`
`If the Assignee is an Organization check here.
`
`Organization Name
`
`SITTING MAN, LLC
`
`Mailing Address Information For Non-Applicant Assignee:
`
`Address 1
`
`Address 2
`
`712 Latta St.
`
`
`Raleigh
`State/Province
`Postal Code
`
`US
`
`Additional Assignee Data may be generated within this form by selecting the Add button.
`
`Signature:
`
`NOTE: This form must be signed in accordance with 37 CFR 1.33. See 37 CFR 1.4 for signature requirements and
`certifications.
`
`
`
`Signature
`
`/Patrick E. Caldwell/
`
`First Name
`
`Last Name
`
`Caldwell
`
`EFS Web 2.2.6
`
`This collection of information is required by 37 CFR 1.76. The information is required to obtain or retain a benefit by the public which
`is to file (and by the USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This
`collection is estimated to take 23 minutes to complete, including gathering, preparing, and submitting the completed application data
`sheet form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you require to
`complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, US Patent and
`Trademark Office, US. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313—1450. DO NOT SEND FEES OR
`COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`
`
`
`
`Date (YYYY-MM-DD)
`
`2014-02-05
`
`Registration Number
`
`Additional Signature may be generated within this form by selecting the Add button.
`
`MICROSOFT CORP. EX. 1019
`Page 5 of 76
`
`

`

`a83859:0
`
`Cezamxm
`
`Eo._n_\o._.
`
`x5262
`
`{0sz
`
`89:95
`
`a$5mc<
`
`#556ng
`
`Emccooow
`
`a$805;
`
`ccmwarms:EEO
`
`flmEBm>mgsw
`
`8252694
`
`NA
`
`9:980
`
`
`
`o|N|_\899$
`
`383mm59:
`
`moSmQ:55
`
`o:Loam?
`
`59:0
`
`83mm
`
`a5:63
`
`-cQBEHmE
`
`9.6809;
`
`fl:5
`
`3%60631
`
`a29:92
`
`
`
`a.6252Do:_m:t_>
`
`NHEmEcoL_>cm_
`
`fl8026038
`
`MICROSOFT CORP. EX. 1019
`Page 6 of 76
`
`

`

`in a first application region of a presentation space of a
`Detect,
`display device, a first visual component, of a first operating
`application in a plurality of operating applications
`
`Present a first navigation control, in a first navigation region
`determined based on the first application region, for navigating to a
`second visual component, of a second application in the plurality, in a
`second application region in the presentation space
`
`to navigate to the second visual component
`
`Detect a user input corresponding to the first navigation control
`
`Send, in response to detecting the user input, navigation information
`
`MICROSOFT CORP. EX. 1019
`Page 7 of 76
`
`

`

`Navigation
`Element Handler
`
`fl
`
`Director fl
`
`.
`PS Monitor fl
`
`Application
`Navigator &
`
`Navigation
`
`MICROSOFT CORP. EX. 1019
`Page 8 of 76
`
`

`

`Execution Environment 401 a
`
`Graphics Subsystem
`439a
`
`GUI Subsystem
`
`437a
`—
`
`gill;
`
`441a
`
`Presentation Controller 435a
`
`Navigation
`Element
`
`Application 403a
`
`Ul Element
`
`Handler
`4338
`
`—
`
`Network Stack 411a
`
`Handler406a .
`
`Navigation
`Director 408a
`
`Application
`Navigator 404a
`
`I
`PS Monitor 4023
`
`Application Protocol Component 413
`
`a
`
`MICROSOFT CORP. EX. 1019
`Page 9 of 76
`
`

`

`Execution Environment 4 1b
`
`Graphics Subsystem
`439b
`
`GUI Subsystem
`437b
`
`Input
`Driver
`441 b
`
`Presentation Controller 4 5b
`
`Network Stack 411b
`
`Navigation
`Element Handler
`406b
`
`Ul element
`handler
`433b
`
`Navigation
`Director
`408b
`
`Content
`Handler
`431 b
`
`5 Network Application
`Agent 405b
`
`Application
`
`Navigator 404b
`
`PS Monitor M
`
`Content Manager
`415b
`
`Application Protocol Component 413b
`
`MICROSOFT CORP. EX. 1019
`Page 10 of 76
`
`

`

`Graphics Subsystem 439C
`
`GUI Subsystem M
`
`I
`PS Monitor M
`
`Application
`Navigator M
`
`Navigation
`Director
`
`M
`
`Navigation
`Element Handler
`
`M
`
`Execution Environment fl
`
`Input Driver
`441C
`
`Network Stack 411C
`
`Presentation Controller
`435c1
`
`First Application 403—1 0
`
`Presentation Controller
`43502
`
`Second Application 403-20
`
`Ul Element
`Handler
`43301
`
`U| Element
`Handler
`
`433C2
`
`Application Protocol Component 4130
`
`MICROSOFT CORP. EX. 1019
`Page 11 of 76
`
`

`

`Network Stack 411d
`
`Application Protocol Component 413d
`
`Network Application Platform
`
`4 9d
`
`Controller m
`
`View Subsystem 42 d
`
`Navigation
`Director
`408d
`
`PS Monitor 402d
`
`Application
`Navigator M
`
`Model Subsystem 419d
`
`Network Application 40 d
`
`Execution Environment 4 1d
`
`Navigation
`Element
`Handler m
`
`Template Engine
`423d
`
`Template
`Database 42 d
`
`Model Database
`421 d
`
`MICROSOFT CORP. EX. 1019
`Page 12 of 76
`
`

`

`User Node
`
`&
`
`fl
`
`Application
`Provider Node
`
`MICROSOFT CORP. EX. 1019
`Page 13 of 76
`
`

`

`FirstApp
`
`Third App
`
`Second App 604—28
`
`OpA OpB
`
`OpN
`
`606-23
`
`Display Presentation Space 602a
`
`/
`
`//
`
`/
`
`// 614-23
`
`/616—3a
`
`/ 616—23
`6161a /
`-
`/
`
`610-23
`
`MICROSOFT CORP. EX. 1019
`Page 14 of 76
`
`

`

`First App 604-1
`
`b
`
`File
`
`Edit View
`
`Bookmarks
`
`Tools
`
`Help
`
`608-1b
`
`Location Http://mysite.OoOT.com
`
`609-1 b
`
`Display Presentation Space 602b
`
`/614-’|b
`
`Second App 604-2b
`——
`
`Application Presentation Space 610-1b
`
`MICROSOFT CORP. EX. 1019
`Page 15 of 76
`
`

`

`Display Presentation Space 6020
`
`// 614—1 0
`
`First App 604-10
`
`File
`
`Edit View
`
`+ First App
`- Second App
`|-Main
`|
`|- Tab 1
`I
`|_ Tabz
`- Third App
`
`Tools
`
`Help
`
`608-1
`
`0
`
`609- c
`
`Application Presentation Space 610-10
`
`Bookmarks
`.
`.
`Location Http://mysrte.OoOT.com
`
`Application Presentation Space 610-20
`
`MICROSOFT CORP. EX. 1019
`Page 16 of 76
`
`

`

`Display Presentation Space 02d
`
`Second App 604-2d
`
`+ First App
`- Second App
`|
`- Main
`|
`|- Tab 1
`|
`|- Tab 2
`
`- Third App
`
`MICROSOFT CORP. EX. 1019
`Page 17 of 76
`
`

`

`Display Presentation Space 602e
`
`Second App 604-2e
`
`First App 604-1e
`
`File
`
`Edit View
`
`Bookmarks
`
`Tools
`
`Location Http://mysite.OoOT.com
`
`Help
`
`Active Apps
`
`/
`
`/
`
`/ Second App -
`Third App
`Main App
`
`MICROSOFT CORP. EX. 1019
`Page 18 of 76
`
`

`

`RELATED APPLICATIONS
`
`[0001] The present application is a continuation-in-part of, and claims priority to US.
`
`Patent Application No. 12/868,767,
`
`titled “METHODS, SYSTEMS, AND COMPUTER
`
`PROGRAM PRODUCTS FOR NAVIGATING BETWEEN VISUAL COMPONENTS,”
`
`filed on 08/26/2010, US. Patent Application No. 12/956,008,
`
`titled “METHODS,
`
`SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR BINDING ATTRIBUTES
`
`BETWEEN VISUAL COMPONENTS,” filed on 11/30/2010, and US. Patent Application
`
`No.
`
`12/955,993,
`
`titled
`
`“METHODS, SYSTEMS, AND COMPUTER PROGRAM
`
`PRODUCTS FOR AUTOMATICALLY SCROLLING ITEMS
`
`IN A SELECTION
`
`CONTROL,” filed on 11/30/2010, all of which are incorporated herein by reference in
`
`their entirety for all purposes.
`
`BACKGROUND
`
`METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR
`NAVIGATING BETWEEN VISUAL COMPONENTS
`
`is
`
`[0001] Cluttered desktops on desktop, notebook, and handheld devices are common.
`
`Navigating among visual components of various applications requires locating a desired
`
`visual component
`
`in the clutter and/or interoperating with a standard user interface
`
`element such as a task bar and/or application menu of a desktop that remains in a
`
`single location and requires the same types of inputs and user movements for each
`
`application and/or visual component to be located. This may require a user to repeat a
`
`similar and/or same set of movements over and over. Further, a task bar or other
`
`standard application navigation user interface may be located in a location that
`
`MICROSOFT CORP. EX. 1019
`Page 19 of 76
`
`

`

`lot of input overhead in cases where switching between applications is frequent. Input to
`
`bring an application into focus is essentially non-productive input, as it is not related to
`
`any of the tasks performed by the applications a user is interacting with.
`
`[0002] Accordingly, there exists a need for methods, systems, and computer program
`
`products for navigating between visual components.
`
`SUMMARY
`
`convenient for some applications but inconvenient for others for a user. This creates a
`
`application in the plurality, in a second application region in the presentation space. The
`
`[0003] The following presents a simplified summary of
`
`the disclosure in order to
`
`provide a basic understanding to the reader. This summary is not an extensive overview
`
`of
`
`the disclosure and it does not
`
`identify key/critical elements of the invention or
`
`delineate the scope of the invention.
`
`Its sole purpose is to present some concepts
`
`disclosed herein in a simplified form as a prelude to the more detailed description that is
`
`presented later.
`
`[0004] Methods and systems are described for navigating between visual components.
`
`In one aspect,
`
`the method includes detecting,
`
`in a first application region of a
`
`presentation space of a display device, a first visual component of a first operating
`
`application in a plurality of operating applications. The method further
`
`includes
`
`presenting a first navigation control, in a first navigation region determined based on the
`
`first application region,
`
`for navigating to a second visual component, of a second
`
`MICROSOFT CORP. EX. 1019
`Page 20 of 76
`
`

`

`[0005] Further, a system for navigating between visual components is described. The
`
`system includes a presentation space monitor component, an application navigator
`
`component, a navigation element handler component, and a navigation director
`
`component adapted for operation in an execution environment. The system includes the
`
`presentation space monitor component configured for detecting,
`
`in a first application
`
`region of a presentation space of a display device, a first visual component of a first
`
`operating application in a plurality of operating applications. The system further includes
`
`the application navigator component configured for presenting a first navigation control,
`
`in a first navigation region determined based on the first application region,
`
`for
`
`navigating to a second visual component, of a second application in the plurality,
`
`in a
`
`second application region in the presentation space. The system still further includes
`
`the navigation element handler component configured for detecting a user input
`
`corresponding to the first navigation control. The system additionally includes the
`
`input, navigation information to navigate to the second visual component.
`
`method still further includes detecting a user input corresponding to the first navigation
`
`control. The method additionally includes sending,
`
`in response to detecting the user
`
`input, navigation information to navigate to the second visual component.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`navigation director component configured for sending, in response to detecting the user
`
`MICROSOFT CORP. EX. 1019
`Page 21 of 76
`
`

`

`[0006] Objects and advantages of the present invention will become apparent to those
`
`skilled in the art upon reading this description in conjunction with the accompanying
`
`drawings,
`
`in which like reference numerals have been used to designate like or
`
`analogous elements, and in which:
`
`[0007] Fig.
`
`1
`
`is a block diagram illustrating an exemplary hardware device included in
`
`and/or otherwise providing an execution environment in which the subject matter may
`
`be implemented;
`
`[0008] Fig. 2 is a flow diagram illustrating a method for navigating between visual
`
`components according to an aspect of the subject matter described herein;
`
`[0009] Fig. 3 is a block diagram illustrating an arrangement of components for
`
`matter described herein;
`
`navigating between visual components according to another aspect of
`
`the subject
`
`matter described herein;
`
`[0010] Fig. 4a is a block diagram illustrating an arrangement of components for
`
`navigating between visual components according to another aspect of
`
`the subject
`
`matter described herein;
`
`[0011] Fig. 4b is a block diagram illustrating an arrangement of components for
`
`navigating between visual components according to another aspect of
`
`the subject
`
`MICROSOFT CORP. EX. 1019
`Page 22 of 76
`
`

`

`navigating between visual components according to another aspect of
`
`the subject
`
`matter described herein;
`
`[0013] Fig. 4d is a block diagram illustrating an arrangement of components for
`
`navigating between visual components according to another aspect of
`
`the subject
`
`matter described herein;
`
`[0014] Fig. 5 is a network diagram illustrating an exemplary system for navigating
`
`between visual components according to another aspect of the subject matter described
`
`herein;
`
`[0012] Fig. 4c is a block diagram illustrating an arrangement of components for
`
`according to another aspect of the subject matter described herein.
`
`[0015] Fig. 6a is a diagram illustrating a user interface presented
`
`according to another aspect of the subject matter described herein;
`
`[0016] Fig. 6b is a diagram illustrating a user interface presented
`
`according to another aspect of the subject matter described herein;
`
`[0017] Fig. 60 is a diagram illustrating a user interface presented
`
`according to another aspect of the subject matter described herein;
`
`[0018] Fig. 6d is a diagram illustrating a user interface presented
`
`according to another aspect of the subject matter described herein; and
`
`[0019] Fig. Be is a diagram illustrating a user interface presented
`
`MICROSOFT CORP. EX. 1019
`Page 23 of 76
`
`

`

`DETAILED DESCRIPTION
`
`[0020] One or more aspects of the disclosure are described with reference to the
`
`drawings, wherein like reference numerals are generally utilized to refer to like elements
`
`throughout, and wherein the various structures are not necessarily drawn to scale.
`
`In
`
`the following description, for purposes of explanation, numerous specific details are set
`
`forth in order to provide a thorough understanding of one or more aspects of the
`
`disclosure. It may be evident, however, to one skilled in the art that one or more aspects
`
`of the disclosure may be practiced with a lesser degree of these specific details. In other
`
`instances, well-known structures and devices are shown in block diagram form in order
`
`to facilitate describing one or more aspects of the disclosure.
`
`[0021] An exemplary device included in an execution environment
`
`that may be
`
`configured according to the subject matter
`
`is
`
`illustrated in Fig.
`
`1. An execution
`
`devices, multiprocessor devices, distributed devices, consumer electronic devices,
`
`environment includes an arrangement of hardware and, optionally, software that may be
`
`further configured to include an arrangement of components for performing a method of
`
`the subject matter described herein. An execution environment
`
`includes and/or is
`
`othenNise provided by one or more devices. An execution environment may include a
`
`virtual execution environment
`
`including software components operating in a host
`
`execution environment. Exemplary devices included in or othenNise providing suitable
`
`execution environments for configuring according to the subject matter include personal
`
`computers, notebook computers, tablet computers, servers, handheld and other mobile
`
`MICROSOFT CORP. EX. 1019
`Page 24 of 76
`
`

`

`routers, communication servers, and/or other network-enabled devices. Those skilled in
`
`the art will understand that the components illustrated in Fig.
`
`1 are exemplary and may
`
`vary by particular execution environment.
`
`[0022] Fig.
`
`1
`
`illustrates hardware device 100 included in execution environment 102.
`
`Fig.
`
`1
`
`illustrates that execution environment 102 includes instruction-processing unit
`
`(IPU) 104, such as one or more microprocessors; physical processor memory 106
`
`including storage locations identified by addresses in a physical memory address space
`
`of IPU 104; persistent secondary storage 108, such as one or more hard drives and/or
`
`terms “IPU” and “processor” are used interchangeably. IPU 104 may access machine
`
`flash storage media; input device adapter 110, such as a key or keypad hardware, a
`
`keyboard adapter, and/or a mouse adapter; output device adapter 112, such as a
`
`display or audio adapter for presenting information to a user; a network interface
`
`component,
`
`illustrated by network interface adapter 114,
`
`for communicating via a
`
`network such as a LAN and/or WAN; and a communication mechanism that couples
`
`elements 104-114,
`
`illustrated as bus 116. Elements 104-114 may be operativer
`
`coupled by various means. Bus 116 may comprise any type of bus architecture,
`
`including a memory bus, a peripheral bus, a local bus, and/or a switching fabric.
`
`[0023]
`
`IPU 104 is an instruction execution machine, apparatus, or device. Exemplary
`
`lPUs include one or more microprocessors, digital signal processors (DSPs), graphics
`
`processing
`
`units,
`
`application-specific
`
`integrated
`
`circuits
`
`(ASICs),
`
`and/or
`
`field
`
`programmable gate arrays (FPGAs).
`
`In the description of the subject matter herein, the
`
`MICROSOFT CORP. EX. 1019
`Page 25 of 76
`
`

`

`code instructions and data via one or more memory address spaces in addition to the
`
`physical memory address space. A memory address space includes addresses
`
`identifying locations in a processor memory. The addresses in a memory address space
`
`are included in defining a processor memory.
`
`IPU 104 may have more than one
`
`processor memory. Thus, IPU 104 may have more than one memory address space.
`
`IPU 104 may access a location in a processor memory by processing an address
`
`identifying the location. The processed address may be in an operand of a machine
`
`code instruction and/or may be identified in a register or other portion of IPU 104.
`
`[0024] Fig. 1 illustrates virtual processor memory 118 spanning at least part of physical
`
`processor memory 106 and at least part of persistent secondary storage 108. Virtual
`
`memory addresses in a memory address space may be mapped to physical memory
`
`synchronous DRAM (DDR SDRAM), error correcting code synchronous DRAM (ECC
`
`addresses identifying locations in physical processor memory 106. An address space
`
`for identifying locations in a virtual processor memory is referred to as a virtual memory
`
`address space;
`
`its addresses are referred to as virtual memory addresses; and its
`
`processor memory is known as a virtual processor memory or virtual memory. The term
`
`“processor memory” may refer to physical processor memory 106 and/or virtual
`
`processor memory 118 depending on the context in which the term is used.
`
`[0025] Physical processor memory 106 may include various types of memory
`
`technologies. Exemplary memory technologies include static random access memory
`
`(SRAM) and/or dynamic RAM (DRAM)
`
`including variants such as dual data rate
`
`MICROSOFT CORP. EX. 1019
`Page 26 of 76
`
`

`

`SDRAM), and/or RAMBUS DRAM (RDRAM). Physical processor memory 106 may
`
`include volatile memory as illustrated in the previous sentence and/or may include
`
`nonvolatile memory such as nonvolatile flash RAM (NVRAM) and/or ROM.
`
`[0026] Persistent secondary storage 108 may include one or more flash memory
`
`storage devices, one or more hard disk drives, one or more magnetic disk drives, and/or
`
`one or more optical disk drives. Persistent secondary storage may include removable
`
`media. The drives and their associated computer-readable storage media provide
`
`volatile and/or nonvolatile storage for computer-readable instructions, data structures,
`
`program components, and other data for execution environment 102.
`
`locations accessed by lPU 104 in a second address space. The first software
`
`first address space and a second software component may be stored in one or more
`
`[0027] Execution environment 102 may include software components stored in
`
`persistent secondary storage 108, in remote storage accessible via a network, and/or in
`
`a processor memory. Fig.
`
`1
`
`illustrates execution environment 102 including operating
`
`system 120, one or more applications 122, and other program code and/or data
`
`components illustrated by other libraries and subsystems 124.
`
`In an aspect, some or all
`
`software components may be stored in locations accessible to lPU 104 in a shared
`
`memory address space shared by the software components. The software components
`
`accessed via the shared memory address space are stored in a shared processor
`
`memory defined by the shared memory address space.
`
`In another aspect, a first
`
`software component may be stored in one or more locations accessed by IPU 104 in a
`
`MICROSOFT CORP. EX. 1019
`Page 27 of 76
`
`

`

`component is stored in a first processor memory defined by the first address space and
`
`the second software component is stored in a second processor memory defined by the
`
`second address space.
`
`[0028] Software components typically include instructions executed by IPU 104 in a
`
`computing context referred to as a “process”. A process may include one or more
`
`“threads”. A “thread” includes a sequence of instructions executed by IPU 104 in a
`
`computing sub-context of a process. The terms “thread” and “process” may be used
`
`interchangeably herein when a process includes only one thread.
`
`[0029] Execution environment 102 may receive user-provided information via one or
`
`more input devices illustrated by input device 128.
`
`Input device 128 provides input
`
`information to other components in execution environment 102 via input device adapter
`
`10
`
`110. Execution environment 102 may include an input device adapter for a keyboard, a
`
`touch screen, a microphone, a joystick, a television receiver, a video camera, a still
`
`camera, a document scanner, a fax, a phone, a modem, a network interface adapter,
`
`and/or a pointing devic