`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMMISSIONER FOR PATENTS
`P.O. Box 1450
`Alexandria, Virginia 22313-1450
`www.uspto.gov.
`
`APPLICATION NUMBER
`
`PATENT NUMBER
`
`GROUP ART UNIT
`
`FILE WRAPPER LOCATION
`
`60/717,019
`
`Correspondence Address/ Fee Address Change
`
`The following fields have been set to Customer Number 23879 on 07/06/2006
`
`* Correspondence Address
`* Maintenance Fee Address
`
`The address of record for Customer Number 23879is:
`BRIAN M BERLINER, ESQ
`O'MELVENY & MYERS, LLP
`400 SOUTH HOPE STREET
`LOS ANGELES,CA 90071-2899
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 1
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 1
`
`

`

`e
`
`GOE+60alllnn
`
`0
`
`Saeiia, VA 22313-1450.
`oSbe tember 13, 2005
`gL
`Cc.
`PROVISIONAL APPLICATION COVER SHEET
`o)
`is ig requestforfiling a PROVISIONAL APPLICATION under 37 CFR1.53(b)(2).
`
`.
`
`Wilbum Liddell, Jr.
`
`’ CUSTOMERNO. 23879
`> CERTIFICATE OF MAILING
`| hereby certify that this correspondence is being deposited with the United States Postal Service in an envelope as "EXPRESS MAIL POST OFFICE TO
`__ADDRESSEE”service under 37 C.F.R. 1.10, Mailing Label No. EV528198602US andis addressed to the: Commissionerfor Patents, P.O. Box 1450,
`_
`Co me
`— =
`oa ——
`sé
`On
`82
`
`1 3
`
`—,
`
`1
`
`Docket Number
`
`815395-1
`
`INVENTOR(s)/APPLICANT(s)
`
`Type a plus sign (+) inside
`this box
`
`RESIDENCE(CITY AND EITHER STATE OR FOREIGN COUNTRY)
`MIDDLEINITIAL
`FIRST NAME
`LAST NAME
`BAKHASH ii 2 Columbus Avenue, #32A, New York, NY 10023
`TITLE OF THE INVENTION(280 characters max)
`
`SYSTEM AND METHOD FOR PROVIDING THREE DIMENSIONAL
`GRAPHIC USER INTERFACE
`
`CORRESPONDENCE ADDRESS
`
`O'MELVENY & MYERS LLP
`400 South Hope Street
`Los Angeles
`
`:
`
`Telephone: (213) 430-6000
`Attn: BRIAN M. BERLINER
`
`STATE = ZIPCODE
`90071-2899
`COUNTRY
`Numberof Sheets
`
`ENCLOSED APPLICATION PARTS(check all that apply)
`
`z
`‘Spectcaton
`“ .
`
`a
`NumberofPages
`Se
`At
`
`Drawing(s)
`
`METHOD OF PAYMENTOF FILING FEES FOR THIS PROVISIONAL APPLICATION FOR PATENT
`
`Exhibits A, B, C, D, E
`
`Applicantclaimssmallentitystatus. See37CFR1.27.
`
`Onecheck is enclosed to coverthefiling fees/
`
`The Commissioneris hereby authorized to charge filing fees or credit any overpayment to
`Deposit Account Number:
`
`50-0639
`
`P|
`
`FILING FEE
`AMOUNT(S)
`
`|$100.00
`
`The invention was made by an agencyof the United States Governmentor under a contract with an agency of the United States Government.
`
`EJ No.
`
`O Yes, the name of the U.S. Government agency and the Government contract numberare:
`
`
`Respectfully submitted,
`
`SIGNATURE:
`
`
`
`
`TYPED OR PRINTED NAME: BRIAN M. BERLINER
`
`Date: September 13, 2005
`
`
`REGISTRATION NO. 34,549
`(if appropriate)
`
`0 Additional inventors are being named on separately numbered sheets attached hereto |
`
`LA2:775202.1
`
`SPACETIN#EGS88/16(6-95)
`EXHIBIT 2002 - PAGE 2
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 2
`
`

`

`SYSTEM AND METHOD FOR PROVIDING THREE DIMENSIONAL
`
`GRAPHICAL USER INTERFACE
`
`815395-1
`
`5
`
`COPYRIGHT NOTICE
`
`This provisional patent document contains material
`
`subject
`
`to copyright
`
`protection. The copyright owner, Eddie Bakhash, has not objection to the reproduction:
`
`of this provisional patent documentor any related materials, as they appear in thefiles
`
`of the Patent and Trademark Office of the United States or any other country, but
`
`10
`
`otherwise reservesall rights whatsoever.
`
`BACKGROUND OF THE INVENTION
`
`1.
`
`Field of the Invention
`
`The present invention is directed toward creating a three dimensional
`
`(“3D”)
`
`interactive computing interface and sorting interface comprised of information from real
`
`15
`
`time and/or static sources, including, but not limited to, meta search results from the
`
`web and/or information from APIs, webservices, search engines, application programs,
`
`networks, and/or files on the end user’s desktop in a unique interactive 3D interface.
`
`The 3D interface is advantageous in that it increases space on a computer desktop,
`
`eliminates the need to constantly open and close programs or hide and reveal them
`
`20
`
`each time they are needed,
`
`takes advantage of dormant computing time, reduces
`
`mouse-clicks and/or offers a more natural alternative to accessing programs and
`
`documents than the traditional folders-within-folders storage system.
`
`2.
`
`Description of Related Art
`
`The present invention provides a graphical user interface (referred to herein as
`
`25
`
`‘“SpaceTime’”) that takes a user from one computing place to another while creating the
`
`LA2:775104.1
`
`-1-
`
`BEST AVAILABLE*GOPY
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 3
`
`

`

`illusion of infinite space in three dimension (“3D”). By capturing the output of the user’s
`
`traditional two dimensional desktop, SpaceTime stages this output in a seamlessly 3D
`
`space by plotting the windowsor other graphical representations of programs in 3D.
`
`In
`
`one embodiment of the present invention, SpaceTime anticipates what the user may
`
`seek next (for example, the next webpage in a search result), eliminates dormant
`
`computing time, and puts the user in a reduced-click computing environment by
`
`automatically plotting the new computing experience while visually recording the old.
`‘Because SpaceTimecreatestheillusion of infinite space in 3D,
`it can create a visual
`
`history of the users computing session, whereby the user can visit past visual
`
`10
`
`computing events (or a snapshot in time) by simply navigating to previously recorded
`
`states. Accordingly, SpaceTimeis a historical visual chronology of the user’s computing
`
`session, whereby the user can name the computer experience they are currently having
`
`through their position (or viewpoint) in a 3D space andrevisit it by recalling the name or
`
`title at a later time.
`
`15
`
`Currently, people use computers by inputting information into the computer to
`
`achieve a given output. Often this can be a series of tedious steps (mouseclicks and
`
`keyboard inputs) to run applications and documents and navigate to get information one
`
`needs. To get to new computing experiences, people often haveto close their current
`
`applications and documents or hide them and then mine throughfolders within folders
`
`20
`
`to find them again at a later date. People do this because their desktopis finite and
`
`users redo things over and over again. This wastes time by (i) requiring many mouse-
`
`clicks to open and close documents, (ii) requiring one to rememberall the combinations
`
`of programs and documents one might need for a given purpose and(iii) requiring one
`
`to create elaborate hierarchical folder systems to aid in the process of storing and
`
`25
`
`recalling applications and documents. This is primarily due to the limited space the end
`
`user has on their desktop.
`
`SpaceTime automates computing by remembering wheretheuserleft off last -
`
`visually - such that the next time the user requires the sameseries of inputs to achieve
`
`that same given output, SpaceTimewill navigate the user through a 3D spacethatis the
`
`LA2:775104.1
`
`-2-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 4
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 4
`
`

`

`visual history of where the userlast left off. Since SpaceTime takes advantage of
`seemingly unlimited space, applications and documents need not be closed, hidden or
`filed. They are staged and can permanently exist visually open where they are and how
`the. user left them last. SpaceTime doesthis by allowing the user to record everything
`
`they ever did, visually, and letting them revisit it through unlimited space. Should the
`user require a new computing experience, they simply create more space and plot new
`
`applications and documents. Should the user require an old computing experience,
`SpaceTime changesthe graphical output of the screen to visually represent what they
`saw during the old computing experience (e.g., data at a particular viewpoint). This
`way, SpaceTimelets one travel back (visually) in computing time.
`
`BRIEF DESCRIPTION OF THE EXHIBITS
`
`Exhibit A illustrates one embodimentof the present invention;
`
`Exhibit B illustrates another embodimentof the present invention;
`Exhibit C illustrates alternate embodiments of the Compass, as discussed and
`depicted herein;
`.
`Exhibit D illustrates screen shots from a system that operates in accordance with
`
`one embodiment of the present invention, including screen shots of (1) an introduction,
`(2) links-in plotted vertically to a linking page (e.g., first phase of visual gestalt), (3) links-
`out plotted vertically above (e.g., second phaseof gestalt building), (4) numerouslinks-
`in and links-out plotted for 3D gestalt, (5) numerous viewpoints graphically marking
`
`gestalt, (6) text entry into input interface, (7) start scene, (8) first visual stack of results,
`(9) close up offirst search result, (10) user recording viewpoint from zoom view,(11)
`first search engine result page, (12) graphic representation of viewpoint in 3D space,
`(13) elevated view of several viewpoint graphic representations, (14) user clickinglink-in
`icon for a given web page in SpaceTime, (15) SpaceTime running on a cellphone, (16)
`a particular gestalt/template for plotting link-in and link-out (e.g., 3D space within a 3D
`space), (17) about SpaceTime, (18) downloading SpaceTime, (19) a table of contents
`(page 1 of 2), and (20) a table of contents (page 2 of 2); and
`
`20
`
`25
`
`LA2:775104.1
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 5
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 5
`
`

`

`*
`
`Figure E illustrates one method of providing a 3D graphical
`
`interface in
`
`accordance with one embodimentof the present invention.
`
`SUMMARY OF THE INVENTION
`
`The present invention provides a graphical userinterface (“SpaceTime) that uses
`
`the two dimensional (“2D”) display of a user's computer to display three dimensional
`(“3D”) objects in a simulated real-time 3D immersive Cartesian space. The program
`mayrun, for example, in conjunction with Internet Explorer, other web browsers or stand
`
`alone applications. SpaceTimeallows the user to create a 3D space ontheir computer
`
`10
`
`or the web. Through special Helper Applications (e.g., represented by interactive icons
`
`within the 3D space), SpaceTime allows the user to locate data, applications, files
`created by applications, desktop windows, HTML pages and 3D applications, and
`
`facilitates or invites the graphical output of these files and programsin their interactive
`3D space.
`In general, the present invention displays graphics from the user’s 2D finite
`
`15
`
`desktop on 3D infinite space while retaining the functionality of the 2D programs and
`
`documents. Users will be able to use these files and applications, without restrictions,
`
`within 3D spaces.
`
`LA2:775104.1
`.
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 6
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 6
`
`

`

`Calcu'ator
`
`ABC WORLD NEWS
`TONIGHT @ 8:00pm
`Hydrogen Fuel Cetls
`and their affects on
`the automobile
`
`B
`
`Google
`on naeSoe oe me tease ay
`Cena Stu
`meaner Sm atm,
`
`s2eu
`
`ier
`
`In a preferred embodimentof the present invention, the Helper Applications are
`adaptedto display the output of files and programs within windows(e.g., within the 3D
`spaces).
`In an alternate embodimentof the present invention, the Helper Applications
`are adapted to display information via customized interfaces whose graphical designs
`
`look like the real world objects they seek to represent. For example, a user may run a
`
`Helper Application for a musicfile. After clicking on the icon for the Helper Application,
`SpaceTimewill prompt the user to locate the music file on either their local computer,
`networked computer or world wide web. The Helper Application will then draw the
`
`10
`
`interface for the music file, preferably in the form of a compact disk, in the 3D space.
`The user can then interact with the graphical representation of the musicfile (e.g., the
`
`graphical representation of a CD) to run and play the musicfile.
`
`15,
`
`In one embodimentof the present invention, SpaceTime allows the user to create
`one or multiple 3D spaces on-the-fly to facilitate the graphical output of files and
`applications. For example, the user may havethe option of linking multiple 3D spaces
`
`LA2:775104.1
`
`-5-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 7
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 7
`
`

`

`together, thereby creating a network of 3D spaces. Regardless of wherethefiles or
`applications are located (e.g., within the samefolder, subfolder, a different computer,
`
`within the network, a different network, across the internet, etc.), the user will have full
`
`access to thefile through it’s native program, or to the website through the default
`
`browser.
`
`In this way, SpaceTime allows the output of disparate computer programsto
`
`visually converge in one expandable, changeable 3D space.
`
`Within the 3D immersive space that SpaceTime creates, the user’s viewpoint can
`
`be changed. SpaceTimedefines a viewpoint as a specific location or perspective in the
`
`local coordinate system (3D space) from which the user may view the sceneorfile. As
`
`10
`
`such, an interface called a Compassis used to help the user name and mapviewpoints
`
`and navigate the viewpoints in a 3D space. The Compasscan beusedto(i) record the
`
`user's current viewpoint at any time while immersed in the 3D space, (ii) assign one or
`
`multiple names to the recorded viewpoint, and/or(iii) store the names of viewpoint(s) as
`
`one namein a collection of names in a relational database. The names constitute a
`
`15
`
`mapof the 3D space as well as a method to navigate the map. The Compass mayalso
`
`serve as the userinterface to the relational database of stored names/viewpoints. The
`
`Compass may have drop down menus,wherein each menuis a record(in the relational
`database)that stores the name(s) and/orfields of viewpoints assigned by the user. The
`Compass may be expandableto facilitate an infinite array of menus or records, thereby
`
`20
`
`creating a table or group of records.
`
`The naming of stored viewpoints can exist as a single name in one menuin the
`
`Compassor as a combination of multiple names in multiple menus.
`
`In one embodiment
`
`of the present invention, each viewpoint
`
`is associated with only one name in each
`
`menu. This way, the user can select multiple names in multiple menus to create
`meaningful combinations of names that dynamically retrieve stored viewpoints based on
`
`25
`
`the relationship of names selected. The user can edit the menus of the compass,
`
`thereby adding or removing categories or expanding the menus.All of this may happen
`
`in real-time, as the user authors and interacts with their 3D scene(s). The user may
`
`also be able to combine two or more disparate Compassinterfaces, thereby creating a
`
`LA2:775104.1
`
`-6-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 8
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 8
`
`

`

`larger virtual map and navigation system to one or more 3D spaces. A named
`viewpoint in the Compasscan link to a viewpoint in the current scene, a viewpoint in
`another 3D file on the local desktop, or a viewpoint in another 3D file hosted on the
`
`world wide web. This way, the Compass creates a means of navigation that creates
`abstraction between viewpoints in any givenfiles (e.g., local desktop files, files on the
`web, etc.).
`
`In one embodiment of the present invention, SpaceTime is further adapted to
`
`generate custom 2D mapsof stored viewpoints and their namesfor specific menu items
`
`in the Compass. Specifically, SpaceTime creates 3D icons for each viewpoint named
`
`and created via the Compass and plots them into the 3D space with the respective
`namesassigned to them assignposts, allowing the user to mapall of the viewpoints for
`a 3D space and draw lines among the viewpoints to see relationships among disparate
`
`viewpoints.
`
`I.
`
`INTERACTIVITY IN 3D & SELECTIVE REDRAWINGOF2DIN 3D
`
`In accordance with one embodiment of the present
`
`invention, SpaceTime
`
`provides full functionality and interactivity of the 2D display of a user's computer
`(including the selective and isolated capturing of graphical windows, desktops, HTML
`pages, and general program outputs) redrawn into a novel simulated real-time 3D
`immersive Cartesian space, whereby the 2D graphics are drawn or mapped onto 3D
`objects. While immersed in this 3D space, the user can see their 2D computerdisplay
`that was captured and redrawn andfully interact with it, creating an entirely new way of
`computing. While interacting with their mapped or redrawn 2D display, the user can
`change their perspective or viewpoint (as defined as a location or visual perspective in
`the local coordinate system or 3D space) by moving closerto it, away from it, changing
`
`20
`
`25
`
`their angle or both.
`
`LA2:775104.1
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 9
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 9
`
`

`

`
`
`
` SohPROTOS
`
`The 3D objects that are being drawn onto (or next to) can collectively represent a
`theme or backdrop for the content that is redrawn, such as a house, library or even
`neighborhood. For example, electronic music files may be mapped onto 3D pictures of
`
`CDs or Records, electronic videos files may be mapped onto televisions or movie
`
`screens, etc. The redrawing of 2DI computer screens onto interactive 3D objects
`
`increases the visual computing space and allows the user to organize the computer
`
`output onto objects or near objects whose 3D visual construct may represent the real
`
`10
`
`world object the computeroutput is associated with.
`
`Il.
`
`CREATING A VISUAL COMPUTING HISTORY USING 3D
`
`In accordance with one embodiment of the present invention, SpaceTime is
`
`adapted to create a visual computing history, whereby normal changes to a 2D
`
`LA2:775104.1
`
`-8-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 10
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 10
`
`

`

`computer display output are drawn or mapped onto new 3D objects, rather than replace
`
`the current output or 2D display once a change is made. For example, as the user
`
`browsesthe internet by interacting with a two dimensional output mapped onto a three
`
`dimensional object, pages that the user would normally hyperlink to by clicking a link
`
`would replace the 2D computer display. SpaceTime, however, is adapted to create an
`entirely new 3D object whose surface is mapped with the new display content that
`
`would normally replace the original 2D interactive page.
`
`oe AAPL: Baste Chart torABBE hy
`‘NTaree B AAPL: Summary for APPLE COf,leYahoo! Finance|
`
`
`
`
`
`10
`
`By storing and archiving the date and time of each new graphical iteration, the
`user creates a visual chronologyof their computing session. The programmatic access
`that is responsible for a “past" graphical iteration would also be archived. For example,
`in the case of viewing a second HTML pagethat one hyperlinked to, the previous URL
`
`would be saved. This way, a user could always look back at what the computer
`previously displayed before it output the current view and interact and function with a
`
`15
`
`LA2:775104.1
`
`-9-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 11
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 11
`
`

`

`previously saved computing state as represented graphically. This process of capturing
`visually the computing history in 3D can continue on indefinitely, whereby the 3D visual
`
`space canbesaved, archived and revisited.
`
`lll.©AN_INTERFACE FOR NAMING, STORING & RE-VISITING VIEWPOINTS OF
`3D SPACES ACROSS DISPARATEFILES
`
`In accordance with one embodiment of the present
`
`invention, a Compass
`
`application is provided. The useris allowedto click at least one button on the Compass
`(while immersed in a three dimensional interactive space) and assign one or multiple
`names to a viewpoint (as defined as a location or visual perspective in the local
`coordinate system or three dimensional space). The user may then view the three
`dimensional
`image associated with the viewpoint and save this viewpoint (or visual
`perspective) along with its corresponding namein a file whose content or data can be
`accessed by the Compass.
`In one embodiment of the present invention, the Compass
`acts as an electronic combination lock, whereby the combination or sequence of one or
`multiple names assigned by the user and addedto the dials of the Compassidentify the
`
`10
`
`15
`
`stored location.
`
`LA2:775104.1
`
`-10-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 12
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 12
`
`

`

`70'sRock ao |
`
`maine
`
`|
`
`Modern
`
`60's Rock
`
`rc
`| rane
`
`For example, consider the situation whereby a user is
`
`immersed in a 3D
`
`interactive space showing 3D objects of compact discs from The Beatles. To view the
`current viewpoint,
`the user could assign multiple names such as MUSIC, ROCK,
`FOREIGN, BRITISH INVASION whereby each name would occupy one space on one
`of manydials of the graphical user interface. By turning the dials to the names MUSIC,
`ROCK, FOREIGN, BRITISH INVASION the program would initiate a change of
`viewpoint to the 3D interactive space showing the 3D objects of compact disks from The
`Beatles. The use of the interface feature for naming, storing and re-visiting viewpoints
`in a 3D spaceis universal and can be applied to a localfile of a 3D space on the user's
`computer, a networked file or a file on the world wide web. Alternate Compass
`
`10
`
`applications areillustrated in Exhibit C.
`
`LA2:775104.1
`
`-1-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 13
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 13
`
`

`

`IV.
`
`AN INTERFACE FOR VISITING STORED VIEWPOINTS OF 3D SPACES
`ACROSS DISPARATE FILES ONE AT-A TIME OR EN MESSE
`
`In accordance with one embodimentof the present invention, the useris able to
`
`access stored viewpoints on a graphical interface called a Compass, which may serve
`
`as an electronic combination lock.
`
`In this embodiment, the Compass will open (or
`
`visually visit) a stored viewpoint when its dials are turned through a predetermined
`sequenceof positions identified on the dials’ face by the appropriate names assigned to
`each dial. Therefore, the Compass can be used to connect a series of viewpoints
`
`together and visually visit a series of connected stored viewpoints.
`
`V.
`
`CREATING NEW 3D SPACES FROM EXISTING ONES AND LINKING THEM
`TOGETHERWITH A PORTAL BUTTON
`
`In accordance with one embodiment of the present
`
`invention,
`
`the user is
`
`immersed in a 3D space and adaptedto click one button called "new space"to created
`another file for a completely new 3D interactive space, whereby the new 3Dinteractive
`spaceis accessible from the current space by clicking a 3D object or "portal button.”
`The “portal button,” which electronically links the new spaceto the current one, may be
`represented by a picture of a viewpoint or visual perspective of the new space. By
`clicking the "new space" button, SpaceTime will automatically create the "portal button"
`within the current space that links to the "new space." Furthermore, SpaceTime may
`
`also allow the user to concurrently assign one or multiple names to the "new space," as
`
`described under
`
`"AN INTERFACE FOR NAMING, STORING & REVISITING
`
`VIEWPOINTS OF 3D SPACES ACROSS DISPARATE FILES," and add these name(s)
`
`to the Compass.
`
`20
`
`25
`
`CREATING HTML TABLE OF CONTENT PAGES FOR NEWLY CREATED 3D
`VI.
`SPACES ON-THE-FLY AND PUBLISHING TO A WWW_SERVER
`
`Should a user create a new space, as described previously within this document
`
`under "CREATING NEW 3D SPACES FROM EXISTING ONES AND LINKING THEM
`
`30
`
`TOGETHER WITH A PORTAL BUTTON,” SpaceTime may be adapted to automatically
`
`LA2:775104.1
`
`-12-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 14
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 14
`
`

`

`create a "table of contents page" by writing an HTML page that describes the new
`
`space, the namesassigned to the new space via the Compass, andpictures of the new
`space through snapshotsofdifferent viewpoints or visual perspectives of the 3Dfile. All
`this information may be assembled into an HTML file that will be automatically published
`
`or sent by file transfer protocol (FTP) to one or many world wide web servers for
`
`promotion as to be found and crawled by the many search engines that traverse the
`
`world wide web. One purpose of creating these HTML "table of content pages" for
`
`newly created 3D spaces on-the-fly and publishing them to the world wide webis so
`
`that they can be used as portal pages, whereby a usercould (i) search the world wide
`
`10
`
`web using keywords, (ii) find a "table of contents page" whose subject correspondsto
`
`the keywords, and(iii) hyperlink the end user from a 2D "table of contents page” to a 3D
`
`interactive space whose subject matter correspondsto the "table of contents page." For
`example, the HTML "table of contents page” maycontain(i) the name of the new space
`as the title of the HTML page, (ii) meta tags whose names would be taken from the
`
`15
`
`names assigned to viewpoints of the Compassinterface, as described in the section
`
`titled "AN INTERFACE FOR NAMING, STORING & RE-VISITING VIEWPOINTS OF 3D
`
`SPACES ACROSS DISPARATEFILES,”(iii) a raster image or picture of the original
`viewpoint or visual perspective of the new space,(iv) a list of all hyperlinks found within
`the new space, (v) a description of the scene, (vi) the author of the scene, (vii) remote
`
`20
`
`desktop connection settings and/or (viii) URLs to the desktops for all remote desktop
`
`connection links shown within the new: space, as described in the section called
`"ACCESSING ONE OR MULTIPLE REMOTE DESKTOP CONNECTIONS THROUGH
`
`3D OBJECTSIN A 3D SPACE."
`
`25
`
`Vil.
`
`HELPER APPLICATIONS IN A3D SPACE THAT HELP CAPTUREFILES,
`APPLICATIONS, COMPUTER OUTPUT & AUTOMATE REPETITIVE TASKS
`
`In accordance with one embodiment of the present invention, the display of 3D
`
`on a computer screen mayinvolve a runtime execution mode! that "plays" a previously
`
`programmed 3D spacelike a tape-recording in a window or web browseras a one-way
`
`LA2:775104.1
`
`- 13 -
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 15
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 15
`
`

`

`broadcast medium. The programmingof this 3D space is accomplished by hand coding
`
`a program orusing an "editor" which preparesa file for the "player." In one embodiment
`of the present invention, the Helper Applications can be accessed from the "player"
`(while an end user is using and immersed within a 3D space) through a graphical user
`
`interface of interactive icons that facilitate the display output of a file or functionality of a
`
`program within windows within a 3D space.
`
`In an alternate embodiment of the present
`
`invention, each Helper Application is adapted to display information via a customized
`
`3D interface whose graphical design and construct resembles the real world objectit
`
`seeks to represent. For example, one may run a Helper Application for a musicfile.
`
`10
`
`After clicking on the icon for the Helper Application, SpaceTime may promptthe user to
`
`locate the music file on either their local computer, networked computer or world wide
`
`web. The Helper Application may then draw the interface for the musicfile in the 3D
`
`space. The user cantheninteract with the graphical representation of the musicfile
`
`(e.g., a graphical representation of a CD) to run andplay the musicfile.
`Regardless of where the file or application displayed in SpaceTime is located
`
`(e.g., within the same folder, subfolder, a different computer, within the network, a
`
`different network, across the internet, etc.), the user has full access to the file through
`
`it's native program, or to the website through the default browser.
`
`In this way,
`
`SpaceTimeallows the output of disparate computer programs to visually converge into
`
`20
`
`one expandable, changeable 3D space. SpaceTime may also prompt the user to
`
`search or scan folders and subfolders in the local computer, network computers,
`
`webserversorthe internet for any files of a given kind or criteria and display their output
`
`as windowsor customized 3D real world object icons en massein the 3D space via the
`
`Helper Application. This way, the user can usethis feature selectively to choose only
`
`25
`
`onefile or automatically to chooseall the files available to them.
`
`Vill.
`
`THE REPRESENTATION OF A COLLECTION OF HELPER APPLICATIONS
`THROUGH ANIMATED 3D ICONS ON A DOCK
`
`In accordance with one embodiment of the present invention, the useris able to
`
`LA2:775104.1
`
`-14-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 16
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 16
`
`

`

`access Helper Applications, as described under "HELPER APPLICATIONS IN A 3D
`
`SPACE THAT HELP CAPTURE FILES, APPLICATIONS, COMPUTER OUTPUT &
`
`AUTOMATE REPETITIVE TASKS,” while immersed in a 3D interactive scene, by
`
`clicking on icons located on a task bar at the base of the screen. By clicking on these
`
`animated 3D icons, the icons may duplicate themselves or animate themselvesinto the
`
`3D scene and provide the beginning of functionality as 3D graphical objects for the
`
`tasks at hand for which the icon wasinitially clicked. For example, under "CREATING
`
`NEW 3D SPACES FROM EXISTING ONES AND LINKING THEM TOGETHER WITHA
`
`PORTAL BUTTON,"the icon onthe task bar to initiate this Helper Application may beof
`
`an open doorway. Once the 3D open doorwayicon onthe task baris clicked, a picture
`
`of a viewpoint or visual perspective of the new space may be animated from the task
`
`bar into the scene.
`
`If this picture were to be clicked from within the 3D scene, it would
`
`act as a doorwaythat would hyperlink the user from the current scene to anotherscene.
`
`15
`
`IX.
`
`THE ADDITION OF GEOMETRY TO A 3D SPACE ON-THE-FLY TO FURTHER
`ORGANIZE AND DEFINE IT
`
`In one embodiment of the present invention, the display of 3D on a computer
`
`screen mayinvolve a runtime execution modelthat "plays" a previously programmed 3D
`space like a tape-recording in a window or web browser as a one-way broadcast
`
`20
`
`medium. The programming of this 3D space is accomplished by hand coding a
`
`program orusing an "editor" which preparesa file for the "player." A Helper Application
`
`for geometry can be accessed from the "player" (while an end user is using and
`
`immersed within a 3D space) through a graphical userinterface of interactive icons that
`
`facilitate the display or input of 2D and 3D objects into the 3D scene based on a user
`
`25
`
`interface of geometrical objects (cube, spheres, cones) or real world objects (room,
`
`desk, building, stairs, CD rack). This addition of geometry into the 3D scene on-the-fly
`
`helps give meaning to an otherwise endless connection of 3D spaces for which users
`
`canfill their output with. SpaceTime mayfurther include a special Search and Browse
`
`application to locate 3D geometry files. The user may use the Search and Browse
`
`LA2:775104.1
`
`-15-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 17
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 17
`
`

`

`to search for geometry files in (or beyond) folders and
`application, for example,
`subfolders located on the local computer, network computers, webservers or the world
`
`wide web.
`
`xX.
`
`THE ADDITION OF AUDIO, SOUND AND MUSIC FILES TO A 3D SPACE ON-
`THE-FLY TO NARRATEIT
`
`In one embodiment of the present invention, the display of 3D on a computer
`screen mayinvolve a runtime execution model that "plays" a previously programmed 3D
`space like a tape-recording in a window or web browser as a one-way broadcast
`medium. The programming of this 3D space is accomplished by hand coding a
`program orusing an "editor" which preparesa file for the "player." A Helper Application
`for audio, sound and music can be accessed from the "player" (while an end useris
`
`using and immersed within a 3D space) through a graphical userinterface of interactive
`icons that provide pre-recorded audio, sound and music and mayalsofacilitate the
`recording of sound through a microphone connected to the computer and inserted into
`the 3D scene through anicon (e.g., of a speaker, etc.) on-the-fly as a way to label (or
`narrate) the scene and record thoughts next to objects in the sceneto further give them
`meaning. The user may further use the Search and Browse application, for example, to
`search for audio, sound, or music files in (or beyond) folders and subfolders onthe local
`computer, network computers, webservers or the world wide web.
`
`Xl.
`
`THE ADDITION OF PICTURES, ANIMATIONS, MOVIES AND VIDEO INTO A
`3D SPACE ON-THE-FLY
`
`In one embodiment of the present invention, the display of 3D on a computer
`screen mayinvolve a runtime execution model that "plays" a previously programmed 3D
`space like a tape-recording in a window or web browser as a one-way broadcast
`medium. The programming of this 3D space is accomplished by hand coding a
`program orusing an "editor" which preparesa file for the "player." A Helper Application
`for pictures, animations, movies and video can be accessed from the "player" (while a
`user is using and immersed within a 3D space) through a graphical user interface of
`
`LA2:775104.1
`
`-16-
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 18
`
`20
`
`25
`
`30
`
`SPACETIME3D
`EXHIBIT 2002 - PAGE 18
`
`

`

`interactive icons that help locate such pictures, animations, movies and video and insert
`
`such media into the 3D scene on-the-fly at the end user's behest. The user may further
`
`use the Search and Browseapplication, for example to search for pictures, animations,
`
`movies and video files in (or beyond) folders and subfolders on the loca