Filed: December 17, 2020
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`______________________
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`______________________
`SAMSUNG ELECTRONICS CO., LTD., and
`
`SAMSUNG ELECTRONICS AMERICA, INC.
`Petitioner,
`
`v.
`
`SPACETIME3D, INC.
`Patent Owner
`
`______________________
`Case IPR2020-01418
`U.S. Patent No. 9,304,654
`
`______________________
`DECLARATION OF EDDIE BAKHASH
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 1
`
`

`

`Declaration of E. Eddie Bakhash
`
`IPR2020-01418 (U.S. Patent No. 9,304,654)
`
`
`
`I, E. Eddie Bakhash, declare and state:
`
`the President and founder of SpaceTime3D, Inc.
`I am
`1.
`(“SpaceTime3D”), and I am the sole inventor of U.S. Patent No. 9,304,654
`(“the ‘654 Patent”). I make this Declaration in support of Patent Owner’s
`Preliminary Response to Petition for Inter Partes Review of the ‘654 Patent.
`2.
`SpaceTime3D is an application software company incorporated in
`New York, NY. It is also the assignee of the ‘654 Patent, a true and correct
`copy of which is attached as Exhibit A. The ’654 patent is a continuation of
`U.S. Pat. No. 8,881,048 (‘the ‘048 Patent”), which is a continuation of U.S.
`Patent No. 7,735,018 patent, which claims priority to a provisional patent
`application that was filed on September 13, 2005, Serial No. 60/717,019.
`3.
`Generally speaking, the ‘654 Patent provides “an improved three-
`dimensional graphical user interface.” According to the specification,
`“[b]ecause the 3D GUI creates the illusion of infinite space in 3D, it can create
`a visual history of the user’s computing session, whereby the user can visit past
`visual computing events (or a snapshot in time) by simply navigating to
`previously recorded states or viewpoints. Accordingly, the 3D GUI can
`function as a visual chronological history of the user’s computing session.”
`See, e.g., ‘048 Patent at col. 5, ll. 6-21.
`4.
`The ‘654 Patent describes several ways of presenting and
`interacting with information in 3D space. The claimed invention, however,
`focuses on one way, where images of applications are presented in 3D space,
`and individual applications are interacted with, one at a time, in 2D space. In
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 2
`
`

`

`Declaration of E. Eddie Bakhash
`
`IPR2020-01418 (U.S. Patent No. 9,304,654)
`
`
`particular, Claim 1 of the ‘654 Patent provides for a 3D GUI where (1) a user
`provides at plurality of inputs, (2) corresponding applications are opened, (3)
`images of the applications are generated, and (4) presented in 3D space, with
`first one being in the foreground, the second one being in the background, etc.
`5. When the user interacts with the first image (in the foreground), a
`corresponding active application is presented to the user in 2D space (the GUI
`switches from 3D space to 2D space), where the application replaces the
`plurality of images. Id. The user can then interact with the application to
`modify the application-specific data associated therewith.
`6.
`In other words, the claimed invention allows a user to navigate
`through a plurality of applications presented as images in 3D space and to
`select a particular application, which results in the GUI switching from 3D
`space, where the plurality of images are presented, to 2D space, where an
`active application (corresponding to the selected image) is presented, thereby
`allowing the user to interact with the active application to modify data
`associated therewith (e.g., acquire a different webpage, etc.). The claimed
`invention further provides that when switching from 3D space to 2D space, the
`selected webpage replaces the plurality of images.
`7.
`The claims of the ‘654 Patent are particularly advantageous in
`ultra-mobile personal computer (“UMPC”) devices (e.g., smartphones) having
`limited screen sizes, reduced processing power, and limited electrical (e.g.,
`battery) power, by allowing a user to interact with a first, active webpage in a
`2D space, and switching to a second, active webpage by (i) replacing the first
`webpage in 2D space with images of a plurality of webpages in 3D space, (ii)
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 3
`
`

`

`Declaration of E. Eddie Bakhash
`
`IPR2020-01418 (U.S. Patent No. 9,304,654)
`
`
`allowing the user to select an image of the second webpage, and (iii) replacing
`the plurality of images in 3D space with the second, active webpage in a 2D
`space.
`By interacting with individual, active applications in 2D space and
`8.
`scrolling through images of a plurality of applications in 3D space, which is a
`non-conventional technique that exploits the fact that images of applications
`can be more easily manipulated in 3D space than the active applications
`themselves, the claimed invention improves the functionality of the computing
`(e.g., UMPC) devices by requiring less power, minimal (or reduced)
`processing, and smaller screen sizes.
`the
`identifies problems with
`9.
`The ‘654 Patent specifically
`conventional system of inputting information into a computer to achieve a
`given output, which involves a series of tedious steps—repetitive mouse clicks
`and keyboard inputs—to run applications and documents or navigate to certain
`information. See, e.g., ‘048 Patent at col. 1, ll. 38-55. To switch to a different
`application or document on a computer, the user often has to close her current
`applications and documents, hide them or overlap them on a finite desktop by
`drawing them on top of each other, and then mine through folder within folder
`to find them again at a later date. Because the user’s desktop is finite, she must
`redo these same tasks over and over again. Id.
`10. This conventional system wastes the end user’s time by (1)
`requiring many mouse clicks to open and close applications and/or documents,
`(2) requiring the user to remember the combinations of programs and
`documents she may need for a given purpose, and (3) requiring the user to
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 4
`
`

`

`Declaration of E. Eddie Bakhash
`
`IPR2020-01418 (U.S. Patent No. 9,304,654)
`
`
`create elaborate hierarchical folder systems to aid in the process of storing and
`recalling applications and/or documents. Id.
`11.
`In 2007, SpaceTime3D released a 3D web browser, generally
`referred to as “SpaceTime.” The web browser incorporated features of the
`‘048 Patent claimed invention in that it allowed a user to navigate through a
`plurality of webpages by presenting images of the webpages in 3D space.
`When the user double-clicked on a particular image, the corresponding
`webpage was presented in 2D space, allowing the user to interact with the
`webpage to acquire additional information (e.g., another webpage via a link
`embedded therein, etc.). As in the claimed invention, the webpage presented in
`2D space replaces the plurality of images presented in 3D space, and vice
`versa.
`12. The web browser received praise by technical journals and
`newspapers, including but not limited to the San Jose Mercury News, The
`Washington Post, The Wall Street Journal, The Economist, Popular Science,
`PC World, Tech Digest, TechNewsWorld, Renderosity, and InternetNews.com.
`A true and correct copy of an article from the San Jose Mercury News, entitled
`“3-D Software Shows Promise,” is attached hereto as Exhibit B; a true and
`correct copy of an article from TechCrunch, entitled “SpaceTime: 3D Browser
`Eye Candy,” is attached hereto as Exhibit C; a true and correct copy of an
`article from TechNewsWorld, discussing the “Product of the Week,” is attached
`hereto as Exhibit D; another article from TechNewsWorld entitled
`“SpaceTime Browser Adds New Dimension to Search,: is attached as Exhibit
`E, and a true and correct copy of an article from Renderosity, entitled “3D
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 5
`
`

`

`Declaration of E. Eddie Bakhash
`
`IPR2020-01418 (U.S. Patent No. 9,304,654)
`
`
`Browsing with SpaceTime,” is attached hereto as Exhibit F.
`13. For instance, reporter Dean Takahashi of the San Jose Mercury
`News exclaimed that SpaceTime3D’s product “is the most advanced 3-D
`navigation system I’ve seen.” See Exhibit B. Greg Kumparak of TechCrunch
`stated that “[i]t’s difficult to describe the user experience … [i]t’s pure eye
`candy” (see Exhibit C), and Rob Enderle of TechNewsWorld stated that “I can
`already image SpaceTime’s tag line: We don’t do searches – we make search
`results amazing” (see Exhibit D).
`14.
`It was not just the 3D browsing that was found to be “eye candy,”
`but the incorporation of the claimed invention, where users can switch back
`and forth between 3D and 2D space, where images of webpages are presented
`in 3D space and individual, active webpages are presented in 2D space. For
`example, reporter Jack Germain of TechNewsWorld wrote that “[w]ith
`SpaceTime, I have an unlimited 3-D space. This lets me map out my browsing
`progress in a visual time line, treating each Web site as an object that I can
`manipulate and rearrange within the 3-D environment. SpaceTime also lets me
`alternate between 3-D and 2-D perspectives by double clicking on a 3-D
`display and then clicking the Return button. This process eliminates the hassle
`of reading and closing pop-up windows and clicking on the Back button.” See
`Exhibit E.
`15. Similarly, a 2007 article in Renerosity provided “[t]his content is
`loaded onto ‘3D blocks’ that are arranged in your 3D view, and you can very
`easily navigate from one to the next. … If you are looking at some websites,
`for example, you can simply double-click the window of your choice and that
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 6
`
`

`

`Declaration of E. Eddie Bakhash
`
`IPR2020-01418 (U.S. Patent No. 9,304,654)
`
`
`will cause it to ‘maximize’ … [i]f you want to return to the 3D view, you can
`simply use the ‘Go Back’ button that appears on the maximized view.” See
`Exhibit F.
`16. Petitioner, Samsung, was also impressed by SpaceTime3D and its
`technology. For example, on February 2, 2008, a Samsung USA employee in
`charge of purchasing new technologies emailed SpaceTime3D: “Hello, my
`name is Young Choi with Samsung Electronics America. It seems like your 3d
`browser can be at its best when it is used in UMPC [mobile devices]. Samsung
`has a number of UMPC products, and I would like to find out if SpaceTime is
`planning to introduce a browser targeted penetrate in UMPC.” See Exhibit G.
`Attached hereto as Exhibits G-M are true and correct copies of emails between
`SpaceTime3D and Samsung.
`17.
`I responded to Samsung’s inquiry, explain that “[b]y placing
`SpaceTime on UMPCs, SpaceTime offers an Apple-like 3D graphical user
`interface that eliminates the restrictions of the 2D Vista graphical user interface
`on small devices (difficult to input information and find things) by allowing
`end users to (1) easily shuffle through information in small spaces and (2)
`interact with their information in 3D by changing perspectives when
`necessary.” See Exhibit H.
`18. Petitioner’s interest in SpaceTime3D continued. In March 2008, I
`met with the Samsung USA employee to present SpaceTime3D’s technology,
`and sent them an email the SpaceTime application from a Windows Vista
`explorer. In that email I wrote “SpaceTime is 3D INTERACTIVE. When you
`FLY through the 3D scene and change your viewpoint, whatever information
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 7
`
`

`

`Declaration of E. Eddie Bakhash
`
`IPR2020-01418 (U.S. Patent No. 9,304,654)
`
`
`you are looking at (web page, video, application window, document),
`SpaceTime allows you full 3D INTERACTIVITY of the web page, video,
`application window or document while you are in 3D. … This 3D
`INTERACTIVITY is part of the SpaceTime Patent.” See Exhibit I.
`I was then invited to attend Petitioner’s “2nd Samsung Sourcing
`19.
`Conference and Event” in order to “discuss future collaboration with Samsung
`Digital Media Groups.” See Exhibit J. According to Samsung, “[t]his event
`will provide an opportunity for us to get an understanding of Spacetime
`technology and solutions to discuss its applicability to our Digital Media
`Products. Samsung is looking forward to discussing potential collaboration to
`implement Spacetime’s technology to our Digital Media Groups.” See id.
`20.
`I attended the event on or around May 19-21, 2008, and provided
`Samsung with a PowerPoint presentation to facilitate the parties’ discussion of
`a potential
`licensing agreement.
` That presentation made clear
`that
`SpaceTime3D’s technology was (at that time) patent-pending.
`21. Following the Conference, Samsung USA notified me that
`Samsung Electronics, in Korea, would also review SpaceTime3D’s technology,
`and on June 4, 2008, Samsung USA asked myself when I “would be able to
`travel to Korea to meet with my UI engineers in Suwon for further technical
`discussions and demos.” See Exhibit K.
`22. While I was unable to travel to South Korea, I did meet with
`Samsung in San Jose, California, and continued to provide Samsung with
`sensitive and confidential information regarding SpaceTime3D’s technology.
`23. Negotiations between the parties continued into 2010. For
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 8
`
`

`

`Declaration of E. Eddie Bakhash
`IPR2020-01418 (U.S. Patent No. 9,304,654)
`
`to hear that
`example, on April 16, 2010, Samsung noted “excitiement]
`[SpaceTime3D] just released a very powerful new GUI
`for tablets and
`netbooks,” inquired about the “basic platform,” expressed a “love to see the
`
`new development of asked_that([SpaceTime3D’s] technology, and
`
`
`
`SpaceTime3D “[pJlease send [them] the changes and improvements you’ve
`make[sic] until now. Samsung’s new tablet runs Android so I’m wonderingif
`your browseris compatible.” See Exhibit L. At this time, Samsungoffered to
`“start
`talking about
`technical collaboration and potential co-development
`agreement,”first “by getting our engineers interested by showing them what
`SpaceTime is offering and how it makes the user experience better.” See
`
`Exhibit M.
`
`24. While these negotiations ultimately broke down,
`
`the back and
`
`forth between SpaceTime3D and Samsung discussing SpaceTime3D’s
`technology and potential licensing, while trade journals and newspapers were
`touting SpaceTime3D’s web browser, which incorporated features of the
`
`claimed invention,
`
`is clearly evidence of commercial success and praise by
`
`others in the industry.
`
`I declare under penalty of perjury under the laws of the United States
`
`that the foregoing is true and correct. Executed this 17th date of December
`
`2020, at Palo Alto, California.
`
`E. Eddie Bakhash
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 9
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 9
`
`

`

`
`
`
`
`
`
`
`EXHIBIT A
`EXHIBIT A
`
`
`
`
`
`
`
`
`
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 10
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 10
`
`

`

`US009304654B2
`
`a2) United States Patent
`US 9,304,654 B2
`(0) Patent No.:
`*Apr. 5, 2016
`(45) Date of Patent:
`Bakhash
`
`(54)
`
`(71)
`
`(72)
`
`SYSTEM AND METHOD FOR DISPLAYING A
`TIMELINE ASSOCIATED WITH A
`PLURALITY OF APPLICATIONS
`
`Applicant: Ezra Eddie Bakhash, New York, NY
`(US)
`
`Inventor: Ezra Eddie Bakhash, New York, NY
`(US)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 84 days.
`
`3/04845 (2013.01); GO6F 1730572 (2013.01);
`G06F 17/30864 (2013.01); GO6F 17/308 73
`(2013.01); GO6T 15/20 (2013.01); GIIB 2734
`(2013.01)
`
`(58) Field of Classification Search
`CPC ween GO6F 3/0481; GO6F 3/04815; GO6F
`3/04817; GO6F 3/0482; GO6F 3/0483; GO6F
`3/04845; GO6F 17/30864; GO6F 17/30873;
`GO6F 17/30572; GO6T 15/04; GO6T 15/20;
`G11B 27/34
`USPC ween 715/782, 781, 764, 788, 766, 767
`See application file for complete search history.
`
`This patent is subject to a terminal dis-
`claimer.
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`(21)
`
`Appl. No.: 14/503,142
`
`(22)
`
`Filed:
`
`Sep. 30, 2014
`
`(65)
`
`(63)
`
`(60)
`
`(51)
`
`(52)
`
`Prior Publication Data
`
`US 2015/0128059 Al
`
`May 7, 2015
`
`Related U.S. Application Data
`
`Continuation of application No. 12/751,879, filed on
`Mar. 31, 2010, now Pat. No. 8,881,048, which is a
`continuation of application No. 11/531,676, filed on
`Sep. 13, 2006, now Pat. No. 7,735,018.
`
`Provisional application No. 60/717,019, filed on Sep.
`13, 2005.
`
`Int. Cl.
`
`G06F 3/0482
`G06F 3/0481
`GO6F 3/048
`G06F 1730
`G06T 15/20
`GI1B 2734
`GO06F 3/0484
`US. Cl.
`
`(2013.01)
`(2013.01)
`(2013.01)
`(2006.01)
`(2011.01)
`(2006.01)
`(2013.01)
`
`6/1994 Yoshikawa 0... 345/179
`5,319,387 A *
`6/1995 Kahletal.
`......
`.. 715/839
`5,428,735 A *
`9/2000 Jain etal.
`........
`.. 715/850
`6,121,969 A *
`6,499,029 B1* 12/2002 Kurapatietal.
`.. 707/750
`6,577,330 BL*
`6/2003 Tsudaetal. oo. 715/782
`
`
`
`(Continued)
`
`Primary Examiner — Ting Lee
`(74) Attorney, Agent, or Firm — Fitzsimmons IP Law
`
`(57)
`
`ABSTRACT
`
`Methodsand systemsare provided for providing an improved
`three-dimensional graphical user interface. In one embodi-
`ment, the method generally comprises: receiving an input
`from an end user, and capturing computing output from at
`least one computer source in response to the received end-
`user input. The computing output can be presented as two or
`more objects within a three-dimensional virtual space dis-
`playedto the enduser. In one embodiment, the method further
`comprises generating a timeline that includes an icon for each
`object presented within the virtual space. In another embodi-
`ment, the method further comprises providing a database for
`storing and categorizing data regarding each object presented
`within the virtual space.
`
`CPC we. GO06F 3/04815 (2013.01); GO6F 3/0482
`(2013.01); GO6F 3/04817 (2013.01); GO6F
`
`19 Claims, 30 Drawing Sheets
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 11
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 11
`
`

`

`US 9,304,654 B2
`
` Page 2
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`6,725,427 B2*
`4/2004 Freeman etal.
`............ 715/273
`
`... 707/999 .002
`6,768,999 B2*
`7/2004 Prageretal. .....
`2001/0050687 AL* 12/2001 Tidaetal. oe. 345/581
`
`3/2002 Sciammarellaetal. ...... 345/838
`2002/0033848 Al*
`
`.......... 345/419
`9/2003 Gottesman et al.
`2003/0164827 Al*
`........... 345/757
`9/2003 Kamiwada etal.
`2003/0179231 Al*
`2004/0268451 A1* 12/2004 Robbin etal.
`......... 999/999 999
`
`* cited by examiner
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 12
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 12
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 1 of 30
`
`US 9,304,654 B2
`
`32
`
`
`
`Load Custom Script andits Icon to Alter
`Application Logic of 30 Cartesian Space
`through Pragrammatic Access
`
`
`(External Proto Node) Represented by
`
`
`interactive Icon on Interface Panel
`
`30
`SeanEvent Handler
`
`
`‘or
`En
`ser {nput
`
`onInterface Panel to
`Execute Appropriate
` Helper Application
`
`
`
`
`
`
`
`Recalculate
`Geometry in
`Scene Basedo
`New Viewpoint
`or Perspective
`
`FIG. 1A
`
`Visit Viewpoint
`
`Record Viewpoint or
`x,y,z Coordinate
`
`Add Desktop
`Window Command
`
`Add Browser
`
`Add Document or
`Application Command
`
`Add Text
`Command
`7
`add Picture
`ommand
`Add Music Command
`
`Add Video Command
`
`Record Sound
`Command
`
`Add Map Command
`
`Add 3D VRMLor
`X3D File Command
`
`Save Space/Email
`Space Command
`
`Add Advertising to
`3D Scene
`
`42
`
`50
`
`62
`
`72
`74
`
`88
`
`92
`
`94
`
`104
`
`(D)
`
`©
`
`©
`
`(A)
`
`(1)
`
`@
`
`OOOO®@
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 13
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 13
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 2 of 30
`
`US 9,304,654 B2
`
`36
`©—4ease| ©
`
`Program Prompts End
`End Sorothelperoad User to Locate Script File
`(D) App
`from Local Computer,
`lication) Icon from
`Network, Internet
`Input Interface Panel
`or other Location
`
`
`
`Prompt User to Choose Viewpoint Name
`Load x,y,z Position or
`from Compassor Click on Icon of Previously+Viewpoint from Compass
`Recorded Viewpoint in 3D Cartesian Space
`File and Bind to it
`©
`
`Prompt Userto
`
`
`Input Viewpoint
`
`
`
`Name(s) to be Added
`
`
`
`to Compass File
`
`
`©)
`
`
`
`(Q)
`
`Store x,y,z Position
`and Viewpoint Name
`within 30 Cartesian
`Space to CompassFile
`
`
`
`
`Draw Interactive 3D
`lcon/Geometry in Scene
`
`
`to Represent Viewpoint
`
`
`
`with Viewpoint Name
`
`
`
`Initiate Open File Class or other Web
`Service, API, or Method for Loading
`
`Data from Local Computer,
`
`Networkor the World Wide Web
` Allow Drag and Drop of File, Document
`
`or Application into 3D Cartesian Space
`
`fram 2D Desktop
`
`
`
`
`
`Draw Interactive 3D Icon/Geometry in
`Draw Text, Map, Picture, Video,
`VRML, X3D or other Content
`Scene to Represent Sound or Music
`thatif Clicked with Play Sound/Music
`into 3D Cartesian Space
`
`
`
`
`
`
`Prompt Userto Input Name of 3D
`Save Space on Local Computer
`
`Cartesian Space to Save or Email.
`and/or Our Company Server (FTP).
`
`
`
`Add Nameto CompassFile
`Server Files can be Public or Private
`
`
`Determine Subject of 3D Cartesian Space by Scanning all Words
`Associated with or within the File Names, Files, htm! Pages,
`
`
`Viewpoint Names, Hyperlinked Files or any other Available
`Information Associated with Items within the 3D Cartesian Space
`
`
`or Words Entered into the Input Interface
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 14
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 14
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 3 of 30
`
`US 9,304,654 B2
`
`
`
`
`interactive icon that Triggers Script is | End User is Prompted to Click
`
`Dynamically Addedto Interface Panel to
`|-jInteractive Icon on Interface Panel
`
`Initiate Command Using XML Encoding||to Initiate Program Altering Script
`
`
`
`
`
`
`There is no Control
`Determine Proper OS Control to
`
`
`for this Information
`Retreive the Kind of information Requested
`
`Store Bit Mapin
`a Frame buffer
`
`108
`
`
`
`
`Periodically Capture the
`
`
`on Screen Output of
`Execute Proper OS Control Specific to the
`Window for
`Said
`Kind of information Requested which
`
`
`will Act as a Mirror to its 3D Representation
`Program/Information as
`
`
`
`
`
`
`a Bit Map Image
`
`Map Visual Output of OS Control, Bit Map
`
`
`or API onto Arbitrary 3D Geometry
`
`
`
`
`Pass Mouse Clicks, Cursor Position,
`
`
`
`Create Device
`Keyboard Input and Movements from
`Input Event
`Control Map on 3D Geometry to the Mirror
`
`
`Handler in 3D
`Controf Running on 2D Environment
`
`
`
`
`Generate Table of Contents Page in the Form of an htmi Page that is Stored on
`
`
`Company Server Next to Saved Space File that Stores Space Name, Hyperlinks
`
`
`in 3D Space, Description, Picture(s) of 3D Space with the Purpose of being
`
`
`an Index for the 3D Spaceto be Crawied by the Major Search Engines as Part
`of their Web Crawling/Indexing. Place Subject (See !tem "A") of 3D Spaceinto
`
`
`Meta Tags of htmi Page. Embed Option in html Page to Download PROGRAM
`Active X Control within html Page to Auto Install Saved Space from
`
`
`Company Serverfor which T.O.C. html Page was Generated and
`Execute on their Computer with the Click of One Button on htmi T.O.C. Page
`
`
`Email Table of Contents html Page to Recipient(s) and Embed
`
`
`Option for Recipient to Download PROGRAM Active X Control within
`
`html Page to Auto Install and Load Saved Space from Company
`
`
`Serverfor which T.O.C. html Page was Generated and Display
`on their Computer with the Click of One Button off html Page
`
`
`
`
`
`Return Appropriate text,
`Sort Words by Frequencyto
`
`
`Picture(s), Video(s), Sound(s),
`Determine Subject of 3D
`
`
`Music, Hyperlinks or other
`Cartesian Space by Identifying
`
`
`Advertisement Content from
`Mast Frequently
`
`
`Advertising Server, Web
`
`Appearing Words
`
`Service or other Location
`
`
`
`Send Subject of 3D Cartesian
`Draw text, Picture(s), Video(s),
`
`Space via xmFile of Most
`Sounds(s), Music, Hyperlinks or
`
`
`other Ad Content from
`Frequently Appearing Words to
`
`Advertising Server or other
`Advenising Serverthrough
`
`internet Request
`
`
`Location into 3D Cartesian Space FIG. 1C
`
`
`
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 15
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 15
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 4 of 30
`
`US 9,304,654 B2
`
`20
`
` Usertnput
`
`
`
`
`
`Recalculate Geometry
`in Scene Based on
`New Viewpoint
`or Perspective
`
`FIG. 2
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 16
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 16
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 5 of 30
`
`US 9,304,654 B2
`
`JO]UODOUSIaeuU,
`
`vrL
`
`
`
`
`
`UONPWJOJU]SIU}JOY
`
`
`
`MODUIAAJOINdINOuseI0SUO
`
`
`
`UORPULOSL/WeIGOIgPIES10}
`
`au)sandeAyeoipouay
`
`
`ysonboyMOPUIAA
`
`yuswiND0q
`
`Jaosean
`
`faguadg
`gonauado
`
`abey
`
`O€l
`
`Ort
`
`asweleuldeyWqas01S
`JoyNg
`
`Srl
`
`
`AyswoesqeAesyquyojU0fdiyJO
`
`
`
`dew1g‘104jUODSOJOINdnOJensipdey
`
`crl
`
`abedey]iq©se
`
`
`
`uoyeUssaidayGESH!O}JOLIYY@SEJOY[IMYoU
`
`
`
`pajsenbayvoeuuojuyJOpulyey]0}SytoadgjoUDDSOJadolgaInoaxy
`
`
`
`
`
`
`
`‘UDISOgJOSIND‘syIIgSsNo;Sse
`
`OSL
`
`€‘Sid
`
`JOLY94}0}ANjaWoadqeUOdey[oU0D
`WO)S}JUSSAOVYpueIndupueoghay
`
`
`
`yUawUOlAUZGzUoBuruunyjonU0g
`
`CEUiJa/pueHyuaag
`
`
`dusd1naqs}eaI9
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 17
`
`9cl
`
`
`
`uoyesyddyyouney
`
`
`
`GESAnoelajU]ayeI9
`
`
`
`aoedsuBisayes
`
`CCL
`
`Oct
`
`vel
`
`\sanbayJaspsyeqiuypuesaysuery
`
`
`
`
`
`ysanbey1asnaimdey
`
`ssaooyonewuesboigyBnosuy
`
`
`doyseqdz0}eoeds-qewo
`
`uoneziwoysngwesBolduopaseg)
`
`(
`
`soedsCEULM
`
`8cl
`
`
`pa:
`
`
`
`
`
`
`
`ysanbayUONEWOJU]JOPUIYSU}SAIBNOY0}[0.RUODSOJedo1gSuIUIA}Eq
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 17
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 6 of 30
`
`US 9,304,654 B2
`
`BUDEsOvHeBeLAS
`
`
`
`
`
`synsayYosRasjoUIBUC}oR]9g0}Jesp}dwoi
`
`POL
`
`
`
`
`
`Jasr,wosBusinduljsonboyyoieassalenay
`
`
`
`
`
`c9L
`
`
`
`
`
`
`
`899,+49919991--S991¥9q,-f99,“991
`
`
`
`
`
`BA
`
`bgqi
`
`OstB2LQZ
`pLcL
`
`OLL
`
`
`
`weiGolyojulBegYyoees
`
`891
`
`
`
`wesBorguoneoyddy
`
`Soepoyuy
`
`
`
`Buunjyden10)poyyaysuiajag
`
`
`
`
`
`
`
`
`
`
`
`SyNsayYyoIe9SJoIGEWoL}synsoyYoreagBulsieg10}sjqisuodsoyydisogWo}sn>peo
`
`
`
`
`
`
`
`
`
`88}
`
`981
`
`
`
`platyyxays,ebedqay,s,uiby9YyoseesO}UI
`
`
`
`
`
`Suisjnduyyenbayyoreeswo)
`
`
`
`ysonbayyesspainjdegsojug
`
`
`
`
`
`S,UIBUCYoIedSJO}FANJeyUS
`UsAlNSJOUlabegGan,
`
`oBedJ8SMOIgGSAA
`
`
`
`abegJesmoigqann
`UddIISHOmeq
`
`61
`
`00¢
`
`yupadALyoroO}
`
`abey[OUOZJaSMOlgGar,B}eIID
`
`
`
`
`
`payauue)TWNYyoeyJO}
`18SpueabeyuosyupadAy
`ALLLNVNDMOVLSSesity
`
`
`JoAnuentsurwuayeg
`aso1gpueaBbeyuo
`
`syuIpedAyAyquapy
`Aeuyueul
`
`ATSVIRIVA
`
`86L
`
`VP‘Sls
`
`aBbegganasled
`
`c6L
`
`aBedJaSMOJGMONulS}]INSaY
`
`SAI909y
`
`aBeweSuyeinwy
`
`Agyaseasyonpuoy
`
`uinjay
`
`061
`
`ge)
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 18
`
`c8t
`
`981
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 18
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 7 of 30
`
`US 9,304,654 B2
`
`
`yOR}SensiAulsabejoAeuyposweibeiqaes-soepajyu]Woysn95
`
`
`
`
`
`
`
`yBnory)yoe}sjensiAulsabeJasmosgGeAAHOS0}JaspuyMoly
`
`
`
`
`
`
`
`
`
`yeu)UONSabegan,}XONJo)Aujowoas)ayeinojeosy
`
`aoedsq-¢ulUOnISO,$31Bunejsues,pueuMogyBuyeasAqyoejsulAemy
`
`Jayyn4sueeddyi!
`
`
`au}JO}BBEjOUODJESMOlgGSAIXANJOINdjnojensi,MeIG
`
`
`siAedyjopugjjunaoedsueisaye9q-¢au}UleBe4syinsoy
`
`
`
`
`YoeaSS,UIBUOYoIReSWOYyUIEdAH9uU)0}pa}auuODTWN
`
`poyoray
`
`902v0e
`
`
`jeueYsoepayylS,WebolgUOUOWNgYBnoy)aoedgUeIseYeDQEUlUMeIgaq0}sabeggaryjoyoeRIS
`
`
`
`
`
`
`
`JensijojnokeyAypoyy0}wesBolg0}ayejdwiaywoysngpeoojses)pugmojly
`
`
`
`UeUlPayoidabeGan}S27]OU}0}YUITyeU)SoBeqayyay}IfepuesoedsueIsayeDGEay)UIpanoly
`
`
`a6edGanSe]2y}UOpuno.jaeyeu)syUIPadAHSU)josabeyGanOY)H1e}Olg0}1887)puyMOI
`
`
`
`
`
`
`wesbeigye}seqINOSyUrT/U]SYUr]Bag-BedjOUODJesMOIGGaAAJUELIND0}ddedSJUSDefpy
`
`
`
`
`
`seabedJaSMOlgGafhJOYOR}SJENSIAOu}JO}XapUSEJO0}avedsURISeLED
`
`
`
`
`
`
`
`
`
`QeulUMBIGSq0}YORISJeNsIAeBUlB6e,}sul4seabeYsynseyMeIG
`
`c0e
`
`Jeaday0}Jaspydwiog
`yoRsyensiAMONBumeIsAqabegsynsayYoueasjoJag]XONJO}SSa001q
`
`
`
`
`(29070}ay!yBAeS 8L¢
`JasnAgpadwosdUOWEIO7JBU}OJOJaAJASqanA“YOMJON‘JEINdWUOD
`
`
`
`
`
`ay‘Sls
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 19
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 19
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 8 of 30
`
`US 9,304,654 B2
`
`FIG. 5A
`
`
`
`
`FIG. 5B
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 20
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 20
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 9 of 30
`
`US 9,304,654 B2
`
`718
`
`—LI
`
`720,760
`
`FIG. 5C
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 21
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 21
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 10 of 30
`
`US 9,304,654 B2
`
`yORssIXANU!ABEJsul-{JojulOdmal,dnesojgo}pug
`
`
`
`yORISSNonalyulabejSst4JoywOdMaIAdnaso}Dofpuig
`
`
`JepicpayloadsulyoR}SAeuyLOS
`
`yoelsjensiaurabeyse7]JoJUjodmar,dnesojy0}pug
`
`
`
`
`
`
`BbzadedsueisayeDQEUlSJBUIPJOODZ'A'xXplod9y
`
`
`yoRsjensi,ulaeyxenJoyulodmaiadnaso|g0}puig
`
`
`jensiAjensiaabegabey
`YOSsnotaalg|}38°)XON
`
`wes|iYOR]
`BES9cve?cS0&282292
`
`
`
`
`zzYOR}SJENSIAU!BBegSNOIAadJOJIOdMaIAdnaso}DoO}puig
`
`
`
`YORISJensiAuyaHegJsulyJOjUIOdMalAdneso)y0)pug
`
`
`jauegsoepayyyuoynduyJespuz0)
`
`
`
`paseguonoyayeudoiddyajnoexy
`
`ove
`
`ye
`
`Ob
`
`
`
`Ovep22
`
`SNOBIst
`
`
`
`abedabey
`
`
`
`Jajpueyyjuangueos
`
`
`
`ynduy4asquo
`
`0c?e
`
`2OG
`
`0S¢
`
`9°14
`
`SZyohe
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 22
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 22
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 11 of 30
`
`US 9,304,654 B2
`
`260
`
`End UserClicks Close Button on any Texture Map
`of Web Browser Control Represented in Visual Stack
`
`262
`
`Remove Web Browser Page
`from Visual Stack
`
`264
`
`266
`
`Position of Removed Page in Stack
`Animated Page Before it was Moved
`
`Animate Forward Pageafter
`Removed Page to Replace
`
`Animate Pageafter Previously
`Animated Page to Original
`Position of Previously
`
`268
`
`270
`
`of Previously Animated Page
`
`Animate Forward Next Page in
`3D Visual Stack to Replace Position
`of Previously Animated Page
`
`Animate Next Page in
`Stack to Position
`
`272
`
`274
`
`Exit Loopif the End of Visual
`Stack or Last Elementin
`
`Array is Reached
`
`FIG. 7
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 23
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 23
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 12 of 30
`
`US 9,304,654 B2
`
`
`
`
`
`
`
`IENLIAPaPeO|UMOG|||ENUIAPapeojuMod||[ENUIAPapeoiumag||jeENUIApapeqruMmog||jenulApapeoiumog||jennypapeojumog
`
`jenuiA8UdUlaBueYD|}S,jUsDUleBueYD|)sjuayOuleBBueyD||sualulaBueyo||sjuayulaGueyy|}syuayguieBueyo
`
`
`
`
`
`
`
`yBnowuypayesipu;|}YyBnosyypayeoipuy||yOnosyypayesipuy||yBnosyypayeoipuyy||yBnosujpayeoipul{|yBnouypayeorpuysiaoeds
`
`Bursnsayndwo9BuisnJayndwogBuispsayndutoyBuisnJayndwo5BuisnsajndwonBuisnsayndwoy
`
`
`
`
`
`
`
`
`
`
`
`
`
`(enuiA$1asedsjenuip$1aoeds|enuiAsiaoedsjenastsoedsjen,Stadedg
`
`
`
`
`
`
`
`
`
`
`
`
`JUBAJENSIA,,WJUdAq[ENSIA,,wJUSAZ|ENSIA,,gUOAQJENSIA,wUBAZ[ENsiA,,USAF[ENSIA,
`JuaHDJasy]aiduinyy|[3UaH_Dsasheidginy
`
`
`
`Auejo8upAueJo8uQ
`
`MONYdeF30}aBueyDpazipewinor
`
`Jual[DAeAzWOJUBA[eNsiA,,
`
`goedsaoeds
`yoreJ0jafl4oeysnd
`
`JONdWODJaAIEgBl}0}
`
`
`
`0}sabueydpazieunorJoJ8yndwiodywuar|D0}af.4jeUIBUGUsNg
`
`
`aijUME$3Ulyoe3woysabueuyeziyeunor
`
`
`
`
`payeuiBugsehueyosieymsayndwiogBuipnjoxyayyjeubuo
`
`
`
`
`WUAIIDJesnaIdHINYy|/JUAIDJeshadyInyy||UaHDJes/aidainyy
`AuewJo9u0AueywjoauOAueyJo3u9
`¥8cC82
`
`
`
`JUBAZIENSIA,,
`
`8“Sid
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 24
`
`J9AIBSUOSOl}4
`PUBBySSAIgOayJaAIag
`
`
`
`osadedsjenvi,pares
`SIU}0}THNSeusiigng
`}|SSa00yUBDaUOAUY
`
`
`
`S{adedsjenyiajeulBUO
`
`Paysigndpuepayeaig
`
`PUWO)18A19g0}
`
`Jayndwo5syasn
`
`Uasashaidainyy
`Aueyjoaug
`
`
`
`'o6z
`
`bz6z
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 24
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 13 of 30
`
`US 9,304,654 B2
`
`6‘Old
`
`
`
`CeeONIETT
`
`bbea
`
`elCl|
`ves
`
`9S
`
`ve
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 25
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 25
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 14 of 30
`
`US 9,304,654 B2
`
`
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 26
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 26
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 15 of 30
`
`US 9,304,654 B2
`
`bb‘Sid
`
`
`
`“manda
`
`t}pest9Mon-kage-wooxeqomauyrcnyGFR?
`
`WOS'NSWN-tioorususmmyrdiy(@-.
`
`
`
`
`16009-wos'siSooSmanrchiyB®
`puemioAepuIMeN
`seyuoney=Melh,
`
`Ory
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 27
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 27
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 16 of 30
`
`US 9,304,654 B2
`
`Ets
`
`FIG.12
`
`Il
`
`s
`LE
`
`Cl
`Ld
`
`OqC
`
`YiewFavoritesJG2&RewindPlayForward
`
`464
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 28
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 28
`
`

`

`U.S. Patent
`
`Apr. 5, 2016
`
`Sheet 17 of 30
`
`US 9,304,654 B2
`
`VEL‘Old
`
`sewoseyaa
` bootterrithor
`
`
`
`
`
`
`
`
`078smoysAbidejensasoumswersésGuneedeunmeynducnApeuTOaloewwet'gegostsoionuyEf
`
`
`
`
`
`panesAW{-)aysvomajod:rybuldcooypolarseuarewsueRNOWOUNDEDWedjeuCKsNONSLceptsC1]SHONTRTID3seoeds
`
`
`
`
`Aang$e‘sreusoyruspoyerasAut22BxAUnGOpminedFeuNisON$800LononpoxdarAdopquaadjevorssoxdMOULAROLLE”a1}UoRDegO
`AuntaoseispewO41Jo89NDREWOpEL|,preWeTedetyJOSongaUERodetipurvogensiiaseqopy(jj
`
`
`SHRUPORTBUzbyyouns-euesedg
`
` sonytdAWfSOVJUBIN[WISNTOdVHDorsmeyAyfg‘TWNOISNANIG33UH1ONIGIAGUdHOdCOHANONYWBISASa4arysyooRoAy(J
`
`
`
`
`‘sjueunadpsay5BYonPechnoopZeuynuered
`
`JOUseyTERARGongvoumoiyfutdoo
`
`
`
`
`
`
`
`“proospetpnsyyGujeserveseuosinueygown‘AfuriOD20490ao;Ind"4-sBopmeg”yeodBurewyE71
`
`
`UNGHOOATINSUUND31d0IdMOHpawog[op
`
`b-6ES48
`
`
`
`
`
`wealiLeylin318-oBarieUees
`
`
`
`Unu’suoneniesay-yenuryGF
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 29
`
`SPACETIME3D
`EXHIBIT 2001 - PAGE 29
`
`

`

` MalK
`H&:yeLioNGLMONMVEVT:OeC___puootuatramamydnueh)a
`
`
`
`
`
`
`
`LOWOOO'OIS.[_Winsosison”|“sanoisaon1dfonuaveagooyes«sau-warwonipnran@@..sewn7.ofSORETTOOTSHILASSNTTYyyfNONworuncmmyrdialDBRaBES
`
`
`ee§6ioegolysayyStaNDBRwroOUAHMoUCayEDaRisanal,4
`
`
`fCOTSRUNTECTUREOUTDFOQUIaRywos
`
`
`
`
`
`
`{vit}Suondowinsowioepuedti~Abojoupa-ucoteay13NQ-woounasour2D-saan
`
`SMAN1S831¥1ANIa
`
`DIEMIOgABPueN2so0Aey
`
`bSy
`
`OLS
`
`
`affong-worsoolshoudng
`
`
`
`
`U.S.