`
`
`
`
`
`
`
`
`
`
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`
`
`
`
`
`
`
`
`
`MICROSOFT CORPORATION,
`Petitioner,
`
`v.
`
`BRADIUM TECHNOLOGIES LLC,
`Patent Owner.
`
`
`
`
`
`
`
`
`
`
`
`PTAB Case No. IPR2017-01817
`Patent No. 9,635,136 B2
`
`
`
`
`
`
`
`
`
`
`
`PETITION FOR INTER PARTES REVIEW
`OF U.S. PATENT NO. 9,635,136 B2
`
`
`
`
`
`
`
`
`Page
`EXHIBIT LIST ....................................................................................................... iii
`I.
`INTRODUCTION .......................................................................................... 1
`II. MANDATORY NOTICES UNDER 37 C.F.R.§42.8(B) .............................. 1
`III. REQUIREMENTS FOR INTER PARTES REVIEW ..................................... 3
`A. GROUND FOR STANDING ............................................................... 3
`B.
`IDENTIFICATION OF CHALLENGE ............................................... 3
`IV. CLAIM LISTING ........................................................................................... 5
`A.
`Independent Claim 1 ............................................................................ 5
`B.
`Dependent Claims 2-9 .......................................................................... 7
`C.
`Independent Claim 10 .......................................................................... 8
`D. Dependent Claims 11-18 .................................................................... 10
`E.
`Independent Claim 19 ........................................................................ 11
`F.
`Dependent Claims 20-27 .................................................................... 13
`V. OVERVIEW OF THE ’136 PATENT ......................................................... 14
`A.
`PRIORITY DATE OF THE ’136 PATENT ...................................... 14
`B.
`SUMMARY OF THE ’136 PATENT ................................................ 14
`C.
`THE FILE HISTORY OF THE ’136 PATENT SHOWS THAT
`THE EXAMINER DID NOT CONSIDER THE CITED
`REFERENCES ................................................................................... 16
`LEVEL OF ORDINARY SKILL IN THE ART ............................... 17
`PROPOSED CLAIM CONSTRUCTION .......................................... 17
`1.
`“Wireless Portable Device” in Claims 1, 10, and 19: .............. 18
`2.
`“Thereby Enabling Efficient Use of Network Bandwidth
`in Conditions of Network Latency” in Claims 1, 10, and
`19 .............................................................................................. 19
`“Configure[d] as a Server to Provide Access to [the] at
`Least Some Image Parcels Received by the Wireless
`Portable Device” in Claims 1, 10, and 19 ................................ 19
`“Image Parcel” in Claims 1, 10, and 19 ................................... 20
`
`D.
`E.
`
`3.
`
`4.
`
`TABLE OF CONTENTS
`
`
`-i-
`
`
`
`TABLE OF CONTENTS
`(continued)
`
`2.
`
`Page
`All Other Claim Terms ............................................................ 22
`5.
`VI. THERE IS A REASONABLE LIKELIHOOD THAT AT LEAST
`ONE CLAIM OF THE ’136 PATENT IS UNPATENTABLE ................... 23
`A.
`THE CITED REFERENCES ARE PRIOR ART .............................. 23
`B.
`GROUND 1: CLAIMS 1-4, 6-8, 10-13, 15-17, 19-22, AND 24-
`26 ARE UNPATENTABLE UNDER 35 U.S.C. § 103(A)
`OVER REDDY IN VIEW OF WOODS ............................................ 25
`1.
`Reddy and Woods show that the Purported Solutions
`Claimed by the ’136 Patent were not Novel in the
`Technical Field ......................................................................... 26
`A POSITA Would Combine Reddy and Woods in the
`Claimed Manner ....................................................................... 34
`Claim 1 ..................................................................................... 37
`Claim 10 ................................................................................... 62
`Claim 19 ................................................................................... 64
`Dependent Claims 2-4, 6-8, 11-13, 15-16, 20-22, and 24-
`26 .............................................................................................. 65
`GROUND 2: CLAIMS 5, 14, AND 23 ARE
`UNPATENTABLE UNDER 35 U.S.C. § 103(A) OVER
`REDDY IN VIEW OF WOODS AND CHIARABINI ..................... 73
`1.
`The Reddy–Woods–Chiarabini Combination .......................... 73
`2.
`Claims 5, 14, and 23 ................................................................ 75
`D. GROUND 3: CLAIMS 9, 18, AND 27 ARE
`UNPATENTABLE UNDER 35 U.S.C. § 103(A) OVER
`REDDY IN VIEW OF WOODS AND FULLEr ............................... 78
`1.
`The Reddy–Woods–Fuller Combination ................................. 78
`2.
`Claims 9, 18, and 27 ................................................................ 80
`VII. CONCLUSION ............................................................................................. 81
`
`3.
`4.
`5.
`6.
`
`C.
`
`-ii-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`
`EXHIBIT LIST
`U.S. Patent No. 9,635,136 B2 to Levanon et al. (“the 136 Patent”)
`
`Ex.1001
`
`Ex.1002
`
`U.S. Patent No. 9,253,239 B2 to Levanon et al. (“the 239 Patent”)
`
`Ex.1003
`
`U.S. Patent No. 5,956,036 B2 to Woods et al. (“Woods”)
`
`Ex.1004
`
`Reddy et al., “TerraVision II: Visualizing Massive Terrain Databases
`in VRML,” IEEE Computer Graphics and Applications March/April
`1999, pp. 30-38 (“Reddy” with added paragraph numbers by
`Petitioner for ease of reference in the Petition)
`
`Ex.1005
`
`Declaration of Prof. William R. Michalson (“Michalson Decl.”)
`
`Ex.1006
`
`U.S. Patent No. 7,324,228 B2 to Chiarabini et al. (“Chiarabini”)
`
`Ex.1007
`
`Printout of IEEE Explore citations to Reddy et al. (Ex.1004)
`
`Ex.1008
`
`Printout of Google Scholar citations to Reddy et al. (Ex.1004)
`
`Ex.1009
`
`Cover page and authenticating declaration of Reddy et al. (Ex.1004)
`from British Library
`
`Ex.1010
`
`Cover page of Reddy et al. (Ex.1004) from Linda Hall Library
`
`Ex.1011
`
`B. Fuller and I. Richer, The MAGIC Project: From Vision to Reality,
`IEEE Network May/June 1996, pp. 15-25
`
`Ex.1012
`
`U.S. Patent No. 7,908,343 B2 to Levanon et al. (“the 343 Patent”)
`
`Ex.1013
`
`U.S. Patent No. 8,924, 506 B2 to Levanon et al. (“the 506 Patent”)
`
`Ex.1014
`
`
`
`
`Visualization System for SRI’s Digital Earth Proposal, dated
`April 16, 1999, available at http://www.ai.sri.com/digitalearth/
`proposal/visualization-system.html
`
`Ex.1015
`
`Isaac Levanon Linkedin profile
`
`Ex. 1016
`
`'136 File History
`
`Ex. 1017 Not Used in This Proceeding
`
`
`
`-iii-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`Deposition Transcript of Peggy Agouris, dated January 13, 2017
`
`Ex.1018
`
`Ex.1019
`
`Deposition Transcript of Isaac Levanon, dated January 18, 2017
`
`Ex.1020
`
`Fujitsu Technical Reference Guide, Stylistic 2300 (1998)
`
`Ex.1021
`
`Bradium Provisional Application No. 60/258465
`
`Ex.1022
`
`The Universal Grid System, NGA Office of GEOINT Sciences,
`March 2007
`
`Ex.1023 Wolford, B., FXT1: 3dfx Texture Compression, Last Updated
`September 14, 1999, available at http://web.archive.org/web/
`20000114134331/http://www.combatsim.com/htm/sept99/3dfx-
`tc1.htm
`
`Ex.1024
`
`U.S. Patent Publication No. 2008/0294332 A1 to Levanon et al.
`
`Ex.1025
`
`U.S. Patent No. 7,561,156 B2 to Levanon et al.
`
`Ex.1026 May 10, 2017 letter from M. Zachary to M. Bernstein
`
`Ex.1027-1029
`
`Not Used in This Proceeding
`
`Ex.1030
`
`Barclay, T. et al., Microsoft TerraServer: A Spatial Data Warehouse,
`Microsoft Research, June 1999, Revised February 2000.
`
`Ex. 1031
`
`Intel Microprocessor Quick Reference Guide - Product Family,
`available at http://www.intel.com/pressroom/kits/quickreffam.htm
`
`Ex. 1032 Barclay, T. et al., Microsoft TerraServer: A Spatial Data Warehouse,
`Microsoft Research, June 1999.
`
`Ex. 1033 Microsoft Terraserver Abstract, Cornell University Library, Submitted
`September 5, 1998.
`
`Ex. 1034 Barclay, T. et al., The Microsoft TerraServer, Microsoft Research,
`June 1998.
`
`Ex. 1035 Barclay, T. et al., Microsoft TerraServer: A Spatial Data Warehouse,
`ACM, 2000.
`
`
`
`
`-iv-
`
`
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`Ex. 1036 Barclay, T. et al., Microsoft TerraServer: SQL Server 7.0, Microsoft,
`June 1998, available at https://msdn.microsoft.com/en-
`us/library/aa226316(v=sql.70).aspx.
`
`Ex. 1037 Microsoft, Partners Announce Microsoft TerraServer – Global Atlas
`Is World’s Largest Database on the Web, Microsoft News Center,
`posted June 24, 1998, available at
`https://news.microsoft.com/1998/06/24/microsoft-partners-announce-
`microsoft-terraserver-global-atlas-is-worlds-largest-database-on-the-
`web/#bMPkijPvjZ8sDgPw.97.
`
`Ex. 1038
`
`Ex. 1039
`
`Ex. 1040
`
`Ex. 1041
`
`Ex. 1042
`
`TerraServer Image Loading and Cutting Process, available at
`https://web.archive.org/web/20000914164508/http://terraserver.micro
`soft.com/qa_load_graph2.asp.
`
`TerraServer Story, TerraServer Site Story, available at https://web-
`beta.archive.org/web/19991129051006/http://terraserver.microsoft.co
`m/terra_story_images.asp.
`
`TerraServer Image Loading and Cutting Process, TerraServer Site
`Story, available at https://web-
`beta.archive.org/web/20000309231237/http://terraserver.microsoft.co
`m/terra_story_load.asp.
`
`TerraServer Scale, TerraServer Site Story, available at https://web-
`beta.archive.org/web/20000226014211/http://terraserver.microsoft.co
`m/terra_story_scale.asp.
`
`TerraServer Interface, TerraServer Site Story, available at
`https://web.archive.org/web/20000707214318/http://terraserver.micro
`soft.com:80/terra_story_interface.asp.
`
`Ex. 1043 Namir C. Shammas, Foundations of C++ and Object-Oriented
`Programming (1995).
`
`Ex. 1044
`
`Patrick Killelea, Web Performance Tuning: Speeding Up the Web
`(Linda Mui ed., 1st ed., October 1998).
`
`
`
`
`-v-
`
`
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`Ex. 1045 Microsoft Computer Dictionary (4th ed., 1999).
`
`Ex. 1046
`
`Steve Lohr, Apple Offers iMac's Laptop Offspring, the iBook, N.Y.
`Times (July 22, 1999), http://www.nytimes.com/1999/07/22/business/
`apple%ADoffers%ADimac%ADs%ADlaptop%ADoffspring%ADthe
`%ADibook.html .
`
`Ex. 1047 Apple iBook Feature Page, Apple Computer, available at
`https://web.archive.org/web/ 19991001211542/
`http://apple.com:80/ibook/mobility.html
`
`Ex. 1048 Airport Technical Fact Sheet, Apple Computer, Inc. (1999).
`
`Ex. 1049 Wireless Networking A Technical Overview: Understanding and
`Using Airport Networks, Airport 1.1, Apple (2000).
`
`Ex. 1050 Rick Bause, IBM announces the new Thinkpad X Series Ultraportable
`Computer (September 11, 2000), http://www03.ibm.com/press/
`us/en/pressrelease/1559.wss.
`
`Ex. 1051 RangeLAN2 7410 CE PC Card: Mobilizing the Workforce with
`Handheld PCs, Proxim, Inc. (1999).
`
`Ex. 1052 Cisco Aironet 340 Series Products: Quick Reference Guide, Cisco
`Systems (2000).
`
`Ex. 1053 Chuck Musciano & Bill Kennedy, HTML & XHTML: The Definitive
`Guide (Mike Loukides and Deb Cameron eds., 4th ed., 2000).
`
`Ex. 1054 Mark R. Brown, Special Edition Using Netscape 2: The Most
`Complete Reference (1995).
`
`Ex. 1055 Abraham Silberschatz and Peter Baer Galvin, Operating System
`Concepts (5th ed., February 1998).
`
`Ex. 1056 Aaron Cohen and Mike Woodring, Win32 Multithread Programming:
`Building Thread-Safe Applications (Ron Petrusha ed., 1st ed., January
`1998).
`
`
`
`
`-vi-
`
`
`
`
`
`Ex. 1057
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`Steve Kleinman, Devang Shah and Bart Smaalders, Programming
`With Threads (1996).
`
`Ex. 1058 Douglas Boling, Programming: Microsoft Windows CE (1998).
`
`Ex. 1059
`
`Eric Giguere, Palm Database Programming: The Complete
`Developer's Guide (Carol Long ed., 1999).
`
`Ex. 1060 William R. Stanek, Mozilla Source Code Guide (1999).
`
`Ex. 1061 Gagan Saksena, nsCacheManager, Mozilla Source Code (1998).
`
`Ex. 1062 Gagan Saksena, nsMemModule, Mozilla Source Code (1998).
`
`Ex. 1063 Gagan Saksena, nsDiskModule, Mozilla Source Code (1998).
`
`Ex. 1064
`
`Francesco Balenna, Programming Microsoft Visual Basic 6.0 (1999).
`
`Ex. 1065 U.S. Patent No. 4,972,319 to Delorme
`
`Ex. 1066
`
`Provisional Application No. 60/258,465 filed December 27, 2000.
`
`Ex. 1067
`
`Provisional Application No. 60/258,466 filed December 27, 2000.
`
`Ex. 1068
`
`Provisional Application No. 60/258,467 filed December 27, 2000.
`
`Ex. 1069
`
`Provisional Application No. 60/258,468 filed December 27, 2000.
`
`Ex. 1070
`
`Provisional Application No. 60/258,488 filed December 27, 2000.
`
`Ex. 1071
`
`Provisional Application No. 60/258,489 filed December 27, 2000.
`
`Ex. 1072
`
`Excerpt of Initial Claim Chart, Bradium Techs. LLC v. Microsoft
`Corporation, No. 15-cv-31-RGA (D. Del).
`
`Ex. 1073 Bing Map Tile System, Bing Maps Articles, available at
`http://msdn.microsoft.com/en-us/library/bb259689.aspx.
`
`
`
`
`
`
`-vii-
`
`
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`
`I.
`
`INTRODUCTION
`
`Pursuant to 35 U.S.C. § 311 and 37 C.F.R. § 42.100, Microsoft Corporation
`
`(“Microsoft” or “Petitioner”) petitions for inter partes review (IPR) of claims 1-27
`
`of U.S. Patent No. 9,635,136 (“the ’136 Patent,” Ex. 1001), owned by Bradium
`
`5
`
`Technologies LLC (“Bradium” or “Patent Owner”).
`
`The ’136 Patent broadly claims dividing large sets of imagery (e.g.,
`
`geographic imagery) into “image parcels” at varying levels of detail to allow users
`
`to browse such imagery online. The cited references show how this concept was
`
`well-known before the priority date of the ’136 Patent.
`
`10
`
`Therefore, claims 1-27 are unpatentable under pre-AIA 35 U.S.C. § 103.
`
`II. MANDATORY NOTICES UNDER 37 C.F.R.§42.8(B)
`REAL PARTY IN INTEREST: Petitioner is the only real party in interest
`
`and there are no other real parties in interest under 35 U.S.C. § 312(a)(2) and
`
`37 C.F.R. § 42.8(b)(1).
`
`15
`
`RELATED MATTERS: Four patents related to the ’136 Patent, U.S. Patent
`
`Nos. 9,253,239 B2 (“the ’239 Patent”), 7,139,794 B2 (“the ’794 Patent”),
`
`7,908,343 B2 (“the ’343 Patent”), and 8,924,506 B2 (“the ’506 Patent”), are being
`
`asserted against Petitioner in an ongoing patent infringement lawsuit brought by
`
`Patent Owner in Bradium Techs. v. Microsoft, 1:15-cv-00031-RGA, filed January
`
`20
`
`9, 2015. Bradium has accused Microsoft of infringing the ’136 Patent (Ex. 1026),
`
`
`
`-1-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`but has not yet served Microsoft with a complaint alleging infringement of the ’136
`
`Patent. Therefore, the 1-year time bar of 35 U.S.C. § 315(b) does not apply to this
`
`Petition.
`
`Petitioner has previously filed IPR petitions challenging four related patents
`
`5
`
`in suit and one additional Bradium patent:
`
`• ’794 Patent: IPR2015-01432, instituted Dec. 23, 2015, Final Written
`
`Decision issued Dec. 21, 2017
`
`• ’343 Patent:
`
`o IPR2015-01434, institution denied Dec. 23, 2015
`
`10
`
`o IPR2016-00448, instituted July 25, 2016
`
`• ’506 Patent:
`
`o IPR2015-01435, institution denied Dec. 23, 2015
`
`o IPR2016-00449, instituted July 27, 2016
`
`• ’239 Patent: IPR2016-01897, instituted April 5, 2017
`
`15
`
`• U.S. Patent No. 9,641,644: IPR2017-01616, filed June 22, 2017
`
`Petitioner is also concurrently filing a petition for IPR of U.S. Patent No.
`
`9,641,645.
`
`NOTICE OF COUNSEL AND SERVICE INFORMATION: Pursuant to
`
`37 C.F.R. §§ 42.8(b)(3), 42.8(b)(4) and 42.10(a), Petitioner appoints Chun M. Ng
`
`20
`
`(Reg. No. 36,878) as its lead counsel, Matthew C. Bernstein (pro hac vice),
`
`
`
`-2-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`Patrick J. McKeever (Reg. No.66,019), Vinay P. Sathe (Reg. No.55,595), Evan
`
`S. Day (Reg. No. 75,992), and Miguel J. Bombach (Reg. No. 68,636) as its back-
`
`up counsel. Lead counsel is at the address of 1201 Third Avenue, Suite 4900,
`
`Seattle, WA 98101 and contact number of 206-359-6400. All back-up counsel are
`
`5
`
`at the mailing address of Perkins Coie LLP, 11988 El Camino Real, Suite 350, San
`
`Diego, CA 92130, contact numbers of 858-720-5700 (phone) and 858-720-5799
`
`(fax). All counsel for Petitioner may be reached at the following email for service
`
`and communications:
`
`PerkinsServiceBradiumIPR@perkinscoie.com.
`
`10
`
`
`
`Pursuant to 37 C.F.R. § 42.10(b), a Power of Attorney is concurrently filed.
`
`III. REQUIREMENTS FOR INTER PARTES REVIEW
`This Petition complies with all statutory requirements and requirements
`
`under 37 C.F.R. §§ 42.104, 42.105 and 42.15 and thus should be accorded a filing
`
`date as of the date of filing of this Petition pursuant to 37 C.F.R. § 42.106.
`
`A. GROUND FOR STANDING
`Pursuant to 37 C.F.R. § 42.104(a), Petitioner certifies that the ’136 Patent is
`
`available for IPR and that Petitioner is not barred or estopped from requesting IPR
`
`challenging claims of the ’136 Patent.
`
`IDENTIFICATION OF CHALLENGE
`
`B.
`Claims Challenged: Pursuant to 37 C.F.R. §§ 42.104(b) and 42.22, Petitioner
`
`requests that the Board institute an IPR trial on claims 1-27 of the ’136 Patent, and
`
`15
`
`20
`
`
`
`-3-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`
`cancel all of these claims.
`
`The Prior Art: The prior art references relied upon are Reddy (Ex. 1004),
`
`Woods (Ex. 1003), Chiarabini (Ex. 1006), and Fuller (Ex. 1011), which are
`
`discussed in this Petition and the Declaration of Prof. William Michalson (Ex.
`
`5
`
`1005).
`
`Supporting Evidence Relied Upon For The Challenge: The evidence
`
`includes the Michalson Declaration (Ex. 1005) and other supporting evidence in
`
`the Exhibit List. If IPR is instituted, Petitioner may seek additional discovery
`
`including a deposition of co-inventor Yonatan Lavi.
`
`10
`
`Statutory Ground(s) Of Challenge And Legal Principles: Pursuant to
`
`37 C.F.R. § 42.104 (b)(2), the review of patentability of claims 1-27 is governed by
`
`pre-AIA 35 U.S.C. §§ 102 and 103. Further, statutory provisions of 35 U.S.C.
`
`§§ 311 to 319 and 325(d) govern this IPR.
`
`Claim Construction: The ’136 Patent is an unexpired patent and each claim
`
`15
`
`shall be given “its broadest reasonable interpretation [BRI] in light of the
`
`specification of the patent in which it appears” to a person of ordinary skill in the
`
`art (“POSITA”). 37 C.F.R. § 42.100(b); Cuozzo Speed Techs. v. Lee, 136 S. Ct.
`
`2131, 2142-46 (2016).
`
`
`
`-4-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`How Claims Are Unpatentable Under Statutory Grounds: Pursuant to
`
`37 C.F.R. § 42.104 (b)(4), Section V explains how claims 1-27 are unpatentable
`
`and specifies where each claim element is found in the cited prior art.
`
`IV. CLAIM LISTING
`The Challenged Claims of the ’136 Patent are the following:
`
`5
`
`A.
`
`INDEPENDENT CLAIM 1
`
`Identifier
`
`Preamble
`
`1.A
`
`1.B
`
`1.C
`
`1.D
`
`1.E
`
`1.F
`
`1.G
`
`
`
`Claim Element
`
`A method of communicating images for display to a plurality of
`wireless portable devices, the method comprising steps of:
`
`pre-processing a source image to obtain a series (K0, K1 . . . KN)
`of related images of progressively lower image resolution,
`
`wherein each related image of the series (K0, K1 . . . KN)
`comprises pixel data and is subdivided into a regular array of
`image parcels, and each image parcel of each regular array of the
`image parcels forms a discrete portion of the source image;
`
`storing the image parcels of the series for serving by one or more
`servers;
`
`providing client software to a wireless portable
`device;
`
`receiving a first request at the one or more servers from the first
`wireless portable device over a network communication channel,
`
`wherein the network communication channel is at least in part
`wireless, and
`
`the first request being for a first image parcel of the series,
`wherein the first image parcel is selected based on a first user-
`controlled image viewpoint on the first wireless portable device
`relative to the source image;
`
`-5-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`sending the first image parcel from the one or more servers to the
`first wireless portable device over the network communication
`channel, in response to the first request;
`
`receiving a second request at the one or more servers from the
`first wireless portable device over the network communication
`channel,
`
`the second request being for a second image parcel of the series,
`wherein the second image parcel is selected based on the first
`user-controlled image viewpoint on the first wireless portable
`device relative to the source image,
`
`the step of receiving the second request being performed after the
`step of receiving the first request; and
`
`sending the second image parcel from the one or more servers to
`the first wireless portable device over the network communication
`channel, in response to the second request; wherein:
`
`the first wireless portable device renders at least a portion of the
`first image parcel before finishing receiving the second image
`parcel;
`
`the first wireless portable device issues the first request and the
`second request according to a priority order;
`
`priority of the second request in the priority order is not higher
`than priority of the first request in the priority order;
`
`the first wireless portable device stores the first image parcel and
`the second image parcel in a local parcel storage at the first
`wireless portable device;
`
`before issuing the first request, the first wireless portable device
`determines that a third image parcel is usable for the first user-
`controlled image viewpoint and the third image parcel is already
`stored in the local parcel storage, and the first wireless portable
`device renders the third image parcel before issuing the first
`request without requesting the third image parcel over the
`network communication channel;
`
`-6-
`
`1.H
`
`1.I
`
`1.J
`
`1.K
`
`1.L
`
`1.M
`
`1.N
`
`1.O
`
`1.P
`
`1.Q
`
`
`
`
`
`1.R
`
`1.S
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`the first wireless portable device handles download operations of
`at least the first image parcel and the second image parcel in
`parallel, thereby enabling efficient use of network bandwidth in
`conditions of network latency; and
`
`the local parcel store is configured as a server to provide access to
`the at least some image parcels received by the first wireless
`portable device.
`
`
`B. DEPENDENT CLAIMS 2-9
`
`Claim
`
`Claim Element
`
`2
`
`3
`
`4
`
`5
`
`6
`
`7
`
`
`
`The method of claim 1, wherein the first user-controlled image
`viewpoint is determined based on a navigational input of the first
`wireless portable device.
`
`The method of claim 2 wherein the navigational input comprises
`three-dimensional positional coordinate data and rotational
`positional data.
`
`The method of claim 2, wherein the first wireless portable device
`stores requests for image parcels to be downloaded from the one
`or more servers in a priority queue, and wherein responsive to a
`change in the navigational input, a request is removed from the
`priority queue.
`
`The method of claim 1, wherein number of parallel image parcel
`download operations by the first wireless portable device for
`image parcels of the series is determined based at least in part on
`network response latency and available system resources.
`
`The method of claim 1, further comprising sending overlay data
`by the one or more servers to the first wireless portable device
`over the network communication channel.
`
`The method according to claim 6, wherein the overlay data
`comprises text annotations relating to at least one item selected
`from the group consisting of: one or more street names, one or
`
`-7-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`more building names, and one or more landmarks.
`
`The method of claim 1, wherein the wireless portable device
`issues the first request and the second request according to a
`priority order based at least in part on viewable areas
`corresponding to the first user-controlled image viewpoint.
`
`The method of claim 1, wherein the first wireless portable device
`issues the first request and the second request according to a
`priority order based at least in part on resolution of the first image
`parcel and resolution of the second image parcel.
`
`8
`
`9
`
`
`
`C.
`
`INDEPENDENT CLAIM 10
`
`Identifier
`
`Preamble
`
`10.A
`
`10.B
`
`10.C
`
`10.D
`
`10.E
`
`
`
`Claim Element
`
`A computing system comprising one or more servers, wherein the
`one or more servers are coupled to a wireless portable device by a
`network communication channel, the network communication
`channel being at least in part wireless, the one or more servers
`being configured to:
`
`pre-process a source image to obtain a series (K0, K1 . . . KN) of
`related images of progressively lower image resolution,
`
`wherein each related image of the series (K0, K1 . . . KN)
`comprises pixel data and is subdivided into a regular array of
`image parcels, and each image parcel of each regular array of the
`image parcels forms a discrete portion of the source image;
`
`store the image parcels of the series for serving by the one or
`more servers;
`
`provide client software to the wireless portable
`device;
`
`receive a first request from the wireless portable device over the
`network communication channel,
`
`-8-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`the first request being for a first image parcel of the series,
`wherein the first image parcel is selected based on a first user-
`controlled image viewpoint on the wireless portable device
`relative to the source image;
`
`send the first image parcel from the one or more servers to the
`wireless portable device over the network communication
`channel, in response to the first request;
`
`receive a second request from the wireless portable device over
`the network communication channel,
`
`the second request being for a second image parcel of the series,
`wherein the second image parcel is selected based on the first
`user-controlled image viewpoint on the wireless portable device
`relative to the source image,
`
`the second request being received by the one or more servers after
`the first request is received by the one or more servers; and
`
`send the second image parcel from the one or more servers to the
`wireless portable device over the network communication
`channel, in response to the second request; wherein:
`
`the wireless portable device renders at least a portion of the first
`image parcel before finishing receiving the second image parcel;
`
`the wireless portable device issues the first request and the second
`request according to a priority order;
`
`priority of the second request in the priority order is not higher
`than priority of the first request in the priority order;
`
`the wireless portable device stores the first image parcel and the
`second image parcel in a local parcel storage at the first wireless
`portable device;
`
`before issuing the first request, the first wireless portable device
`determines that a third image parcel is usable for the first user-
`controlled image viewpoint and that the third image parcel is
`already stored in the local parcel storage, and the wireless
`portable device renders the third image parcel before issuing the
`
`-9-
`
`10.F
`
`10.G
`
`10.H
`
`10.I
`
`10.J
`
`10.K
`
`10.L
`
`10.M
`
`10.N
`
`10.O
`
`10.P
`
`
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`first request without requesting the third image parcel over the
`network communication channel;
`
`the wireless portable device handles download operations of at
`least the first image parcel and the second image parcel in
`parallel, thereby enabling efficient use of network bandwidth in
`conditions of network latency; and
`
`the local parcel store is configured as a server to provide access to
`the at least some image parcels received by the wireless portable
`device.
`
`10.Q
`
`10.R
`
`
`D. DEPENDENT CLAIMS 11-18
`
`Claim
`
`Claim Element
`
`11
`
`12
`
`13
`
`14
`
`15
`
`
`
`The computing system of claim 10, wherein the first user-
`controlled image viewpoint is determined based on a navigational
`input of the wireless portable device.
`
`The computing system of claim 11, wherein the navigational input
`comprises three-dimensional positional coordinate data and
`rotational positional data.
`
`The computing system of claim 11, wherein the wireless portable
`device stores requests for the image parcels of the series to be
`downloaded from the one or more servers in a priority queue, and
`wherein responsive to a change in the navigational input, a
`request is removed from the priority queue.
`
`The computing system of claim 10, wherein number of parallel
`image parcel download operations by the wireless portable device
`for the image parcels of the series is determined based at least in
`part on network response latency and available system resources.
`
`The computing system of claim 10, wherein the one or more
`servers are further configured to send overlay data to the wireless
`portable device over the network communication channel.
`
`-10-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`The computing system of claim 15, wherein the overlay data
`comprises text annotations relating to at least one item selected
`from the group consisting of: one or more street names, one or
`more building names, and one or more landmarks.
`
`The computing system of claim 10, wherein the wireless portable
`device issues the first request and the second request according to
`a priority order based at least in part on viewable areas
`corresponding to the first user-controlled image viewpoint.
`
`The computing system of claim 10, wherein the wireless portable
`device issues the first request and the second request according to
`a priority order based at least in part on resolution of the first
`image parcel and resolution of the second parcel.
`
`16
`
`17
`
`18
`
`
`
`E.
`
`INDEPENDENT CLAIM 19
`
`Identifier
`
`Preamble
`
`19.A
`
`19.B
`
`19.C
`
`19.D
`
`
`
`
`
`Claim Element
`
`A wireless portable device, wherein
`
`the wireless portable device is coupled to one or more servers
`over a network communication channel, the network
`communication channel being at least in part wireless,
`
`the one or more servers storing a series (K0, K1 . . . KN) of
`related images of progressively lower image resolution,
`
`each related image of the series (K0, K1 . . . KN) comprising
`pixel data and being subdivided into a regular array of image
`parcels, each image parcel of each regular array of the image
`parcel of the series forming a discrete portion of a source image,
`
`the series being obtained by processing the source image, the one
`or more servers being configured to serve the related images of
`the series;
`
`the wireless portable device is configured to:
`
`-11-
`
`
`
`IPR Petition of U.S. Patent No. 9,635,136 B2
`PTAB Case No. IPR2017-01817
`determine a first image parcel of the series based on a first user-
`controlled image viewpoint on the wireless portable device
`relative to the source image;
`
`send a first request for the first image parcel of the series to the
`one or more servers over the network communication channel;
`
`receive the first image parcel from the one or more servers over
`the network communication channel, in response to the first
`request;
`
`determine a second image parcel based on the first user-controlled
`image viewpoint on the wireless portable device relative to the
`source image;
`
`send a second request for the second image parcel to the one or
`more servers, the second request being sent after the first request;
`and
`
`receive the second image parcel from the one or more servers to
`the wireless portable device over the network communication
`channel, in response to the second request;
`
`render at least a portion of the first image parcel before finishing
`receiving the second image parcel;
`
`store the first image parcel and the second image parcel in a local
`parcel storage at the first wireless portable device;
`
`before sending the first request, determine that a third image
`parcel is usable for the first user-controlled image viewpoint and
`the third image parcel is already stored in the local parcel storage,
`and render the third image parcel without requesting the third
`image parcel over the network communications channel;
`
`handle download operations of at least the first image parcel and
`the second image parcel in parallel, thereby enabling efficient use
`of network bandwidths in conditions of network latency;
`
`configure the local parcel store as a server to provide access to at
`least some