PTO/AIA14 (11-15)
`Approved for use through 04/30/2017. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unlessit contains a valid OMB control number.
`
` .
`
`. Attorney Docket Number|AP026CON3
`
`
`Application Data Sheet 37 CFR 1.76
`
`Application Number
`
`
`
`Title of Invention|OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION CHANNELS
`
`
`
`
`
`
`
`The application data sheetis part of the provisional or nonprovisional application for whichit is being submitted. The following form contains the
`bibliographic data arranged in a format specified by the United States Patent and Trademark Office as outlined in 37 CFR 1.76.
`This document may be completed electronically and submitted to the Office in electronic format using the Electronic Filing System (EFS) or the
`document may be printed and included in a paperfiled application.
`
`Secrecy Order 37 CFR 5.2:
`
`Oo Portions or all of the application associated with this Application Data Sheet may fall under a Secrecy Order pursuant to
`37 CFR 5.2 (Paperfilers only. Applications that fall under Secrecy Order may not be filed electronically.)
`
`Inventor Information:
`
`Inventor
`Legal Name
`
`{1
`
`Remove
`
` a8 1
`
`ResidenceInformation (Select One)
`City
`
`US Residency
`e@ Non US Residency
`Country of Residence
`
`Active US Military Service
`
`Mailing Address of Inventor:
`
`Address 1
`
`P8 Levi Eshkeol Street
`
`Address 2
`|
`[Pesnana—_—*Y StatelProvince
`city
`Postal Code T|CountryTF
`Inventor
`2
`Legal Name
`
`
`
` Prefix} Given Name
`Middle Name
`Family Name
`
`ResidenceInformation (Select One)
`US Residency
`@) Non US Residency
`Active US Military Service
`
`
`
`
`Mailing Addressof Inventor:
`
`
`Address 2
`|
`
`[Perera SSSCSCSCSCSCSC—C~CSY StatePProvince
`Postal Code
`Country i
`| Ie
`All
`Inventors Must Be Listed - Additional
`Inventor Information blocks may be
`generated within this form by selecting the Add button.
`
`
`
`
`
`Add
`
`
`
`
`
`CorrespondenceInformation:
`EFS Web 2.2.12
`
`1 of 191
`
`Microsoft Corp. Exhibit 1016
`
`
`
`1 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`PTO/AIA14 (11-15)
`Approved for use through 04/30/2017. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number|AP026CON3
`
`
`
`
`
`OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION CHANNELS
`Title of Invention
`
`
` Application Data Sheet 37 CFR 1.76
`
`Application Number
`
`
`
`
`
`
`
`Enter either Customer Number or complete the Correspondence Information section below.
`For further information see 37 CFR 1.33(a).
`
`Add Email
`
`Remove Email
`
`Add Email
`
`Remove Email
`
`
`
`[_] An Addressis being provided for the correspondence Information of this application.
`
`
`Customer Number
`
`
`
`|w@IPLCounsel.com
`
`Email Address
`
`fsean@IPLCounsel.com
`
`Email Address
`
`
`
`Title of the Invention
`
`Application Information:
`
`
`
`
`
`
`
`
`[Rrozscons|SmallEntiyStatusClaimedBI
`Attorney Docket Number
`
`
`
`
`
`Rowomiont——SCSCSCSCSCSCSCSCSCSCSCSSSSSCSCSSSSTTTTCC‘dzC
`
`Application Type
`
`my
`Subject Matter
`
`
`
`
`Total Numberof Drawing Sheets (if any) Suggested Figure for Publication (if any)
`Filing By Reference:
`
`Only complete this section whenfiling an application by reference under 35 U.S.C. 111(c) and 37 CFR 1.57{a). Do not complete this section if
`application papers including a specification and any drawings are being filed. Any domestic benefit or foreign priority information must be
`provided in the appropriate section(s) below (i.e., “Domestic Benefit/National Stage Information’ and “Foreign Priority Information’).
`
`For the purposesofa filing date under 37 CFR 1.53(b), the description and any drawings of the present application are replaced by this
`reference to the previously filed application, subject to conditions and requirements of 37 CFR 1.57(a}.
`
`Application numberof the previously
`filed application
`
`Filing date (YYYY-MM-DD)
`
`Intellectual Property Authority or Country
`
`Publication Information:
`
`[_] Request Early Publication (Fee required at time of Request 37 CFR 1.219)
`
`Cl
`
`Req uest Not to Publish. | hereby request that the attached application not be published under
`35 U.S.C. 122(b) and certify that the invention disclosed in the attached application has not and will not be the
`subject of an application filed in another country, or under a multilateral international agreement, that requires
`publication at eighteen monthsafterfiling.
`
`i
`
`
`
`Representative Information:
`
`Representative information should be provided for all practitioners having a power of attorney in the application. Providing
`this information in the Application Data Sheet does not constitute a power of attorney in the application (see 37 CFR 1.32).
`Either enter Customer Number or complete the Representative Name section below.If both sections are completed the customer
`
`Numberwill be used for the Representative Information during processing.
`
`
`
`Please Select One:
`EFS Web 2.2.12
`
`@ Customer Number
`
`US Patent Practitioner
`2 of
`19
`
`
`(©) Limited Recognition (37 CFR 11.9
`)
`I
`Corp. Exhibi
`1D1
`UlO
`
`2 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`PTO/AIA14 (11-15)
`Approved for use through 04/30/2017. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`- Attorney Docket Number|AP026CON3.
`
`
`Application Data Sheet 37 CFR 1.76
`
`— T
`
`itle of Invention
`
`OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION CHANNELS
`
`Customer Number
`
`85070
`
`Domestic Benefit/National Stage Information:
`
`This section allows for the applicant to either claim benefit under 35 U.S.C. 119(e), 120, 121, 365(c), or 386(c) or indicate
`National Stage entry from a PCT application. Providing benefit claim information in the Application Data Sheet constitutes
`the specific reference required by 35 U.S.C. 119(e) or 120, and 37 CFR 1.78.
`Whenreferring to the current application, please leave the “Application Number’field blank.
`Prior Application StatusPending= Remove
`Filing or 371(c) Date
`(YYYY-MM-DD)
`
`Application Number
`
`Continuity Type
`
`Prior Application Number
`
`Application
`_
`Prior Application
`Filing Date
`Issue Date
`Number
`Continuity Type
`Number
`(YYYY-MM-DD)
`Patent Number
`(YYYY-MM-DD)
`
`!4970526
`[Continuation of
`-|
`[14547148
`port 119
`253239
`pot6-02-02
`
`
`Issue Date
`Filing Date
`Prior Application
`.
`Application
`Number
`Continuity Type
`Number
`(YYYY-MM-DD)
`Patent Number
`(YYYY-MM-DD)
`14547148
`| ontinuation of
`-| {i3027929
`|011-02-15
`6924506
`2014-12-30
`Prior Application Status iPatented= Remove
`Application
`_
`Prior Application
`Filing Date
`Issue Date
`Number
`Continuity Type
`(YYYY-MM-DD)
`Patent Number
`(YYYY-MM-DD)
`13027929
`| ontinuation in part of ~ |[12619643
`i.009-11-16
`908343
`P01 1-03-15
`
`
`
`
`
`
`
`Application Number
`0035987
`Prior Application Status
`
`
`Continuity Type
`| laims benefit of provisional
`
`Application Number
`0035987
`
`EFS Web 2.2.12
`
`Continuity Type
`| laims benefit of provisional
`
`
`
`.
`Application
`Continuity Type
`Number
`~| |10035987
`| ontinuation of
`12619643
`Prior Application Status Expired
`
`Prior Application
`
`Filing Date
`(YYYY-MM-DD)
`i001-12-24
`
`Application Number
`0035987
`
`Prior Application Status
`
`Continuity Type
`| laims benefit of provisional
`
`Prior Application Number
`-| 60258465
`
`
`
`Issue Date
`(YYYY-MM-DD)
`2010-01-05
`Remove
`Filing or 371(c) Date
`(YYYY-MM-DD)
`POO0-12-27
`
`Remove
`
`Patent Number
`644131
`
`
`
`Filing or 371(c) Date
`(YYYY-MM-DD)
`Prior Application Number
`
`| 60258466
`POOO-12-27
`
`Remove
`
`Filing or 371(c) Date
`(YYYY-MM-DD)
`PO00-12-27
`HGOD
`
`Prior Application Number
`| 60258467
`.
`
`nll
`
`J
`
`NA
`
`OD rp .
`
`O
`
`OD
`
`OD
`
`3 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`PTO/AIA14 (11-15)
`Approved for use through 04/30/2017. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`Attorney Docket Number|AP026CON3
`Application Data Sheet 37 CFR 1.76
`
`
`
`
`
`OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION CHANNELS
`Title of Invention
`
` Prior Application Status Expired
`
`Application Number
`
`Application Number
`
`Continuity Type
`
`
`Filing or 371(c) Date
`(YYYY-MM-DD)
`
`Prior Application Number
`
`
`
`
`
`
`
`
`0035987
`
`| laims benefit of provisional
`
`+ 60258468
`
`Application Number
`
`Continuity Type
`
`Prior Application Number
`
`POO0-12-27
`
`Filing or 371(c) Date
`(YYYY-MM-DD)
`
`0035987
`
`| laims benefit of provisional
`
`-| 60258488
`
`
`
`POOO-12-27
`
`Prior Application Number
`Continuity Type
`Application Number
`+| 60258489
`| laims benefit of provisional
`0035987
`Additional Domestic Benefit/National Stage Data may be generated within this form
`by selecting the Add button.
`
`Filing or 371(c) Date
`(YYYY-MM-DD)
`2000-12-27
`
`Foreign Priority Information:
`
`This section allows for the applicant to claim priority to a foreign application. Providing this information in the application data sheet
`constitutes the claim for priority as required by 35 U.S.C. 119{b) and 37 CFR 1.55. Whenpriority is claimed to a foreign application
`thatis eligible for retrieval under the priority document exchange program (PDX)! the information will be used by the Office to
`automatically attempt retrieval pursuant to 37 CFR 1.55(1)(1) and (2). Under the PDX program, applicant bears the ultimate
`responsibility for ensuring that a copy of the foreign application is received by the Office from the participating foreign intellectual
`property office, or a certified copy of the foreign priority application is filed, within the time period specified in 37 CFR 1.55(g){1).
`
`Remove
`Application Number
`Country!
`Filing Date (YYYY-MM-DD)
`Access Code! (if applicable)
`
`
`Additional Foreign Priority Data may be generated within this form by selecting the
`Add button.
`
`Add
`
`Statement under 37 CFR 1.55 or 1.78 for AIA (First Inventor to File) Transition
`Applications
`
`This application (1) claims priority to or the benefit of an application filed before March 16, 2013 and (2) also
`contains, or contained at any time, a claim to a claimed invention that has an effectivefiling date on or after March
`[] 16, 2013.
`NOTE: By providing this statement under 37 CFR 1.55 or 1.78, this application, with a filing date on or after March
`16, 2013, will be examined underthefirst inventor to file provisions of the AIA.
`
`EFS Web 2.2.12
`
`4 of 191
`
`Microsoft Corp. Exhibit 1016
`
`4 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`PTO/AIA14 (11-15)
`Approved for use through 04/30/2017. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`leat
`Application Data Sheet 37 CFR 1.76
`
`Title of Invention
`
`OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION CHANNELS
`
`
`
`Authorization or Opt-Out of Authorization to Permit Access:
`
`
`
`
`
`Whenthis Application Data Sheet is properly signed and filed with the application, applicant has provided written
`authority to permit a participating foreign intellectual property (IP) office access to the instant application-as-filed (see
`paragraph A in subsection 1 below) and the European Patent Office (EPO) access to any search results from the instant
`application (See paragraph B in subsection 1 below).
`
`Should applicant choose not to provide an authorization identified in subsection 1 below, applicant must opt-out of the
`authorization by checking the corresponding box A or B or both in subsection 2 below.
`
`NOTE: This section of the Application Data Sheet is ONLY reviewed and processed with the INITIALfiling of an
`application. After the initial filing of an application, an Application Data Sheet cannot be used to provide or rescind
`authorization for access by a foreign IP office(s).
`Instead, Form PTO/SB/39 or PTO/SB/69 must be used as appropriate.
`
`1. Authorization to Permit Access by a Foreign Intellectual Property Office(s)
`
`A. Priority Document Exchange (PDX)- Unless box A in subsection 2 (opt-out of authorization) is checked, the
`undersigned hereby grants the USPTO authority to provide the European Patent Office (EPO), the Japan Patent Office
`(JPO), the Korean Intellectual Property Office (KIP©), the State Intellectual Property Office of the People’s Republic of
`China (SIPO), the World Intellectual Property Organization (WIPO), and any other foreign intellectual property office
`participating with the USPTOin a bilateral or multilateral priority document exchange agreementin which a foreign
`application claiming priority to the instant patent application is filed, access to: (1) the instant patent application-as-filed
`andits related bibliographic data, (2) any foreign or domestic application to which priority or benefit is claimed by the
`instant application and its related bibliographic data, and (3) the date of filing of this Authorization. See 37 CFR 1.14(h)
`(1).
`
`B. Search Results from U.S. Application to EPO - Unless box B in subsection 2 (opt-out of authorization) is checked,
`the undersigned hereby grants the USPTO authority to provide the EPO accessto the bibliographic data and search
`results from the instant patent application when a European patent application claiming priority to the instant patent
`applicationis filed. See 37 CFR 1.14(h)(2).
`
`The applicant is reminded that the EPO’s Rule 141(1) EPC (European Patent Convention} requires applicants to submit a
`copy of search results from the instant application without delay in a European patent application that claims priority to
`the instant application.
`
`2. Opt-Out of Authorizations to Permit Access by a Foreign Intellectual Property Office(s)}
`
`[|
`
`A. Applicant DOES NOT authorize the USPTOto permit a participating foreign IP office access to the instant
`application-as-filed.
`If this box is checked, the USPTOwill not be providing a participating foreign IP office with
`any documents andinformation identified in subsection 1A above.
`
`B. Applicant DOES NOTauthorize the USPTOto transmit to the EPO any search results from the instant patent
`|] application. If this box is checked, the USPTO will not be providing the EPO with search results from the instant
`application.
`NOTE: Oncethe application has published or is otherwise publicly available, the USPTO may provide accessto the
`application in accordance with 37 CFR 1.14.
`
`EFS Web 2.2.12
`
`5 of 191
`
`Microsoft Corp. Exhibit 1016
`
`5 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`PTO/AIA14 (11-15)
`Approved for use through 04/30/2017. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`- Attorney Docket Number|AP026CON3.
`
`
`Application Data Sheet 37 CFR 1.76
`
`—
`
`Title of Invention
`
`OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION CHANNELS
`
`
`
`Applicant Information:
`
`Providing assignment information in this section does not substitute for compliance with any requirementof part 3 of Title 37 of CFR
`to have an assignment recorded by the Office.
`
`{1
`Applicant
`If the applicant is the inventor (or the remaining joint inventor or inventors under 37 CFR 1.45), this section should not be completed.
`The information to be provided in this section is the name and addressof the legal representative whois the applicant under 37 CFR
`1.43; or the name and addressof the assignee, person to whom the inventor is under an obligation to assign the invention, or person
`who otherwise showssufficient proprietary interest in the matter who is the applicant under 37 CFR 1.46. If the applicantis an
`applicant under 37 CFR 1.46 (assignee, person to whem theinventoris obligated to assign, or person who otherwise showssufficient
`proprietary interest) together with one or morejoint inventors, then the joint inventor or inventors who are also the applicant should be
`identified in this section.
`
`
`Clear
`
`@ Assignee
`
`
`
`Legal Representative under 35 U.S.C. 117
`
`Joint Inventor
`
`Person who showssufficient proprietary interest
`Person to whom the inventoris obligated to assign.
`
`lf applicant is the legal representative, indicate the authority to file the patent application, the inventor is:
`
`Nameof the Deceased or Legally Incapacitated Inventor:Po
`If the Applicant is an Organization check here.
`Xx]
`
`Organization Name
`
`i Bradium Technologies LLC
`
`Mailing Address Information For Applicant:
`
`
`
`
`
`|
`Address 2
`
`City [Guten«dyStaterovince[RY
`
`PhoneNumber]auNumber|
`J
`
`Email Address
`
`
`Additional Applicant Data may be generated within this form by selecting the Add button.
`
`Add
`
`Assignee Information including Non-Applicant Assignee Information:
`
`Providing assignment information in this section does not substitute for compliance with any requirement of part 3 of Title
`
`37 of CFR to have an assignment recorded by the Office.
`
`EFS Web 2.2.12
`
`6 of 191
`
`Microsoft Corp. Exhibit 1016
`
`6 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`Address 2
`
`Postal Code
`
`
`
`
`Mailing Address Information For Assignee including Non-Applicant Assignee:
`
` Address 1
`/5 Montebello Road
`
`
`State/Province
`
`
`
`
`a
`Phone Number
`
`
`
`Email Address
`
`Additional Assignee or Non-Applicant Assignee Data may be generated within this form by
`Add
`selecting the Add button.
`
`
`
`
`
`
`
`PTO/AIA14 (11-15)
`Approved for use through 04/30/2017. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`Attorney Docket Number|AP026CON3
`
`
`Application Data Sheet 37 CFR 1.76
`
`
`
`
`
`OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION CHANNELS
`Title of Invention
`
`
`Application Number
`
`Assignee
`
`(1
`
`Complete this section if assignee information, including non-applicant assignee information, is desired to be included on the patent
`application publication. An assignee-applicant identified in the "Applicant Information” section will appear on the patent application
`publication as an applicant. For an assignee-applicant, complete this section onlyif identification as an assigneeis also desired on the
`patent application publication.
`
`Remove
`
`
`If the Assignee or Non-Applicant Assignee is an Organization check here.
`Xx]
`
`Organization Name
`Bradium Technologies LLC
`
`
`Signature:
`NOTE: This Application Data Sheet must be signed in accordance with 37 CFR 1.33(b). However,if this Application
`Data Sheet is submitted with the INITIALfiling of the application and either box A or B is not checked in
`subsection 2 of the “Authorization or Opt-Out of Authorization to Permit Access”section, then this form must
`also be signed in accordance with 37 CFR 1.14(c).
`
`This Application Data Sheet must be signed by a patent practitioner if one or more of the applicants is a juristic
`entity (e.g., corporation or association). If the applicant is two or morejoint inventors, this form must be signed by a
`
`patent practitioner, all joint inventors who are the applicant, or one or morejoint inventor-applicants who have been given
`powerof attorney (e.g., see USPTO Form PTO/AIA/81) on behalf ofall joint inventor-applicants.
`See 37 CFR 1.4(d) for the manner of making signatures and certifications.
`
`{AnatolyS$.Weiser/
`Signature
`
`
`
`
`Date oto)
`
`
`
`2016-09-29
`
`3229
`
`Additional Signature may be generated within this form by selecting the Add button.
`
`EFS Web 2.2.12
`
`7 of 191
`
`Microsoft Corp. Exhibit 1016
`
`7 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`PTO/AIA14 (11-15)
`Approved for use through 04/30/2017. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`- Attorney Docket Number|AP026CON3.
`
`
`Application Data Sheet 37 CFR 1.76
`
`— T
`
`itle of Invention
`
`OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION CHANNELS
`
`This collection of information is required by 37 CFR 1.76. The information is required te obtain or retain a benefit by the public which
`is to file (and by the USPTOto process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This
`collection is estimated to take 23 minutes to complete, including gathering, preparing, and submitting the completed application data
`sheet form to the USPTO. Timewill vary depending upon the individual case. Any comments on the amount of time you require to
`complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and
`Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR
`COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissionerfor Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`EFS Web 2.2.12
`
`8 of 191
`
`Microsoft Corp. Exhibit 1016
`
`8 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`
`
`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection with your submission of the attached form related to a patent
`application or patent. Accordingly, pursuant to the requirements of the Act, please be advised that: (1) the general authority for the collection of this information
`is 35 U.S.C. 2(b) (2); (2) furnishing of the information solicited is voluntary; and (3) the principal purpose for which the information is used by the U.S. Patent and
`Trademark Office is to process and/or examine your submission related to a patent application or patent. If you do not furnish the requested information, the U.S.
`Patent and Trademark Office may not be able to process and/or examine your submission, which mayresult in termination of proceedings or abandonmentof
`the application or expiration of the patent.
`
`Theinformation provided by you in this form will be subject to the following routine uses:
`
`1.
`
`2.
`
`3
`
`The information cn this form will be treated confidentially to the extent allowed under the Freedom ofInformation Act (5 U.S.C. 552) and the Privacy
`Act (5 U.S.C. 552a). Records from this system of records may be disclosed to the Departmentof Justice to determine whether the Freedom of
`Information Act requires disclosure of these records.
`
`Arecord from this system of records may be disclosed, as a routine use, in the course of presenting evidence to a court, magistrate, or administrative
`tribunal, including disclosures to opposing counselin the course of settlement negotiations.
`
`Areécord in this system of records may be disclosed,as a routine use, to a Member of Congress submitting a request involving an individual, to whom
`the record pertains, when the individual has requested assistance from the Memberwith respect to the subject matter of the record.
`
`4. Arecordin this system of records may be disclosed,as a routine use, to a contractor of the Agency having need for the information in order to perform
`a contract. Recipients of information shall be required to comply with the requirements of the Privacy Act of 1974, as amended, pursuant to 5 U.S.C.
`552a(m).
`
`5. Arecord related to an International Application filed under the Patent Cooperation Treaty in this system of records may be disclosed, as a routine use,
`to the Internaticnal Bureau of the World Intellectual Property Organization, pursuant to the Patent CooperationTreaty.
`
`6. Arecord in this system of records may be disclosed, as a routine use, to another federal agency for purposes of National Security review (35 U.S.C. 181}
`and for review pursuant to the Atomic Energy Act (42 U.S.C. 218(c)).
`
`7. Arecord from this system of records may be disclosed, as a routine use, to the Administrator, General Services, or his/her designee, during an
`inspection of records conducted by GSAas part of that agency's responsibility to recommend improvements in records managementpractices and
`programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall be made in accordance with the GSA regulations governing inspection of
`recordsfor this purpose, and any other relevant(i.e., GSA or Commerce) directive. Such disclosure shall not be used tc make determinations about
`individuals.
`
`8. Arecord from this system of records may be disclosed,as a routine use, to the public after either publication of the application pursuant to 35 U.S.C.
`122(b) or issuance of a patent pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subjectto the limitations of 37 CFR 1.14, as a routine use,
`te the public if the record wasfiled in an application which became abandoned cr in which the proceedings were terminated and which application is
`referenced by either a published application, an application open to public inspections or an issued patent.
`
`9. Arecord from this system of records may be disclosed,as a routine use, to a Federal, State, or local law enforcement agency,if the USPTO becomes
`awareof a violation or potential violation of law or regulation.
`
`EFS Web 2.2.12
`
`of 16
`
`Mi
`
`+
`
`Cor —Exhibit
`
`1016
`
`
`
`9 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`-l-
`
`OPTIMIZED IMAGE DELIVERY OVER LIMITED BANDWIDTH COMMUNICATION
`
`CHANNELS
`
`Isaac Levanon
`
`Yonatan Lavi
`
`Priority Claims/Related Applications
`
`This application is a continuation of and claimspriority to U.S. Patent Application Serial
`
`No. 14/970,526, filed December 15, 2015, entitled OPTIMIZED IMAGE DELIVERY OVER
`
`LIMITED BANDWIDTH COMMUNICATION CHANNELS, now allowed; whichis a
`
`continuation of and claimspriority to U.S. Patent Application Serial No. 14/547,148, filed
`
`November 19, 2014, entitled OPTIMIZED IMAGE DELIVERY OVER LIMITED
`
`10
`
`BANDWIDTH COMMUNICATION CHANNELS, now U.S. Patent No. 9,253,239; which is a
`
`continuation of and claimspriority to U.S. Patent Application Serial No. 13/027,929, filed
`
`February 15, 2011, entitled OPTIMIZED IMAGE DELIVERY OVER LIMITED
`
`BANDWIDTH COMMUNICATION CHANNELS, now U.S. Patent No. 8,924,506; which is a
`
`continuation in part of and claimspriority to U.S. Patent Application Serial No. 12/619,643 filed
`
`15
`
`on November16, 2009, entitled OPTIMIZED IMAGE DELIVERY OVER LIMITED
`
`BANDWIDTH COMMUNICATION CHANNELS, now U.S. Patent No. 7,908,343; which is a
`
`continuation of and claimspriority to U.S. Patent Application Serial No. 10/035,987 filed on
`
`December24, 2001 and entitled OPTIMIZED IMAGE DELIVERY OVER LIMITED
`
`BANDWIDTH COMMUNICATION CHANNELS, now U.S. Patent No. 7,644,131; which
`
`20
`
`claims the benefit under 35 U.S.C. $119(e) of U.S. Provisional Application Nos. 60/258,488,
`
`60/258,489, 60/258,465, 60/258,468, 60/258,466, and 60/258,467, all filed December 27, 2000.
`
`The present application is also related to application serial number 10/035,981 entitled SYSTEM
`
`AND METHODS FOR NETWORKIMAGE DELIVERY WITH DYNAMIC VIEWING
`
`FRUSTUM OPTIMIZED FOR LIMITED BANDWIDTH COMMUNICATION CHANNELS,
`
`25
`
`Levanonetal., filed on December 24, 2001, now U.S. Patent No. 7,139,794, issued on
`
`November 21, 2006, whichis assigned to the Assignee of the present Application. The
`
`disclosuresof all of the foregoing patent documentsare incorporated herein by referenceas if
`
`fully set forth herein, including Figures, Claims, and Tables.
`
`10 of 191
`
`Microsoft Corp. Exhibit 1016
`
`10 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`Field
`
`The disclosure is related to network based, image distribution systems and,in particular,
`
`to a system and methodsfor efficiently selecting and distributing image parcels through a
`
`narrowband or otherwise limited bandwidth communications channel to support presentation of
`
`high-resolution images subject to dynamic viewing frustums.
`
`Background
`
`The Internet and or other network systems may provide a unique opportunity to transmit
`
`for example complex images, typically large scale bit-maps, particularly those approaching
`
`10
`
`photo-realistic levels, over large area and or distances. In common application, the images may
`
`be geographic, topographic, and or other highly detailed maps. The data storage requirements
`
`and often proprietary nature of such imagescould be such that conventional interests may be to
`
`transfer the images on an as-needed basis.
`
`In conventional fixed-site applications, the image data may be transferred over a
`
`15
`
`relatively high-bandwidth network to client computer systemsthat in turn, may render the
`
`image. Client systems may typically implementa local image navigation system to provide zoom
`
`and or pan functions based onuserinteraction. As well recognized problem with such
`
`conventional systems could be that full resolution image presentation may be subject to the
`
`inherent transfer latency of the network. Different conventional systems have been proposed to
`
`20
`
`reduce the latency affect by transmitting the image in highly compressed formats that support
`
`progressive resolution build-up of the image within the currentclient field of view. Using a
`
`transform compressed image transfer function increasesthe field of the image that can be
`
`transferred over a fixed bandwidth network in unit time. Progressive image resolution
`
`transmission, typically using a differential resolution method, permits an approximate image to
`
`25
`
`be quickly presented with image details being continuously added overtime.
`
`Tzou, in U.S. Pat. No. 4,698,689, describes a two-dimensional data transform system
`
`that supports transmission of differential coefficients to represent an image. Subsequent
`
`transmitted coefficient sets are progressively accumulated with prior transmitted sets to provide a
`
`11 of 191
`
`Microsoft Corp. Exhibit 1016
`
`11 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`-3-
`
`succeedingly refined image. The inverse-transform function performed by the client computeris,
`
`however, highly compute intensive. In order to simplify the transform implementation and
`
`further reduce the latency of presenting any portion of an approximate image, images are sub-
`
`divided into a regular array. This enables the inverse-transform function on the client, which is
`
`time-critical, to deal with substantially smaller coefficient data sets. The array size in Tzouis
`
`fixed, which leads to progressively larger coefficient data sets as the detail level of the image
`
`increases. Consequently, there is an inherently increasing latency in resolving finer levels of
`
`detail.
`
`An image visualization system proposed by Yapet al., U.S. Pat. No. 6,182,114,
`
`10
`
`overcomes someof the foregoing problems. The Yapet al. system also employs a progressive
`
`encoding transform to compress the image transfer stream. The transform also operates on a
`
`subdivided image, but the division is indexed to the encoding level of the transform. The
`
`encoded transform coefficient data sets are, therefore, of constant size, which supports a modest
`
`improvementin the algorithmic performanceof the inverse transform operation required on the
`
`15
`
`client.
`
`Yap et al. adds utilization of client image panning or other image pointing input
`
`information to support a foveation-based operator to influencethe retrieval order of the
`
`subdivided image blocks. This two-dimensional navigation information is used to identify a
`
`foveal region that is presumed to be the gaze point of a client system user. The foveation
`
`20
`
`operator defines the corresponding image block as the center point of an orderedretrieval of
`
`coefficient sets representing a variable resolution image. The gaze point image block represents
`
`the area of highest image resolution, with resolution reduction as a function of distance from the
`
`gaze point determined by the foveation operator. This technique thus progressively builds image
`
`resolution at the gaze point and succeedingly outward based on a relatively compute intensive
`
`25
`
`function. Shifts in the gaze point can be responded to with relative speed by preferentially
`
`retrieving coefficient sets at and near the new foveal region.
`
`Significant problems remain in permitting the convenient and effective use of complex
`
`images by manydifferent types of client systems, even with the improvements provided by the
`
`various conventional systems. In particular, the implementation of conventional image
`
`30
`
`visualization systems is generally unworkable for smaller, often dedicated or embedded,clients
`
`12 of 191
`
`Microsoft Corp. Exhibit 1016
`
`12 of 191
`
`Microsoft Corp. Exhibit 1016
`
`

`

`-4-
`
`where use of image visualization would clearly be beneficial. Conventional appro