DOC Code: PD.TO. AUTH
`
`PTO/SB/39 (06-07)
`Approved for use through 09/30/2007. OMB 0651 -OO31
`U.S. Patent and Trademark Office; US. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number.
`
`AUTHORIZATION To PERMIT _~lication Number COMP—UETEIFKNOWN
`
`ACCESS To APPL'CAT'ON BY ——
`PARTICIPATING OFFICES ——
`_—
`
`Send completed form to: Commissioner for Patents
`PO. Box 1450, Alexandria, VA 22313-1450
`
`Title
`(Required)
`
`
`
`The undersigned hereby grants the USPTO authority to provide the European Patent Office (EPO), the
`Japan Patent Office (JPO), and any other intellectual property offices in which a foreign application
`claiming priority to the above-identified application is filed access to the above-identified patent application.
`See 37 CFR 1.14(c) and (h).
`
`In accordance with 37 CFR 1.14(h)(3), access will be provided to a copy of the application-as-filed with
`respect to: 1) the above-identified application, 2) any foreign application to which the above-identified
`application claims priority under 35 USC 119(a)—(d) if a copy of the foreign application that satisfies the
`certified copy requirement of 37 CFR 1.55 has been filed in the above-identified US application, and 3) any
`US application from which benefit is sought in the above-identified application.
`
`This written authorization should be submitted prior to the filing of a subsequent foreign application, in
`which priority is claimed to the above-identified patent application, with any intellectual property office (e.g.,
`the EPO or JPO).
`
`No fee will be charged under 37 CFR 1.19(b)(1) for providing a participating intellectual property office with
`an electronic copy of the above-identified application.
`
`This form must be signed by an authorized party in accordance with 37 CFR 1.14(c).
`
`/Shun Yao/
`
`Attorney of Record
`
`Signature
`
`Printed or Typed Name
`
`Date
`
`(530) 759—1667
`
`Telephone Number
`
`59,242
`
`Registration Number, if applicable
`
`This collection of information is required by 37 CFR 1.14(h). The information is required to obtain or retain a benefit by the public which is to file (and by
`the USPTO to process an application). Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 6
`minutes to complete, including gathering. preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the
`individual case. Any comments on the amount of time you require to complete this form and/or suggestions for reducing this burden, should be sent to
`the Chief information Officer, U.S. Patent and Trademark Office, U.S. Department of Commerce, PO. Box 1450, Alexandria, VA 22313—1450. DO NOT
`SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`If you need assistance in completing the form, call 1-800—PTO-9199 and select option 2.
`
`Page 1 of 474
`
`SNAP EXHIBIT 1004
`
`Page 1 of 474
`
`SNAP EXHIBIT 1004
`
`

`

`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection
`with your submission of the attached form related to a patent application or patent. Accordingly,
`pursuant to the requirements of the Act, please be advised that: (1) the general authority for the
`collection of this information is 35 U.S.C. 2(b)(2); (2) furnishing of the information solicited is voluntary;
`and (3) the principal purpose for which the information is used by the US. Patent and Trademark
`Office is to process and/or examine your submission related to a patent application or patent. If you do
`not furnish the requested information, the US. Patent and Trademark Office may not be able to
`process and/or examine your submission, which may result in termination of proceedings or
`abandonment of the application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1 .
`
`The information on this form will be treated confidentially to the extent allowed under the
`Freedom of Information Act (5 U.S.C. 552) and the Privacy Act (5 U.S.C 552a). Records from
`this system of records may be disclosed to the Department of Justice to determine whether
`disclosure of these records is required by the Freedom of Information Act.
`A record from this system of records may be disclosed, as a routine use, in the course of
`presenting evidence to a court, magistrate, or administrative tribunal, including disclosures to
`opposing counsel in the course of settlement negotiations.
`A record in this system of records may be disclosed, as a routine use, to a Member of
`Congress submitting a request involving an individual, to whom the record pertains, when the
`individual has requested assistance from the Member with respect to the subject matter of the
`record.
`
`A record in this system of records may be disclosed, as a routine use, to a contractor of the
`Agency having need for the information in order to perform a contract. Recipients of
`information shall be required to comply with the requirements of the Privacy Act of 1974, as
`amended, pursuant to 5 U.S.C. 552a(m).
`A record related to an International Application filed under the Patent Cooperation Treaty in
`this system of records may be disclosed, as a routine use, to the International Bureau of the
`World Intellectual Property Organization, pursuant to the Patent Cooperation Treaty.
`A record in this system of records may be disclosed, as a routine use, to another federal
`agency for purposes of National Security review (35 U.S.C. 181) and for review pursuant to
`the Atomic Energy Act (42 U.S.C. 218(0)).
`A record from this system of records may be disclosed, as a routine use, to the Administrator,
`General Services, or his/her designee, during an inspection of records conducted by GSA as
`part of that agency’s responsibility to recommend improvements in records management
`practices and programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall
`be made in accordance with the GSA regulations governing inspection of records for this
`purpose, and any other relevant (i.e., GSA or Commerce) directive. Such disclosure shall not
`be used to make determinations about individuals.
`
`A record from this system of records may be disclosed, as a routine use, to the public after
`either publication of the application pursuant to 35 U.S.C. 122(b) or issuance of a patent
`pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subject to the limitations of 37
`CFR 1.14, as a routine use, to the public if the record was filed in an application which
`became abandoned or in which the proceedings were terminated and which application is
`referenced by eithera published application, an application open to public inspection or an
`issued patent.
`A record from this system of records may be disclosed, as a routine use, to a Federal, State,
`or local law enforcement agency, if the USPTO becomes aware of a violation or potential
`violation of law or regulation.
`
`Page 2 of 474
`
`Page 2 of 474
`
`

`

`PTOISBI14 (06—07)
`Approved for use through 0673012010. OMB 0651-0032
`US. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Application Data Sheet 37 CFR 1.76
`
`_
`
`_
`
`document may be printed and included in a paper filed application.
`
`Title of Invention
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`The application data sheet is part of the provisional or nonprovisional application for which it is being submitted. The following form contains the
`bibliographic data arranged in a format specified by the United States Patent and Trademark Office as outlined in 37 CFR 1.76.
`This document may be completed electronically and submitted to the Office in electronic format using the Electronic Filing System (EFS) or the
`
`
`Secrecy Order 37 CFR 5.2
`
`|:| Portions or all of the application associated with this Application Data Sheet may fall under a Secrecy Order pursuant to
`
`37 CFR 5.2 (Paper filers only. Applications that fall under Secrecy Order may not be filed electronically.)
`
`
`
`
`Applicant Information:
`
`Applicant 1
`
`Applicant Authority @Inventor OLegal Representative under 35 U.S.C. 117
`
`OParty of Interest under 35 U.S.C. 118
`
`Victoria
`ME.
`
`
`Residence Information (Select One) @ US Residency 0 Non US Residency 0 Active US Military Service
`
`Mailing Address of Applicant:
`Address 1
`612 Andover Street
`
`
`Address 2
`
`Applicant 2
`
`Applicant Authority @Inventor OLegal Representative under 35 U.S.C. 117
`
`OParty of Interest under 35 U.S.C. 118
`
`——_
`Residence Information (Select One) @ US Residency 0 Non US Residency 0 Active US Military Service
`
`City
`
`Sunnyvale
`
`StateIProvince
`
`Country of Residencei
`
`US
`
`Citizenship under 37 CFR 1.41(b) i
`
`FR
`
`Mailing Address of Applicant:
`
`——
`
`Family Name
`
`
`Applicant 3
`
`Applicant Authority @Inventor | QLegal Representative under 35 U.S.C. 117 ‘OParty of Interest under 35 U.S.C. 118
`Prefix Given Name
`Middle Name
`
`
`
`Residence Information (Select One) @ US Residency 0 Non US Residency 0 Active US Military Service
`City
`San Francisco
`| StateIProvince | CA
`| Country of Residencei | US
`EFS Web 2.2.0
`
`Page 3 of 474
`
`Page 3 of 474
`
`

`

`PTOISBI14 (06—07)
`Approved for use through 0673012010. OMB 0651-0032
`US. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number
`_
`
`_—
`
`PARC-20080172—US-NP
`—
`
`Application Data Sheet 37 CFR 1.76
`
`
`
`Title of Invention
`
`I
`CONTEXT AND ACT VITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`S
`
`Citizenship under 37 CFR1.41(b)i
`I U
`
`Mailing Address of Applicant:
`
`707 Height Street #4
`Address 1
`
`Address 2
`
`
`
`| CA
`| StateIProvince
`San Francisco
`City
`
`Postal Code 94117 | Countryl US
`
`
`Applicant 4
`
`
`
`OParty of Interest under 35 USS 118
`Applicant Authority @Inventor OLegal Representative under 35 U_S_C_ 117
`
`Prefix Given Name
`Middle Name
`Family Name
`
`
`
`Philippe
`
`J.P.
`
`Golle
`
`Residence Information (Select One)
`
`(0 US Residency 0 Non US Residency 0 Active US Military Service
`
`City
`
`San Francisco
`
`StateIProvince
`
`Country of Residence i
`
`
`Citizenship under 37 CFR 1.41(b) l
`FR
`
`Mailing Address of Applicant:
`
`Address 1
`Address 2
`
`
`255 King Street, Apt. 1007
`
`
`
`| CA
`I StateIProvince
`San Francisco
`City
`
`
`Postal Code 94107 | Countryl US
`
`Applicant 5
`
`
`
`Applicant Authority @Inventor OLegal Representative under 35 U_S_C_ 117
`
`OParty of Interest under 35 USS 118
`
`
`Qingfeng
`Huang
`
`Residence Information (Select One) @ US Residency 0 Non US Residency 0 Active US Military Service
`
`Remove
`
`Mailing Address of Applicant:
`
`Address 1
`4708 Strawberry Lane
`
`Address 2
`
`
`
`
`95129
`
`State! Province
`
`US
`
`Postal Code
`
`Applicant 6
`
`Applicant Authority @Inventor OLegal Representative under 35 U_S_C_ 117
`
`OParty of Interest under 35 USS 118
`
`Residence Information (Select One) @ US Residency 0 Non US Residency 0 Active US Military Service
`
`City
`
`Santa Cruz
`
`StateIProvince
`
`Country of Residencei
`
`US
`
`Citizenship under 37 CFR 1.41(b) l
`
`US
`
`EFS Web 2.2.0
`
`Page 4 of 474
`
`Page 4 of 474
`
`

`

`PTOISBI14 (06—07)
`Approved for use through 0673012010. OMB 0651-0032
`US. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`—
`
`Attorney Docket Number
`_
`
`_—
`
`PARC-20080172—US-NP
`
`Application Data Sheet 37 CFR 1.76
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`Title of Invention
`
`
`
`Mailing Address of Applicant:
`Address 1
`821 California Street
`
`Address 2
`
`StateIProvince
`
`Santa Cruz
`Postal Code 95050 | Countryl US
`
`
`
`
`
`Applicant 7
`iOParty of Interest under 35 U.S.C. 118
`Applicant Authority @Inventor OLegal Representative under 35 U.S.C. 117
`
`Prefix Given Name
`Middle Name
`Family Name
`
`E.
`
`Kurt
`
`Partridge
`
`
`
`
`
`Residence Information (Select One)
`
`(0 US Residency 0 Non US Residency 0 Active US Military Service
`
`City
`
`Palo Alto
`
`StateIProvince
`
`Country of Residence i
`
`
`Citizenship under 37 CFR 1.41(b) l
`US
`
`Mailing Address of Applicant:
`
`Address 1
`
`Address 2
`
`4129 El Camino Way #U
`
`Palo Alto
`
`State! Province
`
`
`
`Postal Code
`US
`
`Applicant 8
`
`OParty of Interest under 35 U.S.C. 118
`Applicant Authority @Inventor OLegal Representative under 35 U.S.C. 117
`Family Name
`Prefix Given Name
`Middle Name
`Yee
`Nicholas
`K.
`
`
`Residence Information (Select One) @ US Residency 0 Non US Residency 0 Active US Military Service
`
`City
`
`Mountain View
`
`StateIProvince
`
`Country of Residencei
`
`US
`
`Citizenship under 37 CFR 1.41(b) i
`
`US
`
`Mailing Address of Applicant:
`
`Address 1
`541 Del Medio Avenue, Apt. 217
`Address 2
`
`City Mountain View I StateIProvince I CA
`
`
`Postal Code
`94040
`
`
`
`
`
`Applicant 9
`
`Applicant Authority @Inventor OLegal Representative under 35 U.S.C. 117
`Prefix— Middle Name
`
`OParty of Interest under 35 U.S.C. 118
`Family Name
`
`Residence Information (Select One) @ US Residency 0 Non US Residency 0 Active US Military Service
`
`City
`
`StateIProvince
`
`Country of Residencei
`
`US
`
`EFS Web 2.2.0
`
`Page 5 of 474
`
`Page 5 of 474
`
`

`

`PTOISBI14 (06—07)
`Approved for use through 0613012010. OMB 0651-0032
`US. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number
`_
`
`_—
`
`PARC-20080172—US-NP
`
`—
`
`Application Data Sheet 37 CFR 1.76
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`Title of Invention
`
`
`
`Mailing Address of Applicant:
`
`Address 1
`Address 2
`
`1016 Ingram Court
`
`Sunnyvale
`State! Province
`
`Postal Code 94037 I Countryl US
`
`
`
`All
`Inventors Must Be Listed - Additional
`Inventor Information blocks may be
`
`Correspondence Information:
`
`Enter either Customer Number or complete the Correspondence Information section below.
`For further information see 37 CFR 1.33(a).
`
`|:| An Address is being provided for the correspondence Information of this application.
`Customer Number
`
`Email Address
`
`shun@parklegal.com
`
`Add Email
`
`Application Information:
`
`Title of the Invention
`
`
`
`CONTEXT AND ACTIVITY—DRIVEN CONTENT DELIVERY AND INTERACTION
`
`
`generated within this form by selecting the Add button.
`
`
`
`
`————
`——
`
`Total Number of Drawing Sheets (if any)
`4
`Suggested Figure for Publication (if any)
`
`Publication Information:
`
`|:| Request Early Publication (Fee required at time of Request 37 CFR 1.219)
`
`Request Not to Publish. I hereby request that the attached application not be published under 35
`U.S.C. 122(b) and certify that the invention disclosed in the attached application has not and will not be the
`subject of an application filed in another country, or under a multilateral international agreement, that requires
`publication at eighteen months after filing.
`
`Representative Information:
`
`Representative information should be provided for all practitioners having a power of attorney in the application. Providing
`this information in the Application Data Sheet does not constitute a power of attorney in the application (see 37 CFR 1.32).
`Enter either Customer Number or complete the Representative Name section below. If both sections
`are completed the Customer Number will be used for the Representative Information during processing.
`
`Please Select One:
`
`0 US Patent Practitioner 0 Limited Recongnition (37 CFR 11.9) Customer Number
`
`® Customer Number
`35699
`
`EFS Web 2.2.0
`
`Page 6 of 474
`
`Page 6 of 474
`
`

`

`PTOISBI14 (06—07)
`Approved for use through 0613012010. OMB 0651-0032
`US. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number
`_
`
`_—
`
`PARC-20080172—US-NP
`
`—
`
`Application Data Sheet 37 CFR 1.76
`
`Title of Invention
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`Domestic Benefit Information:
`
`This section allows for the applicant to claim benefit under 35 U.S.C. 119(e), 120, 121, or 365(0). Providing this information in the
`application data sheet constitutes the specific reference required by 35 U.S.C. 119(e) or 120, and 37 CFR 1.78(a)(2) or CFR 1.78(a)
`(4), and need not otherwise be made part of the specification.
`
` Prior Application Status
`
`Application Number
`
`Continuity Type
`
`Prior Application Number
`
`Filing Date (YYYY-MM-DD)
`Additional Domestic Priority Data may be generated within this form by selecting the Add button.
`
`Foreign Priority Information:
`
`This section allows for the applicant to claim benefit of foreign priority and to identify any prior foreign application for which priority is
`not claimed. Providing this information in the application data sheet constitutes the claim for priority as required by 35 U.S.C. 119(b)
`and 37 CFR 1.55(a).
`
`
`Application Number
`Country I
`Parent Filing Date (YYYY-MM-DD)
`Priority Claimed
`
`Add button.
`
`Additional Foreign Priority Data may be generated within this form by selecting the
`
`Add
`
`0 Yes @ No
`
`Assignee Information:
`Providing this information in the application data sheet does not substitute for compliance with any requirement of part 3 of Title 37
`
`of the CFR to have an assignment recorded in the Office.
`
`Assignee 1
`
`If the Assignee is an Organization check here.
`
`Organization Name
`| Palo Alto Research Center Incorporated
`Mailing Address Information:
`
`Address 1
`
`Address 2
`
`3333 Coyote Hill Road
`
`
`
`Phone Number
`
`Email Address
`
`(650) 812-4000
`
`Fax Number
`
`Additional Assignee Data may be generated within this form by selecting the Add
`button.
`
`
`Signature:
`
`A signature of the applicant or representative is required in accordance with 37 CFR 1.33 and 10.18. Please see 37
`CFR 1.4(d) for the form of the signature.
`
` m [Shun Yao/
`Date (YYYY-MM-DD)
`2008-12-02
`
`EFS Web 2.2.0
`
`Page 7 of 474
`
`Page 7 of 474
`
`

`

`PTOISBI14 (06—07)
`Approved for use through 0613012010. OMB 0651-0032
`US. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number
`
`PARC-20080172—US-NP
`
`Application Data Sheet 37 CFR 1.76
`
` Title of Invention
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`
`First Name
`Shun
`Last Name
`Yao
`Registration Number
`59242
`
`This collection of information is required by 37 CFR 1.76. The information is required to obtain or retain a benefit by the public which
`is to file (and by the USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This
`collection is estimated to take 23 minutes to complete, including gathering, preparing, and submitting the completed application data
`sheet form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you require to
`
`
`complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, US. Patent and
`
`
`Trademark Office, US. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT S_ND FE_S OR
`COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`EFS Web 2.2.0
`
`Page 8 of 474
`
`Page 8 of 474
`
`

`

`Privacy Act Statement
`
`
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection with your submission of the attached form related to
`a patent application or patent. Accordingly, pursuant to the requirements of the Act, please be advised that:
`(1) the general authority for the collection
`of this information is 35 U.S.C. 2(b)(2); (2) furnishing of the information solicited is voluntary; and (3) the principal purpose for which the information is
`used by the U.S. Patent and Trademark Office is to process andlor examine your submission related to a patent application or patent.
`If you do not
`furnish the requested information, the US. Patent and Trademark Office may not be able to process andlor examine your submission, which may
`result in termination of proceedings or abandonment of the application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1.
`
`The information on this form will be treated confidentially to the extent allowed under the Freedom of Information Act (5 U.S.C. 552) an
`the Privacy Act (5 U.S.C. 552a). Records from this system of records may be disclosed to the Department of Justice to determine whether
`the Freedom of Information Act requires disclosure of these records.
`
`A record from this system of records may be disclosed, as a routine use, in the course of presenting evidence to a court, magistrate, or
`administrative tribunal, including disclosures to opposing counsel in the course of settlement negotiations.
`
`A record in this system of records may be disclosed, as a routine use, to a Member of Congress submitting a request involving an
`individual, to whom the record pertains, when the individual has requested assistance from the Member with respect to the subject matter of
`the record.
`
`A record in this system of records may be disclosed, as a routine use, to a contractor of the Agency having need for the information in
`order to perform a contract. Recipients of information shall be required to comply with the requirements of the Privacy Act of 1974, as
`amended, pursuant to 5 U.S.C. 552a(m).
`
`A record related to an International Application filed under the Patent Cooperation Treaty in this system of records may be disclosed, a
`a routine use, to the International Bureau of the World Intellectual Property Organization, pursuant to the Patent Cooperation Treaty.
`
`A record in this system of records may be disclosed, as a routine use, to another federal agency for purposes of National Security
`review (35 U.S.C. 181) and for review pursuant to the Atomic Energy Act (42 U.S.C. 218(c)).
`
`A record from this system of records may be disclosed, as a routine use, to the Administrator, General Services, or hislher designee,
`during an inspection of records conducted by GSA as part of that agency's responsibility to recommend improvements in records
`management practices and programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall be made in accordance with the
`GSA regulations governing inspection of records for this purpose, and any other relevant (i.e., GSA or Commerce) directive. Such
`disclosure shall not be used to make determinations about individuals.
`
`A record from this system of records may be disclosed, as a routine use, to the public after either publication of the application pursuan
`to 35 U.S.C. 122(b) or issuance of a patent pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subject to the limitations of 37
`CFR 1.14, as a routine use, to the public if the record was filed in an application which became abandoned or in which the proceedings were
`terminated and which application is referenced by either a published application, an application open to public inspections or an issued
`patent.
`
`A record from this system of records may be disclosed, as a routine use, to a Federal, State, or local law enforcement agency, if the
`USPTO becomes aware ofa violation or potential violation of law or regulation.
`
`
`EFS Web 2.2.0
`
`Page 9 of 474
`
`Page 9 of 474
`
`

`

`ATTORNEY DOCKET NO. PARC-20080172-US-NP
`
`PATENT APPLICATION
`
`CONTEXT AND ACTIVITY-DRIVEN
`
`CONTENT DELIVERY AND INTERACTION
`
`Inventors: Victoria M. E. Bellotti, Nicolas B. Ducheneaut, Glenn E. Durfee,
`
`Philippe J. P. Golle, Qingfeng Huang, Marc E. Mosko, Kurt E. Partridge,
`Nicholas K. Yee, and Rebecca L. Braynard
`
`10
`
`15
`
`BACKGROUND
`
`Field of the Invention
`
`[0001] The present invention generally relates to techniques and systems
`
`for creating and presenting content to a user. More specifically, the present
`
`invention relates to techniques and systems for creating and presenting content
`
`based on contextual information.
`
`W [
`
`0002] Advancements in computing technology continue to improve
`
`communication between people and provide versatile ways to deliver information.
`
`These advancements have allowed communities around the world to interact and
`
`share information with each other. In particular, mobile devices are becoming an
`
`30
`
`integral part of human life, as people often carry a mobile device throughout their
`
`Attorney Docket No. PARC -20080172-US-NP
`JXC - PARC—20080172—US—NP Patent Annlicationdoc
`
`Inventors: Victoria M. E. Bellotti, et a1.
`
`1
`
`Page 10 of 474
`
`Page 10 of 474
`
`

`

`day. These mobile devices can include a mobile phone, a personal digital
`
`assistant (PDA), an MP3 player, a handheld game console, and a laptop computer.
`
`Newer generations of these mobile devices are developed with more computation
`
`power and a growing number of communication features.
`
`[0003]
`
`In effect, many of these mobile devices can perpetuate a fast-
`
`paccd lifestyle for their users, as they may help users schedule the time around
`
`their responsibilities. However, these technological advances do not effectively
`
`help their users cope with this increase in pace. Typical working professionals
`
`may have a number of communication channels that they monitor, and they often
`
`10
`
`need to remind themselves to monitor these channels. Also, these users typically
`
`have a list of errands they need to complete, and this list may grow throughout a
`
`work week because they do not remember to complete these errands until the
`
`weekend. Furthermore, these users often need to continue advancing their skills,
`
`but their work and social schedules do not allow much free time for extended
`
`15
`
`study.
`
`[0004] Unfortunately, mobile devices are not effective in helping
`
`working professionals accommodate their responsibilities around their busy
`
`schedule, because these mobile devices are not capable of learning and
`
`understanding the behavior of their users. Furthermore, these mobile devices
`
`cannot determine when and how best to provide their users with information or
`
`suitable entertainment content, because they do not take into account the activities
`
`that their users are involved in.
`
`SUMMARY
`
`[0005] One embodiment of the present invention provides a computing
`
`device that delivers personally-defined context-based content to a user. This
`
`Attorney Docket No. PARC -20080172-US-NP
`JXC - PARC—20080172—US—NP Patent Annlicationdoc
`
`Inventors: Victoria M. E. Bellotti, et al.
`
`2
`
`Page 11 of 474
`
`Page 11 of 474
`
`

`

`computing device receives a set of contextual information with respect to the user,
`
`and processes the contextual information to determine whether some aspect of the
`
`current context can be associated with a probable activity being performed by the
`
`user. The computing device then determines whether either or both the context
`
`and current activity of the user satisfy a trigger condition which has been
`
`previously defined by the user. If so, the computing device selects content from a
`
`content database, based on the context or activity, to present to the user, and
`
`presents the selected content.
`
`[0006]
`
`In a variation on this embodiment, the computing device allows
`
`10
`
`the user to create content that is associated with a user-defined contextual or
`
`activity-driven trigger condition. To do so, the computing device records the
`
`content that is provided by the user, and creates a content entry in the content
`
`database for the recorded content, wherein the content entry can be associated
`
`with a number of trigger conditions. Then, the computing device associates a
`
`15
`
`trigger condition for the content entry with a user-defined context or activity. The
`
`computing device continuously compares previously-defined trigger conditions
`
`for the content entry with the ongoing context of the user and/or user activity.
`
`When a trigger condition is met, the computing device retrieves the associated
`
`content and presents it to the user.
`
`[0007]
`
`In a fiirther variation, the computing device allows the user to
`
`create shareable content. To do so, the computing device records the content that
`
`is provided by the user, and creates a content package for the recorded content.
`
`This content package can include the recorded content, and can include a number
`
`of user-defined trigger conditions. The user is capable of sharing the content
`
`package with other users by distributing the content package to other users, and/or
`
`by uploading the content package onto a public server. Furthermore, other users
`
`Attorney Docket No. PARC -20080172-US-NP
`JXC - PARC—20080172—US—NP Patent Annlicationdoc
`
`Inventors: Victoria M. E. Bellotti, et a1.
`
`3
`
`Page 12 of 474
`
`Page 12 of 474
`
`

`

`10
`
`15
`
`that download or receive the content package are allowed to insert, modify, and/or
`
`remove content or trigger conditions from the content package.
`
`[0008]
`
`In a variation on this embodiment, the computing device defines a
`
`context by creating a context or activity entry in a context manager, and associates
`
`the context or activity entry with a set of contextual information.
`
`[0009]
`
`In a fill‘th61‘ variation, the computing device evolves the
`
`presentation of content over time by updating the content entries in the content
`
`database and updating the context or activity entries in the context manager
`
`responsive to actions performed by the user.
`
`[0010]
`
`In a variation on this embodiment, the computing device presents
`
`the selected content by following a number of pre-defined or user-defined
`
`presentation rules associated with the selected content, monitoring actions
`
`performed by the user, and presenting the selected content based on the actions
`
`performed by the user.
`
`[0011]
`
`In a variation on this embodiment, the computing device presents
`
`the selected content by sharing the selected content with a remote device.
`
`[0012]
`
`In a variation on this embodiment, the contextual information
`
`includes one or more of:
`
`time, date, location, proximity to a system-detectable tag
`
`(e.g., radio frequency identification (RFID) tag), device orientation, velocity,
`
`direction, distance, vibration, altitude, temperature, pressure, humidity, sound,
`
`luminous intensity, camera image, and video stream.
`
`[0013]
`
`In a variation on this embodiment, the content includes at least
`
`one or more of: audio clip, image, video stream, language lesson, e-mail, weather
`
`report, calendar reminder, news feed, rich site summary (RS S) feed, and Internet
`
`blog.
`
`Attorney Docket No. PARC -20080172-US-NP
`JXC - PARC—20080172—US—NP Patent Annlicationdoc
`
`Inventors: Victoria M. E. Bellotti, et a1.
`
`4
`
`Page 13 of 474
`
`Page 13 of 474
`
`

`

`BRIEF DESCRIPTION OF THE FIGURES
`
`[0014] FIG. 1 illustrates a content management system in accordance
`
`with an embodiment of the present invention.
`
`[0015] FIG. 2A illustrates a data flow for a content management system
`
`associated with delivering content to a user in accordance with an embodiment of
`
`the present invention.
`
`[0016] FIG. 2B illustrates a data flow for a content management system
`
`associated with allowing a user to create content in accordance with an
`
`embodiment of the present invention.
`
`10
`
`15
`
`[0017] FIG. 3 presents a flow chart illustrating a process for delivering
`
`context-based content to a user in accordance with an embodiment of the present
`
`invention.
`
`[0018] F1G. 4 presents a flow chart illustrating a process for creating
`
`context—based content in accordance with an embodiment of the present invention.
`
`[0019] FIG. 5 illustrates an exemplary computing device that facilitates
`
`creating and delivering context-based content in accordance with an embodiment
`
`of the present invention.
`
`[0020] TABLE l illustrates an exemplary set of rules for presenting a
`
`content package to a user in accordance with an embodiment of the present
`
`invention.
`
`[0021] TABLE 2 illustrates an exemplary set of rules for presenting a
`
`reminder content package to a user in accordance with an embodiment of the
`
`present invention.
`
`Attorney Docket No. PARC -20080172-US-NP
`JXC - PARC—20080172—US—NP Patent Annlicationdoc
`
`Inventors: Victoria M. E. Bellotti, et a1.
`
`S
`
`Page 14 of 474
`
`Page 14 of 474
`
`

`

`DETAILED DESCRIPTION
`
`[0022] The following description is presented to enable any person
`
`skilled in the art to make and use the invention, and is provided in the context of a
`
`particular application and its requirements. Various modifications to th