Doc Code: PD.TO.AUTH
`
`PTO/SB/39 (06-07)
`Approved for use through 09/30/2007. OMB 0651-0031
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unlessit displays a valid OMB control number.
`
`AUTHORIZATION TO PERMIT
`
`ACCESSTO APPLICATION BY
`PARTICIPATING OFFICES
`
`Send completed form to: Commissioner for Patents
`P.O. Box 1450, Alexandria, VA 22313-1450
`
`[riingoae|
`FirstNamedinventor |
`Attorney Docket Number po
`
`Title
`(Required)
`
`The undersigned hereby grants the USPTO authority to provide the European Patent Office (EPO), the
`Japan Patent Office (JPO), and any other intellectual property offices in which a foreign application
`claiming priority to the above-identified application is filed access to the above-identified patent application.
`See 37 CFR 1.14(c) and (h).
`
`In accordance with 37 CFR 1.14(h)(3), access will be provided to a copy of the application-as-filed with
`respect to: 1) the above-identified application, 2) any foreign application to which the above-identified
`application claims priority under 35 USC 119(a)-(d) if a copy of the foreign application that satisfies the
`certified copy requirement of 37 CFR 1.55 has been filed in the above-identified US application, and 3) any
`U.S. application from which benefit is sought in the above-identified application.
`
`This written authorization should be submitted prior to the filing of a subsequent foreign application, in
`which priority is claimed to the above-identified patent application, with any intellectual property office (e.g.,
`the EPO or JPO).
`
`No fee will be charged under 37 CFR 1.19()(1) for providing a participating intellectual property office with
`an electronic copy of the above-identified application.
`
`This form must be signed by an authorized party in accordance with 37 CFR 1.14(c).
`
`/Shun Yao/
`
`Shun Yao
`
`Attorney of Record
`
`Signature
`
`Date
`
`Printed or Typed Name
`
`(530) 759-1667
`
`Telephone Number
`
`59,242
`
`Registration Number, if applicable
`
`SEND FEES OR COMPLETED FORMSTO THIS ADDRESS. SEND TO: Commissionerfor Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`This collection of information is required by 37 CFR 1.14(h). The information is required to obtain or retain a benefit by the public whichis to file (and by
`the USPTOto process an application). Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 6
`minutes to complete, including gathering, preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the
`individual case. Any comments on the amountof time you require to complete this form and/or suggestions for reducing this burden, should be sent to
`the Chief Information Officer, U.S. Patent and Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT
`
`ff you need assistance in completing the form, cail 1-800-PTO-9199 and select opiion 2.
`
`Page 1 of 474
`
`SNAP EXHIBIT 1004
`
`Page 1 of 474
`
`SNAP EXHIBIT 1004
`
`

`

`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection
`with your submission of the attached form related to a patent application or patent. Accordingly,
`pursuant to the requirements of the Act, please be advised that: (1) the general authority for the
`collection of this information is 35 U.S.C. 2(b)(2); (2) furnishing of the information solicited is voluntary;
`and (3) the principal purpose for which the information is used by the U.S. Patent and Trademark
`Office is to process and/or examine your submission related to a patent application or patent. If you do
`not furnish the requested information, the U.S. Patent and Trademark Office may not be able to
`process and/or examine your submission, which may result in termination of proceedings or
`abandonmentof the application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1.
`
`The information on this form will be treated confidentially to the extent allowed under the
`Freedom of Information Act (5 U.S.C. 552) and the Privacy Act (5 U.S.C 552a). Records from
`this system of records may be disclosed to the Department of Justice to determine whether
`disclosure of these records is required by the Freedom of Information Act.
`A record from this system of records may be disclosed, as a routine use, in the course of
`presenting evidence to a court, magistrate, or administrative tribunal, including disclosures to
`opposing counsel in the course of settlement negotiations.
`A record in this system of records may be disclosed, as a routine use, to a Member of
`Congress submitting a request involving an individual, to whom the record pertains, when the
`individual has requested assistance from the Member with respect to the subject matter of the
`record.
`A record in this system of records may be disclosed, as a routine use, to a contractor of the
`Agency having needfor the information in order to perform a contract. Recipients of
`information shall be required to comply with the requirements of the Privacy Act of 1974, as
`amended, pursuant to 5 U.S.C. 552a(m).
`A record related to an International Application filed under the Patent Cooperation Treaty in
`this system of records may be disclosed, as a routine use, to the International Bureau of the
`World Intellectual Property Organization, pursuant to the Patent Cooperation Treaty.
`A record in this system of records may be disclosed, as a routine use, to another federal
`agencyfor purposes of National Security review (35 U.S.C. 181) and for review pursuantto
`the Atomic Energy Act (42 U.S.C. 218(c)).
`A record from this system of records may be disclosed, as a routine use, to the Administrator,
`General Services, or his/her designee, during an inspection of records conducted by GSA as
`part of that agency's responsibility to recommend improvementsin records management
`practices and programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall
`be made in accordancewith the GSA regulations governing inspection of records for this
`purpose, and any other relevant (/.e., GSA or Commerce) directive. Such disclosure shall not
`be used to make determinations about individuals.
`A record from this system of records may be disclosed, as a routine use, to the public after
`either publication of the application pursuant to 35 U.S.C. 122(b) or issuance of a patent
`pursuant to 35 U.S.C. 151. Further, a record maybe disclosed, subject to the limitations of 37
`CFR 1.14, as a routine use, to the public if the record was filed in an application which
`became abandoned or in which the proceedings were terminated and which application is
`referenced by either a published application, an application open to public inspection or an
`issued patent.
`A record from this system of records may be disclosed, as a routine use, to a Federal, State,
`or local law enforcement agency, if the USPTO becomes awareofa violation or potential
`violation of law or regulation.
`
`Page 2 of 474
`
`Page 2 of 474
`
`

`

`PTO/SB/14 (06-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`document may be printed and included in a paper filed application.
`
`Application Data Sheet 37 CFR 1.76
`
`—
`
`Title of Invention
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENTDELIVERY AND INTERACTION
`
`The application data sheetis part of the provisional or nonprovisional application for which it is being submitted. The following form contains the
`bibliographic data arranged in a format specified by the United States Patent and Trademark Office as outlined in 37 CFR 1.76.
`This document may be completed electronically and submitted to the Office in electronic format using the Electronic Filing System (EFS) or the
`
`Secrecy Order 37 CFR 5.2
`
`[_] Portions orall of the application associated with this Application Data Sheet mayfall under a Secrecy Order pursuantto
`
`37 CFR 5.2 (Paper filers only. Applications that fall under Secrecy Order may not be filed electronically.)
`
`
`
`
`Applicant Information:
`Applicant 1
`
`
`Applicant Authority @ Inventor|()Legal Representative under 35 U.S.C. 117 (Party of Interest under 35 U.S.C. 118
`
`Bellotti
`Victoria
`M.E.
`
`
`ResidenceInformation (Select One)
`
`(@) US Residency
`
`©) NonUS Residency
`
`() Active US Military Service
`
`Mailing Address of Applicant:
`
`Address 1
`612 AndoverStreet
`
`Address 2
`
`Applicant 2
`
`
`Applicant Authority Inventor|(Legal Representative under 35 U.S.C. 117 Party ofInterest under 35 U.S.C. 118
`
`Fe
`Residence Information (Select One)
`(@) US Residency
`©) NonUS Residency
`() Active US Military Service
`
`City Country of Residencei|USSunnyvale State/Province
`
`
`Citizenship under 37 CFR 1.41{b)i
`FR
`
`Mailing Address of Applicant:
`Address 1
`701 Pierino Avenue
`
`Address 2
`
`Postal Code
`
`94086
`
`US
`
`Family Name
`
`ResidenceInformation (Select One) () US Residency
`©) NonUSResidency ©) Active US Military Service
`City
`San Francisco
`| State/Province | CA
`| Country of Residence i
`| US
`
`EFS Web 2.2.0
`
`Page 3 of 474
`
`
`Applicant 3
`Applicant Authority @ Inventor
`
`Prefix} Given Name
`
`| ©)Legal Representative under 35 U.S.C. 117
`Middle Name
`
`|Party of Interest under 35 U.S.C. 118
`
`
`
`Page 3 of 474
`
`

`

`PTO/SB/14 (06-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number
`PARC-20080172-US-NP
`—
`Application Data Sheet 37 CFR 1.76
`
`[ApplicatonNumber|
`I
`Title of Invention
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`Ss
`
`
`Citizenship under 37 CFR 1.41(b)i | U
`
`Mailing Address of Applicant:
`
`Address 1
`Address 2
`
`
`707 Haight Street #4
`
`| State/Province
`San Francisco
`City
`
`
`
`Postal Code | Country!|Us 94117
`Applicant 4
`Applicant Authority @ Inventor|()Legal Representative under 35 U.S.C. 117 (Party ofInterest under 35 U.S.C. 118
`
`Prefix} Given Name
`Middle Name
`Family Name
`
`
`
`Philippe
`ResidenceInformation (Select One)
`City
`San Francisco
`
`J.P.
`(@) US Residency
`State/Province
`
`Golle
`() Active US Military Service
`©) NonUS Residency
`Country of Residencei
`
`Citizenship under 37 CFR 1.41{b)i
`FR
`
`Mailing Address of Applicant:
`
`Address1
`Address 2
`
`
`255 King Street, Apt. 1007
`
`
`| CA
`
`| CA
`
`
`
`
`
`| State/Province
`San Francisco
`City
`
`
`
`Postal Code | Country|US 94107
`Applicant 5
`
`
`Applicant Authority @ Inventor|()Legal Representative under 35 U.S.C. 117 C)Party ofInterest under 35 U.S.C. 118
`
`
`Qingfeng
`Huang
`ResidenceInformation (Select One)
`©) NonUS Residency
`
`() Active US Military Service
`
`(@) US Residency
`
`Mailing Address of Applicant:
`
`Address 1
`4708 Strawberry Lane
`
`Address 2
`
`
`San Jose
`
`State/Province
`
`Applicant 6
`
`
`Applicant Authority (@)Inventor|()Legal Representative under 35 U.S.C. 117 Party ofInterest under 35 U.S.C. 118
`
`() Active US Military Service
`©) NonUS Residency
`ResidenceInformation (Select One) () US Residency
`
`City Country of Residencei|USSanta Cruz State/Province
`
`
`
`EFS Web 2.2.0
`
`Page 4 of 474
`
`Page 4 of 474
`
`

`

`PTO/SB/14 (06-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`Attorney Docket Number
`
`PARC-20080172-US-NP
`
`Title of Invention
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`
`
`
`Mailing Address of Applicant:
`Address 1
`821 California Street
`
`Address 2
`
`Santa Cruz
`
`
`
`Postal Code | Country!|Us 95060
`
`
`Applicant 7
`
`Applicant Authority @ Inventor|()Legal Representative under 35 U.S.C. 117 |Party of Interest under 35 U.S.C. 118
`
`
`Prefix) Given Name
`Middle Name
`Family Name
`
`
`Kurt
`ResidenceInformation (Select One)
`City
`Palo Alto
`
`.
`(@) US Residency
`State/Province
`
`Partridge
`©) NonUS Residency
`() Active US Military Service
`Country of Residence i
`
`Application Data Sheet 37 CFR 1.76 Application Number
`State/Province
`
`
`
`Country of Residencei|US
`
`Citizenship under 37 CFR 1.41{b)i
`US
`
`Mailing Address of Applicant:
`
`Address1
`
`Address 2
`
`4129 El Camino Way #U
`
`Palo Alto
`
`State/Province
`
`CA
`
`Postal Code
`
`
`Applicant 8
`Applicant Authority Inventor|(Legal Representative under 35 U.S.C. 117 C)Party ofInterest under 35 U.S.C. 118
`
`Prefix} Given Name
`Middle Name
`Family Name
`Nicholas
`K.
`Yee
`
`
`US
`
`(©) Active US Military Service
`©) NonUS Residency
`(@) US Residency
`Residence Information (Select One)
`
`
`City Country of Residencei|USMountain View State/Province
`
`
`Mailing Address of Applicant:
`
`Address 1
`541 Del Medio Avenue, Apt. 217
`Address 2
`
`
`
`
`Mountain View
`City
`Postal Code
`
`94040
`
`| State/Province
`Country!
`
`| CA
`
`Applicant 9
`Applicant Authority (@)Inventor|()Legal Representative under 35 U.S.C. 117 Party ofInterest under 35 U.S.C. 118
`
`
`
`Prefix]GivenName=siMiddle Name Family Name
`
`ResidenceInformation (Select One)
`City
`Sunnyvale
`
`(@) US Residency
`State/Province
`
`©) NonUS Residency
`
`(©) Active US Military Service
`
`EFS Web 2.2.0
`
`Page 5 of 474
`
`Page 5 of 474
`
`

`

`PTO/SB/14 (06-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number
`PARC-20080172-US-NP
`—
`Application Data Sheet 37 CFR 1.76
`
`[ApplicatonNumber|
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`
`
`Mailing Address of Applicant:
`
`Address 1
`Address 2
`
`1016 Ingram Court
`
`Sunnyvale
`
`Postal Code | Country!|Us 94087
`
`
`
`All
`Inventors Must Be Listed - Additional
`Inventor Information blocks may be
`
` Title of Invention
`State/Province
`generated within this form by selecting the Add button.
`
`
`
`
`Correspondence Information:
`
`Enter either Customer Number or complete the Correspondence Information section below.
`For further information see 37 CFR 1.33(a).
`
`[|] An Address is being provided for the correspondenceInformation of this application.
`
`Customer Number
`
`Email Address
`
`shun@parklegal.com
`
`Add Email
`
`Application Information:
`
`
`
`Suggested Technology Center(if any) ee
`
`Total Number of Drawing Sheets(if any)
`4
`Suggested Figure for Publication {if any)
`
`Publication Information:
`
`[|] Request Early Publication (Fee required at time of Request 37 CFR 1.219)
`
`Req uest Not to Publish. | hereby request that the attached application not be published under 35
`U.S.C. 122(b) and certify that the invention disclosed in the attached application has not and will not be the
`subject of an application filed in another country, or under a multilateral international agreement, that requires
`publication at eighteen months afterfiling.
`
`Representative Information:
`
`Representative information should be provided forall practitioners having a powerof attorney in the application. Providing
`this information in the Application Data Sheet does not constitute a powerof attorney in the application (see 37 CFR 1.32).
`Enter either Customer Numberor complete the Representative Name section below.If both sections
`are completed the Customer Numberwill be used for the Representative Information during processing.
`
`©) Limited Recongnition (37 CFR 11.9} Customer Number
`
`Please Select One:
`
`(#) Customer Number
`35699
`
`C)
`
`USPatentPractitioner
`
`EFS Web 2.2.0
`
`Page 6 of 474
`
`Page 6 of 474
`
`

`

`PTO/SB/14 (06-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`
`Application Data Sheet 37 CFR 1.76 Application Number
`
`Title of Invention
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`Attorney Docket Number
`
`PARC-20080172-US-NP
`
`Domestic Benefit Information:
`
`This section allows for the applicant to claim benefit under 35 U.S.C. 119(e), 120, 121, or 365{c). Providing this information in the
`application data sheet constitutes the specific reference required by 35 U.S.C. 119(e) or 120, and 37 CFR 1.78(a}{2) or CFR 1.78(a)
`(4), and need not otherwise be made part of the specification.
`
` Prior Application Status
`
`Application Number
`
`Continuity Type
`
`Prior Application Number
`
`Filing Date (YYYY-MM-DD)}
`the Add button.
`
`Additional Domestic Priority Data may be generated within this form by selecting
`
`Foreign Priority Information:
`
`This section allows for the applicant to claim benefit of foreign priority and to identify any prior foreign application for which priority is
`not claimed. Providing this information in the application data sheet constitutes the claim for priority as required by 35 U.S.C. 119{b)
`and 37 CFR 1.55(a).
`
`Priority Claimed
`Parent Filing Date (YYYY-MM-DD}
`Country i
`Application Number
`
`
`© Yes @) No
`
`Add
`
`Additional Foreign Priority Data may be generated within this form by selecting the
`Add button.
`
`Assignee Information:
`Providing this information in the application data sheet does not substitute for compliance with any requirementof part 3 of Title 37
`
`of the CFR to have an assignmentrecordedin the Office.
`
`Assignee 1
`If the Assignee is an Organization checkhere.
`
`
`
`
`| Palo Alto Research CenterIncorporated
`Organization Name
`Mailing Address Information:
`
`Address1
`
`Address 2
`
`3333 Coyote Hill Road
`
`
`
`button.
`
`Phone Number
`
`Email Address
`
`(650) 812-4000
`
`Fax Number
`
`Additional Assignee Data may be generated within this form by selecting the Add
`
`Signature:
`
`A signature of the applicant or representative is required in accordance with 37 CFR 1.33 and 10.18. Please see 37
`CFR 1.4(d) for the form of the signature.
`
`
`
`|Signature|/Shun Yao/ Date (YYYY-MM-DD)| 2008-12-02
`
`
`EFS Web 2.2.0
`
`Page 7 of 474
`
`Page 7 of 474
`
`

`

`PTO/SB/14 (06-07)
`Approved for use through 06/30/2010. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Application Data Sheet 37 CFR 1.76 Title of Invention
`
`Attorney Docket Number
`
`PARC-20080172-US-NP
`
`CONTEXT AND ACTIVITY-DRIVEN CONTENT DELIVERY AND INTERACTION
`
`
`First Name
`Shun
`Last Name
`Yao
`Registration Number
`59242
`
`This collection of information is required by 37 CFR 1.76. The information is required to obtain or retain a benefit by the public which
`is to file (and by the USPTOto process) an application. Confidentiality is governed by 35 U.S.C. 122? and 37 CFR 1.14. This
`collection is estimated to take 23 minutes to complete, including gathering, preparing, and submitting the completed application data
`sheet form to the USPTO. Time will vary depending upon the individual case. Any comments on the amountof time you require to
`
`
`complete this form and/or suggestions for reducing this burden, should be sentto the Chief Information Officer, U.S. Patent and
`
`
`Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR
`COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`EFS Web 2.2.0
`
`Page 8 of 474
`
`Page 8 of 474
`
`

`

`Privacy Act Statement
`
`
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection with your submission of the attached form related to
`a patent application cr patent. Accordingly, pursuant to the requirements of the Act, please be advised that:
`(1) the general authority for the collection
`of this information is 35 U.S.C. 2(b)(2); (2) furnishing of the information solicited is voluntary; and (3) the principal purpose for which the information is
`used by the U.S. Patent and Trademark Office is to process and/or examine your submissionrelated to a patent application or patent.
`If you do not
`furnish the requested information, the U.S. Patent and Trademark Office may not be able to process and/or examine your submission, which may
`result in termination of proceedings or abandonmentof the application or expiration of the patent.
`
`The information provided by youin this form will be subject to the following routine uses:
`
`1.
`
`The information on this form will be treated confidentially to the extent allowed under the Freedom ofInformation Act (6 U.S.C. 552) an
`the Privacy Act (5 U.S.C. 552a). Records from this system of records may be disclosed to the Department of Justice to determine whether
`the Freedom of Information Act requires disclosure of these records.
`
`A record from this system of records may be disclosed, as a routine use, in the course of presenting evidence to a court, magistrate, or
`administrative tribunal, including disclosures to opposing counsel in the course of settlement negotiations.
`
`A record in this system of records may be disclosed, as a routine use, to a Member of Congress submitting a request involving an
`individual, te whem the record pertains, when the individual has requested assistance from the Memberwith respect to the subject matter of
`the record.
`
`A record in this system of records may be disclosed, as a routine use, to a contractor of the Agency having need for the information in
`order to perform a contract. Recipients of information shall be required to comply with the requirements of the Privacy Act of 1974, as
`amended, pursuant to 5 U.S.C. 552a(m).
`
`Arecord related to an International Application filed under the Patent Cooperation Treaty in this system of records may be disclosed, a:
`a routine use, to the International Bureau of the World Intellectual Property Organization, pursuant to the Patent Cooperation Treaty.
`
`A record in this system of records may be disclosed, as a routine use, to another federal agency for purposes of National Security
`review (35 U.S.C. 181) and for review pursuantto the Atomic Energy Act (42 U.S.C. 218{c)).
`
`Arecord from this system of records may be disclosed, as a routine use, to the Administrator, General Services, or his/her designee,
`during an inspection of records conducted by GSA aspart of that agency's responsibility to recommend improvements in records
`management practices and programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall be made in accordance with the
`GSA regulations governing inspection of records for this purpose, and any otherrelevant(i.e., GSA or Commerce) directive. Such
`disclosure shall not be used to make determinations aboutindividuals.
`
`Arecord from this system of records may be disclosed, as a routine use, to the public after either publication of the application pursuan
`to 35 U.S.C. 122(b) or issuance of a patent pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subject to the limitations of 37
`CFR 1.14, as a routine use, to the public if the record wasfiled in an application which became abandonedorin which the proceedings were
`terminated and which application is referenced by either a published application, an application open to public inspections or an issued
`patent.
`
`Arecord from this system of records may be disclosed, as a routine use, to a Federal, State, or local law enforcement agency,if the
`USPTO becomes aware of a violation or potential violation of law or regulation.
`
`
`
`EFS Web 2.2.0
`
`Page 9 of 474
`
`Page 9 of 474
`
`

`

`ATTORNEY DOCKET NO. PARC-20080172-US-NP
`
`PATENT APPLICATION
`
`CONTEXT AND ACTIVITY-DRIVEN
`
`CONTENT DELIVERY AND INTERACTION
`
`Inventors: Victoria M. E. Bellotti, Nicolas B. Ducheneaut, Glenn E. Durfee,
`Philippe J. P. Golle, Qingfeng Huang, Marc E. Mosko, Kurt E. Partridge,
`Nicholas K. Yee, and Rebecca L. Braynard
`
`10
`
`15
`
`BACKGROUND
`
`Field of the Invention
`
`[0001] The present invention generally relates to techniques and systems
`
`for creating and presenting content to a user. Morespecifically, the present
`
`invention relates to techniques and systems for creating and presenting content
`
`based on contextual information.
`
`RelatedArt
`
`[0002] Advancements in computing technology continue to improve
`
`communication between people and provide versatile ways to deliver information.
`
`These advancements have allowed communities around the world to interact and
`
`share information with each other. In particular, mobile devices are becoming an
`
`30
`
`integral part of humanlife, as people often carry a mobile device throughout their
`
`Attorney Docket No. PARC-20080172-US-NP
`JXC - PARC-20080172-US-NP Patent Anplication.doc
`
`Inventors: Victoria M. E. Bellotti, et al.
`
`1
`
`Page 10 of 474
`
`Page 10 of 474
`
`

`

`day. These mobile devices can include a mobile phone,a personal digital
`
`assistant (PDA), an MP3 player, a handheld game console, and a laptop computer.
`
`Newergenerations of these mobile devices are developed with more computation
`
`powerand a growing number of communication features.
`
`[0003]
`
`In effect, many of these mobile devices can perpetuate a fast-
`
`pacedlifestyle for their users, as they may help users schedule the time around
`
`their responsibilities. However, these technological advances do not effectively
`
`help their users cope with this increase in pace. Typical working professionals
`
`may have a number of communication channels that they monitor, and they often
`
`10
`
`need to remind themselves to monitor these channels. Also, these users typically
`
`havea list of errands they need to complete, and this list may grow throughout a
`
`work week because they do not remember to complete these errands until the
`
`weekend. Furthermore, these users often need to continue advancingtheir skills,
`
`but their work and social schedules do not allow muchfree time for extended
`
`15
`
`study.
`
`[0004] Unfortunately, mobile devices are not effective in helping
`
`working professionals accommodate their responsibilities around their busy
`
`schedule, because these mobile devices are not capable of learning and
`
`understanding the behavior of their users. Furthermore, these mobile devices
`
`cannot determine when and howbestto provide their users with information or
`
`suitable entertainment content, because they do not take into accountthe activities
`
`that their users are involved in.
`
`SUMMARY
`
`[0005] One embodimentof the present invention provides a computing
`
`device that delivers personally-defined context-based content to a user. This
`
`Attorney Docket No. PARC-20080172-US-NP
`JXC - PARC-20080172-US-NP Patent Anplication.doc
`
`Inventors: Victoria M. E. Bellotti, et al.
`
`2
`
`Page 11 of 474
`
`Page 11 of 474
`
`

`

`computing device receives a set of contextual information with respect to the user,
`
`and processes the contextual information to determine whether someaspect ofthe
`
`current context can be associated with a probable activity being performed by the
`
`user. The computing device then determines whethereither or both the context
`
`and current activity of the usersatisfy a trigger condition which has been
`
`previously defined by the user. If so, the computing device selects content from a
`
`content database, based on the contextor activity, to present to the user, and
`
`presents the selected content.
`
`[0006]
`
`In a variation on this embodiment, the computing device allows
`
`10
`
`the user to create content that is associated with a user-defined contextual or
`
`activity-driven trigger condition. To do so, the computing device records the
`
`content that is provided by the user, and creates a content entry in the content
`
`database for the recorded content, wherein the content entry can be associated
`
`with a numberoftrigger conditions. Then, the computing device associates a
`
`15
`
`trigger condition for the content entry with a user-defined context or activity. The
`
`computing device continuously compares previously-defined trigger conditions
`
`for the content entry with the ongoing context of the user and/oruseractivity.
`
`Whena trigger condition is met, the computing deviceretrieves the associated
`
`content and presentsit to the user.
`
`[0007]
`
`Ina further variation, the computing device allowsthe user to
`
`create shareable content. To do so, the computing device records the content that
`
`is provided by the user, and creates a content package for the recorded content.
`
`This content package can include the recorded content, and can include a number
`
`of user-defined trigger conditions. The user is capable of sharing the content
`
`package with other users by distributing the content packageto other users, and/or
`
`by uploading the content package onto a public server. Furthermore, other users
`
`Attorney Docket No. PARC-20080172-US-NP
`JXC - PARC-20080172-US-NP Patent Anplication.doc
`
`Inventors: Victoria M. E. Bellotti, et al.
`
`3
`
`Page 12 of 474
`
`Page 12 of 474
`
`

`

`that downloador receive the content package are allowed to insert, modify, and/or
`
`remove contentor trigger conditions from the content package.
`
`[0008]
`
`Ina variation on this embodiment, the computing device defines a
`
`context by creating a context or activity entry in a context manager, and associates
`
`the context or activity entry with a set of contextual information.
`
`[0009]
`
`Ina further variation, the computing device evolves the
`
`presentation of content over time by updating the content entries in the content
`
`database and updating the context or activity entries in the context manager
`
`responsive to actions performedby the user.
`
`10
`
`[0010]
`
`Ina variation on this embodiment, the computing device presents
`
`the selected content by following a numberofpre-defined or user-defined
`
`presentation rules associated with the selected content, monitoring actions
`
`performed bythe user, and presenting the selected content based on the actions
`
`performedby the user.
`
`15
`
`[0011]
`
`Ina variation on this embodiment, the computing device presents
`
`the selected content by sharing the selected content with a remote device.
`
`[0012]
`
`Ina variation on this embodiment, the contextual information
`
`includes one or more of:
`
`time, date, location, proximity to a system-detectable tag
`
`(e.g., radio frequency identification (RFID) tag), device orientation, velocity,
`
`direction, distance, vibration, altitude, temperature, pressure, humidity, sound,
`
`luminous intensity, camera image, and video stream.
`
`[0013]
`
`Ina variation on this embodiment, the content includesat least
`
`one or moreof: audio clip, image, video stream, language lesson, e-mail, weather
`
`report, calendar reminder, newsfeed,rich site summary (RSS) feed, and Internet
`
`blog.
`
`Attorney Docket No. PARC-20080172-US-NP
`JXC - PARC-20080172-US-NP Patent Anplication.doc
`
`Inventors: Victoria M. E. Bellotti, et al.
`
`4
`
`Page 13 of 474
`
`Page 13 of 474
`
`

`

`BRIEF DESCRIPTION OF THE FIGURES
`
`[0014]
`
`FIG. 1 illustrates a content management system in accordance
`
`with an embodimentof the present invention.
`
`[0015] FIG. 2A illustrates a data flow for a content management system
`
`5
`
`associated with delivering content to a user in accordance with an embodimentof
`
`the present invention.
`
`[0016]
`
`FIG. 2Billustrates a data flow for a content management system
`
`associated with allowing a user to create content in accordance with an
`
`embodimentof the present invention.
`
`10
`
`[0017] FIG. 3 presents a flow chart illustrating a process for delivering
`
`context-based content to a user in accordance with an embodimentof the present
`
`invention.
`
`[0018] FIG. 4 presents a flow chart illustrating a process for creating
`
`context-based content in accordance with an embodimentofthe present invention.
`
`15
`
`[0019] FIG. 5 illustrates an exemplary computing device that facilitates
`
`creating and delivering context-based content in accordance with an embodiment
`
`of the present invention.
`
`[0020]
`
`TABLE1 illustrates an exemplary set of rules for presenting a
`
`content package to a user in accordance with an embodimentof the present
`
`20
`
`invention.
`
`[0021]
`
`TABLE2 illustrates an exemplary set of rules for presenting a
`
`reminder content package to a user in accordance with an embodimentof the
`
`present invention.
`
`Attorney Docket No. PARC-20080172-US-NP
`JXC - PARC-20080172-US-NP Patent Anplication.doc
`
`Inventors: Victoria M. E. Bellotti, et al.
`
`5
`
`Page 14 of 474
`
`Page 14 of 474
`
`

`

`DETAILED DESCRIPTION
`
`[0022] The following description is presented to enable any person
`
`skilled in the art to make and use the invention,