Under the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless it displays a valid OMB control number.
`PTO Form 1478 (Rev 09/2006)
`
`OMB No. 0651-0009 (Exp 02/28/2021)
`
`Trademark/Service Mark Application, Principal Register
`
`Serial Number: 88895303
`Filing Date: 04/30/020
`
`The table below presents the data as entered.
`
`Entered
`
`88895303
`
`State of Mind AI (SOMAI)
`
`YES
`
`YES
`
`State of Mind AI (SOMAI)
`
`The mark consists of standard characters, without claim to any particular font style, size, or color.
`
`Principal
`
`Pereptive Automata, Inc.
`
`Suite #33, 1250 Borregas Ave
`
`Sunnyvale
`
`California
`
`Input Field
`
`SERIAL NUMBER
`
`MARK INFORMATION
`
`*MARK
`
`STANDARD CHARACTERS
`
`USPTO-GENERATED IMAGE
`
`LITERAL ELEMENT
`
`MARK STATEMENT
`
`REGISTER
`
`APPLICANT INFORMATION
`
`*OWNER OF MARK
`
`*MAILING ADDRESS
`
`*CITY
`
`*STATE
`(Required for U.S. applicants)
`
`*COUNTRY/REGION/JURISDICTION/U.S.
`TERRITORY
`
`United States
`
`*ZIP/POSTAL CODE
`(Required for U.S. and certain international
`addresses)
`
`*EMAIL ADDRESS
`
`LEGAL ENTITY INFORMATION
`
`94089
`
`XXXX
`
`TYPE
`
`corporation
`
`STATE/COUNTRY/REGION/JURISDICTION/U.S.
`TERRITORY OF INCORPORATION
`
`Delaware
`
`GOODS AND/OR SERVICES AND BASIS INFORMATION
`
`INTERNATIONAL CLASS
`
`009 
`
`*IDENTIFICATION
`
`Downloadable software, source code, machine learning algorithms, APIs, supporting tools and services for automated and/or robotic
`systems, including software using artificial intelligence, that process sensor data and output human state of mind and/or behavior prediction
`signals, such as intent-to-cross and awareness of human road users for automated vehicle applications, that an automated system can use to
`modulate its operating decisions and actions, all for automated systems and/or robotics developers, manufacturers, suppliers, and end-users
`
`FILING BASIS
`
`SECTION 1(a)
`
`       FIRST USE ANYWHERE DATE
`
`At least as early as 12/01/2018
`
`       FIRST USE IN COMMERCE DATE
`
`At least as early as 12/01/2018
`
`

`

`       SPECIMEN FILE NAME(S)
`
`       ORIGINAL PDF FILE
`
`       CONVERTED PDF FILE(S)
`       (14 pages)
`
`       ORIGINAL PDF FILE
`
`       CONVERTED PDF FILE(S)
`       (12 pages)
`
`SPE0-2601646480e18060b390b47911678-20200430134303601403_._Perceptive_Automata_SOMAI_Overview_for_Customers__1_.pdf
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0003.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0004.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0005.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0006.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0007.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0008.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0009.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0010.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0011.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0012.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0013.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0014.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0015.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0016.JPG
`
`SPE0-2601646480e18060b390b47911678-20200430134303601403_._Customer_Use_Case_Manual_for_SOMAI_Deployment.pdf
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0017.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0018.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0019.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0020.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0021.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0022.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0023.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0024.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0025.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0026.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0027.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0028.JPG
`
`       ORIGINAL PDF FILE
`
`       CONVERTED PDF FILE(S)
`       (1 page)
`
`       ORIGINAL PDF FILE
`
`       CONVERTED PDF FILE(S)
`       (3 pages)
`
`SPE0-2601646480e18060b390b47911678-20200430134303601403_._SOMAI_Service_Release___Download_Page.pdf
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0029.JPG
`
`SPE0-2601646480e18060b390b47911678-20200430134303601403_._State_of_Mind__SOMAI__User_Guide_v1.04.pdf
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0030.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0031.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0032.JPG
`
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`

`

`       SPECIMEN DESCRIPTION
`
`State of Mind (SOMAI) presentation to customers State of Mind (SOMAI) user manual for customers SOMAI Customer Service Software
`Download and Release Instructions SOMAI User Guide
`
`INTERNATIONAL CLASS
`
`042 
`
`*IDENTIFICATION
`
`Research and development of automated vehicles; software design and development in the field of automated vehicles; Non-downloadable
`cloud-based and/or browser-accessible software, source code, machine learning algorithms, APIs, supporting tools and services for
`automated and/or robotic systems, including software using artificial intelligence, that process sensor data and output human state of mind
`and/or behavior prediction signals, such as intent-to-cross and awareness of human road users for automated vehicle applications, that an
`automated system can use to modulate its operating decisions and actions, all for automated systems and/or robotics developers,
`manufacturers, suppliers, and end-users.
`
`FILING BASIS
`
`SECTION 1(a)
`
`       FIRST USE ANYWHERE DATE
`
`At least as early as 12/01/2018
`
`       FIRST USE IN COMMERCE DATE
`
`At least as early as 12/01/2018
`
`       SPECIMEN FILE NAME(S)
`
`       ORIGINAL PDF FILE
`
`       CONVERTED PDF FILE(S)
`       (14 pages)
`
`       ORIGINAL PDF FILE
`
`       CONVERTED PDF FILE(S)
`       (12 pages)
`
`SPE0-1-2601646480e18060b390b47911678-20200430134303601403_._Perceptive_Automata_SOMAI_Overview_for_Customers__1_.pdf
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0033.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0034.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0035.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0036.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0037.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0038.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0039.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0040.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0041.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0042.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0043.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0044.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0045.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0046.JPG
`
`SPE0-1-2601646480e18060b390b47911678-20200430134303601403_._Customer_Use_Case_Manual_for_SOMAI_Deployment.pdf
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0047.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0048.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0049.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0050.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0051.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0052.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0053.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0054.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0055.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0056.JPG
`
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`       
`

`

`       ORIGINAL PDF FILE
`
`       CONVERTED PDF FILE(S)
`       (1 page)
`
`       ORIGINAL PDF FILE
`
`       CONVERTED PDF FILE(S)
`       (3 pages)
`
`       SPECIMEN DESCRIPTION
`
`ATTORNEY INFORMATION
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0057.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0058.JPG
`
`SPE0-1-2601646480e18060b390b47911678-20200430134303601403_._SOMAI_Service_Release___Download_Page.pdf
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0059.JPG
`
`SPE0-1-2601646480e18060b390b47911678-20200430134303601403_._State_of_Mind__SOMAI__User_Guide_v1.04.pdf
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0060.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0061.JPG
`
`\\TICRS\EXPORT18\IMAGEOUT18\888\953\88895303\xml1\APP0062.JPG
`
`Customer Presentation re: SOMAI State of Mind AI Customer Use Case Summary re: State of Mind (SOMAI) State of Mind AI (SOMAI)
`User Guide SOMAI Customer Service User Guide and Download Instructions
`
`NAME
`
`Peter Piotr Szymanski
`
`ATTORNEY BAR MEMBERSHIP NUMBER
`
`YEAR OF ADMISSION
`
`XXX
`
`XXXX
`
`U.S. STATE/ COMMONWEALTH/ TERRITORY XX
`
`STREET
`
`CITY
`
`STATE
`
`COUNTRY/REGION/JURISDICTION/U.S.
`TERRITORY
`
`ZIP/POSTAL CODE
`
`EMAIL ADDRESS
`
`1900 Jefferson, 205
`
`San Francisco
`
`California
`
`United States
`
`94123
`
`peter@siliconvalleycounsel.com
`
`CORRESPONDENCE INFORMATION
`
`NAME
`
`Peter Piotr Szymanski
`
`PRIMARY EMAIL ADDRESS FOR
`CORRESPONDENCE
`
`SECONDARY EMAIL ADDRESS(ES)
`(COURTESY COPIES)
`
`FEE INFORMATION
`
`peter@siliconvalleycounsel.com
`
`pete@siliconvalleycounsel.com
`
`APPLICATION FILING OPTION
`
`TEAS Standard
`
`NUMBER OF CLASSES
`
`APPLICATION FOR REGISTRATION PER
`CLASS
`
`*TOTAL FEES DUE
`
`*TOTAL FEES PAID
`
`SIGNATURE INFORMATION
`
`2
`
`275
`
`550
`
`550
`
`SIGNATURE
`
`SIGNATORY'S NAME
`
`SIGNATORY'S POSITION
`
`/Peter Piotr Szymanski/
`
`Peter Piotr Szymanski
`
`Attorney of Record, California bar member
`
`       
`       
`       
`       
`

`

`SIGNATORY'S PHONE NUMBER
`
`DATE SIGNED
`
`650-776-4826
`
`04/30/2020
`
`

`

`Under the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless it displays a valid OMB control number.
`PTO Form 1478 (Rev 09/2006)
`
`OMB No. 0651-0009 (Exp 02/28/2021)
`
`Trademark/Service Mark Application, Principal Register
`
`To the Commissioner for Trademarks:
`
`Serial Number: 88895303
`Filing Date: 04/30/020
`
`MARK: State of Mind AI (SOMAI) (Standard Characters, see mark)
`The literal element of the mark consists of State of Mind AI (SOMAI). The mark consists of standard characters, without claim to any particular
`font style, size, or color.
`The applicant, Pereptive Automata, Inc., a corporation of Delaware, having an address of
`      Suite #33, 1250 Borregas Ave
`      Sunnyvale, California 94089
`      United States
`      XXXX
`
`requests registration of the trademark/service mark identified above in the United States Patent and Trademark Office on the Principal Register
`established by the Act of July 5, 1946 (15 U.S.C. Section 1051 et seq.), as amended, for the following:
`
`International Class 009:  Downloadable software, source code, machine learning algorithms, APIs, supporting tools and services for automated
`and/or robotic systems, including software using artificial intelligence, that process sensor data and output human state of mind and/or behavior
`prediction signals, such as intent-to-cross and awareness of human road users for automated vehicle applications, that an automated system can
`use to modulate its operating decisions and actions, all for automated systems and/or robotics developers, manufacturers, suppliers, and end-users
`
`In International Class 009, the mark was first used by the applicant or the applicant's related company or licensee or predecessor in interest at
`least as early as 12/01/2018, and first used in commerce at least as early as 12/01/2018, and is now in use in such commerce. The applicant is
`submitting one(or more) specimen(s) showing the mark as used in commerce on or in connection with any item in the class of listed
`goods/services, consisting of a(n) State of Mind (SOMAI) presentation to customers State of Mind (SOMAI) user manual for customers SOMAI
`Customer Service Software Download and Release Instructions SOMAI User Guide.
`
`Original PDF file:
`SPE0-2601646480e18060b390b47911678-20200430134303601403_._Perceptive_Automata_SOMAI_Overview_for_Customers__1_.pdf
`Converted PDF file(s) (14 pages)
`Specimen File1
`Specimen File2
`Specimen File3
`Specimen File4
`Specimen File5
`Specimen File6
`Specimen File7
`Specimen File8
`Specimen File9
`Specimen File10
`Specimen File11
`Specimen File12
`Specimen File13
`Specimen File14
`Original PDF file:
`SPE0-2601646480e18060b390b47911678-20200430134303601403_._Customer_Use_Case_Manual_for_SOMAI_Deployment.pdf
`Converted PDF file(s) (12 pages)
`Specimen File1
`Specimen File2
`Specimen File3
`Specimen File4
`Specimen File5
`
` 
`

`

`Specimen File6
`Specimen File7
`Specimen File8
`Specimen File9
`Specimen File10
`Specimen File11
`Specimen File12
`Original PDF file:
`SPE0-2601646480e18060b390b47911678-20200430134303601403_._SOMAI_Service_Release___Download_Page.pdf
`Converted PDF file(s) (1 page)
`Specimen File1
`Original PDF file:
`SPE0-2601646480e18060b390b47911678-20200430134303601403_._State_of_Mind__SOMAI__User_Guide_v1.04.pdf
`Converted PDF file(s) (3 pages)
`Specimen File1
`Specimen File2
`Specimen File3
`
`International Class 042:  Research and development of automated vehicles; software design and development in the field of automated vehicles;
`Non-downloadable cloud-based and/or browser-accessible software, source code, machine learning algorithms, APIs, supporting tools and
`services for automated and/or robotic systems, including software using artificial intelligence, that process sensor data and output human state of
`mind and/or behavior prediction signals, such as intent-to-cross and awareness of human road users for automated vehicle applications, that an
`automated system can use to modulate its operating decisions and actions, all for automated systems and/or robotics developers, manufacturers,
`suppliers, and end-users.
`
`In International Class 042, the mark was first used by the applicant or the applicant's related company or licensee or predecessor in interest at
`least as early as 12/01/2018, and first used in commerce at least as early as 12/01/2018, and is now in use in such commerce. The applicant is
`submitting one(or more) specimen(s) showing the mark as used in commerce on or in connection with any item in the class of listed
`goods/services, consisting of a(n) Customer Presentation re: SOMAI State of Mind AI Customer Use Case Summary re: State of Mind (SOMAI)
`State of Mind AI (SOMAI) User Guide SOMAI Customer Service User Guide and Download Instructions.
`
`Original PDF file:
`SPE0-1-2601646480e18060b390b47911678-20200430134303601403_._Perceptive_Automata_SOMAI_Overview_for_Customers__1_.pdf
`Converted PDF file(s) (14 pages)
`Specimen File1
`Specimen File2
`Specimen File3
`Specimen File4
`Specimen File5
`Specimen File6
`Specimen File7
`Specimen File8
`Specimen File9
`Specimen File10
`Specimen File11
`Specimen File12
`Specimen File13
`Specimen File14
`Original PDF file:
`SPE0-1-2601646480e18060b390b47911678-20200430134303601403_._Customer_Use_Case_Manual_for_SOMAI_Deployment.pdf
`Converted PDF file(s) (12 pages)
`Specimen File1
`Specimen File2
`Specimen File3
`Specimen File4
`Specimen File5
`Specimen File6
`Specimen File7
`Specimen File8
`
`

`

`Specimen File9
`Specimen File10
`Specimen File11
`Specimen File12
`Original PDF file:
`SPE0-1-2601646480e18060b390b47911678-20200430134303601403_._SOMAI_Service_Release___Download_Page.pdf
`Converted PDF file(s) (1 page)
`Specimen File1
`Original PDF file:
`SPE0-1-2601646480e18060b390b47911678-20200430134303601403_._State_of_Mind__SOMAI__User_Guide_v1.04.pdf
`Converted PDF file(s) (3 pages)
`Specimen File1
`Specimen File2
`Specimen File3
`
`The owner's/holder's proposed attorney information: Peter Piotr Szymanski. Peter Piotr Szymanski, is a member of the XX bar, admitted to the
`bar in XXXX, bar membership no. XXX, is located at
`      1900 Jefferson, 205
`      San Francisco, California 94123
`      United States
`      peter@siliconvalleycounsel.com
`
`Peter Piotr Szymanski submitted the following statement: The attorney of record is an active member in good standing of the bar of the highest
`court of a U.S. state, the District of Columbia, or any U.S. Commonwealth or territory.
`The applicant's current Correspondence Information:
`      Peter Piotr Szymanski
`       PRIMARY EMAIL FOR CORRESPONDENCE: peter@siliconvalleycounsel.com
`       SECONDARY EMAIL ADDRESS(ES) (COURTESY COPIES): pete@siliconvalleycounsel.com
`
`Requirement for Email and Electronic Filing: I understand that a valid email address must be maintained by the applicant owner/holder and
`the applicant owner's/holder's attorney, if appointed, and that all official trademark correspondence must be submitted via the Trademark
`Electronic Application System (TEAS).
`A fee payment in the amount of $550 has been submitted with the application, representing payment for 2 class(es).
`
`Basis:
`If the applicant is filing the application based on use in commerce under 15 U.S.C. § 1051(a):
`
`Declaration
`
`The signatory believes that the applicant is the owner of the trademark/service mark sought to be registered;
`The mark is in use in commerce and was in use in commerce as of the filing date of the application on or in connection with the
`goods/services in the application;
`The specimen(s) shows the mark as used on or in connection with the goods/services in the application and was used on or in
`connection with the goods/services in the application as of the application filing date; and
`To the best of the signatory's knowledge and belief, the facts recited in the application are accurate.
`
`And/Or
`If the applicant is filing the application based on an intent to use the mark in commerce under 15 U.S.C. § 1051(b), § 1126(d),
`and/or § 1126(e):
`
`The signatory believes that the applicant is entitled to use the mark in commerce;
`The applicant has a bona fide intention to use the mark in commerce and had a bona fide intention to use the mark in commerce as
`of the application filing date on or in connection with the goods/services in the application; and
`To the best of the signatory's knowledge and belief, the facts recited in the application are accurate.
`
`To the best of the signatory's knowledge and belief, no other persons, except, if applicable, concurrent users, have the right to use the
`mark in commerce, either in the identical form or in such near resemblance as to be likely, when used on or in connection with the
`
`

`

`goods/services of such other persons, to cause confusion or mistake, or to deceive.
`
`To the best of the signatory's knowledge, information, and belief, formed after an inquiry reasonable under the circumstances, the
`allegations and other factual contentions made above have evidentiary support.
`
`The signatory being warned that willful false statements and the like are punishable by fine or imprisonment, or both, under 18 U.S.C. §
`1001, and that such willful false statements and the like may jeopardize the validity of the application or submission or any registration
`resulting therefrom, declares that all statements made of his/her own knowledge are true and all statements made on information and
`belief are believed to be true.
`Declaration Signature
`
`Signature: /Peter Piotr Szymanski/   Date: 04/30/2020
`Signatory's Name: Peter Piotr Szymanski
`Signatory's Position: Attorney of Record, California bar member
`Payment Sale Number: 88895303
`Payment Accounting Date: 04/30/2020
`
`Serial Number: 88895303
`Internet Transmission Date: Thu Apr 30 14:09:43 ET 2020
`TEAS Stamp: USPTO/BAS-XXXX:XXX:XXX:XXXX:XXXX:XXXX:XX
`X:XXXX-20200430140943073671-88895303-710
`5d947ae8a3c1f7679d99c01cccac50b635f4c2fa
`13d932b15c5f747a274-CC-09419029-20200430
`134303601403
`
` 
`

`

`State of Mind AI (SOMAI)
`
`

`

`PERCEPTIVE
`AUTGMATA
`
`Human Intuition for Machines
`
`

`

`ANTICIPATING HUMAN BEHAVIOR IS ONE OF THE
`
`THE HARDEST PROBLEMS FOR AUTOMATED DRIVING
`
`fl It's the prediction piece that's still the great unknown.
`Humans are very good at predicting human behavior
`
`“ The choices made by driverless cars are critically
`dependent on understanding and matching the
`
`on the road. Machines will need to be able to predict
`
`expectations of humans. This is the heart of the
`
`and anticipate human behavior much better. H
`
`problem going forward. "
`
`GI" Pratt
`
`CEO of Toyota Research Institute
`GRIT 2018
`
`
`
`Chris Urmson
`
`Head of Waymo. 200972016
`CoFou n der of Aurora. April 2017
`
`“ With radar and higlvesolution cameras and all the computing power we have. we can detect and identify the objects
`on a street. The hard part is anticipating what they're going to do next. We have deve[oped about 80% of the
`technology needed to put selfedriving cars into routine use. But the remaining 20%. including developing software
`
`that can reliably anticipate what other d rivers. pedestrians and cyclists are going to do will be much more difficult. ’7
`
`Bryan Salesky
`
`CoTounder & C 30 of Argo
`July 2019
`
`

`

`HOW AUTOMATED VEHICLES SEE THE WORLD
`
`lPu’cephveAutnmzlaaldismumInzny:yeummbetweenPcrtapuve
`
`PEOPLE ARE OBJECTS IN ‘BOUNDING BOXES’
`
`azaraiumzwmmusum nnlv-d'lsdusurearc-mm:mama»...
`
`

`

`«:9 V
`
`I9
`
`z
`"
`
`w
`2.3
`
`v
`
`BUT VIEWING PEOPLE SIMPLY AS BOXES LEADS TO “PARANOID DRIVING” BECAUSE
`CRITICAL INFORMATION IS MISSING - THE AV HAS NO CHOICE BUT TO STOP
`
`a
`
`

`

`fl.
`I
`h
`
`I
`
`’
`
`.s
`.‘x‘
`
`IN CONTRAST, HUMANS EFFORTLESSLY AND INSTANTANEOUSLY PREDICT THAT
`THIS PEDESTRIAN DOES NOT WANT TO CROSS AND CONTINUE DRIVING
`
`,
`
`«r
`
`'
`
`a
`..a
`
`A
`
`mammazndrea‘piunlmmi
`
`I m. 'If
`:I' nrmatmnanucephveAummzlaald'5mhficflnznyagmn ..
`"ngntrmmnmrmrfiummmim,m,zmereufcnnfi- .
`
`_
`
`-
`
`

`

`OUR UNIQUE PATENTED METHODS HARNESS THE POWER OF
`THE HUMAN PERCEPTUAL SUPERCOMPUTER
`—
`
`Head position
`Shouider tension
`Hand position
`Object handling
`Object carrying
`
`Eye Contact
`Body balance
`Arm movements
`Leg movements
`Type of clothing
`
`Orientation
`Movement
`Changes over time
`Type of person
`Body leaning
`
`Using the tools of behavioral
`science to extract from images
`the cues people use to ‘read’
`other people.
`
`Position offeet
`(SOMAI)
`
` On-Vehicle
` Perce ptive Automata
`
`Fed into our deep learning models
`Training Data —>
`
`Superhuman Predictions
`
`
`
`State of Mind Al
`
`

`

`OUR LICENSABLE SOFTWARE PRODUCT IS THE
`
`SOMAI (“STATE OF MIND Al") SERVICE PACKAGE
`
`SOMAI Service
`(with ongoing
`model updates)
`
`Supporting Tools including:
`
`Supporting Services including:
`
`I State of Mind Analyzer
`- Simulation Plug-In
`0 Visualization Library
`
`0 Test Fleet Support
`I Performance Analysis Support
`
`
`0 SOMAI Signal Usage Consulting
`
`Pedestgén-fi ,,
`
`.0 ‘
`
`Last Mile Delivery
`
`Applications
`
`Robotaxis
`
`Shuttle Services
`
`Automated Trucking
`
`Construction Equipment
`
`Warehouse Equipment
`
`Smart City
`
`

`

`SIMPLE INTEGRATION WITH ON-VEHICLE AUTOMATION STACK
`
`WITHOUT REPLACING OR SLOWING DOWN CUSTOMER SUBSYSTEMS
`
`1}”
`
`Perceptive Automata
`state of Mind Al (SOMAI)
`
`predictions
`
`"
`
`,,.; I
`
`I
`
`Pixels inthe bounding
`boxes
`
`I
`Customer, not PA (i) 7
`Object Detection Data
`
`‘
`
`10
`
`
`
`Corn plementary
`Output Signals
`E‘g; Intention & awareness
`
`
`
`
`<1 ms inference time per object
`(TensorRT, NVIDIATegra;
`unoptimized)
`
`'6—0'
`
`AUTONOMOUS (LII-5)
`Prediction & Planning
`
`A
`((8))
`(GD)v
`
`HIGHLYAUTOMATED (L3)
`Modulatory Signals
`
`

`

`Our Al correctly signals his
`change in intention, and
`his ongoing awareness
`even though he turns his
`
`head away.
`
`

`

`SOLVING FOR THIS CHALLENGE IS CRITICAL
`
`FOR REAL WORLD DEPLOYMENT
`
`
`
`
`
`AUTONOMOUS - L4/5
`
`HIGHLY AUTOMATED - L3
`
`Enhanced Safety
`increased situational awareness for driver
`
`deploy in more complex road environments
`
`0 0
`
`Driver Acceptance
`
`reduce frustrating false positives
`
`finer modulatory signals improve outcomes
`
`O 0
`
`Enabling Transition from L3 to L4/5
`
`focus on common platform
`
`early enablement of L4/5 functionality
`
`O 0
`
`0
`
`Enhanced Safety
`
`0
`
`0
`
`detect and react sooner, before motion
`
`predictable driving => reduce rear—endings
`
`o
`
`Smoother Driving
`
`0
`
`passenger comfort
`
`passenger trust
`0
`Better Fleet/Network Economics
`
`0
`
`0
`
`0
`
`efficiency ofvehicles completingtrips
`
`less vehicle wear and tear + fuel consumption
`
`13
`
`

`

`WAYMO: THE BLEEDING EDGE OF AI
`
`IS THE ABILITY TO UNDERSTAND PEOPLE
`
`fl Anyone can buy a bunch of cameras and LIDAR
`
`sensors, slap them on a car, and call it autonorrous.
`
`But
`
`training a self—driving car to behave li e a
`
`human driver l...] is on the bleeding edge of artificial
`
`
`
`‘6 How can we mal<e it adapt to the drivers that it’s
`
`sharing the road with? How do you tailor it to be
`
`more comfortable or drive more naturally? You
`
`really need a system that fricl<ing vvorl<s. They need
`
`intelligence
`
`research. Waymo's engineers
`
`are
`
`reasoning to understand intentions
`
`of other
`
`modeling not only how cars recognize objects in
`
`drivers and pedestrians. H
`
`the road, for example, but how human behavior
`affects how cars should behave.”
`
`The Verge, May 2018
`Inside Waymo's Strategy to Grow the
`
`Best Brains for Self—Driving Cars
`
`Anca Dragan
`Waymo, 2017
`
`14
`
`

`

`GLOBAL LEADERSHIP POSITION FOR
`
`HUMAN BEHAVIOR PREDICTION
`
`% Slow
`
`i
`
`First
`
`“m“
`
`i‘e’flfi’fiéé‘s‘
`
`WORLD
`
`"353an
`
`PAVE
`
`\_/
`“Fmax'c
`
`In capltal
`(oversu bscri bed
`Series A)
`
`Technical Founders: Neuroscience + Artificial Intelligence Experts
`
`Sam Anthony, PhD
`CarFounder & CTO
`20 years of cognitive scienceand
`computer science experience
`
`III
`I
`UNIVERSITY
`mu HARVARD
`
`David Cox, PhD
`CerFounder Sc Adviser
`Director. MITVIBM Watson Al Lab
`
`I- unis-chum“
`Tedulolngy
`mm...”
`
`I
`
`~© IBM Watson’
`
`‘
`
`Walter Scheirer, PhD
`CarFounder & Adviser
`Fieldrleading researcher in
`computer vision and deep learning
`NIVERSITYDF
`(”RE DAME
`
`SL\TE MIEIEE]
`
`QUARTZ
`
`Bloomberg
`
`nVIDIA
`
`DAIMLER
`
`FfiTQMPAVY
`
`15
`
`

`

`WE ACCELERATE OUR CUSTOMERS’ TIME TO MARKET AND PROVIDE VALUABLE OPTIONALITY
`WITH A PROVEN PATENTED SOLUTION AT DRAMATICALLY LOWER COST
`
`O@®®@
`
`Faster Time
`To Market
`
`CertaintyWith
`Proven Solution
`
`Access to Unique
`Talent & Protected lP
`
`Dramatically
`Lower Cost
`
`Optionality&
`Redundancy
`
`19
`
`

`

`Thank you!
`
`James Gowers
`
`VP Strategy & Business Development
`
`james@perceptiveautomata.com
`
`

`

`PERCEPTIVE
`AUTGMATA
`
`For SOMAI Deployment
`
`Human Intuition for Machines
`
`Customer Use Case Manual
`
`

`

`Customer Use Case Manual For SOMAI Deployment
`
`Table of Contents
`
`COMPANY OVERVIEW
`
`THE CHALLENGE
`
`THE PERCEPTIVE AUTOMATA APPROACH
`
`USING SOMAI OUTPUTS
`
`ADAS FALSE POSITIVE REDUCTION
`
`KALMAN FILTER MODULATION
`
`WORLD MODEL MODULATION
`
`POMDP PRIOR BIASING
`
`FLEXIBILITY, EASE OF INTEGRATION, SPEED, AND SAFETY
`FLEXIBILITY
`
`SIMPLICITY - EASE OF INTEGRATION
`
`SPEED
`
`SAFETY
`
`UPGRADEABILITY
`
`REFERENCES
`
`3
`
`6
`
`7
`
`1o
`
`10
`
`10
`
`11
`
`11
`
`12
`12
`
`13
`
`14
`
`15
`
`15
`
`16
`
`20112
`
`

`

`Customer Use Case Manual For SOMAI Deployment
`
`COMPANY OVERVIEW
`
`Perceptive Automata was founded by a m of Harvard and MIT neuroscientists, computer vision
`researchers, machine learning experts, and software engineers to solve what is often described as
`the hardest problem for highly automated driving: reading the state of mind of humans for the safe
`
`large-scale rollout of highly automated vehicles (L2-L5).
`
`ANTlCIPATING HUMAN BEHAVIOR
`PROBABLY THE HARDEST PROBLEM FOR AUTOMATED DRIVING
`_
`
`fl lt‘s the prediction piece that's Still the
`great tiiikr‘iown Humans are very good at
`predicting: human behavior on the road.
`Machines will need to be able to predict
`and enliclpatehcrrian behavim inueli
`better. ”
`
`H l he (mines made by driverless cars are
`critieally dependent on tir‘iclersiaiiding
`and mateli‘ing the expectations of
`humans.
`I l‘iia: i: the heart of the
`problem going forward. H
`
`Gill Pratt
`CEO of Tow-ates ?
`search Institute
`
`M arm 20 :E}
`
`Chris Urmson
`need at V‘Jtivri‘it: 200" ‘1;
`,
`
`C u , Fc-ui ider Lif Ab l' are, Apr '| EU 1
`
`We enable automated vehicles to better understand what people might do next so they can navigate
`safely around humans, including pedestrians, bicyclists, and motorists. Our Al processes, in real-time,
`
`our customers’ object data and outputs human state of mind attributes, such as 'intention’ and
`'awareness’ as defined in the below graphic, to our customers’ AV path planner or ADAS system.
`
`lllll
`
`lnte ntion
`Do they want to cross?
`
`ii
`
`Awareness
`Do they l
`i- .,
`the car is there?
`
`High Intention,
`High Awareness
`
`Law Intention.
`High Awareness
`
`Low Intention,
`Mid Awareness
`
`Low intention,
`Low Awareness
`
`
`
`!
`
`Sol 12
`
`

`

`Customer Use Case Manual For SOMAI Deployment
`
`PEDESTRIAN, BICYCLIST, AND VEHICLE MODELS
`AND LONG-TAIL T00
`
`Pedestrians
`
`Cyclists
`
`Drivers
`
`
`
`Our signais increase safety and roadmanship by enabling AVs to anticipate human behavior before
`actual body motion is detected. Our signals modulate othenNise paranoid automated driving
`behavior to be more predictable and natural, which reduces rear-endings and enables a smooth ride
`
`experience. For ADAS applications our signals give human drivers better situational awareness and
`increase driver acceptance of more advanced driver assistance functions.
`
`These benefits are critical for increasingly sophisticated driver assistance functions to be embraced
`by human drivers - too many false positives lead to human drivers turning their vehicles’ driver
`assistance systems off. They also critically enable autonomous vehicles to seamlessly integrate into
`human-dominated road environments and to deliver a pleasant ride experience for passengers.
`
`OUR VALUE PROPOSITION
`PRODUCT
`
`—
`
`
`
`AUTONOMOUS - L4/5
`
`Q
`(«a»)v
`HIGHLY AUTOMATED - L3
`
`-
`
`0
`
`-
`
`Safety
`0
`detect and react sooner, before motion
`
`predictable driving => reduce rear-endings
`0
`Smooth Driving
`0
`passenger comfort
`
`passenger trust
`0
`Fleet/Network Economics
`
`-
`
`Safety
`0
`increased situational awareness for driver
`
`deploy in more complex road environments
`o
`- Driver Acceptance
`0
`reduce frustrating false positives
`
`finer modulatory signals improve outcomes
`a
`Enabling Transition from L3 to L45
`
`-
`
`0
`0
`
`efficiency of vehicles completing trips
`less vehicle wear and tear + fuel consumption
`
`:2
`0
`
`focus on common platform
`early enablement of L415 functionality
`
`40112
`
`

`

`Customer Use Case Manual For SOMAI Deployment
`
`We raised $20M from top-tier investors and are working out of offices in Boston and Silicon
`Valley with OEMs, suppliers, and technology companies that are developing ADAS and/or
`
`autonomous driving systems.
`GLOBAL LEADERSHIP POSITION FOR
`HUMAN BEHAVIOR PREDICTION
`
`Jfi m E
`
`fimfifl mums M)m
`
`"mm
`I
`PAV: wen" a
`
`20M
`in capital
`(oversubscribed Series A)
`
`HARVARD
`UNIVERSITY
`I l- nus-dumb
`| I
`Inflam- 0'
`m
`
`SLXTE mrmEE
`
`QUARTZ
`
`Bloombmg
`
`nVIDIA
`
`:i-Huii it
`
`The value we deliver to our customers through our software licensing business model includes
`
`fewer years of technology development for faster market deployment, tens of millions of dollars in
`development cost savings, and access to scarce talent and intellectual property.
`
`OUR VALUE PROPOSITION
`BUSINESS STRATEGY
`
`FasterTime
`To Market
`
`Lower Cost
`
`Access to Unique
`Talent 8. IP
`
`Fetus On
`Your Core
`
`Optimality
`
`THE CHALLENGE
`
`People make effortless, intuitive judgments about what someone else wants or knows constantly.
`In any given thirty second interval at a busy urban intersection, there will be dozens of instances
`
`where one person looks at another and thinks, for example, "she isn’t going to cross," or "he knows
`
`I’m here and is willing to yield,” or "she doesn’t see me, I should stop.”
`
`5 uI12
`
`

`

`Customer Use Case Manual For SOMAI Deployment
`
`Humans are incredibly good at silently communicating with each other. That communication is the
`key to safe, smooth and considerate driving. Until now machines have lacked this critical ability.
`
`They can’t decipher our unspoken social communications nor intuit what’s going on inside our
`heads. 50 how can we give machines like self-driving cars the ability to read human intentions, to
`know what humans know?
`
`The best currently deployed approaches to interacting with the world using computer vision and
`motion planning are insufficient for the task of interacting with humans. Existing non-PA
`
`approaches use physics to locate people and to calculate their trajectory, but can’t usefully
`
`anticipate what a pedestrian might do next. People aren’t billiard balls — we aren’t predictable
`based purely on our past motion.
`
`Let’s take the below example to illustrate this point. Many of today’s approaches convert detected
`humans into 'bounding boxes’, shown below as a yellow box in the image on the left, and then
`attempt to predict their likely actions based on calculated trajectory and context.
`
`The Physics—Only AV Perspective
`
`The Human Driver Perspective
`
`
`
`In this example on the left, a pedestrian is detected at the edge of the road at/near a crosswalk
`with zero motion. The only safe de