Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 1 of 43
`
`EXHIBIT INDEX TO COMPLAINT
`
`Exhibit No.
`
`Description
`
`1
`
`2
`
`3
`
`4
`
`5
`
`6
`
`7
`
`8
`
`9
`
`Annotated screenshot of September 7–11, 2020 Twitter thread by
`@ejohnson99
`
`Printout of software code excerpt re algorithm metrics
`
`Printout of software code excerpt re comparison metrics
`
`Printout of software code excerpt re exam termination reasons
`
`Printout of software code excerpt re blacklisted programs
`
`Screenshot of September 7–8, 2020 Twitter messages between Erik
`Johnson and Mike Olsen
`
`October 19, 2020 email from Twitter Support to E. Johnson re DMCA
`notice
`
`Screenshot of November 11, 2020 Twitter thread by @ejohnson99
`
`November 25–December 9, 2020 email thread between GitHub Support
`and Erik Johnson re DMCA notice
`
`
`
`
`
`1
`
`7166046v2
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 2 of 43
`
`Exhibit 1
`
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 3 of 43
`
`•
`
`Erik Johnson @ejohnson99 • Sep 7, 2020
`Hey @proctorio @artfulhacker How do you explain t his?
`You have strings referencing
`
`"A Proctorio agent will review and verify the test taker's room scan"
`and
`"live id check"
`
`All while still saying that professors are t he only ones who can access
`recordings and look at students?
`0 14
`
`t1 205
`
`Q 405
`
`Erik Johnson @ejohnson99 • Sep 7, 2020
`"Test takers will connect to a live human based on suspicion level d uring
`t he exam" - seemingly, if you raise enough flags to the algorithm du ring
`your exam, Proctorio's "agents" will spy on you.
`These so- callled "agents" appear to have full access to the feed of
`students' exams.
`01
`
`t1 11
`
`Q 128
`
`,!,
`
`•
`•
`
`•
`
`Erik Johnson @ejohnson99 • Sep 7, 2020
`While "verifyi ng room" they can take actions through a UI prompt asking
`t hem "How should Proctorio respond to Verify Room violations?" options
`are:
`- Interrupt the exam to ensure compliance
`- Immediat ely remove the test taker from the exam
`- Add incident to Proctorio Gradebook
`01
`Q 103
`
`tl. 8
`
`,!,
`
`Erik Johnson @ejohnson99 • Sep 7, 2020
`Here's a list o f metrics Proctorio looks for & f lags:
`- Changes in audio levels
`- Abnormal c licking
`- Abnormal copy & pastes
`- Abnormal exam d uration
`- End t imes
`- Eye movem ent
`- # of faces
`- Head movement
`- Abnormal movement of mouse
`& more pastebin.com/2Kbez442
`0 3
`
`tl. 20
`
`Q 114
`
`,!,
`
`
`
`1
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 4 of 43
`
`•
`
`Erik Johnson @ejohnson99 • Sep 7, 2020
`They use these metrics to compare you to other students in the class,
`flagging students and their deviation away from the average number of
`- copy/pastes
`- resizes
`- audio spikes
`- head & eye movements
`- mouse movements
`- keystrokes
`pastebin.com/PtPivBsM
`t.-: 6
`
`Q 2
`
`<::) 89
`
`,!,
`
`•
`
`Erik Johnson @ejohnson99 • Sep 7, 2020
`Your attempt can be terminated if ...
`- 2+min disconnection
`- Attempt t o modify page
`- Attempt to download a file
`- Plugged in a monitor
`- (Un)plugged camera/mic
`- "hardware malfunction"
`- Switched networks
`- Switched Proxies
`- Reloaded tab
`pastebin.com/gWtv3VQx
`t.l, 11
`
`•
`
`Q 2
`
`<::) 91
`
`,!,
`
`Erik Johnson @ejohnson99 • Sep 7, 2020
`In some cases, you will have to scan your room. At the begining of the
`exam, and during if your suspicion level raises. Proctorio compiles the
`footage into a street-view like 360 image of your room/house that your
`professor can access and seemingly proctorio "agents" too .
`
`.. .
`
`a
`
`• d
`
`, ... ___ .,. _____ _
`e ••-• ~ - -
`
`Q 2
`
`t.-: 15
`
`<::) 83
`
`
`
`
`
`2
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 5 of 43
`
`•
`•
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`If you have a poor internet connection, Proctorio isn't so nice about it...
`" No, your connection is t errible and you will experience issues during an
`exam. If you decide to take an exam on this connection we will notify your
`institution you were warned and ignored the warning."
`0 2
`
`Q 101
`
`t.l. 8
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`The Proctorio chrome ext ension "self-destructs" and uninstalls itself if it
`sees a chrome devtools window open, and redirect s students to this
`page in an attempt t o scare them. lti.proctor.io/hacker It doesn't lock your
`IP and it doesn't forward anything to an admin.
`
`,....--1 r-..._
`1 1
`I I
`' " '
`I I
`,,.,,- ......... ,
`\
`\
`I
`I
`I
`/
`I
`
`,,
`
`I
`/
`I
`I
`I
`\.
`
`\
`I
`\
`I
`/
`I
`
`Smile!
`Whoop'? ...
`
`/
`I
`I
`I
`I
`I
`\
`
`01
`
`t.l. 58
`
`Q 168
`
`', '-, _,,,/ / /
`,,,,,, .... ______ ........
`1 '
`, .... _
`,,,/
`.... _ _, l-- ,,...
`,,,....
`.... ....
`t'----------------~}
`You y.;t tned to hock Proctono and we-e cau'.'lht Your IP has;
`been locked and evidence 1,; beinti ~orwarded to your <;chool adrrw,
`
`•
`
`•
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`A similar thing happens if it detects a proxy az545770.vo.msecnd.net
`/lti/proxy or a network interception az545770.vo.msecnd.net/lti/intercept
`On the topic of proxies/net work auditing, Proctorio seemingly routes ALL
`of your chrome browsing traffic through their servers and hides it from
`any tools.
`01
`
`t.l. 12
`
`<::) 85
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`This isn't just active w hen you're taking a test, it ALWAYS does this if it's
`installed. For example, if you open Charles/Burp with the proctorio
`extension installed, you won't see ANY of your network traffic from
`chrome. I can't see where it's sending data because no DevTools.
`0 2
`
`t.l. 14
`
`<::) 101
`
`
`
`3
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 6 of 43
`
`•
`•
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`It's seemingly impossible to tell when the proctorio extension is collecting
`data from your browser and when it 's not. It has all permissions whenever
`installed and could be logging data 24/7. They claim that they use "zero(cid:173)
`knowledge encription" and don't have access to data.
`•v 107
`01
`
`t.l. 16
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`However, I'm not sure how true this statement is when there's clearly a
`way for "agents" to view exam streams, when the CEO posts a student's
`chat logs publicly to attack him, and when they put a law suit against
`someone linking tutorial videos. see:
`
`Proctorio is suing one of our UBC champions for
`student dignity ...
`6' reddit.com
`
`t.l. 14
`
`•v 114
`
`01
`
`•
`•
`•
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`Not only are the privacy concerns very real, but Proctorio, by nature,
`discriminates against low-class families. Forcing a student t o have a
`private, quiet room with a qualit y webcam, microphone, stable internet
`connection, and computer can be nearly impossible for some.
`•v 178
`0 2
`
`t.l. 36
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`Students everywhere have been sharing their concerns through tweets,
`petitions, and more. @Procteario has a collection of some of these
`student voices. As a student at @miamiuniversity I think @PresGreg and
`the university needs to reconsider its adoption of the Proctorio spyware.
`01
`
`t.l. 4
`
`<:) 88
`
`Erik Johnson @ejohnson99 . Sep 7, 2020
`Not just MU, but campuses across the country need to take into account
`the company's practices, CEO's behavior, privacy concerns, and student
`morale. Change isn't going to happen if the universities and your
`professors don't know about these things.
`01
`
`t.l. 4
`
`<:) 69
`
`
`
`4
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 7 of 43
`
`Erik Johnson @ejohnson99. Sep 7, 2020
`End of thread for now, but I will update as I come across more
`information. Hopefully @artfulhacker will unprivate his account and come
`out of damage control mode that his actions of posting a student's chat
`logs incited, and actually address concerns of the public.
`<:? 77
`0 2
`
`t.l. 4
`
`•
`•
`
`Erik Johnson @ejohnson99. Sep 8, 2020
`Here are a few YouTube videos that are "unlisted" however, they are
`linked to from multiple publicly accessible university websites.
`Proctorio Gradebook Tour: Shows how Proctorio sorts and displays
`student attempts by "suspicion level"
`youtu.be/Sy_qdEo-52M
`0 2
`
`t.l. 1
`
`<:) 60
`
`Erik Johnson @ejohnson99. Sep 8, 2020
`Here's one that shows some of the Lockdown options: youtu.be
`/TbLDFUEKs-g
`
`•
`
`And a full 15 minute demo of Proctorio working in the Canvas LMS.
`youtu.be/51s51NQEgjM
`o,
`
`t.l. 2
`
`<:) 52
`
`•
`
`Erik Johnson @ejohnson99. Sep 8, 2020
`And here's a few more that aren't very notable and just show where to
`access certain areas of the software:
`youtu.be/k6D72vizidY
`youtu.be/OyUl4Ca-lb0
`youtu.be/7vG7F5WBCs4
`youtu.be/4MOZYxfYYhk
`youtu.be/w8RVOORI0Lk
`youtu.be/BS_OMKxumA8
`youtu.be/BxmSb_pvNmA
`0 3
`
`t.l. 1
`
`<:) 54
`
`•
`
`o,
`
`Erik Johnson @ejohnson99. Sep 8, 2020
`Again, these videos are all located on easily accessible websites that can
`be found with a quick Google search. Including this PDF document
`detailing the Proctorio Gradebook: my.namejeff.com/3AalrsH3.pdf
`
`t.l. 1
`
`<:) 52
`
`
`
`5
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 8 of 43
`
`•
`•
`
`Erik Johnson @ejohnson99 . Sep 10, 2020
`No explanation needed. twitter.com/leap4emily/sta ...
`
`This Tweet is unavailable.
`
`0 2
`
`t.1 1
`
`<:) 40
`
`Erik Johnson @ejohnson99 . Sep 11, 2020
`More community response regarding proctoring software. Teachers
`threatening to force students to pay for a more invasive remote
`proctoring software. Incredible.
`
`0 Arie Germaine @LegendAriee16 • Sep 10, 2020
`....... in the middle of a pandemic ... school is a joke rn .. #neat
`Show this thread
`
`THAT IS AN INDICAT ION OF EYES MOVING AWAY
`FROM THE SCREEN.
`
`NO\V IFTHE PRETORIO BEHAVIOR DOES NOT
`IM-PROVE ON CONNECT QUTZ 3, THEN YOU WILL
`HAVE TO BUY THE $15 VERS ION OF PROCTORlO.
`
`I TALKED TO Mc-GRAW-HIL L AND THEY SAID THAT A
`LOT OF NEGATIVE BEHAVIOR WAS TAKIN G PLACE.
`
`I would hate to have to write you up for online cheating which
`gets filed in t he Dean's office.
`o,
`
`<:) 86
`
`t.1 5
`
`•
`
`Erik Johnson @ejohnson99 . Sep 11, 2020
`You may be unable to use it if you have any of these installed. It does this
`by looking at audio/video inputs/outputs, and user agent strings.
`pastebin.com/BR5ivdmm Sources for all of these files can be found
`yourself by accessing the chrome directory for ext ensions. Paths are:
`0 5
`
`<:) 47
`
`t.1 2
`
`
`
`6
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 9 of 43
`
`•
`
`•
`
`
`
`
`Erik Johnson @ejohnson99 . Sep 11, 2020
`Mac: ~/Library/Application\ Support/Google/Chrome/Default/Extensions
`/fpmapakogndmenjcfoajifaaonnkpkei/1.4.20241.1_0/
`
`Windows: C:\Users\<Your_User_Nanne>\AppData\Local\Google
`\Chrome\User Data\Default\Extensions
`\fpmapakogndmenjcfoajifaaonnkpkei\1.4.20241.1_0\
`
`o,
`
`t.l. 2
`
`Q 44
`
`Erik Johnson @ejohnson99 . Sep 11, 2020
`The file containing all the UI prompts from the first few tweets is located
`at /_locales. Open up the messages.json file in a text editor and read on.
`The path containing the application names can be found by searching the
`folder's files for a keyword or, /assets/Js2Q.js
`
`o,
`
`t.l. 1
`
`Q 38
`
`
`
`7
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 10 of 43
`
`Exhibit 2
`
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 11 of 43
`
`/
`
` "description": "lms metrics abnormal audio desc",
` "message": "e.g. consistently talking or in noisy room"
`
`
` "description": "lms metrics abnormal audio title",
` "message": "Abnormal changes in audio levels highlights test takers that had significant changes in audio activity throughout the exam."
`
`
` "description": "lms metrics abnormal clicks desc",
` "message": "e.g. rapidly clicking on various parts of the quiz"
`
`
` "description": "lms metrics abnormal clicks title",
` "message": "Abnormal clicking will highlight test takers who interacted with the quiz page less than the rest of the class"
`
`
` "description": "lms metrics abnormal copy desc",
` "message": "e.g. excessive copies and pastes"
`
`
` "description": "lms metrics abnormal copy title",
` "message": "Abnormal copies and pastes highlights test takers who may have taken material from the exam or brought answers into the exam extensively."
`
`
` "description": "lms metrics abnormal duration desc",
` "message": "may indicate help from outside sources"
`
`
` "description": "lms metrics abnormal duration title",
` "message": "Abnormal exam duration will highlight test takers who have finished significantly faster or slower than the rest of the class."
`
`
` "description": "lms metrics abnormal end desc",
` "message": "may indicate an attempt to bypass system or connectivity issue"
`
`
` "description": "lms metrics abnormal end title",
` "message": "End Times will highlight test takers whose LMS end time does not match the Proctorio end time"
`
`
` "description": "lms metrics abnormal eyes desc",
` "message": "e.g. consistently looking at different areas of the screen"
`
`
` "description": "lms metrics abnormal eyes title",
` "message": "Abnormal eye movement will highlight test takers who may have unauthorized materials within the test environment."
`
`
` "description": "lms metrics abnormal faces desc",
`
`123456789
`
`10
`11
`12
`13
`14
`15
`16
`17
`18
`19
`20
`21
`22
`23
`24
`25
`26
`27
`28
`29
`30
`31
`32
`33
`34
`35
`36
`37
`38
`39
`40
`41
`42
`43
`44
`45
`46
`47
`48
`49
`
`1
`
`

`

`50
`51
`52
`53
`54
`55
`56
`57
`58
`59
`60
`61
`62
`63
`64
`65
`66
`67
`68
`69
`70
`71
`72
`73
`74
`75
`76
`77
`78
`79
`80
`81
`82
`83
`84
`85
`86
`87
`88
`89
`90
`91
`92
`93
`94
`95
`96
`97
`98
`99
`100
`101
`102
`
` "message": "e.g. utilizing additional people"
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 12 of 43
`
`
` "description": "lms metrics abnormal faces title",
` "message": "Abnormal number of faces detected will highlight test takers who may have received help from others during the exam."
`
`
` "description": "lms metrics abnormal head desc",
` "message": "e.g. consistently looking at notes or off the screen"
`
`
` "description": "lms metrics abnormal head title",
` "message": "Abnormal head movement will highlight test takers who looked away from the camera significantly more or less than the other test takers."
`
`
` "description": "lms metrics abnormal ip desc",
` "message": "e.g. collaborating with other test takers on quiz at same time"
`
`
` "description": "lms metrics abnormal ip title",
` "message": "Exam Collusion will highlight test takers who took the exam at the same time on the same network"
`
`
` "description": "lms metrics abnormal keys desc",
` "message": "e.g. typing more than other test takers"
`
`
` "description": "lms metrics abnormal keys title",
` "message": "Abnormal use of keystrokes highlights test takers relying on copy and paste or struggling with free response questions."
`
`
` "description": "lms metrics abnormal less",
` "message": "less"
`
`
` "description": "lms metrics abnormal more",
` "message": "more"
`
`
` "description": "lms metrics abnormal mouse desc",
` "message": "e.g. consistently moving the mouse"
`
`
` "description": "lms metrics abnormal mouse title",
` "message": "Abnormal movement of the mouse will highlight test takers who interacted with the quiz page less than the rest of the class."
`
`
` "description": "lms metrics abnormal resize desc",
` "message": "e.g. consistently changing quiz window size"
`
`
` "description": "lms metrics abnormal resize title",
` "message": "Abnormal resizing of the browser highlights test takers who may have had notes or other material hidden behind the quiz window."
`
`/
`
`2
`
`

`

`103
`104
`105
`106
`107
`108
`109
`110
`111
`112
`113
`114
`115
`116
`117
`118
`119
`120
`121
`122
`123
`124
`125
`126
`127
`128
`129
`130
`131
`132
`133
`134
`135
`136
`137
`138
`139
`140
`141
`142
`143
`144
`145
`146
`147
`148
`149
`150
`151
`152
`153
`154
`155
`
`
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 13 of 43
`
` "description": "lms metrics abnormal scroll desc",
` "message": "e.g. rapidly moving through the quiz"
`
`
` "description": "lms metrics abnormal scroll title",
` "message": "Abnormal scrolling will highlight test takers who interacted with the quiz page less than the rest of the class"
`
`
` "description": "lms metrics abnormal start desc",
` "message": "may indicate an attempt to bypass system or connectivity issue"
`
`
` "description": "lms metrics abnormal start title",
` "message": "Start Times will highlight test takers whose LMS start time does not match the Proctorio start time"
`
`
` "description": "lms metrics abnormal unfocus desc",
` "message": "e.g. open separate webpage"
`
`
` "description": "lms metrics abnormal unfocus title",
` "message": "Abnormal amounts of navigation away highlights test takers using external applications or material differently than the rest of the class."
`
`
` "description": "lms metrics frame audio desc",
` "message": "e.g. talking or noisy environment"
`
`
` "description": "lms metrics frame audio incident",
` "message": "Audio levels in the room increased above the threshold"
`
`
` "description": "lms metrics frame audio short",
` "message": "Audio Levels"
`
`
` "description": "lms metrics frame audio title",
` "message": "Flag Changes in Audio Levels"
`
`
` "description": "lms metrics frame clicking short",
` "message": "Clicking"
`
`
` "description": "lms metrics frame collusion short",
` "message": "Exam Collusion"
`
`
` "description": "lms metrics frame copy desc",
` "message": "e.g. duplicating exam content"
`
`
`/
`
`3
`
`

`

`156
`157
`158
`159
`160
`161
`162
`163
`164
`165
`166
`167
`168
`169
`170
`171
`172
`173
`174
`175
`176
`177
`178
`179
`180
`181
`182
`183
`184
`185
`186
`187
`188
`189
`190
`191
`192
`193
`194
`195
`196
`197
`198
`199
`200
`201
`202
`203
`204
`205
`206
`207
`208
`
`
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 14 of 43
` "description": "lms metrics frame copy incident off",
` "message": "Test taker copied and pasted values"
`
`
` "description": "lms metrics frame copy incident on",
` "message": "Test taker attempted to copy and paste values"
`
`
` "description": "lms metrics frame copy short",
` "message": "Copy & Paste"
`
`
` "description": "lms metrics frame copy title",
` "message": "Flag Copy and Paste"
`
`
` "description": "lms metrics frame duration short",
` "message": "Exam Duration"
`
`
` "description": "lms metrics frame end time short",
` "message": "End Times"
`
`
` "description": "lms metrics frame eyes desc",
` "message": "e.g. look at different monitor"
`
`
` "description": "lms metrics frame eyes incident",
` "message": "Test taker's eyes were looking away from the quiz page"
`
`
` "description": "lms metrics frame eyes short",
` "message": "Eye Movement"
`
`
` "description": "lms metrics frame eyes title",
` "message": "Flag Eye Movements"
`
`
` "description": "lms metrics frame faces desc",
` "message": "e.g. multiple test takers taking the same exam"
`
`
` "description": "lms metrics frame faces incident",
` "message": "Multiple faces detected in the image"
`
`
` "description": "lms metrics frame faces short",
` "message": "Multi-Face"
`
`
`
`/
`
`4
`
`

`

`209
`210
`211
`212
`213
`214
`215
`216
`217
`218
`219
`220
`221
`222
`223
`224
`225
`226
`227
`228
`229
`230
`231
`232
`233
`234
`235
`236
`237
`238
`239
`240
`241
`242
`243
`244
`245
`246
`247
`248
`249
`250
`251
`252
`253
`254
`255
`256
`257
`258
`259
`260
`261
`
` "description": "lms metrics frame faces title",
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 15 of 43
` "message": "Flag Multiple Faces"
`
`
` "description": "lms metrics frame head desc",
` "message": "e.g. look at notes"
`
`
` "description": "lms metrics frame head incident",
` "message": "Test taker was looking away from the quiz page"
`
`
` "description": "lms metrics frame head short",
` "message": "Head and Eye Movement"
`
`
` "description": "lms metrics frame head title",
` "message": "Flag Head and Eye Movements"
`
`
` "description": "lms metrics frame keys desc",
` "message": "e.g. typing on multiple choice exam"
`
`
` "description": "lms metrics frame keys incident",
` "message": "Test taker typed on the keyboard"
`
`
` "description": "lms metrics frame keys short",
` "message": "Keystrokes"
`
`
` "description": "lms metrics frame keys title",
` "message": "Flag Keystrokes"
`
`
` "description": "lms metrics frame mouse short",
` "message": "Mouse Movement"
`
`
` "description": "lms metrics frame resize desc",
` "message": "e.g. move browser to uncover other window"
`
`
` "description": "lms metrics frame resize incident off",
` "message": "Test taker changed zoom level or re-sized the browser"
`
`
` "description": "lms metrics frame resize incident on",
` "message": "Test taker attempted to change zoom level or re-size the browser"
`
`
` "description": "lms metrics frame resize short",
`
`/
`
`5
`
`

`

`262
`263
`264
`265
`266
`267
`268
`269
`270
`271
`272
`273
`274
`275
`276
`277
`278
`279
`280
`281
`282
`283
`284
`285
`286
`287
`288
`289
`290
`291
`292
`293
`294
`295
`296
`297
`298
`299
`300
`301
`302
`303
`304
`305
`306
`307
`308
`309
`310
`
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 16 of 43
`
` "message": "Browser Resize"
`
`
` "description": "lms metrics frame resize title",
` "message": "Flag Browser Resize"
`
`
` "description": "lms metrics frame scrolling short",
` "message": "Scrolling"
`
`
` "description": "lms metrics frame start time short",
` "message": "Start Times"
`
`
` "description": "lms metrics frame unfocus desc",
` "message": "e.g. open separate webpage"
`
`
` "description": "lms metrics frame unfocus incident off",
` "message": "Test taker navigated away from the quiz page"
`
`
` "description": "lms metrics frame unfocus incident on",
` "message": "Test taker attempted to navigate away from the quiz page"
`
`
` "description": "lms metrics frame unfocus short",
` "message": "Navigating Away"
`
`
` "description": "lms metrics frame unfocus title",
` "message": "Flag New Windows or Tabs"
`
`
` "description": "lms metrics tamper av desc",
` "message": "Potential audio/video hardware issue detected"
`
`
` "description": "lms metrics tamper av title",
` "message": "Video Tamper"
`
`
` "description": "lms metrics tamper page desc",
` "message": "Potential webpage issue detected"
`
`
` "description": "lms metrics tamper page title",
`
` "message": "Page Tamper"
`
`PDF document made with CodePrint using Prism
`
`/
`
`6
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 17 of 43
`
`Exhibit 3
`
`
`

`

`/
`
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 18 of 43
`
` "description": "copy/paste",
` "message": "Test taker $action$ values $val$% $rel$ than the average.",
` "placeholders": {
` "action": {
` "content": "$1",
` "description": "the test taker's action based on what the professor enabled"
`
` "rel": {
` "content": "$3",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$2",
` "description": "the test taker's value relative to the average (%)"
`
`
` "description": "resize",
` "message": "Test taker $action$ zoom level or browser size $val$% $rel$ than the average.",
` "placeholders": {
` "action": {
` "content": "$1",
` "description": "the action the test taker performed based on the professor settings"
`
` "rel": {
` "content": "$3",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$2",
` "description": "the test taker's value relative to the average (%)"
`
`
` "description": "audio",
` "message": "Audio levels exceeded the threshold $val$% $rel$ than the average.",
` "placeholders": {
` "rel": {
` "content": "$2",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
`
` "description": "head movement",
` "message": "Test taker was looking away from the quiz page $val$% $rel$ than the average.",
` "placeholders": {
` "rel": {
` "content": "$2",
`
`123456789
`
`10
`11
`12
`13
`14
`15
`16
`17
`18
`19
`20
`21
`22
`23
`24
`25
`26
`27
`28
`29
`30
`31
`32
`33
`34
`35
`36
`37
`38
`39
`40
`41
`42
`43
`44
`45
`46
`47
`48
`49
`
`1
`
`

`

`50
`51
`52
`53
`54
`55
`56
`57
`58
`59
`60
`61
`62
`63
`64
`65
`66
`67
`68
`69
`70
`71
`72
`73
`74
`75
`76
`77
`78
`79
`80
`81
`82
`83
`84
`85
`86
`87
`88
`89
`90
`91
`92
`93
`94
`95
`96
`97
`98
`99
`100
`101
`102
`
` "description": "more/less based on the value"
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 19 of 43
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
`
` "description": "eye movement",
` "message": "Test taker was looking away from the quiz page $val$% $rel$ than the average.",
` "placeholders": {
` "rel": {
` "content": "$2",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
`
` "description": "multi face",
` "message": "Multiple faces were detected in the image $val$% $rel$ than the average.",
` "placeholders": {
` "rel": {
` "content": "$2",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
`
` "description": "mouse movement",
` "message": "Test taker moved the mouse $val$% $rel$ than the average.",
` "placeholders": {
` "rel": {
` "content": "$2",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
`
` "description": "mouse movement",
` "message": "Test taker scrolled $val$% $rel$ than the average.",
` "placeholders": {
` "rel": {
` "content": "$2",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
`/
`
`2
`
`

`

`103
`104
`105
`106
`107
`108
`109
`110
`111
`112
`113
`114
`115
`116
`117
`118
`119
`120
`121
`122
`123
`124
`125
`126
`127
`128
`129
`130
`131
`132
`133
`134
`135
`136
`137
`138
`139
`140
`141
`142
`143
`144
`145
`146
`147
`148
`149
`150
`151
`152
`153
`154
`155
`
`
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 20 of 43
`
` "description": "mouse movement",
` "message": "Test taker clicked the mouse $val$% $rel$ than the average.",
` "placeholders": {
` "rel": {
` "content": "$2",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
`
` "description": "mouse movement",
` "message": "Test taker took $val$% $rel$ time than the average to complete the exam.",
` "placeholders": {
` "rel": {
` "content": "$2",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
` "A695_8": {
` "description": "navigation away from the page",
` "message": "Test taker $action$ from the quiz page $val$% $rel$ than the average.",
` "placeholders": {
` "action": {
` "content": "$1",
` "description": "the action that was performed (based on prof settings)"
`
` "rel": {
` "content": "$3",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$2",
` "description": "the test taker's value relative to the average (%)"
`
` "A695_9": {
` "description": "keystrokes",
` "message": "Test taker used the keyboard $val$% $rel$ than the average.",
` "placeholders": {
` "rel": {
` "content": "$2",
` "description": "more/less based on the value"
`
` "val": {
` "content": "$1",
` "description": "the test taker's value relative to the average (%)"
`
`
`/
`
`3
`
`

`

`156
`157
`158
`159
`160
`161
`162
`163
`164
`
`
`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 21 of 43
` "description": "lms results metrics summary text ip",
` "message": "$count$ other test taker$plural$ took the exam on the same connection at the same time.",
` "placeholders": {
`
` "content": "$1"
`
` "plural": {
` "content": "$2"
`
`
`
`PDF document made with CodePrint using Prism
`
`/
`
`4
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 22 of 43
`
`Exhibit 4
`
`
`

`

`Case 2:21-cv-00691-DLR Document 1-2 Filed 04/21/21 Page 23 of 43
`
`1
`
`2
`3
`
`4
`5
`
`6
`7
`
`8
`9
`
`10
`11
`
`12
`13
`
`14
`15
`
`16
`17
`
`"A7220":{"message":"The attempt ended when the test taker disconnected from
`Proctorio for 2 minutes. <a
`href='https://proctorio.zendesk.com/hc/articles/204295348' target='_blank'
`aria-label='The attempt ended when the test taker disconnected from Proctorio
`for 2 minutes.'>$learn_more$</a>.","description":"lms results performance
`close code0","placeholders":{"learn_more":{"content":"$1"}}},
`"A7221":{"message":"The attempt ended when the test taker submitted the exam.
`<a href='https://proctorio.zendesk.com/hc/articles/204993777' target='_blank'
`aria-label='The attempt ended when the test taker submitted the
`exam.'>$learn_more$</a>.","description":"lms results performance close
`code1","placeholders":{"learn_more":{"content":"$1"}}},
`"A72210":{"message":"The attempt ended when a proctor removed the test taker
`from their exam","description":"lms results performance close
`code10"},"A72211":{"message":"The attempt ended when the time limit was
`exceeded and the exam was auto-submitted. <a
`href='https://proctorio.zendesk.com/hc/articles/204296438' target='_blank'
`aria-label='The attempt ended when the time limit was exceeded and the exam
`was auto-submitted.'>$learn_more$</a>.","description":"lms results
`performance close code11","placeholders":{"learn_more":{"content":"$1"}}},
`"A72212":{"message":"The attempt ended when the test taker attempted to
`modify the quiz page. <a
`href='https://proctorio.zendesk.com/hc/articles/204993877' target='_blank'
`aria-label='The attempt ended when the test taker attempted to modify the
`quiz page.'>$learn_more$</a>.","description":"lms results performance close
`code12","placeholders":{"learn_more":{"content":"$1"}}},
`"A72213":{"message":"The attempt ended when the test taker attempted to
`download a file during the quiz. <a
`href='https://proctorio.zendesk.com/hc/articles/205641867' target='_blank'
`aria-label='The attempt ended when the test taker attempted to download a
`file during the quiz.'>$learn_more$</a>.","description":"lms results
`performance close code13","placeholders":{"learn_more":{"content":"$1"}}},
`"A72214":{"message":"The attempt ended when the test taker's battery died. <a
`href='https://proctorio.zendesk.com/hc/articles/205728638' target='_blank'
`aria-label='The attempt ended when the test taker's battery
`died.'>$learn_more$</a>.","description":"lms results performance close
`code14","placeholders":{"learn_more":{"content":"$1"}}},
`"A72215":{"message":"The attempt ended when the test taker plugged in an
`additional monitor. <a
`href='https://proctorio.zendesk.com/hc/articles/206456887' target='_blank'
`aria-label='The attempt ended when the test taker plugged in