Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 1 of 22 PageID #: 49
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 1 of 22 PageID #: 49
`
`
`
`
`
`EXHIBIT B
`
`EXHIBIT B
`
`

`

`(12) United States Patent
`Naboulsi
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9,047,170 B2
`*Jun. 2, 2015
`
`US00904717OB2
`
`(*) Notice:
`
`(54) SAFETY CONTROL SYSTEM FORVEHICLES
`(71) Applicant: Mouhamad Ahmad Naboulsi, West
`Bloomfield, MI (US)
`(72) Inventor: Mouhamad Ahmad Naboulsi, West
`Bloomfield, MI (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`This patent is Subject to a terminal dis-
`claimer.
`(21) Appl. No.: 13/663,085
`1-1.
`(22) Filed:
`(65)
`
`Oct. 29, 2012
`Prior Publication Data
`US 2013/0124038 A1
`May 16, 2013
`
`O
`O
`Related U.S. Application Data
`May
`(60) r of appliftion 9. t
`s
`, now Pat. No. 8.30l., 108, which 1s a
`(Continued)
`
`(51) Int. Cl.
`G06F I7/00
`G08B 2/06
`
`(2006.01)
`(2006.01)
`(Continued)
`
`(52) U.S. Cl.
`CPC ............. G06F 1700 (2013.01); B60R 1 1/0264
`(2013.01); B60R 2011/001 (2013.01); G08B
`21/06 (2013.01)
`
`(58) Field of Classification Search
`USPC ............. 701/36, 41, 29.1, 408,468; 455/345,
`455/411, 556.1, 557, 565, 567,569.1,
`455/569.2, 575.9; 340/438,441, 525,575,
`340/576,901
`See application file for complete search history.
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`7, 1914 Scheibert
`1,103,438 A
`3.223,926. A 12/1965 Maugans
`(Continued)
`
`DE
`JP
`
`FOREIGN PATENT DOCUMENTS
`10352733 A1 10/2004
`62-048.845
`3, 1987
`(Continued)
`OTHER PUBLICATIONS
`Delphi Corporation Selected to Lead Comprehensive Driver Distrac
`tion Research Program; Delphi News Release; Oct. 30, 2002; (3
`pages), Troy, Michigan.
`
`(Continued)
`Primary Examiner — Richard Camby
`(74) Attorney, Agent, or Firm — Vivacqua Law, PLLC;
`Raymond J. Vivacqua; Pete N. Kiousis
`(57)
`ABSTRACT
`According to one aspect of one embodiment of the present
`invention, a safety control system for vehicles, includes, a
`communication device having at least one of an input acces
`sible from within the vehicle and an output communicated
`within the vehicle, at least one sensor operable to sense at
`least one condition related to vehicle operation, and a con
`troller communicated with the sensor and the communication
`device to selectively suppress at least one of said input and
`said output in response to a sensed parameter of said at least
`one condition being outside of a threshold. When an input is
`Suppressed, the driver is prevented from accessing or input
`ting information into the communication device. When an
`output is Suppressed, communication between the device and
`the driver of a vehicle is Suppressed to, among other things,
`avoid distracting the driver during certain driving situations
`or conditions relating to the driver, vehicle and/or environ
`ment.
`
`31 Claims, 5 Drawing Sheets
`
`
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 2 of 22 PageID #: 50
`
`

`

`US 9,047,170 B2
`Page 2
`
`Related U.S. Application Data
`continuation of application No. 10/287.299, filed on
`Nov. 4, 2002, now Pat. No. 6,731,925, which is a
`continuation of application No. 10/279.447, filed on
`Oct. 24, 2002, now abandoned.
`(60) Provisional application No. 60/336,293, filed on Oct.
`24, 2001, provisional application No. 60/390,877,
`filed on Jun. 21, 2002.
`
`(51) Int. Cl.
`B6OR II/O2
`B6OR II/OO
`
`(2006.01)
`(2006.01)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`4.485,375 A 1 1/1984 Hershberger
`4,572.207 A
`2/1986 Yoshimi et al.
`4,649.282 A
`3. SMG, al
`5,266,922. A 1 1/1993 Smith et al.
`5,301.227 A
`4, 1994 Kamei et al.
`3.25 A 2E R. 1
`- 4 J.
`aneko et al.
`5,543,591 A
`8/1996 Gillespie et al.
`5,812,698 A
`9, 1998 Platt et al.
`5,813,989 A
`99. Sight al.
`5,855,144. A
`1/1999 Parada
`5,880,411 A
`3/1999 Gillespie et al.
`5,897,505 A
`4/1999 Feinberg et al.
`5,915,561 A
`6/1999 Lorenzana et al.
`5.936,518 A
`8, 1999 Fukuiet al.
`5,978,737 A 11/1999 Pawlowski et al.
`6,028,271 A
`2/2000 Gillespie et al.
`89. A
`22999 Singa,
`Ww -
`ates et al.
`6,104,101 A
`8/2000 Miller et al.
`6,107,922 A
`8.299 E. 1
`&E A
`R388
`mitZ sal
`k I -
`annon et al.
`6,147.315 A 1 1/2000 Rudolph et al.
`is: A
`2.99 R
`6.54,658. A
`1/2000 s
`erg
`k - I
`f
`Ea al
`ISS f
`1339. R et l
`26,
`158
`ert et al.
`4. W-1
`f
`Wh
`1
`6,240,347 B1
`5299; Everhart et al.
`6,246.933 B1
`6/2001 Bague
`6,249,720 B1
`6/2001 Kubota et al.
`6.253,131 B1
`$398: SE
`3.
`R 239; SE
`6,282,906 B
`9/2001 last et al.
`4 was
`f
`aC Fal
`35E R 858: SR Sh 1
`6,335,689 Bi
`1, 2002 yigue et al.
`- - -
`f
`Ine
`6,339,700 B1
`1 29: Tsai
`352. R
`583 R 1
`- -
`f
`R
`al
`6,380,931 B1
`$383 Gillespie et al.
`6,381,966 B1
`529: EMS, 1
`& S. R 23: S. E. et
`6.430.4ss B1
`8/2002 So
`e N.
`I - W
`oldman et al.
`6,434.450 B1
`8/2002 Griffin, Jr. et al.
`6,434.459 B2
`8/2002 Wong et al.
`6,438,465 B2
`8/2002 Obradoyich et al.
`6,502,022 B1
`12/2002 Chastain et al.
`6,526,762 B1
`3/2003 Barrow
`6,556,810 B2
`4/2003 Suzuki
`6,575,902 B1
`6, 2003 Burton
`6,580,973 B2
`6, 2003 Leivian et al.
`6,580,984 B2
`6, 2003 Fecher et al.
`6,600,975 B2
`7/2003 Moriguchi et al.
`
`8/2003 Gillespie et al.
`6,610,936 B2
`8/2003 Bartlett
`6,611,752 B1
`6,665,600 B2 12/2003 Miller et al.
`6,675,082 B2
`1/2004 Galli et al.
`$32, R 239: Elect et al.
`6.756,903 B2
`62004 Gmiyet al.
`6,771,946 B1
`8/2004 Oyaski
`6,775,603 B2
`8, 2004 YEet al.
`6,791462 B2
`9, 2004 Choi
`6,810,309 B2 10/2004 Sadler et al.
`6,812,942 B2 11/2004 Ribak
`D500,639 S
`1/2005 Cauchy et al.
`6,842,677 B2
`1/2005 Pathare
`6,871,067 B2
`3/2005 Clarket al.
`6,880,941 B2
`4/2005 Suggs
`6,882,906 B2
`4/2005 Geisler et al.
`6,886,060 B2
`4/2005 Wang et al.
`6,886,653 B1
`5/2005 Bellehumeur
`6,892,116 B2
`5/2005 Geisler et al.
`6,895.316 B2
`5/2005 Chen et al.
`: R:
`398 Stal
`6,946,966 B2
`92005 Koenig
`6,968,311 B2 11/2005 Knockeart et al.
`6,973.323 B2 12/2005 Oesterling et al.
`6,974,414 B2 12/2005 Victor
`7,006,793 B2
`2/2006 Himmel et al.
`7,009,488 B2
`3/2006 Schwartz et al.
`7.019.623 B2
`3, 2006 Klausner et al.
`7020.499 B2
`3/2006 Moffetal.
`7,049,941 B2
`5/2006 Rivera-Cintron et al.
`7,054,723 B2
`5/2006 Seto et al.
`T.O62.365 B1
`6, 2006 Fei
`706867 B2
`6/2006 Brunner
`708.4773 B2
`8/2006 Oyama
`7,116,989 B2 10/2006 MaZZara et al.
`T120,785 B1
`10/2006 Bowers et all
`733,753 B2
`1/2006 Nakajima et al.
`7,194,347 B2
`3/2007 Harumoto et al.
`7.218,213 B2
`5/2007 Katagiri et al.
`7.243,012 B2
`7/2007 Miyake et al.
`7,280.852 B2 10/2007 Shimizu et al.
`7,295,904 B2 11/2007 Kanevsky et al.
`7,308.247 B2 12/2007 Thompson et al.
`7.321,825 B2
`1/2008 Ranal
`7,349,782 B2
`3/2008 Churchill et al.
`7.627,427 B2 * 12/2009 Nichols et al. ................ 7O1/517
`7,688,244 B2
`3/2010 Lee et al.
`2001/0002449 A1
`5/2001 Eisenmann et al.
`2001/0016789 A1
`8/2001 Staiger
`2002fOO69071 A1
`6/2002 Knockeart et al.
`2002/0075168 A1
`6/2002 Ablay et al.
`2002/009 1706 A1
`7/2002 Anderson et al.
`2002/011 1725 A1
`8/2002 Burge
`2002/0116156 A1
`8/2002 Remboski et al.
`2002/O120371 A1
`8/2002 Leivian et al.
`2002/O120374, A1
`8/2002 Douros et al.
`2002/0180608 Al 12/2002 Omry et al.
`2003/00 14521 A1
`1/2003 Elson et al.
`2003/0065432 A1
`4/2003 Shuman et al.
`2003/0073406 A1
`4/2003 Benjamin et al.
`2003/0169181 A1
`9/2003 Taylor
`2003,0169522 A1
`9, 2003 Schofield et al.
`2003/017.9233 A1
`9, 2003 McWalter et al.
`2003/0179773 A1
`9, 2003 MOcek et al.
`2003. O182032 A1
`9, 2003 McWalter et al.
`2003/0182233 A1
`9, 2003 Mocek et al.
`2003/0182360 A1
`9, 2003 Mocek et al.
`2003/0187571 A1 10/2003 Impson et al.
`2003,019 1569 A1 10, 2003 Su et al.
`2003/0210 150 A1 11/2003 Benedict
`2003/0216136 A1 11/2003 McBrearty et al.
`2004/OOOO992 A1
`1/2004 Cuddihy et al.
`2004/0039509 A1
`2/2004 Breed
`2004/0044454 A1
`3/2004 ROSS et al.
`2004/0088084 A1
`5, 2004 Geisler et al.
`2004/O122562 A1
`6/2004 Geisler et al.
`2004.0167680 A1
`8/2004 Nakajima et al.
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 3 of 22 PageID #: 51
`
`

`

`US 9,047,170 B2
`Page 3
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2004/O1983 06 A1 10, 2004
`2004/0204795 A1 10, 2004
`2004/0204796 A1 10, 2004
`2004/0236474 A1 11, 2004
`2004/0236475 A1 11, 2004
`2004/0236476 A1 11, 2004
`2004/0243292 A1 12, 2004
`2005, 0021190 A1
`1/2005
`2005, OO3O184 A1
`2, 2005
`2006/00944.12 A1
`5, 2006
`2006/0095848 A1
`5, 2006
`2006/0202842 A1
`9, 2006
`2007/OO73944 A1
`3, 2007
`2007/01528O3 A1
`7/2007
`2007/0167147 A1
`7/2007
`2008.01251.02 A1
`5/2008
`2009 OOO6678 A1
`1/2009
`
`Singh et al.
`Harvey et al.
`Harvey et al.
`Chowdhary et al.
`Chowdhary
`Chowdhary
`Roy
`Worrell et al.
`Victor
`Nonoyama et al.
`Naik
`Sofer
`Gormley
`Huang et al.
`Krasner et al.
`Abel et al.
`Mishima
`
`FOREIGN PATENT DOCUMENTS
`
`JP
`JP
`JP
`JP
`JP
`JP
`
`09-01-1772
`09-292261
`2000-172195
`2000-301964
`2001-045181
`2001-239897
`
`1, 1997
`11, 1997
`6, 2000
`10, 2000
`2, 2001
`9, 2001
`
`OTHER PUBLICATIONS
`
`Volvo Owners Club, Volvo Press Releases; Sep. 8, 2003; (9 pages)
`United Kingdom.
`UK Debut for All-New Volvo S40 at Scottish Motor Show; Oct. 20,
`2003; (2 pages), United Kingdom.
`Duncan Graham-Rowe, Smart Assistant Will Cut Driver Distraction
`(NewScientist.com); Dec. 7, 2003 (2 pages).
`Edwin Bastiaensen; PReVENT Intergrated Project for Active Safety
`Gets Underway (its(aertico); Feb. 3, 2004; (3 pages), Europe.
`Memorandum of Understanding for Realisation of Interoperable In
`Vehicle eCall (Safety Forum eCall Driving Group); May 28, 2004; (7
`pages), Europe.
`Dr. Juergen Schwarz; Response 3–Code of Practice for Develop
`ment, Validation and Market Introduction of ADAS-A PReVENT
`Project (DaimlerChrysler AG); Jun. 3, 2005; (9 pages), Stuttgart,
`Germany.
`Maria Rimini-Doering, et al.; I-TSA Traffic Safety Assessment in a
`Simulator Experiment with Integrated Information and Assistance
`Systems (Fourth International Driving Symposium on Human Fac
`tors in Driver Assessment, Training and Vehicle Design); Jul. 9-12,
`2007: (9 pages), Stevenson, Washington.
`New Solution to Texting While Driving can Save Lives (Cum
`mingHome); Jul. 11, 2007; (2 pages), Georgia.
`Wheel (Version: 12); Author Unknown, Date Unknown. Where Pub
`lished Unknown.
`
`* cited by examiner
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 4 of 22 PageID #: 52
`
`

`

`U.S. Patent
`
`Jun. 2, 2015
`
`Sheet 1 of 5
`
`US 9,047,170 B2
`
`
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 5 of 22 PageID #: 53
`
`

`

`U.S. Patent
`
`Jun. 2, 2015
`
`Sheet 2 of 5
`
`US 9,047,170 B2
`
`
`
`
`
`
`
`
`
`P
`
`21
`
`22
`
`23
`
`24
`
`
`
`25
`
`26
`
`27
`
`28
`
`29
`
`3O
`
`31
`
`32
`
`HAND-GRPPNG
`SENSORS
`
`HAND-GRPPNG
`SENSORS2
`
`GRIPPING FORCE
`SENSOR S1, S2
`
`PULSE, TEMP,
`SKN COND.
`SENSOR S1, S2
`
`STEERING
`IRECTION
`SENsors3
`
`
`
`GAS PEDAL
`SENSOR S4
`
`BRAKE PEDA
`SENSORS5
`
`TRANSMSSION
`SENSORS
`
`PROXMITY
`SENSORS S7, S8
`
`DARKNESS
`SENSOR Sg
`
`RAN
`SENSOR So
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 6 of 22 PageID #: 54
`
`TURN - NDICATOR
`SENSORS
`
`33
`
`NAVGATION
`SOFTWARE
`
`2O
`
`DISABE
`TELEPHONE
`OUT GONG
`CALLS
`
`DSABLE
`TELEPHONE
`RNGER SIGNAL
`AND NCOMING
`CALLS
`
`
`
`DSABLE
`COMPUTER
`ACCESS TO
`INTERNET
`
`ACTUATE
`VISUAL
`|NDCATOR
`
`ACTUAE
`AUDIBE
`ALARM
`
`43
`
`44
`
`45
`
`FIG - 3
`
`

`

`U.S. Patent
`
`Jun. 2, 2015
`
`Sheet 3 of 5
`
`US 9,047,170 B2
`
`50 Yu START
`
`51 g
`
`
`
`SEES)-5E, SS
`
`53
`DISABLE
`
`
`
`ETC
`
`INDICATOR
`
`52
`
`
`
`55
`
`STEERING
`WHEELT
`
`STRESS
`CONDITION?
`
`
`
`
`
`ANY
`CHANGE IN
`DIRECTION WITHN
`PRED. TIME?
`
`62
`
`
`
`
`
`ACTUATE
`AUDIO
`ALARM
`
`63
`
`DRIVE
`N
`REVERSE7
`
`Y
`
`BRAKINGP
`
`HIGH VEL.
`OR
`
`TURN OR
`CURVES
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 7 of 22 PageID #: 55
`
`FIG - 4
`
`

`

`U.S. Patent
`
`Jun. 2, 2015
`
`Sheet 4 of 5
`
`US 9,047,170 B2
`
`:
`
`to Time-Out Flag After emergencies
`3 For Distress
`For Busy
`Predictive Algorithms
`C Off Ramp From Highway Speed
`3. On Ramp to Highway speed
`O Blind View Ahead
`Driving Drift Detected
`Straight Ahead Vector
`Foolproofing counter circumventing
`measure/Data Integrity
`long Calls antidistraction feature
`Driver Biometrics and in Cabin activity
`
`
`
`
`
`
`
`Intelligent Alarms
`c. Long calls/Antidistraction reminder via
`Internal/ExternatRear view Mirrors
`O Collision imminent notification Via
`Internal/External Rearview Mirrors
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 8 of 22 PageID #: 56
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`intelligent Vehicle features
`Service monitor
`Natural Environment
`Vehicle Operation Dynamics
`Switches decision Algorithm
`• Accident Occurred Algorithm
`" Sanity Check Algorithm
`Time & Location Algorithm
`i
`Watch Dog Algorithm/Circuit
`-------- A ---
`
`:
`
`
`
`Telematics Equipment Connections
`c Telephone
`C. Navigation
`C Directory
`C Message recorder
`o Pager
`C. e-mail
`{C Internet Browsing
`C Intelligent collision Alarms
`C Long call anti distraction
`POA
`C: Phone book A Adress book
`
`e
`
`Telematics Equipment
`Announcements / Feedback / Alarms etc.
`
`
`
`Figure 5A
`
`

`

`U.S. Patent
`
`Jun. 2, 2015
`
`Sheet 5 of 5
`
`US 9,047,170 B2
`
`
`
`Frcm BuS or SENSOR OR CACULATED WALUES
`Crive
`o Parking Gear
`Neutral Gear
`Drive Gear
`Clutch depressed M?T Only)
`Transmission Shift UPOown
`Brake activation
`G Force?two planes
`Throttle position, position/time
`Gas Pedal positicin, position/time
`Valves intake sixhaust position sensor
`Tachometer-Engine RPM rate/time
`Valves intakef Exhaust position sensor
`Tachometer-Engine RPM rate/time
`Automatic Transmission Flywheel dynamic
`change in Pressure sensor Charge in Centripital
`force.
`Steering member angle, angle/time
`Inclinorineter
`RCloyer Sensor
`e Airbag deployment
`Rcil/Bank
`Tires Pressure, FR, FL, RR, RL
`o
`Active Olive? Assistan Systems
`to ABS activation Signal time
`e Adaptive/intelligent cruise control
`o Night vision
`b Traction Control signal
`ESP/Stability controls/Anti Roll
`intersection Collision Warning
`s
`a Lane/Road departure
`
`d
`
`Turning signal Left/Right
`Emergency Flasher
`HVAC activation
`Wiper activation
`Intelligent food and beverage
`hcider
`driver Sea Bet
`Accessories activation
`fn actlytic
`ISCRSP, SCRSU, SORSD, SSORSP,
`SSCRSU, SCRD
`
`Annoyances
`• Dog Strap
`•
`Child Crying
`s Dog barking detector
`Cigarettesmoke
`
`Physiology
`Alcohol level
`Heart Rese
`Pressure or Steering Mechanism
`Sweat sensor
`Driver femperature
`Woe Mcnic
`
`Security
`0
`Driver Sea Position/Reciner
`Sens Cf
`Driver Sea: Back weight Sensor
`teering Tilt wheel position
`
`Environment
`Lighting condition Night/Day
`Wiper Setting
`High beam light
`fog lamp
`HVAC Setting
`Total vehicle weight
`vehicle speed
`Number of Passergers
`Bearingficrgitude/Latitude? Altitude
`Proximity Alarm. Front Rear Blind spot
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 9 of 22 PageID #: 57
`
`Figure 5B
`
`

`

`1.
`SAFETY CONTROL SYSTEM FORVEHICLES
`
`US 9,047,170 B2
`
`REFERENCE TO CO.-PENDINGAPPLICATIONS
`
`The present application is a divisional of U.S. patent appli
`cation Ser. No. 10/838,708 filed May 4, 2004 (now U.S. Pat.
`No. 8.301,108) which is a continuation of U.S. patent appli
`cation Ser. No. 10/287.299, filed Nov. 4, 2002 (now U.S. Pat.
`No. 6,731.925), which claims the benefit of a priority from
`U.S. patent application Ser. No. 10/279.447, filed Oct. 24,
`2002, Provisional Application No. 60/390,877 filed Jun. 21,
`2002, and Provisional Application No. 60/336,293 filed Oct.
`24, 2001, the contents of which are incorporated herein by
`reference.
`
`FIELD OF THE INVENTION
`
`The present invention relates to the field of telematics,
`namely to the field of integrating information, communica
`tion, computing and entertainment technologies into vehicles
`for civilian or military use. The invention particularly relates
`to safety control systems for vehicles to reduce driver distrac
`tion, avoiding potentially dangerous conditions tending to
`produce accidents.
`
`BACKGROUND OF THE INVENTION
`
`One potentially dangerous condition is the use of a vehicle
`telephone by the vehicle driver while driving the vehicle. The
`use of telematics in general and particularly cellular tele
`phones by drivers while driving has been found to increase the
`possibility of an accident since such a telephone not only
`diverts the driver's attention from driving, but also generally
`requires the use of at least one of the drivers hands and
`distract the driver's eyes from the road and traffic. In fact,
`many states and countries have enacted legislation requiring
`that telephones used in vehicles by drivers while driving must
`be of the “hands free” type and usually telematics equipment
`carries a warning to educate and discourage the driver about
`the risk of using these devices while driving. However, such
`legislation is difficult to enforce and education is not usually
`effective in assuring driver compliance. Moreover, even
`where the vehicle is equipped with a “hands free' telephone,
`drivers nevertheless still frequently use one hand for holding
`or dialing the telephone. When one hand is occupied by
`holding a telephone, the danger of causing an accident in an
`emergency situation is increased because of the additional
`reaction time required to properly grip the steering wheel
`with both hands. Similar danger exists when the driver
`attempts to control audio and video equipment, e.g. Radio,
`Music CD, DVD, Books on tape etc., or when the driver
`attempts to change environmental controls like adjusting the
`heat or air conditioning, or other vehicle settings.
`There are other potentially dangerous conditions and
`inherent risks in driving that depends on the driving act itself,
`Such as rapidly accelerating or decelerating, excessive
`maneuvering, merging to or exiting a freeway, passing,
`changing lanes, changing gears, depressing the clutch, driv
`ing at high speed, negotiating a turn, braking, reverse-driving,
`or a stress condition on the part of the driver, that could
`increase the possibility of an accident should the driver be
`distracted by activation of the telephone or other signal or
`device. This inherent risk is also dependent on the driving
`purpose as well, for example, the risk in driving a police
`cruiser is inherently riskier then in driving a sedan, and driv
`ing a delivery van has different risk than driving the family
`Wall.
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 10 of 22 PageID #: 58
`
`2
`Herbert et al., U.S. Pat. No. 6,188,315 and Brown, U.S. Pat.
`No. 6,353,778, disclose systems for avoiding preset poten
`tially dangerous conditions while operating a vehicle having
`a vehicle telephone, but the systems described in those patents
`are of relatively limited application, and do not provide for
`avoiding dangerous conditions or to managing risk and indi
`vidualizing the warnings to individual driving skills or appli
`cation and to combinations of events and environmental con
`ditions.
`
`SUMMARY OF THE INVENTION
`
`An object of at least some presently preferred embodi
`ments of the present invention is to provide a safety control
`system for vehicles tending to reduce the possibility of acci
`dents in one or more of the above respects. Another object of
`at least some presently preferred embodiments of the inven
`tion is to provide a method of reducing or avoiding driver
`distraction during potentially dangerous conditions encoun
`tered while operating a vehicle.
`According to one aspect of one embodiment of the present
`invention, a safety control system for vehicles, includes, a
`communication device having at least one of an input acces
`sible from within the vehicle and an output communicated
`within the vehicle, at least one sensor operable to sense at
`least one condition related to vehicle operation, and a con
`troller communicated with the sensor and the communication
`device to selectively suppress at least one of said input and
`said output in response to a sensed parameter of said at least
`one condition being outside of a threshold. When an input is
`Suppressed, the driver is prevented from accessing or input
`ting information into the communication device. When an
`output is Suppressed, communication between the device and
`the driver of a vehicle is Suppressed to, among other things,
`avoid distracting the driver during certain driving situations
`or conditions.
`According to one aspect of one embodiment of the present
`invention, there is provided a safety control system for
`vehicles including a telephone or other input or output device
`and one or more sensors for sensing instantaneous driver
`stimuli and/or a potentially dangerous condition and for auto
`matically disabling or Suppressing the telephone or other
`input or output device when sensing such stimuli and condi
`tion. In one form, the sensors include two sensors mounted on
`a steering member to provide an indication of the presence of
`the drivers hands on the vehicle steering member, and effec
`tive to suspend use of the telephone or other input/output
`device when the two hands of the driver are not sensed as
`present on the steering member while the vehicle is in motion.
`This system is modular, dynamic, interactive, and adaptive to
`each individualized user. In one implementation, the inven
`tion employs a method for automated machine prioritizing to
`provide assistance to the to driver and optimize the function
`ality of telematics features accessibility by arranging them
`according to a user's needs and preferences based on usage
`frequency of individual features and/or application or as cus
`tomized individually by the user preferences, skills and
`events. In another embodiment, sensors on a steering member
`are used to measure changes in driver physiology. Other
`methods can be used for sensing driver physiology, e.g. via
`infrared detection, camera and image/color recognition etc.
`Smart Speaker: Incoming calls are routed to a speaker that
`reflects and bounce sounds of front windshield at driver Look
`Ahead, Eye Level. Or simulate such action so that a driver
`focuses or has his/her attention directed toward the wind
`shield just like he would do if he is carrying a conversation
`with another person.
`
`

`

`4
`and, when sensed, can lead to disabling or Suppressing opera
`tion of the input/output devices to avoid aggravating the
`stressed condition.
`The system may also sense a drowsiness condition of the
`vehicle operator. For example, the system may include a
`steering direction sensor that actuates a drowsiness alarm
`when sensing a failure to change the steering direction within
`a predetermined time, distance interval while accounting for
`vehicle speed in indicating a possible drowsiness condition in
`the driver. Additionally, such sensor when monitored with
`respect to changes overtime will indicate jerk reaction, which
`indicates that the driver was not paying attention and the
`system will temporarily Suspend all telematics to give the
`driver a chance to recover. Another application for Such a
`sensor is the monitoring of an OFF Zero angle for an extended
`period of time/distance which can indicate a blind curve or
`hard curve, and again, here the system will temporarily Sus
`pend the telematics and/or input/output devices from inter
`acting with the driver, and vice versa, until normal driving
`functions are restored.
`According to another aspect of the present invention, there
`is provided a method of avoiding potentially dangerous con
`ditions while operating a vehicle having an input/output
`device and a steering mechanism including a steering mem
`berto be manipulated by the driver, comprising: providing the
`steering member with two sensors for sensing the presence on
`the steering member of the two hands of the driver; and
`disabling the input/output device when the two sensors fail to
`sense the presence on the steering member of both hands of
`the driver while the vehicle is in motion.
`According to further features in the described preferred
`embodiment, the input/output devices may also be disabled
`when the vehicle is traveling in the reverse direction, or is
`being braked, or is within a predetermined proximity of
`another vehicle, or is traveling at a high Velocity, accelerating,
`decelerating, merging onto or exiting a freeway, passing.
`changing lanes, changing gears, depressing the clutch, or a
`driver is occupied using other accessories in the vehicle or
`otherwise distracted. Since a high degree of attention of the
`driver is required under all the foregoing conditions, opera
`tion of the vehicle telephone, for example, even the ringing
`signal of an incoming telephone call, could be highly distract
`ing to the driver and is therefore disabled to avoid the possi
`bility of increasing the risk of an accident.
`To assure that the driver and the vehicle as well as onboard
`communication devices as described above are working har
`moniously together, one presently preferred embodiment of
`the system includes the following
`The Driving Systems, (Man, Machine, Environment,
`Regulation, and History)
`Man: the driver, the passengers, the pedestrians, Society;
`Machine: the car, the telematics, the infrastructure;
`Environment: the driving environment (in the car and
`outside the car and the infrastructure used)
`History: the personal driving experience, the equipment
`maintenance history
`Regulation: the existing laws and common safe driving
`etiquette into, Society and the infrastructure regula
`tion.
`All of these elements will be harmonized by the system as it
`isolates the drivers from non driving related distractions and
`helps them comply with driving related laws and etiquette via
`reminders and passive assistance.
`Further features and advantages of at least some of the
`embodiments or implementations of the invention will be
`apparent from the description below.
`
`Case 1:21-cv-00064-UNA Document 1-2 Filed 01/21/21 Page 11 of 22 PageID #: 59
`
`45
`
`55
`
`60
`
`65
`
`US 9,047,170 B2
`
`10
`
`15
`
`25
`
`30
`
`35
`
`3
`According to further aspects in the described preferred
`embodiment, the steering member is a steering wheel, and the
`sensors include two sensors on opposite sides of the steering
`wheel located to sense the presence of the drivers hands on
`the steering wheel. Preferably, the two sensors are located
`approximately on or between the “two and “ten' and the
`“three' and “nine' clock positions of the steering wheel.
`It will thus be seen that such a system, requiring both hands
`to be on the steering wheel in order for the driver to operate
`the input/output devices, not only requires the vehicle to be
`equipped with a “hands free’ interface for the input/output
`devices, or a system that can be used as such with an adapter
`or when docked to the system gateway, but also enforces the
`use of the “hands free” feature by sensing that the driver
`actually has both hands placed on the steering member before
`the input/output devices can be operated accessed or dis
`played to the driver. Disabling the operation of the device
`would preferably include not only disabling making outgoing
`and receiving incoming telephone calls, but also disabling the
`signal (typically audible tones, vibrations, or visible light) of
`an incoming call, fax, e-mail, the display of non-urgent
`vehicle status or warning indicators, since such signals, indi
`cators or displays can distract the driver. Such distractions are
`problematic at times and conditions wherein operation of the
`vehicle requires more than usual driver attention and interac
`tion, or when other distractions are already present for the
`driver.
`According to further features in the described preferred
`embodiment, the vehicle may also include a computer or the
`driver may also use a portable multi-function telematics
`device in the vehicle allowing access to the Internet or other
`network for transmitting and/or receiving faxes or e-mail or
`browsing the web or accessing a WAN, with the sensors also
`disabling driver initiated access to such devices when the two
`hands of the driver are not sensed on the steering member
`while the vehicle is in motion.
`In most cases, the steering member would be a steering
`wheel as presently included in conventional vehicles. How
`ever, in certain applications the steering member could be a
`40
`joystick, or other type of steering member. In Such case, the
`sensors are placed in areas a driver is recommended or
`required to grip the steering member to safely control the
`vehicle.
`According to further optional features in the preferred
`embodiment of the invention described below, the sensors
`may further include devices for sensing vehicle acceleration,
`deceleration, merging onto or exiting a freeway, passing,
`changing lanes, changing gears, depressing the clutch, a
`reverse-drive condition of the vehicle, the braking of the
`vehicle, the undue proximity of the vehicle to another vehicle,
`excessive maneuvering, and/or an unduly high Velocity of the
`vehicle, any one of which conditions, or combination of con
`ditions, may also be effective to disable the operation of the
`telephone, computer, or other potentially distracting equip
`ment, display or indicator within the vehicle.
`According to still further optional features in the preferred
`embodiment of the invention described below, at least one of
`the sensors on the steering member also senses a physiologi
`cal condition of the driver and disables the input/output
`devices when a predetermined physiological condition is
`sensed. For example, the physiological conditions sensed
`could be a predetermined gripping force applied by a hand of
`the driver while gripping the steering wheel, or a predeter
`mined pulse rate, temperature, blood pressure, blood oxygen
`level, and/or skin conductivity of the driver. Such physiologi
`cal conditions may indicate a stress condition of the driver
`
`50
`
`

`

`US 9,047,170 B2
`
`5
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`These and other objects, features and advantages of the
`present invention will be apparent from the following detailed
`description of the preferred embodiments and best mode,
`appended claims and accompanying drawings in which:
`FIG. 1 schematically illustrates one form of a safety control
`system for vehicles constructed in accordance with the
`present invention;
`FIG. 2 is an enlarged view illustrating the steering wheel in
`the vehicle of FIG. 1 and the sensors mounted thereon;
`FIG.3 is a block diagram illustrating the main components
`in the system of FIG. 1;
`FIG. 4 is a flowchart illustrating the operation of the system
`of FIG. 1; and
`FIG. 5A is page 1 of a block diagram illustrating the nature
`and the flow of signals and algorithms used in one presently
`preferred embodiment of the system of the present invention;
`FIG. 5B is page 2 of a block diagram illustrating the nature
`and the flow of signals and algorithms used in one presently
`preferred embodiment of the system of the present invention,
`hereinafter referred to as FIG. 5.
`
`10
`
`15
`
`DETAILED DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`25
`
`6
`tion, radio volume or station, CD-track etc. The system will
`restore operation of the input/output devices when conditions
`are normalized and will notify driver of all missed activities.
`Vehicle 2 illustrated in FIG. 1 is a conventional vehicle
`including a steering mechanism, generally designated 3, hav
`ing a steering wheel 4, a propulsion device Such as a motor or
`engine 5 for driving the vehicle via a transmission or other
`torque converting means Schematically indicated 6, an accel
`eration pedal 7, and a braking pedal 8 for controlling the
`vehicle. Vehicle 2 further includes one or more visual indica
`tor and audio alarms 9, e.g. mounted within the forward-look
`ahead viewing or hearing by the driver.
`FIG.1 further schematically illustrates a cellular telephone
`10 within the vehicle, and a computer 11 or other multifunc
`tion telematic device allowing access to the Internet for trans
`mitting and/or receiving faxes or e-mail, WAN and Web
`access, or other input/output device. Other input/output
`devices include vehicle fault/warning lights (battery, tem
`perature, washer fluid, etc.) or other signal or alarm (open
`door, low fuel level, seat belt monitor, etc.). Vehicle 2 illus
`trated in FIG. 1 may also include many other components
`conventionally provided on vehicles at the present time or to
`be provided in the future.
`The safety control system included in vehicle 2 illustrated
`in FIG. 1 includes a plurality of sensors for sensing various
`conditions with respe