`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 1 of 23 PageID #: 90
`
`
`
`
`
`EXHIBIT D
`
`EXHIBIT D
`
`
`
`(12) United States Patent
`Naboulsi
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,301,108 B2
`Oct. 30, 2012
`
`USOO8301.108B2
`
`(54) SAFETY CONTROL SYSTEM FORVEHICLES
`
`(*) Notice:
`
`St. oulsi, West
`(76) Inventor: Meth
`oomfield, MI (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 1840 days.
`(21) Appl. No.: 10/838,708
`
`(22) Filed:
`
`May 4, 2004
`
`(65)
`
`Prior Publication Data
`US 2004/0209594 A1
`Oct. 21, 2004
`Related U.S. Application Data
`(63) Continuation of application No. 10/287.299, filed on
`Nov. 4, 2002, now Pat. No. 6,731,925.
`(51) Int. Cl
`(2006.01)
`H04B I/06
`(52) U.S. Cl. ..................... 455/345; 455/569.2: 340/575:
`340/576
`(58) Field of Classification Search
`455/345
`455/411, 556.1, 557 565.567.569 1569 2.
`455,575 9. 340,438 441 525 575 576.
`•- s
`s
`us al- 1 - 9 3 401901
`See application file for complete search histo
`pp
`p
`ry.
`References Cited
`
`(56)
`
`U.S. PATENT DOCUMENTS
`1,103.438 A
`7, 1914 Scheibert
`3.233,926. A
`12/1965 N
`4.485375 A 1 1/1984 Hershberger
`4,572,207 A
`2f1986 Yoshimi et al.
`4,649.282 A *
`3, 1987 Ota et al. ..................... 340,630
`is 22 A
`E. R.E.
`455,565
`5.453,929 A
`9, 1995 Stove. 340/.575
`5,521,580 A * 5/1996 Kaneko et al. ................ 340,439
`5,543,591 A
`8/1996 Gillespie et al.
`
`
`
`9, 1998 Platt et al.
`5,812,698 A
`5,813,989 A * 9/1998 Saitoh et al. .................. 340,576
`5,855,144 A
`1, 1999 Parada
`5,880,411 A
`3/1999 Gillespie et al.
`5,897.505. A
`4/1999 Feinberg et al.
`5,915,561 A
`6/1999 Lorenzana et al.
`(Continued)
`
`DE
`
`FOREIGN PATENT DOCUMENTS
`10352733 A1 10/2004
`(Continued)
`
`OTHER PUBLICATIONS
`Delphi Corporation Selected to Lead Comprehensive Driver Distrac
`tion Research Program; Delphi News Release; Oct. 30, 2002; (3
`pages), Troy, Michigan.
`
`Continued
`(
`)
`Primary Examiner — Quochien B Vuong
`(74) Attorney, Agent, or Firm — Reising Ethington P.C.
`(57)
`ABSTRACT
`According to one aspect of one embodiment of the present
`invention, a safety control system for vehicles, includes, a
`communication device having at least one of an input acces
`sible from within the vehicle and an output communicated
`within the vehicle, at least one sensor operable to sense at
`least one condition related to vehicle operation, and a con
`troller communicated with the sensor and the communication
`device to selectively suppress at least one of said input and
`said output in response to a sensed parameter of said at least
`one condition being outside of a threshold. When an input is
`Suppressed, the driver is prevented from accessing or input
`ting information into the communication device. When an
`output is Suppressed, communication between the device and
`the driver of a vehicle is Suppressed to, among other things,
`avoid distracting the driver during certain driving situations
`or conditions relating to the driver, vehicle and/or environ
`ment.
`
`113 Claims, 4 Drawing Sheets
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 2 of 23 PageID #: 91
`
`BOTH HANS
`GRIPPING
`
`53
`54
`SASE
`5ESS, ASE
`Cogger,
`INDCATOR
`
`ANY
`CHANGEN
`DRECTON WHIN
`PRE.TME
`
`y
`
`2
`
`
`
`
`
`furn Yy
`NCATOR
`ON?
`N
`fARKNESS^Y
`3RRAN
`
`N
`
`
`
`US 8,301,108 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`5,936,518 A * 8/1999 Fukui et al. ................... 340,436
`6,028,271 A
`2/2000 Gillespie et al.
`6,085,078 A
`7/2000 Stamegna
`6,085,278 A
`72000 Gates et al.
`1939, A
`29 Nils et al.
`6,114,949 A
`9, 2000 SNietal
`J. J.
`g: A
`2.99 RS, al
`6.148.251 A
`1/2000 Step et al.
`J. I w
`&E5 A
`2.99 Kinberg
`6,166.656 A * 22000 Okada et al. ... 340,901
`6,188,315 B1* 2/2001 Herbert et al. ................ 340,438
`38.7 R ;38; Eh 1
`25.55 E
`85% R.artet al.
`33.36 E.
`56 Kia et al.
`6.253,131 B
`6/2001 Quigleyet al.
`6.256.558 B
`72001 St. ES al
`4 - W
`glura et al.
`6,263,190 B1
`7/2001 Mamori et al.
`6,282,906 B1
`9/2001 Cauchy
`6,292.719 B1
`92001. Seto et al.
`6,308,115 B1
`10/2001 Yamaguchi et al.
`3: R
`29: Mine
`6.353.778 Bi
`3/2002 Brown
`- - -
`6,373,472 B1
`4/2002 Palalay et al.
`6,380,931 B1
`4/2002 Gillespie et al.
`6,381,966 B1
`52002 Barrow
`6,414,671 B1
`7/2002 Gillespie et al.
`6,418.362 B1
`7/2002 St. Pierre et al.
`6,430,488 B1
`8/2002 Goldman et al.
`59 R
`29: Set al.
`6.438465 B2
`& 2002 Sayih et al.
`6,502,022 B1* 12/2002 Chastain et al. ................ TO1/36
`:
`R 258. E.
`6.580,973 B2
`6/2003 Leivian et al.
`6,600,975 B2
`7/2003 Moriguchietal.
`83.38 R: 558 Spital.
`: ;
`3.9 Mt al.
`w -
`f2004 S
`35 R:
`258A fivetal
`6771946 B1
`8/2004 It al.
`J.
`yaSK1
`375.3 R:
`838.
`r et al.
`9: E:
`3. S. et al.
`D500,639 S
`1/2005 Cauchy et al.
`6,842,677 B2
`1/2005 Pathare
`6,880,941 B2
`4/2005 Suggs
`6,882,906 B2
`4/2005 Geisler et al.
`6,886,060 B2
`4/2005 Wang et al.
`6,886,653 B1
`5/2005 Bellehumeur
`6,892,116 B2
`5/2005 Geisler et al.
`6,895.316 B2
`5/2005 Chen et al.
`6,909,947 B2
`6/2005 Douros et al.
`6,946,966 B2
`9/2005 Koenig
`6,968,311 B2 11/2005 Knockeart et al.
`6,973.323 B2 12/2005 Oesterling et al.
`S. E: 1339. Sart etal
`7.019,623 B2
`3/2006 Klausner et al.
`7,020,499 B2
`3, 2006 Moffi et al.
`7,049,941 B2
`5/2006 Rivera-Cintron et al.
`7,054,723 B2
`5/2006 Seto et al.
`7,062.365 B1
`6, 2006 Fei
`29:19, R:
`838. Er
`716,989 B2 10, 2006 MEa etal
`7,120,785 B1
`10/2006 Bowers et al.
`7,133,753 B2 11/2006 Nakajima et al.
`7,194,347 B2
`3/2007 Harumoto et al.
`7,218,213 B2
`5/2007 Katagiri et al.
`7,243,012 B2
`7/2007 Miyake et al.
`
`7,280.852 B2 10/2007 Shimizu et al.
`23: R: 1587 E.
`4;
`; 'S', EE""
`7349,782 B2
`32008 Churchilletal
`2001/0002449 A1
`5/2001 Eisenmann et al.
`2001/0016789 A1
`8/2001 Staiger
`2002fOO69071 A1
`6/2002 Knockeart et al.
`2002/0075168 A1
`6/2002 Ablay et al.
`2002/009 1706 A1
`7/2002 Anderson et al.
`2002/011 1725 A1
`8/2002 Burge
`2002/0116156 A1
`8/2002 Remboski et al.
`2002/O120371 A1
`8/2002 Leivian et al.
`5838.86 A. SS E. el.
`3:39: A
`3: Ea.
`2003/0065432 A1
`4/2003 Shuman et al.
`2003/0073406 A1
`4/2003 Benjamin et al.
`2003/0169181 A1
`9/2003 Taylor
`2003,0169522 A1
`9, 2003 Schofield et al.
`2003/017.9233 A1
`9, 2003 McWalter et al.
`2003/0179773 A1
`9, 2003 MOcek et al.
`2003. O182032 A1
`9, 2003 McWalter et al.
`2003/0182233 A1
`9, 2003 Mocek et al.
`2003/0182360 A1
`9, 2003 Mocek et al.
`2003/0187571 A1 10/2003 Impson et al.
`2003,019 1569 A1 10, 2003 Su et al.
`2003/0210 150 A1 11/2003 Benedict
`2003/0216136 A1 1 1/2003 McBrearty et al.
`2004/0000992 A1
`1/2004 Cuddihy et al.
`2004/0039509 A1
`2/2004 Breed
`2004/0044454 A1
`3/2004 Ross et al.
`2004/0088084 A1
`5/2004 Geisler et al.
`2004/O122562 A1
`6/2004 Geisler et al.
`2004/016768.0 A1
`8/2004 Nakajima et al.
`2004/0204795 A1 10/2004 Harvey et al.
`2004/0204796 A1 10/2004 Harvey et al.
`3988: A.
`39. ER et al.
`owdhary
`2004/0236476 A1 1 1/2004 Chowdhary
`2004/0243292 A1 12/2004 Roy
`38885. A.
`58. We'll et al.
`2006/00944 12 A1
`5/2006 Nonoyama et al.
`2006/0095848 A1
`5.2006 Naik
`2006/0202842 A1
`9, 2006 Sofer
`2007/0073944 A1
`3/2007 Gormley
`2007/0152803 A1
`7/2007 Huang et al.
`2007/0167147 A1
`7, 2007 Krasner et al.
`2008.01251.02 A1
`5.2008 Abel et al.
`FOREIGN PATENT DOCUMENTS
`62-048.845
`3, 1987
`09-01-1772
`1, 1997
`09-292261
`11, 1997
`2000-172195
`6, 2000
`2000-301964
`10, 2000
`2001-045181
`2, 2001
`2001-239897
`9, 2001
`
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`
`OTHER PUBLICATIONS
`Volvo Owners Club, Volvo Press Releases; Sep. 8, 2003; (9 pages)
`United Kingdom.
`UK Debut for All-New Volvo S40 at Scottish Motor Show; Oct. 20,
`2003; (2 pages), United Kingdom.
`-- .
`.
`.
`.
`Duncan Graham-Rowe, Smart Assistant Will Cut Driver Distraction
`(NewScientist.com); Dec. 7, 2003 (2 pages).
`Edwin Bastiaensen; PReVENT Integrated Project for Active Safety
`Gets Underway (its(aertico); Feb. 3, 2004; (3 pages), Europe.
`Memorandum of Understanding for Realisation of Interoperable In
`Vehicle eCall (Safety Forum eCall Driving Group); May 28, 2004; (7
`pages), Europe.
`Dr. Juergen Schwarz; Response 3–Code of Practice for Develop
`ment, Validation and Market Introduction of ADAS-A PReVENT
`Project (DaimlerChrysler AG); Jun. 3, 2005; (9 pages), Stuttgart,
`Germany.
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 3 of 23 PageID #: 92
`
`
`
`US 8,301,108 B2
`Page 3
`
`Maria Rimini-Doering, et al.; I-TSA Traffic Safety Assessment in a
`Simulator Experiment with Integrated Information and Assistance
`Systems (Fourth International Driving Symposium on Human Fac
`tors in Driver Assessment, Training and Vehicle Design); Jul. 9-12,
`2007: (9 pages), Stevenson, Washington.
`
`New Solution to Texting While Driving can Save Lives (Cum
`mingHome); Jul. 11, 2007; (2 pages), Georgia.
`Wheel (Version: 12); Author Unknown, Date Unknown. Where Pub
`lished Unknown.
`* cited by examiner
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 4 of 23 PageID #: 93
`
`
`
`U.S. Patent
`
`Oct. 30, 2012
`
`Sheet 1 of 4
`
`US 8,301,108 B2
`
`
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 5 of 23 PageID #: 94
`
`
`
`U.S. Patent
`
`Oct. 30, 2012
`
`Sheet 2 of 4
`
`US 8,301,108 B2
`
`21
`
`22
`
`23
`
`24
`
`25
`
`26
`
`27
`
`28
`
`29
`
`30
`
`31
`
`HAND-GRPPNG
`SENSORS
`
`HAND-GRPPNG
`
`GRIPPING FORCE
`SENSORS 1, S2
`
`PULSE, TEMP,
`SKN COND.
`SENSORS1, S2
`
`STEERING
`DIRECTION
`SENSOR S3
`
`GAS PEDAL
`SENSOR S4
`
`BRAKE PEDAL
`SENSORS5
`
`TRANSMSSION
`SENSORS
`
`PROXMITY
`SENSORS S7, S8,
`
`DARKNESS
`SENSOR Sg
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 6 of 23 PageID #: 95
`
`32
`
`33
`
`RAN
`SENSOR So
`
`TURN - NDICATOR
`SENSORS1
`
`NAVGATION
`SOFTWARE
`
`nP
`
`20
`
`
`
`TELEPHONE
`OUTGONG
`CALLS
`
`DSABLE
`TELEPHONE
`RINGER SIGNAL
`AND NCOMING
`CALLS
`
`DSABLE
`COMPUTER
`ACCESS TO
`INTERNET
`
`ACTUATE
`VISUAL
`INDICATOR
`
`ACTUATE
`AUDIBE
`ALARM
`
`41
`
`42
`
`43
`
`44
`
`45
`
`FIG - 3
`
`
`
`U.S. Patent
`
`Oct. 30, 2012
`
`Sheet 3 of 4
`
`US 8,301,108 B2
`
`50
`
`51 s
`
`52
`
`BOTH HANDS
`GRPPNG
`SEERNG
`WHEELP
`
`55
`
`STRESS
`CONDITION?
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 7 of 23 PageID #: 96
`
`DRIVE
`N
`REVERSE 2
`
`
`
`Y
`
`
`
`BRAKNG
`
`OR
`
`TURN OR
`CURVEST
`
`DARKNESS
`OR RAN2
`
`N
`
`
`
`
`
`53
`DSABLE
`TELEPHONE,
`COMPUTER,
`ETC
`
`ACTIVATE
`VISUAL
`NDCATOR
`
`
`
`
`
`ANY
`CHANGE IN
`DIRECTION WITHN
`PRED. TIME?
`
`
`
`62
`
`
`
`ACTUATE
`AUDIO
`ALARM
`
`
`
`
`
`63
`
`FIG - 4
`
`
`
`U.S. Patent
`
`Oct. 30, 2012
`
`Sheet 4 of 4
`
`US 8,301,108 B2
`
`FIGURES
`
`
`
`From BUSORSENSORORCACAEWALUES
`rive
`Purking Gear
`Neutral Gear
`Drive Gear
`Rewcase Gear
`Cutch Depressed (M/TOnly)
`Transmission ShiftJPDown
`Brake activation
`GForce?Two planes
`Throttlepositiol,position/tiric
`Gas Pedal position, position/title
`Valves intake Exhaust position sensor
`Tachometer-Engine RPM rate/time
`Automatic Transmission Flywheel dynamic Change in
`Pressure sensor Change in Centripetal force
`Steering member angle, angle/time
`inflinterg
`Rooversensor
`Airbag deployment
`
`Tires Pressure, FRFLRRRL
`Active Driver Assistant Systems
`ABS activation signal (ime)
`Adaptive/intelligant cruise control
`Night vision
`Traction Control signal
`ESP/Stability controls/Anti Roll
`litersection Collision waning
`Last Road departure
`
`Enviroline
`lighting condition Night/Day
`Wiper setting
`High beam light
`Foglalip
`HVACSetting
`Total Vehicle Weight
`Velicle speed
`Number of Passagers
`Baring longitudellatitude/Altitutic
`Proximity Alun Front rear blind spot
`
`Turning signal left/Right
`Energacy Fiasher
`WACctivation
`Wipcractivation
`intcliigatfood and beverage Holder
`DriverSea. Be
`Accessories activation
`Hon activatios
`SORSP, SORSU, SORSD, SSORSPSSORSU,
`SSORS)
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 8 of 23 PageID #: 97
`
`Araces
`Dog Strap
`Child Crying
`Dogbarking detector
`Cigarctic sinkc
`
`Alcohol Level
`He Re
`Pressure on Secring mechanism
`Sweatsensor
`Driver Temperature
`Voice Monitor
`Security
`river SealPositics/Recliner Seisor
`drivct Seat/Back weight Sensor
`Steering Tiltwicel position
`
`
`
`1.
`SAFETY CONTROL SYSTEM FORVEHICLES
`
`US 8,301,108 B2
`
`REFERENCE TO CO.-PENDINGAPPLICATIONS
`
`The present application is a continuation of U.S. patent
`application Ser. No. 10/287,299, filed Nov. 4, 2002 now U.S.
`Pat. No. 6,731.925, which claims the benefit of an priority
`from U.S. patent application Ser. No. 10/279.447, filed Oct.
`24, 2002, Provisional Application No. 60/336,293 filed Oct.
`24, 2001, and Provisional Application No. 60/390,877 filed
`Jun. 21, 2002, the contents of which are incorporated herein
`by reference.
`
`FIELD OF THE INVENTION
`
`The present invention relates to the field of telematics,
`namely to the field of integrating information, communica
`tion, computing and entertainment technologies into vehicles
`for civilian or military use. The invention particularly relates
`to safety control systems for vehicles to reduce driver distrac
`tion, avoiding potentially dangerous conditions tending to
`produce accidents.
`
`BACKGROUND OF THE INVENTION
`
`One potentially dangerous condition is the use of a vehicle
`telephone by the vehicle driver while driving the vehicle. The
`use of telematics in general and particularly cellular tele
`phones by drivers while driving has been found to increase the
`possibility of an accident since Such a telephone not only
`diverts the driver's attention from driving, but also generally
`requires the use of at least one of the drivers hands and
`distract the driver's eyes from the road and traffic. In fact,
`many states and countries have enacted legislation requiring
`that telephones used in vehicles by drivers while driving must
`be of the “hands free” type and usually telematics equipment
`carries a warning to educate and discourage the driver about
`the risk of using these devices while driving. However, such
`legislation is difficult to enforce and education is not usually
`effective in assuring driver compliance. Moreover, even
`where the vehicle is equipped with a “hands free' telephone,
`drivers nevertheless still frequently use one hand for holding
`or dialing the telephone. When one hand is occupied by
`holding a telephone, the danger of causing an accident in an
`emergency situation is increased because of the additional
`reaction time required to properly grip the steering wheel
`with both hands. Similar danger exists when the driver
`attempts to control audio and video equipment, e.g. Radio,
`Music CD, DVD, Books on tape etc., or when the driver
`attempts to change environmental controls like adjusting the
`heat or air conditioning, or other vehicle settings.
`There are other potentially dangerous conditions and
`inherent risks in driving that depends on the driving act itself,
`Such as rapidly accelerating or decelerating, excessive
`maneuvering, merging to or exiting a freeway, passing,
`changing lanes, changing gears, depressing the clutch, driv
`ing at high speed, negotiating a turn, braking, reverse-driving,
`or a stress condition on the part of the driver, that could
`increase the possibility of an accident should the driver be
`distracted by activation of the telephone or other signal or
`device. This inherent risk is also dependent on the driving
`purpose as well, for example, the risk in driving a police
`cruiser is inherently riskier then in driving a sedan, and driv
`ing a delivery van has different risk than driving the family
`Wall.
`Herbert et al., U.S. Pat. No. 6,188,315 and Brown, U.S. Pat.
`No. 6,353,778, disclose systems for avoiding preset poten
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 9 of 23 PageID #: 98
`
`2
`tially dangerous conditions while operating a vehicle having
`a vehicle telephone, but the systems described in those patents
`are of relatively limited application, and do not provide for
`avoiding dangerous conditions or to managing risk and indi
`vidualizing the warnings to individual driving skills or appli
`cation and to combinations of events and environmental con
`ditions.
`
`SUMMARY OF THE INVENTION
`
`An object of at least some presently preferred embodi
`ments of the present invention is to provide a safety control
`system for vehicles tending to reduce the possibility of acci
`dents in one or more of the above respects. Another object of
`at least some presently preferred embodiments of the inven
`tion is to provide a method of reducing or avoiding driver
`distraction during potentially dangerous conditions encoun
`tered while operating a vehicle.
`According to one aspect of one embodiment of the present
`invention, a safety control system for vehicles, includes, a
`communication device having at least one of an input acces
`sible from within the vehicle and an output communicated
`within the vehicle, at least one sensor operable to sense at
`least one condition related to vehicle operation, and a con
`troller communicated with the sensor and the communication
`device to selectively suppress at least one of said input and
`said output in response to a sensed parameter of said at least
`one condition being outside of a threshold. When an input is
`Suppressed, the driver is prevented from accessing or input
`ting information into the communication device. When an
`output is Suppressed, communication between the device and
`the driver of a vehicle is suppressed to, among other things,
`avoid distracting the driver during certain driving situations
`or conditions.
`According to one aspect of one embodiment of the present
`invention, there is provided a safety control system for
`vehicles including a telephone or other input or output device
`and one or more sensors for sensing instantaneous driver
`stimuli and/or a potentially dangerous condition and for auto
`matically disabling or Suppressing the telephone or other
`input or output device when sensing such stimuli and condi
`tion. In one form, the sensors include two sensors mounted on
`a steering member to provide an indication of the presence of
`the drivers hands on the vehicle steering member, and effec
`tive to suspend use of the telephone or other input/output
`device when the two hands of the driver are not sensed as
`present on the steering member while the vehicle is in motion.
`This system is modular, dynamic, interactive, and adaptive to
`each individualized user. In one implementation, the inven
`tion employs a method for automated machine prioritizing to
`provide assistance to the to driver and optimize the function
`ality of telematics features accessibility by arranging them
`according to a user's needs and preferences based on usage
`frequency of individual features and/or application or as cus
`tomized individually by the user preferences, skills and
`events. In another embodiment, sensors on a steering member
`are used to measure changes in driver physiology. Other
`methods can be used for sensing driver physiology, e.g. via
`infrared detection, camera and image/color recognition etc.
`Smart Speaker: Incoming calls are routed to a speaker that
`reflects and bounce sounds of front windshield at driver Look
`Ahead, Eye Level. Or simulate such action so that a driver
`focuses or has his/her attention directed toward the wind
`shield just like he would do if he is carrying a conversation
`with another person.
`According to further aspects in the described preferred
`embodiment, the steering member is a steering wheel, and the
`
`
`
`US 8,301,108 B2
`
`3
`sensors include two sensors on opposite sides of the steering
`wheel located to sense the presence of the drivers hands on
`the steering wheel. Preferably, the two sensors are located
`approximately on or between the “two and “ten' and the
`“three' and “nine' clock positions of the steering wheel.
`It will thus be seen that such a system, requiring both hands
`to be on the steering wheel in order for the driver to operate
`the input/output devices, not only requires the vehicle to be
`equipped with a “hands free’ interface for the input/output
`devices, or a system that can be used as such with an adapter
`or when docked to the system gateway, but also enforces the
`use of the “hands free” feature by sensing that the driver
`actually has both hands placed on the steering member before
`the input/output devices can be operated accessed or dis
`played to the driver. Disabling the operation of the device
`would preferably include not only disabling making outgoing
`and receiving incoming telephone calls, but also disabling the
`signal (typically audible tones, vibrations, or visible light) of
`an incoming call, fax, e-mail, the display of non-urgent
`vehicle status or warning indicators, since such signals, indi
`cators or displays can distract the driver. Such distractions are
`problematic at times and conditions wherein operation of the
`vehicle requires more than usual driver attention and interac
`tion, or when other distractions are already present for the
`driver.
`According to further features in the described preferred
`embodiment, the vehicle may also include a computer or the
`driver may also use a portable multi-function telematics
`device in the vehicle allowing access to the Internet or other
`network for transmitting and/or receiving faxes or e-mail or
`browsing the web or accessing a WAN, with the sensors also
`disabling driver initiated access to such devices when the two
`hands of the driver are not sensed on the steering member
`while the vehicle is in motion.
`In most cases, the steering member would be a steering
`35
`wheel as presently included in conventional vehicles. How
`ever, in certain applications the steering member could be a
`joystick, or other type of steering member. In Such case, the
`sensors are placed in areas a driver is recommended or
`required to grip the steering member to safely control the
`vehicle.
`According to further optional features in the preferred
`embodiment of the invention described below, the sensors
`may further include devices for sensing vehicle acceleration,
`deceleration, merging onto or exiting a freeway, passing,
`changing lanes, changing gears, depressing the clutch, a
`reverse-drive condition of the vehicle, the braking of the
`vehicle, the undue proximity of the vehicle to another vehicle,
`excessive maneuvering, and/or an unduly high Velocity of the
`vehicle, any one of which conditions, or combination of con
`ditions, may also be effective to disable the operation of the
`telephone, computer, or other potentially distracting equip
`ment, display or indicator within the vehicle.
`According to still further optional features in the preferred
`embodiment of the invention described below, at least one of
`the sensors on the steering member also senses a physiologi
`cal condition of the driver and disables the input/output
`devices when a predetermined physiological condition is
`sensed. For example, the physiological conditions sensed
`could be a predetermined gripping force applied by a hand of
`the driver while gripping the steering wheel, or a predeter
`mined pulse rate, temperature, blood pressure, blood oxygen
`level, and/or skin conductivity of the driver. Such physiologi
`cal conditions may indicate a stress condition of the driver
`and, when sensed, can lead to disabling or Suppressing opera
`tion of the input/output devices to avoid aggravating the
`stressed condition.
`
`4
`The system may also sense a drowsiness condition of the
`vehicle operator. For example, the system may include a
`steering direction sensor that actuates a drowsiness alarm
`when sensing a failure to change the steering direction within
`a predetermined time, distance interval while accounting for
`vehicle speed in indicating a possible drowsiness condition in
`the driver. Additionally, such sensor when monitored with
`respect to changes overtime will indicate jerk reaction, which
`indicates that the driver was not paying attention and the
`system will temporarily Suspend all telematics to give the
`driver a chance to recover. Another application for Such a
`sensor is the monitoring of an OFF Zero angle for an extended
`period of time/distance which can indicate a blind curve or
`hard curve, and again, here the system will temporarily Sus
`pend the telematics and/or input/output devices from inter
`acting with the driver, and vice versa, until normal driving
`functions are restored.
`According to another aspect of the present invention, there
`is provided a method of avoiding potentially dangerous con
`ditions while operating a vehicle having an input/output
`device and a steering mechanism including a steering mem
`berto be manipulated by the driver, comprising: providing the
`steering member with two sensors for sensing the presence on
`the steering member of the two hands of the driver; and
`disabling the input/output device when the two sensors fail to
`sense the presence on the steering member of both hands of
`the driver while the vehicle is in motion.
`According to further features in the described preferred
`embodiment, the input/output devices may also be disabled
`when the vehicle is traveling in the reverse direction, or is
`being braked, or is within a predetermined proximity of
`another vehicle, or is traveling at a high Velocity, accelerating,
`decelerating, merging onto or exiting a freeway, passing,
`changing lanes, changing gears, depressing the clutch, or a
`driver is occupied using other accessories in the vehicle or
`otherwise distracted. Since a high degree of attention of the
`driver is required under all the foregoing conditions, opera
`tion of the vehicle telephone, for example, even the ringing
`signal of an incoming telephone call, could be highly distract
`ing to the driver and is therefore disabled to avoid the possi
`bility of increasing the risk of an accident.
`To assure that the driver and the vehicle as well as onboard
`communication devices as described above are working har
`moniously together, one presently preferred embodiment of
`the system includes the following
`The Driving Systems, (Man, Machine, Environment,
`Regulation, and History)
`Man: the driver, the passengers, the pedestrians, Society;
`Machine: the car, the telematics, the infrastructure;
`Environment: the driving environment (in the car and
`outside the car and the infrastructure used)
`History: the personal driving experience, the equipment
`maintenance history
`Regulation: the existing laws and common safe driving
`etiquette into, Society and the infrastructure regula
`tion.
`All of these elements will be harmonized by the system as it
`isolates the drivers from non driving related distractions and
`helps them comply with driving related laws and etiquette via
`reminders and passive assistance.
`Further features and advantages of at least some of the
`embodiments or implementations of the invention will be
`apparent from the description below.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`These and other objects, features and advantages of the
`present invention will be apparent from the following detailed
`
`10
`
`15
`
`25
`
`30
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 10 of 23 PageID #: 99
`
`
`
`US 8,301,108 B2
`
`5
`description of the preferred embodiments and best mode,
`appended claims and accompanying drawings in which:
`FIG. 1 schematically illustrates one form of a safety control
`system for vehicles constructed in accordance with the
`present invention;
`FIG. 2 is an enlarged view illustrating the steering wheel in
`the vehicle of FIG. 1 and the sensors mounted thereon;
`FIG.3 is a block diagram illustrating the main components
`in the system of FIG. 1;
`FIG. 4 is a flowchart illustrating the operation of the system
`of FIG. 1; and
`FIG. 5 is a block diagram illustrating the nature and the
`flow of signals and algorithms used in one presently preferred
`embodiment of the system of the present invention.
`
`DETAILED DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`FIG. 1 schematically illustrates a vehicle, generally desig
`nated 2, equipped with a control system for sensing a variety
`of risk factors and potentially dangerous conditions and for
`automatically executing various responses when sensing
`Such conditions in order to avoid hazardous situations tending
`to increase the possibility of an accident. One response is the
`disabling or Suppression of one or more input or output
`devices to avoid interaction between the devices and the
`driver in certain situations and conditions. Another response
`includes providing a signal to or requiring the driver to take
`Some action to increase driver alertness and/or awareness.
`One example of a hazardous situation avoided by the con
`trol system illustrated in FIG. 1 is the use of the vehicle
`telephone in certain situations wherein a making of a tele
`phone call by the vehicle driver, or the receiving of an incom
`ing call, particularly the ringing of Such a call, may distract
`the driver and increase the possibility of an accident when the
`driver is in a high-risk driving situation. Similar increased risk
`can result from the driver changing vehicle controls like tem
`perature settings, or interacting (e.g. inputting or receiving
`output) with other telematics such as e-mail, radio, CD, DVD,
`navigation system, incoming page or the like. In Such cases,
`the vehicle telephone, other telematics and/or other input/
`output devices are suppressed and no incoming or outgoing
`signals are allowed to distract the driver. In case the driver is
`the party initiating the telematics, a visual indicator and audio
`feedback can be activated to indicate to the driver that
`telematics is disabled, Supply reason therefore, and even rec
`ommend driving modification to enable telematics. Another
`condition sensed by the system is undue stress in the driver, as
`indicated by the sensed pulse rate, temperature, blood pres
`Sure, skin conductivity (e.g. perspiration), loud Voice(s) or
`stressful sounds in the cabin, such as baby crying, dog barking
`etc., any combination of one or more of which conditions
`would also disable incoming telematics. A further condition
`sensed by the system is the possibility of drowsiness on the
`part of the driver, in which case an audio alarm would be
`activated to alert the driver to this condition. Examples with
`out limitation of other alarms to overcome driver drowsiness
`include vibration in the seat, changing HVAC temperature
`settings and blower speed to extremes, change of seat posi
`tion, radio volume or station, CD-track etc. The system will
`restore operation of the input/output devices when conditions
`are normalized and will notify driver of all missed activities.
`Vehicle 2 illustrated in FIG. 1 is a conventional vehicle
`including a steering mechanism, generally designated 3, hav
`ing a steering wheel 4, a propulsion device Such as a motor or
`engine 5 for driving the vehicle via a transmission or other
`torque converting means Schematically indicated 6, an accel
`
`Case 1:21-cv-00064-UNA Document 1-4 Filed 01/21/21 Page 11 of 23 PageID #: 100
`
`6
`eration pedal 7, and a braking pedal 8 for controlling the
`vehicle. Vehicle 2 further includes one or more visual indica
`tor and audio alarms 9, e.g. mounted within the forward-look
`ahead viewing or hearing by the driver.
`FIG.1 further schematically illustrates a cellular telephone
`10 within the vehicle, and a computer 11 or other multifunc
`tion telematic device allowing access to the Internet for trans
`mitting and/or receiving faxes or e-mail, WAN and Web
`access, or other input/output device. Other input/output
`devices include vehicle fault/warning lights (battery, tem
`perature, washer fluid, etc.) or other signal or alarm (open
`door, low fuel level, seat belt monitor, etc.). Vehicle 2 illus
`trated in FIG. 1 may also include many other components
`conventionally provided on vehicles at the present time or to
`be provided in the future.
`The safety control system included in vehicle 2 illustrated
`in FIG. 1 includes a plurality of sensors for sensing various
`conditions with respect to the vehicle driver, the vehicle itself
`and/or the environment. These signals are collected via direct
`tapping to existing or added sensors or via vehicle bus and
`user specified values. These include sensors S1 and S2
`applied to the steering wheel 4 of the vehicle; sensor S3
`applied to the steering mechanism 3 of the vehicle to sense
`changes in the steering direction and/or actuation of the turn
`ing indicator. The turning signal indicator Switch/lever can
`also act as a blind spot collision avoidance actuator.