5,798,458
`[11] Patent Number:
`[19]
`United States Patent
`
`Monroe
`[45] Date of Patent:
`Aug. 25, 1998
`
`USOO5798458A
`
`3/1989 Fdier ...................................... 340/945
`4,816,828
`3/1990 Horn
`367/124
`4.910.718
`5/I990 Ramalmgam et al
`407/I20
`4,927,299
`5/1991 Scnbncr el al.
`364/449
`....
`5,014,206
`?Jl993 Blazic etal. ....
`..... 73/799
`5,184,516
`“67274 “"995 V“
`H 364,424.06
`5,528,557
`6/1996 Horn
`73/587
`Primary Examiner-—l‘Iczron E. Williams
`Assistant Exanu'ner—Rose M. Miller
`
`
`
`Attorney Agent, or Firm—-Robert C. Curfiss; Braoewell &
`Patterson
`[57]
`
`ABSTRACT
`
`An acoustic sensor system is provided for detcaing failures
`or terrorist events in commercial aviation and is adapted for
`assisting in the detection and post event analysis of such
`events. The system is adapted for use in combination with a
`comprehensive multi-media safety and surveillance system.
`utilizing both visual and audio information as well as critical
`data to the flight <=reW- and to a ground tracking station. and
`recording the inforrnation and data generated during flight
`A plurality of acoustic sensors are strategically and system-
`atically placed about an airframe. The sensors are adapted
`for communicating with a monitorlrecording system and
`may be hard wired or utilize wireless communications
`therewith. In the event of a catastrophic event. such as in
`bomb explosion ti gunshot or stlvcttiral failure an acoustic
`event would be recorded for later analysis.
`
`21 Claims, 11 Drawillg Sheets
`
`[54] ACOUSTIC CATASTROPIIIC EVENT
`[)E'[‘ECT[()N AND DATA CAHURE AND
`RETRIEVAL SYSTEM FOR AIRCRA].-I‘
`_
`-
`Inventor. David A. Monroe. San Antonio. Tex.
`[75]
`[73] Asdgmc: Rayflmon TI Systems’ Inc"Lewisvmc.
`Tex.
`
`[21] APPL No_; 733,437
`
`[22] Filed:
`
`Oct. 28, 1996
`Related US. Application Data
`
`[63] Continuation-in-pan of Set‘. No. 729,139, Oct. 11, 1996.
`
`[51]
`
`Int. CL°
`
`HMN 7/18; Gl1.B 5/02:
`GOGF 15/74
`'73/587; 701/14; 360/5
`[52] US. Cl. ....................................
`[58] Field or Search ...................... 73/587; 364/424.06.
`354/439. DIG. 1. DIG. 2; 360/5; 342132.
`35, 357; 340/945; 701114
`
`[56]
`
`References Cited
`
`3,956,731
`4,510,803
`4,592,034
`4.729.102
`
`us’ PATENT s
`S/1976 Lewis. Jr.
`4/1985 Penn .......
`..
`5/1986 Sachseet :1.
`3/1988 Mills. Jr. et al.
`
`340/945
`.. 73/178 R
`73/587
`..................... 364/424
`
`19a
`
`
`
`BOEING
`Ex. 1017
`
`
`
`WIRED
`
`ACOUSTIC
`SENSORS
`
`WIRELESS
`
`
`
`80
`
`76
`
`72
`
`52
`
`60
`
`'
`
`1532:
`
`ll!
`
`MULTIPLEXER
`
`E
`
`is
`
`

`
`U.S. Patent
`
`Aug. 25, 1998
`
`Sheet 1 of 11
`
`5,798,458
`
`BOEING
`EX. 1017
`
`

`
`U.S. Patent
`
`Aug. 25, 1998
`
`Sheet 2 of 11
`
`5,798,458
`
`FIG. 2
`
`
`
`MULTIPLEXER / MIXER
`
`
`
`
`
`RECORDER
`
`
`
`
`
`205
`
`252
`
`PILOT
`
`INDICATORS
`
`RECORDER
`
`
`BOEING
`Ex. 1017
`
`

`
`U.S. Patent
`
`Aug. 25, 1993
`
`Sheet 3 of 11
`
`5,798,458
`
`2>E
`
`mm
`
`
`
`owgas.mm
`
`.2we
`
`azéo
`
`v_z_._
`
`mmEomooum
`
`mmmg
`
`Em_:_:=s_EEEon\__._.EQwmmurmfifi
`rumfi
`
`
`
`
`ommfi_tam
`
`3
`
`9
`
`0:302
`
`mmowzmm
`
`EEo=\__,_3:E9 N:m:._E.E:_o:.\___E3made;
`
`5:..2m:
`
`EE
`
`.5mm:
`
`EE%S5;
`
`A
`
`oa.\.__
`
`
`
`9.5525..._wu._Etéofi
`
`BOEING
`EX. 1017
`
`

`
`U.S. Patent
`
`Aug. 25, 1998
`
`Sheet 4 of 11
`
`5,798,458
`
`._:._<m<
`
`5..
`
`mE
`
`BOEING
`Ex. 1017
`
`

`
`U.S. Patent
`
`Aug. 25, 1998
`
`Sheet 5 of 11
`
`5,798,458
`
`oam
`
`
`
`_._E_za._E_oa:E_;a
`_c_o§m_:=
`
`:$§__<
`
`$25..
`
`m.o___
`
`BOEING
`EX. 1017
`
`made;
`
`o_5:8<
`
`wmowzum
`
`
`
`

`
`U.S. Patent
`
`Aug. 25
`
`9
`
`1998
`
`Sheet 6 of 11
`
`5,798,458
`
`w~_oEoaz_
`
`.5.=n_ an
`
`oaé
`
`Euoznomo
`
`39.8%.
`
`%¢I'E"-E“-I
`
`mmE__3
`
`28m25
`
`E
`
`E:5.
`
`n_
`
`<
`
`Nam
`
`BOEING
`Ex. 1017
`
`

`
`U
`
`S. Patent
`
`Aug. 25, 1993
`
`Sheet 7 of 11
`
`5,798,458
`
`._.o.=n_
`
`5.2%
`
`...$
`
`._<._._w_n_
`
`:2:
`
`39.8%—:._.o_>>oz<m
`
`___
`
`95
`
`BOEING
`Ex. 1017
`
`
`

`
`U.S
`
`Patent
`
`Aug. 25, 1993
`
`Sheet 3 of 11
`
`5,798,458
`
`oaé
`
`nzaomo
`
`xz:
`
`_._
`
`EoxoamI>3z<m
`
`mmo._.<o_oz_
`
`._.o.__n_ gm
`
`355
`
`._<._._o_o
`
`._<._._o_n_
`
`ozo
`
`_.._§om_<
`
`E38
`
`BO
`Ex.
`
`
`

`
`U.S. Patent
`
`Aug. 25, 1998
`
`Sheet 9 of 11
`
`5,798,458
`
`601
`
`FIG- 11
`
`396
`
`696
`
`DIGITAL OUT
`
`
` HIGH
`
`
`
`SPEED
`MU LTIPLEXER
`
`ANALOG OUT
`
`TIMING CONTROL
`
`BO
`Ex.
`
`

`
`S.U
`
`5,798,458
`
`D...E.E«REmmmmvm
`>553H.m23mmM2“.
`
`f.E>_H._8~_
`19ms§m._n__:=s_E333W...3IAEmm]8*E>_u8z<E5mm:6IEESE3ono.o~._.pn_%%
`
`803aEH25»omwSE28
`
`
`.m8_zoEom_._n._momzumzmE§_9_wmnaga._...:._<m<n_z<mus_<om3W#8sN(5252
`.ummm
`
`
`momzmmzHem93
`
`E
`
`momzmmzE03
`
`182%23HE2
`
`BOEING
`Ex. 1017
`
`
`

`
`U.S. Patent
`
`Aug. 25, 1998
`
`Sheet 11 of 11
`
`5,798,458
`
`mommaofi\meaésaz
`
`
`
`BOEING
`Ex. 1017
`
`

`
`5.798.458
`
`1
`ACOUSTIC CATASTROPHIC EVENT
`DETECTION AND DATA CAPTURE AND
`RETRIEVAL SYSTEM FOR AIRCRAFT
`
`RELATED APPLICATION
`
`This application is a continuation in part of the application
`entitled: VIDEO AND DATA CAPTURE AND
`RETRIEVAL SURVEILLANCE SYSTEM FOR
`AIRCRAFT. invented by the present inventor and filed on
`Oct. 11. 1996. Ser. No. 08f729.l39.
`
`I0
`
`BACKGROUND OF INVENTION
`
`1. Field of Invention
`
`The subject invention is generally related to safety and
`surveillance equipment for aircraft and is specifically
`directed to a system for commercial aircraft wherein acous-
`tic sensors may be utilized to determine the source of an on
`board incident by tracking the sound waves emanating from
`the source throughout the aircraft.
`2. Discussion of the Prior Art
`
`20
`
`35
`
`40
`
`45
`
`Aircraft safety is of ever increasing importance. This is
`particularly true with respect to commercial airlines as more
`and more people and freight are moved in this manner. The
`airways are becoming increasingly crowded with tralfic.
`Global tracking systems are now in place to monitor the
`flight of the aircraft from the moment it lifts ofl‘ until it safely
`lands at its destination. Radar and global positioning sys-
`tems are commonplace both on the aircraft and at the ground
`tracking stations. All of these electronic systems have
`increased the ovuall safety record of commercial traflic to
`new standards as the number of miles flown continues to
`escalate.
`
`In addition, the on board avionics including electronic
`monitoring and diagnostic equipment particularly on large
`commercial jets. continues to evolve. giving both the on
`board crew and the tracking station more complete, accurate
`and up to date information regarding the condition of the
`aircrafi while in flight. Flight recmders long have been
`incorporated in order to provide arecord of each flight and
`in crder to provide critical information to aid in the deter-
`mination of the causes of an accident or malfunction should
`one occtn.
`
`Even with all of this inforrnation. there still remains a
`significant need to develop a system capable of providing
`additional evidence for determining the sotnce of an
`explosion. gun fire or other catastrophic event after occur-
`rence and during the investigation of an incident in an eifort
`to determine the cause.
`location of and timing of the
`occurrence.
`
`Such a system would also permit the recording of infor-
`mation providing the history of the catastrophic occurrence.
`further enhancing reconstruction of incidents leading to an
`airborne catastrophe should one occur.
`While such a system would be of great benefit to the
`airline industry in general and to the commercial airlines in
`particular. thet'e are no systems currently available which
`meet these needs.
`
`SUMMARY OF THE INVENTION
`
`The subject invention provides a low cost system for
`detecting failures or ta-rorist events in commercial aviation
`and is adapted for assisting in the detection and post event
`analysis of such events. In the prefared embodiment the
`system is used in combination with a comprehensive multi-
`
`2
`media safety and surveillance system. which in the preferred
`form provides both visual and audio information as well as
`critical data to the flight crew. and to a ground tracking
`station. and also permits recording the information and data
`generated during flight. Such a system is shown and
`described in my copending application entitled: VIDEO
`AND DATA CAPTURE AND RETRIEVAL SURVEIL-
`LANCE SYSTEM FOR AIRCRAFT.
`invented by the
`present inventor and filed on Oct. 11. I996. Ser. No. 08fl29.
`139. incorporated by reference herein.
`The system may also be used independently to provide a
`low cost tracking and reconstruction system for incidents
`which are sound related. such as an explosion. gun fire or the
`like. In the preferred embodiment a plurality of acoustic
`sensors are strategically and systematically placed about an
`airfrarnc. The sensors are adapted for communicating with a
`monitor/recording system and may be hard wired or utilize
`wireless communications therewith. In the event of a cata-
`strophic event. such as a bomb explosion. a gunshot or
`structural failure an acoustic event would be recorded for
`law analysis. For example. a bomb explosion would send
`out acoustical shock waves. These would be deteaed at
`diiferent times based on the distance from the source and on
`the time required for the waves to propagate in the air. The
`analysis of the rectrdings form the multiple sensors would
`permit calailation of the source of the explosion in tluee
`dimensions. greatly enhancing reconstruction of the inci-
`dent. For example. it would not be necessary to locate the
`damaged portion of the ahfiame to determine where the
`bomb was located. The precise location could be recon-
`structed from the data on the recorder system.
`The same is true of gunshots or even structural mechani-
`cal failures or other acoustical events. For example. if the
`right wing failed. the sensor nearest the right wing would
`register abnormal acoustic energy. which would propagate
`through the plane. The data show when the energy reached
`each of the pltnality of sensors would pinpoint the sotn-ce of
`the energy event.
`The raw data is recorded in a “black box” recorder for
`later analysis. The data can also be processed by high speed
`electronics such as a DSP based system. wherein acoustic
`events can be analyzed by the aircraft computu‘ and action
`can be taken. Fir example, if a gunshot was detected in the
`aft cabin of the plane. the remaining areas could be imme-
`diately sealed from entry. In addition. the pilots could be
`immediately notified. since many such events are not dis-
`cernible to the flight crew at the time an incident occurs.
`Also. the occurrence of such an event could activate a radio
`link for transmitting events to ground stations.
`In an alternative embodiment. a barometric pressure sen-
`sor in incorporated in the system to correct for acoustic
`propagation speed at various pressures. The data can also be
`tracked with navigational data such as a global positioning
`system (GPS) to tag tlte acoustic data with time. latitude.
`longitude and altitude data.
`In its preferred form. a plurality of acoustic sensor units
`are placed strategically throughout the aircraft. For example.
`several sensors would be located directly on the airframe at
`strategic points. such as on the outboard strut of each wing.
`at each engine mount and at the inboard strut and at various
`other points on the airframe. Additional acoustic sensors
`would be placed throughout the aircrafi. for example. at
`various point in the passenger cabins. cargo hold and flight
`deck.
`
`The system may be hardwired in the aircraft. or may use
`wireless transmission and receiving systems. The wireless
`
`BOEING
`Ex. 1017
`
`

`
`5.798.458
`
`3
`system is particularly useful for adapting the system as a
`retrofit on existing aircraft and also provides assurances
`against disruption of data transmission and collection during
`a catastrophic airframe failure. In the preferred embodiment.
`the wireless system is fully self-contained with each sensor
`unit having an independent power supply.
`'l‘he gonad
`communications Link. monitoring and recording systems for
`collecting and transmitting the data are also self-contained.
`‘this assures that the system will continue to operate in the
`event of either a malfunction or a structural failure of the
`aircraft causing a disruption in power source without dis-
`ruption of the generation and collection of data.
`A monitor may be provided on the flight deck and
`recorders may be placed in the tail section. as is common for
`flight data and voice recorders currently in use. The flight
`deck would have instant live access to all of the data as it is
`captured by the multiple sensors and the recorder would
`make an historic record of the data for archive and recon-
`struction purposes.
`Where desired. ground hacking or control stations would
`have selective access to the data on a near orreal time basis.
`That is. the ground tracking station will have the capability
`of interrogating the in flight data while the aircraft is in
`flight. Near real time data can be received and historical data
`can be retrieved. as well. when the random access storage
`device is utilized
`When used in combination with the multi-media system
`of my aforementioned invention. the plurality of sensors are
`synchronized through an on board multiplexing system
`whereby the plurality of data. including acoustic data. may
`be monitored. recorded. andlor transmitted in either a par-
`allel rr suial format. In the prefared embodiment.
`the
`system is adapted for incorporating the data signal generated
`by the aircraft navigational data such as that provided by a
`global positioning system (GPS) for tracking the altitude.
`latitude and longitude coordinates synchronized with the
`collected data in order to provide accurate information of
`where the aircraft is in its fliyrt plan when an incident
`occurs. A time or chronology signal may also be incorpo-
`rated in the data scheme. Any signal which is capable of
`being captured and stored may be monitored in this manner.
`By tying each of the images to a reference such as the GPS
`signal and a clock. the retrieval of data and reconstruction of
`an on board incident is facilitated.
`
`Utilizing the wireless system of the invention in combi-
`nation with the battay back-up power supply. it is possible
`to continue collecting information even after an airframe
`failure and a disruption in aircraft power.
`Preferably,
`the entire capture. retrieval. monitor and
`archive system is installed utilizing a wireless transmitting]
`receiving system in order to assure that transmission will not
`be lost in the event of a powa shutdown or a structural
`failure causing possible open circuit conditions which could
`occur in a hard wired system In the preferred embodiment.
`such a system would be completely self-contained with an
`integrated power supply.
`It
`is.
`therefore. an object and feature of the subject
`invention to provide an acoustic sensor system for detecting
`the location of catastrophic events in commacial aviation.
`It
`is an additional object and feature of the subject
`invention to provide an inexpensive system for detecting
`such events in a manner permitting accurate post event
`analysis.
`It is also an object and feature of the subject invention to
`provide an acoustic detection and retrieval system that can
`be used in combination with a comprehensive. mrrlti-media
`
`4
`
`data generating. collecting. displaying. transmitting. receiv-
`ing and storage safety and surveillance scheme for uircrnft.
`It is also an object and feature of the subject invention to
`provide acoustic surveillance and detection of acoustic
`energy events of critical components and areas of an aircraft
`during flight.
`It
`is an additional object and feature of the subject
`invention to provide an acoustic energy record of critical
`components and areas of an aircraft during flight for archival
`and retrieval ptnposes.
`It is yet another object and feature of the subject invention
`to provide apparatus for permitting ground personnel
`to
`receive data relating to critical components and areas of and
`aircraft dtrring flight.
`It is a further object and feature of the subject invention
`to provide acetnatc information of where the aircrafl
`is
`during a flight path when a specific event occurs.
`It is also an object and feature of the subject invention to
`provide a system for linking recorded acoustic data with an
`inertial navigation system such or other navigational data
`sotnce such as. by way of example. a global positioning
`system for archival ptn-poses.
`It is still another object and feature of the invention to
`permit the monitoring. storing and retrieval of any of a
`variety of video images. acoustic signals and performance
`data by the tradting. surveillance and imaging equipment on
`board the aircraft.
`Other objects and features of the subject invention will be
`readily apparent from the accompanying drawings and
`detailed description of the preferred embodiments.
`BRIE‘ DESCRIPTION OFT]-IE DRAWINGS
`
`FIG. 1 is a cutaway illusl:rat:'on of the fuselage of an
`aircraft showing sample placement of acoustic sensor
`devices in accordance with the invention.
`FIG. 2 is a block diagram of a basic system utilizing
`acoustic sensors.
`:1 multiplexerintlxer and a “black box”
`recorder.
`FIG. 3 is a block diagram of the basic system utilizing
`digital signal processing (DSP) with an alarm system. a pilot
`monitoring system and a “black box" recorder.
`FIG. 4 is a block diagram showing a combination of
`hard-wired and wireless sensors.
`FIG. 5 is similar to FIG. 4. utilizing a high bandwidth
`analog recorder.
`FIG. 6 is similar to FIG. 5. utilizing a high bandwidth
`digital recorder.
`FIG. 7 is a block diagram showing a combination of
`hard-wired and wireless sensors utilizing DSP processing.
`FIG. 8 is a block diagram utilizing digital sensors in
`combination with high speed multiplexing.
`FIG. 9 is similar to FIG. 8. showing DSP processing.
`FIG. 10 shows a DSP based system utilizing analog
`sensors.
`
`FIG. 11 shows a DSP based system utilizing a high ‘speed
`multiplexer.
`FIG. 12 is an alternative embodiment showing the acous-
`tic system of the subject invention in combination with a
`multiple video Imaging device system.
`FIG. 13 is a block diagram illustrating a typical system
`utilizing a wireless transmission and receiving scheme in
`accordance with the invention.
`
`DETAILED DESCRIPTION OF THE
` D EMBODIMENTS
`
`FIG. 1 shows a cutaway diagram of a typical commercial
`airline fuselage 10. with the cargo hold 12. the passenger
`
`I0
`
`45
`
`55
`
`65
`
`BOEING
`EX. 1017
`
`

`
`5.798.458
`
`5
`cabins I4. 16 and the flight deck or cockpit 18 partially
`visible. In the embodiment shown. multiple audio sensor
`devices 19a. 19b. 19c. 19d. 19:. 19f. 19g. 19h. 19:’. 19j. 19k.
`191 and 19m are strategically placed throughout the airframe
`and the cabin area for detecting acoustic energy and trans-
`mitting a signal which may be transmitted to ground.
`recorded in a “black box" recorder. monitored on board.
`and/r analyzed for action. The recorded signals are invalu-
`able in locating the source of an onboard acoustic event such
`as a bomb exploding. a structural failure or a gunshot or the
`like. Additional sensors could also be utilized. the sensors
`l9a—l9m are shown just to provide an example ofplacement
`in order to illustrate the teachings of the subject invention.
`For example. if a structural failure occurred at the point
`where of the forward section of the tail section joins the
`fuselage.
`this would create a detectable acoustic energy
`incident which would first be detected by the sensor 19a. As
`the acoustic wave propagates through the airframe. it would
`be detected by the various sensors at diiferent times based on
`their distance from the source. which is nearest sensor 19a.
`As the wave dissipates. it is likely that remote sensors. such
`as sensors ISU. 19! and 19m may not detect any discunible
`signal. The time and intensity of the detected signal at each
`of the sensors 19a-19m will permit reconstruction of the
`event. pinpointing where the failure or event occurred. By
`tying the acoustic signal to a chronolog. barometric pressure
`and navigational
`tracking signals. as will be explained
`herein. the acoustic data can be used to reconstruct the
`precise location. time and intensity of an event. This will
`greatly enhance the ability to reoonstruri an event and will
`also pennit corrective action to he taken while in flight.
`where possible.
`In the preferred form. the acoustic sensor system of the
`invention is designed to be a stand-alone system providing
`a low-cost surveillance and detection system for monitoring.
`recording and reconst1'uc1.ing acoustic events. However. as
`illusnated herein. the acoustic sensor system can be used in
`combination with the multi-media. comprehensive surveil-
`lance and data collection scheme of my copending applica-
`tion entitled: VIDEO AND DATA CAPTURE AND
`RETRIEVAL SURVEILLANCE SYSTEM FOR
`AIRCRAFI‘. invented by the present inventor and filed on
`Oct. 11. 1996. Ser. No.: 08/229.139. lnootpcrared by refu-
`ence herein and of which this application is a continuation-
`in-part.
`In the cmbotlirncnt shown in FIG. 1. a number of video
`image sensor devices such as. by way of example. analog
`video cameras. are also strategically placed throughout the
`aircraftandmaybemountedlnsidethe slrinoftheaireraft
`and aimed through openings provided in the fuselage to
`fours on aitiarl components of the aircraft. such as the
`landing gear cameras 20. 22. the wing engine camera 24 and
`the tail camera 26. Similar devices or cameras may also be
`strategically placed throughout the interior of the aircrafi.
`such as the passenger cabin camuas 28. 30. 32. 34. 36. 38.
`40. the cargo bay cameras 42. 44. 46. 48 and the flight deck
`camera 50. The placement and numba of devices is a matter
`of choice depending upon the configuration of the aircraft
`and the level of surveillance desired.
`In the embodiment shown and described. a multi-media
`flight recorder or “black box” 52 is installed in the tail
`section of the aircraft. in the same manner as the current data
`and voice black boxes (not shown). A flight deck monitor
`and control panel 54 is located on the control panel in the
`cockpit 18. Other monitors may be provided where desired.
`Turning now to FIG. 2. in its most basic form. the system
`of the subject invention incorporates a plurality of strategi-
`
`15
`
`55
`
`65
`
`6
`ca.lly positioned analog acoustic sensors l9a—19m each
`having an output line 94 for feeding the raw signal into a
`multiplexer-[mixer 96 for producing a combined. multi-
`plexed output signal on line 105 for introduction into a
`single channel analog recorder 52.
`A similar system utilizing digital acoustic devices for the
`sensors 19a-19m is shown in FIG. 3. In this embodiment.
`each of the digital output signals from the various sensors
`19a—l9m is produced on lines 294 where they are introduced
`into the digital system processor (DSP) for producing a
`digital multiplexed signal on line 205 for introduction into a
`digital recording system 252. Where desired. the output
`signal can also be fed via line 206 to a pilot monitor 55 and
`via line 207 to an alarm system 57. Of course. the pilot
`monitor and alarm system can also be i.ncorporated in the
`system of FIG. 2.
`least some of the sensors
`In its preferred form. at
`19a-19m.
`if not all. will
`transmit
`their signals to the
`oollectoriprooessing equipment via wireless transmission.
`As shown in FIG. 4. the basic multiplexing system of FIG.
`2 can incorporate both wired sensors (l9a—d) and wireless
`sensors (I9e-m). As there shown. the wired sensors 19a—19d
`are wired directly to the multiplexer 96 in the same manner
`as diown in FIG. 2. The wireless sensors l9e—l9m provide
`a raw output data signal to a local. dedicated transmitter
`ll6o—16m. respectively for transmitting a signal via the
`dedicated antenna 118 to a receiving antenna 60. The
`receiving antenna then transmits the received signals to the
`dedicated receivers i53a—153m. respectively. where they
`are introduced via dedicated input lines 94 into the multi-
`plexu.
`In the preferred embodiment. each wireless sensor
`19¢-19m includes an integrated power supply such as the
`redungcable battery system incarpctating the battery 110
`and the charge: 111. This assures continuous transmission of
`the data signal even in the event of an airframe structural
`failure and/or the loss of aircraft power. Typically.
`the
`rediargeable system is coupled to aircraft power 114 via a
`distribution line 112. It is also desirable that the collector!
`processor system also be sell"-contained. with a rechargeable
`system comprising the battay 210. charga 211 and distri-
`bution line 212 also being coupled to aircraft power 114.
`As previously described. the multiplexer 96 generates a
`combined output signal on line 105 for introdudzion into the
`"black box" recorder 52. Where desired. a ground link
`system can be incorporated in any of the embodiments.
`wherein the output data signal as shown on line 108 can be
`input into a ground link transceiver 76 and nansmitted via
`radio 80 and antenna 80 to a ground control station. as more
`fully described in my aforementioned copending applica-
`tion. As also more completely described in that application.
`it is desirable to track the time. latitude. longitude. and
`altitude with the collected signals. This is of great value
`when reconstructing an in-air incident. As shown in FIG. 4.
`a navigational tracking system such as ‘a global positioning
`system (GPS) can be recorded with the recorded acoustic
`data. In the illustrated embodiment. the GPS receiver 72
`receives a signal via antenna '74 and introduces the GPS
`signal into the recorder system via line 73.
`A modified system similar to FIG. 4 is shown in FIG. 5.
`In this system a high-bandwith multiplexer 396 is substi-
`tuted for the multiplexer 96 and a high bandwidth analog
`recorder 352 is substituted for the recorder 52. The use of
`high bandwidth technology permits the collection of data at
`greater speeds. permitting more data to be collected and
`recorded by permitting faster cycling time of the multiplexin-
`
`BOEING
`Ex. 1017
`
`

`
`5.798.458
`
`7
`
`through the various sensor inputs. As is explained later
`herein. this is of critical importance when tracing an explo-
`sion or other acoustic incident back to its source using only
`acoustic data. As shown in FIG. 5. the same system may
`incorporate high bandwidth digital recording techniques
`utilizing a high bandwidth digital recorder 452. As there
`shown. the GPS signal may introduced directly into the
`recorder via line 73. as previously described. or may be
`multiplexed with the other data by introducing the GPS
`signal into the mulliplexti’ 396. as indicated by line 473.
`Where desired. digital signal processing (DSP) may be
`substituted for the multiplexer technology illustrated in
`FIGS. 2-6. An exemplary block diagram of a digital signal
`processing system is illustrated in FIG. 7. with the processes‘
`596 substituted for the multiplexing system The remaining
`components function generally as described with respect to
`the embodiments of FIGS. 2-6.
`The system may be fully analog. as shown in FIGS. 2-6
`or may incorporated digital processing with analog sensors.
`as shown in FIG. 8. for example. The digital processing will
`provide higher speed processing and better random search-
`ing capability. When analog sensors are utilized each raw
`data signal from the various sensors l9a—l9m is converted
`into a digital signal via dedicated converters 86a—86m. The
`remainder of the system functions generally as previously
`described. Of course. the multiplexer 696 and the recorder
`652 are of a digital configuration. As shown in FIG. 9. the
`same analog to digital conversion system can also be used
`with digital signal processors with the DSP processor 196
`substituted for the digital multiplexer 696.
`The basic DSP based system is more clearly illustrated in
`FIG. 10. In the embodiment shown. only the hardwired
`sensors 19a—l9d are illustrated. It should be understood that
`wireless sensors could be substituted or could be used in
`combination with the hardwired sensors. as previously
`described. In either case. a raw data analog signal is gxesent
`from each sensor on the dedicated line 694. The DSP
`[processor includes at dedicated analog to digital converter
`86u—86d for each sensor l9a—19d for producing a digital
`signal to be introduced into the DSP engine tr processor
`598. As previously described. the digital GPS signal on line
`673 may be introduced directly into the DSP system. A
`digital output signal is produced on line 601 for distribtttion
`as previously described. to a recorder. ground link or moni-
`tor. Whae desired. an analog output signal may also be
`txoduoed on line 602 by converting the DSP output from .
`digital to analog utilizing the digital to analog converter 600.
`The analog signal on line 662 may also be distributed as
`desired to various analog instruments. The digital signal
`processing system. while more costly than basic
`multiplexing. provides enhanced processing. For example.
`in addition to the basic multiplexing capability. a digital
`processor can be used to detect an event at the time of
`occurrence. This might trigger a ground link activation or a
`pilot monitor. The digital processor also will [rovide for
`direct time code insertion.
`timing analysis and spectral
`analysis to assist in the reconstruction of an event from the
`recorded data.
`As shown in FIG. 11. an even fastu system is provided by
`placing a high speed multiplexer 896 in advance of the
`digital processor 696. This permits a single multiplexed
`input signal 801 to be introduced into the processor 801.
`greatly increasing the speed of the processor by reducing the
`amount of data to be assimilated. As explained later herein.
`timing is of critical importance when tracking the propaga-
`tion of an acoustic wave from its source. Therefore. provid-
`ing higher speed processing is very desirable when cost is
`not a driving factor in the design of the system.
`
`8
`As shown in FIG. 12. the signals generated by various
`other components of the aircraft may also be collected for
`recording. transmission and monitoring utilizing the system
`of the subject invention. in combination with the acoustic
`sensors l9a—m. as indicated by the cameras 20 .
`.
`. S0. for
`example. or other sensors. as more fully shown and
`described in my aforementioned oopcnding application.
`Such sensors would include any data signal desired to be
`incorporated in the comprehensive data system of the
`invention. such as. by way of example. the output signals
`produces by system monitoring transducers including. to:
`example. engine temperature. oil and hydraulic pressure and
`the like. The system can also include data such as the radar
`signal. a chronology of the flight. global positioning and the
`like. This permits a comprehensive history of the flight as
`well as ready access to all available information by both the
`flight crew and a ground station.
`The system may also incorporate a ground link commu-
`nlcations capability. wherein any of the signals transmitted
`to antenna 60 may be introduced into an image transceiva
`76 through the agile frequency receiver 6-6.The frequency
`receiver 66 provides an input to the image transceiva 76
`which is adapted for genuating a radio signal at 78 for input
`to an on board radio transceiver 80. The radio signal is
`transmitted to a ground station (not shown) via antenna 82.
`The frequency receiver 64 provides a data/video signal to
`the monitor 55 of the cockpit control panel 54. The flight
`crew has can control the selection of cameras monitored at
`monitor 55 and can control the transmission of images to the
`ground station via radio 80. This is indicated by the control
`signals on line 84 from the control panel 54 to the control
`network 86. The control network 86 sends control signal out
`over a control transrnisslon line or lines 88 to conn-ol the
`receivers 62. 64. 66 and the recorder 70 and the image
`transceivu 76. The opaation of the video flight recorder and
`the frequency receivers is not intended to be accessible by
`the flight crew. In addition. the antenna 82 can receive
`unlinked video messages from a ground station. These
`signals are tied to the GPS signal and are both recorded at
`the rectxder 70 and transmitted to the flight deck monitor 55.
`The recorder '70 may be a standard analog recorder. or may
`include digital hard drive systems or a random access digital
`memory. or other recording scheme as desired. The random
`access scheme would be particularly useful for having
`instant access to historical data while in flight. For example.
`if a terrorist was found to be on board. it would be useful to
`play back preceding activity to monitor the past actions by
`the terrorist before he was identified by the flight crew or
`ground tracking station. This could prove useful in deta-
`mining a cause of corrective anion. As an example. it could
`assist with the location of weapons.
`The frequency receives 62. 64 and 66. the video recorder
`70. the image transceiver 76. the GPS system '72 and the
`radio 80 utilize known technology well known to those
`skilled in the arts. The antennas 60. 74 and 80 are also of
`standard configuration. The control panel 54 and monitor 55
`are of standard design. with the control panel utilizing
`electrical switches to activate and deactivate t:hc crew con-
`trollable functions. The control