DB '7291 9
`
`VIDEO AND DATA CAPTURE AND RETRIEVAL
`SURVEILLANCE SYSTEM FOR AIRCRAFT
`
`Inventor:
`David Monroe
`
`BOEING Exhibit 1043
`Page 1 of 60
`
`

`
`ROO
`OCT
`-
`1996
`$ O
`
`631
`
`-
`
`-
`
`VIDEO AND DATA CAPTURE AND RETRIEVAL
`RT
`
`-Iinventor:
`David Monroe
`
`BACKGROUND OF INVENTION
`
`Field of Invention
`The subject invention is generally related to safety
`and surveillance equipment for aircraft and is specifically
`directed to a comprehensive multi-media safety and
`surveillance system for commercial aircraft wherein both
`data and video images may be collected, monitored,
`transmitted and stored.
`Discussion of the Prior Art
`Aircraft safety is of ever increasing importance. This
`is particularly true with respect to commercial airlines as
`more and more people and freight are moved in this manner.
`The airways are becoming increasingly crowded with traffic.
`Global tracking systems are now in place to monitor the
`flight of the aircraft from the moment it lifts off until
`it safely lands at its destination. Radar and global
`positioning systems are commonplace both on the aircraft
`All of these
`and at the ground tracking stations.
`electronic systems have increased the overall safety record
`of commercial traffic to new standards as the number of
`miles flown continues to escalate.
`In addition, the on board avionics including
`electronic
`monitoring
`and
`diagnostic
`equipment,
`particularly on large commercial jets, continues to evolve,
`giving both the on board crew and the tracking station more
`complete, accurate and up to date information regarding the
`condition of the aircraft while in flight. Flight recorders
`long have been incorporated in order to provide a record of
`each flight and in order to provide critical information to
`aid in the determination of the causes of an accident or
`malfunction should one occur.
`Even with all of this information, there still remains
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`BOEING Exhibit 1043
`Page 2 of 60
`
`

`
`- 2 -
`
`a significant need to develop a system capable of providing
`good visual evidence of the condition of the aircraft and
`various components during flight. For example, even with
`all of the available electronic monitoring equipment, the
`crew of the aircraft can only make a visual inspection of
`a wing engine by looking out of the window. In many
`aircraft configurations, this requires that the crew member
`move into the passenger cabin in order to obtain a view of
`the engine. Further, with the increasing incidents of
`terrorism and other tampering with aircraft, a good visual
`surveillance system would give instant recognition of known
`terrorists and would provide visual inspection of critical
`areas and components of the aircraft while in flight,
`without detection by either the passengers or by possible
`perpetrators.
`Such a system would also permit the recording .of
`visual information to provide a visual history of the
`flight, further enhancing reconstruction of incidents
`leading to an airborne catastrophe should one occur. Visual
`information could also be transmitted between the ground
`tracking station and the aircraft, providing yet another
`source of information transmission for increasing the
`overall safety of the flight.
`While such a system would be of great benefit to the
`airline industry in general and to the commercial airlines
`in particular, there are no systems currently available
`which meet these needs.
`
`SUMMARY OF THE INVENTION
`The subject invention is directed to a comprehensive
`multi-media safety and surveillance system, which in the
`preferred form provides both visual and audio information
`as well as critical data to the flight crew, and to a
`ground tracking station, and also permits recording the
`information and data generated during. flight. 'In its
`preferred form, a plurality of sensor.units, including at
`least one video image sensor/device, are placed
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 3 of 60
`
`

`
`-
`
`3 -
`
`strategically throughout the aircraft. For example, several
`video cameras may be placed such that the lens of each is
`aimed through an opening provided in the fuselage in order
`to provide video imaging of the engines, tail section, and
`landing gear and other functional components of the
`aircraft. Additional cameras may be placed throughout the
`interior of the aircraft on the flight deck, in the cargo
`hold, in passenger cabin and other desired spaces. The
`data sensors/transducers, such as by way of example, the
`engine temperature sensor, oil pressure and hydraulic
`pressure sensors and strain gauges and the like are also
`incorporated in the data collection system of the subject
`invention.
`The system may be hardwired in the aircraft, or may
`use wireless transmission and receiving systems. The
`wireless system is particularly useful for adapting the
`system as a retrofit on existing aircraft and also provides
`assurances against disruption of data transmission and
`collection during a catastrophic airframe failure. In the
`preferred embodiment, the wireless system is fully self-
`contained with each sensor unit having an independent power
`supply and where appropriate, a sensor light source. The
`ground communications link, monitoring and recording
`systems for collecting and transmitting the data are also
`self-contained. This assures that the system will continue
`to operate in the event of either a malfunction or a
`structural failure of the aircraft causing a disruption in
`power source or will not disrupt the generation and
`collection of data and visual images.
`A monitor may be provided on the flight deck and
`recorders may be placed in the tail section, as is common
`for flight data and voice recorders currently in use. The
`flight deck would have instant live access to all of the
`images as they are captured by the video cameras',and the
`recorder would make an historic record of the images for
`archive purposes. Where random access recording techniques
`are used, such as, by way of example, digital random access
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 4 of 60
`
`

`
`-4-
`
`memory storage devices, the flight deck and the ground
`station personnel may also be able to search and retrieve
`stored information.
`For example, current hydraulic
`pressure of a component may be compared with the pressure
`of a past point in time to monitor rate of change.
`Where desired, ground tracking or control stations
`would have selective access to the images on a near or real
`time basis. In addition, the ground station could send
`video images to. the aircraft flight deck monitors on a
`selective basis. That is, the ground tracking station will
`have the capability of interrogating the in flight data,
`including video images, while the aircraft is in flight.
`Near real time data can be received and historical data can
`be retrieved, as well, when the random access storage
`device is utilized.
`The plurality of sensors are synchronized through an
`on board multiplexing system whereby the plurality of data,
`including visual image data, may be displayed, recorded,
`and/or transmitted in either a split screen or serial
`is
`fashion. In the preferred embodiment, the system
`adapted for incorporating the data signal generated by the
`aircraft navigational data such as that provided by a
`global positioning system (GPS) .for tracking the altitude,
`latitude and longitude coordinates synchronized with the
`collected data in order to provide accurate information of
`where the aircraft is in its flight plan when an incident
`A time or chronology signal may also be
`occurs.
`incorporated in the data scheme. Any signal which is
`capable of being captured and stored may be monitored in
`this manner. By tying each of the images to a reference
`such as the GPS signal or a clock, the retrieval of data
`and reconstruction of an on board incident is facilitated.
`Utilizing the wireless system of the invention in
`combination with the battery back-up power supply, it is
`possible to continue collecting information even after an
`airframe failure and a disruption in aircraft power. For
`example, radar images which are currently displayed on a
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 5 of 60
`
`

`
`-
`
`5 -
`
`monitor can also be transmitted to the ground and can be
`stored in the record of the "black box" recording system on
`board the aircraft. Transducer signals monitoring pressure
`system and engine components are also be collected for
`transmission and storage. Data generated by image sensors
`ranging from analog video cameras to digital cameras to
`infrared sensors and the like can collected and distributed
`by the system. The system is particularly well suited for
`use in combination with forward linking infrared (FLIR)
`cameras, such as available from Texas Instruments, for
`producing visual images in adverse weather conditions such
`This would be particularly useful in
`as heavy fog.
`determining the flight path of the aircraft, both on board
`and for later retrieval when incidents occur in low
`visibility conditions. Therefore, the system of the subject
`invention provides a comprehensive multi-media data
`capture, display, transmission and storage surveillance
`system for the aircraft while in flight, with data readily
`accessible to both the flight crew and a ground tracking
`station.
`Preferably, the entire capture, retrieval, monitor and
`archive system is installed utilizing a wireless
`transmitting/receiving system in order to assure that
`transmission will not be lost in the event of a power
`shutdown or a structural failure causing possible open
`circuit conditions which could occur in a hard wired
`system. In the preferred embodiment, such a system would be
`completely self-contained with an integrated power supply
`and an integrated illumination system. The illumination
`system would provide lighting to permit capture of images
`in the event the aircraft power system fails.
`Such a system would. be of invaluable service to the
`flight crew and the ground tracking station, providing
`visual indication of such information as the operation of
`the landing gear, for example, or of an engine smoke
`condition, or of the presence of smoke or fire in the cargo
`hold. In addition, the system provides instant visual
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 6 of 60
`
`

`
`-
`
`6 -
`
`10
`
`15
`
`20
`
`access to conditions in the passenger cabin or in the cargo
`hold. In addition, the ground station could relay video
`information directly to the crew in the event of certain
`conditions. For example, if a terrorist or terrorist group
`5 were on board, the ground crew would have access to visual
`information indicating the conditions in the passenger
`cabin and cockpit. This would permit the ground crew to
`ascertain the number of terrorists on board, the types of
`weapons carried and visual identification of the
`individuals without any communication from the flight crew
`and without any flight crew action. Such information is
`invaluable in determining the best course of action for
`Further, critical visual
`dealing with such a crisis.
`information can be transmitted to the flight crew for
`assisting the crew in dealing with the situation.
`Of course, it is an important aspect of the invention
`that all of the collected data, including any video images,
`be recorded on a flight recorder to provide an historic
`video record of the flight. This will prove invaluable as
`an aid in reconstructing the cause of catastrophic
`occurrences during a flight.
`In the preferred embodiment, the system includes a
`plurality of strategically located video image sensors such
`as, by way of example, analog video cameras synchronized by
`a master synchronizing source, each camera adapted for
`transmitting the synchronized video signal to a multiplexer
`for distributing the signal to video monitors on board the
`aircraft and archival recorders on board the aircraft. The
`system also includes audio sensors and component monitoring
`sensor devices. The system is adapted for selectively
`transmitting all of the data on a near real time basis to
`a ground tracking station. The system is adapted to provide
`the monitors access to serial, synchronized full screen
`view of each of the cameras, in sequence, or alternatively
`to provide split screen viewing of a plurality of cameras.
`The system may be hardwired or wireless transmission may be
`utilized to further minimize the possibility of a
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 7 of 60
`
`

`
`- 7 -
`
`malfunction at the onset-of a catastrophic occurrence.
`It is, therefore, an object and feature of the subject
`invention to provide a comprehensive, multi-media data
`generating, collecting, displaying, transmitting, receiving
`and storage safety and surveillance scheme for aircraft.
`It is also an object and feature of the subject
`invention to provide video surveillance of critical
`components and areas of an aircraft during flight.
`It is an additional object and feature of the subject
`invention to provide a video record of critical components
`and areas of an aircraft during flight for archival and
`retrieval purposes.
`It is yet another object and feature of the subject
`invention to provide apparatus for permitting ground
`personnel to receive video images, audio information and
`data relating to critical components and areas of and
`aircraft during flight.
`It is a further object and feature of the subject
`invention to provide apparatus for permitting ground
`personnel to transmit data and video images to an aircraft
`during flight.
`It is a further object and feature of the subject
`invention to provide accurate information of where the
`aircraft is during a flight path when a specific visually
`captured image occurs.
`It is also an object and feature of the subject
`invention to provide a system for linking recorded video
`images with an inertial navigation system such or other
`navigational data source such as, by way of example, a
`global positioning system for archival purposes.
`It is still another object and feature of the
`invention to permit the monitoring, storing and retrieval
`of any of a variety of video images, audio signals and
`performance data by the tracking, surveillance and imaging
`equipment on board the aircraft.
`Other objects and features of the subject invention
`will be readily apparent from the accompanying drawings and
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 8 of 60
`
`

`
`- 8 -
`
`detailed description of the preferred embodiments.
`Brief Description of the Drawings
`Fig. 1 is a cutaway illustration of the fuselage of an
`aircraft showing placement of video imaging devices in
`accordance with the invention.
`Fig. 2 is a block diagram of the control electronics
`for a wireless system in accordance with the subject
`invention, utilizing frequency agile receivers in order to
`reduce the number of transmitter/receiver combinations
`required.
`Fig. 3 is a block diagram of multiple image/data
`synchronization scheme in accordance with the subject
`invention.
`Fig. 4 is a block diagram of a multiple video imaging
`device system incorporating the features of the invention
`and a split screen monitor capability.
`Fig. 5 is a block diagram illustrating a typical
`system utilizing a wireless transmission and receiving
`scheme in accordance with the invention.
`Fig. 6 is a block diagram showing a multiple
`sensor/video device, synchronized system configuration, in
`combination with wireless system.
`Fig. 7 is a an expansion of the block diagram of Fig.
`6, showing the multiplexing switching scheme and the
`receivers.
`Fig. 8 is a block diagram for a second alternative
`wireless system incorporating multiplexed digital frame
`synchronization.
`Fig. 9 is a block diagram system illustrating a
`combination of both hard wired and wireless sensor devices,
`wherein remote sensors rely on wireless transmission and
`sensors in close proximity to the processing system may be
`hard wired.
`Fig. 10 is an expansion of the system of Fig. 10,
`illustrating an exemplary engine telemetry sensor array.
`Fig. 11 is an expanded diagram of wireless tqlemetry
`incorporating image sensors.
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 9 of 60
`
`

`
`- 9
`
`-
`
`Fig. 12 is illustrative of a comprehensive multimedia
`system in accordance with the teachings of the subject
`invention.
`Fig. 13 is a modification of the system of the subject
`invention, incorporating analog sensors combined with
`digital to analog conversion schemes and a digital data
`recorder.
`is an illustration demonstrating the
`Fig. 14
`multimedia capability of the system of the subject
`invention.
`Fig. 15 is a block diagram for a multiple
`sensor/device,
`multiple
`channel
`analog
`recorder
`configuration.
`Fig. 16 shows a timing diagram for a three channel
`multiplexed system using a split screen format.
`Fig. 17 is a timing diagram for a time multiplexed
`recording configuration for a single channel system using
`a split screen-format
`Fig. 18 is a timing diagram for an alternative time
`multiplexed recording configuration utilizing split screen
`technology.
`Fig. 19 shows the uplinking and downlinking system
`between the ground station and the airborne aircraft.
`Fig. 20 is an illustration of a flight deck monitor
`and control panel.
`Fig. 21 is an illustration of a ground station monitor
`and control panel.
`Detailed Description of the Preferred Embodiments
`Fig. 1 shows a cutaway diagram of a typical commercial
`airline fuselage 10, with the cargo hold 12, the passenger
`cabins 14, 16 and the flight deck or cockpit 18-partially
`visible. In the example, a number of video image sensor
`devices such as, by way of example, analog video cameras,
`may be mounted inside the skin of the aircraft and aimed
`through openings provided in the fuselage to focus on
`critical components of the aircraft, such as the landing
`gear cameras 20, 22, the wing engine camera 24 and the tail
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 10 of 60
`
`

`
`- 10 -
`
`10
`
`15
`
`20
`
`camera 26.
`Similar devices or cameras may also be
`strategically placed throughout the interior of the
`aircraft, such as the passenger cabin cameras 28, 30, 32,
`34, 36, 38, 40, the cargo bay cameras 42, 44, 46, 48 and
`5 the flight deck camera 50. The placement and number of
`devices is a matter of choice depending upon the
`configuration of the aircraft and the level of surveillance
`desired.
`In the embodiment shown and described, a multi-media
`flight recorder or "black box" 52 is installed 'in the tail
`section of the aircraft, in the same manner as the current
`data and voice black boxes (not shown).
`A flight deck
`monitor and control panel 54 is located on the control
`panel in the cockpit 18. Other monitors may be provided
`where desired.
`An exemplary embodiment of the system is shown in Fig.
`2-5, adapted for wireless installation using frequency
`The system shown is for a wireless
`agile receivers.
`installation wherein the video signal captured by each
`camera is transmitted via radio signals and control signals
`from the control panel are likewise transmitted via
`wireless radio.
`The incoming video signal is received by the antenna
`60 and input into a first frequency agile receiver 62 and
`a second frequency agile receiver 64 and a third frequency
`agile receiver 66. The second receiver 64 converts the
`signal and transmits it to the monitor/control panel 54 in
`the cockpit. The frequency agile receivers are selectively
`tuned under the control of the system to receive the
`specific radio frequency for receiving the video signals
`from the plurality of on board video cameras.
`The output from the split screen system 68 is
`introduced into the flight recorder 70 for permanent
`recording. In the preferred embodiment, a standard global
`positioning system (GPS) is incorporated and includes a
`receiver 72 and an antenna 74.
`The GPS signal is also input into the flight recorder
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 11 of 60
`
`

`
`- 11 -
`
`70 and may be overlaid on the video signal and/or recorded
`on the data track in order to provide precise information
`of the specific time and location of the aircraft for each
`captured and recorded video incident. In the preferred
`embodiment, the GPS system includes an integral battery
`backup power supply which may be part of the master control
`system backup. This allows the GPS system to continue
`operating even in the event of an airframe failure or a
`disruption in aircraft power or a disruption in, navigation
`systems. This allows the recorder to continue collecting
`critical navigational data including time, latitude,
`longitude and altitude. As shown in Fig. 4, the signals
`generated by various other components of the aircraft may
`also be collected for recording, transmission and
`monitoring utilizing the system of the subject invention,
`These signal may
`as indicated by. the sensors 95.
`introduced directly into the recorder or may be
`synchronized with the video signals as indicated at 97.
`Such sensors 95 would include any data signal desired to be
`incorporated in the comprehensive data system of the
`invention, such as, by way of example, the output signals
`produces by system monitoring transducers including, for
`example, engine temperature, oil and hydraulic pressure and
`the like. The system can also include data such as the
`radar signal, a chronology of the flight, global
`positioning and the like. This permits a comprehensive
`history of the flight as well as ready access to all
`available information by both the flight crew and a ground
`station.
`The system may also incorporate a ground link
`communications capability, wherein any of the video signals
`transmitted to antenna 60 may be introduced into an image
`transceiver 76 through the agile frequency receiver 66. e
`frequency receiver 66 provides an input to the image
`transceiver 76 which is adapted for generating a radio
`signal at 78 for input to an on board radio transceiver 80.
`The radio signal is transmitted to a ground station (not
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 12 of 60
`
`

`
`- 12 -
`
`10
`
`15
`
`20
`
`shown) via antenna 82.
`The frequency receiver 64 provides a video signal to
`the monitor 55 of the cockpit control panel 54. The flight
`crew has can control the selection of cameras monitored at
`5 monitor 55 and can control the transmission of images to
`the ground station via radio 80. This is indicated by the
`control signals on line 84 from the control panel 54 to the
`control network 86. The control network 86 sends control
`signal out over a control transmission line or 'lines 88 to
`control the receivers 62, 64, 66 and the recorder 70 and
`the image transceiver 76.
`The operation of the video
`flight recorder and the frequency receivers is not intended
`to be accessible by the flight crew. In addition, the
`antenna 82 can receive uplinked video messages from a
`ground station. These signals are tied to the GPS signal
`and are both recorded at the recorder 70 and transmitted to
`The recorder 70 may be a
`the flight deck monitor 55.
`standard analog recorder, or may include digital hard drive
`systems or a random access digital memory, or other
`recording scheme as desired. The random access scheme
`would be particularly useful for having instant access to
`historical data while in flight. For example, if a
`terrorist was found to be on board, it would be useful to
`play back preceding activity to monitor the past actions by
`the terrorist before he was identified by the flight crew
`or ground tracking station. This could prove useful in
`determining a course of corrective action. As an example,
`it could assist with the location of weapons.
`The frequency receivers 62, 64 and 66, the video
`recorder 70, the image transceiver 76, the GPS system 72
`and the radio 80 utilize known technology well known to
`those skilled in the arts. The antennas 60, 74 and 80 are
`also of standard configuration. The control panel 54 and
`monitor 55 are of standard design, with the control panel
`utilizing electrical switches to activate and deactivate
`the crew controllable functions. The control system 86 is
`a solid state controller and may include firmware or
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 13 of 60
`
`

`
`- 13 -
`
`software for controlling the automated functions which are
`not manually controlled by the crew or the ground
`personnel. The specific configuration of the control system
`is discretionary and is within the purview of those of
`ordinary skill in the art.
`The present invention contemplates the use of
`synchronized multiplexing to maximize the capture of video
`signals from a plurality of cameras while minimizing the
`amount of hard physical equipment to store and process such
`a vast amount of information. One embodiment of the
`synchronizing system is shown in Fig. 3. As there shown,
`each of the plurality of imaging devices such as cameras
`C1-CN, such as, by way of example, the cameras 20, 22, 24,
`26, 28...50, receive a master synchronizing. signal from a
`master synchronizer via an input line 92. This assures
`that the raster scanned image captured by each camera is in
`synchronization with every other camera on the system and
`permits switching between cameras at monitor 55 without
`loss of full screen imaging. Each of the independent images
`captured by the cameras is output on a dedicated output
`line 94 into a switching matrix 96. The matrix permits
`The
`selection of the image to be displayed at monitor 55.
`video signal to the image transceiver 76 is also
`synchronized via the synchronizing system 90 and the
`specific image input to the transceiver 76 is controlled by
`a series of electronic switches .102. Likewise, the recorder
`is synchronized, with all of the video signal on the
`dedicated lines 94 being input into the recorder through a
`series of electronic switches 104. In reality, the monitor
`55, image transceiver 76 and recorder 70 simply process
`whatever signal is present on their respective input lines
`101, 103 and 105, operating in the normal, well-known
`manner. What makes the consolidation of equipment possible
`is the switching scheme utilized at the switch matrix 96 in
`order to capture and utilize a maximum amount of useful
`information in a minimum of data storage capacity
`requirements.
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 14 of 60
`
`

`
`- 14 -
`
`The simple switching scheme shown in Fig. 3 simply
`utilizes a sequencing system, where each of the plurality
`of image signs is introduced into the processing system.
`The multiplexing scheme permits optimum versatility while
`preserving the maximum amount. of produced data. In the
`example of Fig. 3, the multiplexer 96 includes three
`distinctive switching operations such as indicated by the
`For example, the
`switching symbols 100,. 102 and 104.
`operation indicated by switches 100 will permit the flight
`crew to monitor any one or more of the selected camera
`sensors on demand. Likewise, the image transceiver 76 may
`be used to access any one or more of the camera sensors via
`downlike to ground control as indicated by switches 102
`either via ground command or pilot command. The images may
`be recorded at recorder 70 by selecting the camera sensors
`via switches 104 via a pre-established routine, see for
`example, Figs. 15-18, or via pilot control. Other schemes
`could also be accommodated using the teachings of the
`For example, using a thirty camera
`present invention.
`system, if each signal is displayed for one-tenth of a
`second, the system will make a pass of all thirty cameras
`twice every minute. This means the longest gap between
`recorded information for any one camera will be less than
`thirty seconds. That is, the recorder will have an image on
`record for every camera in the twenty camera system every
`thirty seconds. As previously stated, the flight control
`panel 54 permits the flight crew to look at any selected
`camera signal for any desired length of time and/or to
`For example, if
`record or transmit specific signals.
`difficulty with 'the landing gear was detected, the crew
`could train the monitor and the transceiver on the landing
`control camera for as long as necessary without interfering
`with the recorded sequenced information.
`system
`multiplexing
`synchronized
`modified
`A
`incorporating split screen technology is shown in Fig. 4.
`Typically, the switching matrix control 96 is controlled
`via the master controller module 86. Each of the video
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 15 of 60
`
`

`
`- 15 -
`
`signals 94 are input into a split screen network system
`106, which is programmed by the control module 86 via
`control line 108. This permits the video signal input into
`the various processing stations 55, 76 and 70 to be split
`so that more than one image can be simultaneously
`displayed, transmitted or captured. For example, this would
`permit the crew to focus on the landing gear camera using
`a portion of the monitor while permitting the remaining
`images to scan through the normal sequence. Other split
`screen/sequencing schemes can also be used, as will be
`explained (see Figs. 11-13).
`Turning now to Figs. 5-8, the wireless transmission
`system for use-on board the aircraft is shown in block form
`in Fig. 5. Typically, each of the various cameras C will be
`mounted at the desired site and will include a
`self-contained power supply such as the rechargeable
`battery 110. This provides a fully integrated system which
`is operational even in the event of airframe failureo,or
`shut down of the aircraft power supply and backup systems.
`In the preferred embodiment, each camera unit will include
`an illuminating source such as, by way of example, the
`light source 111, which will be operational during a power
`failure mode, or selectively operational during certain
`operating modes. For example, the landing gear camera
`illumination system would be operational whenever the
`natural level of exterior light is insufficient to provide
`a good video image. Other systems such as infrared sensor
`systems can also be incorporated to provide adequate image
`capturing techniques. The battery will rely on a charging
`system 112 which is hardwired to the aircraft power system
`114, but will continue to operate the camera in the event
`of aircraft power disruption for any reason. The camera
`system also includes a self-contained transmitter 116 and
`an antenna 118 for transmitting the captured video signal
`via a dedicated low interference radio frequency. Each
`signal is received by an antenna 60 (see Fig. 5 and 7) and
`deciphered by matching receivers 120, 122, 124, 126...150,
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 16 of 60
`
`

`
`- 16 -
`
`in one-to-one correspondence with the cameras 20, 22, 24,
`26...50, to provide a unique video signal on each of the
`lines 94 as previously described, for providing input into
`the switching matrix 96 of the receiver/processing network.
`The receiver/processor network also include a dedicated,
`self contained power supply as indicated by the
`rechargeable battery 152 and the charging system 124, which
`is connected to the aircraft power system 114.
`Where a synchronized system is used in a wireless
`multiple camera installation, the video camera system C is
`modified as shown in Fig. 6. Numerous synchronizing
`techniques may be utilized, as will be well understood by
`those of ordinary skill in the art. For example, the wires
`may be synched, or the unsynchronized video signal may be
`and then resynchronized utilizing digital
`transmitted
`techniques, or as illustrated here, where the synch signal
`is transmitted. -Specifically, each camera C will include
`a self-contained synchronizing signal receiver 156 in
`addition to the transmitter 116 and the power supply. This
`receiver can also be used as an on-off/switching device for
`the cameras and could be set up as a wireless multiplexer
`by switching cameras. The antenna 118 will be used for
`both transmitting the video signal and receiving the sync
`signal. As diagrammatically shown in Fig. 6, the
`receiver/processing system is modified to include a master
`synchronizing signal source 90, see Fig. 3 and a
`transmitter 158 coupled to the antenna 61.
`As more clearly shown in the expanded diagram of Fig.
`7, the system incorporates a multi-camera wireless,
`synchronized system, with the receiver/processing system
`expanded to show the switching matrix 96 in combination
`with the monitor 55, the image transceiver 76 and the
`recorder 70, see also Figs. 3 and 4 which is a hardwired
`version of the same system.
`Fig. 8 illustrates a system which is a modification
`of the system of Figs. 6 and 7, adapted for frame-by-frame
`synchronization, where selected still images are"created
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`BOEING Exhibit 1043
`Page 17 of 60
`
`

`
`- 17 -
`
`10
`
`15
`
`20
`
`and processed on a synchronized basis for each of the
`plurality of cameras 20, 22, 24, 26, 28, 30, 32, 34...50.
`In this version, the cameras are not synchronized and each
`raw video signal is transmi