Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 1 of 13
`
`
`
`
`
`
` Exhibit 1
`
`
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 2 of 13
`
`USOO789.3848B2
`
`(12) United States Patent
`Chew
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,893,848 B2
`Feb. 22, 2011
`
`(54) APPARATUS AND METHOD FOR LOCATING,
`IDENTIFYING ANDTRACKING VEHICLES
`NA PARKING AREA
`
`(75) Inventor: David K. M. Chew, Singapore (SG)
`(73) Assignee: Stratech Systems Limited. Singapore
`(SG)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`(21) Appl. No.: 12/249,166
`
`(*) Notice:
`
`(22) Filed:
`
`Oct. 10, 2008
`
`(65)
`
`Prior Publication Data
`US 2009/030976O A1
`Dec. 17, 2009
`
`Related U.S. Application Data
`(63) Continuation of application No. 1 1/555,915, filed on
`Nov. 2, 2006, now abandoned, which is a continuation
`of application No. 10/933,585, filed on Sep. 3, 2004,
`now abandoned.
`
`Foreign Application Priority Data
`(30)
`Sep. 3, 2003
`(SG) ............................. 20O30565O-4
`
`(51) Int. Cl.
`(2006.01)
`B60O I/48
`(2006.01)
`G08G L/4
`(52) U.S. Cl. ...................................... 340/932.2: 701/25
`(58) Field of Classification Search .............. 340/932.2,
`340/933: 701/25, 28, 208, 211
`See application file for complete search history.
`References Cited
`
`(56)
`
`U.S. PATENT DOCUMENTS
`
`6.426,708 B1* 7/2002 Trajkovic et al.......... 340/932.2
`6,662,077 B2 * 12/2003 Haag ................
`... 340/932.2
`6,747,687 B1 * 6/2004 Alves ...................... 340/932.2
`6,750,786 B1* 6/2004 Racunas, Jr. ............. 340/932.2
`6,816,085 B1 * 1 1/2004 Haynes et al. ........... 340/932.2
`6,924,749 B2 * 8/2005 Nelson et al. .....
`... 340/932.2
`6,946,974 B1* 9/2005 Racunas Jr. ....
`... 340,932.2
`6,970,101 B1 * 1 1/2005 Squire et al. ......
`... 340/932.2
`7,026,954 B2 * 4/2006 Slemmer et al. ......... 340/932.2
`2002/0171562 A1 11, 2002 Muraki
`2003/0.133594 A1* 7/2003 Sefton ........................ 382,103
`
`FOREIGN PATENT DOCUMENTS
`
`JP
`JP
`JP
`JP
`JP
`JP
`
`HOT-167186
`HOT-212038
`2OOO172993
`2001.266296
`2002117493
`20030589.25
`
`1, 1997
`3, 1997
`6, 2000
`9, 2001
`4/2002
`2, 2003
`
`OTHER PUBLICATIONS
`Official Notice Of Reason For Refusal for Japanese Patent Applica
`tion No. 2006-525309, dated Jun. 29, 2010, 7 pages.
`Taiwanese patent application No. 093126673, Search Report issued
`Oct. 11, 2010, 5 pages.
`* cited by examiner
`Primary Examiner John A Tweel, Jr.
`(74) Attorney, Agent, or Firm—Conley Rose, P.C.
`
`(57)
`
`ABSTRACT
`
`A method for use in the management of vehicle parking in a
`vehicle parking area having a plurality of vehicle parking
`spaces, the method comprising determining the locations of
`vacant vehicle parking spaces; and displaying the locations of
`vacant vehicle parking spaces to people seeking to park
`vehicles.
`
`6,340,935 B1* 1/2002 Hall ........................ 340/932.2
`
`16 Claims, 4 Drawing Sheets
`
`3 °3& 8; a cistic rag:
`
`
`
`
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 3 of 13
`
`U.S. Patent
`
`Feb. 22, 2011
`
`Sheet 1 of 4
`
`US 7,893,848 B2
`
`3.
`8:
`.
`
`
`
`
`
`
`
`
`
`
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 4 of 13
`
`U.S. Patent
`
`Feb. 22, 2011
`
`Sheet 2 of 4
`
`US 7,893,848 B2
`
`FGURE 2
`
`Camera Sensor Network in
`camerasenior Network hal
`Camerasensor New 2
`Camera Sensor Network #1
`
`-
`
`Star
`2
`
`
`
`Repeatedly capture a sequence
`of car park coliages or
`processinata fixed sist of
`dynamic in-lneral
`
`wn as
`
`-
`
`208
`
`2O2
`
`2OO
`
`204
`
`------------ ww as awaww aw wow awwe worra so w w www.aw www.wrw area
`
`IPCC in
`IPCCU i2
`-----------------------------------
`PCCU i?
`
`F----------------------------e."
`Points. It
`- 207
`
`vehicle objecis
`
`A.
`wehicle objects
`
`-
`
`objects images
`statase
`
`Define eversity's clich.
`vehicle objects by analysing
`cuffstad fevious irrages &
`update irrate datatase
`
`identify each non-vehicle object
`by its features arc formulates
`incider status of the carpark
`an update incident status
`
`
`
`Detaining ever status gives
`objects by analysing current and
`previous lates and upiate
`rate calabase
`
`identify each wericle object by its
`features and formulaic parking
`status of the carpark and update
`parki
`status databasa
`
`- 215
`
`2 1 9
`
`TTT central controller in
`Central controller #2
`Central Controllier i
`
`Store incident and parking status at the car park into the central controller database
`
`22
`
`
`
`
`
`
`
`223
`34
`Vacant tol
`Location
`Aggin
`& Gui
`
`227
`Park
`E. Wacto
`cratic
`booking
`Application
`Application
`... 8. Gu
`
`
`
`Weic
`lack-up
`Application
`& CS
`
`229
`7
`Car Park
`Surveillace
`Application
`8. G
`
`A
`Traffic Fion
`Esquiry
`Acadf
`G
`
`233
`
`Congestior
`Pricing
`Applicator
`S. Gi
`
`L
`
`re
`
`Os. D-237
`
`> ar as erra -
`
`as
`
`-ar w xswer ar sy row
`
`r Prara ---
`
`- re
`
`2O6 1
`
`235
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 5 of 13
`
`U.S. Patent
`
`Feb. 22, 2011
`
`Sheet 3 of 4
`
`US 7,893,848 B2
`
`
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 6 of 13
`
`U.S. Patent
`
`Feb. 22, 2011
`
`Sheet 4 of 4
`
`US 7,893,848 B2
`
`RAM
`820
`
`ROM
`822
`
`ProCeSSOr
`818
`
`Computer Network
`at 812
`
`TransCeiver
`L-814
`5.
`Computer Module
`
`DD
`
`Printer
`810
`
`
`
`Bus
`828-
`
`830
`Data Storage
`
`826 824
`IO Interface
`I/O Interce
`
`Display
`808
`
`e
`
`H
`
`1.
`800
`Computer System
`
`806
`Mouse
`
`Figure 4
`
`804
`Keyboard
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 7 of 13
`
`US 7,893,848 B2
`
`1.
`APPARATUS AND METHOD FOR LOCATING,
`IDENTIFYING ANDTRACKING VEHICLES
`NA PARKING AREA
`
`The present application is a continuation of U.S. applica
`tion Ser. No. 1 1/555,915 filed on 2 Nov. 2006 now aban
`doned. The U.S. application Ser. No. 1 1/555,915 is a continu
`ation of U.S. application Ser. No. 10/933,585 filed on 3 Sep.
`2004 now abandoned. The U.S. application Ser. No. 10/933,
`585 claims benefit of priority from Singapore application No.
`200305650-4 filed on 3 Sep. 2003.
`
`10
`
`FIELD OF THE INVENTION
`
`The invention relates to vehicle parking. In particular, it
`relates to apparatus and method for locating, identifying and
`tracking vehicles in a car park.
`
`15
`
`BACKGROUND
`
`2
`In accordance with a second aspect of the present inven
`tion, there is provided a method for use in the management of
`vehicle parking in a vehicle parking area having a plurality of
`vehicle parking spaces. The method comprises determining
`one or more identifying features of each of a plurality of
`vehicles located in vehicle parking spaces, receiving a request
`to locate a specific vehicle with at least one of said one or
`more identifying features, determining one or more possible
`locations for said specific vehicle based on said at least one of
`said one or more identifying features and the determined one
`or more identifying features of each of a plurality of vehicles,
`and displaying said one or more possible locations in
`response to said request. The one or more identifying features
`may comprise one or more of the number plate, the color, the
`make and the model of a vehicle.
`In accordance with a third aspect of the present invention,
`there is provided a system for use in the management of
`vehicle parking in a vehicle parking area having a plurality of
`vehicle parking spaces. The apparatus comprises a detection
`unit for determining the locations of vacant vehicle parking
`spaces and a display unit. The display unit displays the loca
`tions of vacant vehicle parking spaces to people seeking to
`park vehicles. The detection unit may comprise a plurality of
`camera elements and an image processing unit for processing
`images obtained by the camera elements, each camera ele
`ment Surveying one or more of the vehicle parking spaces.
`Each camera element may be arranged such that different
`cells of an image from the camera element is associated with
`one vehicle parking space, and the image processing deter
`mines the location of the vacant vehicle spaces based on
`individual cells of the images. The display unit may comprise
`one or more audio display devices and/or one or more visual
`display devices. The display unit may be arranged to commu
`nicate with one or more remote devices for facilitating dis
`playing the locations of the vacant parking spaces. The
`remote devices may comprise on-vehicle devices.
`In accordance with a fourth aspect of the present invention,
`there is provided a system for use in the management of
`vehicle parking in a vehicle parking area having a plurality of
`vehicle parking spaces. The apparatus comprises a first detec
`tion unit for determining one or more identifying features of
`each of a plurality of vehicles located in vehicle parking
`spaces, an interface unit for receiving a request to locate a
`specific vehicle with at least one of said one or more identi
`fying features, a processing unit for determining one or more
`possible locations for said specific vehicle based on said at
`least one of said one or more identifying features and the
`determined one or more identifying features of each of a
`plurality of vehicles, and a display unit for displaying said one
`or more possible locations in response to said request. The
`system may further comprise a second detection unit for
`determining the locations of vacant vehicle parking spaces.
`The display unit further displays the locations of vacant
`vehicle parking spaces to people seeking to park vehicles. The
`first and second detection units may be implemented in a
`single detection unit. The one or more identifying features
`may comprise one or more of the number plate, the color, the
`make and the model of a vehicle. The first and/or second
`detection units may comprise a plurality of camera elements
`and an image processing unit for processing images obtained
`by the camera elements, each camera element Surveying one
`or more of the vehicle parking spaces. Each camera element
`may be arranged Such that different cells of an image from the
`camera element is associated with one vehicle parking space,
`and the image processing determines the location of the
`vacant vehicle spaces based on individual cells of the images.
`The display unit may comprise one or more audio display
`
`25
`
`30
`
`35
`
`40
`
`45
`
`Adriver encounters many problems while parking vehicles
`in a huge carpark. For instance, in a crowded huge multi-story
`car park, it is difficult for a driver to remember where his/her
`vehicle is parked. Often it is a frustrating experience to search
`for his/her vehicle. Quite often, it is difficult for a driver to
`locate an empty parking space to park his/her vehicle in a
`huge carpark, despite being informed that numerous parking
`spaces are available. Precious time is wasted by drivers when
`he/she cannot remember where the vehicle is parked or not
`being in a position to trace an empty parking space. The
`present car parking systems are not efficient enough for a car
`park operator to ease the problems mentioned above. Slow
`vehicle retrieval and delay in searching for empty lots results
`in problems, such as delayed exit of vehicles, increased car
`park jams, less effective parking capacity, and poor car park
`utilisation. Furthermore, motorists are at great inconve
`nience, and may even result in discouraging others from
`parking in Such car parks. For the car park operators, these
`problems translate directly to revenue loss. This in turn,
`reduces the revenue of the shop keepers or businessmen who
`are present in a building having Such a car park.
`Presently, some car parks have addressed the above prob
`lems to some extent. Some car parks provide empty lot infor
`mation. For example, a carpark is divided into many different
`Zones and vehicle detection sensors are installed between
`each Zone to count the numbers of vehicles coming in and
`going out of a Zone. These vehicle sensors provide informa
`tion to derive the number of vehicles parked inside each Zone.
`Other systems involve the installation of vehicle detection
`sensors (infra red, proximity, or light sensors, etc) for each
`parking lot, thus providing parking lot availability informa
`tion. However, the existing carpark systems have many draw
`backs, including inability to determine when specific lots
`become available, high infrastructural costs, high per carpark
`lot equipment, high installation and maintenance costs.
`Moreover, existing methods are based on the principle of
`counting of vehicles or the occupation of lots.
`
`50
`
`55
`
`60
`
`65
`
`SUMMARY OF THE INVENTION
`
`In accordance with a first aspect of the present invention,
`there is provided a method for use in the management of
`vehicle parking in a vehicle parking area having a plurality of
`vehicle parking spaces. The method comprises determining
`the locations of vacant vehicle parking spaces and displaying
`the locations of vacant vehicle parking spaces to people seek
`ing to park vehicles.
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 8 of 13
`
`US 7,893,848 B2
`
`4
`FIG. 2 shows an example embodiment of a high level
`process flow diagram for use with the embodiment shown in
`FIG. 1:
`FIG.3 illustrates an example embodiment of the invention
`complementing an integrated deployment of a Car Park Sys
`tem; and
`FIG. 4 illustrates a computer system in accord with a pre
`ferred embodiment of the invention.
`
`DETAILED DESCRIPTION
`
`The System Concept Diagram 100 of an embodiment of
`the invention is presented in FIG. 1. The embodiment of the
`invention describes an apparatus and method for automati
`cally providing the occupancy status of specific, individual
`car park lots 101 or spaces, and identifying each of the
`vehicles 103 that occupy them. The provision of occupancy
`status of the carpark lots 101 is achieved by processing one or
`more images of the car park lots 101 to provide information
`regarding the locations and numbers of empty and occupied
`car park lots 101, and guidance information to locate the car
`park lots 101. The identification of vehicles 103 is achieved
`by processing one or more images of the vehicles 103, which
`may include identifying the license plate (i.e., a series of
`number and/or characters) of vehicles 103, providing the
`accurate location (e.g., in which car park lot and where is that
`lot within the entire car park) of vehicles 103 by identifying
`by one or more of their features (e.g. colour, model, brand etc
`of a car), and providing guidance information to locate the
`vehicles 103. The apparatus and method can be extended to
`provide vehicle-related information, such as parking lot
`booking/reservation, parking enforcement, car park Surveil
`lance, vehicle look-up, traffic flow analysis, and congestion
`regulation.
`A camera network 105 having a plurality of cameras 107 is
`installed inside and/or outside of a vehicle parking facility to
`monitor continuously some or all of the parking lots 101
`and/or vehicle lanes for the presence/absence and movement
`of objects, people and vehicles 103. The camera network 105
`may be wired or wireless 106.
`The images acquired by the camera sensor network 105 are
`transmitted through wired or wireless network 111 to a net
`work of Image Processing and Camera Control Units (IPC
`CUs) 113 via anarray of video multiplexes/switches 109. The
`IPCCUs network 113 comprises a plurality discrete IPCCUs
`115 each of which may be assigned to process the images
`from the camera network 105. Each of the IPCCUS 115
`process the images that are channeled to them using built-in
`advanced adaptive self-learning image-processing algo
`rithms that are stored in the memory of the IPCCU 115. These
`algorithms deduce the status of the car park, and transmit the
`car park status through wired or wireless network 117 to the
`Locator Central Controller 125.
`Apart from the IPCCUs 115, the image-processing algo
`rithms may also be located in the locator central controller
`125, the video multiplex/switch 109 or camera units 107.
`However, a typical design will involve placing most (if not
`all) of the image processing algorithms (e.g. those for carpark
`lot status determination and vehicle image acquisition and
`feature processing) at the IPCCUs 115. In some cases, the
`central controller 125 may also host certain image processing
`algorithms. The IPCCU 115 and central controller 125 could
`be provided in the same machine.
`Given the car park status from the IPCCUs 115, the central
`controller 125 facilitates value-added services and extends
`them to the users, which include, but not limited to, car park
`customers, operators and owners. To deliver these services to
`
`3
`devices and/or one or more visual display devices. The dis
`play unit may be arranged to communicate with one or more
`remote devices for facilitating displaying the locations of the
`vacant parking spaces. The remote devices may comprise
`on-vehicle devices.
`In accordance with a fifth aspect of the present invention,
`there is provided a method for automatically providing the
`occupancy status of specific, individual car park spaces, and
`identifying the vehicles that occupy them. The method com
`prises processing one or more images of the carparkspaces to
`10
`provide information regarding the locations and numbers of
`empty and occupied car park spaces, and guidance informa
`tion to their locations and processing one or more images of
`the vehicles occupying car park spaces, to identify one or
`more of their features, thereby to enable the accurate locating
`of the vehicles, and to provide guidance information to their
`locations. Processing one or more images of the vehicles
`occupying car park spaces may comprise processing said
`images of the vehicles to determine one or more of the
`number plate, the color, the make and the model of the vehicle
`in each image.
`In accordance with a sixth aspect of the present invention
`there is provided a computer readable data storage medium
`having stored thereon computer code means for instructing a
`computer to execute a method for use in the management of
`vehicle parking in a vehicle parking area having a plurality of
`vehicle parking spaces. The method comprises determining
`the locations of vacant vehicle parking spaces and displaying
`the locations of vacant vehicle parking spaces to people seek
`ing to park vehicles.
`In accordance with a seventh aspect of the present inven
`tion, there is provided a computer readable data storage
`medium having stored thereon computer code means for
`instructing a computer to execute a method for use in the
`management of vehicle parking in a vehicle parking area
`having a plurality of vehicle parking spaces. The method
`comprises determining one or more identifying features of
`each of a plurality of vehicles located in vehicle parking
`spaces, receiving a request to locate a specific vehicle with at
`least one of said one or more identifying features, determin
`ing one or more possible locations for said specific vehicle
`based on said at least one of said one or more identifying
`features and the determined one or more identifying features
`of each of a plurality of vehicles, and displaying said one or
`more possible locations in response to said request.
`In accordance with an eighth aspect of the present inven
`tion, there is provided a computer readable data storage
`medium having stored thereon computer code means for
`instructing a computer to execute a method for automatically
`providing the occupancy status of specific, individual carpark
`spaces, and identifying the vehicles that occupy them. The
`code comprises processing one or more images of the carpark
`spaces to provide information regarding the locations and
`numbers of empty and occupied car park spaces, and guid
`ance information to their locations, and processing one or
`more images of the vehicles occupying car park spaces, to
`identify one or more of their features, thereby to enable the
`accurate locating of the vehicles, and to provide guidance
`information to their locations.
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The invention is further described by way of non-limitative
`examples, with reference to the accompanying drawings, in
`which:
`FIG. 1 shows a System Concept Diagram of an embodi
`ment of the invention;
`
`60
`
`65
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 9 of 13
`
`US 7,893,848 B2
`
`25
`
`5
`the users, the locator central controller 125 uses a variety of
`means to interact with the users and/or external systems.
`These interactive means include, but not limited to, in-vehicle
`units 131, audio devices 121, video devices 119, mobile
`devices 139, computers 133, LED panels, plasma display
`panels, and signage 123, located e.g. at a junction within the
`carpark, orata self-service kiosk. The signage 123 may guide
`a driver in the direction of empty parking lots. The commu
`nication between the locator central controller 125 and exter
`nal interactive means may be wired or wireless 127, 128.
`A High Level Process Flow Diagram 200 of an example
`embodiment of the invention is presented in FIG. 2. The flow
`diagram 200 comprises three basic blocks, namely a camera
`sensor network 202, an image processing and camera control
`unit 204, and a central controller 206. The process flow starts
`at step 201. At step 208, a camera sensor from a plurality of
`camera sensor network 202 in a car park repeatedly captures
`a sequence of a respective car park cell images. The captured
`cell images are sent for processing at a respective IPCCU
`from a plurality of IPCCUs 204, the processing being done at
`fixed or dynamic time intervals. At the IPCCUs 204, images
`received at step 205 are processed and segmented into vehicle
`and non-vehicle objects.
`At step 209, the non-vehicle objects are further processed
`to determine the event status by analysing the current and
`previous images and the image database is updated. Previous
`non-vehicle object databases are stored and retrieved at step
`203. Incident status database are stored and retrieved at step
`211. At step 217, each of the non-vehicle object is identified
`by its features and the incident status of the car park is for
`mulated and updated in the database.
`At step 215, the vehicle objects are further processed to
`determine the event status by analysing the current and pre
`vious images and the image database is updated. Previous
`vehicle object databases are stored and retrieved at step 207.
`Parking status database are stored and retrieved at step 213. At
`step 219, each of the vehicle object is identified by its features
`and the parking status of the car park is formulated and
`updated in the database.
`The combined output from step 217 (details of the incident
`status) and 219 (details of parking status) are channelled to a
`respective central controller (of a plurality of central control
`lers 206) and are stored in a respective central controller at
`step 221.
`From the data stored at Step 221, services, such as vacant
`lot location application 223, parked vehicle location applica
`tion 225, vacant lot booking application 227, vehicle look-up
`application 229, car park surveillance application 231, traffic
`flow enquiry application 233, congestion pricing application
`235, etc are made available on a respective graphic user
`interface (GUI). At step 237, the processing is terminated.
`The above embodiment of the invention, besides being
`deployed as a standalone system, can be used to complement
`a car park system. FIG. 3 shows an example embodiment of
`an integrated deployment system 300.
`55
`The car park system 300, regulates vehicles 325 entering
`and leaving parking facility 306 by charging the users a park
`ing fee. In order to provide Supplemental value added services
`to the drivers and the car park operators, the system 300 is
`deployed in parallel with the carpark system 100 described in
`the above embodiment. Supplemental services include but
`not limited to, vacant lots locating, parked vehicles locating,
`vacant lots reservation, vehicle safety Surveillance, illegal
`parking enforcement, parked vehicle look-up, traffic flow
`forecast, and congestion control.
`In the example embodiment of the integrated deployment
`system 300, a field controller 305 and IPCCUs 307 are shown
`
`6
`to be independently deployed. Alternatively, the field control
`ler 305 and the IPCCU307 can be integral. The integrated car
`park system in the example embodiment uses separate net
`work of cameras 311, 317 to identify vehicles. Alternatively
`the car park system 100 as described above and the integrated
`deployment system 300 can potentially share the same cam
`eras network.
`A vehicle 325 enters the car park at entry points 333 and
`exits the car park at exit points 331. The entry point has a
`barrier 319 to block vehicles before entering the car park 306.
`Similarly, the exit point has a barrier 315 to block vehicles
`before exiting the car park 306.
`The field controller 305 controls the opening and closing of
`the barriers 315, 319 depending on whether payment for
`parking was done before a vehicle exits the car park.
`The field controllers 305, IPCCUs 307 and central control
`lers 301,303 are typically located in a car park central control
`room 302. The communication between the field controllers
`305, IPCCUs 307 and central controllers is through a com
`mon private communication network 304. This network 304
`can be either wired such as, but not limited to, LAN and
`Serial, or wireless such as, but not limited to, wireless LAN
`802.11a. The communication between the cameras 311
`mounted inside the car park may be wired or wireless 337.
`whilst the communication between the cameras 317 mounted
`outside the car park may be wired or wireless 339.
`The car park central controller 301 regulates the entry and
`exit of vehicles 325, and the locator central controller 303
`tracks and monitors the vehicles 325 while they are within the
`car park premises 306. Although the car park central control
`ler 301 and the locator central controller 303 is shown to be
`standalone and independent systems, in case the car park
`central controller 301 is a microprocessor-based system, the
`two central controllers 301, 303 can share the same micro
`processor-based system i.e. the controllers 301, 303 can be
`integral.
`The embodiment of the invention employs computer vision
`and information technology to detect and analyse events
`inside and outside car parks 306 which, in turn, activates
`Sub-systems based on the analysis to provide value-added
`services to the customers, operators and owners of car parks.
`Cameras 311.317 are respectively mounted on the inside
`and outside of a car park premises 306. The car park 306 is
`divided into an array of physically labeled cells for monitor
`ing and identification purposes. Each car park cell, at any
`given time, may contain objects, people and/or vehicles 325.
`Each cell is being monitored and analysed repeatedly at a
`pre-defined time interval for one or more event status. These
`event status for vehicles parking, include, but not limited to,
`lot-Vacant, lot-occupied, lot-in-transit, no-vehicle, vehicle
`towards, vehicle-away, and vehicle-stop. The event status for
`car park Surveillance, include, but not limited to, no-human,
`human-towards, human-away, crowd-towards, crowd-away,
`and crowd-stop.
`Given the event status related to vehicle parking being
`defined continuously by the IPCCU307 for each carpark cell,
`the real-time parking status of the entire car park can be
`derived and stored in the database of the central controller
`301,303. This information of the carpark status is updated on
`a regular time interval to facilitate accurate retrieval of infor
`mation when needed.
`Status related to vehicles parking includes, but not limited
`to,
`1. Number of vacant lots in the car park
`2. Location of a vacant lot by its lot ID
`
`10
`
`15
`
`30
`
`35
`
`40
`
`45
`
`50
`
`60
`
`65
`
`

`

`Case 1:20-cv-03156-PGG Document 1-1 Filed 04/21/20 Page 10 of 13
`
`US 7,893,848 B2
`
`10
`
`15
`
`8
`The camera sensor network provides image/data acquisi
`tion by cameras 311, 317 installed to cover one or more car
`park lots 335. Some cameras 311,317 are installed for moni
`toring the lanes or other non-parking areas within the carpark
`to provide value added services mentioned above.
`For multi-cameras deployment, at least one video
`switches/multiplexers 309.321,323 is required to channel the
`images to the IPCCUs 307. For single camera deployment,
`images can be streamed directly to the IPCCU 307 or the
`Central Controllers 301, 303. In the case of single camera
`deployment the use of video switch/multiplexer 309, 321,
`323 becomes optional.
`Some or all the cameras 311, 317 can be mounted on PTZ
`platforms, if necessary. The means to control these PTZ plat
`forms may be a function of the cameras if the cameras are
`equipped with embedded microprocessors, or can be
`remotely controlled by the IPCCUs 307.
`Cameras 311, 317 built-in with an embedded micropro
`cessor, can be dynamically programmed to pre-evaluate the
`quality of each image taken, and intelligently adjust the PTZ
`to obtain additional images until an image with acceptable
`quality is found. If no acceptable image is obtained after a
`predefined period of time, the system proceeds to the next
`task and a notification is activated to prompt the operator for
`appropriate action.
`Some or all cameras 311, 317 can be high-performance
`cameras that are capable of monitoring the region of interest
`with some or none of the PTZ functions.
`Apart from cameras, it is possible to include other sensors
`in the system. The camera may also be network compatible,
`such that it can be interfaced directly to the IPCCU 307 or
`central controllers 301,303 via e.g. an IP network 304.
`The connection from the cameras 311,317 to the Switches/
`multiplexers 309.321,323, and from the switches/multiplex
`ers 309, 321, 323 to IPCCUs 307 can be either wired, or
`wireless 337,339.
`2. Image Processing and Camera Control Unit (IPCCU)
`A microprocessor-based system converts the images trans
`mitted from the video switches/multiplexers 309, 321, 323
`directly from the cameras 311, 317, and implements the pri
`mary features mentioned above.
`For each switch/multiplexer 309, 321, 323, one IPCCUs
`307 is be needed to process the images and channel the
`outcomes to the Central Controller 301, 303 of the embodi
`ment of the invention. If no switch/multiplexer 309, 321,323
`is deployed, the images will be channeled directly from the
`cameras to either the IPCCU 307 or the Central Controller
`301, 303. In the latter case, the Central Controller 301, 303
`assumes the role of the IPCCU 307.
`Each IPCCU 307 employs proprietary advanced adaptive
`self-learning image processing algorithms to perform real
`time identification/classification/location of vehicles 325,
`and real-time detection/location of vacant/occupied parking
`lots 335. The system also determines the identity of the
`vehicle at each occupied parking lot 335.
`If the cameras 311,317 are mounted on a PTZ platform do
`not have embedded microprocessors, the IPCCU 307
`assumes the role of controlling the PTZ platform.
`If the cameras 311, 317 or video switches/multiplexers
`309, 321, 323 have built-in embedded microprocessors, the
`embedded microprocessors could potentially perform the
`processing functions of the IPCCU307. In such case, there is
`no need for IPCCU 307.
`IPCCUS 307 communicates with the Central Controller
`301, 303 through either a wired, or a wireless network 304.
`
`7
`3. Location of a parked vehicle by its unique features
`4. Congestion level at a particular car park cell
`Status related to car park surveillance includes, but not
`limited to:
`1. Alert level of a particular car park cell based on density and
`pattern of movement
`2. Alert level of a particular parked vehicle based on unusual
`movement pattern around the vehicle
`With the above status parameters defined in real-time, the
`following services of the embodiment of the invention can be
`deployed:
`1. Parking vacancy locating system to assist the drivers to
`identify and locate vacant lots
`2. Parked vehicle locating system to assist the drivers to
`identify and locate their parked vehicles
`3. Parking reservation system to allow remote booking of
`vacant parking lots
`4. Parking enforcement system to prevent illegal parking or
`use of facility
`5. Intelligent car park Surveillance system to detect unusual
`events in the car park, for example: noticeable Sweating,
`loitering,