IP Library Granted Patent US 11,528,452
Granted Patent B2
US 11,528,452 · App. 14/982,584 · Granted Dec 13, 2022

Indoor positioning system using beacons and video analytics

Inventors: Gábor Törös (BudaPest, HU); Tamás Varjasi (BudaPest, HU); István Maros (BudaPest, HU); Roland Bátai (BudaPest, HU)
Assignee: CURRENT LIGHTING SOLUTIONS, LLC
H04N7/181G01S5/0257G06V20/52H04W4/029G01S5/16G06K9/6293H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,528,452
App. No.
14/982,584
Granted
Dec 13, 2022
Kind
B2
Abstract

A method and system, the method including transmitting a unique identifier of at least one radio frequency (RF) transmitter to a device in a vicinity of the RF transmitter; acquiring images of objects by a vision system, the vision system comprising at least one image capturing device and an image processing unit to determine objects in the images acquired by the image capturing device; determining, by a controller, a location of the device based on, at least in part, the unique identifier of one of the at least one RF transmitters; and determining, by the controller, a precise location of the device based on a correlation between the location of the device determined based on the unique identifier and the objects captured in the images acquired by the image capturing device.

Claims (41)

1. A system comprising:

at least one radio frequency (RF) transmitter to transmit a unique identifier thereof to a mobile device in a vicinity of the RF transmitter;

a vision system comprising at least two image capturing devices disposed external to the mobile device and an image processing unit to identify objects captured in images acquired by the at least two image capturing devices, the at least two image capturing devices being registered or calibrated to a reference coordinate system; and

a controller remote from the mobile device, the controller to:

process a unique identifier of one of the at least one RF transmitters received from the mobile device,

determine a rough location estimate of the mobile device based, at least in part, on the unique identifier of the one of the at least one RF transmitters,

identify a plurality of objects in the captured images, at least one of the plurality of objects comprising the mobile device, and

determine a precise location estimate of the mobile device and determine which of the plurality of objects in the captured images comprises the mobile device based on a correlation between the location of the mobile device determined based on the unique identifier and the objects captured in the images acquired by the at least two image capturing devices,

wherein at least a portion of one or more first operations to determine the rough location estimate are performed in parallel with at least a portion of one or more second operations to determine the precise location estimate.

2. The system of claim 1 , wherein each of the at least one RF transmitter is located at a known position.

3. The system of claim 1 , wherein the at least one RF transmitter and the vision system are located in a predetermined area to be monitored by the at least one RF transmitter and the vision system, wherein the vision system is capable of detecting objects within the entire monitored area.

4. The system of claim 1 , wherein location information associated with the objects captured in the images acquired by the at least two image capturing devices is transmitted to the controller.

5. The system of claim 4 , wherein the location information comprises coordinates of the objects captured in the images relative to the reference coordinate system to which the at least two image capturing devices is associated.

6. The system of claim 1 , wherein the at least one RF transmitter comprises a directional radiating element, and wherein the at least one directional radiating element comprises one of a planar patch antenna, a helical antenna, a Yagi antenna and an array of a plurality thereof.

7. The system of claim 1 , further comprising at least one beacon comprising the at least one radio frequency (RF) transmitter, wherein the at least one beacon is deployed or installed on or suspended from a ceiling of an indoor area being monitored.

8. The system of claim 1 , wherein the objects are persons carrying or wearing the device or are machines to which the device is attached or affixed.

9. A method comprising:

transmitting a unique identifier of at least one radio frequency (RF) transmitter to a device in a vicinity of the RF transmitter;

acquiring images of objects by a vision system, at least one of the objects comprising a mobile device, the vision system comprising at least two image capturing devices disposed external to the mobile device and an image processing unit to identify objects in the images acquired by the at least two image capturing devices, the at least two image capturing devices being registered or calibrated to a reference coordinate system prior to acquiring the images;

processing, by a controller remote from the mobile device, a unique identifier of one of the at least one RF transmitters received from the mobile device;

determining, by the controller:

a rough location estimate of the mobile device based on, at least in part, the unique identifier of the one of the at least one RF transmitters,

a plurality of objects in the captured images, at least one of the plurality of objects comprising the mobile device, and

a precise location estimate of the mobile device and determining which of the plurality of objects in the captured images comprises the mobile device based on a correlation between the location of the mobile device determined based on the unique identifier and the objects captured in the images acquired by the at least two image capturing devices,

wherein at least a portion of one or more first operations to determine the rough location estimate are performed in parallel with at least a portion of one or more second operations to determine the precise location estimate.

10. The method of claim 9 , wherein the at least one RF transmitter transmits a Bluetooth® low energy signal.

11. The method of claim 9 , wherein each of the at least one RF transmitter is located at a known position.

12. The method of claim 9 , wherein the at least one RF transmitter comprises a plurality of RF transmitters.

13. The method of claim 9 , wherein the at least one RF transmitter and the vision system are located in a predetermined area to be monitored by the at least one RF transmitter and the vision system, wherein the vision system is capable of detecting objects within the entire monitored area.

14. The method of claim 9 , further comprising transmitting location information associated with the objects captured in the images acquired by the at least two image capturing devices to the controller.

15. The method of claim 14 , wherein the location information comprises coordinates of the objects captured in the images relative to a reference coordinate system to which the at least two image capturing devices is associated.

16. The method of claim 9 , wherein the objects are persons carrying or wearing the device or are machines to which the device is attached or affixed.

17. A system comprising:

at least one beacon comprising at least one radio frequency (RF) transmitter to transmit a unique identifier thereof to a mobile device in a vicinity of the RF transmitter, wherein the at least one beacon is deployed or installed on or suspended from a ceiling of an indoor area being monitored;

a vision system comprising at least one image capturing system disposed external to the mobile device and an image processing unit to identify at least one object captured in images acquired by the image capturing system, wherein the at least one object is a person carrying or wearing the device or is a machine to which the mobile device is attached or affixed, the at least one image capturing device registered or calibrated to a reference coordinate system; and

a controller remote from the mobile device, the controller to:

process a unique identifier of one of the at least one RF transmitters received from the mobile device,

determine a rough location estimate of the mobile device based, at least in part, on the unique identifier of the one of the at least one RF transmitters,

identify a plurality of objects in the captured images, at least one of the plurality of objects comprising the mobile device, and

determine a precise location estimate of the mobile device and determine which of the plurality of objects in the captured images comprises the mobile device based on a correlation between the location of the mobile device determined based on the unique identifier and the at least one object captured in the images acquired by the image capturing system,

wherein at least a portion of one or more first operations to determine the rough location estimate are performed in parallel with at least a portion of one or more second operations to determine the precise location estimate.

Assignments (12)
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER PREVIOUSLY RECORDED AT REEL: 059034 FRAME: 0469. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 25, 2024
From: HUBBELL LIGHTING, INC.; LITECONTROL CORPORATION; CURRENT LIGHTING SOLUTIONS, LLC; DAINTREE NETWORKS INC.; FORUM, INC.
To: ATLANTIC PARK STRATEGIC CAPITAL FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 066372/0590 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER 10841994 TO PATENT NUMBER 11570872 PREVIOUSLY RECORDED ON REEL 058982 FRAME 0844. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT. Recorded Jan 19, 2024
From: HUBBELL LIGHTING, INC.; LITECONTROL CORPORATION; CURRENT LIGHTING SOLUTIONS, LLC; DAINTREE NETWORKS INC.; FORUM, INC.
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 066355/0455 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2022
From: ALLY BANK
To: CURRENT LIGHTING SOLUTIONS, LLC; FORUM, INC.
Reel/Frame 059392/0079 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2022
From: ALLY BANK
To: CURRENT LIGHTING SOLUTIONS, LLC; FORUM, INC.
Reel/Frame 059432/0592 →
SECURITY INTEREST Recorded Feb 11, 2022
From: HUBBELL LIGHTING, INC.; LITECONTROL CORPORATION; CURRENT LIGHTING SOLUTIONS, LLC; DAINTREE NETWORKS INC.; FORUM, INC.
To: ATLANTIC PARK STRATEGIC CAPITAL FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 059034/0469 →
SECURITY AGREEMENT Recorded Feb 2, 2022
From: HUBBELL LIGHTING, INC.; LITECONTROL CORPORATION; CURRENT LIGHTING SOLUTIONS, LLC; DAINTREE NEETWORKS INC.; FORUM, INC.
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 058982/0844 →
SECURITY AGREEMENT Recorded May 27, 2020
From: CURRENT LIGHTING SOLUTIONS, LLC
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 052763/0643 →
SECURITY AGREEMENT Recorded Jun 28, 2019
From: CURRENT LIGHTING SOLUTIONS, LLC
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 049672/0294 →
SECURITY AGREEMENT Recorded Jun 28, 2019
From: CURRENT LIGHTING SOLUTIONS, LLC
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 051047/0210 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2019
From: GENERAL ELECTRIC COMPANY
To: CURRENT LIGHTING SOLUTIONS, LLC F/K/A GE LIGHTING SOLUTIONS, LLC
Reel/Frame 048791/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2016
From: TÖRÖS, GÁBOR; VARJASI, TAMÁS; MAROS, ISTVÁN; BÁTAI, ROLAND
To: GE HUNGARY KFT.
Reel/Frame 038698/0046 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2016
From: GE HUNGARY KFT.
To: GENERAL ELECTRIC COMPANY
Reel/Frame 038698/0102 →
Continuity (1)
Related Publication 20170187991A1 · Jun 29, 2017