IP Library Granted Patent US 9,829,559
Granted Patent B2
US 9,829,559 · App. 15/007,614 · Granted Nov 28, 2017

Independent beacon based light position system

Inventors: Aaron Ganick (Boxford, MA); Daniel Ryan (San Francisco, CA)
Assignee: ABL IP HOLDING LLC
G01S1/70G01S5/0252G01S5/16H04B10/116H04B10/60H04L25/4902H04N5/23206H04N5/3532H04N5/374H04N7/183H04W4/023G01S5/0263G01S19/48
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,829,559
App. No.
15/007,614
Granted
Nov 28, 2017
Kind
B2
Abstract

Systems an methods are provided that disclose providing a positioning service for devices based on light received from one or more light sources. This light based positioning service uses light information transmitted by each light source to determine the position of the device. The positioning information can include three dimension position information in a building that can then be used to deliver services and information to a mobile device. The content delivered to a mobile device can include multimedia, text, audio, and/or pictorial information. The positioning information along with other location or positioning information can be used in providing augmented reality or location aware services. The light sources can be independent beacons that broadcast information in visible light at a rate that is undetectable by the human eye. Content can be retrieved from a server over a communications connection.

Claims (72)

1. A mobile device, comprising:

an image sensor;

a wireless interface configured to communicate through a network over a wireless medium;

a processor coupled to the image sensor and the wireless interface;

a memory; and

software in the memory to be run by the processor, wherein running of the software by the processor configures the mobile device to perform functions, including functions to:

operate the image sensor to capture an image of at least two visible light sources in an indoor location including a modulated visible light signal transmitted by one of the at least two visible light sources of an indoor location;

using the captured image, demodulate the modulated visible light signal transmitted by the one visible light source;

based on the demodulated visible light signals, determine a light source identifier corresponding to the one visible light source;

retrieve position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresponding to the light source identifier and of other light sources; and

calculate, by applying photogrammetric image processing techniques to the image of the at least two light sources and the position coordinates of the at least two light sources, coordinates for a position of the mobile device relative in the indoor location.

2. The mobile device of claim 1 , wherein the mobile device when retrieving position information is further configured by the software running on the processor, to:

transmit, via the wireless interface, a request to a server requesting position information corresponding to the determined light source identifier; and

receive, via the wireless interface, position information corresponding to the determined light source identifier.

3. The mobile device of claim 1 , further comprises:

indoor location information stored in the memory, the indoor location information including a map of the indoor location, light source identifiers, and position information of light sources within the indoor location, wherein:

the mobile device when retrieving position information is further configured by the software running on the processor, to:

access the indoor location information stored in the memory; and

retrieve position information corresponding to the determined light source identifier.

4. The mobile device of claim 1 , wherein:

the mobile device, when demodulating the visible light signals is further configured by the software running on the processor, to:

apply a threshold to the captured image to isolate regions of brighter pixels in the image, wherein the at least two light sources appear in brighter regions of pixels than other pixels in the captured image;

in response to isolating the brighter regions of pixels in the captured image, independently process each of the isolated brighter regions as corresponding to each of the at least two light sources to determine the visible light signal transmitted by the respective light sources.

5. The mobile device of claim 1 , further comprising:

a display device;

a map of the indoor location stored in the memory; and

wherein running of the software by the processor configures the mobile device to implement functions, including functions to:

retrieve the map of the indoor location in which the mobile device is located; and

present, on the display device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

6. The mobile device of claim 1 , wherein the image sensor is a rolling shutter camera.

7. The mobile device of claim 1 , wherein the image sensor is a charge-coupled device.

8. A method, comprising:

operating an image sensor of the mobile device to capture an image of at least two visible light signals in an outdoor location including a modulated visible light signal transmitted by at least two visible light source of an indoor location;

demodulating the modulated visible light signal transmitted by one of the at least two visible light source using the captured image;

determining a light source identifier corresponding to the one of at least two visible light source based on the demodulated visible light signals;

retrieving position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresponding to the light source identifier and of other light sources; and

calculating, by applying photogrammetric image processing techniques to the image of the at least two light sources and the position coordinates of the three light sources, coordinates for a position of the mobile device relative in the indoor location.

9. The method of claim 8 , wherein retrieving position information further comprises:

transmitting, via a wireless interface configured to communicate through a network over a wireless medium, a request to a server, the request requesting position information corresponding to each of the determined light source identifier; and

receiving, via the wireless interface, position information corresponding to the determined light source identifiers.

10. The method of claim 8 , further comprises:

accessing indoor location information stored in a memory of the mobile device, wherein the indoor location information includes a map of the indoor location, light source identifiers, and position information of light sources within the indoor location; and

retrieving position information from the accessed indoor location information corresponding to the determined light source identifier.

11. The method of claim 8 , wherein demodulating the visible light signals further comprises:

applying a threshold to the captured image to isolate regions of brighter pixels in the image, wherein the at least two light sources appear in brighter regions of pixels than other pixels in the captured image;

in response to isolating the brighter regions of pixels in the captured image, independently processing each of the isolated brighter regions as corresponding to each of the at least two light sources to determine the visible light signal transmitted by the respective light sources.

12. The method of claim 8 , further comprising:

retrieving, from a memory of the mobile device, a map of the indoor location in which the mobile device is located; and

presenting, on a display device of the mobile device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

13. The method of claim 8 , wherein the image sensor is a rolling shutter camera.

14. A non-transitory tangible computer readable medium embodying instructions to cause a mobile device to perform functions, including functions to:

operate an image sensor of the mobile device to capture an image of at least two visible light signal in an outdoor location including a modulated visible light signal transmitted by one of at least one visible light source of an indoor location;

demodulate the modulated visible light signal transmitted by the one of the at least two visible light source using the captured image;

determine a light source identifier corresponding to the one visible light source based on the demodulated visible light signals;

retrieve position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresponding to the light source identifier and of other light sources; and

calculate, by applying photogrammetric image processing techniques to the image of the at least two light sources and the position coordinates of the at least two light sources, coordinates for a position of the mobile device relative in the indoor location.

15. The non-transitory tangible computer readable medium of claim 14 , wherein retrieving position information is further comprises:

transmit, via a wireless interface configured to communicate through a network over a wireless medium, a request to a server, the request requesting position information corresponding to each determined light source identifier; and

receive, via the wireless interface, position information corresponding to the determined light source identifiers.

16. The non-transitory tangible computer readable medium of claim 14 , further comprises:

access indoor location information stored in a memory of the mobile device, wherein the indoor location information includes a map of the indoor location, light source identifiers, and position information of light sources within the indoor location; and

retrieve position information from the accessed indoor location information corresponding to the determined light source identifier.

17. The non-transitory tangible computer readable medium of claim 14 , wherein demodulating the visible light signals further comprises:

apply a threshold to the captured image to isolate regions of brighter pixels in the image, wherein the three light sources appear in brighter regions of pixels than other pixels in the captured image;

in response to isolating the brighter regions of pixels in the captured image, independently process each of the isolated brighter regions as corresponding to each visible light source to determine the visible light signal transmitted by the respective light sources.

18. The non-transitory tangible computer readable medium of claim 14 , further comprising:

retrieve, from a memory of the mobile device, a map of the indoor location in which the mobile device is located; and

present, on a display device of the mobile device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

19. The non-transitory tangible computer readable medium of claim 14 , further comprising:

retrieve, from a memory of the mobile device, a map of the indoor location in which the mobile device is located; and

present, on a display device of the mobile device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

20. The non-transitory tangible computer readable medium of claim 14 , wherein the image sensor is a rolling shutter camera.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2016
From: BYTELIGHT, INC.
To: ABL IP HOLDING LLC
Reel/Frame 037701/0503 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2016
From: GANICK, AARON; RYAN, DANIEL
To: BYTELIGHT, INC.
Reel/Frame 037675/0080 →
Continuity (4)
Continuation 13369144 · Feb 8, 2012
Provisional Application 61567484 · Dec 6, 2011
Provisional Application 61511589 · Jul 26, 2011
Related Publication 20160139232A1 · May 19, 2016