IP Library › Granted Patent US 11,163,379
Granted Patent B2
US 11,163,379 · App. 16/480,422 · Granted Nov 2, 2021

Illuminating an environment for localisation

Inventors: José Araújo (Stockholm, SE); Zeid Al-Husseiny (Stockholm, SE); Lars Andersson (Solna, SE)
Assignee: Telefonaktiebolaget LM Ericsson (publ)
G06F3/0304G06K9/00664G06K9/2027H04N13/254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,163,379
App. No.
16/480,422
Filed
Jul 24, 2019
Granted
Nov 2, 2021
Kind
B2
Art Unit
2665
USPC
382/103
Abstract

It is presented a method for illuminating an environment for localisation of a user device comprising a light source and at least one camera. The method is performed in an illumination determiner. The method includes determining a need for adjusting illumination, determining a field of view of the at least one camera of the user device, and obtaining environment data for elements within the field of view from previously stored environment data. The method also includes selecting at least one key element of the elements, and adjusting illumination of at least a subset of the at least one key element by adapting a light source.

Claims (60)

1. A method for illuminating an environment for localisation of a user device comprising a light source and at least one camera, the method being performed in an illumination determiner and comprising:

determining a need for adjusting illumination;

determining a field of view of the at least one camera of the user device;

obtaining environment data for elements within the field of view from previously stored environment data;

selecting at least one key element of the elements, wherein key elements are of greater importance for simultaneous localisation and mapping, SLAM, than non-key elements, and wherein selecting the at least one key element comprises ranking the elements according to importance for SLAM and selecting a number of the highest ranked elements; and

adjusting illumination of at least a subset of the at least one key element by adapting a light source.

2. The method according to claim 1 , wherein adjusting illumination comprises matching the illumination with an illumination applied for the stored data of the at least a subset of the at least one key element.

3. The method according to claim 1 , further comprising:

determining, for each key element, whether a level of illumination of the key element needs to be adjusted;

and wherein adjusting illumination comprises only adjusting the illumination for any key element for which illumination needs to be adjusted.

4. The method according to claim 1 , wherein adjusting illumination comprises directing the light source.

5. A method for illuminating an environment for localisation of a user device comprising a light source and at least one camera, the method being performed in an illumination determiner and comprising:

determining a need for adjusting illumination;

determining a field of view of the at least one camera of the user device;

obtaining environment data for elements within the field of view from previously stored environment data;

selecting at least one key element of the elements;

adjusting illumination of at least a subset of the at least one key element by adapting a light source

inactivating illumination once the user device has been positioned; and

entering a sleep state for a sleep period before the method is repeated.

6. An illumination determiner for illuminating an environment for localisation of a user device comprising a light source and at least one camera, the illumination determiner comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the illumination determiner to:

determine a need for adjusting illumination;

determine a field of view of the at least one camera of the user device;

obtain environment data for elements within the field of view from previously stored environment data;

select at least one key element of the elements, wherein key elements are of greater importance for simultaneous localisation and mapping, SLAM, than non-key elements, and wherein selecting the at least one key element comprises ranking the elements according to importance for SLAM and selecting a number of the highest ranked elements; and

adjust illumination of at least a subset of the at least one key element by adapting a light source.

7. The illumination determiner according to claim 6 , wherein the instructions to adjust illumination comprise instructions that, when executed by the processor, cause the illumination determiner to turn on the light source.

8. The illumination determiner according to claim 6 , wherein the instructions to adjust illumination comprise instructions that, when executed by the processor, cause the illumination determiner to match the illumination with an illumination applied for the stored data of the at least a subset of the at least one key element.

9. The illumination determiner according to claim 6 , wherein the instructions to determine a need for light source adaptation comprise instructions that, when executed by the processor, cause the illumination determiner to consider illumination from a light source of another user device.

10. The illumination determiner according to claim 6 , wherein the instructions to determine a need for light source adaptation comprise instructions that, when executed by the processor, cause the illumination determiner to determine a need for light source adaptation based on receiving a signal, from another user device, indicating a required change of light situation in the field of view.

11. The illumination determiner according to claim 6 , wherein the instructions to determine a field of view comprise instructions that, when executed by the processor, cause the illumination determiner to determine a field of view based on a pose of the at least one camera of the user device.

12. The illumination determiner according to claim 6 , wherein the instructions to adjust illumination comprise instructions that, when executed by the processor, cause the illumination determiner to direct the light source.

13. The illumination determiner according to claim 6 , further comprising instructions that, when executed by the processor, cause the illumination determiner to:

inactivate illumination once the user device has been positioned; and

enter a sleep state for a sleep period before the method is repeated.

14. An illumination determiner for illuminating an environment for localisation of a user device comprising a light source and at least one camera, the illumination determiner comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the illumination determiner to:

determine a need for adjusting illumination;

determine a field of view of the at least one camera of the user device;

obtain environment data for elements within the field of view from previously stored environment data;

select at least one key element of the elements;

predict movement of at least one of the user device and a key element to a location where light conditions are different from current light conditions; and

adjust illumination of at least a subset of the at least one key element by adapting a light source to gradually adjust intensity of the light source.

15. An illumination determiner:

a processor; and

a memory storing instructions that, when executed by the processor, cause the illumination determiner to:

determine a need for adjusting illumination;

determine a field of view of the at least one camera of the user device;

obtain environment data for elements within the field of view from previously stored environment data;

select at least one key element of the elements;

determine, for each key element, whether a level of illumination of the key element needs to be adjusted; and

adjust illumination of at least a subset of the at least one key element by adapting a light source to only adjust the illumination for any key element for which illumination needs to be adjusted.

16. A computer program product comprising computer readable means including a computer program stored thereon, wherein the computer program being provided to illuminate an environment for localisation of a user device comprising a light source and at least one camera, the computer program comprising computer program code which, when run on a illumination determiner causes the illumination determiner to:

determine a need for adjusting illumination;

determine a field of view of the at least one camera of the user device;

obtain environment data for elements within the field of view from previously stored environment data;

select at least one key element of the elements, wherein key elements are of greater importance for simultaneous localisation and mapping, SLAM, than non-key elements, and wherein selecting the at least one key element comprises ranking the elements according to importance for SLAM and selecting a number of the highest ranked elements; and

adjust illumination of at least a subset of the at least one key element by adapting a light source.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2019
From: AL-HUSSEINY, ZEID; ANDERSSON, LARS; ARAÚJO, JOSÉ
To: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
Reel/Frame 049846/0044 →
Continuity (1)
Related Publication 20190392240A1 · Dec 26, 2019