Granted Patent B2

US 12,272,095 · App. 17/787,391 · Granted Apr 8, 2025

Inventors: Matthieu Fradet (Chanteloup, FR); Vincent Alleaume (Pace, FR); Anthony Laurent (Vignoc, FR); Philippe Robert (Rennes, FR)

Assignee: InterDigital CE Patent Holdings

G06T7/74

Abstract

Claims (52)

1. A method comprising in at least one hardware processor of a user device:

sending, upon determination that the user device is not localized, a message to a server, the message indicating that the user device is not localized and including at least one of an indication of the position of the user device or an identifier of a network device to which the user device is directly connected;

obtaining at least one keyframe, the at least one keyframe being an image of a position in an environment that could enable localization of the user device;

displaying the at least one keyframe on a screen;

capturing by a camera an image of the environment;

sending a localization request including the image to the server; and

obtaining, from the server in response to the localization request, a localization result based on at least one feature of the at least one displayed keyframe and the image captured by the camera.

2. The method of claim 1 , wherein the localization request further includes an indication of the at least one keyframe displayed when the image was captured or just before the at least one displayed keyframe was changed.

3. The method of claim 1 , wherein the at least one keyframe obtained by the at least one hardware processor is based at least on the indication of the position of the user device, wherein each keyframe is associated with a position and wherein the at least one displayed keyframe is associated with a position essentially matching a current position of the user device.

4. The method of claim 1 , wherein the at least one hardware processor obtains the localization result by performing localization based on at least one feature of at least one keyframe and the image.

5. The method of claim 1 , wherein a plurality of keyframes are obtained, wherein a subset of the keyframes is displayed at a given time and wherein the method further comprises displaying a different subset of the keyframes after a given time period, upon reception by a user interface of a dedicated command, or upon detection of a gesture captured by a camera.

6. The method of claim 1 , wherein the at least one keyframe is obtained from the server.

7. The method of claim 1 , further comprising receiving user instructions to localize the user device.

8. The method of claim 1 , further comprising:

comparing the image and the at least one keyframe displayed on the screen; and

in case of a positive comparison, performing at least one of: informing a user of the user device of the positive comparison and launching localization in response to the positive comparison.

9. The method of claim 1 , wherein the environment comprises a plurality of rooms, wherein the method further comprises obtaining an identifier of a current room and wherein the at least one displayed keyframe is of the current room.

10. A user device comprising:

a screen;

a camera; and

at least one hardware processor configured to:

send, upon determination that the user device is not localized, a message to a server, the message indicating that the user device is not localized and including at least one of an indication of the position of the user device or an identifier of a network device to which the user device is directly connected;

obtain at least one keyframe, the at least one keyframe being an image of a position in an environment that could enable localization of the user device;

display the at least one keyframe on a screen;

capture by the camera an image of the environment;

send a localization request including the image to the server; and

obtain, from the server in response to the localization request, a localization result based on at least one feature of the at least one displayed keyframe and the image captured by the camera.

11. The user device of claim 10 , wherein the localization request further includes an indication of the at least one keyframe displayed when the image was captured or just before the at least one displayed keyframe was changed.

12. The user device of claim 10 , wherein the at least one hardware processor is configured to obtain the localization result by performing localization based on at least one feature of at least one keyframe and the image.

13. The user device of claim 10 , wherein a plurality of keyframes are obtained, and wherein the at least one hardware processor is configured to display a subset of the keyframes at a given time, and to display a different subset of the keyframes after a given time period, upon reception by a user interface of a dedicated command, or upon detection of a gesture captured by a camera.

14. The user device of claim 10 , wherein the at least one hardware processor is configured to:

compare the image and the at least one keyframe displayed on the screen; and

in case of a positive comparison, at least one of: inform a user of the user device of the positive comparison and launch localization in response to the positive comparison.

15. The user device of claim 10 , wherein the at least one keyframe obtained by the at least one hardware processor is based at least on the indication of the position of the user device, wherein each keyframe is associated with a position and wherein the at least one displayed keyframe is associated with a position essentially matching a current position of the user device.

16. The user device of claim 10 , wherein the at least one keyframe is obtained from the server.

17. The user device of claim 10 , wherein the at least one hardware processor is further configured to receive user instructions to localize the user device.

18. A server device comprising:

a communication interface configured to communicate with a user device; and

at least one hardware processor configured to:

receive from the user device a message indicating that the user device is not localized;

select and send at least one keyframe to the user device, the at least one keyframe being an image of a position in an environment that could enable localization of the user device;

receive an image from the user device;

obtain a localization result based on at least one feature of at least one keyframe and the image received from the user device; and

send the localization result to the user device.

19. A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one hardware processor to:

send, upon determination that a user device is not localized, a message to a server, the message indicating that the user device is not localized and including at least one of an indication of the position of the user device or an identifier of a network device to which the user device is directly connected;

obtain at least one keyframe, the at least one keyframe being an image of a position in an environment that could enable localization of the user device;

display the at least keyframe on a screen;

capture by a camera an image of the environment;

send a localization request including the image to the server; and

obtain, from the server in response to the localization request, a localization result based on at least one feature of at least one displayed keyframe and the image captured by the camera.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the at least one keyframe obtained by the at least one hardware processor is based at least on the indication of the position of the user device, wherein each keyframe is associated with a position and wherein the at least one displayed keyframe is associated with a position essentially matching a current position of the user device.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (33)