IP Library Granted Patent US 11,933,621
Granted Patent B2
US 11,933,621 · App. 17/495,020 · Granted Mar 19, 2024

Providing a location of an object of interest

Inventors: Sumeet Kumar Sahu (Bangalore, IN); Vishnu Vardhan Kasilya Sudarsan (Bangalore, IN); Tapan Kumar Sahu (Bangalore, IN)
Assignee: QUALCOMM Incorporated
G01C21/3476G01C21/3484G01C21/3623G06T7/73G06T11/00G06V10/95G06V20/00G06V40/20G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,933,621
App. No.
17/495,020
Granted
Mar 19, 2024
Kind
B2
Abstract

Methods for providing a location of an object or objects of interest that may be performed by a processor of a computing device may include generating a map of an environment around the computing device by a first simultaneous location and mapping (SLAM) operation using information received from the optical sensor, identifying an object of interest in the environment of the computing device by an object recognition operation using information received from the optical sensor, determining a location of the object or objects of interest in the environment, and presenting the determined location of the object or objects of interest in the environment in response to a trigger event correlated to the object or objects of interest.

Claims (74)

1. A method performed by a computing device configured with an optical sensor for providing a location of an object of interest, comprising:

generating a map of an environment around the computing device by a first simultaneous location and mapping (SLAM) operation using information received from the optical sensor;

identifying an object of interest in the environment of the computing device by an object identification operation using information received from the optical sensor;

determining a current location of the object of interest in the environment;

receiving an indication that the object of interest has relocated to a second location in the environment;

updating the current location using the second location of the object of interest;

determining whether the computing device is not authorized to disclose the second location of the object of interest; and

presenting an indication that the computing device is not authorized to disclose the second location of the object of interest in response to determining that the computing device is not authorized to disclose the second location of the object of interest.

2. The method of claim 1 , wherein:

generating the map of an environment around the computing device by the first SLAM operation using information received from an optical sensor of the computing device comprises identifying features of the environment around the computing device from the information received from the optical sensor and determining a position of the identified features; and

identifying an object of interest in the environment of the computing device by an object recognition operation using information received from the optical sensor comprises identifying the object of interest while identifying features of the environment around the computing device from the information received from the optical sensor and determining the position of the identified features to generate the map.

3. The method of claim 1 , wherein determining the current location of the object of interest in the environment comprises assigning to the object of interest coordinates, grid points, or mesh points within the map generated by the first SLAM operation.

4. The method of claim 1 , wherein presenting the determined current location of the object of interest in the environment comprises generating a navigation path from a current location of the computing device to the location of the object of interest within the map generated by the first SLAM operation.

5. The method of claim 1 , wherein presenting the determined current location of the object of interest in the environment comprises displaying an approximate distance from a current location of the computing device to the location of the object of interest.

6. The method of claim 1 , wherein presenting the determined current location of the object of interest in the environment comprises displaying an indication of a direction to the location of the object of interest from a current location of the computing device.

7. The method of claim 1 , wherein the trigger event for presenting the current location of the object of interest comprises a user input received by the computing device requesting the location of the object of interest.

8. The method of claim 1 , further comprising correlating the object of interest in the environment with a user action or behavior, wherein the trigger event for presenting the location of the object of interest comprises detecting an occurrence of the user action or behavior.

9. The method of claim 1 , further comprising correlating the object of interest in the environment with a user location, wherein the trigger event for presenting the location of the object of interest comprises detecting a user at or leaving a location.

10. The method of claim 1 , further comprising correlating the object of interest in the environment with a user action or behavior and another condition, wherein the trigger event for presenting the current location of the object of interest comprises detecting an occurrence of the user action or behavior in conjunction with occurrence of the other condition.

11. The method of claim 1 , wherein the trigger event for presenting the current location of the object of interest comprises a time trigger or a date trigger.

12. The method of claim 1 , further comprising:

correlating a plurality of objects of interest with a user behavior or action;

determining locations of each of the plurality of objects of interest in response to detecting the user behavior or action; and

displaying a location of any of the plurality of objects of interest that is not located with a user.

13. The method of claim 1 , wherein identifying an object of interest in the environment of the computing device by an object recognition operation using information received from the optical sensor comprises:

applying images of objects identified in the environment of the computing device to a trained neural network configured to provide as an output identifications of objects of interest; and

determining a current location in the environment of the object of interest provided as output by the trained neural network.

14. The method of claim 1 , wherein determining whether the computing device is not authorized to disclose the second location of the object of interest comprises:

identifying a source of the indication that the object of interest has been relocated to the second location; and

determining whether the source of the indication that the object of interest has been relocated to the second location is authorized to disclose the second location.

15. The method of claim 14 , wherein the source of the indication that the object of interest has been relocated to the second location is a second computing device configured with an optical sensor.

16. A computing device, comprising:

an optical sensor;

a display; and

a processor coupled to the optical sensor and the display, and configure to:

generate a map of an environment around the computing device by a first simultaneous location and mapping (SLAM) operation using information received from the optical sensor;

identify an object of interest in the environment of the computing device by an object identification operation using information received from the optical sensor;

determine a current location of the object of interest in the environment;

receive an indication that the object of interest has been relocated to a second location in the environment;

update the current location using the second location of the object of interest;

determine whether the computing device is not authorized to disclose the second location of the object of interest; and

present an indication that the computing device is not authorized to disclose the second location of the object of interest in response to determining that the computing device is not authorized to disclose the second location of the object of interest.

17. The computing device of claim 16 , wherein the processor is further configured to:

generate the map of an environment around the computing device by the first SLAM operation using information received from an optical sensor of the computing device by identifying features of the environment around the computing device from the information received from the optical sensor and determining a position of the identified features; and

identify an object of interest in the environment of the computing device by an object recognition operation using information received from the optical sensor by identifying the object of interest while identifying features of the environment around the computing device from the information received from the optical sensor and determining the position of the identified features to generate the map.

18. The computing device of claim 16 , wherein the processor is further configured to determine the current location of the object of interest in the environment by assigning to the object of interest coordinates, grid points, or mesh points within the map generated by the first SLAM operation.

19. The computing device of claim 16 , wherein the processor is further configured to present the determined current location of the object of interest in the environment by generating a navigation path from a current location of the computing device to the location of the object of interest within the map generated by the first SLAM operation.

20. The computing device of claim 16 , wherein the processor is further configured to present the determined current location of the object of interest in the environment by generating a navigation path from a current location of the computing device to the location of the object of interest within the map generated by the first SLAM operation.

21. The computing device of claim 16 , wherein the processor is further configured to present the determined current location of the object of interest in the environment by generating a navigation path from a current location of the computing device to the location of the object of interest within the map generated by the first SLAM operation.

22. The computing device of claim 16 , wherein the trigger event for presenting the current location of the object of interest comprises a user input received by the computing device requesting the location of the object of interest.

23. The computing device of claim 16 , wherein the processor is further configured to correlate the object of interest in the environment with a user action or behavior, wherein the trigger event for presenting the location of the object of interest comprises the processor detecting an occurrence of the user action or behavior.

24. The computing device of claim 16 , wherein the processor is further configured to correlate the object of interest in the environment with a user location, wherein the trigger event for presenting the current location of the object of interest comprises detecting a user at or leaving a location.

25. The computing device of claim 16 , wherein the processor is further configured to correlate the object of interest in the environment with a user action or behavior and another condition, wherein the trigger event for presenting the current location of the object of interest comprises the processor detecting an occurrence of the user action or behavior in conjunction with occurrence of the other condition.

26. The computing device of claim 16 , wherein the trigger event for presenting the current location of the object of interest comprises a time trigger or a date trigger.

27. The computing device of claim 16 , wherein the processor is further configured to:

correlate a plurality of objects of interest with a user behavior or action;

determine locations of each of the plurality of objects of interest in response to detecting the user behavior or action; and

display a location of any of the plurality of objects of interest that is not located with a user.

28. The computing device of claim 16 , wherein the processor is further configured to identify an object of interest in the environment of the computing device by an object recognition operation using information received from the optical sensor by:

applying images of objects identified in the environment of the computing device to a trained neural network configured to provide as an output identifications of objects of interest; and

determining a location in the environment of the object of interest provided as output by the trained neural network.

29. The computing device of claim 16 , wherein the processor coupled to the optical sensor and the display, is further configured to determine whether the computing device is not authorized to disclose the second location of the object of interest by:

identifying a source of the indication that the object of interest has been relocated to the second location; and

determining whether the source of the indication that the object of interest has been relocated to the second location is authorized to disclose the second location.

30. The computing device of claim 4 , wherein the source of the indication that the object of interest has been relocated to the second location is a second computing device configured with an optical sensor.

31. A computing device, comprising:

an optical sensor;

means for generating a map of an environment around the computing device by a first simultaneous location and mapping (SLAM) operation using information received from the optical sensor;

means for identifying an object of interest in the environment of the computing device by an object identification operation using information received from the optical sensor;

means for determining a current location of the object of interest in the environment;

means for receiving an indication that the object of interest has been relocated to a second location in the environment;

means for updating the current location using the second location of the object of interest;

means for determining whether the computing device is not authorized to disclose the second location of the object of interest; and

means for presenting an indication that the computing device is not authorized to disclose the second location of the object of interest in response to determining that the computing device is not authorized to disclose the second location of the object of interest.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2022
From: SAHU, SUMEET KUMAR; KASILYA SUDARSAN, VISHNU VARDHAN; SAHU, TAPAN KUMAR
To: QUALCOMM INCORPORATED
Reel/Frame 058555/0876 →
Continuity (1)
Related Publication 20230123242A1 · Apr 20, 2023