IP Library Granted Patent US 12,143,719
Granted Patent B2
US 12,143,719 · App. 18/470,702 · Granted Nov 12, 2024

Methods and devices to identify focal objects

Inventors: Darin K. Winterton (San Jose, CA); Donald Baxter (Stirling, GB); Andrew Hodgson (Edingburgh, GB); Gordon Lunn (Linlithgow, GB); Olivier Pothier (Sceaux, FR); Kalyan-Kumar Vadlamudi-Reddy (San Jose, CA)
Assignees: STMicroelectronics France; STMicroelectronics, Inc.; STMicroelectronics (Research & Development) Limited
H04N23/675H04N23/61H04N23/671
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,143,719
App. No.
18/470,702
Granted
Nov 12, 2024
Kind
B2
Abstract

A method includes dividing a field of view into a plurality of zones and sampling the field of view to generate a photon count for each zone of the plurality of zones, identifying a focal sector of the field of view and analyzing each zone to select a final focal object from a first prospective focal object and a second prospective focal object.

Claims (72)

1. A method, comprising:

dividing a field of view of a Time of Flight system into a plurality of zones;

sampling the field of view with the Time of Flight system to generate a photon count for each zone of the plurality of zones;

identifying a focal sector occupying a subset of the plurality of zones;

analyzing each zone of the plurality of zones within the focal sector to identify a first prospective focal object and a second prospective focal object;

determining a size of the first prospective focal object by analyzing a photon count for each zone of the plurality of zones to count each zone of the plurality of zones that captures an object within a threshold distance of the first prospective focal object;

determining a size of the second prospective focal object by analyzing the photon count for each zone of the plurality of zones to count each zone of the plurality of zones that captures an object within the threshold distance of the second prospective focal object;

selecting a final focal object from the first prospective focal object and the second prospective focal object by comparing the size of the first prospective focal object with the size of the second prospective focal object, the final focal object being located at a final focal object distance from the Time of Flight system; and

focusing a lens of a camera based on the final focal object distance.

2. The method of claim 1 , wherein the focal sector is identified based on user input or a predetermined parameter.

3. The method of claim 1 , further comprising adjusting the final focal object distance by averaging the final focal object distance with a distance of each object within a threshold distance of the final focal object in each zone of the plurality of zones where the final focal object is present.

4. The method of claim 1 , further comprising:

analyzing each zone of the plurality of zones within the focal sector to identify a third prospective focal object; and

determining a size of the third prospective focal object by analyzing the photon count for each zone of the plurality of zones to count each zone of the plurality of zones that captures an object within a threshold distance of the third prospective focal object, wherein the size of the third prospective focal object is compared with the size of the first prospective focal object and the size of the second prospective focal object to select the final focal object.

5. The method of claim 1 , further comprising:

determining that the final focal object distance is equal to a last distance previously outputted by the Time of Flight system; and

outputting the final focal object distance from the Time of Flight system to focus the lens of the camera.

6. The method of claim 1 , further comprising:

determining that that the final focal object distance does not equal a last distance previously outputted by the Time of Flight system;

determining that the final focal object distance is equal to a plurality of previously identified final focal object distances; and

outputting the final focal object distance to focus the lens of the camera.

7. The method of claim 1 , further comprising:

emitting, by an optical source, light into an environment;

detecting, by a plurality of light-sensitive pixels of an optical receiver, photons being reflected from the environment, the plurality of light-sensitive pixels arranged in a plurality of sections corresponding to the plurality of zones; and

directing, by an optical-receiver lens of the optical receiver, photons to the plurality of sections.

8. A method, comprising:

dividing a field of view of a Time of Flight System into a plurality of zones;

sampling the field of view with the Time of Flight system to generate a photon count for each zone of the plurality of zones;

identifying a focal sector occupying a subset of the plurality of zones;

identifying a first prospective focal object and a second prospective focal object;

determining a size of the first prospective focal object and a size of the second prospective focal object;

selecting a final focal object from the first prospective focal object and the second prospective focal object by comparing the size of the first prospective focal object with the size of the second prospective focal object, and wherein the final focal object is located at a final focal object distance from the Time of Flight system; and

focusing a lens of a camera depending on the final focal object.

9. The method of claim 8 , wherein the focal sector is identified based on user input or a predetermined parameter.

10. The method of claim 8 , further comprising adjusting the final focal object distance by averaging the final focal object distance with a distance of each object within a threshold distance of the final focal object in each zone of the plurality of zones where the final focal object is present.

11. The method of claim 8 , further comprising:

analyzing each zone of the plurality of zones within the focal sector to identify a third prospective focal object; and

determining a size of the third prospective focal object by analyzing the photon count for each zone of the plurality of zones to count each zone of the plurality of zones that captures an object within a threshold distance of the third prospective focal object, wherein the size of the third prospective focal object is compared with the size of the first prospective focal object and the size of the second prospective focal object to select the final focal object.

12. The method of claim 8 , further comprising:

determining that the final focal object distance is equal to a last distance previously outputted by the Time of Flight system; and

outputting the final focal object distance from the Time of Flight system to focus the lens of the camera.

13. The method of claim 8 , further comprising:

determining that that the final focal object distance does not equal a last distance previously outputted by the Time of Flight system;

determining that the final focal object distance is equal to a plurality of previously identified final focal object distances; and

outputting the final focal object distance to focus the lens of the camera.

14. The method of claim 8 further comprising:

emitting, by an optical source, light into an environment;

detecting, by a plurality of light-sensitive pixels of an optical receiver, photons being reflected from the environment, the plurality of light-sensitive pixels arranged in a plurality of sections corresponding to the plurality of zones; and

directing, by an optical-receiver lens of the optical receiver, photons to the plurality of sections.

15. A Time of Flight system, comprising:

a non-transitory memory storage comprising instructions; and

a processor in communication with the non-transitory memory storage, wherein the processor is configured to execute the instructions to:

divide a field of view of the Time of Flight System into a plurality of zones;

sample the field of view with the Time of Flight system to generate a photon count for each zone of the plurality of zones;

identify a focal sector occupying a subset of the plurality of zones;

identify a first prospective focal object and a second prospective focal object;

determine a size of the first prospective focal object and a size of the second prospective focal object;

select a final focal object from the first prospective focal object and the second prospective focal object by comparing a size of the first prospective focal object with a size of the second prospective focal object, and wherein the final focal object is located at a final focal object distance from the Time of Flight system; and

focus a lens of a camera depending on the final focal object.

16. The Time of Flight system of claim 15 , wherein the focal sector is identified based on user input or a predetermined parameter.

17. The Time of Flight system of claim 15 , wherein the processor is configured to execute the instructions to adjust the final focal object distance by averaging the final focal object distance with a distance of each object within a threshold distance of the final focal object in each zone of the plurality of zones where the final focal object is present.

18. The Time of Flight system of claim 15 , wherein the processor is configured to execute the instructions to:

analyze each zone of the plurality of zones within the focal sector to identify a third prospective focal object; and

determine a size of the third prospective focal object by analyzing the photon count for each zone of the plurality of zones to count each zone of the plurality of zones that captures an object within a threshold distance of the third prospective focal object, wherein the size of the third prospective focal object is compared with the size of the first prospective focal object and the size of the second prospective focal object to select the final focal object.

19. The Time of Flight system of claim 15 , wherein the processor is configured to execute the instructions to:

determine that the final focal object distance is equal to a last distance previously outputted by the Time of Flight system; and

output the final focal object distance from the Time of Flight system to focus the lens of the camera.

20. The Time of Flight system of claim 19 , further comprising:

an optical source configured to emit light into an environment; and

an optical receiver comprising:

a plurality of light-sensitive pixels to detect photons being reflected from the environment, the plurality of light-sensitive pixels arranged in a plurality of sections corresponding to the plurality of zones, and

an optical-receiver lens to direct photons to the plurality of sections.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2024
From: LUNN, GORDON; HODGSON, ANDREW; BAXTER, DONALD
To: STMICROELECTRONICS (RESEARCH & DEVELOPMENT) LIMITED
Reel/Frame 066417/0861 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2024
From: POTHIER, OLIVIER
To: STMICROELECTRONICS SA
Reel/Frame 066418/0097 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2024
From: VADLAMUDI-REDDY, KALYAN-KUMAR; WINTERTON, DARIN K.
To: STMICROELECTRONICS, INC.
Reel/Frame 066418/0120 →
CHANGE OF NAME Recorded Dec 8, 2023
From: STMICROELECTRONICS SA
To: STMICROELECTRONICS FRANCE
Reel/Frame 065835/0159 →
Continuity (3)
Continuation 17987280 · Nov 15, 2022
Continuation 17122667 · Dec 15, 2020
Related Publication 20240015400A1 · Jan 11, 2024