IP Library › Granted Patent US 12,014,510
Granted Patent B2
US 12,014,510 · App. 17/166,702 · Granted Jun 18, 2024

Systems and methods for an improved camera system using filters for depth estimation of grayscale images

Inventor: Sean P. Rodrigues (Ann Arbor, MI)
Assignee: Toyota Motor Engineering & Manufacturing North America, Inc.
G06T7/557G06T7/50H04N23/50G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,014,510
App. No.
17/166,702
Granted
Jun 18, 2024
Kind
B2
Abstract

System, methods, and other embodiments described herein relate to an improved camera system including directional optics to estimate depth of grayscale images. In one embodiment, the camera system includes a lens that receives light associated with a scene and an inverter that inverts the light from the lens. The camera system also includes a metasurface that resolves an angle of the light from the inverter according to parameters of the metasurface. The camera system also includes a detector that senses the light from the metasurface to form image data by integrating intensity of the light per pixel to estimate depth of an object in the scene.

Claims (37)

1. A camera system comprising:

a lens that receives light associated with a scene;

an inverter that inverts the light from the lens;

a metasurface that resolves an angle of the light from the inverter by mitigating planarization according to parameters of the metasurface; and

a detector that senses the light from the metasurface to form image data by integrating intensity of the light per pixel from views associated with the scene that overlap into a representation pattern having features to estimate depth of an object.

2. The camera system of claim 1 , wherein the representation pattern is a grayscale pattern associated with the scene, that includes the views of the object that overlap with different focus areas, having an expanded field-of-view, resolved angles and additional depth.

3. The camera system of claim 1 , wherein the image data includes the views associated with the object that overlap within the representation pattern utilized for the depth.

4. The camera system of claim 1 , wherein the parameters are associated with any one of refracting, filtering, and directing the light per pixel for the depth or a geometry of the metasurface.

5. The camera system of claim 1 , wherein the metasurface is composed of a photonic band-gap crystal.

6. The camera system of claim 1 , further comprising:

a processor that forms a spatial point distribution including the object in association with the depth.

7. A camera system comprising:

a lens that receives light associated with a scene;

an inverter that inverts the light from the lens;

a metasurface that resolves an angle of the light from the inverter by mitigating planarization according to parameters of the metasurface;

a detector that senses the light from the metasurface to form image data by combining intensity of the light per area from views associated with the scene that overlap into a representation pattern having features to estimate depth; and

a processor that determines spacing between objects in the scene using the depth.

8. The camera system of claim 7 , further comprising:

the processor forms a grayscale pattern associated with the scene from the representation pattern, that includes the views of the objects that overlap with different focus areas, having an expanded field-of-view, resolved angles, and additional depth.

9. The camera system of claim 7 , wherein the image data includes the views associated with the objects that overlap within the representation pattern utilized for the depth.

10. The camera system of claim 7 , wherein the parameters are associated with any one of refracting, filtering, and directing the light per area for the depth or a geometry of the metasurface.

11. The camera system of claim 7 , wherein the metasurface is composed of a photonic band-gap crystal.

12. The camera system of claim 7 , wherein the features have information for a spatial point distribution including the objects in association with the depth.

13. The camera system of claim 7 , wherein the area corresponds to a section of the metasurface and a group of pixels of the detector associated with the angle.

14. The camera system of claim 7 , further comprising:

the processor forms a spatial point distribution including the objects in association with the depth.

15. A camera system comprising:

a lens that receives light associated with a scene;

a light inverter that inverts the light from the lens;

a resolver that resolves an angle of the light from the light inverter by mitigating planarization according to parameters of the resolver; and

a detector array that senses the light from the resolver to form image data by integrating intensity of the light per pixel from views associated with the scene that overlap into a representation pattern having features to estimate depth of an object.

16. The camera system of claim 15 , wherein the representation pattern is a grayscale pattern associated with the scene, that includes the views of the object that overlap with different focus areas, having an expanded field-of-view, resolved angles and additional depth.

17. The camera system of claim 15 , wherein the image data includes the views associated with the object that overlap within the representation pattern utilized for the depth.

18. The camera system of claim 15 , wherein the parameters are associated with any one of refracting, filtering, and directing the light per pixel for the depth or a geometry of the resolver.

19. The camera system of claim 15 , wherein the resolver is composed of a photonic band-gap crystal.

20. The camera system of claim 15 , further comprising:

a processor that forms a spatial point distribution including the object in association with the depth.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 068039/0307 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2021
From: RODRIGUES, SEAN P.
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 055163/0844 →
Continuity (1)
Related Publication 20220245844A1 · Aug 4, 2022
Cited By (1)
US 12,671,178