IP Library Granted Patent US 12,054,097
Granted Patent B2
US 12,054,097 · App. 17/548,409 · Granted Aug 6, 2024

Target identification for vehicle see-through applications

Inventors: Jin Woo Jung (Johns Creek, GA); Rajendramayavan Rajendran Sathyam (Peachtree City, GA)
Assignee: Panasonic Automotive Systems Company of America, Division of Panasonic Corporation of North America
B60R1/00B60K35/00G06T7/70B60K35/22B60K35/60B60K2360/788B60R2300/20B60R2300/802G06T2207/30252G06T2215/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,054,097
App. No.
17/548,409
Granted
Aug 6, 2024
Kind
B2
Abstract

Examples of the disclosure relate to example systems and methods for operating a see-through display for a vehicle. An example system includes a video camera positioned to capture video related to a vehicle structure that blocks a view of the driver. The system also includes a see-through display disposed inside the vehicle between the vehicle structure and the driver. The system also includes a processor configured to identify a closest object within a field of view of the video camera, determine a distance to the closest object, and process the captured video based, at least in part, on the distance to determine a portion of the captured video to be displayed on the see-through display. The processor renders the portion of the captured video to create a see-through effect relative to the vehicle structure.

Claims (35)

1. A see-through system for a vehicle, comprising:

a video camera positioned to capture video related to a vehicle structure that blocks a view of a driver of the vehicle;

a see-through display disposed inside the vehicle between the vehicle structure and the driver; and

a processor configured to:

identify a closest object within a field of view of the video camera, wherein to identify the closest object comprises processing a list of objects in a vicinity of the vehicle, wherein the list of objects is received from an Automatic Driver Assistance System;

determine a distance to the closest object;

process the captured video based, at least in part, on the distance to determine a portion of the captured video to be displayed on the see-through display; and

render the portion of the captured video to create a see-through effect relative to the vehicle structure.

2. The see-through system of claim 1 , wherein processing the list comprises filtering the list to discard objects that are past a maximum distance.

3. The see-through system of claim 1 , wherein processing the list comprises comparing position coordinates of an object from the list with a view cone of the camera.

4. The see-through system of claim 1 , wherein the video camera is a range camera and wherein to identify the closest object comprises receiving distance information from the video camera.

5. The see-through system of claim 1 , wherein to process the captured video comprises cropping an outer portion of the captured video, wherein a size of the cropped area is proportional to the distance.

6. The see-through system of claim 1 , wherein to process the captured video comprises determining the portion of the captured video to be displayed based additionally on an eye position of the driver.

7. The see-through system of claim 1 , wherein the vehicle structure that blocks the view of the driver is an A-pillar.

8. The see-through system of claim 1 , wherein the vehicle structure that blocks the view of the driver is a first A-pillar, the see-through system further comprising:

a second video camera positioned to capture video related to a second A-pillar; and

a second see-through display disposed inside the vehicle between the second A-pillar and the driver.

9. A method of operating a see-through system for a vehicle comprising:

identifying a closest object within a field of view of a video camera, wherein identifying the closest object comprises processing a list of objects in a vicinity of the vehicle, wherein the list of objects is received from an Automatic Driver Assistance System;

determining a distance to the closest object;

processing the video captured by the video camera based, at least in part, on the distance to determine a portion of the video to be displayed on a see-through display positioned between a driver and a vehicle structure that block the driver's view of the outside environment; and

rendering the portion of the video to create a see-through effect relative to the vehicle structure.

10. The method of claim 9 , wherein processing the list comprises filtering the list to discard objects that are past a maximum distance.

11. The method of claim 9 , wherein processing the list comprises comparing position coordinates of an object from the list with a view cone of the camera.

12. The method of claim 9 , wherein the video camera is a range camera and wherein identifying the closest object comprises receiving distance information from the video camera.

13. The method of claim 9 , wherein processing the video comprises cropping an outer portion of the video, wherein a size of the cropped area is proportional to the distance.

14. The method of claim 9 , wherein the vehicle structure that block the driver's view of the outside environment is an A-pillar.

15. A non-transitory computer-readable medium comprising instructions to direct the actions of a processor to operate a see-through system of a vehicle, the instructions to direct the processor to:

identify a closest object within a field of view of a video camera, wherein to identify the closest object comprises processing a list of objects in a vicinity of the vehicle, wherein the list of objects is received from an Automatic Driver Assistance System;

determine a distance to the closest object;

process the video captured by the video camera based, at least in part, on the distance to determine a portion of the video to be displayed on a see-through display positioned between a driver and a vehicle structure that block the driver's view of the outside environment; and

render the portion of the video to create a see-through effect relative to the vehicle structure.

16. The non-transitory computer-readable medium of claim 15 , wherein to identify the closest object comprises determining a list of objects in a vicinity of the vehicle, filtering the list to discard objects that are past a maximum distance, and comparing position coordinates of an object from the list with a view cone of the video camera.

17. The non-transitory computer-readable medium of claim 15 , wherein to process the video comprises cropping an outer portion of the video, wherein a size of the cropped area is proportional to the distance.

18. The non-transitory computer-readable medium of claim 15 , wherein to process the video comprises determining the portion of the video to be displayed based additionally on an eye position of the driver.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE SUPPORTIVE DOCUMENTS PREVIOUSLY RECORDED ON REEL 72222 FRAME 267. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 23, 2025
From: PANASONIC CORPORATION OF NORTH AMERICA
To: PANASONIC AUTOMOTIVE SYSTEMS AMERICA, LLC.
Reel/Frame 072930/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2025
From: PANASONIC CORPORATION OF NORTH AMERICA
To: PANASONIC AUTOMOTIVE SYSTEMS AMERICA, LLC
Reel/Frame 072222/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2021
From: JUNG, JIN WOO; RAJENDRAN SATHYAM, RAJENDRAMAYAVAN
To: PANASONIC AUTOMOTIVE SYSTEMS COMPANY OF AMERICA, DIVISION OF PANASONIC CORPORATION OF NORTH AMERICA
Reel/Frame 058365/0713 →
Continuity (2)
Provisional Application 63125899 · Dec 15, 2020
Related Publication 20220185182A1 · Jun 16, 2022