IP Library Granted Patent US 12,448,756
Granted Patent B2
US 12,448,756 · App. 18/388,760 · Granted Oct 21, 2025

Vehicle vision

Inventor: Rama Venkata Bhupatiraju (Fremont, CA)
Assignee: Zimeno Inc.
E02F9/261B60R1/24G06T7/12G06T7/60G06V20/58H04N5/2628H04N5/268H04N7/181B60R2300/105B60R2300/303B60R2300/802G06T2207/20092G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,448,756
App. No.
18/388,760
Granted
Oct 21, 2025
Kind
B2
Abstract

A vehicle vision system is configured to visibly present a view of a scene to an operator, the operator's view of the scene being otherwise visibly obstructed by an obstruction movably supported by a vehicle.

Claims (55)

1. A vehicle vision system comprising:

a vehicle configured to movably support an obstruction between a lowermost position and at least one raised position blocking an operator's view of a scene;

a lower camera mounted to the vehicle to capture a lower image of the scene beyond the obstruction;

an upper camera mounted to the vehicle to capture an obstructed upper image depicting the obstruction;

a controller configured to:

determine a current height at which the obstruction is supported while raised;

identify a first portion of the obstructed upper image that comprises the obstruction based upon the determined current height at which the obstruction is supported while raised, the first portion being formed by first pixels;

identify a second portion of the lower image depicting the scene obstructed by the obstruction, the second portion being formed by second pixels;

geometrically transform the second pixels based on a perspective of the upper camera;

replace the first pixels in the obstructed upper image with the geometrically transformed second pixels to form a modified upper image; and

display the modified upper image to the operator,

wherein the first portion has a first configuration when the obstruction is supported at a first height while raised and has a second configuration, different than the first configuration, when the obstruction is supported at a second height, while raised, different than the first height.

2. The vehicle vision system of claim 1 , wherein the obstruction comprises a load carrying tool.

3. The vehicle vision system of claim 2 , wherein the load carrying tool comprises a bucket.

4. The vehicle vision system of claim 2 , wherein the obstruction comprises a load carried by the tool and vertically extending beyond the tool.

5. The vehicle vision system of claim 1 , wherein the controller is configured to identify the first portion based upon image segmentation of the upper image to identify boundaries of the obstruction.

6. The vehicle vision system of claim 1 , wherein the controller is configured to identify the first portion based upon the current height at which the obstruction is supported while raised and generic obstruction specifications.

7. The vehicle vision system of claim 6 , wherein the generic obstruction specifications comprise operator input specifications for a load carrying tool of the vehicle.

8. The vehicle vision system of claim 6 , wherein the generic obstruction specifications comprises operator input or stored specifications for a load lifted or carried by the vehicle.

9. The vehicle vision system of claim 1 , wherein the controller is configured to identify the first portion based upon a sensed weight of the obstruction carried by the vehicle.

10. The vehicle vision system of claim 1 further comprising a non-image sensor configured to output signals indicating the current height at which the obstruction is supported while raised, wherein controller is configured to identify the first portion based upon the current height at which the obstruction is supported while raised.

11. The vehicle vision system of claim 1 further comprising a library of stored obstruction specifications, wherein the controller is configured to identify the first portion based upon the current height at which the obstruction is supported while raised and a selected one of the obstruction specifications.

12. The vehicle vision system of claim 1 , wherein the controller is configured to receive input from the operator defining a configuration of the first portion.

13. The vehicle vision system of claim 12 further comprising a display, wherein the controller is configured to present the upper image on the display and wherein the input received from the operator defining the configuration of the first portion is presented on the upper image on the display.

14. The vehicle vision system of claim 1 , wherein the controller is configured to adjust a configuration of the first portion based upon the current height at which the obstruction is supported while raised as the obstruction is vertically moved by the vehicle.

15. The vehicle vision system of claim 1 further comprising a display, wherein the upper camera is configured to capture an unobstructed upper image of the scene, wherein the controller is configured to automatically switch from presenting the unobstructed upper image of the scene and the modified upper image on the display based upon the current height at which the obstruction is supported while raised.

16. The vehicle vision system of claim 15 , wherein the vehicle comprises a load carrying tool that is raised and lowered by the vehicle and wherein the controller is configured to present the unobstructed upper image of the scene in response to the load carrying tool being at a height without supporting a load and is configured to present the modified upper image in response to the load carrying tool being at the height while supporting a load.

17. The vehicle vision system of claim 1 further comprising a display, wherein the controller is configured to:

present the obstructed upper image on the display;

determine presence of a predefined target in the lower image; and

automatically switch from presenting the obstructed upper image on the display to presenting the modified upper image on the display based upon the presence of the predefined target in the lower image.

18. The vehicle vision system of claim 17 , wherein the controller is configured to switch from presenting the obstructed upper image on the display to presenting the modified upper image on the display additionally based upon a determined distance between the predefined target and the vehicle.

19. The vehicle vision system of claim 1 , wherein the first portion has an outline corresponding to an outline of the obstruction.

20. The vehicle vision system of claim 1 , wherein the vehicle comprises a load carrying tool for vertically raising and lowering a load and wherein the first portion has an outline corresponding to an outline of the load being carried by the load carrying tool.

21. A vehicle vision system comprising:

a vehicle configured to movably support an obstruction blocking an operator's view of a scene;

a lower camera mounted to the vehicle to capture a lower image of the scene beyond the obstruction;

an upper camera mounted to the vehicle to capture an obstructed upper image depicting the obstruction;

a controller configured to:

identify a first portion of the obstructed upper image that comprises the obstruction, the first portion being formed by first pixels;

identify a second portion of the lower image depicting the scene obstructed by the obstruction, the second portion being formed by second pixels;

geometrically transform the second pixels based on a perspective of the upper camera; and

replace the first pixels in the obstructed upper image with the geometrically transformed second pixels to form a modified upper image; and

display the modified upper image to the operator, wherein the controller is configured to receive input from the operator defining a configuration of the first portion.

22. A vehicle vision system comprising:

a vehicle configured to movably support an obstruction blocking an operator's view of a scene;

a lower camera mounted to the vehicle to capture a lower image of the scene beyond the obstruction;

an upper camera mounted to the vehicle to capture an obstructed upper image depicting the obstruction;

a controller configured to:

identify a first portion of the obstructed upper image that comprises the obstruction, the first portion being formed by first pixels;

identify a second portion of the lower image depicting the scene obstructed by the obstruction, the second portion being formed by second pixels;

geometrically transform the second pixels based on a perspective of the upper camera;

replace the first pixels in the obstructed upper image with the geometrically transformed second pixels to form a modified upper image; and

display the modified upper image to the operator; and

a display, wherein the upper camera is configured to capture an unobstructed upper image of the scene, wherein the controller is configured to automatically switch from presenting the unobstructed upper image of the scene and the modified upper image on the display based upon a height of the obstruction.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2026
From: ZIMENO INC.
To: CATERPILLAR INC.
Reel/Frame 074144/0732 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2025
From: BHUPATIRAJU, RAMA VENKATA
To: ZIMENO INC.
Reel/Frame 072375/0597 →
Continuity (3)
Provisional Application 63524849 · Jul 3, 2023
Provisional Application 63429123 · Nov 30, 2022
Related Publication 20240175244A1 · May 30, 2024
References Cited (62)
US 4844685A · Sagaser · 1989 [cited by applicant]
US 5297916A · Fujikawa et al. · 1994 [cited by applicant]
US 6052647A · Parkinson et al. · 2000 [cited by applicant]
US 7229139B2 · Lu et al. · 2007 [cited by applicant]
US 8306697B2 · Lu et al. · 2012 [cited by applicant]
US 8340872B2 · Mintah et al. · 2012 [cited by applicant]
US 10816063B2 · Spitz · 2020 [cited by applicant]
US 20010019356A1 · Takeda et al. · 2001 [cited by applicant]
US 20010044685A1 · Schubert · 2001 [cited by applicant]
US 20090112423A1 · Foster et al. · 2009 [cited by applicant]
US 20100206100A1 · Vyas et al. · 2010 [cited by applicant]
US 20110224858A1 · Bissontz · 2011 [cited by applicant]
US 20120315120A1 · Hyder · 2012 [cited by applicant]
US 20140055077A1 · Barrass et al. · 2014 [cited by applicant]
US 20150176253A1 · Taylor et al. · 2015 [cited by applicant]
US 20150275469A1 · Fredrickson et al. · 2015 [cited by applicant]
US 20150310273A1 · Shreve · 2015 [cited by examiner]
US 20160273196A1 · Funk et al. · 2016 [cited by applicant]
US 20170212517A1 · Houle · 2017 [cited by examiner]
US 20180206392A1 · Matsuzaki · 2018 [cited by applicant]
US 20180290592A1 · Stein et al. · 2018 [cited by applicant]
US 20180297204A1 · Krasny et al. · 2018 [cited by applicant]
US 20180373264A1 · Madsen et al. · 2018 [cited by applicant]
US 20190084156A1 · Yasuda et al. · 2019 [cited by applicant]
US 20190119087A1 · Fischbach et al. · 2019 [cited by applicant]
US 20190276281A1 · Hofmeister et al. · 2019 [cited by applicant]
US 20200071144A1 · Draayer et al. · 2020 [cited by applicant]
US 20200131741A1 · Lehmann et al. · 2020 [cited by applicant]
US 20200300691A1 · Bonthuis et al. · 2020 [cited by applicant]
US 20200340213A1 · Zimmerman et al. · 2020 [cited by applicant]
US 20200362539A1 · Plouzek · 2020 [cited by examiner]
US 20200369498A1 · Ekshinge et al. · 2020 [cited by applicant]
US 20210000013A1 · Robertson et al. · 2021 [cited by applicant]
US 20210131072A1 · Gratton et al. · 2021 [cited by applicant]
US 20210170947A1 · Yunus et al. · 2021 [cited by applicant]
US 20210222743A1 · Whitney et al. · 2021 [cited by applicant]
US 20210264624A1 · Fu et al. · 2021 [cited by applicant]
US 20210301494A1 · Berry et al. · 2021 [cited by applicant]
US 20210316617A1 · Pugh · 2021 [cited by applicant]
US 20220106764A1 · Iwasaki et al. · 2022 [cited by applicant]
US 20220120060A1 · Ready-Campbell et al. · 2022 [cited by applicant]
US 20220126816A1 · Von Holst et al. · 2022 [cited by applicant]
US 20220130063A1 · Thomas et al. · 2022 [cited by applicant]
US 20220162048A1 · Meijer et al. · 2022 [cited by applicant]
US 20220333344A1 · Kean et al. · 2022 [cited by applicant]
US 20220350991A1 · Vesperman et al. · 2022 [cited by applicant]
US 20220382274A1 · Kean et al. · 2022 [cited by applicant]
US 20220412050A1 · Hoaby et al. · 2022 [cited by applicant]
US 20230106964A1 · Uro · 2023 [cited by examiner]
US 20240026651A1 · Nishi · 2024 [cited by examiner]
US 20250001939A1 · Lee · 2025 [cited by examiner]
WO 2022196242A1 · 2022 [cited by applicant]
Ahamed et al. “Advancements of wave energy converters based on power take off (PTO) systems: A review.” Ocean Engineering 204 (2020): 107248. Retrieved on Jan. 8, 2024 (Jan. 8, 2024) from entire document, 47 pages. [cited by applicant]
Bostelman et al. “Methods for improving visibility measurement standards of powered industrial vehicles.” Safety science 62 (2014): 257-270. Retrieved on Jan. 15, 2024 (Jan. 15, 2024) from entire document, 14 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2023/037216; mail date Jan. 23, 2024; 15 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2023/080816; mail date Feb. 12, 2024; 12 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2023/081457; mail date Mar. 13, 2024; 7 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2024/015857; mail date Jun. 21, 2024; 12 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2024/015859; mail date Jun. 4, 2024; 8 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2024/015860; mail date Jun. 4, 2024; 7 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2024/015878; mail date May 20, 2024; 7 pages. [cited by applicant]
International Search Report and Written Opinion for PCT/US2024/020789; mail date Jul. 16, 2024; 6 pages. [cited by applicant]