IP Library Granted Patent US 11,681,287
Granted Patent B2
US 11,681,287 · App. 17/141,348 · Granted Jun 20, 2023

Vehicle control system

Inventors: Bryan Datema (Rochester, MN); Cody Clifton (Oshkosh, WI); Xiang Gong (Oshkosh, WI); Zhenyi Wei (Oshkosh, WI); Shashank Bhatia (Rochester, MN)
Assignee: Oshkosh Corporation
G05D1/0016B28C7/02G05D1/0044G07C5/0808G07C5/0816B60W10/30B60W50/08B60W2050/0064G05D1/0278G06V20/20G07C5/008G07C2205/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,681,287
App. No.
17/141,348
Granted
Jun 20, 2023
Kind
B2
Abstract

A system includes a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium has instructions stored thereon that, upon execution by a processor of a portable user device, cause the processor to wirelessly connect to a machine via a wireless transceiver of the portable user device, display a control interface for the machine on a user interface of the portable user device, receive a user input through the control interface regarding operation of a controllable component of the machine, and provide a command to the machine via the wireless transceiver based on the user input to facilitate remote operation of the controllable component of the machine.

Claims (44)

1. A system comprising:

a non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by a processor of a portable user device, cause the processor to:

wirelessly connect to a machine via a wireless transceiver of the portable user device;

provide a live display on a user interface of the portable user device regarding an area in a field of view of a camera of the portable user device;

detect a controllable component of the machine within the live display;

display a control interface for the machine on the user interface of the portable user device in response to detecting the controllable component of the machine within the live display;

receive a user input through the control interface regarding operation of the controllable component of the machine; and

provide a command to the machine via the wireless transceiver based on the user input to facilitate remote operation of the controllable component of the machine.

2. The system of claim 1 , wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to project an augmented reality display of the controllable component onto the live display based on the command to facilitate making a comparison between an augmented reality position of the controllable component and an actual position of the controllable component within the live display.

3. The system of claim 1 , wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to:

acquire image data from the camera of the portable user device regarding an identifier on the machine to facilitate verifying that the portable user device has access to the machine; and

wirelessly connect the portable user device to the machine in response to the portable user device being verified.

4. The system of claim 2 , wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to transmit the image data to a remote server using the wireless transceiver, and wherein the remote server is configured to verify that the portable user device has access to the machine based on the image data.

5. The system of claim 2 , wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to verify that the portable user device has access to the machine based on the image data.

6. The system of claim 1 , further comprising the machine, wherein the machine is a fire apparatus, and wherein the controllable component includes at least one of a ladder assembly, a water turret, a pump system, or a stabilizer.

7. The system of claim 1 , further comprising the machine, wherein the machine is a refuse vehicle, and wherein the controllable component includes at least one of a lift assembly or a tailgate.

8. The system of claim 1 , further comprising the machine, wherein the machine is a concrete mixer vehicle, and wherein the controllable component includes at least one of a drum assembly or a washout system.

9. The system of claim 1 , further comprising the machine, wherein the machine is a lift machine, and wherein the controllable component includes at least one of a steering actuator, a drive actuator, a boom assembly, a lift assembly, or a leveling actuator.

10. The system of claim 1 , further comprising the portable user device, the portable user device including the processor and the non-transitory computer-readable storage medium.

11. The system of claim 1 , wherein the control interface includes a drive and steer operation interface that facilitates remotely driving and steering the machine.

12. The system of claim 1 , wherein the control interface facilitates at least one of (i) remotely initiating a washout process of a drum assembly of the machine with a washout system of the machine or (ii) remotely controlling an amount of water that is used to wash the drum assembly via the washout system.

13. A method comprising:

wirelessly connecting, by a portable user device, to a machine;

displaying, by the portable user device, a live display regarding an area in a field of view of a camera of the portable user device;

detecting, by the portable user device, a controllable component of the machine within the live display;

displaying, by the portable user device, a control interface for the machine in response to detecting the controllable component of the machine within the live display;

receiving, by the portable user device, a user input through the control interface regarding operation of the controllable component of the machine; and

providing, by the portable user device, a command to the machine based on the user input to facilitate remote operation of the controllable component of the machine;

wherein the machine is at least one of a fire apparatus, a refuse vehicle, a concrete mixer vehicle, or a lift machine; and

wherein the controllable component includes at least one of a ladder assembly, a water turret, a pump system, a stabilizer, a lift assembly, a tailgate, a drum assembly, a washout system, a steering actuator, a drive actuator, a boom assembly, or a leveling actuator.

14. The method of claim 13 , further comprising:

acquiring, by the portable user device, image data from the camera of the portable user device regarding an identifier on the machine to facilitate verifying that the portable user device has access to the machine; and

wirelessly connecting, by the portable user device, to the machine in response to the portable user device being verified.

15. A control system comprising:

a non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by a processor of a portable user device, cause the processor to:

acquire image data from a camera of the portable user device regarding an area at which the camera is facing;

provide a live display on a display of the portable user device based on the image data;

detect a controllable component of a machine within the live display based on the image data;

provide a control interface on the display for controlling operation of the controllable component in response to detecting the controllable component within the live display;

receive a command via the control interface for controlling the operation of the controllable component; and

provide the command to a controller of the machine.

16. The control system of claim 15 , wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to project an augmented reality display of the controllable component onto the live display based on the command.

17. The control system of claim 15 , wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to wirelessly connect to the controller of the machine to facilitate remotely controlling the controllable component from an exterior of the machine.

18. The control system of claim 15 , further comprising the controller, wherein the controller is configured to control the operation of the controllable component based on the command.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2021
From: DATEMA, BRYAN; CLIFTON, CODY; GONG, XIANG; WEI, ZHENYI; BHATIA, SHASHANK
To: OSHKOSH CORPORATION
Reel/Frame 054818/0340 →
Continuity (3)
Continuation 16169620 · Oct 24, 2018
Provisional Application 62577048 · Oct 25, 2017
Related Publication 20210124347A1 · Apr 29, 2021