IP Library Granted Patent US 12684094
Granted Patent B1
US 12684094 · App. 19/082,253 · Granted Jul 14, 2026

System and method for machine control using remote operator station

Inventors: Shyam Sanker D E (Chennai, IN); Aravind Badri (Chennai, IN)
Assignee: Caterpillar Inc.
H04N7/181G05D1/2247H04L47/801H04N23/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12684094
App. No.
19/082,253
Granted
Jul 14, 2026
Kind
B1
Abstract

A method for visually monitoring an environment surrounding a mobile machine for facilitating control of the machine from a remote operator station is described. The method includes capturing at least one video feed visually representative of the environment. The at least one video feed is split into multiple feed segments. The method includes determining a gear position of a transmission and a steering angle associated with a steering system of the machine. The method includes selecting one or more feed segments from an entire set of feed segments based on the gear position and the steering angle, and transmitting the one or more feed segments to the remote operator station through a network at a bitrate higher than a first bitrate and a remaining feed segments of the entire set of feed segments to the remote operator station at a bitrate lesser than a second bitrate.

Claims (39)

1 . A method for visually monitoring an environment surrounding a mobile machine for facilitating control of the mobile machine from a remote operator station by an operator, the method comprising:

capturing, by at least one image capturing device, at least one video feed visually representative of the environment surrounding the mobile machine at the remote operator station, the at least one video feed split into multiple feed segments;

determining, by a control system coupled to the at least one image capturing device, a gear position of a transmission of the mobile machine during machine movement;

determining, by the control system, a steering angle associated with a steering system of the mobile machine during the machine movement;

selecting, by the control system, one or more feed segments from an entire set of feed segments based on the gear position and the steering angle; and

transmitting, by the control system, the selected one or more feed segments to the remote operator station through a network at a bitrate higher than a first bitrate and a remaining feed segments of the entire set of feed segments to the remote operator station at a bitrate lesser than a second bitrate,

wherein the second bitrate is less than or equal to the first bitrate facilitated by a current network bandwidth associated with transmitting the entire set of feed segments through the network.

2 . The method of claim 1 further including:

allocating, by the control system, a minimum threshold of network bandwidth for dedicated transmission of the selected one or more feed segments at at least the first bitrate, and

allocating, by the control system, a remaining percentage of network bandwidth for transmitting the remaining feed segments at at least the second bitrate.

3 . The method of claim 1 , wherein the at least one image capturing device includes a plurality of image capturing devices capturing two or more video feeds at least partially distinct from one another and visually representative of the environment surrounding the mobile machine at the remote operator station, and wherein each video feed of the one or more video feeds is split into multiple feed segments, and further wherein the entire set of feed segments includes the multiple feed segments from each of the two or more video feeds.

4 . The method of claim 1 further including dynamically throttling, by the control system, the bitrate of the transmission of one or more adjacently located feed segments of the entire set of feed segments based on the steering angle and the gear position.

5 . The method of claim 1 , wherein the selected one or more feed segments transmitted with the bitrate higher than the first bitrate correspond to portions in a field of view displayed on at least one display at the remote operator station that enable a visualization of a region in a direction towards which the machine movement is executed.

6 . The method of claim 1 , wherein the selected one or more feed segments and the remaining feed segments of the entire set of feed segments are consecutively arranged one after the other in a series in a field of view displayed on at least one display at the remote operator station.

7 . The method of claim 1 , wherein selecting the one or more feed segments based on the gear position and the steering angle includes detecting, by the control system, a current bandwidth value associated with the network to recede below a threshold bandwidth value.

8 . The method of claim 1 , wherein the gear position is one of forward and reverse in which the mobile machine executes movement in a forward direction and a reverse direction opposite the forward direction, respectively.

9 . The method of claim 1 , wherein a number of the selected one or more feed segments transmitted with the bitrate higher than the first bitrate is determined based on a request generated at the remote operator station.

10 . The method of claim 1 , further including transmitting, by the control system, the entire set of feed segments to the remote operator station with same bitrate or with a bitrate defined within a bitrate range when the gear position is either of a neutral position or a parking position.

11 . A system for visually monitoring an environment surrounding a mobile machine for facilitating control of the mobile machine from a remote operator station by an operator, the system comprising:

at least one image capturing device to capture at least one video feed visually representative of the environment surrounding the mobile machine at the remote operator station, the at least one video feed split into multiple feed segments; and

a control system coupled to the at least one image capturing device, the control system configured to:

determine a gear position of a transmission of the mobile machine during machine movement;

determine a steering angle associated with a steering system of the mobile machine during the machine movement;

select one or more feed segments from an entire set of feed segments based on the gear position and the steering angle; and

transmit the selected one or more feed segments to the remote operator station through a network at a bitrate higher than a first bitrate and a remaining feed segments of the entire set of feed segments to the remote operator station at a bitrate lesser than a second bitrate,

wherein the second bitrate is less than or equal to the first bitrate facilitated by a current network bandwidth associated with transmitting the entire set of feed segments through the network.

12 . The system of claim 11 , wherein the control system is configured to:

allocate a minimum threshold of network bandwidth for dedicated transmission of the selected one or more feed segments at at least the first bitrate, and

allocate a remaining percentage of network bandwidth for transmitting the remaining feed segments at at least the second bitrate.

13 . The system of claim 11 , wherein the at least one image capturing device includes a plurality of image capturing devices capturing two or more video feeds at least partially distinct from one another and visually representative of the environment surrounding the mobile machine at the remote operator station, and wherein each video feed of the one or more video feeds is split into multiple feed segments, and further wherein the entire set of feed segments includes the multiple feed segments from each of the two or more video feeds.

14 . The system of claim 11 , wherein the control system is configured to:

dynamically throttling the bitrate of the transmission of one or more adjacently located feed segments of the entire set of feed segments based on the steering angle and the gear position.

15 . The system of claim 11 , wherein the selected one or more feed segments transmitted with the bitrate higher than the first bitrate correspond to portions in a field of view displayed on at least one display at the remote operator station that enable a visualization of a region in a direction towards which the machine movement is executed.

16 . The system of claim 11 , wherein the selected one or more feed segments and the remaining feed segments of the entire set of feed segments are consecutively arranged one after the other in a field of view displayed on at least one display at the remote operator station.

17 . The system of claim 11 , wherein to select the one or more feed segments based on the gear position and the steering angle, the control system is configured to detect a current bandwidth value associated with the network to recede below a threshold bandwidth value.

18 . The system of claim 11 , wherein the gear position is one of forward and reverse in which the mobile machine executes movement in a forward direction and a reverse direction opposite the forward direction, respectively.

19 . The system of claim 11 , wherein a number of the selected one or more feed segments transmitted with the bitrate higher than the first bitrate is determined based on a request generated at the remote operator station.

20 . The system of claim 11 , wherein the control system is configured to:

transmit the entire set of feed segments to the remote operator station with same bitrate or with a bitrate defined within a bitrate range when the gear position is either of a neutral position or a parking position.