IP Library › Granted Patent US 12,231,781
Granted Patent B2
US 12,231,781 · App. 18/054,242 · Granted Feb 18, 2025

Remote control system, and remote operation apparatus, video image processing apparatus, and computer-readable medium

Inventor: Toshiya Nakakura (Tokyo, JP)
Assignee: NTT Communications Corporation
H04N23/80G06F3/012H04N7/183
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,781
App. No.
18/054,242
Granted
Feb 18, 2025
Kind
B2
Abstract

A remote operation apparatus is configured to operate in response to a control signal transmitted via a network from a user apparatus connected to a display unit and includes a movable unit capable of changing a posture. The remote operation apparatus includes: a video data acquisition unit configured to acquire video data acquired from a camera disposed in the movable unit; a motion detection data acquisition unit configured to acquire, through a motion sensor, motion detection data representing a change in the posture of the movable unit; and a data transmission unit configured to transmit the acquired video data and the acquired motion detection data to the user apparatus via the network.

Claims (20)

1. A remote control system comprising a user apparatus connected to a display unit and a remote operation apparatus configured to operate in response to a control signal transmitted from the user apparatus via a network,

the remote operation apparatus comprising:

a movable unit capable of changing a posture;

a video data acquisition unit configured to acquire video data output from a camera disposed in the movable unit;

a motion detection data acquisition unit configured to acquire, through a motion sensor, motion detection data representing a change in the posture of the movable unit; and

a data transmission unit configured to transmit the acquired video data and the acquired motion detection data to the user apparatus via the network,

the user apparatus comprising:

a data reception unit configured to receive the video data and the motion detection data transmitted from the remote operation apparatus via the network;

a determination unit configured to determine, based on the received motion detection data, a period when the posture of the movable unit is changing;

a video image processing unit configured to perform, based on a determination result of the determination unit, a process of reducing a sense of immersion with respect to the video data received during the period when the posture of the movable unit is changing; and

an output unit configured to output, to the display unit, data in which the sense of immersion has been reduced.

2. A video image processing apparatus provided in either a user apparatus connected to a display unit or a remote operation apparatus that is configured to operate in response to a control signal transmitted from the user apparatus via a network and that includes a movable unit capable of changing a posture, the video image processing apparatus comprising:

a video data acquisition unit configured to acquire video data output from a camera disposed in the movable unit;

a motion detection data acquisition unit configured to acquire, through a motion sensor, motion detection data representing a change in the posture of the movable unit;

a determination unit configured to determine, based on the acquired motion detection data, a period when the posture of the movable unit is changing;

a video image processing unit configured to perform, based on a determination result of the determination unit, a process of reducing a sense of immersion with respect to the video data acquired during the period when the posture of the movable unit is changing; and

an output unit configured to output, to the display unit, data in which the sense of immersion has been reduced.

3. The video image processing apparatus according to claim 2 , wherein the video image processing unit is configured to perform, on the video data acquired during the period when the posture of the movable unit is changing, a process of stilling a video image, replacing the video data with still image data of a single color, making the video image translucent, reducing a pixel density, or reducing a frame size.

4. The video image processing apparatus according to claim 2 , wherein the video image processing unit is configured to replace the video data acquired during the period when the posture of the movable unit is changing with standby image data to which information indicating that the remote operation apparatus is moving has been added.

5. A non-transitory computer-readable medium recording a program for causing a processor included in the video image processing apparatus according to claim 2 to execute processing to be performed by each of the units included in the video image processing apparatus.

Assignments (2)
CHANGE OF NAME Recorded Jan 12, 2026
From: NTT COMMUNICATIONS CORPORATION
To: NTT DOCOMO BUSINESS, INC.
Reel/Frame 074329/0821 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2022
From: NAKAKURA, TOSHIYA
To: NTT COMMUNICATIONS CORPORATION
Reel/Frame 061718/0032 →
Priority Claims (1)
JP 2020-085315 · May 14, 2020 · national
Continuity (2)
Continuation PCTJP2021018476 · May 14, 2021
Related Publication 20230076335A1 · Mar 9, 2023
References Cited (23)
US 10969591B2 · Nakamura · 2021 [cited by applicant]
US 20050267826A1 · Levy · 2005 [cited by examiner]
US 20110248837A1 · Israr · 2011 [cited by examiner]
US 20160228771A1 · Watson · 2016 [cited by applicant]
US 20170285694A1 · Kim · 2017 [cited by examiner]
US 20180078034A1 · Savall · 2018 [cited by examiner]
US 20180194004A1 · Fukuda · 2018 [cited by examiner]
US 20180296921A1 · Watson · 2018 [cited by applicant]
US 20180338132A1 · Rao Padebettu · 2018 [cited by examiner]
US 20190385376A1 · Kim · 2019 [cited by examiner]
US 20200055195A1 · Ignakov · 2020 [cited by examiner]
US 20200319463A1 · Nakamura · 2020 [cited by applicant]
US 20210084429A1 · Tajik · 2021 [cited by examiner]
US 20210192805A1 · Nakakura · 2021 [cited by applicant]
JP 05228855A · 1993 [cited by applicant]
JP 2002135641A · 2002 [cited by applicant]
JP 2017201742A · 2017 [cited by applicant]
JP 2019106628A · 2019 [cited by applicant]
JP 6655751B1 · 2020 [cited by applicant]
WO WO2019176035A1 · 2019 [cited by applicant]
Extended European Search Report issued Oct. 10, 2023 in European Application No. 21805315.5, 11 pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion issued Nov. 24, 2022, in PCT/JP2021/018476, 6 pages. [cited by applicant]
International Search Report issued Aug. 3, 2021 in PCT/JP2021/018476 filed on May 14, 2021, 6 pages (with English Translation). [cited by applicant]