IP Library Granted Patent US 12700203
Granted Patent B2
US 12700203 · App. 18/607,910 · Granted Aug 4, 2026

Information processing apparatus, information processing method, and recording medium

Inventor: Atsushi Hirai (Tokyo To, JP)
Assignee: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
G06T19/20G06V40/28G06T2219/2004G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12700203
App. No.
18/607,910
Granted
Aug 4, 2026
Kind
B2
Abstract

An information processing apparatus includes a processor connected to a memory. The processor receives, from a camera, an image obtained by imaging a user being an operator. The processor sets, within an imaging range of the camera, a virtual operation region for receiving an operation onto a device. The processor detects a hand of the user on the basis of the image. The processor operates the device in accordance with a moving direction of the hand of the user in a case where the hand of the user has been detected from the virtual operation region. The processor changes a position of the virtual operation region to follow a position of the hand of the user in a case where the position of the hand of the user has moved from an inside of the virtual operation region to an outside of the virtual operation region.

Claims (45)

1 . An information processing apparatus comprising:

a memory in which a computer program is stored; and

a hardware processor connected to the memory and configured to perform processing by executing the computer program, the processing including

receiving, from a camera, an image obtained by imaging a user being an operator;

setting, within an imaging range of the camera, a virtual operation region for receiving an operation onto a device;

detecting a hand of the user on the basis of the image;

operating the device in accordance with a moving direction of the hand of the user in a case where the hand of the user has been detected from the virtual operation region; and

changing a position of the virtual operation region to follow a position of the hand of the user in a case where the position of the hand of the user has moved from an inside of the virtual operation region to an outside of the virtual operation region,

wherein the processing includes

detecting a swipe operation of moving the hand of the user in one direction, and

changing the position of the virtual operation region to follow the position of the hand of the user in a case where the hand of the user has moved from the inside of the virtual operation region to the outside of the virtual operation region due to the swipe operation, and

wherein the processing includes changing the virtual operation region on the basis of the hand detected in a seek operation corresponding to the swipe operation.

2 . The information processing apparatus according to claim 1 , wherein

the virtual operation region is defined by a minimum operation position indicating one end in a direction in which the operation is performed and a maximum operation position indicating the other end of the direction, and

the processing includes changing the minimum operation position or the maximum operation position, each corresponding to a moving direction of the hand of the user, the changing being performed to follow the position of the hand of the user while keeping a size of the virtual operation region.

3 . The information processing apparatus according to claim 2 , wherein the minimum operation position and the maximum operation position are set on the basis of at least one of absolute coordinates and relative coordinates with respect to the device.

4 . The information processing apparatus according to claim 2 , wherein the virtual operation region is a two-dimensional region or a three-dimensional region.

5 . The information processing apparatus according to claim 1 , wherein, when two or more devices are arranged adjacent to each other, the processing includes changing, in the seek operation, the virtual operation region by prioritizing an operation onto a device initially operated by the user out of the two or more devices.

6 . The information processing apparatus according to claim 1 , wherein the processing includes

detecting an operation direction of a fingertip of the user, and

changing the virtual operation region in a case where the operation direction is directed to the device and the fingertip has moved from the inside of the virtual operation region to the outside of the virtual operation region.

7 . The information processing apparatus according to claim 1 , wherein the processing includes, after the changing of the virtual operation region, restoring the virtual operation region to a state before the changing on the basis of a release operation corresponding to a motion of the hand.

8 . The information processing apparatus according to claim 1 , wherein the processing includes

setting, within an imaging range of the camera, an operation detectable region including the virtual operation region; and

changing the position of the virtual operation region within the operation detectable region.

9 . The information processing apparatus according to claim 1 , wherein

the processing includes setting the virtual operation region on the basis of a positional relationship between the device and the user, and

the nearer to the user, the smaller the virtual operation region becomes.

10 . An information processing method implemented by a computer, the method comprising:

receiving, from a camera, an image obtained by imaging a user being an operator;

setting, within an imaging range of the camera, a virtual operation region for receiving an operation onto a device;

detecting a hand of the user on the basis of the image;

operating the device in accordance with a moving direction of the hand of the user in a case where the hand of the user has been detected from the virtual operation region; and

changing a position of the virtual operation region to follow a position of the hand of the user in a case where the position of the hand of the user has moved from an inside of the virtual operation region to an outside of the virtual operation region,

wherein

the virtual operation region is defined by a minimum operation position indicating one end in a direction in which the operation is performed and a maximum operation position indicating the other end of the direction, and

the processing includes changing the minimum operation position or the maximum operation position, each corresponding to a moving direction of the hand of the user, the changing being performed to follow the position of the hand of the user while keeping a size of the virtual operation region, and

wherein the minimum operation position and the maximum operation position are set on the basis of at least one of absolute coordinates and relative coordinates with respect to the device.

11 . A non-transitory computer-readable recording medium on which programmed instructions are recorded, the instructions causing a computer to execute processing, the processing comprising:

receiving, from a camera, an image obtained by imaging a user being an operator;

setting, within an imaging range of the camera, a virtual operation region for receiving an operation onto a device;

detecting a hand of the user on the basis of the image;

operating the device in accordance with a moving direction of the hand of the user in a case where the hand of the user has been detected from the virtual operation region; and

changing a position of the virtual operation region to follow a position of the hand of the user in a case where the position of the hand of the user has moved from an inside of the virtual operation region to an outside of the virtual operation region,

wherein the processing includes, after the changing of the virtual operation region, restoring the virtual operation region to a state before the changing on the basis of a release operation corresponding to a motion of the hand.