IP Library › Granted Patent US 12705855
Granted Patent B2
US 12705855 · App. 18/559,648 · Granted Aug 11, 2026

Information processing apparatus, information processing system and method for processing information

Inventors: Takashi Yamaguchi (Tokyo, JP); Yugo Katsuki (Tokyo, JP); Shinji Katsuki (Tokyo, JP); Takanori Fukazawa (Tokyo, JP); Hiroyasu Baba (Tokyo, JP); Hiroshi Yoshida (Tokyo, JP); Fumisada Maeda (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06V10/25G06T7/20G06V10/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12705855
App. No.
18/559,648
Granted
Aug 11, 2026
Kind
B2
Abstract

Provided is an information processing apparatus including a controller and a processor. The controller controls one of a first sensor and a second sensor based on sensing data output from the other. The first sensor detects light emitted from an object and the second sensor detects a change in luminance value of the light as an event. The processor processes the sensing data output from the first sensor or the second sensor.

Claims (60)

1 . An information processing apparatus, comprising:

a Central Processing Unit (CPU) configured to:

correct a deviation between first sensing data and second sensing data, based on a positional relation between a first sensor and a second sensor and an optical difference between the first sensor and the second sensor, wherein

the first sensing data is output from the first sensor, and

the second sensing data is output from the second sensor;

control, based on the correction of the deviation, one of the first sensor or the second sensor, wherein

the second sensor is controllable based on the first sensing data output from the first sensor,

the first sensor is controllable based on the second sensing data output from the second sensor,

the first sensor detects light emitted from an object, and

the second sensor detects a change in a luminance value of the light as an event; and

process one of the first sensing data or the second sensing data.

2 . The information processing apparatus according to claim 1 , wherein

the second sensor includes:

a plurality of pixels in a matrix; and

a detector circuit that detects, in each pixel of the plurality of pixels, that a luminance change exceeds a specific threshold.

3 . The information processing apparatus according to claim 2 , wherein the first sensor includes an image sensor.

4 . The information processing apparatus according to claim 3 , wherein the CPU is further configured to:

control a region of interest of the second sensor based on a range, including the object, within an image generated from the first sensing data.

5 . The information processing apparatus according to claim 4 , wherein the CPU is further configured to:

control the specific threshold of the second sensor based on one of a luminance value of the object or the range within the image.

6 . The information processing apparatus according to claim 4 , wherein the CPU is further configured to:

select the second sensing data, based on a sampling time of the first sensing data and a sampling rate of the first sensing data.

7 . The information processing apparatus according to claim 6 , wherein the CPU is further configured to:

estimate one of a condition of the object or a condition of the image, based on a plurality of pieces of the second sensing data.

8 . The information processing apparatus according to claim 7 , wherein the CPU is further configured to estimate a motion of the object based on the plurality of pieces of the second sensing data.

9 . The information processing apparatus according to claim 2 , wherein the first sensor includes at least one of an RGB sensor or a time-of-flight (ToF) sensor.

10 . The information processing apparatus according to claim 9 , wherein the CPU is further configured to:

control a region of interest of the first sensor based on the second sensing data.

11 . The information processing apparatus according to claim 10 , wherein the CPU is further configured to:

control a sampling time, sampling rate, and one of a gain of the first sensor or an illumination intensity of an illumination device that irradiates the object with the light, based on an output frequency of the second sensing data.

12 . The information processing apparatus according to claim 10 , wherein the CPU is further configured to select the first sensing data, based on an output frequency of the second sensing data.

13 . The information processing apparatus according to claim 12 , wherein the CPU is further configured to:

analyze an image generated from the first sensing data; and

estimate a condition of the object.

14 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to process third sensing data of a third sensor.

15 . The information processing apparatus according to claim 14 , wherein the third sensor includes at least one of a positioning sensor, a biometric sensor, a temperature sensor, a wind direction and wind force sensor, or an inclination sensor.

16 . The information processing apparatus according to claim 1 , wherein the CPU is further configured to correct a difference in at least one of an angle of view, parallax, lens aberration, or a distance to the object.

17 . An information processing system, comprising:

a first sensor configured to:

detect light emitted from an object; and

output first sensing data based on the detection of the light;

a second sensor configured to:

detect a change in a luminance value of the light as an event; and

output second sensing data based on the detection of the change in the luminance value; and

an information processing apparatus comprising a Central Processing Unit (CPU), wherein the CPU is configured to:

correct a deviation between the first sensing data and the second sensing data, based on a positional relation between the first sensor and the second sensor and an optical difference between the first sensor and the second sensor;

control, based on the correction of the deviation, one of the first sensor or the second sensor, wherein

the second sensor is controllable based on the first sensing data output from the first sensor, and

the first sensor is controllable based on the second sensing data output from the second sensor; and

process one of the first sensing data or the second sensing data.

18 . A method for processing information by an information processing apparatus, the method comprising:

correcting a deviation between first sensing data and second sensing data, based on a positional relation between a first sensor and a second sensor and an optical difference between the first sensor and the second sensor, wherein

the first sensing data is output from the first sensor, and

the second sensing data is output from the second sensor;

controlling, based on the correction of the deviation, one of the first sensor or the second sensor, wherein

the second sensor is controllable based on the first sensing data output from the first sensor,

the first sensor is controllable based on the second sensing data output from the second sensor,

the first sensor detects light emitted from an object, and

the second sensor detects a change in a luminance value of the light as an event; and

processing one of the first sensing data or the second sensing data.