IP Library Granted Patent US 12,603,986
Granted Patent B2
US 12,603,986 · App. 17/802,538 · Granted Apr 14, 2026

Information processing device, information processing method, and information processing system

Inventors: Yasuhiro Sutou (Tokyo, JP); Toshio Yamazaki (Tokyo, JP); Seungha Yang (Tokyo, JP); Ryo Hirono (Tokyo, JP)
Assignee: Sony Group Corporation
H04N17/002G06T3/40G06T11/001H04N23/64H04N23/73
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,603,986
App. No.
17/802,538
Granted
Apr 14, 2026
Kind
B2
Abstract

The present disclosure relates to an information processing device, an information processing method, and an information processing system capable of achieving simpler camera calibration. A control unit generates, in a case where calibration is required for a camera of a mobile unit, a first trigger for displaying a pattern imaged by the camera on a mobile terminal, and generates a second trigger for presenting feedback to a user according to whether or not appropriate imaging of the pattern by the camera is possible. The technology according to the present disclosure can be applied to, for example, a mobile unit such as a drone or a mobile terminal such as a smartphone.

Claims (53)

1 . A mobile terminal comprising:

a communication circuit; and

a control circuit configured to:

in a case where calibration is required for a camera of a holdable mobile device, generate a first trigger that instructs the mobile terminal to display a pattern to be imaged by the camera of the holdable mobile device on the mobile terminal, separate from and spaced apart from the holdable mobile device,

receive, via the communication circuit, an image of the displayed pattern captured by the camera of the holdable mobile device;

determine, based on the received image, whether or not appropriate imaging of the pattern is possible, and

generate a second trigger that instructs the mobile terminal to present feedback to a user of the mobile terminal according to whether or not appropriate imaging of the pattern displayed on the mobile terminal by the camera of the holdable mobile device is possible, the feedback including an indication to the user that a user initiated imaging will generate an appropriate image.

2 . The mobile terminal according to claim 1 , wherein

the control circuit is configured to generate the first trigger when an outer shape of the mobile terminal is detected.

3 . The mobile terminal according to claim 1 , wherein

the pattern is a circle grid.

4 . The mobile terminal according to claim 3 , wherein

the circle grid is a circular symmetrical pattern or a circular asymmetrical pattern.

5 . The mobile terminal according to claim 1 , wherein

the pattern is a chessboard.

6 . The mobile terminal according to claim 1 , wherein

the pattern is formed by periodically arranging figures of different sizes.

7 . The mobile terminal according to claim 1 , wherein

the pattern is formed by periodically arranging figures having different shapes.

8 . The mobile terminal according to claim 1 , wherein

the control circuit is configured to change a shape of an entirety of the pattern in which figures are periodically arranged.

9 . The mobile terminal according to claim 1 , wherein

the control circuit is configured to change a size of an entirety of the pattern according to a distance between the camera and the mobile terminal.

10 . The mobile terminal according to claim 1 , wherein

the control circuit is configured to change a color of an entirety of the pattern.

11 . The mobile terminal according to claim 1 , wherein

the feedback is presented by at least one of vibration or sound in the mobile terminal.

12 . The mobile terminal according to claim 1 , wherein

the control circuit is configured to control imaging for the calibration by the camera in a case where appropriate imaging of the pattern by the camera is possible.

13 . The mobile terminal according to claim 12 , wherein

the control circuit is configured to set at least one of a shutter speed or a diaphragm value of a lens of the camera on a basis of sensor data acquired in the mobile terminal.

14 . The mobile terminal according to claim 13 , wherein

the sensor data is acquired by at least one of an acceleration sensor or a gyro sensor.

15 . The mobile terminal according to claim 1 , wherein

the control circuit is configured to generate a third trigger for presenting guidance for notifying the user of the camera that is a target of the calibration.

16 . The mobile terminal according to claim 15 , wherein

the guidance is presented by at least one of vibration or sound in the mobile terminal according to a distance between the camera that is a target of the calibration and the mobile terminal.

17 . The mobile terminal according to claim 15 , wherein

the guidance indicates, on the mobile terminal, a direction in which the camera that is a target of the calibration exists.

18 . The mobile terminal according to claim 15 , wherein

the guidance is presented by light emission of a light source in the camera that is a target of the calibration.

19 . An information processing method comprising

by a mobile terminal,

generating, in a case where calibration is required for a camera of a holdable mobile device, a first trigger that instructs the mobile terminal to display a pattern to be imaged by the camera of the holdable mobile device on the mobile terminal, separate from and spaced apart from the holdable mobile device,

receiving an image of the displayed pattern captured by the camera of the holdable mobile device,

determining, based on the received image, whether or not appropriate imaging of the pattern is possible, and

generating a second trigger that instructs the mobile terminal to present feedback to a user of the mobile terminal according to whether or not appropriate imaging of the pattern by the camera of the holdable mobile device is possible, the feedback including an indication to the user that a user initiated imaging will generate an appropriate image.

20 . An information processing system comprising:

a holdable mobile device including a camera;

a mobile terminal, separate from and spaced apart from the holdable mobile device, wherein the mobile terminal is configured to display a pattern to be imaged by the camera of the holdable mobile device; and

control circuitry configured to generate in a case where calibration is required for the camera of the holdable mobile device, a first trigger that instructs the mobile terminal to display the pattern;

determine, based on an image of the displayed pattern captured by the camera and transmitted from the holdable mobile device, whether or not appropriate imaging of the pattern is possible; and

a second trigger that instructs the mobile terminal to present feedback to a user of the mobile terminal according to whether or not appropriate imaging of the pattern by the camera of the holdable mobile device is possible, the feedback including an indication to the user that a user initiated imaging will generate an appropriate image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2022
From: SUTOU, YASUHIRO; YAMAZAKI, TOSHIO; YANG, SEUNGHA; HIRONO, RYO
To: SONY GROUP CORPORATION
Reel/Frame 061759/0390 →
Priority Claims (1)
JP 2020-035852 · Mar 3, 2020 · national
Continuity (1)
Related Publication 20230140518A1 · May 4, 2023
References Cited (16)
US 9933515B2 · Prokhorov · 2018 [cited by examiner]
US 10546390B2 · Shen · 2020 [cited by examiner]
US 11061412B2 · Harada · 2021 [cited by examiner]
US 11482008B2 · Huang · 2022 [cited by examiner]
US 12307713B2 · Dai · 2025 [cited by examiner]
US 20150130951A1 · Olson · 2015 [cited by applicant]
US 20160161602A1 · Prokhorov · 2016 [cited by applicant]
US 20190156517A1 · Shen et al. · 2019 [cited by applicant]
CN 104881172A · 2015 [cited by applicant]
CN 105096324A · 2015 [cited by applicant]
CN 109382821A · 2019 [cited by applicant]
CN 110689583A · 2020 [cited by applicant]
EP 3079134A1 · 2016 [cited by applicant]
JP 201930943A · 2019 [cited by applicant]
KR 1020150077081A · 2015 [cited by applicant]
International Search Report and Written Opinion mailed on May 18, 2021, received for PCT Application PCT/JP2021/006072, filed on Feb. 18, 2021, 8 pages including English Translation. [cited by applicant]