IP Library › Granted Patent US 12,058,441
Granted Patent B2
US 12,058,441 · App. 17/753,882 · Granted Aug 6, 2024

Information processing apparatus with automatic adjustment of focal point

Inventor: Takashi Tsujimura (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N23/675G06T7/70G06V10/774H04N23/61G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,058,441
App. No.
17/753,882
Granted
Aug 6, 2024
Kind
B2
Abstract

An information processing apparatus collects image data, performs a training process using the image data to create a trained model for autofocus (AF), and outputs the trained model to a requesting device. A terminal apparatus includes a communication function, and acquires the trained model output by the information processing apparatus. An electronic device includes an imaging function, acquires the trained model from the terminal apparatus, and performs autofocus on the basis of the trained model. When the electronic device performs autofocus to capture an image of an object and an intended spot is not automatically in-focus, a user registers the image data (out-of-focus image data) in the terminal apparatus. An AF point is designated in the out-of-focus image data. The information processing apparatus collects the out-of-focus image data from the terminal apparatus, and performs the training process using the out-of-focus image data to create and output the trained model.

Claims (71)

1. An information processing apparatus, comprising:

a collection unit that collects image data;

a training unit that:

uses a plurality of the image data collected by the collection unit to extract an object position included in the image data,

performs a training process regarding a relationship between the image data and the object position, wherein a range-finding point is designated in the image data used in the training process, and

creates a trained model for an automatic focal point adjustment that specifies an object from the image data to specify a focal position; and

an output unit that outputs the trained model created by the training unit to a device requesting the trained model.

2. The information processing apparatus according to claim 1 , wherein

the collection unit accumulates the collected image data by automatically dividing up the image data by a category of the object, and

the training unit starts the training process with respect to the object when the image data collected by the collection unit for each category of the object reaches a specific number.

3. The information processing apparatus according to claim 2 , wherein the output unit outputs the collected image data and an aggregate status of the collected image data by the category of the object.

4. The information processing apparatus according to claim 1 , wherein a plurality of range-finding points are designatable, and an order of priority is determined.

5. The information processing apparatus according to claim 4 , wherein the order of priority of the plurality of designated range-finding points is changeable.

6. The information processing apparatus according to claim 1 , wherein the collection unit collects the image data in which the range-finding point is designated.

7. The information processing apparatus according to claim 1 , further comprising an annotation unit that automatically annotates the image data by utilizing the image data used in the training process by the training unit.

8. An electronic device, comprising:

a storage unit that stores a trained model for an automatic focal point adjustment, wherein the trained model is based on a range-finding point designated in image data;

a control unit that performs the automatic focal point adjustment based on the trained model stored in the storage unit; and

an optical system that brings into focus a specific part of an object according to control by the control unit.

9. A terminal apparatus, comprising:

a communication unit capable of communicating with an information processing apparatus;

a control unit that acquires a trained model for an automatic focal point adjustment from the information processing apparatus through the communication unit, wherein the trained model is based on a range-finding point designated in image data; and

a provision unit that provides the trained model acquired from the information processing apparatus to an electronic device that performs the automatic focal point adjustment based on the trained model.

10. The terminal apparatus according to claim 9 , wherein the control unit:

registers the image data in the information processing apparatus through the communication unit; and

acquires the trained model based on the image data from the information processing apparatus.

11. The terminal apparatus according to claim 10 , further comprising:

a display unit that displays the image data; and

an input unit that outputs a signal corresponding to an input operation by a user to the control unit, wherein

the control unit designates the range-finding point with respect to the image data displayed on the display unit, according to the signal from the input unit.

12. The terminal apparatus according to claim 11 , wherein

the display unit displays the image data published by the information processing apparatus, and

the control unit designates the range-finding point with respect to the image data published by the information processing apparatus, according to the signal from the input unit.

13. The terminal apparatus according to claim 11 , wherein

the display unit displays the image data before the image data is registered in the information processing apparatus, and

the control unit:

designates the range-finding point with respect to the image data before the image data is registered in the information processing apparatus, according to the signal from the input unit, and

registers the image data in which the range-finding point is designated in the information processing apparatus through the communication unit.

14. An information processing system, comprising:

an information processing apparatus that:

collects image data,

uses a plurality of the collected image data to extract an object position included in the image data,

performs a training process regarding a relationship between the image data and the object position, wherein a range-finding point is designated in the image data used in the training process,

creates a trained model for an automatic focal point adjustment that specifies an object from the image data to specify a focal position, and

outputs the trained model to a device requesting the trained model;

a terminal apparatus that acquires the trained model from the information processing apparatus; and

an electronic device that:

acquires the trained model from the terminal apparatus; and

performs the automatic focal point adjustment based on the trained model.

15. An information processing system, comprising:

an information processing apparatus that:

collects image data,

uses a plurality of the collected image data to extract an object position included in the image data,

performs a training process regarding a relationship between the image data and the object position, wherein a range-finding point is designated in the image data used in the training process,

creates a trained model for an automatic focal point adjustment that specifies an object from the image data to specify a focal position, and

outputs the trained model to a device requesting the trained model; and

an electronic device that:

acquires the trained model from the information processing apparatus; and

performs the automatic focal point adjustment based on the trained model.

16. An information processing method, comprising:

collecting image data;

using a plurality of the collected image data to extract an object position included in the image data;

performing a training process regarding a relationship between the image data and the object position, wherein a range-finding point is designated in the image data used in the training process;

creating a trained model for an automatic focal point adjustment that specifies an object from the image data to specify a focal position; and

outputting the created trained model to a device requesting the trained model.

17. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

collecting image data;

using a plurality of the collected image data to extract an object position included in the image data;

performing a training process regarding a relationship between the image data and the object position, wherein a range-finding point is designated in the image data used in the training process;

creating a trained model for an automatic focal point adjustment of an electronic device that specifies an object from the image data to specify a focal position; and

outputting the created trained model to a device requesting the trained model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2022
From: TSUJIMURA, TAKASHI
To: SONY GROUP CORPORATION
Reel/Frame 059289/0818 →
Priority Claims (1)
JP 2019-176855 · Sep 27, 2019 · national
Continuity (1)
Related Publication 20230353872A1 · Nov 2, 2023