IP Library › Granted Patent US 12,256,137
Granted Patent B2
US 12,256,137 · App. 17/914,136 · Granted Mar 18, 2025

Information processing apparatus, information processing method, and program

Inventors: Hiroshi Ikeda (Tokyo, JP); Takashi Itou (Saitama, JP)
Assignee: SONY GROUP CORPORATION
H04N23/61H04N5/2628H04N23/64H04N23/69H04N23/695H04N5/268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,256,137
App. No.
17/914,136
Granted
Mar 18, 2025
Kind
B2
Abstract

There is provided an information processing apparatus, an information processing method, and a program capable of easily obtaining a captured image with an appropriate angle of view with a small number of imaging apparatuses. The information processing apparatus includes: a view angle candidate setting unit configured to set a plurality of candidates for an angle of view from a captured image range that can be captured by a first imaging apparatus with respect to a predetermined imaging space; and an imaging view angle setting unit configured to set an imaging angle of view of the first imaging apparatus on a basis of the plurality of candidates for the angle of view. The present technology can be applied to, for example, a system that captures a television broadcast program, or the like.

Claims (48)

1. An information processing apparatus comprising:

a view angle candidate setting unit configured to set a plurality of candidates for an angle of view from a captured image range that can be captured by a first imaging apparatus with respect to a predetermined imaging space; and

an imaging view angle setting unit configured to set an imaging angle of view of the first imaging apparatus based on the plurality of candidates for the angle of view,

wherein the view angle candidate setting unit sets the plurality of candidates for the angle of view based on a situation of the imaging space recognized based on a captured image captured by a second imaging apparatus, and

wherein the view angle candidate setting unit and the imaging view angle setting unit are each implemented via at least one processor.

2. The information processing apparatus according to claim 1 , further comprising:

a recognition unit configured to recognize the situation of the imaging space based on the captured image obtained by imaging the imaging space,

wherein the recognition unit is implemented via at least one processor.

3. The information processing apparatus according to claim 2 ,

wherein the recognition unit recognizes a main subject which is a main subject in the imaging space and a related subject related to the main subject, as the situation of the imaging space, and

wherein the view angle candidate setting unit sets the candidates for the angle of view based on the recognized main subject and related subject.

4. The information processing apparatus according to claim 3 ,

wherein the recognition unit recognizes content of a scene in the imaging space as the situation of the imaging space, and

wherein the view angle candidate setting unit sets the candidates for the angle of view further based on the content of the scene.

5. The information processing apparatus according to claim 2 ,

wherein the recognition unit recognizes the situation of the imaging space based on the captured image captured by the first imaging apparatus, and

wherein the imaging view angle setting unit sets the imaging angle of view to a wide angle of view having a largest field of view at a predetermined timing.

6. The information processing apparatus according to claim 5 ,

wherein the imaging view angle setting unit sets the imaging angle of view to the wide angle of view in a case where a main subject that is a main subject in the imaging space does not exist in the captured image captured by the first imaging apparatus.

7. The information processing apparatus according to claim 1 ,

wherein the imaging view angle setting unit sets the imaging angle of view so as to include the plurality of candidates for the angle of view.

8. The information processing apparatus according to claim 7 ,

wherein the imaging view angle setting unit selects the candidates for the angle of view to be included in the imaging angle of view so that resolution of a main candidate for the angle of view is equal to or greater than a predetermined threshold value, the main candidate for the angle of view being estimated to be important among the plurality of candidates for the angle of view.

9. The information processing apparatus according to claim 8 , further comprising:

a recognition unit configured to recognize the situation of the imaging space based on a captured image obtained by imaging the imaging space, wherein the view angle candidate setting unit selects the main candidate for the angle of view from the plurality of candidates for the angle of view based on at least one of the situation of the imaging space or a usage of the captured image captured by the first imaging apparatus, and

wherein the recognition unit is implemented via at least one processor.

10. The information processing apparatus according to claim 7 ,

wherein the imaging view angle setting unit sets, as the imaging angle of view, a region in which a rectangular region including the plurality of candidates for the angle of view is provided with a margin in at least one direction.

11. The information processing apparatus according to claim 7 , further comprising:

a cutting out unit configured to cut out an image of an angle of view corresponding to at least one of the candidates for the angle of view from the captured image captured by the first imaging apparatus,

wherein the cutting out unit is implemented via at least one processor.

12. The information processing apparatus according to claim 11 ,

wherein the cutting out unit cuts out images of a plurality of angles of view respectively corresponding to the candidates for the angle of view from the captured image captured by the first imaging apparatus.

13. The information processing apparatus according to claim 1 , further comprising:

a view angle control unit configured to control panning, tilting, and zooming of the first imaging apparatus so as to achieve the set imaging angle of view,

wherein the view angle control unit is implemented via at least one processor.

14. The information processing apparatus according to claim 13 ,

wherein the view angle control unit controls a driving speed of panning, tilting, and zooming of the first imaging apparatus based on whether or not a predetermined role is assigned to the captured image captured by the first imaging apparatus.

15. The information processing apparatus according to claim 1 ,

wherein the information processing apparatus is provided in the first imaging apparatus.

16. An information processing method, executed by at least one processor of an information processing apparatus, the method comprising:

setting a plurality of candidates for an angle of view from a captured image range that can be captured by an imaging apparatus with respect to a predetermined imaging space; and

setting an imaging angle of view of the imaging apparatus based on the plurality of candidates for the angle of view,

wherein the plurality of candidates for the angle of view are set based on a situation of the imaging space recognized based on a captured image captured by a second imaging apparatus.

17. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute an information processing method, the method comprising:

setting a plurality of candidates for an angle of view from a captured image range that can be captured by an imaging apparatus with respect to a predetermined imaging space; and

setting an imaging angle of view angle of the imaging apparatus based on the plurality of candidates for the angle of view,

wherein the plurality of candidates for the angle of view are set based on a situation of the imaging space recognized based on a captured image captured by a second imaging apparatus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2022
From: IKEDA, HIROSHI; ITOU, TAKASHI
To: SONY GROUP CORPORATION
Reel/Frame 061197/0185 →
Priority Claims (1)
JP 2020-062196 · Mar 31, 2020 · national
Continuity (1)
Related Publication 20230328355A1 · Oct 12, 2023
References Cited (24)
US 8860780B1 · Davey · 2014 [cited by examiner]
US 9591364B2 · Kinoshita · 2017 [cited by examiner]
US 9699378B2 · Miyamoto · 2017 [cited by examiner]
US 9876993B2 · Sablak · 2018 [cited by examiner]
US 10547774B2 · Kinoshita · 2020 [cited by examiner]
US 11012614B2 · Kinoshita · 2021 [cited by examiner]
US 20090268079A1 · Motomura · 2009 [cited by examiner]
US 20100103192A1 · Fukumoto · 2010 [cited by examiner]
US 20100141767A1 · Mohanty · 2010 [cited by examiner]
US 20110285808A1 · Feng · 2011 [cited by examiner]
US 20120044347A1 · Sugio · 2012 [cited by examiner]
US 20120081510A1 · Miyamoto · 2012 [cited by examiner]
US 20130342720A1 · Azami · 2013 [cited by examiner]
US 20140081956A1 · Yuki · 2014 [cited by examiner]
US 20150350523A1 · Kinoshita · 2015 [cited by examiner]
US 20150373414A1 · Kinoshita · 2015 [cited by examiner]
US 20170220871A1 · Ikeda · 2017 [cited by examiner]
US 20180278852A1 · Lin · 2018 [cited by examiner]
US 20200059595A1 · Ono · 2020 [cited by examiner]
US 20200120262A1 · Kinoshita · 2020 [cited by examiner]
JP 2007134845A · 2007 [cited by applicant]
JP 2008072261A · 2008 [cited by applicant]
JP 2011101165A · 2011 [cited by applicant]
JP 2012060510A · 2012 [cited by applicant]