IP Library Granted Patent US 12,418,715
Granted Patent B2
US 12,418,715 · App. 18/033,197 · Granted Sep 16, 2025

Information processing device, information processing method, and program

Inventors: Yuki Nakai (Kanagawa, JP); Hironori Hattori (Tokyo, JP); Kazuto Kanda (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
H04N23/633H04N7/181H04N23/61H04N23/632H04N23/90H04N23/69H04N23/695
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,418,715
App. No.
18/033,197
Granted
Sep 16, 2025
Kind
B2
Abstract

There is provided an information processing device that includes a control unit configured to perform image-capture control on the basis of image-capture rendering information indicating a change in captured image and image-capture target information indicating an image-capture target. The term “image-capture” used herein means an operation for obtaining an image using a camera, the “camera” being defined as both a real camera and a virtual camera that virtually changes composition by clipping a part of an image obtained as a result of a light-receiving operation of the real camera.

Claims (52)

1. An information processing device comprising:

circuitry configured to:

acquire image-capture rendering information indicating a change in visual rendering mode pertaining to captured image and image-capture target information including information indicating a person being an image-capture target and information indicating an image-capture target range pertaining to a range in which part of the person is contained in the captured image; and

perform image-capture control to track and capture the person being the image-capture target so that the part of the person indicated by the image-capture target range is included in the captured image based on the acquired image-capture target range with an image-capture rendering mode corresponding to the image-capture rendering information.

2. The information processing device according to claim 1 , wherein

the person being the image-capture target is a person selected from among candidates.

3. The information processing device according to claim 1 , wherein

the person being the image-capture target is a person recognized in a designated area of an image-capture target space.

4. The information processing device according to claim 1 , wherein

the image-capture target information includes information indicating a position in an image-capture target space.

5. The information processing device according to claim 1 , wherein

the information indicating the image-capture target range corresponds to information indicating a range of positions relative to the person in which an image of an instrument is captured in a case where the instrument is in use by the person being the image-capture target.

6. The information processing device according to claim 1 , wherein

the image-capture control includes at least any one of pan control, tilt control, or zoom control for a real camera.

7. The information processing device according to claim 1 , wherein

the image-capture control includes image-clipping control for an image captured by a real camera.

8. The information processing device according to claim 1 , wherein

the image-capture rendering information includes rendering information regarding zoom.

9. The information processing device according to claim 8 , wherein

the image-capture rendering information corresponds to information including at least any one of a zoom speed, a zoom start angle of view, or a zoom end angle of view.

10. The information processing device according to claim 1 , wherein

the image-capture rendering information includes rendering information regarding camera shake.

11. The information processing device according to claim 1 , wherein

the image-capture rendering information includes rendering information regarding focus.

12. The information processing device according to claim 1 , wherein the circuitry is further configured to:

receive selection of information to be applied to the image-capture control from among a plurality of types of information for at least any one of the image-capture rendering information or the image-capture target information; and

perform display control of a selection reception screen for receiving selection of the information to be applied.

13. The information processing device according to claim 12 , wherein

a plurality of cameras to be subject to the image-capture control is provided, and

the circuitry is further configured to receive the selection of the image-capture target, the image-capture target range, or the image-capture rendering mode corresponding to each camera of the plurality of cameras.

14. The information processing device according to claim 13 , wherein

the circuitry is further configured to perform, as the image-capture control, display control of an operation panel on which an execution instruction operation element of control based on the image-capture rendering information or the image-capture target information selected on the selection reception screen is deployed,

the circuitry is capable of receiving a plurality of sets of the selection for each of the cameras, and

the circuitry is further configured to perform control to display the operation panel for each of the sets.

15. The information processing device according to claim 1 , the information processing device functioning as a part of an image processing system capable of switching an output image among images captured by a plurality of cameras, wherein

the circuitry is further configured to perform, on a basis of control information regarding the switching of the output image, the image-capture control based on the image-capture rendering information.

16. The information processing device according to claim 15 , wherein

the circuitry is further configured to start, in response to selection of the output image or a next output candidate image from among the images captured by the plurality of cameras, the control for an image-capture source camera of the selected captured image.

17. An information processing method comprising:

acquiring image-capture rendering information indicating a change in visual rendering mode pertaining to captured image and image-capture target information including information indicating a person being an image-capture target and information indicating an image-capture target range pertaining to a range in which part of the person is contained in the captured image; and

performing image-capture control to track and capture the person being the image-capture target so that the part of the person indicated by the image-capture target range is included in the captured image based on the acquired image-capture target range with an image-capture rendering mode corresponding to the image-capture rendering information.

18. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an information processing method, the method comprising:

acquiring image-capture rendering information indicating a change in visual rendering mode pertaining to captured image and image-capture target information including information indicating a person being an image-capture target and information indicating an image-capture target range pertaining to a range in which part of the person is contained in the captured image; wherein

performing image-capture control to track and capture the person being the image-capture target so that the part of the person indicated by the image-capture target range is included in the captured image based on the acquired image-capture target range with an image-capture rendering mode corresponding to the image-capture rendering information.

19. The information processing device according to claim 13 , wherein

the circuitry is further configured to perform, as the display control of the selection reception screen, display control of a screen capable of receiving the selection for the plurality of cameras.

20. The information processing device according to claim 1 ,

wherein the circuitry is further configured to perform image-capture control as a composition based on the image-capture target, the image-capture target range, and the image-capture rendering information.

21. The information processing device according to claim 20 , wherein

the circuitry is further configured to receive the selection of rate of change in composition and perform image-capture control changing from current composition to other composition based on the rate of change in the composition.

22. The information processing device according to claim 20 , wherein

the circuitry is further configured to perform image-capture control to maintain the current composition for a predetermined time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2023
From: NAKAI, YUKI; HATTORI, HIRONORI; KANDA, KAZUTO
To: SONY GROUP CORPORATION
Reel/Frame 063428/0421 →
Priority Claims (1)
JP 2020-181260 · Oct 29, 2020 · national
Continuity (1)
Related Publication 20230396873A1 · Dec 7, 2023
References Cited (14)
US 9167134B2 · Hirano · 2015 [cited by examiner]
US 10825226B2 · Cotter · 2020 [cited by examiner]
US 20170111576A1 · Tojo · 2017 [cited by examiner]
US 20190089886A1 · Hattori · 2019 [cited by examiner]
CA 2736750A1 · 2010 [cited by examiner]
JP 2008288745A · 2008 [cited by applicant]
JP 2008301355A · 2008 [cited by applicant]
JP 2010016878A · 2010 [cited by applicant]
JP 2013190569A · 2013 [cited by applicant]
JP 2014057174A · 2014 [cited by applicant]
JP 5560397B2 · 2014 [cited by examiner]
JP 2014209768A · 2014 [cited by applicant]
JP 2019180017A · 2019 [cited by examiner]
Cristian Vater et al., of “Detecting single-target changes in multiple object tracking: The case of peripheral vision”, (2016) DOI 10.3758/s13414-016-1078-7 (Year: 2016). [cited by examiner]