IP Library › Granted Patent US 12,470,679
Granted Patent B2
US 12,470,679 · App. 18/272,489 · Granted Nov 11, 2025

Information processing device, information processing method, program, and display system

Inventors: Sho Ogura (Kanagawa, JP); Yoshihiro Yoshioka (Kanagawa, JP); Keiichi Yoshioka (Tokyo, JP); Jun Yoshikawa (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
H04N13/117H04N13/282H04N13/349H04N13/398
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,470,679
App. No.
18/272,489
Granted
Nov 11, 2025
Kind
B2
Abstract

An information processing device according to the present technology includes a display control unit that controls a display of rotation center position information on a target space captured image that is an image in which a real space for which a free-viewpoint image is to be generated is captured, the rotation center position information indicating a position of viewpoint rotation center of the free-viewpoint image.

Claims (56)

1 . An information processing device comprising:

circuitry configured to

determine rotation center position information with respect to a plurality of images captured by a plurality of imaging devices, and

control display of the determined rotation center position information on a target space captured image captured by one of the plurality of imaging devices,

wherein the target space captured image is an image capturing a real space for which a free-viewpoint image is generated using the plurality of images,

wherein the rotation center position information indicates a position of viewpoint rotation center of the free-viewpoint image generated from a start imaging device at a start viewpoint of the free-viewpoint image to an end imaging device at an end viewpoint of the free-viewpoint image, and

wherein the circuitry is further configured to control display of an imaging device path indicated by imaging device path information from the start viewpoint to the end viewpoint, the imaging device path determining the rotation center position information.

2 . The information processing device according to claim 1 ,

wherein the rotation center position information includes information indicating a height of the viewpoint rotation center.

3 . The information processing device according to claim 1 ,

wherein the circuitry controls the display of the determined rotation center position information by displaying information indicating a specifiable range of the viewpoint rotation center on the target space captured image.

4 . The information processing device according to claim 3 ,

wherein the circuitry is further configured to receive an operation on the displayed rotation center position information, and

wherein the circuitry receives only an operation to specify the position of the viewpoint rotation center within the specifiable range as a valid position specification operation.

5 . The information processing device according to claim 1 ,

wherein the circuitry controls a display of information indicating an image frame of the free-viewpoint image on the target space captured image.

6 . The information processing device according to claim 1 ,

wherein the target space captured image is a captured image from at least one of the start imaging device at the start viewpoint of the free-viewpoint image and the end imaging device at the end viewpoint of the free-viewpoint image.

7 . The information processing device according to claim 6 ,

wherein the start imaging device and the end imaging device are determined based on the imaging device path information.

8 . The information processing device according to claim 1 ,

wherein the circuitry determines the rotation center position information based on a result of image recognition processing on the target space captured image.

9 . The information processing device according to claim 5 ,

wherein the circuitry determines the image frame based on a result of image recognition processing on the target space captured image.

10 . The information processing device according to claim 6 ,

wherein the target space captured image includes the captured image from the start imaging device and the captured image from the end imaging device.

11 . The information processing device according to claim 1 ,

wherein the circuitry is further configured to

receive an operation on the displayed rotation center position information, and

generate the free-viewpoint image based on information on the viewpoint rotation center set based on the received operation.

12 . The information processing device according to claim 1 ,

wherein the circuitry controls the display of the determined rotation so that the rotation center position information is displayed in a display area for the information on the camera path.

13 . The information processing device according to claim 1 ,

wherein the circuitry is further configured to receive an operation on the information on imaging device path as an operation to adjust a shape of a viewpoint movement trajectory indicated by imaging device path information.

14 . The information processing device according to claim 1 ,

wherein the circuitry controls the determined rotation center position to be displayed immediately after the imaging device path information is specified.

15 . An information processing method comprising:

determining, by an information processing device, rotation center position information with respect to a plurality of images captured by a plurality of imaging devices; and

controlling, by the information processing device, display of the determined rotation center position information on a target space captured image captured by one of the plurality of imaging devices,

wherein the target space captured image is an image capturing a real space for which a free-viewpoint image is generated using the plurality of images,

wherein the rotation center position information indicates a position of viewpoint rotation center of the free-viewpoint image generated from a start imaging device at a start viewpoint of the free-viewpoint image to an end imaging device at an end viewpoint of the free-viewpoint image, and

wherein the method further comprises controlling display of an imaging device path indicated by imaging device path information from the start viewpoint to the end viewpoint, the imaging device path determining the rotation center position information.

16 . A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer device causes the computer device to implement a function of execute a method, the method comprising:

determining rotation center position information with respect to a plurality of images captured by a plurality of imaging devices; and

controlling display of the determined rotation center position information on a target space captured image captured by one of the plurality of imaging devices,

wherein the target space captured image is an image capturing a real space for which a free-viewpoint image is generated using the plurality of images,

wherein the rotation center position information indicates a position of viewpoint rotation center of the free-viewpoint image generated from a start imaging device at a start viewpoint of the free-viewpoint image to an end imaging device at an end viewpoint of the free-viewpoint image, and

wherein the method further comprises controlling display of an imaging device path indicated by imaging device path information from the start viewpoint to the end viewpoint, the imaging device path determining the rotation center position information.

17 . A display system comprising:

a display device configured to display an image; and

circuitry configured to

determine rotation center position information with respect to a plurality of images captured by a plurality of imaging devices, and

control, in the display device, display of the determined rotation center position information on a target space captured image captured by one of the plurality of imaging devices,

wherein the target space captured image is an image capturing a real space for which a free-viewpoint image is generated using the plurality of images,

wherein the rotation center position information indicates a position of viewpoint rotation center of the free-viewpoint image generated from a start imaging device at a start viewpoint of the free-viewpoint image to an end imaging device at an end viewpoint of the free-viewpoint image, and

wherein the circuitry is further configured to control, in the display device, display of an imaging device path indicated by imaging device path information from the start viewpoint to the end viewpoint, the imaging device path determining the rotation center position information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2023
From: OGURA, SHO; YOSHIOKA, YOSHIHIRO; YOSHIOKA, KEIICHI; YOSHIKAWA, JUN
To: SONY GROUP CORPORATION
Reel/Frame 064261/0738 →
Priority Claims (1)
JP 2021-028706 · Feb 25, 2021 · national
Continuity (1)
Related Publication 20240314279A1 · Sep 19, 2024
References Cited (11)
US 20080088706A1 · Girgensohn · 2008 [cited by examiner]
US 20130107020A1 · Hashimoto · 2013 [cited by examiner]
US 20190158801A1 · Matsubayashi · 2019 [cited by examiner]
US 20190172271A1 · Yasuda · 2019 [cited by examiner]
US 20200226736A1 · Kar · 2020 [cited by examiner]
JP 2015114716A · 2015 [cited by applicant]
JP 2019045995A · 2019 [cited by applicant]
JP 2019056978A · 2019 [cited by applicant]
JP 2020021104A · 2020 [cited by applicant]
JP 2020173529A · 2020 [cited by applicant]
WO WO2018030206A1 · 2018 [cited by applicant]