IP Library › Granted Patent US 12,206,838
Granted Patent B2
US 12,206,838 · App. 17/484,264 · Granted Jan 21, 2025

View-independent multi-camera volumetric capture system

Inventors: Tobias Anderberg (Los Angeles, CA); David Bailey (Los Angeles, CA)
Assignees: Sony Group Corporation; Sony Pictures Entertainment, Inc.
H04N13/388G06T19/006H04N13/243G06T2207/10021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,206,838
App. No.
17/484,264
Granted
Jan 21, 2025
Kind
B2
Abstract

Reducing data used during capture in a physical capture volume by selectively activating image capture devices from a virtual view, including: setting up a virtual camera to receive information about and visualize the physical capture volume and a plurality of image capture devices in the virtual view; providing, to the virtual camera, the virtual view of the physical capture volume with a capability to move around the physical capture volume and activate or deactivate each of the plurality of image capture devices; calculating a view frustum, wherein the view frustum is a region of 3-D space within the physical capture volume that would appear on a view screen of the virtual camera; and defining the view frustum of the virtual camera which intersects with the plurality of image capture devices defined in the virtual view.

Claims (45)

1. A system to reduce data used during capture using a virtual camera in a physical capture volume, the system comprising:

a visual display to display a visual representation of the virtual camera;

a processor to control the visual representation of the virtual camera;

a volumetric capture system in communication with the processor and the visual display,

wherein the volumetric capture system includes a plurality of image capture devices,

wherein the virtual camera provides a birds-eye-view and a capability to move around the physical capture volume and activate or deactivate each of the plurality of image capture devices,

wherein the capability to activate or deactivate includes selectively activating at least one of the plurality of image capture devices from a virtual view to reduce data used during the capture,

wherein selectively activating includes calculating a view frustum which is a region of 3-D space within the capture volume that would appear on a view screen of the virtual camera,

wherein the virtual camera receives information about and visualizes the volumetric capture system and the plurality of image capture devices in the virtual world.

2. The system of claim 1 , wherein the plurality of image capture devices is arranged in a dome-like structure.

3. The system of claim 2 , wherein the virtual camera further provides a capability to move around the dome-like structure.

4. The system of claim 1 , wherein the virtual camera has a number of settings associated with it including aperture, focal length, focus, and other device parameters.

5. The system of claim 1 , wherein the processor includes data about each of the plurality of image capture devices.

6. The system of claim 1 , wherein the processor is configured to calculate the view frustum which is a region of 3-D space within the volumetric capture system that would appear on the view screen.

7. A method of reducing data used during capture in a physical capture volume, the method comprising:

setting up a virtual camera to receive information about and visualize the physical capture volume and a plurality of image capture devices in the virtual view;

providing, to the virtual camera, a virtual view of the physical capture volume with a capability to move around the physical capture volume and activate or deactivate each of the plurality of image capture devices,

wherein the capability to activate or deactivate includes selectively activating at least one of the plurality of image capture devices from the virtual view to reduce data used during the capture;

calculating a view frustum, wherein the view frustum is a region of 3-D space within the physical capture volume that would appear on a view screen of the virtual camera; and

defining the view frustum of the virtual camera which intersects with the plurality of image capture devices defined in the virtual view,

wherein the virtual camera receives information about and visualizes the physical capture volume and the plurality of image capture devices.

8. The method of claim 7 , further comprising

arranging the plurality of image capture devices in a dome-like structure surrounding the physical capture volume.

9. The method of claim 7 , further comprising

arranging the plurality of image capture devices sequentially on posts.

10. The method of claim 7 , wherein the virtual camera has a number of associated settings including aperture, focal length, focus, and other device parameters.

11. The method of claim 10 , wherein defining the view frustum includes

defining the view frustum using the number of associated settings on the virtual camera.

12. The method of claim 7 , further comprising

activating only devices of the plurality of image capture devices that are intersected by the virtual view frustum.

13. The method of claim 7 , further comprising

deactivating devices of the plurality of image capture devices that are not intersected by the virtual view frustum.

14. A non-transitory computer-readable storage medium storing a computer program to reduce data used during capture in a physical capture volume, the computer program comprising executable instructions that cause a computer to:

setup a virtual camera to receive information about and visualize the physical capture volume and a plurality of image capture devices in the virtual view;

provide, to the virtual camera, a virtual view of the physical capture volume with a capability to move around the physical capture volume and activate or deactivate each of the plurality of image capture devices,

wherein the capability to activate or deactivate includes selectively activating at least one of the plurality of image capture devices from the virtual view to reduce data used during the capture;

calculate a view frustum, wherein the view frustum is a region of 3-D space within the physical capture volume that would appear on a view screen of the virtual camera; and

define the view frustum of the virtual camera which intersects with the plurality of image capture devices defined in the virtual view,

wherein the virtual camera receives information about and visualizes the physical capture volume and the plurality of image capture devices.

15. The computer-readable storage medium of claim 14 , further comprising executable instructions that cause the computer to arrange the plurality of image capture devices in a dome-like structure surrounding the physical capture volume.

16. The computer-readable storage medium of claim 14 , further comprising executable instructions that cause the computer to arrange the plurality of image capture devices sequentially on posts.

17. The computer-readable storage medium of claim 14 , wherein the virtual camera has a number of associated settings including aperture, focal length, focus, and other device parameters.

18. The computer-readable storage medium of claim 17 , wherein the executable instructions that cause the computer to define the view frustum includes executable instructions that cause the computer to define the view frustum using the number of associated settings on the virtual camera.

19. The computer-readable storage medium of claim 14 , further comprising executable instructions that cause the computer to activate only devices of the plurality of image capture devices that are intersected by the virtual view frustum.

20. The computer-readable storage medium of claim 14 , further comprising executable instructions that cause the computer to deactivate devices of the plurality of image capture devices that are not intersected by the virtual view frustum.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2021
From: ANDERBERG, TOBIAS; BAILEY, DAVID
To: SONY GROUP CORPORATION; SONY PICTURES ENTERTAINMENT INC.
Reel/Frame 057835/0150 →
Continuity (1)
Related Publication 20230101991A1 · Mar 30, 2023
References Cited (23)
US 9573062B1 · Long et al. · 2017 [cited by applicant]
US 10771763B2 · Zavesky et al. · 2020 [cited by applicant]
US 10951879B2 · Besley · 2021 [cited by applicant]
US 20120098925A1 · Dasher et al. · 2012 [cited by applicant]
US 20140300602A1 · Nam · 2014 [cited by examiner]
US 20180197324A1 · Kaisha · 2018 [cited by applicant]
US 20180367709A1 · Takama · 2018 [cited by applicant]
US 20190174122A1 · Besley · 2019 [cited by examiner]
US 20190364265A1 · Matsunobu · 2019 [cited by applicant]
US 20200184710A1 · Besley · 2020 [cited by examiner]
US 20200388073A1 · Mall · 2020 [cited by applicant]
US 20210035354A1 · Williams · 2021 [cited by examiner]
US 20210134058A1 · Ito · 2021 [cited by examiner]
US 20210266511A1 · Ogasawara · 2021 [cited by examiner]
US 20210383172A1 · Gruber · 2021 [cited by examiner]
US 20220139027A1 · Luo · 2022 [cited by examiner]
CN 112150575A · 2020 [cited by applicant]
EP 1480450A2 · 2004 [cited by applicant]
EP 3586269A1 · 2020 [cited by applicant]
EP 3668093A1 · 2020 [cited by applicant]
WO 2018164852A1 · 2018 [cited by applicant]
WO 2018112498A1 · 2020 [cited by applicant]
International Search Report in PCT/US2022/013418, Federal Institute of Industrial Property, May 5, 2022, 2pgs. [cited by applicant]