IP Library › Granted Patent US 12,597,445
Granted Patent B2
US 12,597,445 · App. 18/054,690 · Granted Apr 7, 2026

Collaborative enhancement of volumetric video with a device having multiple cameras

Inventors: Sarbajit K. Rakshit (Kolkata, IN); Vinod A. Valecha (Pune, IN)
Assignee: International Business Machines Corporation
G11B27/036G06F3/1454H04N13/167H04N13/172H04N13/189H04N13/302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,597,445
App. No.
18/054,690
Granted
Apr 7, 2026
Kind
B2
Abstract

Provided are techniques for collaborative enhancement of volumetric video with a device having multiple cameras. A volumetric video is displayed as a holographic projection. In response to identifying one or more user actions of a user at the device with the holographic projection of the volumetric video, the volumetric video is updated and an updated holographic projection that indicates the one or more user actions of the user is displayed. Additional content is received for the updated volumetric video from a plurality of other devices, where the additional content comprises one or more user actions of other users at the plurality of other devices. The additional content is aggregated to generate an aggregated volumetric video that indicates the one or more user actions of the user and the one or more user actions of the other users. A further updated holographic projection based on the aggregated volumetric video is displayed.

Claims (70)

1 . A method implemented in a device, comprising operations for:

displaying a volumetric video as a holographic projection;

in response to identifying one or more user actions of a user at the device with the holographic projection of the volumetric video,

updating the volumetric video; and

displaying an updated holographic projection of the updated volumetric video that indicates the one or more user actions of the user;

receiving additional content for the updated volumetric video from a plurality of other devices, wherein the additional content comprises one or more user actions of other users at the plurality of other devices;

aggregating the additional content from the plurality of other devices with the updated volumetric video to generate an aggregated volumetric video that indicates the one or more user actions of the user and the one or more user actions of the other users; and

displaying a further updated holographic projection based on the aggregated volumetric video.

2 . The method implemented in the device of claim 1 , further comprising operations for:

sending the updated volumetric video to the plurality of other devices.

3 . The method implemented in the device of claim 1 , further comprising operations for:

providing a recommendation of a folding angle for a display screen of the device.

4 . The method implemented in the device of claim 1 , further comprising operations for:

capturing the one or more user actions from different directions using multiple cameras.

5 . The method implemented in the device of claim 1 , further comprising operations for:

receiving text input;

updating the aggregated volumetric video with the text input; and

displaying a yet further updated holographic projection of the updated aggregated volumetric video with the text input.

6 . The method implemented in the device of claim 1 , further comprising operations for:

receiving voice input;

updating the aggregated volumetric video with the voice input; and

displaying a yet further updated holographic projection of the updated aggregated volumetric video with the voice input.

7 . The method implemented in the device of claim 1 , wherein users at the device and at the plurality of other devices work collaboratively on the volumetric video.

8 . A computer program product, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable by at least one processor of a device to perform operations for:

displaying a volumetric video as a holographic projection;

in response to identifying one or more user actions of a user at the device with the holographic projection of the volumetric video,

updating the volumetric video; and

displaying an updated holographic projection of the updated volumetric video that indicates the one or more user actions of the user;

receiving additional content for the updated volumetric video from a plurality of other devices, wherein the additional content comprises one or more user actions of other users at the plurality of other devices;

aggregating the additional content from the plurality of other devices with the updated volumetric video to generate an aggregated volumetric video that indicates the one or more user actions of the user and the one or more user actions of the other users; and

displaying a further updated holographic projection based on the aggregated volumetric video.

9 . The computer program product of claim 8 , wherein the program code is executable by the at least one processor to perform further operations for:

sending the updated volumetric video to the plurality of other devices.

10 . The computer program product of claim 8 , wherein the program code is executable by the at least one processor to perform further operations for:

providing a recommendation of a folding angle for a display screen of the device.

11 . The computer program product of claim 8 , wherein the program code is executable by the at least one processor to perform further operations for:

capturing the one or more user actions from different directions using multiple cameras.

12 . The computer program product of claim 8 , wherein the program code is executable by the at least one processor to perform further operations for:

receiving text input;

updating the aggregated volumetric video with the text input; and

displaying a yet further updated holographic projection of the updated aggregated volumetric video with the text input.

13 . The computer program product of claim 8 , wherein the program code is executable by the at least one processor to perform further operations for:

receiving voice input;

updating the aggregated volumetric video with the voice input; and

displaying a yet further updated holographic projection of the updated aggregated volumetric video with the voice input.

14 . The computer program product of claim 8 , wherein users at the device and at the plurality of other devices work collaboratively on the volumetric video.

15 . A device, comprising:

one or more processors, one or more computer-readable memories and one or more computer-readable, tangible storage devices; and

program instructions, stored on at least one of the one or more computer-readable, tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to perform operations comprising:

displaying a volumetric video as a holographic projection;

in response to identifying one or more user actions of a user at the device with the holographic projection of the volumetric video,

updating the volumetric video; and

displaying an updated holographic projection of the updated volumetric video that indicates the one or more user actions of the user;

receiving additional content for the updated volumetric video from a plurality of other devices, wherein the additional content comprises one or more user actions of other users at the plurality of other devices;

aggregating the additional content from the plurality of other devices with the updated volumetric video to generate an aggregated volumetric video that indicates the one or more user actions of the user and the one or more user actions of the other users; and

displaying a further updated holographic projection based on the aggregated volumetric video.

16 . The device of claim 15 , wherein the operations further comprise:

sending the updated volumetric video to the plurality of other devices.

17 . The device of claim 15 , wherein the operations further comprise:

providing a recommendation of a folding angle for a display screen of the device.

18 . The device of claim 15 , wherein the operations further comprise:

capturing the one or more user actions from different directions using multiple cameras.

19 . The device of claim 15 , wherein the operations further comprise:

receiving text input;

updating the aggregated volumetric video with the text input; and

displaying a yet further updated holographic projection of the updated aggregated volumetric video with the text input.

20 . The device of claim 15 , wherein the operations further comprise:

receiving voice input;

updating the aggregated volumetric video with the voice input; and

displaying a yet further updated holographic projection of the updated aggregated volumetric video with the voice input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2022
From: RAKSHIT, SARBAJIT K.; VALECHA, VINOD A.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 061783/0224 →
Continuity (1)
Related Publication 20240161784A1 · May 16, 2024
References Cited (17)
US 10964104B2 · Duffy · 2021 [cited by applicant]
US 11321919B2 · Horsman · 2022 [cited by applicant]
US 20200169717A1 · Zavesky · 2020 [cited by examiner]
US 20210227178A1 · Lyon · 2021 [cited by examiner]
US 20210368155A1 · Begeja · 2021 [cited by applicant]
“Arcturus Adds Depthkit Support to HoloSuite, Streamlining the Volumetric Video Pipeline”, Acturus, Nov. 9, 2021, 4 pp., [online][retrieved Aug. 17, 2022] https://www.globenewswire.com/en/news-release/2021/11/09/2330730… [cited by applicant]
“HoloPlayer One Turn your 3D data into an interactive hologram”, Geo Week News, Dec. 6, 2017, 6 pp.. [online] [retrieved Aug. 17, 2022] https://www.geoweeknews.com/news/holoplayer-one-simple-platform-turns-3d-data-inter… [cited by applicant]
J. Zhang, et al., “NeuVV: Neural Volumetric Videos with Immersive Rendering and Editing”, arXiv:2202.06.088v1 [cs.CV] Feb. 12, 2022, 18 pp. (available at: https://deepai.org/publication/neuvv-neural-volumetric-videos-wi… [cited by applicant]
“New Integration Create holograms using 4Dviews high quality volumetric video capture system and stream them in 8th Wall WebAR”, 8thWall, Mar. 1, 2022, 6 pp., [online][retrieved Aug. 17, 2022] https://www.8thwall.com/bl… [cited by applicant]
Mell et al., “Effectively and Securely Using the Cloud Computing Paradigm” dated Oct. 7, 2009, NIST, Information Technology Laboratory, 80 pp. [cited by applicant]
Mell et al., “The NIST Definition of Cloud Computing” dated Sep. 2011, Recommendations of the National Institute of Standards and Technology, 7 pp. [cited by applicant]
“Canon and IBM Japan Form Joint Business Operation Utilizing Volumetric Video Technology to Promote the Visual and Performing Arts”, Canon, Jul. 7, 2021, 8 pp. (retrieved from: https://sg.canon/en/consumer/form-joint-ut… [cited by applicant]
J. Antunes, “Canon and IBM: using volumetric video to promote visual arts”, Jul. 13, 2021, 2 pp. (retrieved from: https://www.provideocoalition.com/canon-and-IBM-using-volumetric-video-to-promote-visual-arts/). [cited by applicant]
A. Cohen, “Welcome to the Netaverse, Brooklyn Nets Players Are Seen in a New (3D) Light”, sporttechie.com, Feb. 2, 2022, 6 pp. (retrieved from: https://www.sporttechie.com/welcome-to-the-netaverse-where-brooklyn-nets-pl… [cited by applicant]
“Canon, Inc. and IBM Launch Collaboration in Entertainment and the Arts in Japan”, Jul. 15, 2021, 4 pp. (retrieved from: https://newsroom.ibm.com/2021-07-15-Canon,-Inc-and-IBM-Launch-Collaboration-in-Entertainment-and-t… [cited by applicant]
“Introduction of Foldable Screens”, geeksforgeeks.org, Jun. 3, 2020, updated Sep. 30, 2022, 4 pp. (retrieved from: https://www.geeksforgeeks.org/introduction-of-foldable-screens/). [cited by applicant]
“The business benefits of volumetric video”, Business.bt.com, Jun. 17, 2021, 5 pp. (retrieved from: https://business.bt.com/why-choose-bt/insights/the-future-is-now/transforming-industries-with-volumetric-video). [cited by applicant]