IP Library › Granted Patent US 12,505,670
Granted Patent B2
US 12,505,670 · App. 18/084,053 · Granted Dec 23, 2025

Personalized aggregation of volumetric videos

Inventors: Aaron K. Baughman (Cary, NC); Sarbajit K. Rakshit (Kolkata, IN); Micah Forster (Round Rock, TX); Kavitha Hassan Yogaraj (Bangalore, IN)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06V20/41G06V10/235G06V10/764G06V20/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,505,670
App. No.
18/084,053
Granted
Dec 23, 2025
Kind
B2
Abstract

An embodiment includes selecting, using a first attribute of a first object, the first object in a first volumetric video. The embodiment also includes selecting, using a second attribute of a second object, the second object in a second volumetric video, where the first attribute and the second attribute satisfy an aggregation rule. The embodiment also includes generating an aggregated volumetric video from the first volumetric video and the second volumetric video, where the generating of the aggregated video comprises rendering the first object and the second object simultaneously in the aggregated volumetric video based on the aggregation rule.

Claims (58)

1 . A computer-implemented method comprising:

selecting, using a first attribute of a first object, the first object in a first volumetric video;

selecting, using a second attribute of a second object, the second object in a second volumetric video, wherein the first attribute and the second attribute satisfy an aggregation rule;

generating an aggregated volumetric video from the first volumetric video and the second volumetric video, wherein the generating of the aggregated video comprises rendering the first object and the second object simultaneously in the aggregated volumetric video based on the aggregation rule;

detecting a user input from a user indicative of a selection of the first volumetric video; and

determining whether the user is authorized to view the first volumetric video by comparing a permission rule associated with the user to an access rule associated with the first volumetric video, wherein the generating of the aggregated volumetric video is responsive to determining that the user is authorized to view the first volumetric video.

2 . The method of claim 1 , wherein the selecting of the first object in the first volumetric video comprises using an instance segmentation process, wherein the instance segmentation process comprises classifying a first portion of the first volumetric video as being representative of the first object having the first attribute.

3 . The method of claim 2 , wherein instance segmentation process further comprises:

extracting an image segment from a frame of the first volumetric video;

classifying the extracted image segment using a trained machine-learning based image classifier, wherein the image classifier outputs a segment classification in response to receiving the extracted image segment;

determining that the segment classification output from the image classifier is associated with the first object having the first attribute;

designating, responsive to determining that the segment classification is associated with the first object having the first attribute, the extracted image segment as a depiction of at least some of the first object such that the first portion of the first volumetric video comprises the extracted image segment.

4 . The method of claim 2 , further comprising:

extracting the first portion of the first volumetric video from frames of the first volumetric video; and

inserting the thus extracted first portion of the first volumetric video into frames of a third volumetric video.

5 . The method of claim 4 , further comprising:

extracting a second portion of the second volumetric video from frames of the second volumetric video, wherein the second portion is representative of the second object having the second attribute; and

inserting the thus extracted second portion of the second volumetric video into frames of a third volumetric video.

6 . The method of claim 1 , further comprising:

transmitting the aggregated volumetric video to a user device;

detecting a user input indicative of a selection of the first volumetric video; and

transitioning, responsive to the user input, from transmitting the aggregated volumetric video to the user device to transmitting the first volumetric video to the user device.

7 . The method of claim 1 , further comprising:

transmitting a multiview selection image to a user device, wherein the multiview selection image comprises a preview image associated with the aggregated volumetric video;

detecting a user input indicative of a selection of the preview image; and

transmitting, responsive to the user input, the aggregated volumetric video to the user device.

8 . The method of claim 1 , further comprising:

comparing a first set of aggregation rules associated with a first user to a second set of aggregation rules associated with a second user;

detecting that the first set of aggregation rules matches the second set of aggregation rules, wherein the first set of aggregation rules and the second set of aggregation rules both include said aggregation rule; and

transmitting, responsive to detecting that the first set of aggregation rules matches the second set of aggregation rules, the aggregated volumetric video to the first user and to the second user.

9 . The method of claim 8 , further comprising:

designating, responsive to detecting that the first set of aggregation rules matches the second set of aggregation rules, the first user and the second user for collective aggregation processing.

10 . The method of claim 9 , further comprising:

transmitting, responsive to designating the first user and the second user for collective aggregation processing, the aggregated volumetric video to a first user device associated with the first user and to a second user device associated with the second user.

11 . A computer program product comprising one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions executable by a processor to cause the processor to perform operations comprising:

selecting, using a first attribute of a first object, the first object in a first volumetric video;

selecting, using a second attribute of a second object, the second object in a second volumetric video, wherein the first attribute and the second attribute satisfy an aggregation rule;

generating an aggregated volumetric video from the first volumetric video and the second volumetric video, wherein the generating of the aggregated video comprises rendering the first object and the second object simultaneously in the aggregated volumetric video based on the aggregation rule;

detecting a user input from a user indicative of a selection of the first volumetric video; and

determining whether the user is authorized to view the first volumetric video by comparing a permission rule associated with the user to an access rule associated with the first volumetric video, wherein the generating of the aggregated volumetric video is responsive to determining that the user is authorized to view the first volumetric video.

12 . The computer program product of claim 11 , wherein the stored program instructions are stored in a computer readable storage device in a data processing system, and wherein the stored program instructions are transferred over a network from a remote data processing system.

13 . The computer program product of claim 11 , wherein the stored program instructions are stored in a computer readable storage device in a server data processing system, and wherein the stored program instructions are downloaded in response to a request over a network to a remote data processing system for use in a computer readable storage device associated with the remote data processing system, further comprising:

program instructions to meter use of the program instructions associated with the request; and

program instructions to generate an invoice based on the metered use.

14 . The computer program product of claim 11 , the operations further comprising:

transmitting the aggregated volumetric video to a user device;

detecting a user input indicative of a selection of the first volumetric video; and

transitioning, responsive to the user input, from transmitting the aggregated volumetric video to the user device to transmitting the first volumetric video to the user device.

15 . The computer program product of claim 11 , the operations further comprising:

transmitting a multiview selection image to a user device, wherein the multiview selection image comprises a preview image associated with the aggregated volumetric video;

detecting a user input indicative of a selection of the preview image; and

transmitting, responsive to the user input, the aggregated volumetric video to the user device.

16 . A computer system comprising a processor and one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions executable by the processor to cause the processor to perform operations comprising:

selecting, using a first attribute of a first object, the first object in a first volumetric video;

selecting, using a second attribute of a second object, the second object in a second volumetric video, wherein the first attribute and the second attribute satisfy an aggregation rule;

generating an aggregated volumetric video from the first volumetric video and the second volumetric video, wherein the generating of the aggregated video comprises rendering the first object and the second object simultaneously in the aggregated volumetric video based on the aggregation rule;

detecting a user input from a user indicative of a selection of the first volumetric video; and

determining whether the user is authorized to view the first volumetric video by comparing a permission rule associated with the user to an access rule associated with the first volumetric video, wherein the generating of the aggregated volumetric video is responsive to determining that the user is authorized to view the first volumetric video.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2022
From: BAUGHMAN, AARON K.; RAKSHIT, SARBAJIT K.; FORSTER, MICAH; YOGARAJ, KAVITHA HASSAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 062144/0529 →
Continuity (1)
Related Publication 20240203121A1 · Jun 20, 2024
References Cited (31)
US 10469873B2 · Pang et al. · 2019 [cited by applicant]
US 20160205419A1 · Ricci et al. · 2016 [cited by applicant]
US 20160379055A1 · Loui et al. · 2016 [cited by applicant]
US 20200169715A1 · Liu · 2020 [cited by examiner]
US 20200169717A1 · Zavesky et al. · 2020 [cited by applicant]
US 20200336722A1 · Gibbon et al. · 2020 [cited by applicant]
US 20200413157A1 · Rothschild · 2020 [cited by examiner]
US 20210212658A1 · McGrath et al. · 2021 [cited by applicant]
US 20210225079A1 · Horsman et al. · 2021 [cited by applicant]
US 20210266513A1 · Liu et al. · 2021 [cited by applicant]
US 20220038635A1 · Hutsler et al. · 2022 [cited by applicant]
US 20230026014A1 · Brandt et al. · 2023 [cited by applicant]
US 20240293077A1 · Kumar · 2024 [cited by examiner]
CN 114830676A · 2022 [cited by applicant]
CN 120345236A · 2025 [cited by applicant]
EP 3801284A1 · 2021 [cited by applicant]
WO 2024131437A1 · 2024 [cited by applicant]
ip.com, Method and System for Metaverse Collaboration for Microscopic Object Analysis, Jul. 25, 2022. [cited by applicant]
Zhang et al., Innovating Multi-user Volumetric Video Streaming through Cross-layer Design, HotNets '21, pp. 16-22, Nov. 10-12, 2021. [cited by applicant]
IBM, Canon, Inc. and IBM Launch Collaboration in Entertainment and the Arts in Japan, Jul. 15, 2021, https://newsroom.ibm.com/2021-07-15-Canon,-Inc-and-IBM-Launch-Collaboration-in-Entertainment-and-the-Arts-in-Japan. [cited by applicant]
Cohen, Welcome to the Netaverse, Where Brooklyn Nets Players Can Be Seen in a Whole New (3D) Light, Feb. 3, 2022, https://www.sporttechie.com/welcome-to-the-netaverse-where-brooklyn-nets-players-can-be-seen-in-a-whole-n… [cited by applicant]
Antunes, Canon and IBM: using volumetric video to promote visual arts, Jul. 13, 2021, https://www.provideocoalition.com/canon-and-ibm-using-volumetric-video-to-promote-visual-arts/. [cited by applicant]
Canon, Canon and IBM Japan Form Joint Business Operation Utilizing Volumetric Video Technology to Promote the Visual and Performing Arts, Jul. 7, 2021, https://sg.canon/en/consumer/form-joint-utilizing-volumetric-video-… [cited by applicant]
Perkins, The business benefits of volumetric video, Jun. 17, 2021, https://business.bt.com/insights/the-future-is-now/transforming-industries-with-volumetric-video/. [cited by applicant]
Qian et al., Toward Practical Volumetric Video Streaming on Commodity Smartphones, HotMobile '19: Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications, Feb. 27-28, 2019, pp. 135-14… [cited by applicant]
Zerman et al., A Case Study on the Use of Volumetric Video in Augmented Reality for Cultural Heritage, NordiCHI '20, Oct. 25-29, 2020. [cited by applicant]
Khan et al., Can Accurate Future Bandwidth Prediction Improve Volumetric Video Streaming Experience?, 2021 International Wireless Communications and Mobile Computing (IWCMC), Jun. 28, 2021-Jul. 2, 2021. [cited by applicant]
Diaz et al., Region Dependent Mesh Refinement for Volumetric Video Workflows, 2019 International Conference on 3D Immersion (IC3D), Dec. 11, 2019. [cited by applicant]
Xu et al., Mutual Information in 3D Video, 2007 3DTV Conference, May 7-9, 2007. [cited by applicant]
Gul et al., Low-latency Cloud-based Volumetric Video Streaming Using Head Motion Prediction, Nossdav'20, Jun. 10-11, 2020. [cited by applicant]
International Searching Authority, PCT/CN2023/133903, Feb. 6, 2024. [cited by applicant]