IP Library › Granted Patent US 12,342,026
Granted Patent B2
US 12,342,026 · App. 18/417,403 · Granted Jun 24, 2025

Collaborative video capture and sharing

Inventors: Jill M. Boyce (Portland, OR); Basel Salahieh (San Jose, CA)
Assignee: VIMMERSE, INC.
H04N21/2743H04N21/25875H04N21/278
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,342,026
App. No.
18/417,403
Granted
Jun 24, 2025
Kind
B2
Abstract

Content hosting for composite video is described using metadata and user identification. A user management module registers a first user ID for a primary device, a second user ID for a secondary device, a session ID for a session between the primary device and the secondary device, and a player device with a third user ID and privileges to view a composite video. A content hosting module receives a first video associated with the first user ID and the session ID and a second video associated with the second user ID and the session ID. The first and second videos include metadata regarding time and position. The content hosting module serves a composite video to the player device in response to a request associated with the third user ID. A content preparation module forms the composite video using the first video and the second video.

Claims (60)

1. A method comprising:

registering a first user ID for a primary device, a second user ID for a secondary device, and a session ID for a session between the primary device and the secondary device;

forming the session having the session ID between the primary device associated with the first user ID and the secondary device associated with the second user ID and associating the session ID with the primary device and the secondary device;

receiving a first video associated with the first user ID and the session ID, the first video including metadata regarding time and position;

receiving a second video associated with the second user ID and the session ID, the second video including metadata regarding time and position;

forming a composite video using the first video and the second video;

determining that all expected files for the session have been uploaded successfully using the identification of the devices of the session;

registering a player device with a third user ID and privileges to view the composite video; and

serving the composite video to the player device in response to a request associated with the third user ID.

2. The method of claim 1 , further comprising controlling access to the composite video based on the first user ID and the second user ID.

3. The method of claim 2 , further comprising:

registering additional user IDs;

linking the additional user IDs to the first user ID; and

controlling access to the composite video based on the linking.

4. The method of claim 1 , further comprising forming the composite video by:

coding the first video in pictures of a base layer;

coding the second video in pictures of another layer;

generating text overlays; and

adding the text overlays to the composite video.

5. An apparatus comprising a machine-readable medium having instructions stored thereon that when operated on by one or more processors cause the apparatus to perform operations comprising:

registering a first user ID for a primary device, a second user ID for a secondary device, and a session ID for a session between the primary device and the secondary device;

receiving a first video associated with the first user ID and the session ID, the first video including metadata regarding time and position;

receiving a second video associated with the second user ID and the session ID, the second video including metadata regarding time and position;

forming a composite video using the first video and the second video;

registering a player device with a third user ID and privileges to view the composite video;

serving the composite video to the player device in response to a request associated with the third user ID; and

receiving a user-defined name of the session, a creation time of the session, and a name and a device ID for each device in the session after serving the composite video.

6. The apparatus of claim 5 , the operations further comprising:

maintaining a list of user IDs for which the third user ID has a follower relationship;

presenting the list of user IDs to the player device upon receiving a request from the player device; and

receiving a selection of a user ID from the list of user IDs;

wherein the content hosting module is further to present a composite video associated with the selected user ID.

7. The apparatus of claim 5 , wherein forming a composite video comprises:

processing available uploaded capture files to form combined content that combines content from multiple devices in which a region of a picture contains a first input video, and a second region of the picture contains a second input video.

8. A method comprising:

registering a first user ID for a primary device;

registering a second user ID for a secondary device;

registering a session ID for a session between the primary device and the secondary device;

registering a player device with a third user ID and privileges to view a composite video;

receiving a first video associated with the first user ID and the session ID, the first video including metadata regarding time and position;

receiving a second video associated with the second user ID and the session ID, the second video including metadata regarding time and position;

forming a composite video using the first video and the second video;

serving the composite video to the player device in response to a request associated with the third user ID; and

receiving a user-defined name of the session, a creation time of the session, and a name and a device ID for each device in the session after serving the composite video.

9. The method of claim 8 , wherein the user management module is further to:

maintain a list of user IDs for which the third user ID has a follower relationship;

present the list of user IDs to the player device upon receiving a request from the player device; and

receive a selection of a user ID from the list of user IDs; and

wherein the content hosting module is further to present a composite video associated with the selected user ID.

10. The method of claim 8 , wherein the selected user ID is associated with a selected device, the method comprising designating the selected device as a primary capture device of the composite video.

11. The method of claim 8 , further comprising forming the session, having the session ID, between a first device associated with the first user ID and a second device associated with the second user ID.

12. The method of claim 8 further comprising determining that all expected files for the session have been uploaded using the first user ID and the second user ID of the session.

13. The method of claim 8 , further comprising processing the first video and the second video to form combined content that combines content from multiple devices.

14. The method of claim 13 , wherein the combined content comprises a composite video in which a region of a picture contains a first input video, and a second region of the picture contains a second input video.

15. The method of claim 14 , wherein the first input video is coded in pictures of a base layer, and the second input video is coded in pictures of another layer.

16. The method of claim 14 , wherein the combined content comprises immersive video with multiple input videos of a 3D scene and camera parameters associated with each input video, combined using patches and atlases.

17. The method of claim 14 , wherein the combined content comprises immersive video that allows the player device to navigate playback with 6 degrees of freedom of position and orientation.

18. The method of claim 8 , further comprising combining audio from multiple users, to form spatial audio.

19. The method of claim 8 , further comprising generating text overlays and adding the text overlays to the composite video.

20. The method of claim 8 , further comprising associating combined content files with a list of users participating in a capture session.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2024
From: BOYCE, JILL M.; SALAHIEH, BASEL
To: VIMMERSE, INC.
Reel/Frame 066201/0911 →
Continuity (3)
Division 17981312 · Nov 4, 2022
Provisional Application 63277072 · Nov 8, 2021
Related Publication 20240205486A1 · Jun 20, 2024
References Cited (34)
US 9742975B2 · O'Donnell et al. · 2017 [cited by applicant]
US 9769332B1 · Delaunay et al. · 2017 [cited by applicant]
US 10581782B2 · Tang · 2020 [cited by examiner]
US 10582277B2 · Tang · 2020 [cited by examiner]
US 11153442B1 · Balyasny et al. · 2021 [cited by applicant]
US 11245947B1 · Sabo · 2022 [cited by applicant]
US 11481236B1 · Weiss et al. · 2022 [cited by applicant]
US 11539801B1 · Noskin et al. · 2022 [cited by applicant]
US 11743444B2 · Faust et al. · 2023 [cited by applicant]
US 11804039B2 · Jorasch et al. · 2023 [cited by applicant]
US 11829786B2 · Weiss et al. · 2023 [cited by applicant]
US 20060174203A1 · Jung et al. · 2006 [cited by applicant]
US 20120236103A1 · Cahill · 2012 [cited by examiner]
US 20120263439A1 · Lassman · 2012 [cited by examiner]
US 20130283319A1 · Marshall et al. · 2013 [cited by applicant]
US 20140047074A1 · Chung · 2014 [cited by examiner]
US 20150043892A1 · Groman · 2015 [cited by applicant]
US 20150317655A1 · Myers et al. · 2015 [cited by applicant]
US 20160005135A1 · Bokestad · 2016 [cited by examiner]
US 20160006920A1 · Gomes Da Motta et al. · 2016 [cited by applicant]
US 20160277802A1 · Bernstein · 2016 [cited by examiner]
US 20160286244A1 · Chang · 2016 [cited by examiner]
US 20180098134A1 · Sufuentes et al. · 2018 [cited by applicant]
US 20180152736A1 · Alexander · 2018 [cited by examiner]
US 20180342329A1 · Rufo et al. · 2018 [cited by applicant]
US 20190289253A1 · Curio · 2019 [cited by applicant]
US 20200137354A1 · Nathan et al. · 2020 [cited by applicant]
US 20200268471A1 · Kajita · 2020 [cited by applicant]
US 20210303075A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210374391A1 · Jorasch et al. · 2021 [cited by applicant]
US 20240335739A1 · Paradise · 2024 [cited by examiner]
Boyce et al., “MPEG Immersive Video Coding Standard”, Mar. 10, 2021, Proceedings of the IEEE, (vol. 109, Issue 9, Sep. 2021). [cited by examiner]
Nemcic et al., “Multiview Video Coding Extension of the H.264/AVC Standard”, Sep. 15-17, 2010, Proceedings ELMAR-2010. [cited by examiner]
Hannuksela et al., “Overview of the Multiview High Efficiency Video Coding (MV-HEVC) Standard”, Sep. 27-30, 2015, 2015 IEEE International Conference on Image Processing (ICIP). [cited by examiner]