IP Library Granted Patent US 11,632,533
Granted Patent B2
US 11,632,533 · App. 17/373,737 · Granted Apr 18, 2023

System and method for generating combined embedded multi-view interactive digital media representations

Inventors: Stefan Johannes Josef Holzer (San Mateo, CA); Dave Morrison (San Francisco, CA); Radu Bogdan Rusu (San Francisco, CA); George Haber (Los Altos Hills, CA); Keith Martin (San Francisco, CA)
Assignee: Fyusion, Inc.
H04N13/221G06T7/285G06T17/00H04N13/117H04N13/178H04N13/189H04N13/243H04N13/275H04N13/279H04N13/344H04N13/366G06T2207/10021G06T2207/30252G06T2219/2008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,632,533
App. No.
17/373,737
Granted
Apr 18, 2023
Kind
B2
Abstract

Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view.

Claims (35)

1. A method for automatic generation of a multi-view interactive digital media representation (MIDMR) recording, the method comprising:

obtaining a first MIDMR;

obtaining a second MIDMR; and

generating a third MIDMR from the first MIDMR and the second MIDMR, wherein the first and second MIDMRs are obtained using different capture motions, wherein the third MIDMR is a combined embedded MIDMR, wherein the third MIDMR provides a three dimensional view of a first object MIDMR as well as an embedded three dimensional view of a second object MIDMR,

wherein the first and second MIDMRS are generated by stitching together two dimensional images, and wherein the third MIDMR is generated by combining the first and second MIDMR, and wherein the first, second, and third MIDMRs each provide a three-dimensional view of content without rendering and/or storing an actual three-dimensional model.

2. The method of claim 1 , wherein the combined embedded MIDMR comprises the second MIDMR being embedded in the first MIDMR, thereby forming an embedded second MIDMR.

3. The method of claim 2 , wherein the third MIDMR includes a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device.

4. The method of claim 3 , wherein the embedded second MIDMR is not available for viewing in the general view.

5. The method of claim 4 , wherein the general view includes a selectable tag located somewhere on the first MIDMR, the selectable tag corresponding to the embedded second MIDMR.

6. The method of claim 5 , wherein selection of the selectable tag triggers a specific view to be displayed on the user device, wherein the specific view corresponds to the embedded second MIDMR.

7. The method of claim 1 , further comprising generating a user template to assist in execution of the steps in claim 1 .

8. The method of claim 1 , further comprising automatically generating a webpage once the third MIDMR is generated.

9. The method of claim 1 , wherein the general object MIDMR is a representation of a vehicle.

10. The method of claim 1 , wherein viewing angles of the third MIDMR are manipulated by rotating the device or moving the device along a translational path.

11. A non-transitory computer readable medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:

obtaining a first MIDMR;

obtaining a second MIDMR; and

generating a third MIDMR from the first MIDMR and the second MIDMR, wherein the first and second MIDMRs are obtained using different capture motions, wherein the third MIDMR is a combined embedded MIDMR, wherein the third MIDMR provides a three dimensional view of a first object MIDMR as well as an embedded three dimensional view of a second object MIDMR,

wherein the first and second MIDMRS are generated by stitching together two dimensional images, and wherein the third MIDMR is generated by combining the first and second MIDMR, and wherein the first, second, and third MIDMRs each provide a three-dimensional view of content without rendering and/or storing an actual three-dimensional model.

12. The non-transitory computer readable medium of claim 11 , wherein the combined embedded MIDMR comprises the second MIDMR being embedded in the first MIDMR, thereby forming an embedded second MIDMR.

13. The non-transitory computer readable medium of claim 12 , wherein the third MIDMR includes a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device.

14. The non-transitory computer readable medium of claim 13 , wherein the embedded second MIDMR is not available for viewing in the general view.

15. The non-transitory computer readable medium of claim 14 , wherein the general view includes a selectable tag located somewhere on the first MIDMR, the selectable tag corresponding to the embedded second MIDMR.

16. The non-transitory computer readable medium of claim 15 , wherein selection of the selectable tag triggers a specific view to be displayed on the user device, wherein the specific view corresponds to the embedded second MIDMR.

17. The non-transitory computer readable medium of claim 11 , further comprising generating a user template to assist in execution of the steps in claim 11 .

18. The non-transitory computer readable medium of claim 11 , further comprising automatically generating a webpage once the third MIDMR is generated.

19. The non-transitory computer readable medium of claim 11 , wherein the general object MIDMR is a representation of a vehicle.

20. A system comprising:

a processor;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions for:

obtaining a first MIDMR;

obtaining a second MIDMR; and

generating a third MIDMR from the first MIDMR and the second MIDMR, wherein the first and second MIDMRs are obtained using different capture motions, wherein the third MIDMR is a combined embedded MIDMR, wherein the third MIDMR provides a three dimensional view of a first object MIDMR as well as an embedded three dimensional view of a second object MIDMR,

wherein the first and second MIDMRS are generated by stitching together two dimensional images, and wherein the third MIDMR is generated by combining the first and second MIDMR, and wherein the first, second, and third MIDMRs each provide a three-dimensional view of content without rendering and/or storing an actual three-dimensional model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2021
From: HOLZER, STEFAN JOHANNES JOSEF; MORRISON, DAVE; RUSU, RADU BOGDAN; HABER, GEORGE; MARTIN, KEITH
To: FYUSION, INC.
Reel/Frame 056842/0775 →
Continuity (5)
Continuation 15969749 · May 2, 2018
Continuation In Part 15936231 · Mar 26, 2018
Continuation In Part 14860983 · Sep 22, 2015
Continuation 14800638 · Jul 15, 2015
Related Publication 20210344891A1 · Nov 4, 2021
Cited By (1)
US 12,581,196