IP Library Granted Patent US 9,836,873
Granted Patent B2
US 9,836,873 · App. 14/539,889 · Granted Dec 5, 2017

Analysis and manipulation of panoramic surround views

Inventors: Stefan Johannes Josef Holzer (Hagelstadt, DE); Stephen David Miller (Menlo Park, CA); Radu Bogdan Rusu (San Francisco, CA)
Assignee: FYUSION, INC.
G06T15/205G06F3/04842G06F17/30256G06F17/30277G06F17/30837G06T3/4038G06T17/00H04N5/23238H04N5/265H04N13/0278H04N13/0282G06T2207/10021G06T2207/20221G06T2215/12G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,836,873
App. No.
14/539,889
Granted
Dec 5, 2017
Kind
B2
Abstract

Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a surround view. In particular embodiments, a surround view can be generated by combining a panoramic view of an object with a panoramic view of a distant scene, such that the object panorama is placed in a foreground position relative to the distant scene panorama. Such combined panoramas can enhance the interactive and immersive viewing experience of the surround view.

Claims (29)

1. A method comprising:

obtaining a first surround view, wherein the first surround view includes a panoramic multi-view interactive digital media representation of an object, wherein the first surround view is an object panorama;

obtaining a second surround view, wherein the second surround view includes a panoramic view of a distant scene; and

generating a third surround view including the first surround view placed in a foreground position relative to the second surround view, wherein the first and second surround views are obtained using different capture motions such that a more complex surround view corresponding to a more complex capture motion can be generated using separate smaller surround views corresponding to separate smaller capture motions.

2. The method of claim 1 , wherein the first surround view is an object panorama.

3. The method of claim 1 , wherein the object is dynamic, and wherein the third surround view is a dynamic panorama.

4. The method of claim 1 , wherein the distant scene is dynamic, and wherein the third surround view is a dynamic panorama.

5. The method of claim 1 , wherein the third surround view includes dynamic content that is animated during user navigation.

6. The method of claim 1 , wherein the object is made of a group of items.

7. The method of claim 1 , wherein the distant scene moves less than the object when the third surround view is navigated.

8. The method of claim 7 , wherein the object appears three-dimensional when the third surround view is navigated.

9. The method of claim 1 , wherein the object is display on a device, wherein the viewing angle of the object is manipulated by tilting and rotating the device.

10. The method of claim 1 , wherein the viewing angle of the object is manipulated by rotating the device along an axis corresponding to a same axis of the object.

11. A non-transitory computer readable medium comprising:

computer code for obtaining a first surround view, wherein the first surround view includes a panoramic multi-view interactive digital media representation of an object, wherein the first surround view is an object panorama;

computer code for obtaining a second surround view, wherein the second surround view includes a panoramic view of a distant scene; and

computer code for generating a third surround view including the first surround view placed in a foreground position relative to the second surround view, wherein the first and second surround views are obtained using different capture motions such that a more complex surround view corresponding to a more complex capture motion can be generated using separate smaller surround views corresponding to separate smaller capture motions.

12. The non-transitory computer readable medium of claim 11 , wherein the first surround view is an object panorama.

13. The non-transitory computer readable medium of claim 11 , wherein the object is dynamic, and wherein the third surround view is a dynamic panorama.

14. The non-transitory computer readable medium of claim 11 , wherein the distant scene is dynamic, and wherein the third surround view is a dynamic panorama.

15. The non-transitory computer readable medium of claim 11 , wherein the third surround view includes dynamic content that is animated during user navigation.

16. The non-transitory computer readable medium of claim 11 , wherein the object is made of a group of items.

17. The non-transitory computer readable medium of claim 11 , wherein the distant scene moves less than the object when the third surround view is navigated.

18. The non-transitory computer readable medium of claim 17 , wherein the object appears three-dimensional when the third surround view is navigated.

19. A system comprising:

means for obtaining a first surround view, wherein the first surround view includes a panoramic multi-view interactive digital media representation of an object, wherein the first surround view is an object panorama;

means for obtaining a second surround view, wherein the second surround view includes a panoramic view of a distant scene; and

means for generating a third surround view including the first surround view placed in a foreground position relative to the second surround view, wherein the first and second surround views are obtained using different capture motions such that a more complex surround view corresponding to a more complex capture motion can be generated using separate smaller surround views corresponding to separate smaller capture motions.

20. The system of claim 19 , wherein the first surround view is an object panorama.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2015
From: HOLZER, STEFAN JOHANNES JOSEF; MILLER, STEPHEN DAVID; RUSU, RADU BOGDAN
To: FYUSION, INC.
Reel/Frame 034888/0708 →
Continuity (2)
Provisional Application 61903359 · Nov 12, 2013
Related Publication 20150130894A1 · May 14, 2015