IP Library Granted Patent US 9,118,843
Granted Patent B2
US 9,118,843 · App. 13/743,439 · Granted Aug 25, 2015

Methods and systems for creating swivel views from a handheld device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,118,843
App. No.
13/743,439
Granted
Aug 25, 2015
Kind
B2
Abstract

Examples of methods and systems for creating swivel views from handheld video are described. In some examples, a method may be performed by a handheld device to receive or capture a video of a target object and the video may include a plurality of frames and content of the target object from a plurality of viewpoints. The device may determine one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint and may align the approximately corresponding frames of the video based on one or more feature points of the target object to generate an aligned video. The device may provide sampled frames from multiple viewpoints from the aligned video, configured for viewing the target object in a rotatable manner, such as in a swivel view format.

Claims (41)

1. A method, comprising:

receiving, at a computing system, a video of a target object, wherein the video includes a plurality of frames, and wherein the video includes content representing a plurality of images of the target object from a plurality of viewpoints;

determining, by the computing system, one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint, wherein a first of the one or more approximately corresponding frames is from a first portion of the video and a second of the one or more approximately corresponding frames is from another portion of the video;

aligning the one or more approximately corresponding frames of the video to generate an aligned video;

sampling, by the computing system, frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints; and

providing, by the computing system, the sampled frames configured for viewing the target object in a swivel view format that enables an aligned and continuous view of the target object from the plurality of viewpoints in a rotatable manner.

2. The method of claim 1 , wherein receiving the video comprises receiving the video from a mobile device configured for handheld use.

3. The method of claim 1 , wherein the plurality of viewpoints include one or more viewpoints from circling 360 degrees around the target object.

4. The method of claim 1 , wherein sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints comprises selecting frames at approximately evenly spaced degrees of rotation from the plurality of viewpoints.

5. The method of claim 1 , further comprising providing the sampled frames configured for viewing such that a view of the target object is based on a received input to a viewer.

6. The method of claim 1 , further comprising:

determining one or more feature points of the target object in the plurality of frames, wherein the one or more feature points include distinct pixels capable of being tracked across the plurality of frames; and

based on an amount of movement of the one or more feature points across the plurality of frames, determining one or more transformation parameters applicable to adjust the video to be substantially focused on the target object.

7. A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions, the functions comprising:

receiving a video of a target object, wherein the video includes a plurality of frames, and wherein the video includes content representing a plurality of images of the target object from a plurality of viewpoints;

determining one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint, wherein a first of the one or more approximately corresponding frames is from a first portion of the video and a second of the one or more approximately corresponding frames is from another portion of the video;

aligning the one or more approximately corresponding frames of the video to generate an aligned video;

sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints; and

providing the sampled frames configured for viewing the target object in a swivel view format that enables an aligned and continuous view of the target object from the plurality of viewpoints in a rotatable manner.

8. The non-transitory computer readable medium of claim 7 , wherein the functions further comprise receiving the video from a mobile device configured for handheld use.

9. The non-transitory computer readable medium of claim 7 , wherein the plurality of viewpoints include one or more viewpoints from about 360 degrees around the target object.

10. The non-transitory computer readable medium of claim 7 , wherein the function of sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints further comprises selecting frames at approximately evenly spaced degrees of rotation from the plurality of viewpoints.

11. The non-transitory computer readable medium of claim 7 , wherein the functions further comprise providing the sampled frames configured for viewing such that a view of the target object is based on a received input to a viewer.

12. The non-transitory computer readable medium of claim 7 , wherein the functions further comprise:

determining one or more feature points of the target object in the plurality of frames, wherein the one or more feature points include distinct pixels capable of being tracked across the plurality of frames; and

based on an amount of movement of the one or more feature points across the plurality of frames, determining one or more transformation parameters applicable to adjust the video to be substantially focused on the target object.

13. A system, comprising:

at least one processor; and

data storage comprising program instructions executable by the at least one processor to cause the at least one processor to perform functions comprising:

receiving a video of a target object, wherein the video includes a plurality of frames, and wherein the video includes content representing a plurality of images of the target object from a plurality of viewpoints;

determining one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint, wherein a first of the one or more approximately corresponding frames is from a first portion of the video and a second of the one or more approximately corresponding frames is from another portion of the video;

aligning the one or more approximately corresponding frames of the video to generate an aligned video;

sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints; and

providing the sampled frames configured for viewing the target object in a swivel view format that enables an aligned and continuous view of the target object from the plurality of viewpoints in a rotatable manner.

14. The system of claim 13 , wherein the functions further comprise receiving the video from a mobile telephone that includes a camera and processor configured for obtaining video content.

15. The system of claim 13 , wherein the plurality of viewpoints include one or more viewpoints from circling 360 degrees around the target object.

16. The system of claim 13 , wherein the function of sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints comprises selecting frames at approximately evenly spaced degrees of rotation from the plurality of viewpoints.

17. The system of claim 13 , wherein the functions further comprise providing the sampled frames configured for viewing such that a view of the target object is based on a received input to a viewer.

18. The system of claim 13 , wherein the functions further comprise:

determining one or more feature points of the target object in the plurality of frames, wherein the one or more feature points include distinct pixels capable of being tracked across the plurality of frames; and

based on an amount of movement of the one or more feature points across the plurality of frames, determining one or more transformation parameters applicable to adjust the video to be substantially focused on the target object.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044334/0466 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2013
From: IOFFE, SERGEY; FRUEH, CHRISTIAN
To: GOOGLE INC.
Reel/Frame 029656/0018 →