IP Library Granted Patent US 9,256,986
Granted Patent B2
US 9,256,986 · App. 13/718,088 · Granted Feb 9, 2016

Automated guidance when taking a photograph, using virtual objects overlaid on an image

Inventors: Shunichi Kasahara (Kanagawa, JP); Takuo Ikeda (Tokyo, JP)
Assignee: SONY CORPORATION
G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,256,986
App. No.
13/718,088
Granted
Feb 9, 2016
Kind
B2
Abstract

There is provided an image processing device including a data acquisition unit configured to acquire a recommended angle-of-view parameter that represents a recommended angle of view for a subject in an environment that appears in an image, and a display control unit configured to overlay on the image a virtual object that guides a user so that an angle of view for capturing an image of the subject becomes closer to the recommended angle of view, using the recommended angle-of-view parameter. The recommended angle-of-view parameter is a parameter that represents a three-dimensional position and attitude of a device that captures an image of the subject at the recommended angle of view.

Claims (33)

1. An image processing device comprising:

circuitry configured to:

acquire a recommended angle-of-view parameter that represents a recommended angle of view for a subject in an environment that appears in an image;

overlay on the image a virtual object that guides a user so that an angle of view for capturing an image of the subject becomes closer to the recommended angle of view, using the recommended angle-of-view parameter,

wherein the recommended angle-of-view parameter is a parameter that represents a three-dimensional position and attitude of a device that captures an image of the subject at the recommended angle of view;

overlay on the image a target object representing the recommended angle of view, and intermediate objects representing intermediate angles of views between the recommended angle of view and a current angle of view;

form an animation for guiding the user by sequentially overlaying the target object and the intermediate objects on a plurality of frames, such that the target object and the intermediate objects on the plurality of frames are simultaneously displayed; and

change display attributes of the intermediate objects in a stepwise manner, such that one of the intermediate objects closest to the target object has a peripheral line that is thicker than a peripheral line of another one of the intermediate objects farther away from the target object.

2. The image processing device according to claim 1 , wherein the circuitry is configured to:

recognize a current angle-of-view parameter representing the current angle of view, using the image, and

determine an arrangement of the intermediate objects in the environment using the recommended angle-of-view parameter and the current angle-of-view parameter.

3. The image processing device according to claim 2 , wherein the intermediate objects are arranged in the environment at positions and attitudes interpolated at non-even intervals between the recommended angle of view and the current angle of view.

4. The image processing device according to claim 1 , wherein the circuitry is configured to form a track of an angle of view for guiding the user by overlaying the target object and the intermediate objects.

5. The image processing device according to claim 1 , wherein the circuitry is configured to cause the image processing device to execute a predetermined operation when the current angle of view is determined to be substantially equal to the recommended angle of view.

6. The image processing device according to claim 5 , wherein the predetermined operation is recording of a captured image.

7. The image processing device according to claim 5 , wherein the predetermined operation is acquisition or reproduction of content associated with the subject.

8. The image processing device according to claim 5 , wherein the predetermined operation is guidance to a next subject or a next recommended angle of view.

9. The image processing device according to claim 1 , wherein the recommended angle-of-view parameter is a parameter that represents an angle of view of when a recommended image of the subject is captured.

10. The image processing device according to claim 1 , wherein the recommended angle-of-view parameter is a parameter that represents an angle of view determined based on a predefined rule for the subject and a position and an attitude of the subject.

11. The image processing device according to claim 1 , wherein the circuitry is configured to operate in conjunction with a device that resides on a cloud computing environment.

12. An image processing method comprising:

acquiring a recommended angle-of-view parameter representing a three-dimensional position and attitude of a device that captures an image of a subject in an environment that appears in an image at a recommended angle of view;

overlaying on the image a virtual object for guiding a user so that an angle of view for capturing an image of the subject becomes closer to the recommended angle of view, using the recommended angle-of-view parameter;

overlaying on the image a target object representing the recommended angle of view, and intermediate objects representing intermediate angles of views between the recommended angle of view and a current angle of view;

forming an animation for guiding the user by sequentially overlaying the target object and the intermediate objects on a plurality of frames, such that the target object and the intermediate objects on the plurality of frames are simultaneously displayed; and

changing display attributes of the intermediate objects in a stepwise manner, such that one of the intermediate objects closest to the target object has a peripheral line that is thicker than a peripheral line of another one of the intermediate objects farther away from the target object.

13. A non-transitory computer readable medium having a computer program recorded thereon, the computer program configured to perform a method when executed on a computer, the method comprising:

acquiring a recommended angle-of-view parameter that represents a recommended angle of view for a subject in an environment that appears in an image;

overlaying on the image a virtual object that guides a user so that an angle of view for capturing an image of the subject becomes closer to the recommended angle of view, using the recommended angle-of-view parameter,

wherein the recommended angle-of-view parameter is a parameter that represents a three-dimensional position and attitude of a device that captures an image of the subject at the recommended angle of view;

overlaying on the image a target object representing the recommended angle of view, and intermediate objects representing intermediate angles of views between the recommended angle of view and a current angle of view;

forming an animation for guiding the user by sequentially overlaying the target object and the intermediate objects on a plurality of frames, such that the target object and the intermediate objects on the plurality of frames are simultaneously displayed; and

changing display attributes of the intermediate objects in a stepwise manner, such that one of the intermediate objects closest to the target object has a peripheral line that is thicker than a peripheral line of another one of the intermediate objects farther away from the target object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2012
From: KASAHARA, SHUNICHI; IKEDA, TAKUO
To: SONY CORPORATION
Reel/Frame 029491/0524 →
Priority Claims (1)
JP 2012-026871 · Feb 10, 2012 · national
Continuity (1)
Related Publication 20130208005A1 · Aug 15, 2013