IP Library Granted Patent US 9,805,513
Granted Patent B2
US 9,805,513 · App. 14/991,477 · Granted Oct 31, 2017

Image processing device, image processing method, and program

Inventors: Yasuhiro Suto (Tokyo, JP); Masaki Fukuchi (Tokyo, JP); Kenichirou Ooi (Kanagawa, JP); Jingjing Guo (Tokyo, JP); Kouichi Matsuda (Tokyo, JP)
Assignee: Sony Corporation
G06T19/006G02B27/0172G06T11/60G06T19/003G09G5/00G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,805,513
App. No.
14/991,477
Granted
Oct 31, 2017
Kind
B2
Abstract

There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.

Claims (31)

1. An image processing device comprising:

a position information obtaining unit configured to obtain a position information of an object;

a control unit configured to acquire action data for a proposed action to be performed in a real space, based on the position information of the object; and

a superimposing unit configured to generate an output image by superimposing a direction for the proposed action at a position in a captured image determined based on the position of the object in the real space,

wherein the action data defines a correspondence between the direction for the proposed action and the position of the object,

wherein the action data further defines a correspondence between the direction for the proposed action and a progress condition of the object in the real space, and

wherein the position information obtaining unit, the control unit, and the superimposing unit are each implemented via at least one processor.

2. The image processing device according to claim 1 , wherein the object is a physical object.

3. The image processing device according to claim 2 , wherein the progress condition includes a condition according to a position or a posture of the physical object.

4. The image processing device according to claim 1 , wherein the control unit controls displaying of the direction for the proposed action.

5. The image processing device according to claim 1 , wherein the position information is generated based on at least one captured image of the real world.

6. The image processing device according to claim 1 ,

wherein the progress condition indicates a current progress of performing a procedure associated with the object.

7. The image processing device according to claim 6 , wherein the procedure associated with the object is a manipulation of the object in the real space.

8. The image processing device according to claim 6 , wherein the procedure associated with the object is a manipulation of the object to change a location of the object within the real space.

9. The image processing device according to claim 1 , wherein the progress condition indicates a completion of a procedure associated with a manipulation of the object.

10. The image processing device according to claim 9 , wherein the manipulation is a changing of a position of the object.

11. The image processing device according to claim 1 , wherein the progress condition indicates a current progress of a change of the object.

12. The image processing device according to claim 11 , wherein the change of the object includes a change in position of the object.

13. An image processing method comprising:

obtaining a position information of an object;

acquiring action data for a proposed action to be performed in a real space, based on the position information of the object; and

generating an output image by superimposing a direction for the proposed action at a position in a captured image determined based on the position of the object in the real space,

wherein the action data defines a correspondence between the direction for the proposed action and the position of the object, and

wherein the action data further defines a correspondence between the direction for the proposed action and a progress condition of the object in the real space.

14. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

obtaining a position information of an object;

acquiring action data for a proposed action to be performed in a real space, based on the position information of the object; and

generating an output image by superimposing a direction for the proposed action at a position in a captured image determined based on the position of the object in the real space,

wherein the action data defines a correspondence between the direction for the proposed action and the position of the object, and

wherein the action data further defines a correspondence between the direction for the proposed action and a progress condition of the object in the real space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2016
From: SUTO, YASUHIRO; FUKUCHI, MASAKI; OOI, KENICHIROU; GUO, JINGJING; MATSUDA, KOUICHI
To: SONY CORPORATION
Reel/Frame 037442/0143 →
Priority Claims (1)
JP 2010-021368 · Feb 2, 2010 · national
Continuity (4)
Continuation 14869063 · Sep 29, 2015
Continuation 14527148 · Oct 29, 2014
Continuation 12984847 · Jan 5, 2011
Related Publication 20160125657A1 · May 5, 2016