IP Library › Granted Patent US 10,140,746
Granted Patent B2
US 10,140,746 · App. 12/995,610 · Granted Nov 27, 2018

Image processing device, image processing method, and computer program

Inventor: Tooru Masuda (Minato-ku, JP)
Assignee: SONY CORPORATION
G06T13/80G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,140,746
App. No.
12/995,610
Granted
Nov 27, 2018
Kind
B2
Abstract

Provided is an image processing device. A feature point detection unit detects a feature point from moving image data. An association processing unit associates the feature point with additional information, the feature point being selected based on feature point selection information for selecting one or at least two feature points that display the additional information displayed to be accompanied with the feature point. A motion analysis unit analyzes a changing behavior of the feature point through reproduction of moving image data. A data generating unit generates data indicating change content to change display of the additional information associated with the feature point based on motion information indicating the behavior of the feature point analyzed by the motion analysis unit and a display scenario indicating a change pattern to change the additional information added to the feature point according to the behavior of the feature point.

Claims (43)

1. An image processing device comprising:

circuitry configured to

detect a feature point from stored moving image data;

associate the feature point with additional information, the feature point being selected based on feature point selection information, wherein the additional information includes image data that is displayed as added to a reproduction of the stored moving image data;

analyze a changing behavior of the feature point through the reproduction of the stored moving image data;

generate data indicating change content to change display of the image data of the additional information associated with the feature point based on motion information indicating the behavior of the feature point analyzed and a display scenario indicating a change pattern to change the additional information associated with the feature point according to the behavior of the feature point; and

control a display device to display the reproduction of the stored moving image data and to display the image data of the additional information based on the change content such that the image data of the additional information has motion corresponding to motion of the feature point of the stored moving image data,

wherein when selection information to select at least two feature points, including the detected feature point, is input, the circuitry is configured to generate data to generate a display size of the additional information according to a distance between the at least two feature points.

2. The image processing device according to claim 1 , wherein the circuitry is configured to accept input of the feature point selection information.

3. The image processing device according to claim 1 , wherein

the circuitry is configured to

select at least one stored display scenario as a selected display scenario based on the behavior of the feature point, and

generate data to display the additional information using a display method defined in the selected display scenario.

4. The image processing device according to claim 3 , wherein the at least one display scenario stored is predetermined.

5. The image processing device according to claim 4 , wherein the display scenario selection information includes information corresponding to a user selection of at least one display scenario stored.

6. The image processing device according to claim 3 , wherein the at least one display scenario stored is previously set.

7. The image processing device according to claim 6 , wherein the display scenario selection information includes information corresponding to a user selection of at least one display scenario stored.

8. The image processing device according to claim 3 , wherein the display scenario selection information includes information corresponding to a user selection of at least one display scenario stored.

9. The image processing device according to claim 1 , wherein the circuitry is configure to:

store at least one piece of additional information, and

accept input of selection information for selecting the additional information associated with the feature point.

10. The image processing device according to claim 1 , wherein the circuitry is configured to accept input of additional information by hand-drawing.

11. The image processing device according to claim 1 , wherein the circuitry is configured to generate data to change a display position of the additional information associated with the feature point based on a position of the feature point in an image of moving image data recognized from the motion information.

12. The image processing device according to claim 1 , wherein the circuitry is configured to generate data to change a size of the additional information associated with the feature point based on a size of the feature point relative to a display size of moving image data recognized from the motion information.

13. The image processing device according to claim 1 , wherein the circuitry is configured to generate data to display the additional information associated with the feature point according to a change of a facial expression of the feature point recognized from the motion information.

14. The image processing device according to claim 1 , wherein the circuitry is configured to generate data to change display of the additional information associated with the feature point according to a movement speed of the feature point recognized from the motion information.

15. The image processing device according to claim 1 , wherein the display scenario selection information includes a user selection of the display scenario.

16. An image processing method comprising the steps of:

detecting at least one feature point from stored moving image data;

associating the at least one feature point with additional information, wherein the additional information includes image data that is displayed as added to a reproduction of the stored moving image data;

analyzing a changing behavior of the at least one feature point through the reproduction of the stored moving image data;

generating data indicating change content to change display of the image data of the additional information associated with the at least one feature point based on motion information indicating the analyzed behavior of the at least one feature point and a display scenario indicating a change pattern to change the additional information associated with the at least one feature point; and

controlling a display device to display the reproduction of the stored moving image data and to display the image data of the additional information based on the change content such that the image data of the additional information has motion corresponding to motion of the at least one feature point of the stored moving image data,

wherein when selection information to select at least two feature points, including the detected at least one feature point, is input, the method further comprises generating data to generate a display size of the additional information according to a distance between the at least two feature points.

17. The image processing method according to claim 16 , wherein the display scenario selection information includes a user selection of the display scenario.

18. A non-transitory computer readable medium storing a program for causing at least one processor to perform a method comprising:

detecting a feature point from stored moving image data;

associating the feature point with additional information, the feature point being selected based on feature point selection information, wherein the additional information includes image data that is displayed as added to a reproduction of the stored moving image data;

analyzing a changing behavior of the feature point through the reproduction of the stored moving image data;

generating data indicating change content to change display of the image data of the additional information associated with the feature point based on motion information indicating the behavior of the feature point analyzed and a display scenario indicating a change pattern to change the additional information associated with the feature point according to the behavior of the feature point; and

controlling a display device to display the reproduction of the stored moving image data and to display the image data of the additional information based on the change content such that the image data of the additional information has motion corresponding to motion of the feature point of the stored moving image data,

wherein when selection information to select at least two feature points, including the detected feature point, is input, the method further comprises generating data to generate a display size of the additional information according to a distance between the at least two feature points.

19. The non-transitory computer readable medium according to claim 18 , wherein the display scenario selection information includes a user selection of the display scenario.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2010
From: MASUDA, TOORU
To: SONY CORPORATION
Reel/Frame 025450/0120 →
Priority Claims (1)
JP 2009-094370 · Apr 8, 2009 · national
Continuity (1)
Related Publication 20110181774A1 · Jul 28, 2011