IP Library › Granted Patent US 10,635,931
Granted Patent B2
US 10,635,931 · App. 15/516,796 · Granted Apr 28, 2020

Information processing device, information processing method, and program

Inventors: Kazuhiro Shimauchi (Tokyo, JP); Seijiro Inaba (Kanagawa, JP); Nobuho Ikeda (Kanagawa, JP); Hiroshi Ikeda (Kanagawa, JP); Shuichi Asajima (Tokyo, JP); Yuki Ono (Kanagawa, JP)
Assignee: Sony Corporation
G06K9/6202G06K9/00664G06K9/00765G06K9/3233G06K9/6215G06K9/6284G06K2209/27
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,635,931
App. No.
15/516,796
Granted
Apr 28, 2020
Kind
B2
Abstract

The present technology relates to an information processing device, an information processing method, and a program that are designed to enable easy generation of a path for successively displaying characteristic images. The information processing device includes a setting unit that sets a path for connecting characteristic portions in at least one image by referring to metadata including at least information about feature points detected from the image. The setting unit sets the path by determining a regression curve, using the feature points. In a case where the feature points include a feature point at a distance equal to or longer than a predetermined threshold value from the regression curve, the setting unit redetermines the regression curve after removing a feature point detected from an image including a feature point having a low score among the feature points. The present technology can be applied to information processing devices that process still images and moving images.

Claims (41)

1. An information processing device comprising:

a processor; and

a memory, the memory storing program code executable by the processor to perform operations comprising:

setting a viewing path for connecting characteristic portions in an image by referring to metadata including at least information about a plurality of feature points detected from the image,

wherein the viewing path is arranged for successively viewing different fields of view within the image with progression along the viewing path, and wherein the viewing path includes one or more of the characteristic portions, and

setting the viewing path comprises determining a regression curve using the feature points.

2. The information processing device according to claim 1 , wherein, when the feature points include a feature point at a distance equal to or longer than a predetermined threshold value from the regression curve, setting the viewing path comprises re-determining the regression curve after removing a feature point that has a low score among the feature points.

3. The information processing device according to claim 1 , wherein setting the viewing path further comprises dividing the determined regression curve into a plurality of sections, determining differential values for the respective sections, and, when at least one of the differential values is equal to or smaller than a predetermined threshold value, re-determining the regression curve after increasing an order for determining the regression curve.

4. The information processing device according to claim 1 , wherein the image is a moving image.

5. The information processing device according to claim 1 , wherein the image is one of a plurality of images, and the viewing path connects characteristic portions respectively included in the plurality of images.

6. An information processing method comprising:

setting a viewing path for connecting characteristic portions an image by referring to metadata including at least information about a plurality of feature points detected from the image,

wherein the viewing path is arranged for successively viewing different fields of view within the image along the viewing path, and wherein the viewing path includes one or more of the characteristic portions, and

setting the viewing path comprises determining a regression curve using the feature points.

7. The method according to claim 6 , wherein, when the feature points include a feature point at a distance equal to or longer than a predetermined threshold value from the regression curve, setting the viewing path comprises re-determining the regression curve after removing a feature point detected from an image including a feature point having a low score among the feature points.

8. The method according to claim 6 , wherein the image is a moving image.

9. A non-transitory computer-readable medium storing a program, the program being executable by a processor to perform operations comprising:

setting a viewing path for connecting characteristic portions an image by referring to metadata including at least information about a plurality of feature points detected from the image,

wherein the viewing path is arranged for successively viewing different fields of view within the image along the viewing path, and wherein the viewing path includes one or more of the characteristic portions, and

setting the viewing path comprises determining a regression curve using the feature points.

10. The computer readable medium according to claim 9 , wherein, when the feature points include a feature point at a distance equal to or longer than a predetermined threshold value from the regression curve, setting the viewing path comprises re-determining the regression curve after removing a feature point detected from an image including a feature point having a low score among the feature points.

11. The computer readable medium according to claim 9 , wherein the image is a moving image.

12. An information processing device comprising:

a processor; and

a memory, the memory storing program code executable by the processor to perform operations comprising:

setting a viewing path for connecting characteristic portions in an image by referring to metadata including at least information about a plurality of feature points detected from the image,

wherein the viewing path is arranged for successively viewing different fields of view within the image with progression along the viewing path, and wherein the viewing path includes one or more of the characteristic portions,

wherein the image is a moving image, and

setting the viewing path comprises setting an effect period for providing an effect, the effect period being a period in which feature points in a divisional period obtained by dividing the moving image into a plurality of periods satisfy a predetermined condition.

13. The information processing device according to claim 12 , wherein the predetermined condition is that the number of feature points in the divisional period is equal to or larger than a threshold value.

14. The information processing device according to claim 12 , wherein the effect is a time-slice effect.

15. The information processing device according to claim 12 , wherein the effect is an effect to display a scene captured from different angles in the same period.

16. The information processing device according to claim 12 , wherein setting the viewing path comprises setting a chronological path outside the effect period.

17. An information processing device comprising:

a processor; and

a memory, the memory storing program code executable by the processor to perform operations comprising:

setting a viewing path for connecting characteristic portions in an image by referring to metadata including at least information about a plurality of feature points detected from the image,

wherein the viewing path is arranged for successively viewing different fields of view within the image with progression along the viewing path, and wherein the viewing path includes one or more of the characteristic portions,

the image is one of a plurality of the images,

the images are classified into a unified group including an image having an imaging range overlapping an imaging range of another image and an isolated group having an imaging range not overlapping an imaging range of another image, and

setting the viewing path comprises setting a global path for all images in the unified group, and setting a local path for each image in the unified group.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2017
From: SHIMAUCHI, KAZUHIRO; INABA, SEIJIRO; IKEDA, NOBUHO; IKEDA, HIROSHI; ASAJIMA, SHUICHI; ONO, YUKI
To: SONY CORPORATION
Reel/Frame 042155/0456 →
Priority Claims (1)
JP 2014-209971 · Oct 14, 2014 · national
Continuity (1)
Related Publication 20170308771A1 · Oct 26, 2017