IP Library › Granted Patent US 10,607,653
Granted Patent B2
US 10,607,653 · App. 15/740,495 · Granted Mar 31, 2020

Image processing method, image processing apparatus, and program

Inventors: Naoki Hayashi (Chiba, JP); Shintaro Kajiwara (Tokyo, JP); Yoshitaka Nakamura (Tokyo, JP)
Assignee: Sony Corporation
G11B27/34G11B20/10G11B27/031H04N5/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,653
App. No.
15/740,495
Filed
Dec 28, 2017
Granted
Mar 31, 2020
Kind
B2
Art Unit
2484
USPC
386/241
Abstract

To improve usability and edit efficiency of video data editing based on additional information, additional information added according to a time axis of video data is first recognized. An edit range of the video data is then set according to whether the additional information is first additional information for designating a specific point in time in the time axis of the video or second additional information for designating a specific time range in the time axis of the video. Therefore, a part to be handled as the edit range is set according to the additional data.

Claims (59)

1. An image processing method comprising:

recognizing, with an electronic processor, metadata added to video data in parallel to the video data being captured, the metadata being associated with one or more points in time along a time axis of the video data;

determining, with the electronic processor, whether the metadata is first additional information for designating a specific point in time in the time axis of the video data or second additional information for designating a specific time range in the time axis of the video data; and

setting, with the electronic processor, an edit range of the video data based on the determination of whether the metadata is the first additional information or the second additional information,

wherein in response to determining that the metadata is the first additional information, setting the edit range at the specific point in time designated by the first additional information; and

wherein in response to determining that the metadata is the second additional information, setting the edit range at a start point and an end point of the specific time range designated by the second additional information,

wherein setting the edit range at the specific point in time designated by the first additional information further includes setting the edit range to a first range from a first point in time that is a first set time period before the specific point in time to a second point in time that is a second set time period after the specific point in time according to the first additional information, and

wherein setting the edit range at the start point and the end point of the specific time range designated by the second additional information further includes setting the edit range to a second range from a third point in time that is a third set time period before the start point of the specific time range to a fourth point in time that is a fourth set time period after the end point of the specific time range according to the second additional information, and

wherein setting the edit range of the video data further includes variably setting one of the first set time period, the second set time period, the third set time period, or the fourth set time period based on one type of a plurality of types of metadata serving as the first additional information or the second additional information.

2. The image processing method according to claim 1 , wherein setting the edit range further includes setting the edit range as a range cut from the video data.

3. The image processing method according to claim 1 , further comprising:

controlling a display to display and present the edit range that is set for the video data.

4. The image processing method according to claim 3 , further comprising:

controlling the display to present the specific point in time in the video data designated by the first additional information.

5. The image processing method according to claim 3 , further comprising:

controlling the display to indicate a representative point in time to present the specific time range in the video data designated by the second additional information.

6. The image processing method according to claim 3 , further comprising:

controlling the display to reproduce and display the video data based on information of the edit range that is set.

7. The image processing method according to claim 1 , further comprising:

receiving an edit operation to edit the edit range that is set; and

changing the edit range that is set based on the edit operation that is received.

8. The image processing method according to claim 1 , further comprising:

receiving an edit operation to edit an image reproduction mode of the edit range that is set; and

changing the image reproduction mode of the edit range that is set based on the edit operation that is received.

9. The image processing method according to claim 1 , further comprising:

designating the one type of the plurality of types of metadata serving as the first additional information or the second additional information; and

setting a predetermined image reproduction mode in the edit range based on the one type of the plurality of types of metadata that is designated as the first additional information or the second additional information.

10. The image processing method according to claim 1 , further comprising:

setting one of the first set time period and the third set time period to a time length longer than a normally set time length when the one type of the metadata is added to the video data according to a user operation during video shooting of the video data.

11. The image processing method according to claim 1 , further comprising:

generating and outputting edited video data based on information of the edit range that is set.

12. The image processing method according to claim 11 , further comprising:

storing the edited video data in a storage medium.

13. The image processing method according to claim 11 , further comprising:

transmitting the edited video data to an external device.

14. An image processing apparatus comprising:

a memory; and

an electronic processor communicatively connected to the memory, the electronic processor is configured to

recognize metadata added to video data in parallel to the video data being captured, the metadata being associated with one or more points in according to a time axis of the video data;

determine whether the metadata is first additional information for designating a specific point in time in the time axis of the video data or second additional information for designating a specific time range in the time axis of the video data, and

set an edit range of the video data based on the determination of whether the metadata is the first additional information or the second additional information,

wherein in response to determining that the metadata is the first additional information, setting the edit range at the specific point in time designated by the first additional information; and

wherein in response to determining that the metadata is the second additional information, setting the edit range at a start point and an end point of the specific time range designated by the second additional information,

wherein setting the edit range at the specific point in time designated by the first additional information further includes setting the edit range to a first range from a first point in time that is a first set time period before the specific point in time to a second point in time that is a second set time period after the specific point in time according to the first additional information, and

wherein setting the edit range at the start point and the end point of the specific time range designated by the second additional information further includes setting the edit range to a second range from a third point in time that is a third set time period before the start point of the specific time range to a fourth point in time that is a fourth set time period after the end point of the specific time range according to the second additional information, and

wherein setting the edit range of the video data further includes variably setting one of the first set time period, the second set time period, the third set time period, or the fourth set time period based on one type of a plurality of types of metadata serving as the first additional information or the second additional information.

15. The image processing apparatus according to claim 14 , wherein the electronic processor is further configured to set one of the first set time period and the third set time period to a time length longer than a normally set time length when the one type of the metadata is added to the video data according to a user operation during video shooting of the video data.

16. The image processing apparatus according to claim 14 , wherein the electronic processor is further configured to control a display to display and present the edit range that is set for the video data.

17. A non-transitory computer-readable medium comprising a program that, when executed by an electronic processor, causes the electronic processor to perform a set of operations comprising:

recognizing metadata added to video data in parallel the video data being captured, the metadata being associated with one or more points in time along a time axis of the video data;

determining whether the metadata is first additional information for designating a specific point in time in the time axis of the video data or second additional information for designating a specific time range in the time axis of the video data; and

setting an edit range of the video data based on the determination of whether the metadata is the first additional information or the second additional information,

wherein in response to determining that the metadata is the first additional information, setting the edit range at the specific point in time designated by the first additional information; and

wherein in response to determining that the metadata is the second additional information, setting the edit range at a start point and an end point of the specific time range designated by the second additional information,

wherein setting the edit range at the specific point in time designated by the first additional information further includes setting the edit range to a first range from a first point in time that is a first set time period before the specific point in time to a second point in time that is a second set time period after the specific point in time according to the first additional information, and

wherein setting the edit range at the start point and the end point of the specific time range designated by the second additional information further includes setting the edit range to a second range from a third point in time that is a third set time period before the start point of the specific time range to a fourth point in time that is a fourth set time period after the end point of the specific time range according to the second additional information, and

wherein setting the edit range of the video data further includes variably setting one of the first set time period, the second set time period, the third set time period, or the fourth set time period based on one type of a plurality of types of metadata serving as the first additional information or the second additional information.

18. The non-transitory computer-readable medium according to claim 17 , wherein the set of operations further includes

setting one of the first set time period and the third set time period to a time length longer than a normally set time length when the one type of the metadata is added to the video data according to a user operation during video shooting of the video data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2017
From: HAYASHI, NAOKI; KAJIWARA, SHINTARO; NAKAMURA, YOSHITAKA
To: SONY CORPORATION
Reel/Frame 044969/0179 →
Priority Claims (1)
JP 2015-162581 · Aug 20, 2015 · national
Continuity (1)
Related Publication 20180190325A1 · Jul 5, 2018
Cited By (2)
US 12,238,265 US 12,316,965