IP Library Granted Patent US 11,321,880
Granted Patent B2
US 11,321,880 · App. 16/772,470 · Granted May 3, 2022

Information processor, information processing method, and program for specifying an important region of an operation target in a moving image

Inventor: Shogo Takanashi (Tokyo, JP)
Assignee: SONY CORPORATION
G06T11/00G06F3/0354G06F3/0425G06F3/04883G06K9/00355
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,321,880
App. No.
16/772,470
Granted
May 3, 2022
Kind
B2
Abstract

[Object] There is provided a mechanism that makes it possible to efficiently specify an important region of a moving image including a dynamic content. [Solution] An information processor including a control unit that recognizes a motion of an operator with respect to an operation target in a moving image and specifies an important region of the operation target in the moving image on a basis of an operation position of the operator.

Claims (34)

1. An information processing apparatus comprising:

processing circuitry configured to

recognize a motion of an operator with respect to an operation target in a moving image and specify an important region of the operation target in the moving image on a basis of an operation position of the operator,

wherein the processing circuitry is configured to specify the important region by generating a reproduction screen including a first region showing at least a portion of a first frame of the moving image having information indicating the important region superimposed thereon and including at least a portion of a second frame of the moving image having information indicating the important region superimposed thereon.

2. The information processing apparatus processor according to claim 1 , wherein each of the first frame and the second frame is associated with a time indicator corresponding to the respective frame.

3. The information processing apparatus according to claim 2 , wherein, in the first region,

the first frame and the second frame are arranged in a predetermined direction from one end toward another end in a reproduction order of the moving image.

4. The information processing apparatus according to claim 2 , wherein, in the first region, the first frame and the second frame are arranged in a predetermined direction from one end toward another end in an order of importance of the important region of the first frame and the second frame.

5. The information processing apparatus according to claim 2 , wherein the processing circuitry is configured to assign a reproduction index to each of the first frame and the second frame in accordance with importance of the important region of the first frame and the second frame.

6. The information processing apparatus according to claim 5 , wherein the processing circuitry is configured to assign the reproduction index based on a predetermined condition of a start and an end of accumulation of respective importances of one or more important regions of frames included in the moving image.

7. The information processing apparatus according to claim 6 , wherein the processing circuitry is configured to assign the reproduction index at a time when the respective importances of the one or more important regions of frames included in the moving image reach a peak.

8. The information processing apparatus according to claim 2 , wherein the reproduction screen further includes a second region in which the moving image is reproduced, and a third region in which the first frame or the second frame is displayed at a time corresponding to a reproduction position of the moving image.

9. The information processing apparatus according to claim 8 , wherein, in response to a selection of one of the first frame or the second frame included in the first region, the processing circuitry is configured to reproduce the moving image from a reproduction position corresponding to the selected one of the first image or the second image.

10. The information processing apparatus according to claim 8 , wherein, in response to a selection of the one of the first frame or the second frame included in the first region, the processing circuitry is configured to reproduce the moving image from a reproduction position corresponding to a change in the important region included in the selected one of the first image or the second image.

11. The information processing apparatus according to claim 2 , wherein the reproduction screen includes an image in which information is superimposed on an image of the operation target, the information indicating the important regions of the first frame and the second frame.

12. The information processing apparatus according to claim 11 , wherein the information indicating the important regions is displayed with respective time points in the moving image corresponding to each of the important regions.

13. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to calculate an accumulated value of a time in which the operation position remains for each region of the operation target appearing in the moving image, and specifies a region having an accumulated value above a threshold as the important region.

14. The information processing apparatus according to claim 13 , wherein the processing circuitry is configured decrease the accumulated value of a region of the operation target when the operation position no longer points to the region.

15. The information processing apparatus according to claim 14 , wherein the processing circuitry is configured to start decreasing the accumulated value in response to a determination that a predetermined change has occurred in the operation target appearing in the moving image.

16. The information processing apparatus according to claim 1 , wherein

the operation target comprises a writing surface on which information is written, and

the operation position comprises a position of a hand of the operator or a position pointed by a pointer held by the operator.

17. An information processing apparatus comprising:

processing circuitry configured to

control a display of information indicating an important region of an operation target in a moving image, the important region being specified on a basis of an operation position of an operator with respect to the operation target in the moving image,

wherein the processing circuitry is configured to control the display of the information by generating a reproduction screen including a first region showing at least a portion of a first frame of the moving image having information indicating the important region superimposed thereon and including at least a portion of a second frame of the moving image having information indicating the important region superimposed thereon.

18. An information processing method executed by a processor, the method comprising:

recognizing a motion of an operator with respect to an operation target in a moving image; and

specifying, by processing circuitry, an important region of the operation target in the moving image on a basis of an operation position of the operator,

wherein the specifying includes generating a reproduction screen including a first region showing at least a portion of a first frame of the moving image having information indicating the important region superimposed thereon and including at least a portion of a second frame of the moving image having information indicating the important region superimposed thereon.

19. A non-transitory computer-readable storage medium storing computer-readable instructions thereon, which, when executed by a computer, cause the computer to perform an information processing method comprising:

recognizing a motion of an operator with respect to an operation target in a moving image; and

specifying an important region of the operation target in the moving image on a basis of an operation position of the operator,

wherein the specifying includes generating a reproduction screen including a first region showing at least a portion of a first frame of the moving image having information indicating the important region superimposed thereon and including at least a portion of a second frame of the moving image having information indicating the important region superimposed thereon.

Assignments (2)
CHANGE OF NAME Recorded Jun 13, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 063984/0837 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2020
From: TAKANASHI, SHOGO
To: SONY CORPORATION
Reel/Frame 053933/0422 →
Priority Claims (1)
JP JP2017-245779 · Dec 22, 2017 · national
Continuity (1)
Related Publication 20200388057A1 · Dec 10, 2020