IP Library Granted Patent US 9,613,661
Granted Patent B2
US 9,613,661 · App. 14/167,534 · Granted Apr 4, 2017

Information processing apparatus, recording medium, and information processing system

Inventors: Hideyuki Matsunaga (Tokyo, JP); Kosei Yamashita (Tokyo, JP)
Assignee: SONY CORPORATION
G11B27/10G06K9/0055G06K9/00342G09B19/0038G11B27/28G11B27/322A63B69/38
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,613,661
App. No.
14/167,534
Granted
Apr 4, 2017
Kind
B2
Abstract

There is provided an information processing that acquires captured image data of a subject; and associates a plurality of time points of the image data and a plurality of time points of event information based on sensor time information, the event information acquired based on sensor information acquired in time series by a sensor apparatus and indicating occurrence of an operation of the sensor apparatus.

Claims (60)

1. An information processing system comprising:

circuitry configured to

acquire captured image data of a subject;

associate a plurality of time points of the image data and a plurality of time points of event information based on sensor time information, the event information acquired based on sensor information including motion information of the subject and acquired in time series by a sensor apparatus attached to the subject and indicating occurrence of an operation of the sensor apparatus;

correct a time deviation between the image data and the event information, the time deviation being a deviation between a time in the image data and a time in the event information corresponding to a single real-world time; and

generate a digest image based on the event information.

2. The information processing system according to claim 1 , wherein

the circuitry is configured to acquire the sensor time information based on a predetermined operation of the sensor apparatus that is detected in the image data.

3. The information processing system according to claim 2 , wherein

the predetermined operation coincides with a time defined by a clock of the sensor apparatus.

4. The information processing system according to claim 2 , wherein

the predetermined operation indicates that the occurrence of an event is detected by the sensor apparatus.

5. The information processing system according to claim 1 , wherein

the circuitry is configured to acquire the sensor time information based on information received from the sensor apparatus while the image data is being captured.

6. The information processing system according to claim 5 , wherein

the information received from the sensor apparatus is metadata associated with the image data.

7. The information processing system according to claim 1 , wherein

the circuitry is configured to correct the time deviation by adjusting a fixed-value deviation between the plurality of time points of the image data and the plurality of time points of the event information based on the sensor time information at at least one time point.

8. The information processing system according to claim 1 , wherein

the circuitry is configured to correct the time deviation by adjusting a linear deviation between the plurality of time points of the image data and the plurality of time points event information based on the sensor time information at at least two time points.

9. The information processing system according to claim 1 , wherein

the circuitry is configured to correct the time deviation by adjusting the plurality of time points of the image data and the plurality of time points of the event information by comparing a time of occurrence of a first event group detected in the image data with a time of occurrence of a second event group defined by the event information.

10. The information processing system according to claim 9 , wherein

the circuitry is configured to set parameters for modifying the plurality of time points of the event information to obtain a highest correlation between the time of occurrence of the first event group and the time of occurrence of the second event group.

11. The information processing system according to claim 10 , wherein

the circuitry is configured to set the parameters for modifying the plurality of time points of the event information by at least one of offsetting and changing a length of the plurality of time points of the event information.

12. The information processing system according to claim 1 , wherein

the sensor time information indicates a time in the sensor apparatus at a time point while the image data is being captured.

13. The information processing system according to claim 1 , wherein the system comprises:

the sensor apparatus configured to acquire the sensor information in time series and execute a predetermined operation coinciding with a time; and

an imaging apparatus including the circuitry.

14. The information processing system according to claim 1 , further comprising:

a server including circuitry configured to perform the associating.

15. The information processing system according to claim 1 , wherein

the digest image includes a scene of an event designated by a user.

16. A non-transitory computer-readable recording medium having a program recorded thereon, the program causing a computer to:

acquire captured image data of a subject;

associate a plurality of time points of the image data and a plurality of time points of event information based on sensor time information, the event information acquired based on sensor information including motion information of the subject and acquired in time series by a sensor apparatus attached to the subject and indicating occurrence of an event in an action of the subject;

correct a time deviation between the image data and the event information, the time deviation being a deviation between a time in the imaae data and a time in the event information corresponding to a single real-world time; and

generate a digest image based on the event information.

17. The non-transitory computer-readable recording medium according to claim 16 , wherein

the digest image includes a scene of an event designated by a user.

18. An information processing system comprising:

circuitry configured to

acquire captured image data of a subject;

store the captured image data of the subject in association with a plurality of time stamps of the image data;

receive sensor information acquired in time series by a sensor apparatus attached to the subject and indicating occurrence of an operation of the sensor apparatus;

associate a plurality of the time stamps of the image data and a plurality of time stamps of event information based on sensor time information, the event information acquired based on the sensor information;

correct a time deviation between the image data and the event information, the time deviation being a deviation between a time in the image data and a time in the event information corresponding to a single real-world time; and

generate a digest image based on the event information.

19. The information processing system of claim 18 , further comprising:

a communication interface configured to receive the sensor information from the sensor apparatus.

20. The information processing system of claim 19 , wherein

the communication interface is a wireless communication interface configured to communicate directly with the sensor apparatus.

21. The information processing system of claim 18 , wherein

the circuitry is configured to transmit an instruction to activate the sensor apparatus upon the initiation of capturing the image data of the subject.

22. The information processing system of claim 18 , wherein

the information processing system is an imaging apparatus including a wireless interface configured to communicate with the sensory apparatus.

23. The information processing system according to claim 18 , wherein

the digest image includes a scene of an event designated by a user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2014
From: MATSUNAGA, HIDEYUKI; YAMASHITA, KOSEI
To: SONY CORPORATION
Reel/Frame 032288/0959 →
Priority Claims (1)
JP 2013-060061 · Mar 22, 2013 · national
Continuity (1)
Related Publication 20140286621A1 · Sep 25, 2014