IP Library Granted Patent US 8,958,686
Granted Patent B2
US 8,958,686 · App. 13/248,584 · Granted Feb 17, 2015

Information processing device, synchronization method, and program

Inventor: Shingo Tsurumi (Saitama, JP)
Assignee: Sony Corporation
H04N5/91G11B27/034G11B27/28H04N21/42203H04N21/4325H04N21/4334H04N21/8106G11B2020/10537H04N5/765H04N9/8205
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,958,686
App. No.
13/248,584
Granted
Feb 17, 2015
Kind
B2
Abstract

An information processing system including a first apparatus that reproduces content, acquires behavior data corresponding to a viewer of the reproduced content, and stores the acquired behavior data and synchronization data indicating a timing of the reproduced content with respect to the acquired behavior data. The system also includes a second apparatus that reproduces the content with the behavior data based on the stored synchronization data.

Claims (40)

1. An information processing system, comprising:

a first apparatus operable to:

reproduce content;

acquire behavior data corresponding to a viewer of the reproduced content, wherein the behavior data comprises captured video data of the viewer during the reproduction of the content; and

store the acquired behavior data and synchronization data indicating a timing of the reproduced content with respect to the acquired behavior data; and a second apparatus operable to:

reproduce the content along with reproducing the acquired behavior data based on the stored synchronization data, wherein the second apparatus is operable to detect a face area of the viewer from the captured video data, and reproduce the content along with the detected face area based on the stored synchronization data.

2. The information processing system of claim 1 , wherein the behavior data comprises manipulation data indicating one or more of: a play, pause and fast-forward operation performed on the content reproduced by the first apparatus.

3. The information processing system of claim 2 , wherein the second apparatus is operable to reproduce the content in accordance with the manipulation data based on the stored synchronization data.

4. The information processing system of claim 1 , wherein the content is one or more of: still image data, music data, game data and video data.

5. The information processing system of claim 1 , wherein the synchronization data is metadata generated by the first apparatus.

6. The information processing system of claim 1 , wherein the synchronization data comprises an association between a start time of acquisition of the behavior data and a start time of reproduction of the content by the first apparatus.

7. The information processing system of claim 1 , wherein the synchronization data comprises an association between the acquired behavior data and a frame of the content reproduced by the first apparatus.

8. The information processing system of claim 1 , wherein the first apparatus is configured to detect subject area from the reproduced content.

9. The information processing system of claim 8 , wherein the first apparatus extracts at least one of luminance information, color information, edge information, face information and motion information to generate a subject map that specifies the subject area.

10. The information processing system of claim 8 , wherein the subject area is a face area or a dynamic subject area of the reproduced content.

11. The information processing system of claim 8 , wherein the second apparatus is operable to reproduce the content with the behavior data so that the behavior data does not overlap the detected subject area.

12. The information processing system of claim 1 , wherein the first apparatus is operable to detect a characteristic of the viewer from the acquired behavior data.

13. The information processing system of claim 12 , wherein the first apparatus is operable to generate feature information corresponding to the detected characteristic of the viewer.

14. The information processing system of claim 12 , wherein the first apparatus is operable to store the detected characteristic and the synchronization data indicating the timing of the reproduced content corresponding to the detected characteristic.

15. The information processing system of claim 1 , wherein the second apparatus is operable to generate a graphic corresponding to a generated feature information, and reproduce the content with the generated graphic based on the stored synchronization data.

16. The information processing system of claim 1 , wherein the second apparatus is operable to:

reproduce the content with the behavior data based on the stored synchronization data;

acquire second behavior data corresponding to a second viewer of the reproduced content; and

store the acquired second behavior data and second synchronization data indicating a timing of the reproduced content with respect to the acquired second behavior data.

17. The information processing system of claim 1 , wherein the behavior data is acquired when determining that the viewer is watching the reproduced content.

18. An information processing method, comprising:

reproducing content by a first apparatus;

acquiring, by the first apparatus, behavior data corresponding to a viewer of the reproduced content, wherein the behavior data comprises captured video data of the viewer during the reproduction of the content;

storing, at the first apparatus, the acquired behavior data and synchronization data indicating a timing of the reproduced content with respect to the acquired behavior data; and

reproducing, by a second apparatus, the content along with reproducing the acquired behavior data based on the stored synchronization data, wherein the second apparatus is operable to detect a face area of the viewer from the captured video data, and reproduce the content along with the detected face area based on the stored synchronization data.

19. A non-transitory computer-readable medium having stored thereon, a computer program having at least one code section for information processing, the at least one code section being executable by one or more processors for causing a computer to perform steps comprising:

reproducing content at an apparatus;

acquiring behavior data corresponding to a viewer of the reproduced content, wherein the behavior data comprises captured video data of the viewer during the reproduction of the content, wherein when the content is reproduced along with reproducing the acquired behavior data at another apparatus, a face area of the viewer is detected from the captured video data and the detected face area is reproduced along with the content; and

storing the acquired behavior data and synchronization data indicating a timing of the reproduced content with respect to the acquired behavior data.

20. An information processing system, comprising:

a first apparatus operable to:

reproduce content;

acquire behavior data corresponding to a viewer of the reproduced content, wherein the behavior data comprises captured video data of the viewer during the reproduction of the content, wherein the behavior data comprises manipulation data indicating one or more of: a play, pause or fast-forward operation performed on the content reproduced by the first apparatus; and

store the acquired behavior data and synchronization data indicating a timing of the reproduced content with respect to the acquired behavior data; and a second apparatus operable to:

reproduce the content with the acquired behavior data based on the stored synchronization data, wherein the second apparatus is operable to detect a face area of the viewer from the captured video data, and reproduce the content with the detected face area based on the stored synchronization data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2011
From: TSURUMI, SHINGO
To: SONY CORPORATION
Reel/Frame 026991/0835 →
Priority Claims (1)
JP P2010-232171 · Oct 15, 2010 · national
Continuity (1)
Related Publication 20120093486A1 · Apr 19, 2012