IP Library Granted Patent US 10,462,497
Granted Patent B2
US 10,462,497 · App. 15/570,129 · Granted Oct 29, 2019

Free viewpoint picture data distribution system

Inventor: Akihiro Shimura (Tokyo, JP)
Assignee: DENTSU INC.
H04N21/21805G06F3/0481H04N21/2365H04N21/258H04N21/431H04N21/4402H04N21/44213H04N21/472H04N21/6587
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,462,497
App. No.
15/570,129
Granted
Oct 29, 2019
Kind
B2
Abstract

[TASK] To provide a recommended viewpoint to a user who is not familiar with a switching operation for switching a viewpoint of a free viewpoint motion image. [SOLUTION TO PROBLEMS] When a user gives a switching instruction for switching a viewpoint and a viewpoint direction by user terminals 3 a to 3 n −1, the switching instruction is sent to a distribution computer 2 . The distribution computer 2 stores the switching instruction for each user ID and for each content ID. The distribution computer 2 generates recommended projection characteristic data on the basis of a plurality of switching instructions for free viewpoint motion image data corresponding to its content ID. When a new distribution request for data corresponding to the content ID is received from the user terminal 3 n , the distribution computer 2 distributes recommended projection characteristic data together with free viewpoint motion image data.

Claims (82)

1. A free viewpoint picture data distribution system comprising:

a distribution computer including:

a CPU; and

storage that stores free viewpoint picture data capable of changing a viewpoint for viewing, the distribution computer distributes the free viewpoint picture data to a user terminal, wherein the user terminal receives the free viewpoint picture data, generates, when projection characteristic data including a viewpoint and a viewpoint direction is given, specific viewpoint motion image data viewed from the viewpoint and the viewpoint direction for the free viewpoint picture data, displays the generated specific viewpoint motion image data, and causes, when projection characteristic changing data for changing a projection characteristic for the specific viewpoint motion image data displayed on the display means is given from an operator of the user terminal, generation of specific viewpoint motion image data based on the projection characteristic changing data, and sends a history of the projection characteristic changing data to the distribution computer,

wherein the distribution computer further receives the history of the projection characteristic changing data as user-specific operation data, stores the received user-specific operation data, determines user-specific operation data having a characteristic operation trend common in the plural pieces of user-specific operation data as target user-specific operation data for generating a recommended display condition, and determines representative user-specific operation data on the basis of the target user-specific operation data, wherein the recommended display condition is distributed together with the free viewpoint picture data,

wherein, at a relative elapsed time from a start of playback, if a viewpoint change history matches among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data, and

wherein, if a change history of the viewpoint direction also matches in addition to the viewpoint change history, such user-specific operation data is determined as the target user-specific operation data.

2. The free viewpoint picture data distribution system according to claim 1 ,

wherein, if viewpoint change timing matches in a relative elapsed time from a start of playback, such user-specific operation data is determined as the target user-specific operation data.

3. The free viewpoint picture data distribution system according to claim 1 ,

wherein, if at least one combination of a viewpoint and a viewpoint direction matches in a relative elapsed time from a start of playback among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

4. The free viewpoint picture data distribution system according to according to claim 1 ,

wherein, at a relative elapsed time from a start of playback, if zoom processing is performed at the same relative elapsed time among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

5. The free viewpoint picture data distribution system according to claim 1 ,

wherein, at a relative elapsed time from a start of playback, if timing for changing a playback speed matches among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

6. The free viewpoint picture data distribution system according to claim 1 ,

wherein user-specific operation data of a user whose total number of pieces of user-specific operation data stored excesses a predetermined value is determined as the target user-specific operation data.

7. The free viewpoint picture data distribution system according to claim 1 ,

wherein user-specific operation data of a user whose total number of pieces of user-specific operation data among the user-specific operation data related to specific motion image data excesses a predetermined value is determined as the target user-specific operation data.

8. A free viewpoint picture data distribution system comprising:

a distribution computer including:

a CPU; and

storage that stores free viewpoint picture data capable of changing a viewpoint for viewing, the distribution computer distributes the free viewpoint picture data to a user terminal, wherein the user terminal receives the free viewpoint picture data, generates, when projection characteristic data including a viewpoint and a viewpoint direction is given, specific viewpoint motion image data viewed from the viewpoint and the viewpoint direction for the free viewpoint picture data, displays the generated specific viewpoint motion image data, and causes, when projection characteristic changing data for changing a projection characteristic for the specific viewpoint motion image data displayed on the display means is given from an operator of the user terminal, generation of specific viewpoint motion image data based on the projection characteristic changing data, and sends a history of the projection characteristic changing data to the distribution computer,

wherein the distribution computer further receives the history of the projection characteristic changing data as user-specific operation data, stores the received user-specific operation data, determines user-specific operation data having a characteristic operation trend common in the plural pieces of user-specific operation data as target user-specific operation data for generating a recommended display condition, and determines representative user-specific operation data on the basis of the target user-specific operation data, wherein the recommended display condition is distributed together with the free viewpoint picture data,

wherein user-specific operation data including a specific operation is determined as the target user-specific operation data, and the specific operation is a zoom-in operation, and further wherein the specific operation takes more than a predetermined time period for the total operating time after the zoom-in operation.

9. The free viewpoint picture data distribution system according to claim 8 ,

wherein, if viewpoint change timing matches in a relative elapsed time from a start of playback, such user-specific operation data is determined as the target user-specific operation data.

10. The free viewpoint picture data distribution system according to claim 8 ,

wherein, if at least one combination of a viewpoint and a viewpoint direction matches in a relative elapsed time from a start of playback among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

11. The free viewpoint picture data distribution system according to according to claim 8 ,

wherein, at a relative elapsed time from a start of playback, if zoom processing is performed at the same relative elapsed time among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

12. The free viewpoint picture data distribution system according to claim 8 ,

wherein, at a relative elapsed time from a start of playback, if timing for changing a playback speed matches among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

13. The free viewpoint picture data distribution system according to claim 8 ,

wherein user-specific operation data of a user whose total number of pieces of user-specific operation data stored excesses a predetermined value is determined as the target user-specific operation data.

14. The free viewpoint picture data distribution system according to claim 8 ,

wherein user-specific operation data of a user whose total number of pieces of user-specific operation data among the user-specific operation data related to specific motion image data excesses a predetermined value is determined as the target user-specific operation data.

15. A free viewpoint picture data distribution system comprising:

a distribution computer including:

A CPU; and

storage that stores free viewpoint picture data capable of changing a viewpoint for viewing, a distribution computer generates, when a viewpoint and a viewpoint direction is given, specific viewpoint motion image data viewed from the viewpoint and the viewpoint direction for the free viewpoint picture data and distributes the specific viewpoint motion image data to a user terminal, wherein the user terminal receives the specific viewpoint motion image data and displays the specific viewpoint motion image data, gives a switching instruction to the distribution computer when an instruction to switch a viewpoint and a viewpoint direction for the specific viewpoint motion image data displayed is given from a user,

wherein the distribution computer receives a history of the switching instruction as user-specific operation data, generates new specific viewpoint motion image data on the basis of the switching instruction and causes the distribution means to distribute the generated new specific viewpoint motion image data; and

wherein the distribution computer further:

stores the received user-specific operation data; and

determines user-specific operation data having a characteristic operation trend common in the plural pieces of user-specific operation data as target user-specific operation data for generating a recommended display condition, and for determining representative user-specific operation data on the basis of the target user-specific operation data; and

wherein the distribution means distributes the specific viewpoint motion image data on the basis of the recommended display condition,

wherein, at a relative elapsed time from a start of playback, if a viewpoint change history matches among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data, and

wherein, if a change history of the viewpoint direction also matches in addition to the viewpoint change history, such user-specific operation data is determined as the target user-specific operation data.

16. The free viewpoint picture data distribution system according to claim 15 ,

wherein, if viewpoint change timing matches in a relative elapsed time from a start of playback, such user-specific operation data is determined as the target user-specific operation data.

17. The free viewpoint picture data distribution system according to claim 15 ,

wherein, if at least one combination of a viewpoint and a viewpoint direction matches in a relative elapsed time from a start of playback among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

18. The free viewpoint picture data distribution system according to according to claim 15 ,

wherein, at a relative elapsed time from a start of playback, if zoom processing is performed at the same relative elapsed time among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

19. The free viewpoint picture data distribution system according to claim 15 ,

wherein, at a relative elapsed time from a start of playback, if timing for changing a playback speed matches among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

20. The free viewpoint picture data distribution system according to claim 15 ,

wherein user-specific operation data of a user whose total number of pieces of user-specific operation data stored excesses a predetermined value is determined as the target user-specific operation data.

21. The free viewpoint picture data distribution system according to claim 15 ,

wherein user-specific operation data of a user whose total number of pieces of user-specific operation data among the user-specific operation data related to specific motion image data excesses a predetermined value is determined as the target user-specific operation data.

22. A free viewpoint picture data distribution system comprising:

a distribution computer including:

A CPU; and

storage that stores free viewpoint picture data capable of changing a viewpoint for viewing, a distribution computer generates, when a viewpoint and a viewpoint direction is given, specific viewpoint motion image data viewed from the viewpoint and the viewpoint direction for the free viewpoint picture data and distributes the specific viewpoint motion image data to a user terminal, wherein the user terminal receives the specific viewpoint motion image data and displays the specific viewpoint motion image data, gives a switching instruction to the distribution computer when an instruction to switch a viewpoint and a viewpoint direction for the specific viewpoint motion image data displayed is given from a user,

wherein the distribution computer receives a history of the switching instruction as user-specific operation data, generates new specific viewpoint motion image data on the basis of the switching instruction and causes the distribution means to distribute the generated new specific viewpoint motion image data; and

wherein the distribution computer further:

stores the received user-specific operation data; and

determines user-specific operation data having a characteristic operation trend common in the plural pieces of user-specific operation data as target user-specific operation data for generating a recommended display condition, and for determining representative user-specific operation data on the basis of the target user-specific operation data; and

wherein the distribution means distributes the specific viewpoint motion image data on the basis of the recommended display condition,

wherein user-specific operation data including a specific operation is determined as the target user-specific operation data, and the specific operation is a zoom-in operation, and further wherein the specific operation takes more than a predetermined time period for the total operating time after the zoom-in operation.

23. The free viewpoint picture data distribution system according to claim 22 ,

wherein, if viewpoint change timing matches in a relative elapsed time from a start of playback, such user-specific operation data is determined as the target user-specific operation data.

24. The free viewpoint picture data distribution system according to claim 22 ,

wherein, if at least one combination of a viewpoint and a viewpoint direction matches in a relative elapsed time from a start of playback among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

25. The free viewpoint picture data distribution system according to according to claim 22 ,

wherein, at a relative elapsed time from a start of playback, if zoom processing is performed at the same relative elapsed time among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

26. The free viewpoint picture data distribution system according to claim 22 ,

wherein, at a relative elapsed time from a start of playback, if timing for changing a playback speed matches among the plural pieces of user-specific operation data, such user-specific operation data is determined as the target user-specific operation data.

27. The free viewpoint picture data distribution system according to claim 22 ,

wherein user-specific operation data of a user whose total number of pieces of user-specific operation data stored excesses a predetermined value is determined as the target user-specific operation data.

28. The free viewpoint picture data distribution system according to claim 22 ,

wherein user-specific operation data of a user whose total number of pieces of user-specific operation data among the user-specific operation data related to specific motion image data excesses a predetermined value is determined as the target user-specific operation data.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2023
From: DENTSU GROUP INC.
To: DENTSU INC.
Reel/Frame 062836/0966 →
CHANGE OF NAME Recorded Feb 21, 2023
From: DENTSU INC.
To: DENTSU GROUP INC.
Reel/Frame 062813/0637 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2017
From: SHIMURA, AKIHIRO
To: DENTSU INC.
Reel/Frame 043973/0389 →
Priority Claims (1)
JP 2015-094365 · May 1, 2015 · national
Continuity (1)
Related Publication 20180146218A1 · May 24, 2018