IP Library Granted Patent US 11,069,137
Granted Patent B2
US 11,069,137 · App. 16/832,640 · Granted Jul 20, 2021

Rendering captions for media content

Inventors: Jussi Leppänen (Tampere, FI); Sujeet Mate (Tampere, FI); Arto Lehtiniemi (Lempaala, FI); Antti Eronen (Tampere, FI)
Assignee: NOKIA TECHNOLOGIES OY
G06T19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,069,137
App. No.
16/832,640
Granted
Jul 20, 2021
Kind
B2
Abstract

An apparatus comprising means for rendering virtual reality content, wherein the virtual reality content comprises a virtual reality object associated with a caption and wherein the caption is rendered within a field of view of a user; determining a level of interest with respect to the virtual reality object; and determining if the caption is to be rendered based at least partly on the determined level of interest associated with the virtual reality object.

Claims (38)

1. An apparatus comprising:

at least one processor; and

at least one memory including computer program code,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

cause rendering of virtual reality content, wherein the virtual reality content comprises a virtual reality object associated with a caption and wherein the caption is rendered within a field of view of a user;

determine a level of interest with respect to the virtual reality object;

determine if the caption is to be rendered based at least partly on the determined level of interest associated with the virtual reality object;

detect a change in the field of view of the user such that the virtual reality object is outside the field of view;

determine whether the caption is to be rendered after the detected change based, at least partly, on the determined level of interest associated with the virtual reality object; and

in an instance the caption is to be rendered after the detected change, cause rendering of the caption at least one of in a position indicative of a direction of the virtual reality object, or with a visual indicator of the direction of the virtual reality object.

2. The apparatus according to claim 1 , wherein the caption comprises textual content related to the virtual reality object the caption is associated with.

3. The apparatus according to claim 2 , wherein the textual content is determined using speech recognition and automatic translation.

4. The apparatus according to claim 1 , wherein determining the level of interest with respect to the virtual reality object comprises at least one of: detecting gaze of the user, detecting orientation of the user's head, detecting what the user is listening to or receiving user input indicative of interest with respect to the object.

5. The apparatus according to claim 1 , wherein detecting the change in the field of view comprises at least one of detecting movement of a user, or a part of the user, or receiving an input that is determined to represent movement of the user.

6. The apparatus according to claim 5 , wherein the determining if the caption is to be displayed after the detected change in the field of view is further based on a virtual distance between virtual reality object and the user after the movement.

7. A method comprising

causing rendering of virtual reality content, wherein the virtual reality content comprises a virtual reality object associated with a caption and wherein the caption is rendered within a field of view of a user;

determining a level of interest with respect to the virtual reality object;

determining if the caption is to be rendered after based at least partly on the determined level of interest associated with the virtual reality object;

detecting a change in the field of view of the user such that the virtual reality object is outside the field of view;

determining whether the caption is to be rendered after the detected change based, at least partly, on the determined level of interest associated with the virtual reality object; and

in an instance the caption is to be rendered after the detected change, causing rendering of the caption at least one of in a position indicative of a direction of the virtual reality object, or with a visual indicator of the direction of the virtual reality object.

8. The method according to claim 7 , wherein the caption comprises textual content related to the virtual reality object the caption is associated with.

9. The method according to claim 8 , wherein the textual content is determined using speech recognition and automatic translation.

10. The method according to claim 7 , wherein determining the level of interest with respect to the virtual reality object comprises at least one of: detecting gaze of the user, detecting orientation of the user's head, detecting what the user is listening to or receiving user input indicative of interest with respect to the object.

11. The method according to claim 7 , wherein detecting the change in the field of view comprises at least one of detecting movement of a user, or a part of the user, or receiving an input that is determined to represent movement of the user.

12. The method according to claim 11 , wherein the determining if the caption is to be displayed after the detected change in the field of view is further based on a virtual distance between virtual reality object and the user after the movement.

13. A non-transitory computer readable medium comprising program instructions stored thereon for performing at least the following:

cause rendering of virtual reality content, wherein the virtual reality content comprises a virtual reality object associated with a caption and wherein the caption is rendered within a field of view of a user;

determine a level of interest with respect to the virtual reality object;

determine if the caption is to be rendered based at least partly on the determined level of interest associated with the virtual reality object;

detect a change in the field of view of the user such that the virtual reality object is outside the field of view;

determine whether the caption is to be rendered after the detected change based, at least partly, on the determined level of interest associated with the virtual reality object; and

in an instance the caption is to be rendered after the detected change, cause rendering of the caption at least one of in a position indicative of a direction of the virtual reality object, or with a visual indicator of the direction of the virtual reality object.

14. The non-transitory computer readable medium according to claim 13 , wherein the caption comprises textual content related to the virtual reality object the caption is associated with.

15. The non-transitory computer readable medium according to claim 14 , wherein the textual content is determined using speech recognition and automatic translation.

16. The non-transitory computer readable medium according to claim 13 , wherein determining the level of interest with respect to the virtual reality object comprises at least one of: detecting gaze of the user, detecting orientation of the user's head, detecting what the user is listening to or receiving user input indicative of interest with respect to the object.

17. The non-transitory computer readable medium according to claim 13 , wherein detecting the change in the field of view comprises at least one of detecting movement of a user, or a part of the user, or receiving an input that is determined to represent movement of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2020
From: LEPPANEN, JUSSI; MATE, SUJEET; LEHTINIEMI, ARTO; ERONEN, ANTTI
To: NOKIA TECHNOLOGIES OY
Reel/Frame 053151/0646 →
Priority Claims (1)
EP 19166620 · Apr 1, 2019 · regional
Continuity (1)
Related Publication 20200312025A1 · Oct 1, 2020