Separate time-warping for a scene and an object for display of virtual reality content

1. A computer-implemented method comprising:

performing a first time-warping of a scene of virtual reality content based on head pose information received during or after a rendering of the scene to obtain a time-warped scene;

performing a second time-warping of an object based at least on object pose information received during or after a rendering of the object to obtain a time-warped object; and

displaying on a display device a composite image based on the time-warped scene and the time-warped object.

2. The method of claim 1 :

wherein the head pose information includes information indicating a head pose, the head pose information comprising at least one of location information indicating a location of a user's head or of a virtual reality headset worn by a user and orientation information indicating an orientation of the user's head or of the virtual reality headset.

3. The method of claim 1 :

wherein the head pose information comprises head pose information received from a tracking device that tracks a pose of a virtual reality headset worn by a user.

4. The method of claim 1 :

wherein the object pose information includes information indicating an object pose, the object pose information comprising at least one of location information indicating a location of the object and orientation information indicating an orientation of the object.

5. The method of claim 1 :

wherein the object comprises a virtual object to be displayed on the display device; and

wherein the object pose information comprises at least one of location information and orientation information of the virtual object.

6. The method of claim 5 :

wherein the object comprises a virtual object to be displayed on the display device; and

wherein the object pose information comprises at least one of the following:

at least one of location information and orientation information of the virtual object received from a virtual reality application; and

at least one of location information and orientation information of the virtual object received from a tracking device that tracks a pose of a controller or other physical object that controls the location and orientation of the virtual object.

7. The method of claim 1 , further comprising:

receiving a first head pose information;

performing a rendering of the scene based on the first head pose information; and

receiving a second head pose information during or after the rendering of the scene;

wherein performing the first time-warping of the scene comprises at least rotating the scene based on the second head pose information to obtain the time-warped scene.

8. The method of claim 1 , further comprising:

receiving a first object pose information;

performing a rendering of the object based on the first object pose information; and

receiving a second object pose information during or after the rendering of the object;

wherein performing the second time-warping of the object comprises at least rotating the object based on the second object pose information to obtain the time-warped object.

9. The method of claim 1 :

wherein the performing a second time-warping comprises performing a second time-warping, separate from the first time-warping, of an object based on the object pose information received during or after a rendering of the object.

10. The method of claim 1 :

wherein the performing a first time-warping comprises performing a first time-warping, in a first processing pipeline, of a scene of virtual reality content based on the head pose information received during or after a rendering of the scene; and

wherein the performing a second time-warping comprises performing a second time-warping, separate from the first time-warping, in a second processing pipeline, of an object based on the object pose information received during or after a rendering of the object.

11. The method of claim 1 wherein the performing a second time-warping comprises:

performing a second time-warping of an object based on both the head pose information and the object pose information.

12. The method of claim 1 wherein the object comprises a virtual object having a location and orientation that is controlled based on a location and orientation of a virtual reality controller, wherein the performing a second time-warping comprises:

receiving, during or after a rendering of the virtual object, object pose information from the virtual reality controller, the object pose information including pose information for the virtual reality controller; and

performing a second time-warping of the virtual object that is controlled by the virtual reality controller based at least on the pose information for the virtual reality controller to obtain a time-warped virtual object.

13. The method of claim 1 wherein the object comprises a virtual object that is controlled by a virtual reality application, wherein the performing a second time-warping comprises:

receiving, during or after a rendering of the virtual object, object pose information for the virtual object from the virtual reality application; and

performing a second time-warping of the virtual object that is controlled by the virtual reality application based at least on the pose information for the virtual object to obtain a time-warped virtual object.

14. An apparatus comprising:

at least one processor;

a memory storing instructions that, when executed by the at least one processor, cause the apparatus to:

perform a first time-warping of a scene of virtual reality content based on head pose information received during or after a rendering of the scene to obtain a time-warped scene;

perform a second time-warping of an object based at least on object pose information received during or after a rendering of the object to obtain a time-warped object; and

display on a display device a composite image based on the time-warped scene and the time-warped object.

15. The apparatus of claim 14 :

wherein the head pose information includes information indicating a head pose, the head pose information comprising at least one of location information indicating a location of a user's head or of a virtual reality headset worn by a user and orientation information indicating an orientation of the user's head or of the virtual reality headset.

16. The apparatus of claim 14 :

wherein the head pose information comprises head pose information received from a tracking device that tracks a pose of a virtual reality headset worn by a user.

17. The apparatus of claim 14 :

wherein the object pose information includes information indicating an object pose, the object pose information comprising at least one of location information indicating a location of the object and orientation information indicating an orientation of the object.

18. The apparatus of claim 14 :

wherein the object comprises a virtual object to be displayed on the display device; and

wherein the object pose information comprises at least one of location information and orientation information of the virtual object.

19. The apparatus of claim 18 :

wherein the object comprises a virtual object to be displayed on the display device; and

wherein the object pose information comprises at least one of the following:

at least one of location information and orientation information of the virtual object received from a virtual reality application; and

at least one of location information and orientation information of the virtual object received from a tracking device that tracks a pose of a controller or other physical object that controls the location and orientation of the virtual object.

20. The apparatus of claim 14 , the instructions further causing the apparatus to:

receive a first head pose information;

perform a rendering of the scene based on the first head pose information; and

receive a second head pose information during or after the rendering of the scene;

wherein causing the apparatus to perform the first time-warping of the scene comprises causing the apparatus to at least rotate the scene based on the second head pose information to obtain the time-warped scene.

21. The apparatus of claim 14 , the instructions further causing the apparatus to:

receive a first object pose information;

perform a rendering of the object based on the first object pose information; and

receive a second object pose information during or after the rendering of the object;

wherein causing the apparatus to perform the second time-warping of the object comprises causing the apparatus to at least rotate the object based on the second object pose information to obtain the time-warped object.

22. The apparatus of claim 14 :

wherein causing the apparatus to perform a second time-warping comprises causing the apparatus to perform a second time-warping, separate from the first time-warping, of an object based on the object pose information received during or after a rendering of the object.

23. The apparatus of claim 14 :

wherein causing the apparatus to perform a first time-warping comprises causing the apparatus to perform a first time-warping, in a first processing pipeline, of a scene of virtual reality content based on the head pose information received during or after a rendering of the scene; and

wherein causing the apparatus to perform a second time-warping comprises causing the apparatus to perform a second time-warping, separate from the first time-warping, in a second processing pipeline, of an object based on the object pose information received during or after a rendering of the object.

24. The apparatus of claim 14 , wherein causing the apparatus to perform a second time-warping comprises causing the apparatus to:

perform a second time-warping of an object based on both the head pose information and the object pose information.

25. The apparatus of claim 14 , wherein the object comprises a virtual object having a location and orientation that is controlled based on a location and orientation of a virtual reality controller, wherein causing the apparatus to perform a second time-warping comprises causing the apparatus to:

receive, during or after a rendering of the virtual object, object pose information from the virtual reality controller, the object pose information including pose information for the virtual reality controller; and

perform a second time-warping of the virtual object that is controlled by the virtual reality controller based at least on the pose information for the virtual reality controller to obtain a time-warped virtual object.

26. The apparatus of claim 14 , wherein the object comprises a virtual object that is controlled by a virtual reality application, wherein causing the apparatus to perform a second time-warping comprises causing the apparatus to:

receive, during or after a rendering of the virtual object, object pose information for the virtual object from the virtual reality application; and

perform a second time-warping of the virtual object that is controlled by the virtual reality application based at least on the pose information for the virtual object to obtain a time-warped virtual object.