User interface for accessing virtual viewpoint animations
View Patent ↗A user such as a television viewer is provided with the capability to view an event from different virtual viewpoints which differ from the viewpoint of a camera. In one aspect, the user is informed of particular camera images from which a virtual viewpoint can be viewed. For example, a menu interface may provide thumbnail preview images of the one or more particular camera images. In another aspect, the use enters commands to manipulate a virtual viewpoint, such as by rotating around a point, moving a lookout point and zooming in or out. In response, a display is provided which includes a textured 3d model of the event combined with at least one textured object in the event. For instance, the event may be a sporting event and the at least one textured object may be a participant in the sporting event.
1. A method for providing image data of an event involving participants at an event facility, comprising:
receiving a television broadcast of the event at a user system, the user system comprises a display, a user input device and a host computer, the host computer comprising at least one processor, the television broadcast includes: (a) video data, including a plurality of camera images of the event, the plurality of camera images include first and second selected images of the event and (b) auxiliary data associated with the video data, the auxiliary data including: (i) a preview image of the first selected image, (ii) a model which is based on the first selected image of the event, and which includes texture data of at least one of the participants from the first selected image of the event, (iii) a preview image of the second selected image, and (iv) a model which is based on the second selected image of the event, and which includes texture data of at least one of the participants from the second selected image of the event, the model which is based on the first selected image of the event and the model which is based on the second selected image of the event include texture data of the event facility;
displaying the preview images of the first and second selected images on the display;
receiving, via the user input device, user commands which select the first preview image and identify specific virtual viewpoints of the event; and
in response to the user commands, executing processor-readable code at the at least one processor to run the model which is based on the first selected image of the event to depict, on the display, the at least one of the participants from the first selected image of the event and the event facility, from the specific virtual viewpoints.
2. The method of claim 1 , wherein:
the first and second selected images of the event are identified by operator commands at a production center associated with a television broadcast facility which provides the television broadcast of the event.
3. The method of claim 1 , wherein:
the user commands include a command for rotating around a point.
4. The method of claim 1 , wherein:
the user commands include a command for moving a lookout point.
5. The method of claim 1 , wherein:
the user commands include a command for zooming in or out.
6. The method of claim 1 , wherein:
the user system comprises at least one of a television or a set-top box.
7. The method of claim 1 , wherein:
the texture data of the at least one of the participants from the first selected image of the event and the texture data of the at least one of the participants from the second selected image of the event, comprise 2d or 3d texture data.
8. The method of claim 1 , wherein:
the texture data of the event facility includes 3d texture data.
9. The method of claim 1 , wherein:
the event facility is a stadium, and the texture data of the event facility includes 3d texture data of the stadium.
10. The method of claim 1 , wherein:
the model which is based on the first selected image of the event and the model which is based on the second selected image of the event, include a 3d model of an object of the event.
11. The method of claim 1 , wherein:
the model which is based on the first selected image of the event and the model which is based on the second selected image of the event, include a 3d model of a goal post of the event.
12. The method of claim 1 , further comprising:
creating an animation from the specific virtual viewpoints.
13. At least one processor-readable storage device having processor-readable code stored thereon, the processor-readable code is executable by at least one processor to perform a method for providing image data of an event involving participants at an event facility, the method performed comprising:
receiving a television broadcast of the event at a user system, the user system comprises a display, a user input device and a host computer, the host computer comprising at least one processor, the television broadcast includes: (a) video data, including a plurality of camera images of the event, the plurality of camera images include first and second selected images of the event and (b) auxiliary data associated with the video data, the auxiliary data including: (i) a preview image of the first selected image, (ii) a model which is based on the first selected image of the event, and which includes texture data of at least one of the participants from the first selected image of the event, (iii) a preview image of the second selected image, and (iv) a model which is based on the second selected image of the event, and which includes texture data of at least one of the participants from the second selected image of the event, the model which is based on the first selected image of the event and the model which is based on the second selected image of the event include texture data of the event facility;
displaying the preview images of the first and second selected images on the display;
receiving, via the user input device, user commands which select the first preview image and identify specific virtual viewpoints of the event; and
in response to the user commands, executing processor-readable code at the at least one processor to run the model which is based on the first selected image of the event to depict, on the display, the at least one of the participants from the first selected image of the event and the event facility, from the specific virtual viewpoints.
14. The at least one processor-readable storage device of claim 13 , wherein:
the texture data of the at least one of the participants from the first selected image of the event and the texture data of the at least one of the participants from the second selected image of the event, comprise 2d or 3d texture data; and
the texture data of the event facility includes 3d texture data.
15. The at least one processor-readable storage device of claim 13 , wherein:
the first and second selected images of the event are identified by operator commands at a production center associated with a television broadcast facility which provides the television broadcast of the event.
16. A method for providing image data of an event involving participants at an event facility, comprising:
receiving a television broadcast of the event at a user system, the user system comprises a display, a user input device and a host computer, the host computer comprising at least one processor, the television broadcast includes: (a) video data, including a plurality of camera images of the event, the plurality of camera images include first and second selected images of the event and (b) auxiliary data associated with the video data, the auxiliary data including: (i) a preview image of the first selected image, (ii) a model which is based on the first selected image of the event, and which includes texture data of at least one of the participants from the first selected image of the event, (iii) a preview image of the second selected image, and (iv) a model which is based on the second selected image of the event, and which includes texture data of at least one of the participants from the second selected image of the event, the model which is based on the first selected image of the event and the model which is based on the second selected image of the event include texture data of the event facility;
displaying the preview images of the first and second selected images on the display;
receiving, via the user input device, a user command which selects the first preview image; and
in response to the user command, executing processor-readable code at the at least one processor to run, according to a predefined script, the model which is based on the first selected image of the event to depict, on the display, an animation which includes the at least one of the participants from the first selected image of the event and the event facility, from a predefined sequence of virtual viewpoints.
17. The method of claim 16 , wherein:
the first and second preview images are based on the plurality of camera images of the event.
18. The method of claim 16 , wherein:
the first and second images include an image from the animation.
19. The method of claim 16 , further comprising:
providing the user with an ability to stop and start the animation.
20. The method of claim 16 , wherein:
the first and second selected images of the event are identified by operator commands at a production center associated with a television broadcast facility which provides the television broadcast of the event.