Picture-taking within virtual reality
In one embodiment, a method includes a computing system receiving hand configuration data associated with a user of an artificial reality application. The system may determine, based on the hand configuration data, that two fingers of a virtual left hand and two fingers of a virtual right hand of the user are extended. The system may determine that those fingers define a quadrilateral in a virtual environment, with the two fingers of the virtual left hand defining a first corner of the quadrilateral and the two fingers of the virtual right hand defining an opposite corner of the quadrilateral. The system may generate, based on the quadrilateral and a viewpoint of the user in the virtual environment, an image that captures a scene in the virtual environment. The system may then display the generated image in the virtual environment.
1. A method comprising, by a computing system:
rendering, at a first-time instance, a visual scene comprising at least one virtual object, the visual scene being rendered at a first resolution;
displaying the visual scene to a user using a headset worn by the user;
receiving, at the first-time instance, hand configuration data associated with the user;
determining a frame defined by the hand configuration data;
determining, via one or more sensors associated with the headset worn by the user, a viewpoint of the user;
projecting rays from the viewpoint of the user through the frame defined by the hand configuration data;
generating an image of a portion of the visual scene at a second resolution higher than the first resolution of the visual scene comprising the virtual object based on a density of rays projected through the frame defined by the hand configuration data, wherein the generated image of the portion of the visual scene becomes part of the visual scene at a same time instance at which the visual scene is currently rendered; and
re-rendering the visual scene with the generated image of the portion of the visual scene, wherein in response to re-rendering, displaying simultaneously, using the headset, (1) a preview of the generated image of the portion of the visual scene at the second resolution at the first-time instance and (2) the visual scene at the first resolution at the first-time instance.
2. The method of claim 1 , wherein the determining of the frame defined by the hand configuration data further comprises:
determining that a first left finger, a second left finger, a first right finger, and a second right finger are substantially aligned, within a predetermined threshold, in a plane of the visual scene determined by the frame.
3. The method of claim 1 , wherein the determining of the frame defined by the hand configuration data comprises:
determining, based on the hand configuration data, that a first left finger, a second left finger, a first right finger, and a second right finger of the user are extended, wherein the hand configuration data indicate that corresponding fingers of the user are not touching hand-held controllers of the computing system.
4. The method of claim 3 , wherein the first left finger, the second left finger, the first right finger, and the second right finger correspond, respectively, to the user's left index finger, left thumb, right index finger, and right thumb.
5. The method of claim 1 , further comprising:
in response to the determination that the frame is defined by the hand configuration data, displaying a visual indicator indicating that a picture-taking mode is enabled.
6. The method of claim 1 , further comprising:
receiving an input from the user after the determination that the frame is defined by the hand configuration data;
wherein the image is generated in response to the input.
7. The method of claim 6 , wherein the input is triggered by fingers of the user that are used to define the frame.
8. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
render, at a first-time instance, a visual scene comprising at least one virtual object, the visual scene being rendered at a first resolution;
display the visual scene to a user using a headset worn by the user;
receive, at the first-time instance, hand configuration data associated with the user;
determine a frame defined by the hand configuration data;
determine, via one or more sensors associated with the headset worn by the user, a viewpoint of the user;
project rays from the viewpoint of the user through the frame defined by the hand configuration data;
generate an image of a portion of the visual scene at a second resolution higher than the first resolution of the visual scene comprising the virtual object based on a density of rays projected through the frame defined by the hand configuration data, wherein the generated image of the portion of the visual scene becomes part of the visual scene at a same time instance at which the visual scene is currently rendered; and
re-render the visual scene with the generated image of the portion of the visual scene, wherein in response to re-rendering, display simultaneously, using the headset, (1) a preview of the generated image of the portion of the visual scene at the second resolution at the first-time instance and (2) the visual scene at the first resolution at the first-time instance.
9. The media of claim 8 , wherein when determining the frame defined by the hand configuration data, the software is further operable when executed to:
determine that a first left finger, a second left finger, a first right finger, and a second right finger are substantially aligned, within a predetermined threshold, in a plane of the visual scene determined by the frame.
10. The media of claim 8 , wherein when determining the frame defined by the hand configuration data, the software is further operable when executed to:
determine, based on the hand configuration data, that a first left finger, a second left finger, a first right finger, and a second right finger are extended, the hand configuration data indicating that corresponding fingers of the user are not touching hand-held controllers.
11. The media of claim 10 , wherein the first left finger, the second left finger, the first right finger, and the second right finger correspond, respectively, to the user's left index finger, left thumb, right index finger, and right thumb.
12. The media of claim 8 , wherein the software is further operable when executed to:
in response to the determination that the frame is defined by the hand configuration data, display a visual indicator indicating that a picture-taking mode is enabled.
13. The media of claim 8 , wherein the software is further operable when executed to:
receive an input from the user after the determination that the frame is defined by the hand configuration data;
wherein the image is generated in response to the input.
14. A system comprising:
one or more processors; and
one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:
render, at a first-time instance, a visual scene comprising at least one virtual object, the visual scene being rendered at a first resolution;
display the visual scene to a user using a headset worn by the user;
receive, at the first-time instance, hand configuration data associated with the user;
determine a frame defined by the hand configuration data;
determine, via one or more sensors associated with the headset worn by the user, a viewpoint of the user;
project rays from the viewpoint of the user through the frame defined by the hand configuration data;
generate an image of a portion of the visual scene at a second resolution higher than the first resolution of the visual scene comprising the virtual object based on a density of rays projected through the frame defined by the hand configuration data, wherein the generated image of the portion of the visual scene becomes part of the visual scene at a same time instance at which the visual scene is currently rendered; and
re-render the visual scene with the generated image of the portion of the visual scene, wherein in response to re-rendering, display simultaneously, using the headset, (1) a preview of the generated image of the portion of the visual scene at the second resolution at the first-time instance and (2) the visual scene at the first resolution at the first-time instance.
15. The system of claim 14 , wherein when determining the frame defined by the hand configuration data, the processors are further operable when executing the instructions to:
determine that a first left finger, a second left finger, a first right finger, and a second right finger are substantially aligned, within a predetermined threshold, in a plane of the visual scene determined by the frame.
16. The system of claim 14 , wherein when determining the frame defined by the hand configuration data, the processors are further operable when executed to:
determine, based on the hand configuration data, that a first left finger, a second left finger, a first right finger, and a second right finger are extended, the hand configuration data indicating that corresponding fingers of the user are not touching hand-held controllers.
17. The system of claim 16 , wherein the first left finger, the second left finger, the first right finger, and the second right finger correspond, respectively, to the user's left index finger, left thumb, right index finger, and right thumb.
18. The system of claim 14 , wherein the processors are further operable when executing the instructions to:
in response to the determination that the frame is defined by the hand configuration data, display a visual indicator indicating that a picture-taking mode is enabled.
19. The system of claim 14 , wherein the processors are further operable when executing the instructions to:
receive an input from the user after the determination that the frame is defined by the hand configuration data;
wherein the image is generated in response to the input.