REAL-TIME VIRTUAL REFLECTION
Techniques are provided for a real-time virtual reflection and for video interaction with virtual objects in a system. According to one embodiment, a user's image is captured by a video camera, and is outputted to a visual display in reverse, providing a mirror-image feedback to the user's movements. Through the camera interface, the system interprets user's gestures to manipulate virtual objects in real-time, in conjunction with the user's movements. In some embodiments, a user simulates trying on apparel and accessories according to the techniques set forth.
1 . A computer-implemented method for video interaction with virtual objects, the method comprising the steps of:
receiving, by a computer, a stream of frames from a visual data capture device of a user in movement;
outputting a stream of frames as video signal for processing by a visual display device based on the received stream of frames;
while receiving and outputting,
receiving a request for applying a virtual object to a stream of frames;
processing the request for applying the virtual object to one or more frames of the stream of frames; and
outputting modified stream of frames with the virtual object applied to the one or more frames.
2 . A computer-implemented method of claim 1 , wherein the processing further comprising the steps of:
for each frame in the stream of frames,
determining image feature points for a user in a current output frame;
identifying one or more images stored in a storage medium for the virtual object;
determining a first image of the virtual object to apply to the current output frame;
determining a position for applying the virtual object to the current output frame; and
applying the first image of the virtual object to the current output frame.
3 . A computer-implemented method of claim 2 , further comprising determining one or more of user's angles of rotation in the first frame based on image feature points; and the determining of the first image is based on a particular angle of rotation.
4 . A computer-implemented method of claim 2 , wherein the determining a position further comprises determining position values for applying image of virtual object to the current output frame based on the image feature points.
5 . A computer-implemented method of claim 1 , wherein the virtual object applied to one or more frames is persistently coupled to a user feature.
6 . A computer-implemented method of claim 5 , wherein the user features includes a body part of the user.
7 . A computer-implemented method of claim 5 , wherein the user feature is determined from a stream of video using computer vision techniques.
8 . A computer-implemented method of claim 1 , wherein each of frames of the output stream of frames is the reverse image of a received frame.
9 . A computer-implemented method of claim 8 , the each of the reversed frames of the output stream of frames is outputted with minimal time elapsed between the receiving and the outputting.
10 . A computer-implemented method of claim 1 , wherein the output stream of frames comprises a virtual reflection of the user while in motion.
11 . A system for video interaction with virtual objects, said system comprising:
one or more processors; and
a computer-readable storage medium carrying one or more sequences of instructions, which when executed by said one or more processors implement a method for video interaction with virtual objects said method comprising:
receiving, by a computer, a stream of frames from a visual data capture device of a user in movement;
outputting a stream of frames as video signal for processing by a visual display device based on the received stream of frames;
while receiving and outputting,
receiving a request for applying a virtual object to a stream of frames;
processing the request for applying the virtual object to one or more frames of the stream of frames; and
outputting modified stream of frames with the virtual object applied to the one or more frames.
12 . A system of claim 11 , wherein the processing further comprising the steps of:
for each frame in the stream of frames,
determining image feature points for a user in a current output frame;
identifying one or more images stored in a storage medium for the virtual object;
determining a first image of the virtual object to apply to the current output frame;
determining a position for applying the virtual object to the current output frame; and
applying the first image of the virtual object to the current output frame.
13 . A system of claim 12 , further comprising determining one or more of user's angles of rotation in the first frame based on the image feature points; and the determining of the first image is based on a particular angle of rotation.
14 . A system of claim 12 , wherein the determining a position further comprises determining position values for applying image of virtual object to the current output frame based on the image feature points.
15 . A system of claim 11 , wherein the virtual object applied to one or more frames is persistently coupled to a user feature.
16 . A system of claim 15 , wherein the user features includes a body part of the user.
17 . A system of claim 15 , wherein the user feature is determined from a stream of video using computer vision techniques.
18 . A system of claim 11 , wherein each of frames of the output stream of frames is the reverse image of a received frame.
19 . A system of claim 18 , the each of the reversed frames of the output stream of frames is outputted with minimal time elapsed between the receiving and the outputting.
20 . A system of claim 11 , wherein the output stream of frames comprises a virtual reflection of the user while in motion.