Systems and methods for implementing personal camera that adapts to its surroundings, both co-located and remote

1. A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream between at least a first user and a second user, the real-time video conference stream containing a first video of the first user and a first background and a second video of the second user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method comprising:

a. receiving the real time video conference stream containing the first video of first the user and the first background;

b. detecting the first background in the received real time video conference stream from the first user; and

c. replacing the first background with a second background associated with the second user or with a modified version of the second background, wherein the second background is a background of the second user.

2. The system of claim 1 , wherein the second background is a pre-recorded background retrieved from a database.

3. The system of claim 1 , wherein the second background is automatically generated.

4. The system of claim 1 , wherein the second background is recorded by the second user in response to a prompt by the system of the second user.

5. The system of claim 1 , wherein the detecting and separating the background in the real time video conference stream comprises detecting a face of the first user.

6. The system of claim 5 , wherein the face of the first user is detected by identifying a plurality of feature points in video frames of the real time video conference stream.

7. The system of claim 5 , wherein detecting the face of the first user comprises detecting at least one of lip motion and head orientation of the first user, the method further comprises automatically muting or unmuting a microphone of the first user based on the detected at least one of lip motion and head orientation.

8. The system of claim 5 , wherein the detecting the first background in the real time video conference stream comprises detecting a second face and separating the second face together with the first background in the received real time video conference stream from the first user.

9. The system of claim 5 , further comprising learning the face of the first user.

10. The system of claim 9 , wherein, in response to the commencement of a video conference, learning the face of the first user.

11. The system of claim 9 , wherein the face of the first user is learned in advance of the video conference.

12. The system of claim 8 , wherein the separating the first background in the real time video conference stream comprises identifying the first user based on the learned face of the first user and separating the first background from the identified user.

13. The system of claim 1 , wherein the second background is received during at least one of the commencement of the real-time video conference stream and during the real-time video conference stream.

14. A computer-implemented method, the method being performed by a computerized system comprising a processing unit and a memory, the method comprising:

a. receiving a real time video conference stream between at least a first user and a second user, the real-time video conference stream containing a first video of the first user and a first background and a second video of the second user;

b. detecting the first background in the received real time video conference stream from the first user; and

c. replacing the first background with a second background associated with the second user or with a modified version of the second background, wherein the second background is a background of the second user.

15. The computer-implemented method of claim 14 , wherein the second background is a pre-recorded background retrieved from a database.

16. The computer-implemented method of claim 14 , wherein second the background is automatically generated.

17. The computer-implemented method of claim 14 , wherein the second background is recorded by the second user in response to a prompt by the system of the second user.

18. The computer-implemented method of claim 14 , wherein the detecting the background in the real time video conference stream comprises detecting a face of the first user and separating the background in the real time video conference stream.

19. The computer-implemented method of claim 14 , wherein the face of the first user is detected by identifying a plurality of feature points in video frames of the real time video conference stream.