Granted Patent B2

US 11,423,627 · App. 17/197,935 · Granted Aug 23, 2022

Inventor: Russell Holmes (Otley, GB)

G06T19/006G06F3/048G06T11/60G06V40/10H04M3/567H04M11/085H04N7/141H04N7/15H04N7/152H04N21/2187H04N21/21805H04N21/23418H04N21/23424G06V40/103G06V40/169H04M2201/50H04M2203/359H04N7/144H04N7/147H04N2007/145

Abstract

Claims (55)

1. A computer-implemented method of superimposing video carried out by a processor, the method comprising the steps of:

receiving a first live video from a first user device, the first live video including video of a first human element of a first user captured by a rear facing camera of the first user device, wherein the first user is simultaneously viewing a front facing display of the first user device while the video of the first human element of the first user is being captured by the rear facing camera of the first user device;

receiving a second video from a second user device, the second video including video of a second user;

identifying and extracting the first human element of the first user from the first live video using a detection algorithm;

combining the first human element of the first user and a portion or all of the second video to create a superimposed video including the first human element of the first user captured by the rear facing camera of the first user device from the first live video and a second human element of the second user from the second video; and

displaying the superimposed video on at least the first user device;

wherein the location of the extracted first human element captured by the rear facing camera of the first user device and displayed on the first user device within the superimposed video is directly controlled by the position of the first human element relative to the location of the rear facing camera of the first user device;

further wherein the first user views the superimposed video on the front facing display of the first user device while the video of the first human element of the first user is being captured by the rear facing camera of the first user device and the first user moves the first human element into a chosen position relative to the second human element in the superimposed video.

2. The computer-implemented method of superimposing video of claim 1 , wherein in response to real-time movement by the first human element of the first user relative to the first user device, contact is simulated between the first human element of the first user and the second human element of the second user in the superimposed video.

3. The computer-implemented method of superimposing video of claim 2 , wherein, in response to simulated contact between the first human element of the first user and the second human element of the second user in the superimposed video, the first user device provides a haptic response.

4. The computer-implemented method of superimposing video of claim 2 , wherein the first user aligns the position of the first human element of the first user to simulate contact with the second human element of the second user in the superimposed video while viewing the position of the first human element of the first user and the second human element of the second user on the front facing display of the first user device to selectively induce a haptic response in at least one of the first user device and the second user device.

5. The computer-implemented method of superimposing video of claim 1 , further comprising the step of:

identifying and extracting a first non-human element from the first live video using a detection algorithm; and

wherein the step of combining the first human element of the first user and a portion or all of the second video to create a superimposed video including the first human element of the first user captured by the rear facing camera of the first user device from the first live video and a second human element of the second user from the second video further includes:

combining the first non-human element from the first live video with the first human element of the first user and a portion or all of the second video to create a superimposed video including the first non-human element captured by the rear facing camera of the first user device from the first live video, the first human element of the first user captured by the rear facing camera of the first user device from the first live video and a second human element of the second user from the second video.

6. The computer-implemented method of superimposing video of claim 5 , wherein, in response to movement of the first human element of the first user relative to the first user device, each of the first non-human element and the first human element of the first user obscures at least a portion of the second human element of the second user in the superimposed video.

7. The computer-implemented method of superimposing video of claim 1 , wherein, in response to movement of the first human element of the first user relative to the first user device, the first human element of the first user obscures at least a portion of the second human element of the second user in the superimposed video.

8. The computer-implemented method of superimposing video of claim 1 , further comprising the steps of:

receiving a third live video from a third user device, the third live video including video of a third human element of a third user captured by a rear facing camera of the third user device, wherein the third user is simultaneously viewing a front facing display of the third user device while the video of the third human element of the third user is being captured by the rear facing camera of the third user device;

identifying and extracting the third human element of the third user from the third live video using a detection algorithm;

combining the third human element of the third user and a portion or all of the second video to create a second superimposed video including the third human element of the third user captured by the rear facing camera of the third user device from the third live video and the second human element of the second user from the second video; and

displaying the second superimposed video on at least the third user device;

wherein the location of the extracted third human element captured by the rear facing camera of the third user device and displayed on the third user device within the second superimposed video is directly controlled by the position of the third human element relative to the location of the rear facing camera of the third user device;

further wherein the third user views the second superimposed video on the front facing display of the third user device while the video of the third human element of the third user is being captured by the rear facing camera of the third user device and the third user moves the third human element into a chosen position relative to the second human element in the second superimposed video.

9. The computer-implemented method of superimposing video of claim 1 , wherein the first user device is a virtual reality headset and the rear facing camera of the first user device is an externally facing camera.

10. The computer-implemented method of superimposing video of claim 1 , wherein the second video is pre-recorded.

11. A computer-implemented system for superimposing video, comprising:

a first user device featuring a camera, processor, memory, and networking interface;

a second user device featuring a camera, processor, memory, and networking interface;

wherein the first user device's processor:

receives a first live video from the first user device, the first live video including video of a first human element of a first user captured by a rear facing camera of the first user device, wherein the first user is simultaneously viewing a front facing display of the first user device while the video of the first human element of the first user is being captured by the rear facing camera of the first user device, and a second video from a second user device, the second video including video of a second user;

identifies and extracts a first human element of the first user from the first live video using a detection algorithm;

combines the first human element of the first user and a portion or all of the second video to create a superimposed video including the first human element of the first user captured by the rear facing camera of the first user device from the first live video and a second human element of the second user captured by the camera of the second user device from the second video; and

displays the superimposed video on at least the first user device;

wherein the location of the extracted first human element captured by the rear facing camera of the first user device and displayed on the first user device within the superimposed video is directly controlled by the position of the first human element relative to the location of the rear facing camera of the first user device;

further wherein the first user views the superimposed video on the front facing display of the first user device while the video of the first human element of the first user is being captured by the rear facing camera of the first user device and the first user moves the first human element into a chosen position relative to the second human element in the superimposed video.

12. The computer-implemented system for superimposing video of claim 11 , wherein in response to real-time movement by the first human element of the first user relative to the first user device, contact is simulated between the first human element of the first user and the second human element of the second user in the superimposed video.

13. The computer-implemented system of superimposing video of claim 12 , wherein, in response to simulated contact between the first human element of the first user and the second human element of the second user in the superimposed video, the first user device provides a haptic response.

14. The computer-implemented system of superimposing video of claim 12 , wherein the first user aligns the position of the first human element of the first user to simulate contact with the second human element of the second user in the superimposed video while viewing the position of the first human element of the first user and the second human element of the second user on the front facing display of the first user device to selectively induce a haptic response in at least one of the first user device and the second user device.

15. The computer-implemented system of superimposing video of claim 11 , further wherein one of the first user device's processor and the second user device's processor further:

identifies and extracts a first non-human element from the first live video using a detection algorithm; and

combines the first non-human element from the first live video with the first human element of the first user and a portion or all of the second video to create a superimposed video including the first non-human element captured by the rear facing camera of the first user device from the first live video, the first human element of the first user captured by the rear facing camera of the first user device from the first live video and a second human element of the second user from the second video.

16. The computer-implemented system of superimposing video of claim 15 , wherein, in response to movement of the first human element of the first user relative to the first user device, each of the first non-human element and the first human element of the first user obscures at least a portion of the second human element of the second user in the superimposed video.

17. The computer-implemented system for superimposing video of claim 11 , wherein in response to movement of the first human element of the first user relative to the first user device, the first human element of the first user obscures at least a portion of the second human element of the second user in the transmitted superimposed video.

18. The computer-implemented system of superimposing video of claim 11 , further comprising:

a third user device featuring a camera, processor, memory, and networking interface;

wherein the third user device's processor:

receives a third live video from the third user device, the third live video including video of a third human element of a third user captured by a rear facing camera of the third user device, wherein the third user is simultaneously viewing a front facing display of the third user device while the video of the third human element of the third user is being captured by the rear facing camera of the third user device, and the second video from the second user device, the second video including video of the second user;

identifies and extracts a third human element of the third user from the third live video using a detection algorithm;

combines the third human element of the third user and a portion or all of the second video to create a second superimposed video including the third human element of the third user captured by the rear facing camera of the third user device from the third live video and the second human element of the second user captured by the front facing camera of the second user device from the second video; and

displays the second superimposed video on at least the third user device;

wherein the location of the extracted third human element captured by the rear facing camera of the third user device and displayed on the third user device within the second superimposed video is directly controlled by the position of the third human element relative to the location of the rear facing camera of the third user device;

further wherein the third user views the second superimposed video on the front facing display of the third user device while the video of the third human element of the third user is being captured by the rear facing camera of the third user device and the third user moves the third human element into a chosen position relative to the second human element in the second superimposed video.

19. The computer-implemented system of superimposing video of claim 11 , wherein the first user device is a virtual reality headset and the rear facing camera of the first user device is an externally facing camera.

20. The computer-implemented system for superimposing video of claim 11 , wherein the second video is pre-recorded.

Continuity (12)