Granted Patent B2

US 12,361,502 · App. 18/099,892 · Granted Jul 15, 2025

Inventors: Michael P. Caputo (Aurora, IL); Scott E. Woodard (New Buffalo, MI); Gregory Joseph Doerr (Palatine, IL)

Assignee: MFTB Holdco, Inc.

G06Q50/16G06Q10/107G06Q10/1095G06Q30/0203G06Q50/265H04N7/15

Abstract

Claims (62)

1. A computer-implemented method comprising:

presenting, by one or more computer devices, video of a property that is captured by a first device at the property to each of multiple other devices remote from the property, the multiple other devices including at least a second device, a third device and a fourth device;

determining, by the one or more computer devices, a confidential communication pair including only the second and third devices;

establishing, by the one or more computer devices and during the presenting of the video, multiple communication channels between the multiple other devices, the multiple communication channels including a shared communication channel between all of the multiple other devices in which transmissions for the shared communication channel are routed via a relay server device, and including a confidential communication channel that is between only the second and third devices of the confidential communication pair and is separate from the shared communication channel and in which other transmissions for the confidential communication channel are sent directly between the second and third devices without being routed via the relay server device;

exchanging, by the one or more computer devices and concurrently with the presenting of the video as part of the shared communication channel between the multiple other devices, first data between the multiple other devices, wherein the first data is received from at least one of the multiple other devices and is routed to other of the multiple other devices via the relay server device; and

exchanging, by the one or more computer devices and as part of the confidential communication channel that includes only the second and third devices and is separate from the shared communication channel, second data that is directly routed between only the second and third devices without being routed via the relay server device, wherein the exchanging of the second data includes:

receiving a disengagement event from the second device corresponding to one or more activities of a user of the second device during the presenting of the video;

analyzing the disengagement event to generate user engagement measurement data; and

forwarding the user engagement measurement data to the third device.

2. The computer-implemented method of claim 1 wherein the shared communication channel further includes the first device at the property, and wherein the exchanging of the first data further includes sending the first data to the first device.

3. The computer-implemented method of claim 1 wherein the one or more computer devices include the first device.

4. The computer-implemented method of claim 1 wherein the video is presented on the second device as part of an application program, and wherein the disengagement event is based at least in part on the user of the second device performing at least one of interacting with the second device to change a focus on the second device away from the application program or moving vision of the user away from the application program.

5. The computer-implemented method of claim 1 wherein the exchanging of the second data further includes determining a quantity of multiple disengagement events from the second device during the presenting of the video, and including the determined quantity as part of the user engagement measurement data.

6. The computer-implemented method of claim 1 wherein the analyzing of the disengagement event includes determining a timestamp for the disengagement event during the video, and including the determined timestamp as part of the user engagement measurement data.

7. A system comprising:

one or more processing units; and

one or more memories storing a server computer software application that, when executed by the one or more processing units, adapt the system to perform operations including at least:

presenting video of a property that is captured by a first device at the property to each of multiple other devices remote from the property, the multiple other devices including at least a second device, a third device and a fourth device;

determining a first confidential communication pair including only the second and third devices, and determining a second confidential communication pair including only the fourth device and one other device that is not the second or third devices;

establishing, during the presenting of the video, multiple communication channels between the multiple other devices, the multiple communication channels including a shared communication channel between all of the multiple other devices in which transmissions for the shared communication channel are routed via a relay server device, and including a first confidential communication channel that is between only the second and third devices of the first confidential communication pair and is separate from the shared communication channel and in which first transmissions for the first confidential communication channel are sent directly between the second and third devices without being routed via the relay server device, and including a second confidential communication channel that is between only the fourth device and the one other device of the second confidential communication pair and is separate from the shared communication channel and from the first confidential communication channel and in which second transmissions for the second confidential communication channel are sent directly between the fourth device and the one other device without being routed via the relay server device;

exchanging, concurrently with the presenting of the video and as part of the shared communication channel between the multiple other devices, first data between the multiple other devices, wherein the first data is received from at least one of the multiple other devices and is routed to other of the multiple other devices via the relay server device;

exchanging, concurrently with the presenting of the video and as part of the first confidential communication channel that is between only the second and third devices and is separate from the shared communication channel, second data between only the second and third devices, wherein the second data is received from one of the second and third devices and is directly routed to an other of the second and third devices without being routed via the relay server device, and wherein the exchanging of the second data between only the second and third devices includes limiting transmission of the second data to not be accessible to the fourth device; and

exchanging, concurrently with the presenting of the video and as part of the second confidential communication channel that is between only the fourth device and one other device and is separate from the shared communication channel and from the first confidential communication channel, third data between only the fourth device and one other device, wherein the third data is received from the fourth device and is directly routed to the one other device without being routed via the relay server device, and wherein the exchanging of the third data between only the fourth device and the one other device includes limiting transmission of the third data to not be accessible to the second and third devices.

8. The system of claim 7 wherein the shared communication channel further includes the first device at the property, wherein the exchanging of the first data further includes sending the first data to the first device, and wherein the one other device is the first device.

9. The system of claim 7 wherein the multiple other devices further include a fifth device remote from the property, and wherein the one other device is the fifth device.

10. The system of claim 7 wherein the exchanging of the second data as part of the first confidential communication channel includes:

receiving, from the second device, a feedback request during the presenting of the video;

forwarding the feedback request to the third device over the first confidential communication channel;

receiving, in response to the feedback request, feedback during the presenting of the video from the third device; and

forwarding the feedback to the second device over the first confidential communication channel; and

wherein the system is further adapted to update stored information associated with at least one of the video or the property to include the feedback.

11. The system of claim 10 wherein the system is further adapted to:

transcribe, before forwarding of the feedback request, the feedback request from audio captured by the second device to a first group of text, wherein the forwarded feedback request is the transcribed first group of text; and

transcribe, before forwarding of the feedback, the feedback from audio captured by the third device to a second group of text, wherein the forwarded feedback is the transcribed second group of text.

12. The system of claim 7 wherein the exchanging of the second data includes receiving confidential communication audio from the second device, and forwarding the confidential communication audio over the first confidential communication channel to only the third device.

13. The system of claim 7 wherein the system is further adapted to:

receive a disengagement event from the second device corresponding to one or more activities of a user of the second device during the presenting of the video;

analyze the disengagement event to generate user engagement measurement data; and

forward the user engagement measurement data to at least one of the fourth device or the one other device.

14. The system of claim 7 wherein the system is further adapted to:

determine an auto-tag of a feature of the property that is visible in the video; and

store the auto-tag and a corresponding timestamp, and

wherein the presenting of the video to the multiple other devices over the shared communication channel includes forwarding the auto-tag to the multiple other devices.

15. The system of claim 7 wherein the one or more processing units and the one or more memories are part of the first device, and wherein the first device is configured to execute the server computer software application.

16. A system comprising:

one or more processing units; and

one or more memories storing a server computer software application that, when executed by the one or more processing units, adapt the system to perform operations including at least:

presenting video of a property that is captured by a first device at the property to each of multiple other devices remote from the property, the multiple other devices including at least a second device, a third device and a fourth device;

determining a confidential communication pair including only the second and third devices;

establishing, during the presenting of the video, multiple communication channels between the multiple other devices, the multiple communication channels including a shared communication channel between all of the multiple other devices in which transmissions for the shared communication channel are routed via a relay server device, and including a confidential communication channel that is between only the second and third devices of the confidential communication pair and is separate from the shared communication channel and in which other transmissions for the confidential communication channel are sent directly between the second and third devices without being routed via the relay server device;

exchanging, concurrently with the presenting of the video and as part of the shared communication channel between the multiple other devices, first data between the multiple other devices, wherein the first data is received from at least one of the multiple other devices and is routed to other of the multiple other devices via the relay server device; and

exchanging, concurrently with the presenting of the video and as part of the confidential communication channel that is between only the second and third devices and is separate from the shared communication channel, second data that is directly routed between only the second and third devices without being routed via the relay server device, wherein the exchanging of the second data includes:

receiving, from the second device, a real-time feedback request during the presenting of the video;

forwarding the real-time feedback request to the third device over the confidential communication channel;

receiving, from the third device and in response to the real-time feedback request, real-time feedback from the third device during the presenting of the video; and

forwarding the real-time feedback to the second device over the confidential communication channel.

17. The system of claim 16 wherein the shared communication channel further includes the first device at the property, and wherein the exchanging of the first data further includes sending the first data to the first device.

18. The system of claim 16 wherein the first device at the property is a presenter device.

19. The system of claim 16 wherein the system is further adapted to:

transcribe, before forwarding of the real-time feedback request, the real-time feedback request from audio captured by the second device to a first group of text, wherein the forwarded real-time feedback request is the transcribed first group of text; and

transcribe, before forwarding of the real-time feedback, the real-time feedback from audio captured by the third device to a second group of text, wherein the forwarded real-time feedback is the transcribed second group of text.

20. The system of claim 16 wherein the exchanging of the second data includes receiving confidential communication audio from the second device, and forwarding the confidential communication audio over the confidential communication channel to only the third device.

Assignments (6)

Continuity (2)

References Cited (125)