Granted Patent B2

US 12,273,618 · App. 18/434,151 · Granted Apr 8, 2025

Inventors: Dylan Shane Eirinberg (Venice, CA); Daniel Trinh (Paris, FR)

Assignee: Snap Inc.

H04N23/661G06V20/64G16Y40/30H04L51/046H04L51/10H04L51/222H04N5/272

Abstract

Claims (79)

1. A method comprising:

obtaining a video that depicts a plurality of real-world objects in a given location;

identifying a subset of video cameras associated with an account;

receiving input that associates a group of video cameras in the subset with each of a respective one of the plurality of real-world objects, the receiving of the input comprising:

presenting a list of video cameras comprising the subset of video cameras associated with the account;

receiving a first user selection of the group of video cameras from the list of video cameras that correspond to the given location;

in response to receiving the first user selection of the group of video cameras, presenting identifiers of the plurality of real-world objects that is depicted in the video; and

receiving a second user selection that associates a first video camera of the group of video cameras with a first real-world object of the plurality of real-world objects and a second video camera of the group of video cameras with a second real-world object of the plurality of real-world objects; and

storing one or more attributes of each of a group of the real-world objects in association with respective video cameras in the group of video cameras based on the received input.

2. The method of claim 1 , the given location comprising a home, and further comprising:

detecting, by an interaction application implemented on a device, a real-world object depicted in a captured image;

determining a current location of the device; and

selecting the first video camera from the plurality of video cameras based on one or more attributes of the real-world object depicted in the image.

3. The method of claim 2 , further comprising:

receiving, by the interaction application, a video feed from the first video camera that is selected;

detecting a display position of the real-world object in the captured image; and

causing, by the interaction application, the video feed received from the first video camera to be displayed at the display position on top of the real-world object depicted in the captured image.

4. The method of claim 1 , further comprising:

generating a display element having a size and shape corresponding to a real-world object depicted in an image corresponding to an individual one of the subset of video cameras;

scaling a video feed to fit within the display element having the size and shape corresponding to the real-world object depicted in the image; and

causing the scaled video to be displayed in the display element at a display position.

5. The method of claim 1 , further comprising displaying a graphical user interface comprising one or more commands for controlling an IoT device.

6. The method of claim 1 , further comprising:

establishing a link between an interaction application and the first video camera of the subset of video cameras over a local area network.

7. The method of claim 1 , wherein the one or more attributes of the group of the real-world objects comprise one or more visual elements of the group of the real-world objects.

8. The method of claim 1 , further comprising:

obtaining location information for each of the plurality of real-world objects; and

storing the location information of each of the real-world objects in association with the respective video cameras in the group of video cameras.

9. The method of claim 1 , further comprising:

obtaining location information for the first video camera and the second video camera of the subset of video cameras;

comparing the location information of the first and second video cameras with a current location of a device; and

determining that the first video camera is closer to the device than the second video camera in response to comparing the location information, wherein the first video camera is selected in response to determining that the first video camera is closer to the device.

10. The method of claim 1 , further comprising:

generating a virtual object;

populating the virtual object using a video feed received from an individual video camera of the subset of cameras; and

overlaying the virtual object populated using the video feed on top of a real-world object depicted in an image.

11. The method of claim 1 , wherein an individual real-world object comprises a side of a wall that divides a first room and a second room, wherein the first video camera of the subset of cameras is in the second room, and wherein a current location of a device is in a first room.

12. The method of claim 11 , further comprising overlaying a video feed that depicts a real-world environment of the second room on top of the side of the wall depicted in an image captured from the first room.

13. The method of claim 1 , further comprising:

accessing an application programming interface (API) associated with the first video camera of the subset of video cameras;

generating a request to obtain a video feed based on the API; and

transmitting the request to the first video camera, wherein the video feed is received in response to the first video camera receiving the request.

14. The method of claim 1 , further comprising:

identifying a manufacturer server associated with the first video camera of the subset of video cameras;

generating a request to obtain a video feed; and

transmitting the request to the manufacturer server, wherein the video feed is received in response to the first video camera receiving the request from the manufacturer server.

15. A system comprising:

at least one processor; and

a memory component having instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

obtaining a video that depicts a plurality of real-world objects in a given location;

identifying a subset of video cameras associated with an account;

receiving input that associates a group of video cameras in the subset with each of a respective one of the plurality of real-world objects, the receiving of the input comprising:

presenting a list of video cameras comprising the subset of video cameras associated with the account;

receiving a first user selection of the group of video cameras from the list of video cameras that correspond to the given location;

in response to receiving the first user selection of the group of video cameras, presenting identifiers of the plurality of real-world objects that is depicted in the video; and

receiving a second user selection that associates a first video camera of the group of video cameras with a first real-world object of the plurality of real-world objects and a second video camera of the group of video cameras with a second real-world object of the plurality of real-world objects; and

storing one or more attributes of each of a group of the real-world objects in association with respective video cameras in the group of video cameras based on the received input.

16. The system of claim 15 , the operations further comprising:

detecting, by an interaction application implemented on a device, a real-world object depicted in a captured image;

determining a current location of a device; and

selecting the first video camera from the plurality of video cameras based on one or more attributes of the real-world object depicted in the image.

17. The system of claim 16 , the operations comprising:

receiving, by the interaction application, a video feed from the first video camera of the subset of video cameras that is selected;

detecting a display position of the real-world object in the captured image; and

causing, by the interaction application, the video feed received from the first video camera to be displayed at the display position on top of the real-world object depicted in the captured image.

18. The system of claim 15 , the operations comprising:

generating a display element having a size and shape corresponding to the real-world object depicted in an image and corresponding to an individual one of the subset of video cameras;

scaling a video feed to fit within the display element having the size and shape corresponding to the real-world object depicted in the image; and

causing the scaled video to be displayed in the display element at a display position.

19. The system of claim 15 , the operations comprising displaying a graphical user interface comprising one or more commands for controlling an IoT device.

20. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by a processor of a device, cause the processor to perform operations comprising:

obtaining a video that depicts a plurality of real-world objects in a given location;

identifying a subset of video cameras associated with an account;

receiving input that associates a group of video cameras in the subset with each of a respective one of the plurality of real-world objects, the receiving of the input comprising:

presenting a list of video cameras comprising the subset of video cameras associated with the account;

receiving a first user selection of the group of video cameras from the list of video cameras that correspond to the given location;

in response to receiving the first user selection of the group of video cameras, presenting identifiers of the plurality of real-world objects that is depicted in the video; and

receiving a second user selection that associates a first video camera of the group of video cameras with a first real-world object of the plurality of real-world objects and a second video camera of the group of video cameras with a second real-world object of the plurality of real-world objects; and

storing one or more attributes of each of a group of the real-world objects in association with respective video cameras in the group of video cameras based on the received input.

Assignments (1)

Continuity (3)

References Cited (77)