IP Library Granted Patent US 11,627,118
Granted Patent B1
US 11,627,118 · App. 16/583,695 · Granted Apr 11, 2023

Utilizing inter-device communications and user permissions for capturing digital images at events

Inventor: Mark Terrano (Redmond, WA)
Assignee: Meta Platforms Technologies, LLC
H04L63/0442G06F3/011G06N20/00G06T7/0002H04N5/23203H04N5/23222H04W4/021G06T2207/20081G06T2207/30168H04L67/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,627,118
App. No.
16/583,695
Granted
Apr 11, 2023
Kind
B1
Abstract

The present disclosure relates to methods, systems, and non-transitory computer-readable media for using inter-device communications and user permissions to capture and transmit digital images of users who have opted in for other computing devices capturing their images at an event. For example, the disclosed systems can receive registration information corresponding to a user attending an event, including whether the user opts in to having digital images of the user captured during the event. During the event, the disclosed systems can provide the current location of the user to other computing devices at the event. Upon detecting a trigger, one or more of the computing devices can capture (and encrypt) a digital image of the user and provide the digital image for access by the user. The disclosed systems can also modify a digital image of the user to censor an image of the user from the digital image or prevent computing devices from capturing digital images of the user entirely based on indications provided by the user.

Claims (67)

1. A method comprising:

receiving, from a first computing device, an opt-in indication that a user of the first computing device has selected to permit a computing device to capture images of the user at a designated location;

based on receiving the opt-in indication, transmitting, to a second computing device, an image-capture indication to capture an image of the user of the first computing device at the designated location, the image-capture indication comprising a user encryption code that prevents the second computing device from displaying captured images of the user after the captured images have been encrypted;

providing, to the second computing device, a machine learning model trained to detect when a point of view comprises a favorable view for capturing one or more digital images based on a predicted popularity of the point of view among one or more social media platforms;

receiving, from the second computing device, a digital image of the user of the first computing device, the digital image captured via a camera of the second computing device based on the favorable view detected via the machine learning model and encrypted using the user encryption code to prevent the second computing device from displaying the digital image; and

providing the digital image for access by the first computing device.

2. The method of claim 1 , further comprising transmitting an image notification to the first computing device indicating that the digital image is available for access.

3. The method of claim 1 , wherein the designated location corresponds to an event and further comprising:

adding the digital image to an event album based on receiving an approval indication from the first computing device; and

sending an album notification to a plurality of computing devices corresponding to the event notifying the plurality of computing devices of the event album comprising the digital image and an additional digital image from the event.

4. The method of claim 1 , further comprising:

receiving one or more geo-fencing parameters indicating the designated location and an image-share request from the first computing device; and

providing the digital image to one or more other computing devices within the designated location indicated by the one or more geo-fencing parameters based on the image-share request.

5. The method of claim 1 , further comprising:

receiving, from the first computing device, a location update indicating a current location of the first computing device; and

transmitting the location update to the second computing device indicating the user of the first computing device is located at the designated location available for image capture.

6. The method of claim 1 , wherein the first computing device comprises a head-mounted-display device capable of providing an augmented reality display.

7. The method of claim 1 , wherein the user encryption code comprises a public encryption key corresponding to the user of the first computing device and the public encryption key corresponds to a private encryption key of the user of the first computing device.

8. The method of claim 1 , wherein transmitting the image-capture indication that includes the user encryption code that prevents the second computing device from displaying the captured images of the user comprises transmitting the image-capture indication that includes the user encryption code that further prevents the second computing device from storing or transmitting unencrypted images of the user.

9. The method of claim 1 , wherein providing the machine learning model trained to detect when the point of view comprises the favorable view based on the predicted popularity of the point of view among the one or more social media platforms comprises providing the machine learning model trained to detect when the point of view comprises the favorable view based on a predicted number of shares or a predicted number of likes on the one or more social media platforms.

10. A non-transitory computer-readable medium comprising instructions that, when executed by at least one processor, cause a computing device to:

receive an image-capture indication to capture a digital image of a user of a target computing device, the image-capture indication comprising a user encryption code that prevents the computing device from displaying captured images of the user after the captured images have been encrypted;

receive a machine learning model trained to detect when a point of view comprises a favorable view for capturing one or more digital images based on a predicted popularity of the point of view among one or more social media platforms;

detect an image-capture trigger for capturing one or more digital images based on the favorable view detected via the machine learning model;

based on detecting the image-capture trigger:

capture, via a camera of the computing device, one or more digital images of the user of the target computing device; and

encrypt the one or more digital images of the user utilizing the user encryption code to prevent the computing device from displaying the one or more digital images; and

provide the one or more digital images of the user for access by the target computing device.

11. The non-transitory computer-readable medium of claim 10 ,

further comprising instructions that, when executed by the at least one processor, cause the computing device to further detect the image-capture trigger for capturing the one or more digital images by:

detecting that the user of the target computing device is within a point of view for capturing the digital image of the user;

detecting a movement indication from an inertial measurement unit of the computing device indicating an accelerated movement or a speed above an image-capture threshold;

detecting a voice cue from a user of the computing device; or

detecting one or more physiological cues from the user of the computing device, the one or more physiological cues indicative of activity occurring within a detectable range of the user of the computing device.

12. The non-transitory computer-readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:

detect an additional image-capture trigger for capturing a digital image of a user of the computing device; and

transmit an image-capture request to the target computing device to capture the digital image of the user of the computing device.

13. The non-transitory computer-readable medium of claim 12 , further comprising instructions that, when executed by the at least one processor, cause the computing device to detect the additional image-capture trigger based on at least one of:

a voice analysis of the user of the computing device;

a heartbeat analysis of the user of the computing device; or

movement of the user of the computing device.

14. The non-transitory computer-readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:

receive, from an additional computing device, a censorship request to censor digital images from including an image of an additional user of the additional computing device;

determine that at least one digital image of the one or more digital images of the user includes the image of the additional user of the additional computing device; and

modify the at least one digital image to censor the image of the additional user of the additional computing device based on the censorship request.

15. The non-transitory computer-readable medium of claim 14 , further comprising instructions that, when executed by the at least one processor, cause the computing device to modify the at least one digital image to censor the image of the additional user of the additional computing device by, within the at least one digital image:

blurring the image of the additional user of the additional computing device;

replacing the image of the additional user of the additional computing device; or

removing the image of the additional user of the additional computing device.

16. The non-transitory computer-readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:

receive an image-restriction indication to avoid capturing an image of an additional user of an additional computing device;

detect an additional image-capture trigger for capturing additional digital images;

determining that the additional user of the additional computing device is within view; and

capturing one or more additional digital images without capturing a digital image of the additional user of the additional computing device based on the image-restriction indication.

17. A system comprising:

at least one processor; and

at least one non-transitory computer-readable medium comprising instructions that, when executed by the at least one processor, cause the system to:

receive, from a first computing device, an opt-in indication that a user of the first computing device has selected to permit a computing device to capture images of the user at a designated location;

based on receiving the opt-in indication, transmit, to a second computing device, an image-capture indication to capture an image of the user of the first computing device at the designated location, the image-capture indication comprising a user encryption code that prevents the second computing device from displaying captured images of the user after the captured images have been encrypted;

provide, to the second computing device, a machine learning model trained to detect when a point of view comprises a favorable view for capturing one or more digital images based on a predicted popularity of the point of view among one or more social media platforms;

receive, from the second computing device, a digital image of the user of the first computing device, the digital image captured via a camera of the second computing device based on the favorable view detected via the machine learning model and encrypted using the user encryption code to prevent the second computing device from displaying the digital image; and

provide the digital image for access by the first computing device, the digital image encrypted using the user encryption code.

18. The system of claim 17 , further comprising instructions that, when executed by the at least one processor, cause the system to encrypt the digital image using the user encryption code corresponding to the user of the first computing device.

19. The system of claim 17 , further comprising instructions that, when executed by the at least one processor, cause the system to transmit an image notification to the first computing device indicating that the digital image is available for access.

20. The system of claim 17 , further comprising instructions that, when executed by the at least one processor, cause the system to:

receive one or more geo-fencing parameters indicating the designated location and an image-share request from the first computing device; and

provide the digital image to one or more other computing devices within the designated location indicated by the one or more geo-fencing parameters based on the image-share request.

Assignments (2)
CHANGE OF NAME Recorded May 19, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060121/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2019
From: TERRANO, MARK
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 050643/0852 →