IP Library › Granted Patent US 12,287,826
Granted Patent B1
US 12,287,826 · App. 17/853,689 · Granted Apr 29, 2025

Systems and methods for sharing media items capturing subjects

Inventors: David Newman (San Diego, CA); Timothy David Bucklin (San Diego, CA); Otto Sievert (Oceanside, CA); Luc Sargent (San Mateo, CA)
Assignee: GoPro, Inc.
G06F16/58G06F16/78
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,287,826
App. No.
17/853,689
Granted
Apr 29, 2025
Kind
B1
Abstract

Media items (e.g., images, videos) may be captured by one or more image capture devices. One or more of the media items may be identified as including/likely including depiction of a user based on proximity of capture of the media item(s) in time and location to the user. The identified media item(s) may be provided to the user.

Claims (34)

1. A system for identifying media items, the system comprising:

one or more hardware processors configured by machine-readable instructions to:

obtain capture information of a set of media items, the capture information defining capture locations and capture times of the set of media items,

obtain user information, the user information defining one or more locations of a user at one or more times;

identify one or more media items from the set of media items based on the capture information of the set of media items and the user information, wherein a given media item captured by a given image capture device is identified based on proximity of capture of the given media item in time and location to the user, wherein the given media item is identified based on determination that the user is within a field of view of the given image capture device during capture of the given media item and a size of the user depicted within the given media item; and

provide the one or more identified media items to the user.

2. The system of claim 1 , wherein:

a direction in which the field of view of the given image capture device is pointed is determined based on motion of the given image capture device; and

permission to provide the given media item to the user is obtained before capture of the given media item.

3. A system for identifying media items, the system comprising:

one or more hardware processors configured by machine-readable instructions to:

obtain capture information of a set of media items, the capture information defining capture locations and capture times of the set of media items,

obtain user information, the user information defining one or more locations of a user at one or more times;

identify one or more media items from the set of media items based on the capture information of the set of media items and the user information, wherein a given media item captured by a given image capture device is identified based on proximity of capture of the given media item in time and location to the user, wherein the given media item is identified further based on determination that the user is within a field of view of the given image capture device during capture of the given media item; and

provide the one or more identified media items to the user.

4. The system of claim 3 , wherein the given media item being identified based on the proximity of the capture of the given media item in time and location to the user includes the given media item being identified based on a first capture location of the given media item at a first capture time being within a threshold distance of a first location of the user at the first capture time.

5. The system of claim 4 , wherein a size of the field of view of the given image capture device is determined based on a size of punchout used by the given image capture device to capture the given media item.

6. The system of claim 5 , wherein a direction in which the field of view of the given image capture device is pointed is determined based on motion of the given image capture device.

7. The system of claim 6 , wherein the direction determined based on the motion of the given image capture device is confirmed using motion vector of the given media item.

8. The system of claim 4 , wherein the given media item is identified further based on a size of the user depicted within the given media item.

9. The system of claim 3 , wherein permission to provide the given media item to the user is obtained before capture of the given media item.

10. The system of claim 3 , wherein permission to provide the given media item to the user is obtained via scanning of a machine-readable optical code by the given image capture device that captured the given media item.

11. A method for identifying media items, the method performed by a computing system including one or more processors, the method comprising:

obtaining, by the computing system, capture information of a set of media items, the capture information defining capture locations and capture times of the set of media items,

obtaining, by the computing system, user information, the user information defining one or more locations of a user at one or more times;

identifying, by the computing system, one or more media items from the set of media items based on the capture information of the set of media items and the user information, wherein a given media item captured by a given image capture device is identified based on proximity of capture of the given media item in time and location to the user, wherein the given media item is identified further based on determination that the user is within a field of view of the given image capture device during capture of the given media item; and

providing, by the computing system, the one or more identified media items to the user.

12. The method of claim 11 , wherein identifying the given media item based on the proximity of the capture of the given media item in time and location to the user includes identifying the given media item based on a first capture location of the given media item at a first capture time being within a threshold distance of a first location of the user at the first capture time.

13. The method of claim 12 , wherein a size of the field of view of the given image capture device is determined based on a size of punchout used by the given image capture device to capture the given media item.

14. The method of claim 13 , wherein a direction in which the field of view of the given image capture device is pointed is determined based on motion of the given image capture device.

15. The method of claim 14 , wherein the direction determined based on the motion of the given image capture device is confirmed using motion vector of the given media item.

16. The method of claim 12 , wherein the given media item is identified further based on a size of the user depicted within the given media item.

17. The method of claim 11 , wherein permission to provide the given media item to the user is obtained before capture of the given media item.

18. The method of claim 11 , wherein permission to provide the given media item to the user is obtained via scanning of a machine-readable optical code by the given image capture device that captured the given media item.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2022
From: NEWMAN, DAVID; BUCKLIN, TIMOTHY DAVID; SIEVERT, OTTO; SARGENT, LUC
To: GOPRO, INC.
Reel/Frame 060359/0967 →
References Cited (198)
US 5130794A · Ritchey · 1992 [cited by applicant]
US 6337683B1 · Gilbert · 2002 [cited by applicant]
US 6593956B1 · Potts · 2003 [cited by applicant]
US 7222356B1 · Yonezawa · 2007 [cited by applicant]
US 7483618B1 · Edwards · 2009 [cited by applicant]
US 8446433B1 · Mallet · 2013 [cited by applicant]
US 8611422B1 · Yagnik · 2013 [cited by applicant]
US 8718447B2 · Yang · 2014 [cited by applicant]
US 8730299B1 · Kozko · 2014 [cited by applicant]
US 8763023B1 · Goetz · 2014 [cited by applicant]
US 8910046B2 · Matsuda · 2014 [cited by applicant]
US 8988509B1 · Macmillan · 2015 [cited by applicant]
US 9032299B2 · Lyons · 2015 [cited by applicant]
US 9036001B2 · Chuang · 2015 [cited by applicant]
US 9077956B1 · Morgan · 2015 [cited by applicant]
US 9111579B2 · Meaney · 2015 [cited by applicant]
US 9142253B2 · Ubillos · 2015 [cited by applicant]
US 9151933B2 · Sato · 2015 [cited by applicant]
US 9204039B2 · He · 2015 [cited by applicant]
US 9208821B2 · Evans · 2015 [cited by applicant]
US 9245582B2 · Shore · 2016 [cited by applicant]
US 9253533B1 · Morgan · 2016 [cited by applicant]
US 9317172B2 · Lyons · 2016 [cited by applicant]
US 9423944B2 · Eppolito · 2016 [cited by applicant]
US 9473758B1 · Long · 2016 [cited by applicant]
US 9479697B2 · Aguilar · 2016 [cited by applicant]
US 9564173B2 · Swenson · 2017 [cited by applicant]
US 9652667B2 · Macmillan · 2017 [cited by applicant]
US 9754159B2 · Macmillan · 2017 [cited by applicant]
US 9760768B2 · Macmillan · 2017 [cited by applicant]
US 10084961B2 · Macmillan · 2018 [cited by applicant]
US 20040062439A1 · Cahill · 2004 [cited by applicant]
US 20040128317A1 · Sull · 2004 [cited by applicant]
US 20040169724A1 · Ekpar · 2004 [cited by applicant]
US 20050025454A1 · Nakamura · 2005 [cited by applicant]
US 20060122842A1 · Herberger · 2006 [cited by applicant]
US 20070173296A1 · Hara · 2007 [cited by applicant]
US 20070204310A1 · Hua · 2007 [cited by applicant]
US 20070230461A1 · Singh · 2007 [cited by applicant]
US 20080044155A1 · Kuspa · 2008 [cited by applicant]
US 20080123976A1 · Coombs · 2008 [cited by applicant]
US 20080152297A1 · Ubillos · 2008 [cited by applicant]
US 20080163283A1 · Tan · 2008 [cited by applicant]
US 20080177706A1 · Yuen · 2008 [cited by applicant]
US 20080208791A1 · Das · 2008 [cited by applicant]
US 20080253735A1 · Kuspa · 2008 [cited by applicant]
US 20080313541A1 · Shafton · 2008 [cited by applicant]
US 20090213270A1 · Ismert · 2009 [cited by applicant]
US 20090274339A9 · Cohen · 2009 [cited by applicant]
US 20090327856A1 · Mouilleseaux · 2009 [cited by applicant]
US 20100045773A1 · Ritchey · 2010 [cited by applicant]
US 20100064219A1 · Gabrisko · 2010 [cited by applicant]
US 20100086216A1 · Lee · 2010 [cited by applicant]
US 20100104261A1 · Liu · 2010 [cited by applicant]
US 20100183280A1 · Beauregard · 2010 [cited by applicant]
US 20100231730A1 · Ichikawa · 2010 [cited by applicant]
US 20100245626A1 · Woycechowsky · 2010 [cited by applicant]
US 20100251295A1 · Amento · 2010 [cited by applicant]
US 20100278504A1 · Lyons · 2010 [cited by applicant]
US 20100278509A1 · Nagano · 2010 [cited by applicant]
US 20100281375A1 · Pendergast · 2010 [cited by applicant]
US 20100281386A1 · Lyons · 2010 [cited by applicant]
US 20100287476A1 · Sakai · 2010 [cited by applicant]
US 20100299630A1 · Mccutchen · 2010 [cited by applicant]
US 20100318660A1 · Balsubramanian · 2010 [cited by applicant]
US 20100321471A1 · Casolara · 2010 [cited by applicant]
US 20110025847A1 · Park · 2011 [cited by applicant]
US 20110069148A1 · Jones · 2011 [cited by applicant]
US 20110069189A1 · Venkataraman · 2011 [cited by applicant]
US 20110075990A1 · Eyer · 2011 [cited by applicant]
US 20110093798A1 · Shahraray · 2011 [cited by applicant]
US 20110134240A1 · Anderson · 2011 [cited by applicant]
US 20110173565A1 · Ofek · 2011 [cited by applicant]
US 20110206351A1 · Givoly · 2011 [cited by applicant]
US 20110211040A1 · Lindemann · 2011 [cited by applicant]
US 20110258049A1 · Ramer · 2011 [cited by applicant]
US 20110293250A1 · Deever · 2011 [cited by applicant]
US 20110320322A1 · Roslak · 2011 [cited by applicant]
US 20120014673A1 · O'Dwyer · 2012 [cited by applicant]
US 20120027381A1 · Kataoka · 2012 [cited by applicant]
US 20120030029A1 · Flinn · 2012 [cited by applicant]
US 20120057852A1 · Devleeschouwer · 2012 [cited by applicant]
US 20120123780A1 · Gao · 2012 [cited by applicant]
US 20120127169A1 · Barcay · 2012 [cited by applicant]
US 20120233000A1 · Fisher · 2012 [cited by examiner]
US 20120311448A1 · Achour · 2012 [cited by applicant]
US 20130024805A1 · In · 2013 [cited by applicant]
US 20130044108A1 · Tanaka · 2013 [cited by applicant]
US 20130058532A1 · White · 2013 [cited by applicant]
US 20130063561A1 · Stephan · 2013 [cited by applicant]
US 20130078990A1 · Kim · 2013 [cited by applicant]
US 20130127636A1 · Aryanpur · 2013 [cited by applicant]
US 20130136193A1 · Hwang · 2013 [cited by applicant]
US 20130142384A1 · Ofek · 2013 [cited by applicant]
US 20130151970A1 · Achour · 2013 [cited by applicant]
US 20130166303A1 · Chang · 2013 [cited by applicant]
US 20130191743A1 · Reid · 2013 [cited by applicant]
US 20130195429A1 · Fay · 2013 [cited by applicant]
US 20130197967A1 · Pinto · 2013 [cited by applicant]
US 20130208134A1 · Hamalainen · 2013 [cited by applicant]
US 20130208942A1 · Davis · 2013 [cited by applicant]
US 20130215220A1 · Wang · 2013 [cited by applicant]
US 20130259399A1 · Ho · 2013 [cited by applicant]
US 20130263002A1 · Park · 2013 [cited by applicant]
US 20130283301A1 · Avedissian · 2013 [cited by applicant]
US 20130287214A1 · Resch · 2013 [cited by applicant]
US 20130287304A1 · Kimura · 2013 [cited by applicant]
US 20130300939A1 · Chou · 2013 [cited by applicant]
US 20130308921A1 · Budzinski · 2013 [cited by applicant]
US 20130318443A1 · Bachman · 2013 [cited by applicant]
US 20130343727A1 · Rav-Acha · 2013 [cited by applicant]
US 20140026156A1 · Deephanphongs · 2014 [cited by applicant]
US 20140064706A1 · Lewis, II · 2014 [cited by applicant]
US 20140072285A1 · Shynar · 2014 [cited by applicant]
US 20140093164A1 · Noorkami · 2014 [cited by applicant]
US 20140096002A1 · Dey · 2014 [cited by applicant]
US 20140105573A1 · Hanckmann · 2014 [cited by applicant]
US 20140161351A1 · Yagnik · 2014 [cited by applicant]
US 20140165119A1 · Liu · 2014 [cited by applicant]
US 20140169766A1 · Yu · 2014 [cited by applicant]
US 20140176542A1 · Shohara · 2014 [cited by applicant]
US 20140193040A1 · Bronshtein · 2014 [cited by applicant]
US 20140212107A1 · Saint-Jean · 2014 [cited by applicant]
US 20140219634A1 · Mcintosh · 2014 [cited by applicant]
US 20140226953A1 · Hou · 2014 [cited by applicant]
US 20140232818A1 · Carr · 2014 [cited by applicant]
US 20140232819A1 · Armstrong · 2014 [cited by applicant]
US 20140245336A1 · Lewis, II · 2014 [cited by applicant]
US 20140300644A1 · Gillard · 2014 [cited by applicant]
US 20140328570A1 · Cheng · 2014 [cited by applicant]
US 20140341528A1 · Mahate · 2014 [cited by applicant]
US 20140366052A1 · Ives · 2014 [cited by applicant]
US 20140376876A1 · Bentley · 2014 [cited by applicant]
US 20150012827A1 · Elmeih · 2015 [cited by applicant]
US 20150015680A1 · Wang · 2015 [cited by applicant]
US 20150022355A1 · Pham · 2015 [cited by applicant]
US 20150029089A1 · Kim · 2015 [cited by applicant]
US 20150058709A1 · Zaletel · 2015 [cited by applicant]
US 20150085111A1 · Lavery · 2015 [cited by applicant]
US 20150154452A1 · Bentley · 2015 [cited by applicant]
US 20150154782A1 · Geisner · 2015 [cited by applicant]
US 20150178915A1 · Chatterjee · 2015 [cited by applicant]
US 20150186073A1 · Pacurariu · 2015 [cited by applicant]
US 20150220504A1 · Bocanegra Alvarez · 2015 [cited by applicant]
US 20150254871A1 · Macmillan · 2015 [cited by applicant]
US 20150256746A1 · Macmillan · 2015 [cited by applicant]
US 20150256808A1 · Macmillan · 2015 [cited by applicant]
US 20150271483A1 · Sun · 2015 [cited by applicant]
US 20150287435A1 · Land · 2015 [cited by applicant]
US 20150294141A1 · Molyneux · 2015 [cited by applicant]
US 20150318020A1 · Pribula · 2015 [cited by applicant]
US 20150339324A1 · Westmoreland · 2015 [cited by applicant]
US 20150375117A1 · Thompson · 2015 [cited by applicant]
US 20150382083A1 · Chen · 2015 [cited by applicant]
US 20160005440A1 · Gower · 2016 [cited by applicant]
US 20160026874A1 · Hodulik · 2016 [cited by applicant]
US 20160027470A1 · Newman · 2016 [cited by applicant]
US 20160027475A1 · Hodulik · 2016 [cited by applicant]
US 20160029105A1 · Newman · 2016 [cited by applicant]
US 20160055885A1 · Hodulik · 2016 [cited by applicant]
US 20160088287A1 · Sadi · 2016 [cited by applicant]
US 20160098941A1 · Kerluke · 2016 [cited by applicant]
US 20160119551A1 · Brown · 2016 [cited by applicant]
US 20160217325A1 · Bose · 2016 [cited by applicant]
US 20160225405A1 · Matias · 2016 [cited by applicant]
US 20160225410A1 · Lee · 2016 [cited by applicant]
US 20160234345A1 · Roberts · 2016 [cited by applicant]
US 20160358603A1 · Azam · 2016 [cited by applicant]
US 20160366330A1 · Boliek · 2016 [cited by applicant]
US 20170006214A1 · Andreassen · 2017 [cited by applicant]
US 20170110155A1 · Campbell · 2017 [cited by applicant]
US 20170295318A1 · Macmillan · 2017 [cited by applicant]
US 20170366755A1 · Lustig · 2017 [cited by applicant]
US 20180103197A1 · Campbell · 2018 [cited by applicant]
WO 2001020466 · 2001 [cited by applicant]
WO 2009040538A1 · 2009 [cited by applicant]
Ernoult, Emeric, ‘How to Triple Your YouTube Video Views with Facebook’, SocialMediaExaminer.com, Nov. 26, 2012, 16 pages. [cited by applicant]
FFmpeg, “AVPacket Struct Reference,” Doxygen, Jul. 20, 2014, 24 Pages, [online] [retrieved on Jul. 13, 2015] Retrieved from the internet <URL:https://www.ffmpeg.org/doxygen/2.5/group_lavf_decoding.html>. 24 pages. [cited by applicant]
FFmpeg, “Demuxing,” Doxygen, Dec. 5, 2014, 15 Pages, [online] [retrieved on Jul. 13, 2015] Retrieved from the internet <URL:https://www.ffmpeg.org/doxygen/2.3/group_lavf_encoding.html>. 15 pages. [cited by applicant]
FFmpeg, “Muxing,” Doxygen, Jul. 20, 2014, 9 Pages, [online] [retrieved on Jul. 13, 2015] Retrieved from the internet <URL: https://www.ffmpeg.org/doxyg en/2. 3/structAVPacket.html>. 9 pages. [cited by applicant]
Han et al., ‘Deep Compression: Compressing Deep Neural Networks with Pruning’, Trained Quantization and Huffman Coding, International Conference on Learning Representations, 2016, 14 pgs. [cited by applicant]
He et al., ‘Deep Residual Learning for Image Recognition,’ arXiv:1512.03385, 2015, 12 pgs. [cited by applicant]
Iandola et al., ‘SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size’, arXiv:1602.07360v3 [cs.CV] Apr. 6, 2016 (9 pgs.). [cited by applicant]
Parkhi et al., ‘Deep Face Recognition,’ Proceedings of the British Machine Vision, 2015, 12 pgs. [cited by applicant]
PCT International Preliminary Report on Patentability for PCT/US2015/023680, dated Oct. 4, 2016, 10 pages. [cited by applicant]
PCT International Search Reort for PCT/US15/18538 dated Jun. 16, 2015 (2 pages). [cited by applicant]
PCT International Search Report and Written Opinion for PCT/US15/12086 dated Mar. 17, 2016, 7 pages. [cited by applicant]
PCT International Search Report and Written Opinion for PCT/US15/18538, Jun. 16, 2015, 26 pages. [cited by applicant]
PCT International Search Report and Written Opinion for PCT/US16/31076, Aug. 8, 2016, 19 Pages. [cited by applicant]
PCT International Search Report for PCT/US15/23680 dated Aug. 3, 2015, 4 pages. [cited by applicant]
PCT International Search Report for PCT/US15/41624 dated Nov. 4, 2015, 5 pages. [cited by applicant]
PCT International Search Report for PCT/US17/16367 dated Apr. 14, 2017 (2 pages). [cited by applicant]
PCT International Written Opinion for PCT/US2015/041624, Dec. 17, 2015, 7 Pages. [cited by applicant]
Ricker, ‘First Click: TomTom's Bandit camera beats GoPro with software’, Mar. 9, 2016 URL: http://www.theverge.com/2016/3/9/11179298/tomtom-bandit-beats-gopro (6 pages). [cited by applicant]
Schroff et al., ‘FaceNet: A Unified Embedding for Face Recognition and Clustering,’ IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, 10 pgs. [cited by applicant]
Sergey Ioffe and Christian Szegedy, “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift,” in Proc. ICML. 2015, pp. 448-456, JMLR.org. [cited by applicant]
Tran et al., ‘Learning Spatiotemporal Features with 3D Convolutional Networks’, arXiv:1412.0767 [cs.CV] Dec. 2, 2014 (9 pgs). [cited by applicant]
Yang et al., ‘Unsupervised Extraction of Video Highlights Via Robust Recurrent Auto-encoders’ arXiv:1510.01442v1 [cs.CV] Oct. 6, 2015 (9 pgs). [cited by applicant]