IP Library › Granted Patent US 12,598,273
Granted Patent B2
US 12,598,273 · App. 18/667,568 · Granted Apr 7, 2026

Camera platform incorporating schedule and stature

Inventors: Shuai Zheng (Berkeley, CA); Fan Yang (San Jose, CA); Mohammadhadi Kiapour (San Francisco, CA); Qiaosong Wang (San Jose, CA); Japjit S. Tulsi (Los Altos Hills, CA); Robinson Piramuthu (Oakland, CA)
Assignee: eBay Inc.
H04N7/185G06F18/214G06N20/00G06Q30/0623G06Q30/08G06T7/60G06T11/60G06V10/10G06V20/20G06V30/194H04N23/63G06F3/04842G06F18/2431G06Q30/0631G06Q30/0643G06T2210/16H04N23/61H04N23/631
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,598,273
App. No.
18/667,568
Filed
May 17, 2024
Granted
Apr 7, 2026
Kind
B2
Examiner
YANG, QIAN
Art Unit
2677
USPC
382/103
Abstract

Camera platform techniques are described. In an implementation, a plurality of digital images and data describing times, at which, the plurality of digital images are captured is received by a computing device. Objects of clothing are recognized from the digital images by the computing device using object recognition as part of machine learning. A user schedule is also received by the computing device that describes user appointments and times, at which, the appointments are scheduled. A user profile is generated by the computing device by training a model using machine learning based on the recognized objects of clothing, times at which corresponding digital images are captured, and the user schedule. From the user profile, a recommendation is generated by processing a subsequent user schedule using the model as part of machine learning by the computing device.

Claims (34)

1 . A method implemented by a computing device, the method comprising:

receiving, by the computing device, digital images including objects, times at which the digital images are captured, and a user schedule including appointments corresponding to the times the digital images are captured;

recognizing, by the computing device, the objects;

training, by the computing device, a machine learning model to generate a recommendation based on the objects recognized, the times at which the digital images are captured, and the user schedule; and

generating, by the computing device, the recommendation via the machine learning model.

2 . The method as described in claim 1 , wherein the receiving includes locations at which the digital images are captured and wherein the training of the machine learning model to generate the recommendation is based on the locations.

3 . The method as described in claim 1 , wherein the user schedule is a training schedule including weather conditions at times and locations of the appointments.

4 . The method as described in claim 1 , wherein the recommendation is output as augmented reality content.

5 . The method as described in claim 4 , wherein the augmented reality content is output via a user interface along with a direct view of a physical environment of the computing device.

6 . The method as described in claim 1 , wherein the recommendation is clothing.

7 . The method as described in claim 1 , wherein the recommendation is selectable via a user interface to begin a purchase from a service provider system via a network.

8 . The method as described in claim 1 , further comprising presenting, by the computing device, the recommendation as an augmented reality overlay within a live camera feed captured by the computing device.

9 . The method as described in claim 8 , wherein the presenting of the recommendation includes stabilizing the augmented reality overlay relative to scene content using at least one of orientation sensor data of the computing device and image-based feature tracking across one or more frames.

10 . The method as described in claim 1 , further comprising generating, by the computing device, size data, stature data, and style data from the digital images, and wherein the generating of the recommendation is based at least in part on the generated size data, stature data, and style data.

11 . The method as described in claim 1 , wherein the receiving of the digital images comprises receiving depth image data, the method further comprising performing, by the computing device, skeletal tracking on the depth image data to estimate a three-dimensional skeletal model of a person depicted in the digital images, and wherein the generating of the recommendation is further based at least in part on the skeletal tracking.

12 . A computing device comprising:

a processing system; and

a computer-readable storage medium having stored instructions that, responsive to execution by the processing system, induce the processing system to perform operations comprising:

receiving digital images including objects, times at which the digital images are captured, and a user schedule including appointments corresponding to the times the digital images are captured;

recognizing the objects;

training a machine learning model to generate a recommendation based on the objects recognized, the times at which the digital images are captured, and the user schedule; and

generating the recommendation via the machine learning model.

13 . The computing device as described in claim 12 , wherein at least one of a size, a stature, or a style are described in the recommendation.

14 . The computing device as described in claim 12 , wherein the recommendation is for an object.

15 . The computing device as described in claim 14 , wherein the object is clothing.

16 . The computing device as described in claim 12 , wherein the recommendation is output as augmented reality content.

17 . The computing device as described in claim 16 , wherein the augmented reality content is output via a user interface along with a direct view of a physical environment of the computing device.

18 . The computing device as described in claim 17 , wherein the direct view is part of a live feed.

19 . A non-transitory computer-readable storage medium storing executable instructions, which when executed by a processing device, induce the processing device to perform operations comprising:

receiving digital images including objects, times at which the digital images are captured, and a user schedule including appointments corresponding to the times the digital images are captured;

recognizing the objects;

training a machine learning model to generate a recommendation based on the objects recognized, the times at which the digital images are captured, and the user schedule; and

generating the recommendation via the machine learning model.

20 . The non-transitory computer-readable storage medium as described in claim 19 , wherein the recommendation is for an object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2024
From: ZHENG, SHUAI; YANG, FAN; KIAPOUR, MOHAMMADHADI; WANG, QIAOSONG; TULSI, JAPJIT S.; PIRAMUTHU, ROBINSON
To: EBAY INC.
Reel/Frame 067449/0963 →
Continuity (6)
Continuation 18302714 · Apr 18, 2023
Continuation 17170549 · Feb 8, 2021
Continuation 16673638 · Nov 4, 2019
Continuation 15859056 · Dec 29, 2017
Provisional Application 62558836 · Sep 14, 2017
Related Publication 20240305751A1 · Sep 12, 2024
References Cited (128)
US 8068676B2 · Zhang et al. · 2011 [cited by applicant]
US 8121618B2 · Rhoads et al. · 2012 [cited by applicant]
US 8385971B2 · Rhoads et al. · 2013 [cited by applicant]
US 8615524B2 · Kanigsberg et al. · 2013 [cited by applicant]
US 8965460B1 · Rao et al. · 2015 [cited by applicant]
US 9025864B2 · Zhang et al. · 2015 [cited by applicant]
US 9179061B1 · Kraft et al. · 2015 [cited by applicant]
US 9218530B2 · Davis et al. · 2015 [cited by applicant]
US 9240077B1 · Kraft et al. · 2016 [cited by applicant]
US 9329762B1 · Schultz et al. · 2016 [cited by applicant]
US 9443199B2 · Pinckney et al. · 2016 [cited by applicant]
US 9471912B2 · Verkasalo et al. · 2016 [cited by applicant]
US 10008039B1 · Neustein et al. · 2018 [cited by applicant]
US 10282776B2 · Jo et al. · 2019 [cited by applicant]
US 10311409B1 · Brailovskiy et al. · 2019 [cited by applicant]
US 10495878B2 · Chi et al. · 2019 [cited by applicant]
US 10509962B2 · Zheng et al. · 2019 [cited by applicant]
US 10949667B2 · Zheng et al. · 2021 [cited by applicant]
US 11126849B2 · Zheng et al. · 2021 [cited by applicant]
US 11659143B2 · Zheng et al. · 2023 [cited by applicant]
US 11665320B2 · Zheng et al. · 2023 [cited by applicant]
US 12081913B2 · Zheng et al. · 2024 [cited by applicant]
US 20090304267A1 · Tapley et al. · 2009 [cited by applicant]
US 20100046842A1 · Conwell et al. · 2010 [cited by applicant]
US 20100191578A1 · Tran et al. · 2010 [cited by applicant]
US 20100313141A1 · Yu et al. · 2010 [cited by applicant]
US 20110298897A1 · Sareen et al. · 2011 [cited by applicant]
US 20110302117A1 · Pinckney et al. · 2011 [cited by applicant]
US 20120040612A1 · Lee et al. · 2012 [cited by applicant]
US 20120188147A1 · Hosein et al. · 2012 [cited by applicant]
US 20130215116A1 · Siddique et al. · 2013 [cited by applicant]
US 20130293580A1 · Spivack · 2013 [cited by applicant]
US 20140185871A1 · Ito et al. · 2014 [cited by applicant]
US 20140267792A1 · Mullins · 2014 [cited by applicant]
US 20140337174A1 · Lin et al. · 2014 [cited by applicant]
US 20150206257A1 · Harada · 2015 [cited by applicant]
US 20150286873A1 · Davis et al. · 2015 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160070439A1 · Bostick et al. · 2016 [cited by applicant]
US 20160189039A1 · Leppanen et al. · 2016 [cited by applicant]
US 20170064260A1 · Wexler et al. · 2017 [cited by applicant]
US 20170083789A1 · Shah et al. · 2017 [cited by applicant]
US 20170091713A1 · Paris · 2017 [cited by examiner]
US 20170109609A1 · Hill et al. · 2017 [cited by applicant]
US 20170132841A1 · Morrison · 2017 [cited by applicant]
US 20170372268A1 · Ilan et al. · 2017 [cited by applicant]
US 20180082479A1 · Zhang · 2018 [cited by applicant]
US 20180150892A1 · Waldron et al. · 2018 [cited by applicant]
US 20180158134A1 · Hassan · 2018 [cited by applicant]
US 20180197223A1 · Grossman · 2018 [cited by applicant]
US 20180218433A1 · Penner et al. · 2018 [cited by applicant]
US 20180300791A1 · Ganesan et al. · 2018 [cited by applicant]
US 20190066304A1 · Hirano et al. · 2019 [cited by applicant]
US 20190080171A1 · Zheng et al. · 2019 [cited by applicant]
US 20190080172A1 · Zheng et al. · 2019 [cited by applicant]
US 20200065588A1 · Zheng et al. · 2020 [cited by applicant]
US 20210158046A1 · Zheng et al. · 2021 [cited by applicant]
US 20210312180A1 · Zheng et al. · 2021 [cited by applicant]
US 20230254455A1 · Zheng et al. · 2023 [cited by applicant]
CN 104081379 · 2014 [cited by applicant]
CN 105094311 · 2015 [cited by applicant]
CN 106462979 · 2017 [cited by applicant]
JP 2010015565 · 2010 [cited by examiner]
JP 2012014544 · 2012 [cited by applicant]
KR 1020120015803 · 2012 [cited by applicant]
KR 20160128119 · 2016 [cited by applicant]
KR 20160144665 · 2016 [cited by applicant]
KR 20160145732A · 2016 [cited by applicant]
WO WO2013063299 · 2013 [cited by applicant]
WO WO2014063157 · 2014 [cited by applicant]
WO WO2016175412 · 2016 [cited by applicant]
WO WO2019055352 · 2019 [cited by applicant]
US 12,022,239 B2, 06/2024, Zheng et al. (withdrawn) [cited by applicant]
Liu et al. “DeepStyle: Learning User Preferences for Visual Recommendation”, SIGIR'17, Aug. 7-11, 2017, Shinjuku, Tokyo, Japan (Year: 2017). [cited by examiner]
MaAuley et al., “Image-Based Recommendations on Styles and Substitutes”, SIGIR '15: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (Year: 2015). [cited by examiner]
Kalantidis et al. “Getting the Look: Clothing Recognition and Segmentation for Automatic Product Suggestions in Everyday Photos”, ICMR '13: Proceedings of the 3rd ACM conference on International conference on multimedia… [cited by examiner]
Machine translation for JP 2010-015565 (Year: 2010). [cited by examiner]
“Foreign Office Action”, KR Application No. 1020237037204, 8 pages. [cited by applicant]
“Examiner Interview Summary”, U.S. Appl. No. 15/858,463, filed May 17, 2019, 3 pages. [cited by applicant]
“Examiner Interview Summary”, U.S. Appl. No. 15/858,463, filed Nov. 21, 2019, 3 pages. [cited by applicant]
“Final Office Action”, U.S. Appl. No. 15/858,463, filed Oct. 2, 2019, 16 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2018/050280, Mar. 17, 2020, 9 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2018/050280, Nov. 26, 2018, 13 pages. [cited by applicant]
“Non-Final Office Action”, U.S. Appl. No. 15/858,463, filed Apr. 14, 2020, 16 pages. [cited by applicant]
“Non-Final Office Action”, U.S. Appl. No. 15/858,463, filed Apr. 18, 2019, 16 pages. [cited by applicant]
“Notice of Allowance”, U.S. Appl. No. 15/859,056, filed Aug. 13, 2019, 9 pages. [cited by applicant]
“Response to Final Office Action”, U.S. Appl. No. 15/858,463, filed Dec. 3, 2019, 10 pages. [cited by applicant]
“Response to Non-Final Office Action”, U.S. Appl. No. 15/858,463, filed Jul. 18, 2019, 11 pages. [cited by applicant]
“Response to Non-Final Office Action”, U.S. Appl. No. 15/859,056, filed Jul. 18, 2019, 11 pages. [cited by applicant]
“Response to Restriction Requirement”, U.S. Appl. No. 15/859,056, filed Jul. 17, 2019, 8 pages. [cited by applicant]
“Restriction Requirement”, U.S. Appl. No. 15/859,056, filed Jul. 9, 2019, 6 pages. [cited by applicant]
“Supplemental Amendment”, U.S. Appl. No. 15/859,056, filed Aug. 1, 2019, 9 pages. [cited by applicant]
“Supplemental Notice of Allowability”, U.S. Appl. No. 15/859,056, filed Oct. 29, 2019, 2 pages. [cited by applicant]
“Supplemental Notice of Allowance”, U.S. Appl. No. 15/859,056, filed Aug. 29, 2019, 3 pages. [cited by applicant]
10-2020-7007259, , “Decision for Appeal against Final Rejection received for Korean Patent Application No. 10-2020-7007259, mailed on Jul. 28, 2022”, Jul. 28, 2022, 32 Pages. [cited by applicant]
10-2020-7007259, , “Final Office Action Received for Korean Patent Application No. 10-2020-7007259, mailed on Dec. 13, 2021”, Dec. 13, 2021, 5 Pages. [cited by applicant]
10-2020-7007259, , “Final Office Action Received for Korean Patent Application No. 10-2020-7007259, mailed on Feb. 9, 2022”, Feb. 9, 2022, 8 Pages. [cited by applicant]
10-2020-7007259, , “Office Action received for Korean Patent Application No. 10-2020-7007259, mailed on Jun. 19, 2021”, Jun. 19, 2021, 9 Pages. [cited by applicant]
10-2022-7008248, , “Foreign Office Action”, KR Application No. 10-2022-7008248, Feb. 14, 2023, 10 pages. [cited by applicant]
10-2022-7008248, , “Office Action received for Korean Patent Application No. 10-2022-7008248 mailed on Jul. 1, 2022”, Jul. 1, 2022, 4 Pages( 1 Page of english Translation & 3 Pages of official Copy). [cited by applicant]
10-2023-7037204, , “Foreign Office Action”, KR Application 10-2023-7037204, May 14, 2024, 5 pages. [cited by applicant]
U.S. Appl. No. 15/858,463, , “Applicant Interview summary received for U.S. Appl. No. 15/858,463 mailed on Jul. 13, 2020”, filed Jul. 13, 2020, 3 Pages. [cited by applicant]
U.S. Appl. No. 15/858,463, , “Applicant Initiated Interview Summary Received for U.S. Appl. No. 15/858,463, mailed on Nov. 19, 2020”, filed Nov. 19, 2020, 3 Pages. [cited by applicant]
U.S. Appl. No. 15/858,463, , “Final Office Action Received for U.S. Appl. No. 15/858,463, mailed on Oct. 9, 2020”, filed Oct. 9, 2020, 19 Pages. [cited by applicant]
U.S. Appl. No. 15/858,463, , “Notice Of Allowance received for U.S. Appl. No. 15/858,463, mailed on Dec. 9, 2020”, filed Dec. 9, 2020, 9 Pages. [cited by applicant]
U.S. Appl. No. 15/859,056, , “Supplementary Amendment filed on Jul. 29, 2019, for U.S. Appl. No. 15/859,056”, filed Jul. 29, 2019, 9 Pages. [cited by applicant]
U.S. Appl. No. 16/673,638, , “Non Final Office Action Received for U.S. Appl. No. 16/673,638, mailed on Mar. 5, 2021”, filed Mar. 5, 2021, 15 Pages. [cited by applicant]
U.S. Appl. No. 16/673,638, , “Notice of Allowance Received for U.S. Appl. No. 16/673,638, mailed on May 19, 2021”, filed May 19, 2021, 7 Pages. [cited by applicant]
U.S. Appl. No. 16/673,638, , “Supplemental Notice of Allowability Received for U.S. Appl. No. 16/673,638, mailed on Aug. 27, 2021”, filed Aug. 27, 2021, 2 Pages. [cited by applicant]
U.S. Appl. No. 17/170,549, , “Final Office Action”, U.S. Appl. No. 17/170,549, filed Nov. 1, 2022, 9 pages. [cited by applicant]
U.S. Appl. No. 17/170,549, , “Non-Final Office Action”, U.S. Appl. No. 17/170,549, filed Jul. 13, 2022, 8 pages. [cited by applicant]
U.S. Appl. No. 17/170,549, , “Notice of Allowance”, U.S. Appl. No. 17/170,549, filed Jan. 19, 2023, 7 pages. [cited by applicant]
U.S. Appl. No. 17/170,549, , “Supplemental Notice of Allowability”, U.S. Appl. No. 17/170,549, filed Apr. 26, 2023, 2 pages. [cited by applicant]
U.S. Appl. No. 17/348,010, , “Non-Final Office Action”, U.S. Appl. No. 17/348,010, filed Dec. 9, 2022, 21 pages. [cited by applicant]
U.S. Appl. No. 17/348,010, , “Notice of Allowance”, U.S. Appl. No. 17/348,010, filed Mar. 7, 2023, 7 pages. [cited by applicant]
U.S. Appl. No. 17/348,010, , “Supplemental Notice of Allowability”, U.S. Appl. No. 17/348,010, filed Apr. 17, 2023, 2 pages. [cited by applicant]
U.S. Appl. No. 18/302,714, , “Notice of Allowance”, U.S. Appl. No. 18/302,714, filed Feb. 23, 2024, 8 pages. [cited by applicant]
U.S. Appl. No. 18/302,714, , “Supplemental Notice of Allowability”, U.S. Appl. No. 18/302,714, filed Jul. 5, 2024, 2 pages. [cited by applicant]
18785474.0, , “Communication under Article 94(3) received for European Patent Application No. 18785474.0, mailed on Sep. 30, 2021”, Sep. 30, 2021, 8 Pages. [cited by applicant]
201880059042.9, , “Foreign Office Action”, CN Application No. 201880059042.9, Jan. 2, 2024, 5 pages. [cited by applicant]
201880059042.9, , “Foreign Office Action”, CN Application No. 201880059042.9, Aug. 30, 2023, 6 pages. [cited by applicant]
201880059042.9, , “Foreign Office Action”, CN Application No. 201880059042.9, Mar. 25, 2023, 8 pages. [cited by applicant]
Macedo, et al., “Context-Aware Event Recommendation in Event-based Social Networks”, RecSys '15: Proceedings of the 9th ACM Conference on Recommender Systems [retrieved Dec. 16, 2022]. Retrieved from the Internet <https… [cited by applicant]
Simo-Serra, Edgar et al., “Neuroaesthetics in Fashion: Modeling the Perception of Fashionability”, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 1, 2015, 9 pages. [cited by applicant]
Vladimirovich, , “Shopping Recommendation System Based on Metric Analysis of Clothing Descriptions”, 2015—Master's Thesis, 2015, 71 pages. [cited by applicant]
Wang, Haosha , “Machine Fashion: An Artificial Intelligence Based Clothing Fashion Stylist”, 2014—Master's Thesis, 2014, 66 pages. [cited by applicant]
Zhou, Xinyi et al., “Application of Deep Learning in Object Detection”, May 2017, 4 pages. [cited by applicant]
“Foreign Office Action”, KR Application No. 20237037204, Aug. 14, 2025, 5 pages. [cited by applicant]