IP Library › Granted Patent US 12,307,544
Granted Patent B2
US 12,307,544 · App. 18/608,091 · Granted May 20, 2025

Automatic guided image capturing and presentation of images

Inventors: Robinson Piramuthu (Oakland, CA); Wen Zheng (San Jose, CA)
Assignee: eBay Inc.
G06T1/0007G06Q30/0643G06T11/60G06V10/235G06V10/28G06V20/20G06V20/64H04N5/2226H04N23/631H04N23/64H04N23/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,307,544
App. No.
18/608,091
Filed
Mar 18, 2024
Granted
May 20, 2025
Kind
B2
Art Unit
2639
USPC
348/222.1
Abstract

Disclosed are embodiments for facilitating automatic-guided image capturing and presentation. In some embodiments, the method includes capturing an image of an item, removing a background of the image frame, performing manual mask editing, generating an item listing based on the manually edited mask, inferring item information from the image frame and applying the inferred item information to an item listing.

Claims (41)

1. A method comprising:

receiving a first image of an item captured based at least in part on guidance to position the item within a bounded area of a user interface;

removing, by one or more processors, a portion of pixels in the first image of the item to generate a second image of the item, wherein the portion of pixels in the first image of the item are background pixels;

determining, by the one or more processors and from the second image of the item, a category of the item;

automatically selecting, by the one or more processors and based at least in part on the category of the item, a presentation layer from a plurality of presentation layers for presentation of the second image, wherein respective presentation layers of the plurality of presentation layers are associated with respective categories of items; and

causing presentation of the second image at the presentation layer of a network-based marketplace.

2. The method of claim 1 , further comprising receiving user input associated with the presentation layer, wherein causing presentation of the second image at the presentation layer of the network-based marketplace comprises updating one or more characteristics of the presentation layer based at least in part on the user input.

3. The method of claim 2 , wherein the one or more characteristics of the presentation layer include at least one of a style of the presentation layer or a color of the presentation layer.

4. The method of claim 1 , wherein causing presentation of the second image at the presentation layer of the network-based marketplace comprises causing presentation of a virtual sale indicator at the presentation layer, wherein the virtual sale indicator includes a visual indicator associated with a price of the item.

5. The method of claim 1 , further comprising:

receiving user input associated with a selection of the item via the presentation layer of the network-based marketplace; and

causing, in response to the user input, presentation of information associated with the item.

6. The method of claim 5 , wherein causing presentation of the information comprises causing, based at least in part on filling at least part of an item listing using the information, presentation of the item listing for the item associated with the network-based marketplace, the item listing comprising the second image.

7. The method of claim 5 , wherein the information comprises a list of items associated with the item.

8. The method of claim 1 , further comprising causing presentation of the guidance in real-time, wherein the guidance includes instructions associated with a first boundary and a second boundary that define the bounded area of the user interface, and wherein the first boundary corresponds to the background pixels and the second boundary corresponds to an additional portion of pixels in the first image of the item that are foreground pixels.

9. The method of claim 1 , further comprising causing presentation of the guidance in real-time, wherein the guidance includes instructions associated with at least one of an environment of the item or a position of an additional item in the first image.

10. The method of claim 1 , wherein the presentation layer is automatically selected based at least in part on inferring information from the second image, and wherein the information comprises the category of the item and one or more characteristics of the item.

11. A system comprising:

at least one hardware processor; and

a computer-readable storage device storing instructions which, when executed by the at least one hardware processor, cause the system to perform operations comprising:

receiving a first image of an item captured based at least in part on guidance to position the item within a bounded area of a user interface;

removing, by one or more processors, a portion of pixels in the first image of the item to generate a second image of the item, wherein the portion of pixels in the first image of the item are background pixels;

determining, by the one or more processors and from the second image of the item, a category of the item;

automatically selecting, by the one or more processors and based at least in part on the category of the item, a presentation layer from a plurality of presentation layers for presentation of the second image, wherein respective presentation layers of the plurality of presentation layers are associated with respective categories of items; and

causing presentation of the second image at the presentation layer of a network-based marketplace.

12. The system of claim 11 , the operations further comprising receiving user input associated with the presentation layer, wherein to cause presentation of the second image at the presentation layer of the network- based marketplace, the operations comprise updating one or more characteristics of the presentation layer based at least in part on the user input.

13. The system of claim 12 , wherein the one or more characteristics of the presentation layer include at least one of a style of the presentation layer or a color of the presentation layer.

14. The system of claim 11 , wherein to cause presentation of the second image at the presentation layer of the network-based marketplace, the operations comprise causing presentation of a virtual sale indicator at the presentation layer, wherein the virtual sale indicator includes a visual indicator associated with a price of the item.

15. The system of claim 11 , the operations further comprising:

receiving user input associated with a selection of the item via the presentation layer of the network-based marketplace; and

causing, in response to the user input, presentation of additional information associated with the item.

16. The system of claim 11 , the operations further comprising causing presentation of the guidance in real-time, wherein the guidance includes instructions associated with a first boundary and a second boundary that define the bounded area of the user interface, and wherein the first boundary corresponds to the background pixels and the second boundary corresponds to an additional portion of pixels in the first image of the item that are foreground pixels.

17. The system of claim 11 , the operations further comprising causing presentation of the guidance in real-time, wherein the guidance includes instructions associated with at least one of an environment of the item or a position of an additional item in the first image.

18. A non-transitory computer-readable medium storing instructions which, when executed by at least one hardware processor, cause a system to perform operations comprising:

receiving a first image of an item captured based at least in part on guidance to position the item within a bounded area of a user interface;

removing, by one or more processors, a portion of pixels in the first image of the item to generate a second image of the item, wherein the portion of pixels in the first image of the item are background pixels;

determining, by the one or more processors and from the second image of the item, a category of the item;

automatically selecting, by the one or more processors and based at least in part on the category of the item, a presentation layer from a plurality of presentation layers for presentation of the second image, wherein respective presentation layers of the plurality of presentation layers are associated with respective categories of items; and

causing presentation of the second image at the presentation layer of a network-based marketplace.

19. The non-transitory computer-readable medium of claim 18 , the operations further comprising receiving user input associated with the presentation layer, wherein to cause presentation of the second image at the presentation layer of the network-based marketplace, the operations comprise updating one or more characteristics of the presentation layer based at least in part on the user input.

20. The non-transitory computer-readable medium of claim 18 , wherein to cause presentation of the second image at the presentation layer of the network-based marketplace, the operations comprise causing presentation of a virtual sale indicator at the presentation layer, wherein the virtual sale indicator includes a visual indicator associated with a price of the item.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2024
From: PIRAMUTHU, ROBINSON; ZHENG, WEN
To: EBAY INC.
Reel/Frame 066819/0378 →
Continuity (6)
Continuation 17675086 · Feb 18, 2022
Continuation 16985670 · Aug 5, 2020
Continuation 16363158 · Mar 25, 2019
Continuation 15361973 · Nov 28, 2016
Provisional Application 62263433 · Dec 4, 2015
Related Publication 20240221108A1 · Jul 4, 2024
References Cited (91)
US 5923380A · Yang et al. · 1999 [cited by applicant]
US 5978519A · Bollman et al. · 1999 [cited by applicant]
US 7702540B1 · Woolston · 2010 [cited by examiner]
US 8358691B1 · Wang et al. · 2013 [cited by applicant]
US 8521609B2 · Lewis · 2013 [cited by examiner]
US 9547799B2 · Chen et al. · 2017 [cited by applicant]
US 9807316B2 · Jen et al. · 2017 [cited by applicant]
US 10270965B2 · Piramuthu et al. · 2019 [cited by applicant]
US 10771685B2 · Piramuthu et al. · 2020 [cited by applicant]
US 11258894B2 · Huang · 2022 [cited by applicant]
US 11258944B2 · Piramuthu et al. · 2022 [cited by applicant]
US 11704706B2 · Nandiraju · 2023 [cited by applicant]
US 11966995B2 · Piramuthu · 2024 [cited by examiner]
US 11978106B2 · Jain · 2024 [cited by examiner]
US 20040100572A1 · Kim · 2004 [cited by applicant]
US 20060285747A1 · Blake et al. · 2006 [cited by applicant]
US 20080082426A1 · Gokturk et al. · 2008 [cited by applicant]
US 20090248742A1 · Krishnamurthy et al. · 2009 [cited by applicant]
US 20090290795A1 · Criminisi et al. · 2009 [cited by applicant]
US 20110038536A1 · Gong · 2011 [cited by applicant]
US 20110264549A1 · Lewis et al. · 2011 [cited by applicant]
US 20120075440A1 · Ahuja et al. · 2012 [cited by applicant]
US 20120093362A1 · Liu et al. · 2012 [cited by applicant]
US 20120327172A1 · El-Savan et al. · 2012 [cited by applicant]
US 20130038759A1 · Jo et al. · 2013 [cited by applicant]
US 20130121593A1 · Wang et al. · 2013 [cited by applicant]
US 20130258117A1 · Penov et al. · 2013 [cited by applicant]
US 20130336523A1 · Ruan · 2013 [cited by applicant]
US 20140226052A1 · Kang et al. · 2014 [cited by applicant]
US 20150058150A1 · Gura et al. · 2015 [cited by applicant]
US 20150098648A1 · Ishii · 2015 [cited by applicant]
US 20150110391A1 · Zhou et al. · 2015 [cited by applicant]
US 20150110392A1 · Wang · 2015 [cited by applicant]
US 20150235374A1 · Wang · 2015 [cited by applicant]
US 20150254855A1 · Patankar et al. · 2015 [cited by applicant]
US 20150254868A1 · Srikanth et al. · 2015 [cited by applicant]
US 20160034944A1 · Raab et al. · 2016 [cited by applicant]
US 20160217328A1 · Yanai · 2016 [cited by examiner]
US 20160335681A1 · Swanson · 2016 [cited by applicant]
US 20160335789A1 · Zhang et al. · 2016 [cited by applicant]
US 20170046764A1 · Konik · 2017 [cited by examiner]
US 20170083762A1 · Segalovitz et al. · 2017 [cited by applicant]
US 20170111574A1 · Miyashita · 2017 [cited by applicant]
US 20170116667A1 · High et al. · 2017 [cited by applicant]
US 20170163882A1 · Piramuthu et al. · 2017 [cited by applicant]
US 20170223261A1 · Shimizu et al. · 2017 [cited by applicant]
US 20190005649A1 · Gering et al. · 2019 [cited by applicant]
US 20190289199A1 · Piramuthu et al. · 2019 [cited by applicant]
US 20200366834A1 · Piramuthu et al. · 2020 [cited by applicant]
US 20220239829A1 · Piramuthu et al. · 2022 [cited by applicant]
CN 102090080 · 2011 [cited by applicant]
CN 102708370 · 2012 [cited by applicant]
CN 108292425 · 2018 [cited by applicant]
KR 1020090130003 · 2009 [cited by applicant]
KR 1020130017440 · 2013 [cited by applicant]
KR 1020150058733 · 2015 [cited by applicant]
KR 1020180089494 · 2018 [cited by applicant]
KR 1020200021555 · 2022 [cited by applicant]
WO 2012144957A1 · 2012 [cited by applicant]
WO WO2013063299 · 2013 [cited by applicant]
WO WO2015044947 · 2015 [cited by applicant]
WO WO2017095834 · 2017 [cited by applicant]
10-2018-7019034, , “Notice Of Allowance received for Korean Patent Application No. 10-2018-7019034, mailed on Nov. 20, 2019”, Nov. 20, 2019, 3 pages. [cited by applicant]
10-2018-7019034, , “Office Action Received for Korean Patent Application No. 10-2018-7019034, mailed on Sep. 3, 2019”, Sep. 3, 2019, 6 pages. [cited by applicant]
10-2020-7005017, , “Notice Of Allowance received for Korean Patent Application No. 10-2020-7005017, mailed on Apr. 22, 2020”, Apr. 22, 2020, 3 pages. [cited by applicant]
U.S. Appl. No. 15/361,973, , ““First Action Interview—Office Action Summary received for U.S. Appl. No. 15/361,973 , mailed on Jul. 30, 2018””, Jul. 30, 2018, 7 pages. [cited by applicant]
U.S. Appl. No. 15/361,973, , “First Action Pre-Interview Communication Received for U.S. Appl. No. 15/361,973 mailed on May 14, 2018”, May 14, 2014, 6 pages. [cited by applicant]
U.S. Appl. No. 15/361,973, , “Notice of Allowance received for U.S. Appl. No. 15/361,973, mailed on Dec. 10, 2018”, Dec. 10, 2018, 11 pages. [cited by applicant]
U.S. Appl. No. 16/363,158, , “Non Final Office Action Received for U.S. Appl. No. 16/363,158, mailed on Dec. 20, 2019”, Dec. 20, 2019, 30 pages. [cited by applicant]
U.S. Appl. No. 16/363,158, , “Notice Of Allowance received for U.S. Appl. No. 16/363,158, mailed on May 6, 2020”, May 6, 2020, 11 pages. [cited by applicant]
U.S. Appl. No. 16/985,670, , ““Notice Of Allowance received for U.S. Appl. No. 16/985,670, mailed on Oct. 19, 2021””, Oct. 19, 2021, 11 pages. [cited by applicant]
U.S. Appl. No. 16/985,670, , “Corrected Notice of Allowability Received for U.S. Appl. No. 16/985,670, mailed on Jan. 26, 2022”, Jan. 26, 2022, 2 pages. [cited by applicant]
U.S. Appl. No. 16/985,670, , “Corrected Notice of Allowability Received for U.S. Appl. No. 16/985,670, mailed on Nov. 18, 2021”, Nov. 18, 2021, 2 pages. [cited by applicant]
U.S. Appl. No. 16/985,670, , “Non Final Office Action Received for U.S. Appl. No. 16/985,670, mailed on May 24, 2021”, May 24, 2021, 29 pages. [cited by applicant]
U.S. Appl. No. 17/675,086, , “Final Office Action”, U.S. Appl. No. 17/675,086, filed Oct. 18, 2023, 44 pages. [cited by applicant]
U.S. Appl. No. 17/675,086, , “Final Office Action Received for U.S. Appl. No. 17/675,086, Mailed on May 2, 2023”, May 2, 2023, 36 pages. [cited by applicant]
U.S. Appl. No. 17/675,086, , “Non-Final Office Action”, U.S. Appl. No. 17/675,086, filed Jul. 12, 2023, 40 pages. [cited by applicant]
U.S. Appl. No. 17/675,086, , “Non-Final Office Action Received for U.S. Appl. No. 17/675,086, mailed on Oct. 27, 2022”, Oct. 27, 2022, 33 pages. [cited by applicant]
U.S. Appl. No. 17/675,086, filed Jan. 16, 2024, , “Notice of Allowance”, U.S. Appl. No. 17/675,086, filed Jan. 16, 2024, 10 pages. [cited by applicant]
201680070578.1, , ““Notice of Decision to Grant Received for Chinese Patent Application No. 201680070578.1, mailed on Jun. 6, 2022””, Jun. 6, 2022, 4 pages. [cited by applicant]
201680070578.1, , ““Office Action received for Chinese Patent Application No. 201680070578.1 mailed on Feb. 3, 2021””, Feb. 3, 2021, 13 pages. [cited by applicant]
201680070578.1, , “Office Action Received for Chinese Patent Application No. 201680070578.1, mailed on Aug. 4, 2021”, Aug. 4, 2021, 14 pages. [cited by applicant]
201680070578.1, , “Office Action received for Chinese Patent Application No. 201680070578.1 mailed on Dec. 30, 2021”, Dec. 30, 2021, 20 pages. [cited by applicant]
202210844364.2, , “Foreign Office Action”, CN Application 202210844364.2, 11 pages. [cited by applicant]
Bai, et al., “A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting”, IEEE, 2007, 8 pages. [cited by applicant]
PCT/US2016/064057, , “International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2016/064057, mailed on Jun. 14, 2018, 7 pages.”, Jun. 14, 2018, 7 pages. [cited by applicant]
PCT/US2016/064057, , “International Search Report received for PCT Application No. PCT/US2016/064057 mailed on Mar. 9, 2017”, Mar. 9, 2017, 4 pages. [cited by applicant]
PCT/US2016/064057, , “International Written Opinion received for PCT Application No. PCT/US2016/064057 mailed on Mar. 9, 2017”, Mar. 9, 2017, 5 pages. [cited by applicant]
Rawls, , “Mobile marketing: How mobile technology is revolutionizing marketing, communications and advertising”, Kogan Page Publishers, Jan. 2015, 10 pages. [cited by applicant]
“Foreign Notice of Allowance”, CN Application No. 202210844364.2, Feb. 11, 2025, 7 pages. [cited by applicant]
“Foreign Office Action”, CN Application No. 202210844364.2, Nov. 30, 2024, 12 pages. [cited by applicant]