IP Library › Granted Patent US 12,481,419
Granted Patent B2
US 12,481,419 · App. 18/476,238 · Granted Nov 25, 2025

Analyzing and linking a set of images by identifying objects in each image to determine a primary image and a secondary image

Inventors: Nithya Chellam (Bengaluru, IN); Rahul Kyamaji (Bengaluru, IN); Sruthi Madapoosi Ravi (Chennai, IN); Krithika Sairam (Coimbatore, IN); Pranav Shekhar Jha (Bengaluru, IN)
Assignee: eBay Inc.
G06F3/04842G06F3/0482G06F3/0485G06F40/134G06Q30/0601G06F3/14G06F2203/04806
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,481,419
App. No.
18/476,238
Granted
Nov 25, 2025
Kind
B2
Abstract

A set of images is accessed from a server. The set is analyzed to identify objects in each image using object recognition algorithms. A primary image that includes more of the identified objects than any of the other images of the set is determined. For each of the identified objects in the primary image, a secondary image that includes the identified object and has a higher magnification than the primary image is determined. Links are inserted into the primary image at locations including an identified object that is also in a secondary image. The primary image is displayed and, upon receiving a selection of one of the links, the secondary image that includes the identified object at the location of the selected link is displayed. The set of images is ordered based on relative positions of the identified objects in each image and then linked together based on the ordering.

Claims (40)

1 . A method comprising:

obtaining, by at least one computing device, a plurality of uploaded images uploaded for association with an item;

determining, by the at least one computing device, a primary image of the item from the plurality of uploaded images;

determining, by the at least one computing device, that the plurality of uploaded images excludes an image with a higher magnification view of an assembly associated with the item than the primary image based on object recognition performed across the plurality of uploaded images to identify the assembly and by determining a relative magnification of the assembly in images in which the assembly is identified;

identifying, by the at least one computing device and from a database of images, a new image having the higher magnification view of the assembly than the primary image; and

inserting, by the at least one computing device and into the primary image, a link to the new image.

2 . The method of claim 1 , further comprising responsive to selection of the link to the new image, causing display of the new image.

3 . The method of claim 1 , wherein the link to the new image is inserted at a location of the assembly in the primary image.

4 . The method of claim 1 , wherein the new image is zoomed in on the assembly relative to the primary image.

5 . The method of claim 1 , further comprising saving a flag with the primary image and the new image, the flag indicating to publish the primary image and the new image together with linking information that describes a relationship between the primary image and the new image.

6 . The method of claim 1 , further comprising causing display of the primary image as an initial image when a corresponding set of published electronic images is selected for viewing, and responsive to selection of the link, causing display of the new image.

7 . The method of claim 1 , wherein the link to the new image is highlighted in the primary image.

8 . The method of claim 1 , further comprising causing the assembly to be highlighted in the primary image responsive to detecting hovering over a location of the assembly in the primary image.

9 . The method of claim 1 , wherein the link is integrated into an edge of the primary image.

10 . The method of claim 9 , wherein the link is integrated into a right side edge of the primary image.

11 . The method of claim 9 , wherein the link is integrated into a left side edge of the primary image.

12 . The method of claim 9 , wherein the link is included in a plurality of links integrated into the edge of the primary image, and the plurality of links are operable to cycle through a corresponding set of published electronic images in a pre-arranged order.

13 . The method of claim 1 , further comprising:

determining that the plurality of uploaded images excludes an image with a higher magnification view of an additional assembly than the primary image;

identifying, from the database of images, an additional new image having the higher magnification view of the additional assembly than the primary image; and

inserting, into the primary image, a link to the additional new image.

14 . The method of claim 1 , further comprising identifying the assembly associated with the item in the primary image of the item.

15 . The method of claim 1 , further comprising determining whether the relative magnification of the assembly provides the higher magnification view of the assembly than the primary image.

16 . A system comprising:

hardware processing circuitry; and

one or more hardware memories storing instructions that when executed configure the hardware processing circuitry to perform operations including:

obtaining a plurality of uploaded images uploaded for association with an item;

determining a primary image of the item from the plurality of uploaded images;

determining that the plurality of uploaded images excludes an image with a higher magnification view of an assembly associated with the item than the primary image based on object recognition performed across the plurality of uploaded images to identify the assembly and by determining a relative magnification of the assembly in images in which the assembly is identified;

identifying, from a database of images, a new image having the higher magnification view of the assembly than the primary image; and

inserting, into the primary image, a link to the new image.

17 . The system of claim 16 , wherein the operations further include causing display of the primary image as an initial image when a corresponding set of published electronic images is selected for viewing, and responsive to selection of the link causing display of the new image.

18 . The system of claim 16 , wherein the operations further include causing the assembly to be highlighted in the primary image responsive to detecting a user hovering over a location of the assembly in the primary image.

19 . The system of claim 16 , wherein the link is included in a plurality of links integrated into an edge of the primary image, and the plurality of links are operable to cycle through a corresponding set of published electronic images in a pre-arranged order.

20 . A non-transitory computer readable storage medium having instructions that when executed configure hardware processing circuitry to perform operations including:

obtaining a plurality of uploaded images uploaded for association with an item;

determining a primary image of the item from the plurality of uploaded images;

determining that the plurality of uploaded images excludes an image with a higher magnification view of an assembly associated with the item than the primary image based on object recognition performed across the plurality of uploaded images to identify the assembly and by determining a relative magnification of the assembly in images in which the assembly is identified;

identifying, from a database of images, a new image having the higher magnification view of the assembly than the primary image; and

inserting, into the primary image, a link to the new image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2023
From: CHELLAM, NITHYA; KYAMAJI, RAHUL; RAVI, SRUTHI MADAPOOSI; SAIRAM, KRITHIKA; JHA, PRANAV SHEKHAR
To: EBAY INC.
Reel/Frame 065078/0513 →
Continuity (3)
Continuation 16509170 · Jul 11, 2019
Continuation 15088586 · Apr 1, 2016
Related Publication 20240061563A1 · Feb 22, 2024
References Cited (95)
US 7023475B2 · Bean et al. · 2006 [cited by applicant]
US 7216295B2 · Wu · 2007 [cited by applicant]
US 7716157B1 · Bourdev et al. · 2010 [cited by applicant]
US 7990394B2 · Vincent et al. · 2011 [cited by applicant]
US 8121902B1 · Desjardins · 2012 [cited by examiner]
US 8254504B2 · Webster et al. · 2012 [cited by applicant]
US 8487957B1 · Bailly et al. · 2013 [cited by applicant]
US 8515159B2 · Snavely et al. · 2013 [cited by applicant]
US 8542245B2 · Kondo et al. · 2013 [cited by applicant]
US 9171195B1 · Rybakov et al. · 2015 [cited by applicant]
US 9204090B2 · Kim · 2015 [cited by applicant]
US 10366144B2 · Chellam et al. · 2019 [cited by applicant]
US 10475160B1 · Conroy et al. · 2019 [cited by applicant]
US 11809692B2 · Chellam et al. · 2023 [cited by applicant]
US 20020075311A1 · Orbanes et al. · 2002 [cited by applicant]
US 20030103063A1 · Mojaver et al. · 2003 [cited by applicant]
US 20040015778A1 · Britton et al. · 2004 [cited by applicant]
US 20040169684A1 · Orth et al. · 2004 [cited by applicant]
US 20060150099A1 · Laff et al. · 2006 [cited by applicant]
US 20080069480A1 · Aarabi · 2008 [cited by examiner]
US 20080089590A1 · Isomura et al. · 2008 [cited by applicant]
US 20080267451A1 · Karazi · 2008 [cited by applicant]
US 20080288855A1 · Issler et al. · 2008 [cited by applicant]
US 20090148045A1 · Lee et al. · 2009 [cited by applicant]
US 20100211602A1 · Menon et al. · 2010 [cited by applicant]
US 20100295971A1 · Zhu · 2010 [cited by applicant]
US 20110091065A1 · Chandrashekar et al. · 2011 [cited by applicant]
US 20110105194A1 · Wang et al. · 2011 [cited by applicant]
US 20110126138A1 · Kawai · 2011 [cited by applicant]
US 20110228120A1 · Inoue et al. · 2011 [cited by applicant]
US 20110251903A1 · Ryu et al. · 2011 [cited by applicant]
US 20120002868A1 · Loui et al. · 2012 [cited by applicant]
US 20120019545A1 · Nonaka · 2012 [cited by applicant]
US 20120110453A1 · Ma · 2012 [cited by examiner]
US 20120151398A1 · Foy et al. · 2012 [cited by applicant]
US 20120192235A1 · Tapley · 2012 [cited by examiner]
US 20120281913A1 · Kutaragi et al. · 2012 [cited by applicant]
US 20130022291A1 · Sumi · 2013 [cited by applicant]
US 20130265467A1 · Matsuzawa et al. · 2013 [cited by applicant]
US 20130282466A1 · Hampton · 2013 [cited by applicant]
US 20130311329A1 · Knudson · 2013 [cited by examiner]
US 20140052549A1 · Dollens · 2014 [cited by applicant]
US 20140180758A1 · Agarwal et al. · 2014 [cited by applicant]
US 20140225925A1 · Hayashi et al. · 2014 [cited by applicant]
US 20140279982A1 · Eames · 2014 [cited by examiner]
US 20150120719A1 · Aarabi · 2015 [cited by examiner]
US 20150169177A1 · Zhao et al. · 2015 [cited by applicant]
US 20150199385A1 · Choi et al. · 2015 [cited by applicant]
US 20150373414A1 · Kinoshita · 2015 [cited by applicant]
US 20160070438A1 · Kim et al. · 2016 [cited by applicant]
US 20160110902A1 · Chirakansakcharoen et al. · 2016 [cited by applicant]
US 20170091584A1 · Bhat et al. · 2017 [cited by applicant]
US 20170286372A1 · Chellam et al. · 2017 [cited by applicant]
US 20200081959A1 · Chellam et al. · 2020 [cited by applicant]
CN 101164083 · 2008 [cited by applicant]
CN 101753913 · 2010 [cited by applicant]
CN 102017661 · 2011 [cited by applicant]
CN 102222079 · 2011 [cited by applicant]
CN 102640098 · 2012 [cited by applicant]
CN 102668585 · 2012 [cited by applicant]
CN 102812452 · 2012 [cited by applicant]
CN 103733177 · 2014 [cited by applicant]
CN 103827924 · 2014 [cited by applicant]
CN 104919452 · 2015 [cited by applicant]
CN 105005982 · 2015 [cited by applicant]
CN 105045793 · 2015 [cited by applicant]
CN 105339953 · 2016 [cited by applicant]
CN 108885702 · 2018 [cited by applicant]
JP 2011244343 · 2011 [cited by applicant]
KR 20060053763 · 2006 [cited by applicant]
KR 20120134560 · 2012 [cited by applicant]
KR 101320014 · 2013 [cited by applicant]
WO WO2017172905 · 2017 [cited by applicant]
Ohba et al. (Ohba), “Image data creation support device and method thereof”, published on Dec. 9, 2012, Document ID: CN-102668585-A, pp. 18 (Year: 2012). [cited by examiner]
“Google Street View”, Google [retrieved 2023-07-11]. Retrieved from the Internet <https://ggstreetview.com/>., 2 Pages. [cited by applicant]
10-2018-7031708, , “Notice of Allowance received for Korean Patent Application No. 10-2018-7031708, mailed on Oct. 26, 2020”, Oct. 26, 2020, 4 pages. [cited by applicant]
10-2018-7031708, , “Office Action Received for Korean Patent Application No. 10-2018-7031708, mailed on Apr. 9, 2020”, Apr. 9, 2020, 13 pages. [cited by applicant]
U.S. Appl. No. 15/088,586, , “Applicant Initialed Interview Summary received for U.S. Appl. No. 15/088,586”, Aug. 21, 2017, 4 Pages. [cited by applicant]
U.S. Appl. No. 15/088,586, , “First Action Interview - Office Action Summary received for U.S. Appl. No. 15/088,586”, Jun. 16, 2017, 2 Pages. [cited by applicant]
U.S. Appl. No. 15/088,586, , “Notice of Allowance received for U.S. Appl. No. 15/088,586, mailed on Jul. 6, 2018”, Jul. 6, 2018, 8 Pages. [cited by applicant]
U.S. Appl. No. 15/088,586, , “Notice of Allowance received for U.S. Appl. No. 15/088,586, mailed on Mar. 20, 2019”, Mar. 20, 2019, 7 Pages. [cited by applicant]
U.S. Appl. No. 15/088,586, , “Office Action-First Interview Summary received for U.S. Appl. No. 15/088,586, mailed on Nov. 2, 2017”, Nov. 2, 2017, 10 Pages. [cited by applicant]
U.S. Appl. No. 15/088,586, , “Supplemental Notice of Allowance received for U.S. Appl. No. 15/088,586, mailed on Jul. 19, 2018”, Jul. 19, 2018, 5 Pages. [cited by applicant]
U.S. Appl. No. 16/509,170, , “Final Office Action Received for U.S. Appl. No. 16/509,170, mailed on Feb. 12, 2021”, Feb. 12, 2021, 34 pages. [cited by applicant]
U.S. Appl. No. 16/509,170, , “Final Office Action Received for U.S. Appl. No. 16/509,170, mailed on Oct. 17, 2022”, Oct. 17, 2022, 22 pages. [cited by applicant]
U.S. Appl. No. 16/509,170, , “Non Final Office Action Received for U.S. Appl. No. 16/509,170, mailed on Jul. 9, 2020”, Jul. 9, 2020, 43 pages. [cited by applicant]
U.S. Appl. No. 16/509,170, , “Non Final Office Action Received for U.S. Appl. No. 16/509,170, mailed on Mar. 17, 2022”, Mar. 17, 2022, 23 pages. [cited by applicant]
U.S. Appl. No. 16/509,170, , “Notice of Allowance”, U.S. Appl. No. 16/509,170, filed May 16, 2023, 7 pages. [cited by applicant]
17776542.7, , “Communication Pursuant to Article 94(3) EPC received for European Patent Application No. 17776542.7”, 8 Pages, Feb. 22, 2021. [cited by applicant]
17776542.7, , “Extended European Search Report received for European Patent Application No. 17776542.7”, Nov. 5, 2019, 8 Pages. [cited by applicant]
201780021254.3, , “Notice of decision to grant received for Chinese Patent Application No. 201780021254.3, mailed on Nov. 21, 2022”, Nov. 21, 2022, 4 Pages. [cited by applicant]
201780021254.3, , “Office Action received for Chinese Patent Application No. 201780021254.3, mailed on Aug. 19, 2022”, Aug. 19, 2022, 7 Pages. [cited by applicant]
PCT/US17/24734, , “International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2017/024734, mailed on Oct. 11, 2018”, Oct. 11, 2018, 7 pages. [cited by applicant]
PCT/US2017/024734, , “International Search Report received for PCT Application No. PCT/US2017/024734, mailed on Jun. 19, 2017”, Jun. 19, 2017, 2 pages. [cited by applicant]
PCT/US2017/024734, , “International Written Opinion received for PCT Application No. PCT/US2017/024734, mailed on Jun. 19, 2017”, Jun. 19, 2017, 5 pages. [cited by applicant]