IP Library › Granted Patent US 12,367,590
Granted Patent B2
US 12,367,590 · App. 18/488,131 · Granted Jul 22, 2025

Physical object boundary detection techniques and systems

Inventors: Patrick Ryan Nelson (San Carlos, CA); Jinrong Xie (San Jose, CA); Randall Chall Fry (Portland, OR)
Assignee: eBay Inc.
G06T7/13G06Q10/08345G06T7/70G06T19/006G06T2207/10028G06T2207/20024G06T2207/20092G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,590
App. No.
18/488,131
Granted
Jul 22, 2025
Kind
B2
Abstract

Physical object boundary detection techniques and systems are described. In one example, an augmented reality module generates three dimensional point cloud data. This data describes depths at respective points within a physical environment that includes the physical object. A physical object boundary detection module is then employed to filter the point cloud data by removing points that correspond to a ground plane. The module then performs a nearest neighbor search to locate a subset of the points within the filtered point cloud data that correspond to the physical object. Based on this subset, the module projects the subset of points onto the ground plane to generate a two-dimensional boundary. The two-dimensional boundary is then extruded based on a height determined from a point having a maximum distance from the ground plane from the filtered cloud point data.

Claims (35)

1. A method implemented by at least one computing device, the method comprising:

generating, by the at least one computing device, point cloud data defining depths at respective points for a physical object within a physical environment;

generating, by the at least one computing device, a three-dimensional boundary of the physical object based on the point cloud data;

generating, by the at least one computing device, digital content based on the three-dimensional boundary generated; and

displaying, by the at least one computing device, the digital content.

2. The method as described in claim 1 , wherein the displaying of the digital content is via a user interface, in which the user interface includes a display of a digital image of the physical environment as part of a live camera feed that includes the physical object within the physical environment.

3. The method as described in claim 1 , wherein the digital content is a webpage.

4. The method as described in claim 1 , wherein the digital content includes one or more digital images.

5. The method as described in claim 1 , wherein the digital content includes the three-dimensional boundary generated.

6. The method as described in claim 1 further comprising:

receiving, by the at least one computing device, digital images corresponding to the physical environment including the physical object, and wherein the generating of the point cloud data is based at least in part on the digital images corresponding to the physical environment including the physical object.

7. The method as described in claim 1 , further comprising generating, by the at least one computing device, shipping data for the physical object as part of the generating of the digital content, and wherein the digital content includes the shipping data.

8. The method as described in claim 7 , wherein the shipping data includes an amount of packing to be used in packaging the physical object.

9. The method as described in claim 7 , wherein the shipping data includes an estimated cost of shipping the physical object.

10. The method as described in claim 7 , wherein the shipping data describes an estimated shipping cost based on dimensions of the three-dimensional boundary.

11. The method of claim 7 , wherein the digital content includes a listing of the physical object, in which the listing includes the shipping data generated.

12. A system comprising:

at least one hardware processor; and

a non-transitory computer-readable storage medium storing executable instructions that, when executed, cause the at least one hardware processor to perform operations comprising:

generating point cloud data defining depths at respective points for a physical object within a physical environment;

generating a three-dimensional boundary of the physical object based on the point cloud data;

generating digital content based on the three-dimensional boundary generated; and

displaying the digital content.

13. The system as described in claim 12 , wherein the digital content includes one or more digital images.

14. The system as described in claim 12 , further comprising generating shipping data for the physical object as part of the generating of the digital content, and wherein the digital content includes the shipping data.

15. The system as described in claim 12 , wherein the digital content includes a listing of the physical object.

16. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by at least one processor, causes the at least one processor to perform operations comprising:

generating point cloud data defining depths at respective points for a physical object within a physical environment;

generating a three-dimensional boundary of the physical object based on the point cloud data;

generating digital content based on the three-dimensional boundary generated; and

displaying the digital content.

17. The non-transitory computer-readable storage medium as described in claim 16 , further comprising generating shipping data for the physical object based on the three-dimensional boundary as part of the generating of the digital content, and wherein the digital content includes the shipping data.

18. The non-transitory computer-readable storage medium as described in claim 17 , wherein the shipping data includes an amount of packing to be used in packaging the physical object.

19. The non-transitory computer-readable storage medium as described in claim 17 , wherein the shipping data includes an estimated cost of shipping the physical object.

20. The non-transitory computer-readable storage medium as described in claim 16 , wherein the digital content includes a listing of the physical object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2023
From: NELSON, PATRICK RYAN; XIE, JINRONG; FRY, RANDALL CHALL
To: EBAY INC.
Reel/Frame 065247/0237 →
Continuity (4)
Continuation 18091928 · Dec 30, 2022
Continuation 17095589 · Nov 11, 2020
Continuation 15984140 · May 18, 2018
Related Publication 20240046481A1 · Feb 8, 2024
References Cited (73)
US 8872851B2 · Choubassi et al. · 2014 [cited by applicant]
US 9251399B2 · Hwang et al. · 2016 [cited by applicant]
US 9396554B2 · Williams et al. · 2016 [cited by applicant]
US 9595115B1 · Cederlof · 2017 [cited by applicant]
US 9600892B2 · Patel et al. · 2017 [cited by applicant]
US 9633483B1 · Xu et al. · 2017 [cited by applicant]
US 9870645B2 · Montaigne et al. · 2018 [cited by applicant]
US 10268892B1 · Miller et al. · 2019 [cited by applicant]
US 10370136B1 · Linnell et al. · 2019 [cited by applicant]
US 10467811B1 · Cederlof · 2019 [cited by applicant]
US 10853946B2 · Nelson et al. · 2020 [cited by applicant]
US 11562492B2 · Nelson et al. · 2023 [cited by applicant]
US 11830199B2 · Nelson et al. · 2023 [cited by applicant]
US 20040182925A1 · Anderson et al. · 2004 [cited by applicant]
US 20100066750A1 · Yu et al. · 2010 [cited by applicant]
US 20120022924A1 · Runnels et al. · 2012 [cited by applicant]
US 20130293532A1 · Vaddadi · 2013 [cited by examiner]
US 20130293539A1 · Hunt et al. · 2013 [cited by applicant]
US 20130321398A1 · Howard et al. · 2013 [cited by applicant]
US 20140192050A1 · Qiu et al. · 2014 [cited by applicant]
US 20150062120A1 · Reisner-Kollmann et al. · 2015 [cited by applicant]
US 20150086114A1 · Todeschini · 2015 [cited by applicant]
US 20150187067A1 · Bendall et al. · 2015 [cited by applicant]
US 20160025982A1 · Sutherland et al. · 2016 [cited by applicant]
US 20160027212A1 · Da Veiga et al. · 2016 [cited by applicant]
US 20160071318A1 · Lee et al. · 2016 [cited by applicant]
US 20160078663A1 · Sareen et al. · 2016 [cited by applicant]
US 20160133026A1 · Patel et al. · 2016 [cited by applicant]
US 20160171771A1 · Pedrotti et al. · 2016 [cited by applicant]
US 20170017301A1 · Doornenbal · 2017 [cited by examiner]
US 20170091957A1 · Driegen et al. · 2017 [cited by applicant]
US 20170302905A1 · Shteinfeld · 2017 [cited by examiner]
US 20180081995A1 · Ludwig et al. · 2018 [cited by applicant]
US 20180095276A1 · Ng-Thow-Hing · 2018 [cited by applicant]
US 20180181902A1 · Tu et al. · 2018 [cited by applicant]
US 20190122393A1 · Sinharoy et al. · 2019 [cited by applicant]
US 20190272674A1 · Comer et al. · 2019 [cited by applicant]
US 20190355121A1 · Nelson et al. · 2019 [cited by applicant]
US 20210065375A1 · Nelson et al. · 2021 [cited by applicant]
US 20230252642A1 · Nelson et al. · 2023 [cited by applicant]
CN 106225678 · 2016 [cited by applicant]
CN 107289855A · 2017 [cited by applicant]
CN 112166461B · 2024 [cited by applicant]
CN 119339022A · 2025 [cited by applicant]
EP 3232404 · 2017 [cited by applicant]
JP 2013196355 · 2013 [cited by applicant]
JP 2017191605 · 2017 [cited by applicant]
KR 20160048874 · 2016 [cited by applicant]
KR 20170142890A · 2017 [cited by applicant]
KR 20180046361 · 2018 [cited by applicant]
KR 102711186B1 · 2024 [cited by applicant]
WO WO2019222061 · 2019 [cited by applicant]
201980032813 , “Foreign Office Action”, CN Application 201980032813.X, Mar. 15, 2024, 26 pages. [cited by applicant]
10-2020-7030265, , “Foreign Office Action”, KR Application No. 10-2020-7030265, Aug. 4, 2022, 20 pages. [cited by applicant]
10-2020-7030265, , “Notice of Allowance”, KR Application No. 10-2020-7030265, Feb. 9, 2023, 8 pages. [cited by applicant]
10-2023-7015732, , “Foreign Office Action”, KR Application No. 10-2023-7015732, Jan. 2, 2024, 10 pages. [cited by applicant]
U.S. Appl. No. 15/984,140, , “Non-Final Office Action”, U.S. Appl. No. 15/984,140, Jan. 13, 2020, 27 pages. [cited by applicant]
U.S. Appl. No. 15/984,140, , “Notice of Allowance”, U.S. Appl. No. 15/984,140, Jul. 28, 2020, 8 pages. [cited by applicant]
U.S. Appl. No. 15/984,140, , “Response to Non-Final Office Action filed Apr. 13, 2020 for U.S. Appl. No. 15/984,140, mailed on Jan. 13, 2020”, Apr. 13, 2020, 13 Pages. [cited by applicant]
U.S. Appl. No. 17/095,589, , “Corrected Notice of Allowability”, U.S. Appl. No. 17/095,589, Nov. 23, 2022, 2 pages. [cited by applicant]
U.S. Appl. No. 17/095,589, , “Non-Final Office Action”, U.S. Appl. No. 17/095,589, Jun. 24, 2022, 29 pages. [cited by applicant]
U.S. Appl. No. 17/095,589, , “Non-final Office Action received for U.S. Appl. No. 17/095,589, mailed on Dec. 24, 2021”, Dec. 24, 2021, 25 Pages. [cited by applicant]
U.S. Appl. No. 17/095,589, , “Notice of Allowance”, U.S. Appl. No. 17/095,589, Oct. 13, 2022, 8 pages. [cited by applicant]
U.S. Appl. No. 18/091,928, , “Non-Final Office Action”, U.S. Appl. No. 18/091,928, Jun. 7, 2023, 7 pages. [cited by applicant]
19727562.1, , “Communication Pursuant to Article 94(3) EPC”, EP Application No. 19727562.1, Apr. 11, 2023, 6 pages. [cited by applicant]
Leo, Marco et al., “Robust Estimation of Object Dimensions and External Defect Detection with a Low-Cost Sensor”, Journal of Nondestructive Evaluation 36, Article No. 17 [retrieved May 2, 2023]. Retrieved from the Inter… [cited by applicant]
Leo, Marco et al., “Robust Estimation of Object Dimensions and External Defect Detection with a Low- Cost Sensor”, Journal of Nondestructive Evaluation, vol. 36 No. 17 [retrieved Aug. 10, 2022]. Retrieved from the Inter… [cited by applicant]
PCT/US2019/031842, , “International Preliminary Report on Patentability Received for Application No. PCT/US2019/031842, mailed on Dec. 3, 2020”, Dec. 3, 2020, 13 Pages. [cited by applicant]
PCT/US2019/031842, , “International Search Report and Written Opinion”, Application No. PCT/US2019/031842, Oct. 16, 2019, 19 pages. [cited by applicant]
PCT/US2019/031842, , “International Written Opinion Received for PCT Application No. PCT/US2019/031842, mailed on Oct. 16, 2019”, Oct. 16, 2019, 11 Pages. [cited by applicant]
PCT/US2019/031842, , “Invitation to Pay Additional Fees and, Where Applicable, Protest Fee Received for PCT Application No. 1PCT/US2019/031842, mailed on Aug. 21, 2019”, Aug. 21, 2019, 15 Pages. [cited by applicant]
“Foreign Decision to Grant”, KR Application No. 10-2023-7015732, Jul. 1, 2024, 7 pages. [cited by applicant]
Leo, et al., “Robust Estimation of Object Dimensions and External Defect Detection with a Low-Cost Sensor”, Journal of Nondestructive Evaluation, vol. 36, No. 1, Feb. 10, 2017, 16 pages. [cited by applicant]