IP Library Granted Patent US 10,949,667
Granted Patent B2
US 10,949,667 · App. 15/858,463 · Granted Mar 16, 2021

Camera platform and object inventory control

Inventors: Shuai Zheng (Berkeley, CA); Fan Yang (San Jose, CA); Mohammadhadi Kiapour (San Francisco, CA); Qiaosong Wang (San Jose, CA); Japjit S. Tulsi (Los Altos Hills, CA); Robinson Piramuthu (Oakland, CA)
Assignee: eBay Inc.
G06K9/00671G06K9/6256G06K9/66G06K9/78G06N20/00G06Q30/0623G06Q30/08G06T7/60G06T11/60H04N5/23293H04N7/185G06F3/04842G06K9/628G06Q30/0631G06Q30/0643G06T2210/16H04N5/23218H04N5/232933
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,949,667
App. No.
15/858,463
Granted
Mar 16, 2021
Kind
B2
Abstract

Camera platform and object inventory control techniques are described. In an implementation a live feed of digital images is output in a user interface by a computing device. A user selection is received through interaction with the user interface of at least one of the digital images. An object, included within the at least one digital image, is recognized using machine learning. Metadata is then obtained that pertains to the recognized object. Augmented reality digital content is generated based at least in part of the obtained metadata. The augmented reality digital content is displayed as part of the live feed of digital images as associated with the object.

Claims (40)

1. A system comprising:

a camera platform manager module implemented at least partially in hardware of at least one computing device to:

output a live feed of digital images in a user interface; and

receive a user selection, via the user interface, of an object included in at least one digital image of the live feed of digital images;

an object recognition module implemented at least partially in hardware of the at least one computing device to recognize the object responsive to the user selection;

an object data collection module implemented at least partially in hardware of the at least one computing device to obtain metadata pertaining to the recognized object, the metadata including a price to sell the recognized object;

an augmented reality configuration module implemented at least partially in hardware of the at least one computing device to generate augmented reality digital content based at least in part on the obtained metadata; and

an augmented reality rendering module implemented at least partially in hardware of the at least one computing device to display the augmented reality digital content in real time in the user interface as part of the live feed, the displayed augmented reality digital content including a first visual representation of the price to sell the recognized object and a second visual representation of an additional price to sell at least one additional recognized object in an inventory of recognized objects, the displayed augmented reality digital content further including a third visual representation of an overall current value of the price to sell the recognized objects.

2. The system as described in claim 1 , wherein the price to sell the recognized object is obtained from a service provider system.

3. The system as described in claim 2 , wherein the price to sell the recognized object is based on a plurality of online auctions involving similar objects.

4. The system as described in claim 1 , wherein the metadata includes information describing a characteristic of the recognized object.

5. The system as described in claim 1 , wherein the metadata includes information describing replacement of a part of the recognized object.

6. The system as described in claim 1 , wherein the augmented reality digital content further includes an additional visual representation of a purchase price to purchase another instance of the recognized object.

7. The system as described in claim 1 , wherein the augmented reality digital content is displayed concurrently with and proximal to the recognized object within the live feed of digital images.

8. A method implemented by a computing device, the method comprising:

outputting, by the computing device, a live feed of digital images in a user interface;

receiving, by the computing device, a user selection of at least one digital image of the live feed of digital images;

recognizing, by the computing device, responsive to the user selection, an object included within the at least one digital image;

obtaining, by the computing device, metadata that includes a price to sell the recognized object;

generating, by the computing device, augmented reality digital content based at least in part on the obtained metadata; and

displaying, by the computing device, the augmented reality digital content in the live feed of the user interface, the displayed augmented reality digital content including a first visual representation of the price to sell the recognized object and a second visual representation of an additional price to sell at least one additional recognized object in an inventory of recognized objects, the displayed augmented reality digital content further including a third visual representation of an overall current value of the price to sell the recognized objects.

9. The method as described in claim 8 , wherein the price to sell the recognized object is obtained from a service provider system.

10. The method as described in claim 8 , wherein the metadata includes information describing a characteristic of the recognized object.

11. The method as described in claim 8 , wherein the metadata includes information describing replacement of a part of the recognized object.

12. The method as described in claim 8 , wherein the augmented reality digital content is displayed concurrently with and proximal to the recognized object within the live feed of digital images.

13. The method as described in claim 8 , wherein the augmented reality content is output as part of the live feed of digital images as associated with the recognized object.

14. A system comprising:

a camera platform manager module implemented at least partially in hardware of at least one computing device to:

output a live feed of digital images in a user interface; and

receive a user selection, via the user interface, of an object included in at least one digital image of the live feed of digital images;

an object recognition module implemented at least partially in hardware of the at least one computing device to recognize the object responsive to the user selection;

an object data collection module implemented at least partially in hardware of the at least one computing device to obtain metadata that describes a replacement part of the recognized object, the metadata including a price to sell the recognized object;

an augmented reality configuration module implemented at least partially in hardware of the at least one computing device to generate augmented reality digital content based at least in part on the obtained metadata; and

an augmented reality rendering module implemented at least partially in hardware of the at least one computing device to display the augmented reality digital content in real time in the user interface as part of the live feed, the displayed augmented reality digital content including a first visual representation of the price to sell the recognized object and a second visual representation of an additional price to sell at least one additional recognized object in an inventory of recognized objects, the displayed augmented reality digital content further including a third visual representation of an overall current value of the price to sell the recognized objects.

15. The system as described in claim 14 , wherein the augmented reality digital content is displayed concurrently with and proximal to the recognized object within the live feed of digital images.

16. The system as described in claim 1 , wherein the object recognition module recognizes the object using machine learning.

17. The system as described in claim 1 , wherein the displayed augmented reality digital content further includes a fourth visual representation of a change in the overall current value of the price to sell the recognized objects.

18. The system as described in claim 1 , wherein the user selection comprises a gesture, a spoken utterance, a click-and-drag operation, or a tap of a finger.

19. The system as described in claim 14 , wherein the displayed augmented reality digital content further includes a fourth visual representation of a change in the overall current value of the price to sell the recognized objects.

20. The system as described in claim 14 , wherein the user selection comprises a gesture, a spoken utterance, a click-and-drag operation, or a tap of a finger.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2017
From: ZHENG, SHUAI; YANG, FAN; KIAPOUR, MOHAMMADHADI; WANG, QIAOSONG; TULSI, JAPJIT S.; PIRAMUTHU, ROBINSON
To: EBAY INC.
Reel/Frame 044507/0191 →
Continuity (2)
Provisional Application 62558836 · Sep 14, 2017
Related Publication 20190080171A1 · Mar 14, 2019
Cited By (1)
US 12,598,273