IP Library › Granted Patent US 11,017,190
Granted Patent B1
US 11,017,190 · App. 17/031,880 · Granted May 25, 2021

Apparatus and method for locating a service object based on a label

Inventors: Chi Fai Ho (Palo Alto, CA); Augustine Junda Ho (Palo Alto, CA)
Assignee: TP Lab, Inc.
G06K7/10861B25J9/162B25J9/1679B25J9/1697
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,017,190
App. No.
17/031,880
Granted
May 25, 2021
Kind
B1
Abstract

A service rendering system locates a service object based on a label. A controller of the service rendering system receives an image captured by a camera coupled to the controller, processes the image to identify a label image in the image, identifies a label in the label image as corresponding to the service object, and obtains a service point location encoded in the label, where the service point location comprises a location relative to a location of the label. The controller calculates a label position of the label using the image of the label and calculates a service point position using the service point location and the label position.

Claims (72)

1. A method for locating a service object by a service rendering system, comprising:

(a) receiving, by a controller of the service rendering system, an image captured by a camera coupled to the controller;

(b) processing, by the controller, the image to identify a label image in the image;

(c) identifying, by the controller, a label in the label image as corresponding to the service object;

(d) obtaining, by the controller, a service point location encoded in the label, wherein the service point location comprises a location relative to a location of the label;

(e) calculating, by the controller, a label position of the label using the image of the label; and

(f) calculating, by the controller, a service point position using the service point location and the label position.

2. The method of claim 1 , further comprising:

(g) issuing, by the controller, instructions to move the service rendering system to the service object at the service point position.

3. The method of claim 2 , wherein the service rendering system comprises a mechanical arm, wherein the issuing (g) comprises:

(g1) issuing, by the controller, the instructions to move the mechanical arm to the service object at the service point position.

4. The method of claim 1 , wherein the label comprises controller readable code, the controller readable code comprising one or more of the following: a bar code; a Quick Response (QR) code; a 2-dimensional bar code; a 3-dimensional bar code; a pattern; a colored pattern; a black-and-white pattern; a colored blob; a sequence of one or more characters; a product code; and a serial number.

5. The method of 1 , wherein the service rendering system comprises a mechanical arm, wherein the method further comprises:

(g) obtaining, by the controller, a service request encoded in the label; and

(h) issuing, by the controller, instructions for the mechanical arm to render a service at the service point position according to the service request.

6. The method of claim 5 , wherein the issuing (h) comprises:

(h1) issuing, by the controller, the instructions for the mechanical arm to physically couple to the service object at the service point position.

7. The method of claim 6 , wherein the service object comprises a lock, wherein the issuing (h1) comprises:

(h1i) issuing, by the controller, the instructions for the mechanical arm to perform a lock operation on the lock according to the service request.

8. The method of claim 6 , wherein the service object comprises a physical item, wherein the issuing (h1) comprises:

(h1i) issuing, by the controller, the instructions for the mechanical arm to perform a physical item operation on the physical item according to the service request.

9. The method of claim 5 , wherein the mechanical arm comprises one or more sensors, wherein the issuing (h) comprises:

(h1) issuing, by the controller, the instructions for the mechanical arm to perform a sensor operation at the service point position using the one or more sensors.

10. A non-transitory computer readable medium comprising computer readable program code embodied therein for locating a service object by a service rendering system, wherein when executed by a processor of the service rendering system, causes the processor to:

(a) receive an image captured by a camera coupled to the processor;

(b) process the image to identify a label image in the image;

(c) identify a label in the label image as corresponding to the service object;

(d) obtain a service point location encoded in the label, wherein the service point location comprises a location relative to a location of the label;

(e) calculate a label position of the label using the image of the label; and

(f) calculate a service point position using the service point location and the label position.

11. The medium of claim 10 , wherein the processor is further caused to:

(g) issue instructions to move the service rendering system to the service object at the service point position.

12. The medium of claim 11 , wherein the service rendering system comprises a mechanical arm, wherein the issue (g) comprises:

(g1) issue the instructions to move the mechanical arm to the service object at the service point position.

13. The medium of claim 10 , wherein the label comprises processor readable code, the processor readable code comprising one or more of the following: a bar code; a Quick Response (QR) code; a 2-dimensional bar code; a 3-dimensional bar code; a pattern; a colored pattern; a black-and-white pattern; a colored blob; a sequence of one or more characters; a product code; and a serial number.

14. The medium of 10 , wherein the service rendering system comprises a mechanical arm, wherein the processor is further caused to:

(g) obtain a service request encoded in the label; and

(h) issue instructions for the mechanical arm to render a service at the service point position according to the service request.

15. The medium of claim 14 , wherein the issue (h) comprises:

(h1) issue the instructions for the mechanical arm to physically couple to the service object at the service point position.

16. The medium of claim 15 , wherein the service object comprises a lock, wherein the issue (h1) comprises:

(h1) issue the instructions for the mechanical arm to perform a lock operation on the lock according to the service request.

17. The medium of claim 15 , wherein the service object comprises a physical item, wherein the issue (h1) comprises:

(h1) issue the instructions for the mechanical arm to perform a physical item operation on the physical item according to the service request.

18. The medium of claim 14 , wherein the mechanical arm comprises one or more sensors, wherein the issue (h) comprises:

(h1) issue the instructions for the mechanical arm to perform a sensor operation at the service point position using the one or more sensors.

19. A service rendering system, comprising:

a controller;

a camera coupled to the controller; and

a non-transitory computer readable medium comprising computer readable program code embodied therein for locating a service object, wherein when executed by the controller, causes the controller to:

(a) receive an image captured by the camera;

(b) process the image to identify a label image in the image;

(c) identify a label in the label image as corresponding to the service object;

(d) obtain a service point location encoded in the label, wherein the service point location comprises a location relative to a location of the label;

(e) calculate a label position of the label using the image of the label; and

(f) calculate a service point position using the service point location and the label position.

20. The system of claim 19 , wherein the controller is further caused to:

(g) issue instructions to move the service rendering system to the service object at the service point position.

21. The system of claim 20 , wherein the service rendering system further comprises a mechanical arm, wherein the issue (g) comprises:

(g1) issue the instructions to move the mechanical arm to the service object at the service point position.

22. The system of claim 19 , wherein the label comprises controller readable code, the controller readable code comprising one or more of the following: a bar code; a Quick Response (QR) code; a 2-dimensional bar code; a 3-dimensional bar code; a pattern; a colored pattern; a black-and-white pattern; a colored blob; a sequence of one or more characters; a product code; and a serial number.

23. The system of 19 , wherein the service rendering system further comprises a mechanical arm, wherein the controller is further caused to:

(g) obtain a service request encoded in the label; and

(h) issue instructions for the mechanical arm to render a service at the service point position according to the service request.

24. The system of claim 23 , wherein the issue (h) comprises:

(h1) issue the instructions for the mechanical arm to physically couple to the service object at the service point position.

25. The system of claim 24 , wherein the service object comprises a lock, wherein the issue (h1) comprises:

(h1) issue the instructions for the mechanical arm to perform a lock operation on the lock according to the service request.

26. The system of claim 24 , wherein the service object comprises a physical item, wherein the issue (h1) comprises:

(h1) issue the instructions for the mechanical arm to perform a physical item operation on the physical item according to the service request.

27. The system of claim 23 , wherein the mechanical arm comprises one or more sensors, wherein the issue (h) comprises:

(h1) issue the instructions for the mechanical arm to perform a sensor operation at the service point position using the one or more sensors.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2023
From: HO, CHI FAI; HO, AUGUSTINE JUNDA
To: TP LAB, INC.
Reel/Frame 062893/0039 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2021
From: HO, CHI FAI; HO, AUGUSTINE JUNDA
To: TP LAB INC
Reel/Frame 056021/0238 →
Continuity (1)
Continuation 15991874 · May 29, 2018