IP Library › Granted Patent US 9,053,363
Granted Patent B1
US 9,053,363 · App. 13/829,199 · Granted Jun 9, 2015

Object identification in visual media

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,053,363
App. No.
13/829,199
Granted
Jun 9, 2015
Kind
B1
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining the identity of an object in an image where the object in the image is in a disassembled state. In one aspect, a method includes accessing previous interactive sessions, each of the interactive sessions including images of a reference object in one or more disassembled states and each of the interactive sessions specifying an identity of the reference object in an assembled state; processing an image of a first object to identify characteristics of the first object, the first object being in a disassembled state in the image; comparing the image of the first object in the disassembled state to images of reference objects in disassembled states; and determining an identity of the first object based on the comparison and the identities of the reference objects in assembled states specified in the interactive sessions.

Claims (59)

1. A method comprising:

accessing previous interactive sessions, each of the interactive sessions including images of a reference object in one or more disassembled states and each of the interactive sessions specifying an identity of the reference object in an assembled state, wherein the reference object in a disassembled state requires the assembly of one or more additional parts to be in the assembled state;

processing an image of a first object to identify characteristics of the first object, the first object being in a disassembled state in the image;

comparing the image of the first object in the disassembled state to images of reference objects in disassembled states included in the interactive sessions; and

determining, by one or more data processors, an identity of the first object based on the comparison and the identities of the reference objects in assembled states specified in the interactive sessions.

2. The method of claim 1 , comprising:

comparing the image of the first object in the disassembled state to images of reference objects in assembled states included in the interactive sessions; and

identifying one or more additional parts required for the first object in the disassembled state to be in an assembled state based on the comparison of the image of the first object in the disassembled state to the images of the reference objects in assembled states.

3. The method of claim 1 , comprising:

identifying one or more assembled parts of the first object in the disassembled state based on the comparison, each of the one or more assembled parts being an existing part of the first object in the disassembled state.

4. The method of claim 1 , comprising:

identifying one or more broken parts of the first object in the disassembled state based on the comparison, each of the one or more broken parts being an existing part of the first object in the disassembled state that is broken.

5. The method of claim 1 , wherein determining the identity of the first object comprises:

identifying a particular reference object, of the reference objects, in a disassembled state as being most similar to the first object in the disassembled state based on the comparison;

determining an identity of the particular reference object in an assembled state based on the identities of the reference objects in assembled states specified in the interactive sessions; and

determining the identity of the first object in the disassembled state is the identity of the particular reference object in the assembled state.

6. The method of claim 1 , comprising:

comparing the image of a particular reference object in an assembled state to images of other reference objects in assembled states; and

identifying one or more broken parts of the particular reference object in the assembled state based on the comparison of the image of the particular reference object in the assembled state to the images of the other reference objects in assembled states, each of the one or more broken parts being an existing part of the particular reference object in the assembled state that is broken.

7. A system comprising:

one or more data processors; and

instructions stored on a computer-readable storage apparatus that when executed by the one or more data processors cause the one or more data processors to perform operations comprising:

accessing previous interactive sessions, each of the interactive sessions including images of a reference object in one or more disassembled states and each of the interactive sessions specifying an identity of the reference object in an assembled state, wherein the reference object in a disassembled state requires the assembly of one or more additional parts to be in the assembled state;

processing an image of a first object to identify characteristics of the first object, the first object being in a disassembled state in the image;

comparing the image of the first object in the disassembled state to images of reference objects in disassembled states included in the interactive sessions; and

determining an identity of the first object based on the comparison and the identities of the reference objects in assembled states specified in the interactive sessions.

8. The system of claim 7 , wherein the instructions, when executed by the one or more data processors, cause the one or more data processors to perform operations comprising:

comparing the image of the first object in the disassembled state to images of reference objects in assembled states included in the interactive sessions; and

identifying one or more additional parts required for the first object in the disassembled state to be in an assembled state based on the comparison of the image of the first object in the disassembled state to the images of the reference objects in assembled states.

9. The system of claim 7 , wherein the instructions, when executed by the one or more data processors, cause the one or more data processors to perform operations comprising:

identifying one or more assembled parts of the first object in the disassembled state based on the comparison, each of the one or more assembled parts being an existing part of the first object in the disassembled state.

10. The system of claim 7 , wherein the instructions, when executed by the one or more data processors, cause the one or more data processors to perform operations comprising:

identifying one or more broken parts of the first object in the disassembled state based on the comparison, each of the one or more broken parts being an existing part of the first object in the disassembled state that is broken.

11. The system of claim 7 , wherein determining the identity of the first object comprises:

identifying a particular reference object, of the reference objects, in a disassembled state as being most similar to the first object in the disassembled state based on the comparison;

determining an identity of the particular reference object in an assembled state based on the identities of the reference objects in assembled states specified in the interactive sessions; and

determining the identity of the first object in the disassembled state is the identity of the particular reference object in the assembled state.

12. The system of claim 7 , wherein the instructions, when executed by the one or more data processors, cause the one or more data processors to perform operations comprising:

comparing the image of a particular reference object in an assembled state to images of other reference objects in assembled states; and

identifying one or more broken parts of the particular reference object in the assembled state based on the comparison of the image of the particular reference object in the assembled state to the images of the other reference objects in assembled states, each of the one or more broken parts being an existing part of the particular reference object in the assembled state that is broken.

13. A computer-readable storage medium having instructions stored thereon, which, when executed by one or more data processors, cause the one or more processor to perform operations comprising:

accessing previous interactive sessions, each of the interactive sessions including images of a reference object in one or more disassembled states and each of the interactive sessions specifying an identity of the reference object in an assembled state, wherein the reference object in a disassembled state requires the assembly of one or more additional parts to be in the assembled state;

processing an image of a first object to identify characteristics of the first object, the first object being in a disassembled state in the image;

comparing the image of the first object in the disassembled state to images of reference objects in disassembled states included in the interactive sessions; and

determining an identity of the first object based on the comparison and the identities of the reference objects in assembled states specified in the interactive sessions.

14. The computer-readable storage medium of claim 13 , wherein the instructions, when executed by the one or more data processors, cause the one or more data processors to perform operations comprising:

comparing the image of the first object in the disassembled state to images of reference objects in assembled states included in the interactive sessions; and

identifying one or more additional parts required for the first object in the disassembled state to be in an assembled state based on the comparison of the image of the first object in the disassembled state to the images of the reference objects in assembled states.

15. The computer-readable storage medium of claim 13 , wherein the instructions, when executed by the one or more data processors, cause the one or more data processors to perform operations comprising:

identifying one or more assembled parts of the first object in the disassembled state based on the comparison, each of the one or more assembled parts being an existing part of the first object in the disassembled state.

16. The computer-readable storage medium of claim 13 , wherein the instructions, when executed by the one or more data processors, cause the one or more data processors to perform operations comprising:

identifying one or more broken parts of the first object in the disassembled state based on the comparison, each of the one or more broken parts being an existing part of the first object in the disassembled state that is broken.

17. The computer-readable storage medium of claim 13 , wherein determining the identity of the first object comprises:

identifying a particular reference object, of the reference objects, in a disassembled state as being most similar to the first object in the disassembled state based on the comparison;

determining an identity of the particular reference object in an assembled state based on the identities of the reference objects in assembled states specified in the interactive sessions; and

determining the identity of the first object in the disassembled state is the identity of the particular reference object in the assembled state.

18. The computer-readable storage medium of claim 13 , wherein the instructions, when executed by the one or more data processors, cause the one or more data processors to perform operations comprising:

comparing the image of a particular reference object in an assembled state to images of other reference objects in assembled states; and

identifying one or more broken parts of the particular reference object in the assembled state based on the comparison of the image of the particular reference object in the assembled state to the images of the other reference objects in assembled states, each of the one or more broken parts being an existing part of the particular reference object in the assembled state that is broken.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044334/0466 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2013
From: NORDSTROM, PAUL G.
To: GOOGLE INC.
Reel/Frame 030382/0937 →