IP Library Granted Patent US 12,020,227
Granted Patent B2
US 12,020,227 · App. 17/543,271 · Granted Jun 25, 2024

Measurement information processing mode switching system

Inventors: Brad M. Johnson (Raleigh, NC); David J. Steiner (Durham, NC); Suzanne M. Bleakley (Cary, NC); William L. Dungan (Cary, NC)
G06Q20/201G06Q20/18G06Q20/208G06T7/20G06V10/255G07G1/0063G07G1/0072G07G1/06G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,020,227
App. No.
17/543,271
Granted
Jun 25, 2024
Kind
B2
Abstract

Systems and methods of automatically switching measurement information processing modes related to a self-checkout kiosk. In one exemplary embodiment, a method is performed by an electronic device that includes processing circuitry. The method may include detecting, using object recognition, at least one object present in real-time captured imagery. The method may further include, responsive to detecting the at least one object present in the real-time captured imagery, switching measurement information processing modes from a first measurement information processing mode to a second measurement information processing mode.

Claims (59)

1. A self-checkout system, comprising:

a camera;

an electronic measurement device having a digital scale operable to measure a weight of an object;

a display device operable to display the measured weight of an object;

a bag rack coupled to the display device and the digital scale;

processing circuitry; and

memory, the memory storing instructions executable by the processing circuitry that cause the self-checkout system to:

access real-time captured imagery retrieved from the camera; and

while accessing the real-time captured imagery from the camera:

detect, using object recognition, at least one object present in the real-time captured imagery; and

responsive to detecting the at least one object present in the real-time captured imagery, switch measurement information processing modes from a first measurement information processing mode to a second measurement information processing mode, wherein the second measurement information processing mode is different from the first measurement information processing mode, the first and second measurement information processing modes process measurement information retrieved from the electronic measurement device in real time, and the second measurement information processing mode determines a measured object characteristic value of a target object corresponding to the detected at least one object present in the real-time captured imagery, with the second measurement information processing mode being further configured to:

determine a measured weight of the target object based on the measurement information retrieved from the digital scale;

determine a price of the target object based on the measured weight, which is further configured to:

 identify a produce type or product brand of the target object, from among a plurality of predetermined produce types and product brands, by using the object recognition on the real-time captured imagery;

 identify a price per weight unit of the identified produce type or product brand; and

 determine the price of the target object based on multiplying the identified price per weight unit by the measured weight of the target object that is based on the measurement information retrieved from the digital scale in real-time; and

update a list of items to be purchased to add an item name corresponding to a type of the target object in association with the determined price and the measured weight.

2. The self-checkout system of claim 1 , wherein the measured object characteristic value comprises at least one of a weight of the target object, a mass of the target object, a volume of the target object, an area or the target object, a length of the target object, a width of the target object, a number of target objects, and a size of the target object.

3. The self-checkout system of claim 1 , wherein the first measurement information processing mode is a security check measurement information processing mode that includes performing a security check related action responsive to a security check failing, the security check failing responsive to the measured object characteristic value being outside of a tolerance threshold in comparison with an expected object characteristic value of the target object.

4. The self-checkout system of claim 1 , wherein the instructions further cause the processing circuitry to:

switch back to the first measurement information processing mode after a predetermined period of time after the measured object characteristic value of the target object has been determined.

5. The self-checkout system of claim 1 , wherein the second measurement information processing mode is further configured to:

determine the measured object characteristic of the target object based on the measurement information retrieved from the electronic measurement device;

determine a price of the target object based on the measured object characteristic, and

update a list of items to be purchased to add an item name corresponding to a type of the target object in association with the determined price and the measured object characteristic.

6. The self-checkout system of claim 5 , wherein the determining of the price of the target object based on the measured object characteristic is further configured to:

identify a produce type or product brand of the target object, from among a plurality of predetermined produce types and product brands, by using the object recognition on the real-time captured imagery;

identify a price per object characteristic unit of the identified produce type or product brand; and

determine the price of the target object based on multiplying the identified price per object characteristic unit by the measured object characteristic value of the target object that is based on the measurement information retrieved from the electronic measurement device in real-time.

7. The self-checkout system of claim 5 , wherein the measured object characteristic value comprises at least one of a weight of the target object, a mass of the target object, a volume of the target object, an area or the target object, a length of the target object, a width of the target object, a number of target objects, and a size of the target object.

8. The self-checkout system of claim 1 , wherein the display device further displays the determined price of the target object.

9. The self-checkout system of claim 1 , wherein the instructions further cause the processing circuitry to:

track movement of the target object; and

perform the switching from the first measurement information processing mode to the second measurement information processing mode after detecting the target object has been placed in a bag associated with the bag rack attached to the digital scale.

10. The self-checkout system of claim 1 , wherein the measurement information retrieved from the electronic measurement device is retrieved after a predetermined amount of settling time has elapsed, and the predetermined amount of time of settling time is at least one second.

11. A computer-implemented method, comprising:

by a self-checkout system that includes a camera, an electronic measurement device having a digital scale operable to measure a weight of an object, a display device operable to display the measured weight of an object, and a bag rack coupled to the display device and the digital scale,

while accessing real-time captured imagery retrieved from a camera:

detecting, using object recognition, at least one object present in the real-time captured imagery; and

responsive to detecting the at least one object present in the real-time captured imagery, switching measurement information processing modes from a first measurement information processing mode to a second measurement information processing mode, wherein the second measurement information processing mode is different from the first measurement information processing mode, the first and second measurement information processing modes process measurement information retrieved from the electronic measurement device in real time, and the second measurement information processing mode determines a measured object characteristic value of a target object corresponding to the detected at least one object present in the real-time captured imagery, with the second measurement information processing mode being further configured to:

determine a measured weight of the target object based on the measurement information retrieved from the digital scale;

determine a price of the target object based on the measured weight, which is further configured to:

identify a produce type or product brand of the target object, from among a plurality of predetermined produce types and product brands, by using the object recognition on the real-time captured imagery;

identify a price per weight unit of the identified produce type or product brand; and

determine the price of the target object based on multiplying the identified price per weight unit by the measured weight of the target object that is based on the measurement information retrieved from the digital scale in real-time; and

update a list of items to be purchased to add an item name corresponding to a type of the target object in association with the determined price and the measured weight.

12. The computer-implemented method of claim 11 , wherein the measured object characteristic value comprises at least one of a weight of the target object, a mass of the target object, a volume of the target object, an area or the target object, a length of the target object, a width of the target object, a number of target objects, and a size of the target object.

13. The computer-implemented method of claim 11 , wherein the first measurement information processing mode is a security check measurement information processing mode that includes performing a security check related action responsive to a security check failing, the security check failing responsive to the measured object characteristic value being outside of a tolerance threshold in comparison with an expected object characteristic value of the target object.

14. A non-transitory computer readable medium storing computer-executable instructions that, when executed by processing circuitry, cause the processing circuitry to:

access real-time captured imagery retrieved from a camera of a self-checkout system that also includes an electronic measurement device having a digital scale operable to measure a weight of an object, a display device operable to display the measured weight of an object, and a bag rack coupled to the display device and the digital scale; and

while accessing the real-time captured imagery from the camera:

detect, using object recognition, at least one object present in the real-time captured imagery; and

responsive to detecting the at least one object present in the real-time captured imagery, switch measurement information processing modes from a first measurement information processing mode to a second measurement information processing mode, wherein the second measurement information processing mode is different from the first measurement information processing mode, the first and second measurement information processing modes process measurement information retrieved from the electronic measurement device in real time, and the second measurement information processing mode determines a measured object characteristic value of a target object corresponding to the detected at least one object present in the real-time captured imagery, with the second measurement information processing mode being further configured to:

determine a measured weight of the target object based on the measurement information retrieved from the digital scale;

determine a price of the target object based on the measured weight, which is further configured to:

identify a produce type or product brand of the target object, from among a plurality of predetermined produce types and product brands, by using the object recognition on the real-time captured imagery;

identify a price per weight unit of the identified produce type or product brand; and

determine the price of the target object based on multiplying the identified price per weight unit by the measured weight of the target object that is based on the measurement information retrieved from the digital scale in real-time; and

update a list of items to be purchased to add an item name corresponding to a type of the target object in association with the determined price and the measured weight.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2022
From: JOHNSON, BRAD M.; STEINER, DAVID J.; BLEAKLEY, SUZANNE M.; DUNGAN, WILLIAM L.
To: TOSHIBA GLOBAL COMMERCE SOLUTIONS, INC.
Reel/Frame 059268/0062 →
Continuity (1)
Related Publication 20230186266A1 · Jun 15, 2023