IP Library Granted Patent US 12,211,313
Granted Patent B2
US 12,211,313 · App. 17/801,936 · Granted Jan 28, 2025

Customer analysis apparatus, customer analysis method, and non-transitory storage medium

Inventors: Makiko Akiguchi (Tokyo, JP); Azusa Furukawa (Tokyo, JP); Kei Shibuya (Tokyo, JP); Kan Arai (Tokyo, JP); Hiroshi Hashimoto (Tokyo, JP); Ken Hanazawa (Tokyo, JP)
Assignee: NEC CORPORATION
G06V40/168G06Q30/0201G06T7/246G06T7/292G06T11/00G06V20/52G06T2210/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,313
App. No.
17/801,936
Granted
Jan 28, 2025
Kind
B2
Abstract

A customer analysis apparatus ( 10 ) includes an image acquisition unit ( 110 ) and an image processing unit ( 120 ). The image acquisition unit ( 110 ) acquires a first image generated by a first image capture unit ( 22 ) and a second image generated by a second image capture unit ( 24 ). The image processing unit ( 120 ) processes the first image and the second image. More specifically, the image processing unit ( 120 ) generates product information indicating a product ( 50 ) taken out from a product shelf ( 40 ), by processing the first image and the second image. Further, the image processing unit ( 120 ) generates customer attribute information of a customer taking out the product ( 50 ), by processing the first image. Then, the image processing unit ( 120 ) causes a result storage unit ( 130 ) to store the product information and the customer attribute information in association with each other.

Claims (91)

1. A customer analysis apparatus used with a first image capture unit and a second image capture unit each capturing an image of at least one of a product placement location and an area in front of the product placement location, the customer analysis apparatus comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to perform operations comprising:

acquiring a first image generated by the first image capture unit and a second image generated by the second image capture unit; and

processing the first image and the second image, wherein

the first image capture unit, the product placement location, and the second image capture unit are arranged in this order in a first direction,

the first image capture unit is positioned at a height identical to that of or above the product placement location and captures an image of at least a diagonally lower area,

the second image capture unit is positioned at a height identical to that of or below the product placement location and below the first image capture unit and captures an image of at least a diagonally upper area, and

the operations further comprise:

generating product information indicating a product taken out from the product placement location, by processing the first image and the second image;

generating customer attribute information indicating an attribute of a customer taking out the product, by processing the first image; and

causing a storage unit to store the product information and the customer attribute information in association with each other.

2. The customer analysis apparatus according to claim 1 , wherein

generating customer attribute information comprises:

generating shoe information indicating a shoe worn by the customer, by processing the first image; and

making the shoe information at least part of the customer attribute information.

3. The customer analysis apparatus according to claim 1 , wherein

generating customer attribute information comprises:

generating clothing information indicating clothing worn by the customer, by processing the first image; and

making the clothing information at least part of the customer attribute information.

4. The customer analysis apparatus according to claim 1 , wherein

generating customer attribute information comprises:

generating wearing article information indicating a wearing article worn over a face of the customer, by further processing the second image; and

making the wearing article information at least part of the customer attribute information.

5. The customer analysis apparatus according to claim 1 , wherein

generating customer attribute information comprises:

generating child attribute information indicating an attribute of a child accompanying the customer, by further processing the second image; and

making the child attribute information at least part of the customer attribute information.

6. The customer analysis apparatus according to claim 1 , wherein

a display unit is provided at the product placement location or a store in which the product placement location is provided, and

the operations further comprise:

acquiring display information to be displayed by the display unit, by using the customer attribute information; and

causing the display unit to display the acquired display information.

7. A customer analysis method executed by a computer used with a first image capture unit and a second image capture unit each capturing an image of at least one of a product placement location and an area in front of the product placement location, the customer analysis method comprising:

acquiring a first image generated by the first image capture unit and a second image generated by the second image capture unit;

generating product information indicating a product taken out from the product placement location, by processing the first image and the second image;

generating customer attribute information indicating an attribute of a customer taking out the product, by processing the first image; and

causing a storage unit to store the product information and the customer attribute information in association with each other, wherein

the first image capture unit, the product placement location, and the second image capture unit are arranged in this order in a first direction,

the first image capture unit is positioned at a height identical to that of or above the product placement location and captures an image of at least a diagonally lower area, and

the second image capture unit is positioned at a height identical to that of or below the product placement location and below the first image capture unit and captures an image of at least a diagonally upper area.

8. The customer analysis method according to claim 7 , wherein

generating customer attribute information comprises:

generating shoe information indicating a shoe worn by the customer, by processing the first image; and

making the shoe information at least part of the customer attribute information.

9. The customer analysis method according to claim 7 , wherein

generating customer attribute information comprises:

generating clothing information indicating clothing worn by the customer, by processing the first image; and

making the clothing information at least part of the customer attribute information.

10. The customer analysis method according to claim 7 , wherein

generating customer attribute information comprises:

generating wearing article information indicating a wearing article worn over a face of the customer, by further processing the second image; and

making the wearing article information at least part of the customer attribute information.

11. The customer analysis method according to claim 7 , wherein

generating customer attribute information comprises:

generating child attribute information indicating an attribute of a child accompanying the customer, by further processing the second image; and

making the child attribute information at least part of the customer attribute information.

12. The customer analysis method according to claim 7 , wherein

a display unit is provided at the product placement location or a store in which the product placement location is provided, and

the customer analysis method further comprises:

acquiring display information to be displayed by the display unit, by using the customer attribute information; and

causing the display unit to display the acquired display information.

13. A non-transitory storage medium storing a program executed by a computer used with a first image capture unit and a second image capture unit each capturing an image of at least one of a product placement location and an area in front of the product placement location, the program causing the computer to execute a customer analysis method, the customer analysis method comprising:

acquiring a first image generated by the first image capture unit and a second image generated by the second image capture unit;

generating product information indicating a product taken out from the product placement location, by processing the first image and the second image;

generating customer attribute information indicating an attribute of a customer taking out the product, by processing the first image; and

causing a storage unit to store the product information and the customer attribute information in association with each other, wherein

the first image capture unit, the product placement location, and the second image capture unit are arranged in this order in a first direction,

the first image capture unit is positioned at a height identical to that of or above the product placement location and captures an image of at least a diagonally lower area, and

the second image capture unit is positioned at a height identical to that of or below the product placement location and below the first image capture unit and captures an image of at least a diagonally upper area.

14. The non-transitory storage medium according to claim 13 , wherein

generating customer attribute information comprises:

generating shoe information indicating a shoe worn by the customer, by processing the first image; and

making the shoe information at least part of the customer attribute information.

15. The non-transitory storage medium according to claim 13 , wherein

generating customer attribute information comprises:

generating clothing information indicating clothing worn by the customer, by processing the first image; and

making the clothing information at least part of the customer attribute information.

16. The non-transitory storage medium according to claim 13 , wherein

generating customer attribute information comprises:

generating wearing article information indicating a wearing article worn over a face of the customer, by further processing the second image; and

making the wearing article information at least part of the customer attribute information.

17. The non-transitory storage medium according to claim 13 , wherein

generating customer attribute information comprises:

generating child attribute information indicating an attribute of a child accompanying the customer, by further processing the second image; and

making the child attribute information at least part of the customer attribute information.

18. The non-transitory storage medium according to claim 13 , wherein

a display unit is provided at the product placement location or a store in which the product placement location is provided, and

the customer analysis method further comprises:

acquiring display information to be displayed by the display unit, by using the customer attribute information; and

causing the display unit to display the acquired display information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2022
From: AKIGUCHI, MAKIKO; FURUKAWA, AZUSA; SHIBUYA, KEI; ARAI, KAN; HASHIMOTO, HIROSHI; HANAZAWA, KEN
To: NEC CORPORATION
Reel/Frame 060887/0273 →
Continuity (1)
Related Publication 20230080815A1 · Mar 16, 2023
References Cited (29)
US 11763374B2 · Miyagi · 2023 [cited by examiner]
US 11798064B1 · Rodriguez · 2023 [cited by examiner]
US 11887051B1 · Guan · 2024 [cited by examiner]
US 11914785B1 · Glaser · 2024 [cited by examiner]
US 12080135B2 · Iwai · 2024 [cited by examiner]
US 20110176005A1 · Kaneko · 2011 [cited by examiner]
US 20140279246A1 · Chen et al. · 2014 [cited by applicant]
US 20150029339A1 · Kobres · 2015 [cited by examiner]
US 20150262460A1 · Ito · 2015 [cited by examiner]
US 20160196575A1 · Uchida · 2016 [cited by examiner]
US 20180096353A1 · Matsui · 2018 [cited by examiner]
US 20190005535A1 · Uchida et al. · 2019 [cited by applicant]
US 20190005536A1 · Uchida et al. · 2019 [cited by applicant]
US 20190005537A1 · Uchida et al. · 2019 [cited by applicant]
US 20210142490A1 · Shiraishi · 2021 [cited by applicant]
US 20210304256A1 · Ishida et al. · 2021 [cited by applicant]
US 20240265789A1 · Zalewski · 2024 [cited by examiner]
JP 2016062564A · 2016 [cited by applicant]
JP 2016200873A · 2016 [cited by applicant]
JP 2018055248A · 2018 [cited by applicant]
JP 2019113976A · 2019 [cited by applicant]
KR 101885669B1 · 2018 [cited by applicant]
WO 2015033575A1 · 2015 [cited by applicant]
WO 2016043093A1 · 2016 [cited by applicant]
WO WO2018235198A1 · 2018 [cited by examiner]
Liciotti et al., “Shopper Analytics: a customer activity recognition system using a distributed RGB-D camera network” (Year: 2015). [cited by examiner]
JP Office Action for JP Application No. 2022-503028, mailed on Sep. 26, 2023 with English Translation. [cited by applicant]
International Search Report for PCT Application No. PCT/JP2020/008442, mailed on Jul. 7, 2020. [cited by applicant]
US Office Action for U.S. Appl. No. 18/512,750, mailed on Nov. 5, 2024. [cited by applicant]