IP Library Granted Patent US 10,713,688
Granted Patent B2
US 10,713,688 · App. 14/036,359 · Granted Jul 14, 2020

Method and system for gesture-based cross channel commerce and marketing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,713,688
App. No.
14/036,359
Granted
Jul 14, 2020
Kind
B2
Abstract

A computing device (e.g., a server) coupled to a digital signage device may receive characteristic information associated with a visitor of the digital signage device. The received characteristic information may be analyzed, and based on a result of the analysis, advertisement attributes may be determined. The computing device may select, based on the determined advertisement attributes, a particular advertisement from a plurality of advertisement bids. The computing device may cause display of the selected particular advertisement on the digital signage device for the visitor. The characteristic information may be generated by the digital signage device utilizing a video analytics. The computing device may receive particular gesture information associated with a mobile device of the visitor who responds to the displayed particular advertisement. The computing device may cause a cloud computing platform to push content associated with the particular advertisement into the mobile device for the visitor to place an order.

Claims (90)

1. A method, comprising:

in a computing system operatively coupled to a digital signage device that is configured to detect a visitor to the digital signage device and to perform video analytics on captured video images of the visitor to generate characteristic information about the visitor and particular gesture information:

receiving video from a camera of the digital signage device;

determine bid requirements for soliciting advertisement bids based on an analysis of the received video;

determining a winning bid from a plurality of advertisers;

cause to be displayed a particular advertisement associated with the winning bid;

configuring a display of the digital signage device into a multi-zone layout;

performing multivariate testing and A/B testing in the multi-zone layout based on at least visitor viewing time, visitor facial gestures, and visitor interaction captured by the camera, wherein at least two zones of the multi-zone layout comprise A/B testing zones;

causing the multi-zone layout to be reconfigured based on the multivariate testing and A/B testing;

receiving, by the computing system from the digital signage device via a first communication link, the generated characteristic information and particular gesture information associated with the visitor who responds to the displayed particular advertisement of the digital signage device by inputting a particular motion-based gesture that is both sensed by an accelerometer of a mobile computing device and detected by the digital signage device;

receiving, by the computing system from the cloud network, location information and particular profile information that was sent, from the mobile computing device to the cloud network via a second communication link that is different than the first communication link, in response to the accelerometer sensing the particular motion-based gesture;

accessing, via the computer system based on the particular gesture information received from the digital signage device via the first communication link, location information and particular profile information associated with the visitor from the cloud network that received, from the mobile computing device via the second communication link, the location information and the particular profile information in response to the mobile computing device detecting the particular motion-based gesture; and

based on the location information and the particular profile information received from the cloud network and the mobile computing device and based on the generated characteristic information and the particular gesture information received from the digital signage device, pushing content associated with the displayed particular advertisement into the mobile computing device for the visitor.

2. The method according to claim 1 , further comprising:

generating the particular gesture information associated with the mobile computing device by the digital signage device utilizing a video analytics on video images captured by the digital signage device, or

detecting, with the mobile computing device, one or more motion-based gestures.

3. The method according to claim 1 , wherein the A/B testing zones comprise a first version of an advertisement and a second version of the advertisement, and further comprising determining, based on a statistical analysis, whether the first version or the second version is shown later when the advertisement is displayed.

4. The method according to claim 3 , further comprising:

detecting the one or more motion-based gestures utilizing an accelerometer in the mobile computing device; and

communicating, based on the detecting of the one or more motion-based gestures, the location information and the particular profile information to the computing system utilizing a particular application running on the mobile computing device.

5. The method according to claim 4 , further comprising:

receiving, from the digital signage device, characteristic information associated with the visitor of the digital signage device;

analyzing the received characteristic information; determining advertisement attributes based on a result of said analyzing;

selecting, based on the determined advertisement attributes, a particular advertisement from among a plurality of advertisement bids; and causing display of the selected particular advertisement on the digital signage device for the visitor.

6. The method according to claim 5 , wherein the characteristic information associated with the visitor comprises one or more of the following:

demographic information of the visitor;

behavioral information of the visitor; and

location information of the visitor in a field-of-view captured by the digital signage device.

7. The method according to claim 5 , wherein the characteristic information is generated by the digital signage device utilizing a video analytics on video images captured by the digital signage device.

8. The method according to claim 5 , further comprising testing a plurality of versions of the particular advertisement, wherein said testing comprises:

receiving, from the digital signage device, action information associated with the visitor who views a first version of the particular advertisement;

analyzing statistically the received action information associated with the first version of the particular advertisement and other received action information associated with the first version as well as associated with one or more other versions of the particular advertisement; and

determining, based on a result of the analysis of the action information, a particular version among the plurality of versions for display on the digital signage device.

9. The method according to claim 8 , wherein the action information which is statistically analyzed comprises one or more of audience impression, viewing time, viewer facial gesture and viewer interaction.

10. The method according to claim 8 , wherein the action information is generated by the digital signage device utilizing one or both of:

a video analytics on video images captured by the digital signage device; and

a tracking on sensor information captured by the digital signage device.

11. A system, comprising:

a digital signage device that includes a camera and a display, wherein the display is configured into a multi-zone layout, wherein the digital signage device is configured to perform multivariate testing and A/B testing in the multi-zone layout based on at least visitor viewing time, visitor facial gestures, and visitor interaction captured by the camera, wherein at least two zones of the multi-zone layout comprise A/B testing zones, wherein the digital signage device is caused to reconfigure the multi-zone layout based on the multivariate testing and A/B testing, and wherein the digital signage device is configured to detect a visitor to the digital signage device and to perform video analytics on captured video images of the visitor to generate characteristic information about the visitor and particular gesture information;

a mobile computing device that includes an accelerometer that is configured to sense a particular motion-based gesture that is an input to the mobile computing device; and

a computing system operatively coupled to the digital signage device, wherein the computing system is operable to:

receive, from the digital signage device, video images;

determine bid requirements for soliciting advertisement bids based on an analysis of the received video images;

determining a winning bid from a plurality of advertisers;

cause to be displayed a particular advertisement associated with the winning bid;

receive, from the digital signage device via a first communication link, the generated characteristic information and particular gesture information associated with the visitor who responds to the displayed particular advertisement of the digital signage device by inputting the particular motion-based gesture that is both sensed by accelerometer of the mobile computing device and detected by the digital signage device;

receive, from the cloud network, location information and particular profile information that was sent, from the mobile computing device to the cloud network via a second communication link that is different than the first communication link, in response to the accelerometer sensing the particular motion-based gesture;

access, based on the particular gesture information received from the digital signage device via the first communication link, location information and particular profile information associated with the visitor from the cloud network that received, from the mobile computing device via the second communication link, the location information and the particular profile information in response to the mobile computing device detecting the particular motion-based gesture; and

based on the location information and the particular profile information received from the cloud network and the mobile computing device and based on the generated characteristic information and the particular gesture information received from the digital signage device, push content associated with the displayed particular advertisement into the mobile computing device for the visitor.

12. The system according to claim 11 , wherein the computing system is further operable to:

receive, from the digital signage device, characteristic information associated with the visitor of the digital signage device;

analyze the received characteristic information; determine advertisement attributes based on a result of the analysis of the characteristic information;

select, based on the determined advertisement attributes, a particular advertisement from among a plurality of advertisement bids; and

cause display of the selected particular advertisement on the digital signage device for the visitor.

13. The system according to claim 12 , wherein the characteristic information associated with the visitor comprises one or more of the following:

demographic information of the visitor;

behavioral information of the visitor; and

location information of the visitor in a field-of-view captured by the digital signage device.

14. The system according to claim 12 , wherein the characteristic information is generated by the digital signage device utilizing a video analytics on video images captured by the digital signage device.

15. The system according to claim 12 , wherein the computing system is operable to test a plurality of versions of the particular advertisement by:

receiving, from the digital signage device, action information associated with the visitor who views a first version of the particular advertisement;

analyzing statistically the received action information associated with the first version of the particular advertisement and other received action information associated with the first version as well as associated with one or more other versions of the particular advertisement; and

determining, based on a result of the analysis of the action information, a particular version among the plurality of versions for display on the digital signage device.

16. A non-transitory computer readable medium comprising a plurality of instructions that, in response to being executed by a computing device operatively coupled to a digital signage device, cause the computing device to:

receive video from a camera of a digital signage device;

determine bid requirements for soliciting advertisement bids based on an analysis of the received video;

determining a winning bid from a plurality of advertisers;

cause to be displayed a particular advertisement associated with the winning bid;

configure a display of the digital signage device into a multi-zone layout;

perform multivariate testing and A/B testing in the multi-zone layout based on at least visitor viewing time, visitor facial gestures, and visitor interaction captured by the camera, wherein at least two zones of the multi-zone layout comprise A/B testing zones;

reconfigure the multi-zone layout based on the multivariate testing and A/B testing;

receive, via a first communication link from the digital signage device that is configured to detect a visitor to the digital signage device and to perform video analytics on captured video images of the visitor to generate characteristic information about the visitor and particular gesture information, the generated characteristic information and particular gesture information associated with the visitor who responds to the displayed particular advertisement of the digital signage device by inputting a particular motion-based gesture that is both sensed by an accelerometer of a mobile computing device and detected by the digital signage device;

receive, from the cloud network, location information and particular profile information that was sent, from the mobile computing device to the cloud network via a second communication link that is different than the first communication link, in response to the accelerometer sensing the particular motion-based gesture;

access, based on the particular gesture information received from the digital signage device via the first communication link, location information and particular profile information associated with the visitor from the cloud network that received, from the mobile computing device via the second communication link, the location information and the particular profile information in response to the mobile computing device detecting the particular motion-based gesture; and

based on the location information and the particular profile information received from the cloud network and the mobile computing device and based on the generated characteristic information and the particular gesture information received from the digital signage device, push content associated with the displayed particular advertisement into the mobile computing device for the visitor.

17. The non-transitory computer readable medium according to claim 16 , wherein the plurality of instructions further cause the computing device to:

receive, from the digital signage device, characteristic information associated with the visitor of the digital signage device;

analyze the received characteristic information;

determine advertisement attributes based on a result of the analysis of the characteristic information;

select, based on the determined advertisement attributes, a particular advertisement from among a plurality of advertisement bids; and

cause display of the selected particular advertisement on the digital signage device for the visitor.

18. The non-transitory computer readable media according to claim 17 , wherein the characteristic information associated with the visitor comprises one or more of the following:

demographic information of the visitor;

behavioral information of the visitor; and

location information of the visitor in a field-of-view captured by the digital signage device.

19. The non-transitory computer readable media according to claim 17 , wherein the characteristic information is generated by the digital signage device utilizing a video analytics on video images captured by the digital signage device.

20. The non-transitory computer readable media according to claim 17 , wherein the plurality of instructions further cause the computing device to test a plurality of versions of the particular advertisement by:

receiving, from the digital signage device, action information associated with the visitor who views a first version of the particular advertisement;

analyzing statistically the received action information associated with the first version of the particular advertisement and other received action information associated with the first version as well as associated with one or more other versions of the particular advertisement; and

determining, based on a result of the analysis of the action information, a particular version among the plurality of versions for display on the digital signage device.

Assignments (14)
SECURITY INTEREST Recorded May 7, 2021
From: TRANSFORM SR BRANDS LLC
To: CANTOR FITZGERALD SECURITIES
Reel/Frame 056179/0863 →
SECURITY INTEREST Recorded May 15, 2020
From: TRANSFORM SR BRANDS LLC
To: JPP, LLC
Reel/Frame 053467/0062 →
RELEASE OF SECURITY INTEREST Recorded Mar 18, 2020
From: CITIBANK, N.A., AS AGENT
To: TRANSFORM SR BRANDS LLC
Reel/Frame 052188/0176 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2020
From: CANTOR FITZGERALD SECURITIES
To: TRANSFORM SR BRANDS LLC
Reel/Frame 052184/0782 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2020
From: BANK OF AMERICA, N.A.
To: TRANSFORM SR BRANDS LLC
Reel/Frame 052183/0879 →
SECURITY INTEREST Recorded Sep 20, 2019
From: TRANSFORM SR BRANDS LLC
To: CANTOR FITZGERALD SECURITIES
Reel/Frame 050451/0309 →
RELEASE OF SECURITY INTEREST Recorded Apr 22, 2019
From: CANTOR FITZGERALD SECURITIES, AS AGENT
To: TRANSFORM SR BRANDS LLC
Reel/Frame 049284/0149 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2019
From: SEARS BRANDS, L.L.C.
To: TRANSFORM SR BRANDS LLC
Reel/Frame 048710/0182 →
SECURITY INTEREST Recorded Feb 25, 2019
From: TRANSFORM SR BRANDS LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 048433/0001 →
SECURITY INTEREST Recorded Feb 25, 2019
From: TRANSFORM SR BRANDS LLC
To: CITIBANK, N.A.
Reel/Frame 048424/0291 →
RELEASE OF SECURITY INTEREST Recorded Feb 15, 2019
From: JPP, LLC
To: SEARS BRANDS, L.L.C.
Reel/Frame 048352/0708 →
SECURITY INTEREST Recorded Feb 12, 2019
From: TRANSFORM SR BRANDS LLC
To: CANTOR FITZGERALD SECURITIES, AS AGENT
Reel/Frame 048308/0275 →
SECURITY INTEREST Recorded Jan 5, 2018
From: SEARS BRANDS, L.L.C.
To: JPP, LLC
Reel/Frame 045013/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2013
From: BHAUMIK, VIJAN; AGARWAL, SHUBHAM
To: SEARS BRANDS, L.L.C.
Reel/Frame 031437/0180 →