IP Library Granted Patent US 12,315,333
Granted Patent B2
US 12,315,333 · App. 17/945,165 · Granted May 27, 2025

Gaming environment tracking system calibration

Inventors: Martin S. Lyons (Henderson, NV); Bryan Kelly (Rancho Santa Margarita, CA)
Assignee: LNW Gaming, Inc.
G07F17/3227G07F17/322G07F17/3223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,315,333
App. No.
17/945,165
Granted
May 27, 2025
Kind
B2
Abstract

A method and apparatus to automatically modify one or more presentation attributes of a gaming system. For instance, the gaming system detects, via analysis of an image data by a neural network model, an appearance of one or more features of a gaming surface. The gaming system further automatically modifies, via the neural network model in response to detecting the appearance of the one or more features, a presentation attribute associated with presentation of gaming content via a designated area of the gaming surface. The gaming system further projects, via a projection system based on the modified presentation attribute, the gaming content onto the designated area of the gaming surface.

Claims (53)

1. A method comprising:

detecting, by a processor in response to analysis of image data by a neural network model, an appearance of one or more features of a gaming surface;

automatically modifying, by the processor via the neural network model in response to the detecting the appearance of the one or more features, a presentation attribute associated with presentation of gaming content via a designated area of the gaming surface; and

projecting, by the processor via a projection system based on the modified presentation attribute, the gaming content onto the designated area of the gaming surface.

2. The method of claim 1 , further comprising:

capturing the image data from an image-sensor perspective of an image sensor oriented at the gaming surface within a gaming environment, and wherein the analysis of the image data comprises, analyzing the appearance of the one or more features in the image data against a known geometry of the one or more features.

3. The method of claim 2 , wherein the known geometry comprises an isomorphic equivalent to the appearance of the one or more features taken from a substantially equivalent image-sensor perspective oriented at the gaming surface during training of the neural network model in a training environment, and wherein the modifying is based on one or more transformations by the neural network model of the detected appearance of the one or more features to the isomorphic equivalent.

4. The method of claim 3 , wherein the one or more transformations are based on one or more layout elements of the gaming surface specified in a layout authorized for presentation of wagering games via the designated area of the gaming surface.

5. The method of claim 1 , wherein the gaming surface comprises a hard surface covered by a reflective material on which at least one of the one or more features is projected.

6. The method of claim 1 , wherein the one or more features comprise features used for administration of a wagering game.

7. The method of claim 1 , wherein the automatically modifying comprises:

detecting, by the processor based on the analysis of the image data by the neural network model, first relative positions between a first feature of the one or more features and a second feature of the one or more features;

searching, by the processor via the neural network model based on one or more transformations of the first relative positions, a library of layout templates;

selecting, by the processor via the neural network model based on the searching, a layout template from the library of layout templates, wherein the layout template has second relative positions between additional features on a gaming-surface layout, and wherein the second relative positions are isomorphic to the first relative positions; and

wherein modifying the presentation attribute is based, at least in part, on dimensions of the additional features obtained from the layout template.

8. The method of claim 7 , further comprising detecting, based on the analysis of the image data by the neural network model, a manufacturer of one or more of the gaming surface or the layout template, and wherein the searching comprises searching only a portion of the library of layout templates related to the detected manufacturer.

9. The method of claim 1 , wherein the image data is captured via an image-sensor perspective of an image sensor affixed relative to the designated area, and wherein prior to automatically modifying the presentation attribute, said method further comprising:

obtaining additional image data taken of the gaming content projected onto the gaming surface using the presentation attribute for projection prior to being modified; and

determining, based on isomorphic evaluation of the additional image data by the neural network model against the image data, a change in position of the one or more features relative to the designated area, wherein the automatically modifying the presentation attribute comprises automatically calibrating the presentation attribute based on the change in position.

10. The method of claim 1 , wherein the automatically modifying the presentation attribute comprises one or more of:

self-calibrating a projector setting of the projection system; or

modifying, based on analysis of the appearance of the one or more features by the neural network model, one or more of a position, a dimension, or an orientation of the gaming content within a virtual overlay of the gaming surface.

11. The method of claim 1 , wherein the one or more features comprise at least one physical feature of the gaming surface and a grid of fiducial markers projected at the gamming surface via a projection perspective of the projection system, wherein each fiducial marker within the grid of fiducial markers has a unique appearance associated with specific coordinates of a grid structure, and wherein detecting the appearance of the one or more features comprises:

detecting, by the neural network model via the analysis of the image data, at least a portion of the grid of fiducial markers that are visible on the gaming surface; and

determining, based on a detected orientation of the at least a portion of the grid of fiducial markers relative to known dimensions of the at least one physical feature, a homography matrix to automatically transform, based on the projection perspective and based on the specific coordinates of the grid structure, one or more dimensions of the gaming content to fit the designated area via the projecting.

12. A gaming system comprising:

a projection system; and

a processor, wherein the processor is configured to execute instructions, which, when executed, cause the gaming system to perform operations to:

detect, in response to analysis of image data by a neural network model, an appearance of one or more features of a gaming surface;

automatically modify, via the neural network model in response to the detecting the appearance of the one or more features, a presentation attribute associated with presentation of gaming content via, a designated area of the gaming surface; and

project, via the projection system based on the modified presentation attribute, the gaming content onto the designated area of the gaming surface.

13. The gaming system of claim 12 , wherein the processor is further configured to execute instructions, which, when executed, cause the gaming system to perform operations to:

capture the image data from an image-sensor perspective of an image sensor oriented at the gaming surface within a gaming environment, and wherein the operation of analysis of the image data comprises operations to evaluate the appearance of the one or more features in the image data against a known geometry of the one or more features.

14. The gaming system of claim 13 , wherein the known geometry comprises an isomorphic equivalent to the appearance of the one or more features taken from a substantially equivalent image-sensor perspective oriented at the gaming surface during training of the neural network model in a training environment, and wherein the operation to automatically modify the presentation attribute is based on one or more transformations by the neural network model of the detected appearance of the one or more features to the isomorphic equivalent.

15. The gaming system of claim 12 , wherein the gaming surface comprises a hard surface covered by a reflective material on which at least one of the one or more features is projected.

16. The gaming system of claim 12 , wherein the processor is further configured to execute instructions, which, when executed, cause the gaming system to perform operations to:

detect, based on the analysis of the image data by the neural network model, first relative positions between a first feature of the one or more features and a second feature of the one or more features;

search, via the neural network model based on one or more transformations of the first relative positions, a library of layout templates;

select, via the neural network model based on the searching, a layout template from the library of layout templates, wherein the layout template has second relative positions between additional features on a gaming-surface layout, and wherein the second relative positions are isomorphic to the first relative positions; and

wherein modification of the presentation attribute is based, at least in part, on dimensions of the additional features obtained from the layout template.

17. The gaming system of claim 12 , wherein the image data is captured via an image-sensor perspective of an image sensor affixed relative to the designated area, and wherein prior to automatic modification of the presentation attribute, said processor is further configured to execute instructions, which, when executed, cause the gaming system to perform operations to:

obtain additional image data taken of the gaming content projected onto the gaming surface using the presentation attribute for projection prior to being modified; and

determine, based on isomorphic evaluation of the additional image data by the neural network model against the image data, a change in position of the one or more features relative to the designated area, wherein automatic modification of the presentation attribute comprises automatic calibration of the presentation attribute based on the change in position.

18. One or more non-transitory machine-readable media including instructions executable by a processor, the instructions including:

instructions for detecting, by a processor in response to analysis of image data by a neural network model, an appearance of one or more features of a gaming surface;

instructions for automatically modifying, via the neural network model in response to the detecting the appearance of the one or more features, a presentation attribute associated with presentation of gaming content via a designated area of the gaming surface; and

instructions for projecting, via a projection system based on the modified presentation attribute, the gaming content onto the designated area of the gaming surface.

19. The one or more non-transitory machine-readable media of claim 18 , wherein the instructions for automatically modifying the presentation attribute comprise one or more of:

instructions for self-calibrating a projector setting of the projection system; or

instructions for modifying, based on analysis of the appearance of the one or more features by the neural network model, one or more of a position, a dimension, or an orientation of the gaming content within a virtual overlay of the gaming surface.

20. The one or more non-transitory machine-readable media of claim 18 , wherein the one or more features comprise at least one physical feature of the gaming surface and a grid of fiducial markers projected at the gaming surface via a projection perspective of the projection system, wherein each fiducial marker within the grid of fiducial markers has a unique appearance associated with specific coordinates of a grid structure, and wherein the instructions for detecting the appearance of the one or more features comprise:

instructions for detecting, by the neural network model via the analysis of the image data, at least a portion of the grid of fiducial markers that are visible on the gaming surface; and

instructions for determining, based on a detected orientation of the at least a portion of the grid of fiducial markers relative to known dimensions of the at least one physical feature, a homography matrix to automatically transform, based on the projection perspective and based on the specific coordinates of the grid structure, one or more dimensions of the gaming content to fit the designated area via the projecting.

Assignments (4)
SECURITY AGREEMENT Recorded May 23, 2025
From: LNW GAMING, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 071340/0404 →
SECURITY AGREEMENT Recorded Feb 28, 2025
From: LNW GAMING, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 070365/0460 →
CHANGE OF NAME Recorded Feb 7, 2023
From: SG GAMING, INC.
To: LNW GAMING, INC.
Reel/Frame 062669/0341 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2022
From: LYONS, MARTIN S.; KELLY, BRYAN
To: SG GAMING, INC.
Reel/Frame 061103/0534 →
Continuity (3)
Continuation 17319904 · May 13, 2021
Provisional Application 63050944 · Jul 13, 2020
Related Publication 20230005327A1 · Jan 5, 2023
References Cited (147)
US 5103081A · Fisher et al. · 1992 [cited by applicant]
US 5451054A · Orenstein · 1995 [cited by applicant]
US 5757876A · Dam et al. · 1998 [cited by applicant]
US 6460848B1 · Soltys et al. · 2002 [cited by applicant]
US 6514140B1 · Storch · 2003 [cited by applicant]
US 6517435B2 · Soltys et al. · 2003 [cited by applicant]
US 6517436B2 · Soltys et al. · 2003 [cited by applicant]
US 6520857B2 · Soltys et al. · 2003 [cited by applicant]
US 6527271B2 · Soltys et al. · 2003 [cited by applicant]
US 6530836B2 · Soltys et al. · 2003 [cited by applicant]
US 6530837B2 · Soltys et al. · 2003 [cited by applicant]
US 6533276B2 · Soltys et al. · 2003 [cited by applicant]
US 6533662B2 · Soltys et al. · 2003 [cited by applicant]
US 6579180B2 · Soltys et al. · 2003 [cited by applicant]
US 6579181B2 · Soltys et al. · 2003 [cited by applicant]
US 6595857B2 · Soltys et al. · 2003 [cited by applicant]
US 6663490B2 · Soltys et al. · 2003 [cited by applicant]
US 6688979B2 · Soltys et al. · 2004 [cited by applicant]
US 6712696B2 · Soltys et al. · 2004 [cited by applicant]
US 6758751B2 · Soltys et al. · 2004 [cited by applicant]
US 7011309B2 · Soltys et al. · 2006 [cited by applicant]
US 7124947B2 · Storch · 2006 [cited by applicant]
US 7316615B2 · Soltys et al. · 2008 [cited by applicant]
US 7753781B2 · Storch · 2010 [cited by applicant]
US 7771272B2 · Soltys et al. · 2010 [cited by applicant]
US 8130097B2 · Knust et al. · 2012 [cited by applicant]
US 8285034B2 · Rajaraman et al. · 2012 [cited by applicant]
US 8606002B2 · Rajaraman et al. · 2013 [cited by applicant]
US 8896444B1 · Knust et al. · 2014 [cited by applicant]
US 9165420B1 · Knust et al. · 2015 [cited by applicant]
US 9174114B1 · Knust et al. · 2015 [cited by applicant]
US 9378605B2 · Koyama · 2016 [cited by applicant]
US 9511275B1 · Knust et al. · 2016 [cited by applicant]
US 9795870B2 · Ratliff · 2017 [cited by applicant]
US 9811735B2 · Cosatto · 2017 [cited by applicant]
US 9889371B1 · Knust et al. · 2018 [cited by applicant]
US 10032335B2 · Shigeta · 2018 [cited by applicant]
US 10096206B2 · Bulzacki et al. · 2018 [cited by applicant]
US 10192085B2 · Shigeta · 2019 [cited by applicant]
US 10242525B1 · Knust et al. · 2019 [cited by applicant]
US 10242527B2 · Bulzacki et al. · 2019 [cited by applicant]
US 10304191B1 · Mousavian et al. · 2019 [cited by applicant]
US 10380838B2 · Bulzacki et al. · 2019 [cited by applicant]
US 10398202B2 · Shigeta · 2019 [cited by applicant]
US 10403090B2 · Shigeta · 2019 [cited by applicant]
US 10410066B2 · Bulzacki et al. · 2019 [cited by applicant]
US 10493357B2 · Shigeta · 2019 [cited by applicant]
US 10529183B2 · Shigeta · 2020 [cited by applicant]
US 10540846B2 · Shigeta · 2020 [cited by applicant]
US 10580254B2 · Shigeta · 2020 [cited by applicant]
US 10593154B2 · Shigeta · 2020 [cited by applicant]
US 10600279B2 · Shigeta · 2020 [cited by applicant]
US 10600282B2 · Shigeta · 2020 [cited by applicant]
US 10665054B2 · Shigeta · 2020 [cited by applicant]
US 10706675B2 · Shigeta · 2020 [cited by applicant]
US 10720013B2 · Main, Jr. · 2020 [cited by applicant]
US 10741019B2 · Shigeta · 2020 [cited by applicant]
US 10748378B2 · Shigeta · 2020 [cited by applicant]
US 10755524B2 · Shigeta · 2020 [cited by applicant]
US 10755525B2 · Shigeta · 2020 [cited by applicant]
US 10762745B2 · Shigeta · 2020 [cited by applicant]
US 10825288B1 · Knust et al. · 2020 [cited by applicant]
US 10832517B2 · Bulzacki et al. · 2020 [cited by applicant]
US 10846980B2 · French et al. · 2020 [cited by applicant]
US 10846985B2 · Shigeta · 2020 [cited by applicant]
US 10846986B2 · Shigeta · 2020 [cited by applicant]
US 10846987B2 · Shigeta · 2020 [cited by applicant]
US 11503275B2 · Kranski et al. · 2022 [cited by applicant]
US 11544989B1 · Seelig · 2023 [cited by examiner]
US 20040085451A1 · Chang · 2004 [cited by applicant]
US 20050059479A1 · Soltys et al. · 2005 [cited by applicant]
US 20060019739A1 · Soltys et al. · 2006 [cited by applicant]
US 20110115158A1 · Gagner et al. · 2011 [cited by applicant]
US 20110230248A1 · Baerlocher et al. · 2011 [cited by applicant]
US 20130001008A1 · Corona et al. · 2013 [cited by applicant]
US 20140357361A1 · Rajaraman · 2014 [cited by applicant]
US 20150199872A1 · George et al. · 2015 [cited by applicant]
US 20160089594A1 · Yee · 2016 [cited by applicant]
US 20160103176A1 · Zeise et al. · 2016 [cited by applicant]
US 20180040190A1 · Keilwert et al. · 2018 [cited by applicant]
US 20180053377A1 · Shigeta · 2018 [cited by applicant]
US 20180061178A1 · Shigeta · 2018 [cited by applicant]
US 20180068525A1 · Shigeta · 2018 [cited by applicant]
US 20180075698A1 · Shigeta · 2018 [cited by applicant]
US 20180114406A1 · Shigeta · 2018 [cited by applicant]
US 20180211110A1 · Shigeta · 2018 [cited by applicant]
US 20180211472A1 · Shigeta · 2018 [cited by applicant]
US 20180232987A1 · Shigeta · 2018 [cited by applicant]
US 20180239984A1 · Shigeta · 2018 [cited by applicant]
US 20180336757A1 · Shigeta · 2018 [cited by applicant]
US 20190043309A1 · Shigeta · 2019 [cited by applicant]
US 20190088082A1 · Shigeta · 2019 [cited by applicant]
US 20190102987A1 · Shigeta · 2019 [cited by applicant]
US 20190147689A1 · Shigeta · 2019 [cited by applicant]
US 20190172312A1 · Shigeta · 2019 [cited by applicant]
US 20190188957A1 · Bulzacki et al. · 2019 [cited by applicant]
US 20190188958A1 · Shigeta · 2019 [cited by applicant]
US 20190236891A1 · Shigeta · 2019 [cited by applicant]
US 20190259238A1 · Shigeta · 2019 [cited by applicant]
US 20190266832A1 · Shigeta · 2019 [cited by applicant]
US 20190318576A1 · Shigeta · 2019 [cited by applicant]
US 20190320768A1 · Shigeta · 2019 [cited by applicant]
US 20190333322A1 · Shigeta · 2019 [cited by applicant]
US 20190333323A1 · Shigeta · 2019 [cited by applicant]
US 20190333326A1 · Shigeta · 2019 [cited by applicant]
US 20190340873A1 · Shigeta · 2019 [cited by applicant]
US 20190344157A1 · Shigeta · 2019 [cited by applicant]
US 20190347893A1 · Shigeta · 2019 [cited by applicant]
US 20190347894A1 · Shigeta · 2019 [cited by applicant]
US 20190362594A1 · Shigeta · 2019 [cited by applicant]
US 20190371112A1 · Shigeta · 2019 [cited by applicant]
US 20190392680A1 · Shigeta · 2019 [cited by applicant]
US 20200034629A1 · Vo et al. · 2020 [cited by applicant]
US 20200035060A1 · Shigeta · 2020 [cited by applicant]
US 20200065618A1 · Zhang · 2020 [cited by applicant]
US 20200118390A1 · Shigeta · 2020 [cited by applicant]
US 20200122018A1 · Shigeta · 2020 [cited by applicant]
US 20200175806A1 · Shigeta · 2020 [cited by applicant]
US 20200202134A1 · Bulzacki et al. · 2020 [cited by applicant]
US 20200226878A1 · Shigeta · 2020 [cited by applicant]
US 20200234464A1 · Shigeta · 2020 [cited by applicant]
US 20200242888A1 · Shigeta · 2020 [cited by applicant]
US 20200258351A1 · Shigeta · 2020 [cited by applicant]
US 20200265672A1 · Shigeta · 2020 [cited by applicant]
US 20200273289A1 · Shigeta · 2020 [cited by applicant]
US 20200294346A1 · Shigeta · 2020 [cited by applicant]
US 20200302168A1 · Vo et al. · 2020 [cited by applicant]
US 20200342281A1 · Shigeta · 2020 [cited by applicant]
US 20200349806A1 · Shigeta · 2020 [cited by applicant]
US 20200349807A1 · Shigeta · 2020 [cited by applicant]
US 20200349808A1 · Shigeta · 2020 [cited by applicant]
US 20200349809A1 · Shigeta · 2020 [cited by applicant]
US 20200349810A1 · Shigeta · 2020 [cited by applicant]
US 20200349811A1 · Shigeta · 2020 [cited by applicant]
US 20200364979A1 · Shigeta · 2020 [cited by applicant]
US 20200372746A1 · Shigeta · 2020 [cited by applicant]
US 20200372752A1 · Shigeta · 2020 [cited by applicant]
US 20220327886A1 · Mathur · 2022 [cited by examiner]
US 20220383698A1 · Lyons · 2022 [cited by examiner]
US 20240013617A1 · Arbogast · 2024 [cited by examiner]
CN 111145259A · 2020 [cited by applicant]
KR 1020160088224A · 2016 [cited by applicant]
WO 2009062153A1 · 2009 [cited by applicant]
WO 2021104153A1 · 2021 [cited by applicant]
US 10,854,041 B2, 12/2020, Shigeta (withdrawn) [cited by applicant]
China National Intellectual Property Administration, “First Office Action,” Application No. 2021107764872, Jul. 4, 2024, 16 pages (Chinese Version). [cited by applicant]
China National Intellectual Property Administration, “First Office Action,” Application No. 2021107764872, Jul. 4, 2024, 16 pages (English Version). [cited by applicant]