IP Library › Granted Patent US 12,746,455
Granted Patent B2
US 12,746,455 · App. 18/050,381 · Granted Sep 29, 2026

Augmented reality physical card games

Inventors: Sharon Moll (Lachen, CH); Pawel Wawruch (Yverdon-les-Bains, CH); Piotr Gurgul (Hergiswil, CH)
Assignee: Snap Inc.
A63F1/04A63F1/02G06F3/011G06F3/017A63F2001/008A63F2001/022A63F2001/0491
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,746,455
App. No.
18/050,381
Granted
Sep 29, 2026
Kind
B2
Abstract

Systems, methods, and computer readable media for augmented reality (AR) physical card games. Examples capture an image of a user view of a real-world scene and process the image to determine the locations and codes of physical cards within the image. Overlays are determined for the cards based on the codes. An AR graphics component displays on a display of an AR wearable device the overlays adjusted in accordance with the user view. The overlays may be images, animations, or videos. A card game is downloaded onto the AR wearable device. The card game includes rules that keep track of a score, assist with play, and insure fair play. The card game includes user interfaces that may be shared among the players. Methods include manufacturing the playing cards with computer-readable codes to identify the cards.

Claims (68)

1 . A method performed on an augmented reality (AR) wearable device, the method comprising:

capturing, by an image capturing device of the AR wearable device, an image corresponding to a user view of a real-world scene;

accessing, in a memory of the AR wearable device, data indicating a card within the image and a location of the card, the card comprising a code;

receiving, from a host device via a wireless network, a card assignment generated by the host device for a game session, the card assignment dynamically mapping a plurality of codes printed on a plurality of cards to a plurality of overlays, selected from a plurality of games, wherein a same code of the plurality of codes is mapped to different overlays in different game sessions, each card of the plurality of cards comprising a different code;

determining an overlay for the card based on the card assignment and the code;

adjusting a shape of the overlay based on the location of the card and a user view; and

displaying, on a display of the AR wearable device, the overlay for the card, wherein a position of the overlay is based on the location of the card and the user view, the overlay replacing a visual appearance of a face of the card as seen through the display of the AR wearable device.

2 . The method of claim 1 further comprising:

determining a gesture performed by a user of the AR wearable device related to the card;

determining a rule associated with the gesture; and

performing the rule.

3 . The method of claim 2 wherein the gesture is play the card and the rule comprises:

in response to an end of hand condition, determine which user of a plurality of users, comprising the user, won a hand indicated by the end of hand condition, and adjusting a score.

4 . The method of claim 2 wherein the gesture is play the card and the rule comprises:

in response to a card being incorrectly play condition, displaying on a display of the AR wearable device an indication that the card is being incorrectly played.

5 . The method of claim 2 further comprising:

determining a gesture performed by the user is laying out a plurality of cards for a game; and

in response to a number of the plurality of cards being a same number as a number of cards to play the game, determining a card assignment, wherein the card assignment assigns each of the plurality of cards an overlay of a plurality of overlays, and wherein each of the plurality of cards is identified based on each of the plurality of cards comprising a different code.

6 . The method of claim 1 wherein the overlay is a video that the AR wearable device plays on the card, the overlay is an image, or the overlay is an animated image.

7 . The method of claim 1 wherein the overlay is a first overlay and wherein the method further comprises:

in response to determining that a condition of a rule is satisfied, changing the first overlay to a second overlay.

8 . The method of claim 1 wherein the code is on at least one face of the card or on at least one edge of the card.

9 . The method of claim 1 further comprising:

receiving an indication of a selection of a game from a user of the AR wearable device;

downloading the game, the game comprising the overlay; and

running the game.

10 . The method of claim 9 wherein the user is a first user and the AR wearable device is a first AR wearable device, and wherein the method further comprises:

receiving from a second AR wearable device an indication of a request from a second user to join the game; and

adding the second user and the second AR wearable device to the game.

11 . The method of claim 10 further comprising:

sending the card assignment to the second AR wearable device.

12 . The method of claim 11 wherein the user played the card and wherein the method further comprises:

sending to the second AR wearable device an indication that the user played the card and an indication of the code.

13 . The method of claim 1 further comprising:

sending an indication to join a game to a computing device;

receiving an acceptance to join the game from the computing device; and

running the game comprising the overlay.

14 . An augmented reality (AR) wearable device comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, configure the AR wearable device to perform operations comprising:

capturing, by an image capturing device of the AR wearable device, an image corresponding to a user view of a real-world scene;

accessing, in a memory of the AR wearable device, data indicating a card within the image and a location of the card, the card comprising a code;

receiving, from a host device via a wireless network, a card assignment generated by the host device for a game session, the card assignment dynamically mapping a plurality of codes printed on a plurality of cards to a plurality of overlays, selected from a plurality of games, wherein a same code of the plurality of codes is mapped to different overlays in different game sessions, each card of the plurality of cards comprising a different code;

determining an overlay for the card based on the card assignment and the code;

adjusting a shape of the overlay based on the location of the card and a user view; and

displaying, on a display of the AR wearable device, the overlay for the card, wherein a position of the overlay is based on the location of the card and the user view, the overlay replacing a visual appearance of a face of the card as seen through the display of the AR wearable device.

15 . The AR wearable device of claim 14 wherein the operations further comprise:

determining a gesture performed by a user of the AR wearable device related to the card;

determining a rule associated with the gesture; and

performing the rule.

16 . The AR wearable device of claim 15 wherein the gesture is play the card and the rule comprises:

in response to an end of hand condition, determine which user of a plurality of users, comprising the user, won a hand indicated by the end of hand condition, and adjust a score.

17 . The AR wearable device of claim 15 wherein the gesture is play the card and the rule comprises:

In response to a card being incorrectly play condition, displaying on a display of the AR wearable device an indication that the card is being incorrectly played.

18 . The AR wearable device of claim 17 wherein the operations further comprise:

determining a gesture performed by the user is laying out a plurality of cards for a game; and

in response to a number of the plurality of cards being a same number as a number of cards to play the game, determining a card assignment, wherein the card assignment assigns each of the plurality of cards an overlay of a plurality of overlay, and wherein each of the plurality of cards is identified based on each of the plurality of cards comprising a different code.

19 . A non-transitory computer-readable storage medium that stores instructions for execution by at least one processor of an augmented reality (AR) wearable device, the instructions to configure the at least one processor to:

capturing, by an image capturing device of the AR wearable device, an image corresponding to a user view of a real-world scene;

accessing, in a memory of the AR wearable device, data indicating a card within the image and a location of the card, the card comprising a code;

receiving, from a host device via a wireless network, a card assignment generated by the host device for a game session, the card assignment dynamically mapping a plurality of codes printed on a plurality of cards to a plurality of overlays, selected from a plurality of games, wherein a same code of the plurality of codes is mapped to different overlays in different game sessions, each card of the plurality of cards comprising a different code;

determining an overlay for the card based on the card assignment and the code;

adjusting a shape of the overlay based on the location of the card and a user view; and

displaying, on a display of the AR wearable device, the overlay for the card, wherein a position of the overlay is based on the location of the card and the user view, the overlay replacing a visual appearance of a face of the card as seen through the display of the AR wearable device.

20 . The non-transitory computer-readable storage medium of claim 19 , wherein the at least one processor is further configured to:

determining a gesture performed by a user of the AR wearable device related to the card;

determining a rule associated with the gesture; and

performing the rule.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2022
From: MOLL, SHARON; WAWRUCH, PAWEL; GURGUL, PIOTR
To: SNAP INC.
Reel/Frame 061567/0239 →
Continuity (1)
Related Publication 20240139611A1 · May 2, 2024
References Cited (111)
US 7971156B2 · Albertson et al. · 2011 [cited by applicant]
US 7996793B2 · Latta et al. · 2011 [cited by applicant]
US 8152637B2 · Watanabe · 2012 [cited by examiner]
US 8487938B2 · Latta et al. · 2013 [cited by applicant]
US 8856691B2 · Geisner et al. · 2014 [cited by applicant]
US 9225897B1 · Sehn et al. · 2015 [cited by applicant]
US 9230160B1 · Kanter · 2016 [cited by applicant]
US 9276886B1 · Samaranayake · 2016 [cited by applicant]
US 9705831B2 · Spiegel · 2017 [cited by applicant]
US 9742713B2 · Spiegel et al. · 2017 [cited by applicant]
US 10102423B2 · Shaburov et al. · 2018 [cited by applicant]
US 10284508B1 · Allen et al. · 2019 [cited by applicant]
US 10439972B1 · Spiegel et al. · 2019 [cited by applicant]
US 10509466B1 · Miller et al. · 2019 [cited by applicant]
US 10514876B2 · Sehn · 2019 [cited by applicant]
US 10579869B1 · Xiong et al. · 2020 [cited by applicant]
US 10614855B2 · Huang · 2020 [cited by applicant]
US 10748347B1 · Li et al. · 2020 [cited by applicant]
US 10958608B1 · Allen et al. · 2021 [cited by applicant]
US 10962809B1 · Castañeda · 2021 [cited by applicant]
US 10996846B2 · Robertson et al. · 2021 [cited by applicant]
US 10997787B2 · Ge et al. · 2021 [cited by applicant]
US 11012390B1 · Al Majid et al. · 2021 [cited by applicant]
US 11030454B1 · Xiong et al. · 2021 [cited by applicant]
US 11036368B1 · Al Majid et al. · 2021 [cited by applicant]
US 11062498B1 · Voss et al. · 2021 [cited by applicant]
US 11087728B1 · Canberk et al. · 2021 [cited by applicant]
US 11092998B1 · Castañeda et al. · 2021 [cited by applicant]
US 11106342B1 · Al Majid et al. · 2021 [cited by applicant]
US 11126206B2 · Meisenholder et al. · 2021 [cited by applicant]
US 11143867B2 · Rodriguez, II · 2021 [cited by applicant]
US 11169600B1 · Canberk et al. · 2021 [cited by applicant]
US 11227626B1 · Krishnan Gorumkonda et al. · 2022 [cited by applicant]
US 11307747B2 · Dancie et al. · 2022 [cited by applicant]
US 11531402B1 · Stolzenberg · 2022 [cited by applicant]
US 11546505B2 · Canberk · 2023 [cited by applicant]
US 20030062675A1 · Noro · 2003 [cited by examiner]
US 20060073892A1 · Watanabe · 2006 [cited by examiner]
US 20090012788A1 · Gilbert et al. · 2009 [cited by applicant]
US 20110301934A1 · Tardif · 2011 [cited by applicant]
US 20120083325A1 · Heatherly · 2012 [cited by examiner]
US 20120218298A1 · Hayakawa · 2012 [cited by examiner]
US 20130083066A1 · Aoki · 2013 [cited by examiner]
US 20130123009A1 · Maharbiz · 2013 [cited by examiner]
US 20140121015A1 · Massing · 2014 [cited by examiner]
US 20140171036A1 · Simmons · 2014 [cited by applicant]
US 20150120293A1 · Wohlert et al. · 2015 [cited by applicant]
US 20150370320A1 · Connor · 2015 [cited by applicant]
US 20160078683A1 · Sudol · 2016 [cited by examiner]
US 20160361642A1 · Linden · 2016 [cited by examiner]
US 20170123487A1 · Hazra et al. · 2017 [cited by applicant]
US 20170277684A1 · Dharmarajan Mary · 2017 [cited by applicant]
US 20170277685A1 · Takumi · 2017 [cited by applicant]
US 20170326462A1 · Lyons · 2017 [cited by examiner]
US 20170351910A1 · Elwazer et al. · 2017 [cited by applicant]
US 20180043259A1 · Wong · 2018 [cited by examiner]
US 20180158370A1 · Pryor · 2018 [cited by applicant]
US 20180214767A1 · Oh · 2018 [cited by applicant]
US 20200001168A1 · Gerhard · 2020 [cited by examiner]
US 20200043233A1 · Nelson · 2020 [cited by examiner]
US 20200067998A1 · Pilnock · 2020 [cited by examiner]
US 20200285854A1 · Merchant et al. · 2020 [cited by applicant]
US 20210011612A1 · Dancie et al. · 2021 [cited by applicant]
US 20210074016A1 · Li et al. · 2021 [cited by applicant]
US 20210166732A1 · Shaburova et al. · 2021 [cited by applicant]
US 20210174034A1 · Retek et al. · 2021 [cited by applicant]
US 20210241529A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303075A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303077A1 · Anvaripour et al. · 2021 [cited by applicant]
US 20210303140A1 · Mourkogiannis · 2021 [cited by applicant]
US 20210382564A1 · Blachly et al. · 2021 [cited by applicant]
US 20210397000A1 · Rodriguez, II · 2021 [cited by applicant]
US 20210405761A1 · Canberk · 2021 [cited by applicant]
US 20220188539A1 · Chan et al. · 2022 [cited by applicant]
US 20220206588A1 · Canberk et al. · 2022 [cited by applicant]
US 20220300730A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220300731A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220326781A1 · Hwang et al. · 2022 [cited by applicant]
US 20220334649A1 · Hwang et al. · 2022 [cited by applicant]
US 20230010603A1 · Shigeta · 2023 [cited by examiner]
CN 103049761 · 2016 [cited by applicant]
EP 3707693 · 2020 [cited by applicant]
JP 2014155861A · 2014 [cited by examiner]
JP 5925347B1 · 2016 [cited by examiner]
JP 2016093521A · 2016 [cited by examiner]
KR 20110110379A · 2011 [cited by applicant]
KR 20170047943A · 2017 [cited by examiner]
KR 20220158824 · 2022 [cited by applicant]
WO WO2013141349A1 · 2013 [cited by examiner]
WO 2016168591 · 2016 [cited by applicant]
WO WO2017069396A1 · 2017 [cited by examiner]
WO 2019094618 · 2019 [cited by applicant]
WO 2022005687 · 2022 [cited by applicant]
WO 2022005693 · 2022 [cited by applicant]
WO 2022060549 · 2022 [cited by applicant]
WO 2022066578 · 2022 [cited by applicant]
WO 2022132381 · 2022 [cited by applicant]
WO 2022146678 · 2022 [cited by applicant]
WO 2022198182 · 2022 [cited by applicant]
WO 2022216784 · 2022 [cited by applicant]
WO 2022225761 · 2022 [cited by applicant]
WO 2022245765 · 2022 [cited by applicant]
“International Application Serial No. PCT/US2023/035928, International Preliminary Report on Patentability mailed May 8, 2025”, 11 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/035928, International Search Report mailed Feb. 9, 2024”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/035928, Written Opinion mailed Feb. 9, 2024”, 9 pgs. [cited by applicant]
“The Eye of Judgment”, Wikipedia, (Oct. 7, 2022). [cited by applicant]
Haruhiro, Katayose, “ARMS: A Trading Card Game using AR Technology”, Proceedings of the 2005 ACM Sigchi International Conference on Advances In Computer Entertainment Technology, Ace '05, Acm Press, New York, New York, … [cited by applicant]
Hidehiko, Okada, et al., “Application and evaluation of augmented reality user interface to a card game Scopa”, Sice Annual Conference (SICE), 2011 Proceedings of, IEEE, (Sep. 13, 2011), 2127-2130. [cited by applicant]
Kuchera, Ben, “Let your geek flag fly: a review of Eye of Judgment / Ars Technica”, [Online]. Retrieved from the Internet: <https://arstechnica.com/gaming/2007/10/eyeofjudgment-ars>, (Oct. 24, 2007). [cited by applicant]
Myojin, Seiko, et al., “Augmented reality card game based on user-specific information control”, Theory of Computing, ACM, 2 Penn Plaza, Suite 701 New York NY 10121-0701 USA, (Oct. 29, 2012), 1193-1196. [cited by applicant]
“European Application Serial No. 23809814.9, Response to Communication pursuant to Rules 161(1) and 162 EPC filed Nov. 24, 2025”, 20 pgs. [cited by applicant]