IP Library Granted Patent US 12,423,863
Granted Patent B2
US 12,423,863 · App. 18/208,086 · Granted Sep 23, 2025

Computer implemented method and system for providing an augmented reality entertainment environment

Inventors: Pedro Federico Quijada Leyton (London, GB); David Erwan Damien Uberti (London, GB); Lloyd Preston Stemple (London, GB); Aron Giuseppe Visciglia (London, GB)
Assignee: Sony Interactive Entertainment Europe Limited
G06T7/73A63F13/52A63F13/5372G06T11/00G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,423,863
App. No.
18/208,086
Granted
Sep 23, 2025
Kind
B2
Abstract

A method and system are provided which enable an object, known or unknown, to be augmented with additional visual elements. This may provide a more immersive experience, for example, when gaming or viewing content.

Claims (22)

1. A computer-implemented method for providing an augmented reality entertainment environment, the method implemented by a processing resource, the method comprising the steps of:

initialising the augmented reality entertainment environment at a location;

determining the presence of a physical object;

determining whether the physical object is a known or unknown physical object and, if the physical object is determined to be known, retrieving position tracking data for the object; generating at least one visual element for rendering in the augmented reality entertainment environment; rendering the visual element in the augmented reality environment relative to the location of the physical object; and, if the physical object is determined to be unknown, identifying the object, generating position tracking data for the object to track the position of the object; generating at least one visual element for rendering in the augmented reality entertainment environment; and rendering the visual element in the augmented reality environment relative to the location of the physical object.

2. The method of claim 1 , wherein the generation of the visual element for rendering in the augmented reality entertainment environment comprises generation of a graphical overlay.

3. The method of claim 2 , wherein the graphical overlay is dimensioned to at least partially cover the physical object.

4. The method of claim 2 , wherein the graphical overlay is at least partially animated.

5. The method of claim 2 , wherein the generation of the graphical overlay is based on content being displayed in the augmented reality entertainment environment.

6. The method of claim 2 , wherein the generation of the graphical overlay is based on content being displayed on the physical object.

7. The method of claim 2 , wherein the generation of the graphical overlay is based on an in-game element for a game being played by at least one user of the augmented reality entertainment environment.

8. The method of claim 7 , wherein the at least one visual element comprises a stream of information.

9. The method of claim 8 , wherein the stream of information is based on content being displayed in the augmented reality entertainment environment.

10. The method of claim 9 , wherein the stream of information comprises subtitles related to the content being displayed in the augmented reality entertainment environment.

11. The method of claim 10 , wherein the subtitles are provided in a language determined by a user profile.

12. The method of claim 8 , wherein the at least one visual element comprises content from a source external to the augmented reality entertainment environment.

13. The method of claim 12 wherein the content from the external source comprises a social media feed.

14. The method of claim 1 , wherein the physical object is identified based on a trained model.

15. The method of claim 1 , wherein rendering the visual element in the augmented reality entertainment environment comprises synchronising the position of the visual element with the identified position of the physical object.

16. The method of claim 1 , wherein rendering the visual element in the augmented reality entertainment environment comprises locating the visual element adjacent to the physical object.

17. The method of claim 1 , wherein the visual element comprises control indicia for content being displayed in the augmented reality entertainment environment.

18. The method of claim 17 , wherein the control indicia is located adjacent to the physical object.

19. A system configured to implement the method of claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2023
From: LEYTON, PEDRO FEDERICO QUIJADA; UBERTI, DAVID ERWAN DAMIEN; STEMPLE, LLOYD PRESTON; VISCIGLIA, ARON GIUSEPPE
To: SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED
Reel/Frame 063913/0166 →
Priority Claims (1)
GB 2208505 · Jun 10, 2022 · national
Continuity (1)
Related Publication 20230401739A1 · Dec 14, 2023
References Cited (18)
US 20150097862A1 · Reisner-Kollmann et al. · 2015 [cited by applicant]
US 20150187108A1 · Mullins · 2015 [cited by applicant]
US 20170278304A1 · Hildreth et al. · 2017 [cited by applicant]
US 20180008141A1 · Krueger · 2018 [cited by examiner]
US 20180173323A1 · Harvey · 2018 [cited by examiner]
US 20180300897A1 · Woods · 2018 [cited by examiner]
US 20190347846A1 · Olson et al. · 2019 [cited by applicant]
US 20200184653A1 · Faulkner · 2020 [cited by applicant]
US 20200334908A1 · Wilson et al. · 2020 [cited by applicant]
US 20200368616A1 · Delamont · 2020 [cited by applicant]
CN 114120067A · 2022 [cited by applicant]
CN 114254663A · 2022 [cited by applicant]
CN 114548279A · 2022 [cited by applicant]
WO 2015175730A1 · 2015 [cited by applicant]
WO 2019043568A1 · 2019 [cited by applicant]
WO 2022005850A1 · 2022 [cited by applicant]
UK IPO Combined Search and Examination Report received in Application No. GB2208505.4, date of search Dec. 16, 2022, in 7 pages. [cited by applicant]
Extended European Search Report received in corresponding EP Application No. 23174666.0, dated Oct. 30, 2023, in 9 pages. [cited by applicant]