IP Library › Granted Patent US 12,148,102
Granted Patent B2
US 12,148,102 · App. 17/411,989 · Granted Nov 19, 2024

Dynamic augmentation of stimuli based on profile of user

Inventor: Jorge Arroyo Palacios (Livermore, CA)
Assignee: Sony Interactive Entertainment Inc.
G06T19/006G02B27/0172G06F18/214G06T7/50G06T13/40G06T17/20G06V20/10G06V40/10G06V40/168G06V40/174G06V40/20G02B2027/0138G06T2207/10028G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,148,102
App. No.
17/411,989
Filed
Aug 25, 2021
Granted
Nov 19, 2024
Kind
B2
Examiner
LHYMN, SARAH
Art Unit
2613
USPC
345/423
Abstract

A method for augmenting a real-world scene viewed through augmented reality (AR) glasses includes determining that an overlay should be processed for a real-world person being viewed via the AR glasses, with the determining using artificial intelligence (AI) to identify a trigger scenario. The AI is configured to process a video stream of images captured of the real-world person using a camera of the AR glasses to identify the trigger scenario, which is associated with an intensity level exhibited by the real-world person. The method also includes identifying the overlay to replace a portion of the real-world person in the video stream of images, and generating an augmented video stream that includes the video stream composited with the overlay. The augmented video stream being presented via the AR glasses is configured to adjust the intensity level exhibited by the real-world person when viewed via the AR glasses.

Claims (10)

1. A method for augmenting a real-world scene viewed through augmented reality (AR) glasses, comprising:

capturing a video stream of images of a real-world person using a camera of the AR glasses;

determining that an overlay should be processed for an arm or a leg of the real-world person being viewed via the augmented reality (AR) glasses, the determining using artificial intelligence (AI) to identify a trigger scenario associated with the arm or the leg of the real-world person from the video stream of images, the trigger scenario being associated with an intensity level of movement of the arm or leg of the real-world person;

identifying the overlay to replace the arm or the leg of the real-world person in the video stream of images, the arm or the leg being associated with a rig of joints of the real-world person, and the arm or the leg being further associated with a mesh that defines a three-dimensional outline of a shape of the arm or the leg, the overlay being configured to mask the portion of the arm or the leg and replace the portion of the arm or the portion of the leg, and the overlay that replaces the portion of the arm or the portion of the leg includes animation that changes a range of motion of the movement of the arm or leg of the real-world person when viewed via the AR glasses; and

generating an augmented video stream that includes the video stream composited with the overlay, the augmented video stream being presented via the AR glasses instead of the video stream of images captured by the camera, the augmented video stream presenting an adjusted intensity level based on said animation to avoid presenting the arm or the leg of the real-world person that is identified to be associated with the trigger scenario via the AR glasses.

2. The method of claim 1 , wherein changing the range of motion of the movement of the arm or the leg of the real-world person adjusts the intensity level of the movement of the arm or leg of the real-world person when viewed via the AR glasses.

3. The method of claim 2 , wherein the overlay is an animated overlay that adjusts the intensity level of the movement of the arm or leg of the real-world person when viewed via the AR glasses by adjusting an amplitude of the movement of the arm or the leg.

4. The method of claim 2 , wherein the overlay is an animated overlay that adjusts the intensity level of the movement of the arm or leg of the real-world person when viewed via the AR glasses by adjusting a frequency of the movement of the arm or the leg.

5. The method of claim 2 , wherein the overlay is an animated overlay that adjusts the intensity level of the movement of the arm or the leg of the real-world person when viewed via the AR glasses by adjusting an amplitude of the movement of the arm or the leg and adjusting a frequency of the movement of the arm or the leg.

6. The method of claim 2 , wherein the overlay is an animated overlay that adjusts the intensity level of the movement of the arm or the leg of the real-world person when viewed via the AR glasses by reducing an amplitude of the movement of the arm or the leg and reducing a frequency of the movement of the arm or the leg.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2021
From: PALACIOS, JORGE ARROYO
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 057291/0682 →
Continuity (1)
Related Publication 20230063681A1 · Mar 2, 2023
Cited By (1)
US 12,646,182