IP Library Granted Patent US 10,922,891
Granted Patent B2
US 10,922,891 · App. 16/352,333 · Granted Feb 16, 2021

Method for generating an augmented representation of a real environment, corresponding device, computer program product, and computer-readable carrier medium

Inventors: Tao Luo (Beijing, CN); Philippe Robert (Rennes, FR); Anthony Laurent (Vignoc, FR)
Assignee: INTERDIGITAL CE PATENT HOLDINGS
G06T19/006G02B27/017G06F3/011G06F3/012G06F3/04815G02B2027/014G02B2027/0138G06T2200/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,922,891
App. No.
16/352,333
Granted
Feb 16, 2021
Kind
B2
Abstract

The disclosure relates to a method for generating an augmented representation of a real environment, called an augmented reality representation. Such a method includes obtaining, as a function of said real environment, a virtual boundary dividing the real environment into two spaces, respectively called an activity space and a mixed space. The augmented reality representation is generated by obtaining a first part of the augmented reality representation, called an activity part, corresponding to a representation of at least one part of the activity space. Thereafter, obtaining a second part of the augmented reality representation, called a mixed part, corresponding to an augmented representation of at least one part of the mixed space, in which at least one virtual content is combined with the representation of at least one part of the mixed space.

Claims (33)

1. A method for generating an augmented representation of a real environment comprising at least one real object, the method comprising:

obtaining a virtual boundary as a function of data associated with the at least one real object of the real environment and as a function of a difference between a scale of the real environment and a scale of a default virtual scene comprising virtual content, the virtual boundary dividing the real environment into an activity space and a mixed space;

generating the augmented representation comprising:

obtaining a first part of the augmented representation corresponding to a representation of at least one part of the activity space being free of virtual content;

obtaining a second part of the augmented representation corresponding to an augmented representation of at least one part of the mixed space, in which the virtual content is combined with a representation of at least one part of the mixed space.

2. The method according to claim 1 , wherein the virtual boundary is obtained as a function of a shape of the at least one real object.

3. The method according to claim 1 , wherein the at least one real object is a moving object, and wherein the virtual boundary is obtained dynamically as a function of the at least one moving real object.

4. The method according to claim 1 , wherein obtaining the virtual boundary comprises obtaining the virtual boundary as a function of a category of the real environment.

5. The method according to claim 1 , wherein the data associated with the at least one object comprise a position of a user of the augmented representation within the real environment.

6. The method according to claim 1 , wherein the data associated with the at least one object comprises at least one of a current height and a current posture of a user of the augmented representation.

7. The method according to claim 1 , wherein obtaining the second part of the augmented representation comprises scaling the at least one virtual content as a function of at least one difference between a size of the default virtual scene comprising the at least one virtual content and a size of the real environment in the mixed space.

8. The method according to claim 7 , wherein the at least one virtual content is scaled as a function of a difference between a size of a virtual ground area of the default virtual scene and a size of a real ground area of the real environment in the mixed space.

9. The method according to claim 1 , wherein at least one virtual content in the second part is obtained by taking account of a representation of the at least one real object in the first part.

10. The method according to claim 1 , further comprising alerting a user of the augmented representation when a distance between the user and the virtual boundary is lower than a predetermined threshold.

11. A non-transitory computer-readable medium including program code instructions for generating an augmented representation of a real environment, wherein the program code instructions perform:

obtaining a virtual boundary as a function of data associated with the at least one real object of the real environment and as a function of a difference between a scale of the real environment and a scale of a default virtual scene comprising virtual content, the virtual boundary dividing the real environment into an activity space and a mixed space;

generating the augmented representation comprising:

obtaining a first part of the augmented representation corresponding to a representation of at least one part of the activity space and being free of virtual content;

obtaining a second part of the augmented representation corresponding to an augmented representation of at least one part of the mixed space, in which the virtual content is combined with a representation of at least one part of the mixed space.

12. A device for generating an augmented representation of a real environment comprising at least one real object, the device comprising at least one processor adapted and configured to:

obtain a virtual boundary as a function of data associated with the at least one real object of the real environment and as a function of a difference between a scale of the real environment and a scale of a default virtual scene comprising virtual content, the virtual boundary dividing the real environment into an activity space and a mixed space;

generate the augmented representation comprising:

obtaining a first part of the augmented representation corresponding to a representation of at least one part of the activity space and being free of virtual content;

obtaining a second part of the augmented representation corresponding to an augmented representation of at least one part of the mixed space, in which the virtual content is combined with the representation of at least one part of the mixed space.

13. The device according to claim 12 , wherein the virtual boundary is obtained as a function of a shape of the at least one real object.

14. The device according to claim 12 , wherein the at least one real object is a moving object, and wherein the virtual boundary is obtained dynamically as a function of the at least one moving real object.

15. The device according to claim 12 , wherein obtaining the virtual boundary comprises obtaining the virtual boundary as a function of a category of the real environment.

16. The device according to claim 12 , wherein the data associated with the at least one object comprise a position of a user of the augmented representation within the real environment.

17. The device according to claim 12 , wherein the data associated with the at least one object comprises at least one of a current height and a current posture of a user of the augmented representation.

18. The device according to claim 12 , wherein obtaining the second part of the augmented representation comprises scaling the at least one virtual content as a function of at least one difference between a size of the default virtual scene comprising the at least one virtual content and a size of the real environment in the mixed space.

19. The device according to claim 18 , wherein the at least one virtual content is scaled as a function of a difference between a size of a virtual ground area of the default virtual scene and a size of a real ground area of the real environment in the mixed space.

20. The device according to claim 12 , wherein at least one virtual content in the second part is obtained by taking account of a representation of the at least one real object in the first part.

21. The device according to claim 12 , comprising an output device for alerting a user of the augmented representation when a distance between the user and the virtual boundary is lower than a predetermined threshold.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2022
From: INTERDIGITAL CE PATENT HOLDINGS, SAS
To: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
Reel/Frame 060310/0350 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2021
From: LUO, TAO; ROBERT, PHILIPPE; LAURENT, ANTHONY
To: INTERDIGITAL CE PATENT HOLDINGS
Reel/Frame 054865/0147 →
Priority Claims (1)
EP 18305267 · Mar 13, 2018 · regional
Continuity (1)
Related Publication 20190287308A1 · Sep 19, 2019