IP Library Granted Patent US 11,386,632
Granted Patent B2
US 11,386,632 · App. 17/367,645 · Granted Jul 12, 2022

Augmented reality apparatus, system and method, and computer-readable storage medium

Inventors: Kai Xiao (Beijing, CN); Qi Zheng (Beijing, CN); Zhongsheng Hong (Beijing, CN); Jia Han (Beijing, CN)
Assignee: SONY GROUP CORPORATION
G06T19/006G01C21/206G02B27/01G06T19/003G02B2027/014G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,386,632
App. No.
17/367,645
Granted
Jul 12, 2022
Kind
B2
Abstract

An electronic apparatus, a wireless communication system, a wireless communication method, and a computer-readable storage medium are provided. The electronic apparatus includes a processing circuit configured to: determine a current audiovisual angle of a user; compare the current audiovisual angle of the user with an expected audiovisual angle, and generate indication information for directing the user to the expected audiovisual angle, and provide the indication information to the user. The indication information directs the user to the expected audiovisual angle by using a direct direction indication and an indirect direction indication. With the electronic apparatus, the wireless communication system, the wireless communication method, and the computer-readable storage medium, the user can obtain a better visual feeling, and thus the user experience can be improved.

Claims (82)

1. An electronic apparatus associated with a user, comprising processing circuit configured to:

acquire an expected direction of a user based on at least one of a current location or a current viewing angle of the user;

provide a first indication and a second indication for directing the user to the expected direction;

wherein the first indication is a direct direction indication and the second indication is an indirect direction indication, and

wherein the indirect direction indication indicates information associated with an area in the direction of the expected direction;

display an object to the user when the user goes toward the expected direction; and

provide information associated with the object based on a distance between the user and the object,

wherein the information associated with the object includes at least one of visual content or sound content.

2. The electronic apparatus according to claim 1 , wherein the information associated with the area in the direction of the expected direction comprised light brightness information associated with the area.

3. The electronic apparatus according to claim 1 , wherein the object is associated with a real object.

4. The electronic apparatus according to claim 1 , wherein the sound content is a sound associated with one or more actual sounds that can be heard by the user according to the distance between the user and the object.

5. The electronic apparatus according to claim 1 , wherein the processing circuit is further configured to:

provide sound not associated with the object as the sound content when the distance between the user and the object satisfies a first condition; and

provide sound associated with the object as the sound content when the distance between the user and the object satisfies a second condition.

6. The electronic apparatus according to claim 1 , wherein the processing circuit is further configured to:

provide first visual content based on a first distance between the user and the object; and

provide second visual content based on a second distance longer than the first distance between the user and the object.

7. The electronic apparatus according to claim 1 , wherein the processing circuit is further configured to provide a display mode conversion icon as at least part of the visual content based on the distance between the user and the object satisfying a condition.

8. The electronic apparatus according to claim 1 ,

wherein the information associated with the area in the direction of the expected direction further includes sound information associated with the area and animation information associated with the area,

wherein a portion of the sound information is a sound information from an aural source located in the area and that can be heard in a case that the user is located in the area,

wherein the light information associated with the area is a light information from a visual source located in the area and that can be seen in a case that the user is located in the area, and

wherein a portion of the animation information is related to a visual source located in the area and that can be seen in a case that the user is located in the area.

9. The electronic apparatus according to claim 1 , wherein the processing circuit is further configured to:

determine the current location and the viewing angle of the user;

transmit the current location and the viewing angle to a server; and

receive control information from the server regarding the first and second indication, the object and information associated with the object thereof.

10. The electronic apparatus according to claim 1 , wherein the electronic apparatus is an augmented reality (AR) apparatus.

11. An electronic apparatus associated with a server, comprising processing circuit configured to:

determine an expected direction of a user based on at least one of a current location or a current viewing angle of the user;

generate a first indication and a second indication for directing the user to the expected direction;

control an electronic apparatus associated with the user to display an object to the user when the user goes towards the expected direction;

generate information associated with the object based on a distance between the user and the object;

wherein the first indication is a direct direction indication and the second indication is an indirect direction indication,

wherein the indirect direction indication indicates information associated with an area in the direction of the expected direction, and

wherein the information associated with the object includes at least one of visual content or sound content.

12. The electronic apparatus according to claim 11 , wherein the information associated with the area in the direction of the expected direction comprises light brightness information associated with the area.

13. The electronic apparatus according to claim 11 , wherein the object is associated with a real object.

14. The electronic apparatus according to claim 11 , wherein the sound content is a sound associated with one or more actual sounds that can be heard by the user according to the distance between the user and the object.

15. The electronic apparatus according to claim 11 , wherein the processing circuit is further configured to:

generate sound not associated with the object as the sound content when the distance between the user and the object satisfies a first condition; and

generate sound associated with the object as the sound content when the distance between the user and the object satisfies a second condition.

16. The electronic apparatus according to claim 11 , wherein the processing circuit is further configured to:

generate first visual content based on a first distance between the user and the object; and

generate second visual content based on a second distance longer than the first distance between the user and the object.

17. The electronic apparatus according to claim 11 , wherein the processing circuit is further configured to generate display mode conversion icon as at least part of the visual content based on the distance between the user and the object satisfying a condition.

18. The electronic apparatus according to claim 11 ,

wherein the information associated with the area in the direction of the expected direction further includes sound information associated with the area and animation information associated with the area,

wherein a portion of the sound information is a sound information from an aural source located in the area and that can be heard in a case that the user is located in the area,

wherein the light information associated with the area is a light information from a visual source located in the area and that can be seen in a case that the user is located in the area, and

wherein a portion of the animation information is related to a visual source located in the area and that can be seen in a case that the user is located in the area.

19. A non-transient computer readable medium containing program instructions for causing a processor to perform the method of:

acquiring an expected direction of a user based on at least one a current location or a current viewing angle of the user;

providing a first indication and a second indication for directing the user to the expected direction,

wherein the first indication is a direct direction indication and the second indication is an indirect direction indication,

wherein the indirect direction indication indicates information associated with an area in the direction of the expected direction, and

wherein the information associated with the area in the direction of the expected direction comprises light brightness information associated with the area;

displaying an object to the user when the user goes toward the expected direction; and

providing information associated with the object based on a distance between the user and the object,

wherein the information associated with the object includes at least one of visual content or sound content.

20. The non-transient computer readable medium according to claim 19 , wherein the sound content is a sound associated with one or more actual sounds that can be heard by the user according to the distance between the user and the object.

21. The non-transient computer readable medium according to claim 19 , wherein the method further includes:

providing sound not associated with the object as the sound content when the distance between the user and the object satisfies a first condition; and

providing sound associated with the object as the sound content when the distance between the user and the object satisfies a second condition.

22. The non-transient computer readable medium according to claim 19 ,

wherein the information associated with the area in the direction of the expected direction further includes sound information associated with the area and animation information associated with the area,

wherein a portion of the sound information is a sound information from an aural source located in the area and that can be heard in a case that the user is located in the area,

wherein the light information associated with the area is a light information from a visual source located in the area and that can be seen in a case that the user is located in the area, and

wherein a portion of the animation information is related to a visual source located in the area and that can be seen in a case that the user is located in the area.

23. A method of providing an augmented reality to a user of an electronic apparatus, the method comprising:

acquiring an expected direction of the user based on at least one of a current location or a current viewing angle of the user;

providing a first indication and a second indication for directing the user to the expected direction,

wherein the first indication is a direct direction indication and the second indication is an indirect direction indication,

wherein the indirect direction indication indicates information associated with an area in the direction of the expected direction, and

displaying an object to the user when the user goes toward the expected direction; and

providing information associated with the object based on a distance between the user and the object,

wherein the information associated with the object includes at least one of visual content or sound content.

24. The method according to claim 23 ,

wherein the information associated with the area in the direction of the expected direction further includes sound information associated with the area and animation information associated with the area,

wherein a portion of the sound information is a sound information from an aural source located in the area and that can be heard in a case that the user is located in the area,

wherein the light information associated with the area is a light information from a visual source located in the area and that can be seen in a case that the user is located in the area, and

wherein a portion of the animation information is related to a visual source located in the area and that can be seen in a case that the user is located in the area.

Assignments (1)
CHANGE OF NAME Recorded Jul 6, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 056823/0528 →
Continuity (3)
Continuation 16992133 · Aug 13, 2020
Continuation 16019605 · Jun 27, 2018
Related Publication 20210335048A1 · Oct 28, 2021