IP Library Granted Patent US 11,062,524
Granted Patent B2
US 11,062,524 · App. 16/992,133 · Granted Jul 13, 2021

Augmented reality apparatus, system and method, and computer-readable storage medium

Inventors: Kai Xiao (Beijing, CN); Qi Zheng (Beijing, CN); Zhongsheng Hong (Beijing, CN); Jia Han (Beijing, CN)
Assignee: SONY CORPORATION
G06T19/006G01C21/206G02B27/01G06T19/003G02B2027/014G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,062,524
App. No.
16/992,133
Granted
Jul 13, 2021
Kind
B2
Abstract

An electronic apparatus, a wireless communication system, a wireless communication method, and a computer-readable storage medium are provided. The electronic apparatus includes a processing circuit configured to: determine a current audiovisual angle of a user; compare the current audiovisual angle of the user with an expected audiovisual angle, and generate indication information for directing the user to the expected audiovisual angle, and provide the indication information to the user. The indication information directs the user to the expected audiovisual angle by using a direct direction indication and an indirect direction indication. With the electronic apparatus, the wireless communication system, the wireless communication method, and the computer-readable storage medium, the user can obtain a better visual feeling, and thus the user experience can be improved.

Claims (84)

1. An electronic apparatus associated with a user, comprising a processing circuit configured to:

acquire an expected direction of the user based on a current location and a current viewing angle of the user;

provide a first indication and a second indication for directing the user to the expected direction,

wherein the first indication is a direct direction indication and the second indication is an indirect direction indication,

wherein the indirect direction indication indicates information associated with an area in the direction of the expected direction, and

wherein the information associated with the area in the direction of the expected direction comprises light brightness information associated with the area;

display an object to the user when the user goes toward the expected direction; and

provide information associated with the object based on a distance between the user and the object,

wherein the information associated with the object includes at least one of visual content and sound content.

2. The electronic apparatus according to claim 1 , wherein the object is associated with a real object.

3. The electronic apparatus according to claim 1 , wherein the sound content is sound associated with actual sounds that can be heard by the user according to the distance between the user and the object.

4. The electronic apparatus according to claim 1 , wherein the processing circuit is further configured to

provide sound not associated with the object as the sound content when the distance between the user and the object satisfies a first condition; and

provide sound associated with the object as the sound content when the distance between the user and the object satisfies a second condition.

5. The electronic apparatus according to claim 1 , wherein the processing circuit is further configured to

provide first visual content based on a first distance between the user and the object; and

provide second visual content based on a second distance longer than the first distance between the user and the object.

6. The electronic apparatus according to claim 1 , wherein the processing circuit is further configured to

provide a display mode conversion icon as at least part of the visual content if the distance between the user and the object satisfies a condition.

7. The electronic apparatus according to claim 1 ,

wherein the information associated with the area in the direction of the expected direction further includes sound information associated with the area and animation information associated with the area,

wherein a portion of the sound information is a sound information from an aural source located in the area and that can be heard in a case that the user is located in the area,

wherein the light information associated with the area is a light information from a visual source located in the area and that can be seen in a case that the user is located in the area, and

wherein a portion of the animation information from a visual source located in the area and that can be seen in a case that the user is located in the area.

8. The electronic apparatus according to claim 1 , wherein the processing circuit is further configured to

determine the current location and the viewing angle of the user;

transmit the current location and the viewing angle to a server; and

receive control information from the server regarding the first and second indication, the object and information associated with the object thereof.

9. The electronic apparatus according to claim 1 , wherein the electronic apparatus is an augmented reality (AR) apparatus.

10. An electronic apparatus associated with a server, comprising processing circuit configured to:

determine an expected direction of a user based on a current location and a current viewing angle of the user;

generate a first indication and a second indication for directing the user to the expected direction;

control an electronic apparatus associated with the user to display an object to the user when the user goes towards the expected direction;

generate information associated with the object based on a distance between the user and the object;

wherein the first indication is a direct direction indication and the second indication is an indirect direction indication,

wherein the indirect direction indication indicates information associated with an area in the direction of the expected direction, and

wherein the information associated with the area in the direction of the expected direction comprises light brightness information associated with the area,

wherein the information associated with the object includes at least one of visual content and sound content.

11. The electronic apparatus according to claim 10 , wherein the object is associated with a real object.

12. The electronic apparatus according to claim 10 , wherein the sound content is sound associated with actual sounds that can be heard by the user according to the distance between the user and the object.

13. The electronic apparatus according to claim 10 , wherein the processing circuit is further configured to

generate sound not associated with the object as the sound content when the distance between the user and the object satisfies a first condition; and

generate sound associated with the object as the sound content when the distance between the user and the object satisfies a second condition.

14. The electronic apparatus according to claim 10 , wherein the processing circuit is further configured to

generate first visual content based on a first distance between the user and the object; and

generate second visual content based on a second distance longer than the first distance between the user and the object.

15. The electronic apparatus according to claim 10 , wherein the processing circuit is further configured to generate display mode conversion icon as at least part of the visual content if the distance between the user and the object satisfies a condition.

16. A non-transient computer readable medium containing program instructions for causing a processor to perform the method of:

acquiring an expected direction of a user based on a current location and a current viewing angle of the user;

providing a first indication and a second indication for directing the user to the expected direction,

wherein the first indication is a direct direction indication and the second indication is an indirect direction indication,

wherein the indirect direction indication indicates information associated with an area in the direction of the expected direction, and

wherein the information associated with the area in the direction of the expected direction comprises light brightness information associated with the area;

displaying an object to the user when the user goes toward the expected direction; and

providing information associated with the object based on a distance between the user and the object,

wherein the information associated with the object includes at least one of visual content and sound content.

17. The non-transient computer readable medium according to claim 16 , wherein the sound content is sound associated with actual sounds that can be heard by the user according to the distance between the user and the object.

18. The non-transient computer readable medium according to claim 16 , wherein the method further includes:

providing sound not associated with the object as the sound content when the distance between the user and the object satisfies a first condition; and

providing sound associated with the object as the sound content when the distance between the user and the object satisfies a second condition.

19. A method of providing an augmented reality to a user of an electronic apparatus, the method comprising:

acquiring an expected direction of the user based on a current location and a current viewing angle of the user;

providing a first indication and a second indication for directing the user to the expected direction,

wherein the first indication is a direct direction indication and the second indication is an indirect direction indication,

wherein the indirect direction indication indicates information associated with an area in the direction of the expected direction, and

wherein the information associated with the area in the direction of the expected direction comprises light brightness information associated with the area;

displaying an object to the user when the user goes toward the expected direction; and

providing information associated with the object based on a distance between the user and the object,

wherein the information associated with the object includes at least one of visual content and sound content.

20. The electronic apparatus according to claim 10 ,

wherein the information associated with the area in the direction of the expected direction further includes sound information associated with the area and animation information associated with the area,

wherein a portion of the sound information is a sound information from an aural source located in the area and that can be heard in a case that the user is located in the area,

wherein the light information associated with the area is a light information from a visual source located in the area and that can be seen in a case that the user is located in the area, and

wherein a portion of the animation information from a visual source located in the area and that can be seen in a case that the user is located in the area.

21. The non-transient computer readable medium according to claim 16 ,

wherein the information associated with the area in the direction of the expected direction further includes sound information associated with the area and animation information associated with the area,

wherein a portion of the sound information is a sound information from an aural source located in the area and that can be heard in a case that the user is located in the area,

wherein the light information associated with the area is a light information from a visual source located in the area and that can be seen in a case that the user is located in the area, and

wherein a portion of the animation information from a visual source located in the area and that can be seen in a case that the user is located in the area.

22. The method according to claim 19 ,

wherein the information associated with the area in the direction of the expected direction further includes sound information associated with the area and animation information associated with the area,

wherein a portion of the sound information is a sound information from an aural source located in the area and that can be heard in a case that the user is located in the area,

wherein the light information associated with the area is a light information from a visual source located in the area and that can be seen in a case that the user is located in the area, and

wherein a portion of the animation information from a visual source located in the area and that can be seen in a case that the user is located in the area.

Continuity (2)
Continuation 16019605 · Jun 27, 2018
Related Publication 20200372720A1 · Nov 26, 2020