IP Library Granted Patent US 12,067,321
Granted Patent B2
US 12,067,321 · App. 17/580,383 · Granted Aug 20, 2024

Apparatus, a method and a computer program for rotating displayed visual information

Inventors: Arto Juhani Lehtiniemi (Lempäälä, FI); Miikka Tapani Vilermo (Siuro, FI); Anssi Sakari Rämö (Tampere, FI); Toni Mäkinen (Pirkkala, FI)
Assignee: NOKIA TECHNOLOGIES OY
G06F3/14G06F3/0346G06T3/40H04R1/406H04R3/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,067,321
App. No.
17/580,383
Granted
Aug 20, 2024
Kind
B2
Abstract

According to various, but not necessarily all, embodiments there is provided an apparatus comprising means for: determining a direction of arrival of sound from a sound source relative to a user device using at least one captured audio signal; controlling an angle of orientation of visual information displayed on a display, wherein the angle of orientation of the visual information is at least partially dependent upon the determined direction of arrival of sound from the sound source relative to the user device.

Claims (45)

1. An apparatus comprising:

at least one processor; and

at least one memory including computer program code,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

determine, using at least one captured audio signal, a direction of arrival of sound from a sound source relative to a user device and a distance of the sound source from the user device;

responsive to the distance of the sound source from the user device being less than a threshold distance, control an angle of orientation of visual information displayed on a display, wherein the angle of the orientation of the visual information is at least partially dependent upon the determined direction of arrival of sound from the sound source relative to the user device; and

responsive to the distance of the sound source from the user device being greater than the threshold distance, maintain the angle of orientation of the visual information displayed on the display without change by preventing change to the angle of orientation of the visual information displayed on the display based on the determined direction of arrival of sound from the sound source relative to the user device.

2. The apparatus as claimed in claim 1 , further configured to cause to control a position of the visual information is displayed at on the display, wherein the position of the visual information displayed on the display is at least partially dependent upon the determined direction of arrival of sound from the sound source relative to the user device.

3. The apparatus as claimed in claim 1 , further configured to cause to determine changes of the direction of arrival of sound from the sound source relative to the user device;

wherein the controlling the angle of the orientation of the visual information displayed on the display correspondingly changes the angle of the orientation of the visual information in response to a determined change in the direction of arrival of sound from the sound source.

4. The apparatus as claimed in claim 1 , further configured to cause to change the angle of the orientation of the visual information to a predefined angle after determining that the determined direction of arrival of sound from the sound source satisfies a threshold direction of arrival associated with the predefined angle.

5. The apparatus as claimed in claim 1 , further configured to cause to estimate a location of the sound source relative to the user device whilst the sound source is not producing sound; and

wherein the angle of the orientation of the visual information is at least partially dependent upon the estimated location of the sound source relative to the user device whilst the sound source is not producing sound.

6. The apparatus as claimed in claim 1 , further configured to cause to at least one of alter a scale of the visual information or crop the visual information, wherein at least one of the altering or cropping is at least partially dependent upon the angle of the orientation of the visual information.

7. The apparatus as claimed in claim 1 , wherein user interface controls associated with the visual information are displayed on the display, wherein the apparatus is further configured to cause to adjust at least one of a position or an orientation of the user interface controls, wherein the adjusting is at least partially dependent upon the angle of the orientation of the visual information.

8. The apparatus as claimed in claim 1 ,

wherein the angle of the orientation of the visual information displayed on the display additionally depends upon application settings of an application running on the display, wherein the application is associated with the visual information.

9. The apparatus as claimed in claim 1 , wherein the visual information comprises one or more images or video captured by image capture means of the user device;

wherein if the user device is rotated whilst the one or more images or video is being captured, wherein the controlling the angle of the orientation of the visual information comprises maintaining the angle of the orientation of the visual information displayed on the display by determining the direction of arrival of sound from the sound source relative to the rotated user device to counteract changes to the angle of the orientation of the visual information displayed on the display that do or could occur due to the rotation of the user device.

10. The apparatus as claimed in claim 1 , further configured to cause to:

identify the sound source as a previously known sound source; and

restrict changing of the angle of the orientation of the visual information, wherein unknown sound sources are restricted from causing changing of the angle of the orientation of the visual information.

11. The apparatus as claimed in claim 1 , further configured to cause to:

determine a direction of arrival of sound from a second sound source relative to the user device using at least one captured audio signal;

control an angle of orientation of second visual information displayed on the display, wherein the visual information and the second visual information are displayed on the display at the same time, wherein the angle of the orientation of the second visual information is at least partially dependent upon the determined direction of arrival of sound from the second sound source relative to the user device.

12. A method comprising:

determining, using at least one captured audio signal, a direction of arrival of sound from a sound source relative to a user device and a distance of the sound source from the user device;

responsive to the distance of the sound source from the user device being less than a threshold distance, controlling an angle of orientation of visual information displayed on a display, wherein the angle of the orientation of the visual information is at least partially dependent upon the determined direction of arrival of sound from the sound source relative to the user device; and

responsive to the distance of the sound source from the user device being greater than the threshold distance, maintaining the angle of orientation of the visual information displayed on the display without change by preventing change to the angle of orientation of the visual information displayed on the display based on the determined direction of arrival of sound from the sound source relative to the user device.

13. The method as claimed in claim 12 , further comprising:

controlling a position of the visual information is displayed at on the display, wherein the position of the visual information displayed on the display is at least partially dependent upon the determined direction of arrival of sound from the sound source relative to the user device.

14. The method as claimed in claim 12 , further comprising:

determining changes of the direction of arrival of sound from the sound source relative to the user device;

wherein the controlling the angle of the orientation of the visual information displayed on the display correspondingly changes the angle of the orientation of the visual information in response to a determined change in the direction of arrival of sound from the sound source.

15. The method as claimed in claim 12 , further comprising:

changing the angle of the orientation of the visual information to a predefined angle after determining that the determined direction of arrival of sound from the sound source satisfies a threshold direction of arrival associated with the predefined angle.

16. The method as claimed in claim 12 , further comprising:

estimating a location of the sound source relative to the user device whilst the sound source is not producing sound; and

wherein the angle of the orientation of the visual information is at least partially dependent upon the estimated location of the sound source relative to the user device whilst the sound source is not producing sound.

17. The method as claimed in claim 12 , further comprising: at least one of altering a scale of the visual information or cropping the visual information, wherein at least one of the altering or cropping is at least partially dependent upon the angle of the orientation of the visual information.

18. The method as claimed in claim 12 , wherein user interface controls associated with the visual information are displayed on the display, wherein the method further comprises adjusting at least one of a position or an orientation of the user interface controls, wherein the adjusting is at least partially dependent upon the angle of the orientation of the visual information.

19. A non-transitory computer readable medium comprising program instructions stored thereon for performing at least the following:

determining, using at least one captured audio signal, a direction of arrival of sound from a sound source relative to a user device and a distance of the sound source from the user device;

responsive to the distance of the sound source from the user device being less than a threshold distance, controlling an angle of orientation of visual information displayed on a display, wherein the angle of the orientation of the visual information is at least partially dependent upon the determined direction of arrival of sound from the sound source relative to the user device; and

responsive to the distance of the sound source from the user device being greater than the threshold distance, maintaining the angle of orientation of the visual information displayed on the display without change by preventing change to the angle of orientation of the visual information displayed on the display based on the determined direction of arrival of sound from the sound source relative to the user device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2022
From: LEHTINIEMI, ARTO JUHANI; VILERMO, MIIKKA TAPANI; RAMO, ANSSI SAKARI; MAKINEN, TONI
To: NOKIA TECHNOLOGIES OY
Reel/Frame 058715/0123 →
Priority Claims (1)
EP 21156520 · Feb 11, 2021 · regional
Continuity (1)
Related Publication 20220253262A1 · Aug 11, 2022