IP Library Granted Patent US 11,562,471
Granted Patent B2
US 11,562,471 · App. 17/187,514 · Granted Jan 24, 2023

Arrangement for generating head related transfer function filters

Inventors: Antti J. Vanne (Kuopio, FI); Tomi A. Huttunen (Kuopio, FI); Jukka O. Antikainen (Kuopio, FI)
Assignee: APPLE INC.
G06T7/0002G06V10/751G06V10/993G06V40/10G06V40/16G06V40/166H04N5/23222H04S7/303G06T2207/30168G06T2207/30201H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,562,471
App. No.
17/187,514
Granted
Jan 24, 2023
Kind
B2
Abstract

Arrangement for acquiring images for producing a head related transfer function filter is disclosed. In the arrangement the camera of a mobile phone or similar portable device is adjusted for the imaging. All acquired images are analyzed and only suitable images are sent further for producing the head related transfer filter. The arrangement is further configured to provide instructions to the user so that the whole head and other relevant body parts are sufficiently covered.

Claims (52)

1. A method for acquiring images required for producing geometrical data for determining head related transfer function filters, the method comprising:

initializing a camera application in a user device of a user, for controlling a camera module of the user device;

acquiring a plurality of images using the camera module;

selecting images showing anatomy, which anatomy may be used in producing a head related transfer function filter;

determining if the selected images comprises sufficient anatomy in order to produce the head related transfer function filter; and

if a result of the determination is negative then the method further comprises: providing haptic feedback that the determination is negative and that the user adjust camera position; and

acquiring additional images of areas that are not sufficiently covered in the selected images.

2. The method of claim 1 further comprising transmitting each selected image to a head related transfer function filter generation server.

3. The method of claim 1 further comprising discarding images that do not comprise geometry that may be used in producing the head related transfer filter.

4. The method of claim 1 wherein initializing the camera application comprises at least one of the following:

selecting sufficient resolution;

turning on a camera lighting device of the user device;

adjusting exposure time; and

selecting appropriate frame rate.

5. The method of claim 1 further comprising providing voice instructions to the user for acquiring additional images of areas that are not sufficiently covered in the selected images.

6. The method of claim 1 wherein the selecting comprises detecting or labelling ear and face landmarks within the selected images.

7. The method of claim 1 wherein the selecting is based on at least one of the following: visibility of a chosen anatomic feature within an image, quality of the image, and angular coverage of the image.

8. The method of claim 7 further comprising arranging the selected images into at least three data sets, wherein the sets comprise:

images of head and upper torso;

images of the left ear; and

images of the right ear.

9. The method of claim 1 wherein selecting images showing anatomy comprises using a machine learning feature detector that detects ears and face in input images.

10. The method of claim 9 wherein the detector is pre-trained with a dataset of more than >1000 images.

11. A non-transitory computer readable medium for holding instructions that are capable of programming a server to perform a method comprising the following operations for determining a head related transfer function filter:

select images, from a plurality of images received from a user device of a user, showing anatomy, which anatomy may be used in producing a head related transfer function filter, the plurality of images being acquired using a camera module in the user device controlled by a camera application in the user device;

determine if the selected images comprise sufficient anatomy in order to produce the head related transfer function filter;

if a result of the determination is negative then instruct the user device to provide haptic feedback that the determination is negative and that the user adjust camera position; and

acquire additional images of areas that are not sufficiently covered in the selected images.

12. The non-transitory computer readable medium of claim 11 having further instructions that program the server to initialize the camera application in the user device, for controlling the camera module.

13. The non-transitory computer readable medium of claim 11 having further instructions that program the server to instruct the user device to acquire the plurality of images using the camera module in the user device.

14. A user device for acquiring images required for producing geometrical data for determining head related transfer function filters, the user device comprising:

a processor configured to execute computer programs;

a memory configured to store computer programs;

a data communication interface configured to communicate with a data communication network; and

an imaging device;

wherein the user device is configured to:

acquire a plurality of images using the imaging device, under control of an application program stored in the memory;

select images, from the plurality of images, showing anatomy, which anatomy may be used in producing a head related transfer function filter, and discard images, from the plurality of images, that do not comprise geometry that may be used in producing the head related transfer filter; and

transmit the selected images using the data communication interface to a server, wherein the server is to determine if the selected images comprise sufficient anatomy in order to produce the head related transfer function filter, and if a result of the determination is negative then the server instructs the user device to i) provide haptic feedback to the user that the determination is negative, and ii) instruct the user to adjust camera position and acquire additional images of areas that are not sufficiently covered in the selected images.

15. The user device of claim 14 wherein the memory has stored therein instructions that configure the processor to initialize the camera application by at least one of the following:

selecting sufficient resolution;

turning on a camera lighting device of the user device;

adjusting exposure time; and

selecting appropriate frame rate.

16. The user device of claim 14 wherein the memory has stored therein instructions that configure the processor to provide voice instructions to the user for acquiring additional images of areas that are not sufficiently covered in the selected images.

17. The user device of claim 14 wherein the memory has stored instructions that configure the processor to select the images based on at least one of the following: visibility of a chosen anatomic feature within an image, quality of the image, and angular coverage of the image.

18. The user device of claim 14 wherein the memory has stored therein further instructions that configure the processor to arrange the selected images into at least three data sets, wherein the sets comprise:

images of head and upper torso;

images of the left ear; and

images of the right ear.

19. The user device of claim 14 wherein the memory has stored therein further instructions that configure the processor to select the images using a machine learning feature detector that detects ears and face in input images.

20. The user device of claim 19 wherein the detector is pre-trained with a dataset of more than >1000 images.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2022
From: OWNSURROUND OY
To: APPLE INC.
Reel/Frame 060210/0358 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2022
From: VANNE, ANTTI; HUTTUNEN, TOMI; ANTIKAINEN, JUKKA
To: OWNSURROUND OY
Reel/Frame 059998/0813 →
Priority Claims (1)
FI 20185300 · Mar 29, 2018 · national
Continuity (2)
Continuation 16357193 · Mar 18, 2019
Related Publication 20210183046A1 · Jun 17, 2021