IP Library Granted Patent US 10,937,142
Granted Patent B2
US 10,937,142 · App. 16/357,193 · Granted Mar 2, 2021

Arrangement for generating head related transfer function filters

Inventors: Antti J. Vanne (Los Gatos, CA); Tomi A. Huttunen (Kuopio, FI); Jukka O. Antikainen (Kuopio, FI)
Assignee: OwnSurround Oy
G06T7/0002G06K9/00221G06K9/00255G06K9/00362G06K9/036G06K9/6202H04N5/23222H04S7/303G06T2207/30168G06T2207/30201H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,937,142
App. No.
16/357,193
Granted
Mar 2, 2021
Kind
B2
Abstract

Arrangement for acquiring images for producing a head related transfer function filter is disclosed. In the arrangement the camera of a mobile phone or similar portable device is adjusted for the imaging. All acquired images are analyzed and only suitable images are sent further for producing the head related transfer filter. The arrangement is further configured to provide instructions to the user so that the whole head and other relevant body parts are sufficiently covered.

Claims (44)

1. A method for acquiring images required for producing geometrical data for head related transfer function filters comprising:

initializing a camera application in a user device for controlling a camera module of the user device;

acquiring a plurality of images using the camera module;

selecting images showing anatomy, which anatomy may be used in producing a head related transfer function filter;

determining if the selected images comprises sufficient anatomy in order to produce the head related transfer function filter, wherein a result of the determination is negative when a visibility detection process that is applied to a detected ear has detected hairs over the detected ear; and

if the result of the determination is negative the method further comprises: providing instructions to the user to remove hairs on the detected ear and acquire additional images of areas that are not sufficiently covered in the selected images.

2. A method according to claim 1 , wherein the method further comprises: transmitting each selected image comprising anatomy for producing the head related transfer filter to a head related transfer function filter generation server.

3. A method according to claim 1 , wherein the method further comprises: discarding images that do not comprise geometry that may be used in producing the head related transfer filter.

4. A method according to claim 1 , wherein the method further comprises: preparing the user device for acquiring the images, wherein the preparing comprises at least one of the following:

Selecting sufficient resolution;

Turning on the lighting device of the camera user device;

Adjusting exposure time; and

Selecting appropriate frame rate.

5. A method according to claim 1 , wherein the method further comprises, when providing instructions, at least one of the following:

showing visual instructions on the screen of the device;

providing voice instructions to the user; and

providing haptic instructions.

6. A method according to claim 1 , wherein the selecting further comprises: detecting and/or labelling ear and face landmarks.

7. A method according to claim 6 , wherein the method further comprises: arranging the selected images into at least three data sets, wherein the sets comprise:

Images of head and upper torso;

Images of the left ear; and

Images of the right ear.

8. A method according to claim 1 , wherein the selecting is based on at least one of the following:

Visibility of chosen anatomic feature;

Quality of the image

Angular coverage of the images.

9. A method for acquiring images needed for producing geometrical data for head related transfer function filters, the method comprising:

initializing a camera application in a user device for controlling a camera module of the user device;

acquiring a plurality of images using the camera module;

selecting images showing anatomy to be used in producing a head related transfer function filter; and

determining if the selected images comprise sufficient anatomy to produce the head related transfer function filter wherein a result of the determination is negative in that a visibility detection process that is applied to a detected ear results in detection of hair over the detected ear,

wherein if the result of the determination is negative the method further comprises providing instructions to the user for removing hairs that are on the detected ear and for acquiring images of areas that are not sufficiently covered in the selected images.

10. A method according to claim 9 , wherein the method further comprises transmitting each selected image that comprises anatomy for producing the head related transfer filter, to a head related transfer function filter generation server.

11. A method according to claim 9 wherein the result of the determination is negative in that ear or face features are not detected, and wherein providing instructions to the user comprises giving audio feedback to the user.

12. A method according to claim 9 wherein determining if the selected images comprises sufficient anatomy comprises performing a sparse 3D reconstruction of head and ears and comparing original camera images to virtual images generated from the sparse 3D reconstruction.

13. An apparatus comprising:

at least one processor ( 12 ) configured to execute computer programs;

at least one memory ( 13 ) configured to store computer programs and related data;

at least one data communication interface ( 14 ) configured to communicate with external data communication networks; and

at least one imaging device ( 15 );

wherein said at least one processor becomes configured by the stored computer programs and related data to receive a plurality of images acquired using the at least one imaging device, and select from the plurality of images those showing anatomy to be used in producing a head related transfer function filter, and determine if the selected images comprise sufficient anatomy to produce the head related transfer function filter wherein a result of the determination is negative in that a visibility detection process that is applied to a detected ear results in detection of hair over the detected ear,

wherein if the result of the determination is negative the processor is configured to provide instructions to the user for removing hairs that are on the detected ear and for acquiring images of areas that are not sufficiently covered in the selected images.

14. The apparatus of claim 13 wherein apparatus is configured to transmit each selected image comprising anatomy for producing the head related transfer filter to a head related transfer function filter generation server.

15. The apparatus of claim 13 wherein the processor is configured to discard images that do not comprise geometry that may be used in producing the head related transfer filter.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2023
From: OWNSURROUND OY
To: APPLE INC.
Reel/Frame 062441/0402 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2022
From: VANNE, ANTTI; HUTTUNEN, TOMI; ANTIKAINEN, JUKKA
To: OWNSURROUND OY
Reel/Frame 059998/0813 →
Continuity (1)
Related Publication 20190304081A1 · Oct 3, 2019