IP Library Granted Patent US 11,190,677
Granted Patent B2
US 11,190,677 · App. 16/837,651 · Granted Nov 30, 2021

Systems and methods for registering headset system

Inventors: Michael Costa (Los Angeles, CA); Trevor Dunlop (Los Angeles, CA); Roman Flores, II (Los Angeles, CA); Matthew Hutter (Los Angeles, CA); Michael O'Brien (Los Angeles, CA); Ilyas Patanam (Los Angeles, CA); Mina Ranjbaran (Los Angeles, CA); Gerard Salinas (Los Angeles, CA); Fabien Scalzo (Los Angeles, CA); Lane Stith (Los Angeles, CA); Matthew Sylvester (Los Angeles, CA); Justin White (Los Angeles, CA); Jan Zwierstra (Los Angeles, CA)
Assignee: NovaSignal Corp.
H04N5/23218A61B8/4209A61B8/4245H04N1/00H04N5/2253H04N5/23299H04N1/4092
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,190,677
App. No.
16/837,651
Granted
Nov 30, 2021
Kind
B2
Abstract

Arrangements described herein relate to systems, apparatuses, and methods for a headset system that includes a transducer, a camera configured to capture image data of a subject, and a controller configured to detect one or more fiducial markers placed on the subject using the captured image data, and register the transducer with respect to the subject based on the detected fiducial markers.

Claims (44)

1. A method for operating a transducer of a headset system that collects ultrasound data from a subject, the method comprising:

detecting two or more fiducial markers placed on the subject by:

identifying a plurality of candidate regions using image data; and

selecting two or more candidate regions of the plurality of candidate regions as corresponding to the two or more fiducial markers;

determining a scanning area of the subject bounded by the two or more fiducial markers; and

restricting the transducer from traveling beyond the scanning area while the transducer collects the ultrasound data.

2. The method of claim 1 , wherein the plurality of candidate regions are identified using the image data based on machine vision.

3. The method of claim 1 , wherein the plurality of candidate regions are identified using the image data based on a Maximally Stable Extremal Regions (MSER) algorithm.

4. The method of claim 1 , wherein the image data comprises two images of the subject from different viewpoints.

5. The method of claim 1 , wherein each of the plurality of candidate regions comprises a list of pixels.

6. The method of claim 1 , wherein selecting the two or more candidate regions of the plurality of candidate regions as corresponding to the two or more fiducial markers comprises:

sorting the plurality of candidate regions into candidate region pairs;

determining features for each of the candidate region pairs;

determining a probability that each of the candidate region pairs corresponds to the two or more fiducial markers; and

selecting the two or more candidate regions based on the probability.

7. The method of claim 6 , wherein sorting the plurality of candidate regions into the candidate region pairs comprises determining permutations of pairings of the plurality of candidate regions.

8. The method of claim 6 , wherein each of the features comprise one or more of a location, a size, a shape, an image intensity, or a local texture.

9. The method of claim 8 , wherein the probability that each of the candidate region pairs corresponds to the two or more fiducial markers is determined based on the one or more of the location, the size, the shape, the image intensity, or the local texture.

10. The method of claim 6 , wherein the probability that each of the candidate region pairs corresponds to the two or more fiducial markers is determined based on a weight assigned to each of the features.

11. A non-transitory computer-readable medium having computer-readable instructions, such that when executed, causes a processor of a headset system to operate a transducer of the headset system that collects ultrasound data from a subject by:

detecting two or more fiducial markers placed on the subject by:

identifying a plurality of candidate regions using image data; and

selecting two or more candidate regions of the plurality of candidate regions as corresponding to the two or more fiducial markers;

determining a scanning area of the subject bounded by the two or more fiducial markers; and

restricting the transducer from traveling beyond the scanning area while the transducer collects the ultrasound data.

12. The non-transitory computer-readable medium of claim 11 , wherein the plurality of candidate regions are identified using the image data based on machine vision.

13. The non-transitory computer-readable medium of claim 11 , wherein the image data comprises two images of the subject from different viewpoints.

14. The non-transitory computer-readable medium of claim 11 , wherein each of the plurality of candidate regions comprises a list of pixels.

15. The non-transitory computer-readable medium of claim 11 , wherein selecting the two or more candidate regions of the plurality of candidate regions as corresponding to the two or more fiducial markers comprises:

sorting the plurality of candidate regions into candidate region pairs;

determining features for each of the candidate region pairs;

determining a probability that each of the candidate region pairs corresponds to the two or more fiducial markers; and

selecting the two or more candidate regions based on the probability.

16. The non-transitory computer-readable medium of claim 15 , wherein sorting the plurality of candidate regions into the candidate region pairs comprises determining permutations of pairings of the plurality of candidate regions.

17. The non-transitory computer-readable medium of claim 15 , wherein each of the features comprise one or more of a location, a size, a shape, an image intensity, or a local texture.

18. The non-transitory computer-readable medium of claim 17 , wherein the probability that each of the candidate region pairs corresponds to the two or more fiducial markers is determined based on the one or more of the location, the size, the shape, the image intensity, or the local texture.

19. The non-transitory computer-readable medium of claim 15 , wherein the probability that each of the candidate region pairs corresponds to the two or more fiducial markers is determined based on a weight assigned to each of the features.

20. A system, comprising:

a controller configured to:

detect two or more fiducial markers placed on a subject by:

identifying a plurality of candidate regions using image data; and

selecting two or more candidate regions of the plurality of candidate regions as corresponding to the two or more fiducial markers;

determine a scanning area of the subject bounded by the two or more fiducial markers; and

restrict the transducer from traveling beyond the scanning area while the transducer collects ultrasound data.

Assignments (8)
DEFAULT Recorded Mar 5, 2024
From: NOVASIGNAL CORP.
To: AVENUE VENTURE OPPORTUNITIES FUND, L.P.
Reel/Frame 066741/0678 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2023
From: AVENUE VENTURE OPPORTUNITIES FUND, L.P.
To: NEURASIGNAL, INC.
Reel/Frame 064238/0383 →
STATEMENT OF FORECLOSURE Recorded Jul 5, 2023
From: NOVASIGNAL CORP.
To: AVENUE VENTURE OPPORTUNITIES FUND, L.P.
Reel/Frame 064206/0484 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2023
From: AVENUE VENTURE OPPORTUNITIES FUND, L.P.
To: NEURASIGNAL, INC.
Reel/Frame 064155/0787 →
SECURITY INTEREST Recorded Jul 5, 2023
From: NEURASIGNAL, INC.
To: AVENUE CAPITAL MANAGEMENT II, L.P.
Reel/Frame 064155/0854 →
SECURITY INTEREST Recorded Dec 18, 2021
From: NOVASIGNAL CORP.
To: AVENUE VENTURE OPPORTUNITIES FUND, L.P.
Reel/Frame 058425/0481 →
CHANGE OF NAME Recorded Jun 9, 2021
From: NEURAL ANALYTICS, INC.
To: NOVASIGNAL CORP.
Reel/Frame 056675/0829 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2020
From: COSTA, MICHAEL; DUNLOP, TREVOR; FLORES, ROMAN, II; HUTTER, MATTHEW; O'BRIEN, MICHAEL; PATANAM, ILYAS; RANJBARAN, MINA; SALINAS, GERARD; SCALZO, FABIEN; STITH, LANE; SYLVESTER, MATTHEW; WHITE, JUSTIN; ZWIERSTRA, JAN
To: NEURAL ANALYTICS, INC.
Reel/Frame 052288/0289 →
Continuity (3)
Continuation 16132068 · Sep 14, 2018
Provisional Application 62558804 · Sep 14, 2017
Related Publication 20200228702A1 · Jul 16, 2020
Cited By (1)
US 12,390,191