IP Library Granted Patent US 11,637,962
Granted Patent B2
US 11,637,962 · App. 17/371,479 · Granted Apr 25, 2023

Computer-vision-based object tracking and guidance module

Inventors: Brian Martel (Farmington, NH); YiFeng Xiong (Madbury, NH); Drew Anthony Schena (Portsmouth, NH); Narasimhachary Nallana Chakravarty (Rollinsford, NH); Rafal Piotrowski (Portsmouth, NH)
Assignee: POSITION IMAGING, INC.
H04N5/2354G06Q10/0833G06Q10/0836G06T7/521H04N5/2253H04N7/181H04N9/097
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,637,962
App. No.
17/371,479
Granted
Apr 25, 2023
Kind
B2
Abstract

An apparatus comprises a mount body by which the apparatus is secured to a structure. A camera assembly includes an image sensor adapted to capture images within its field of view. A lighting assembly houses one or more light sources including a directional light source. A control-board assembly, fixed to the mount body, houses control boards including one or more processors configured to acquire information about an object, to associate a location within the field of view of the image sensor with the object, to point light emitted by the directional light source at the location associated with the object by rotating the lighting assembly and turning the laser assembly, and, based on an image acquired from the camera assembly, to detect change within the field of view of the image sensor corresponding to placement or removal of the object.

Claims (36)

1. A computer-vision system comprising:

a mount body having a channel sized to receive a rail, the channel having a sidewall disposed between opposing walls, the sidewall having multiple angled surfaces that determine a full range of angles at which the rail can be secured to the mount body;

a camera assembly attached to the mount body, the camera assembly including an image sensor that captures images within its field of view;

a lighting assembly housing one or more light sources; and

a controller in electrical communication with the camera assembly to acquire the images captured by the image sensor and with the lighting assembly to control operation of the one or more light sources, the controller configured to acquire information about an object, to associate a location within the field of view of the image sensor with the object, to point light emitted by the one or more light sources at the location associated with the object by articulating at least one of the lighting assembly and the one or more light sources, and, based on an image acquired from the camera assembly, to detect change within the field of view of the image sensor corresponding to placement or removal of the object.

2. The computer-vision system of claim 1 , further comprising a guidance system that includes a directional light source of the one or more light sources and an electrical and/or mechanical system for operating at least one of the directional light source or an audio system of the computer-vision system.

3. The computer-vision system of claim 2 , wherein the guidance system directs light from the directional light source or generates audio from the audio system to instruct a user where the object should be placed.

4. The computer-vision system of claim 2 , wherein the guidance system directs light from the directional light source or generates audio from the audio system to instruct a user where the object is located for removal from the location.

5. The computer-vision system of claim 1 , wherein the camera assembly further comprises a depth sensor fixed to a mounting surface and a plurality of support mounts of different heights attached to a frame of the camera assembly, and wherein the image sensor is mounted to a board held by the plurality of support mounts at a non-zero offset angle relative to the mounting surface upon which the depth sensor is fixed.

6. The computer-vision system of claim 1 , further comprising:

a bracket with two arms and a mounting surface; and

a channel bar attached between ends of the two arms, the channel bar having dimensions adapted to fit closely within.

7. A computer-vision system comprising:

a lighting assembly housing at least one light source;

a camera assembly housing an RGB (red green blue) camera and a depth camera that capture image information within their fields of view, the camera assembly having a mounting surface upon which the depth camera is fixed, a plurality of support mounts of different heights attached to a frame of the camera assembly, the RGB camera being mounted to a board held by the plurality of support mounts at a non-zero offset angle relative to the mounting surface upon which the depth camera is fixed; and

a controller in communication with the camera assembly to receive image information captured by the cameras and with the lighting assembly to control operation of the at least one light source, the controller housing control boards including a processor configured to receive and process images captured by the camera assembly and to operate the at least one light source in response to the processed images.

8. An apparatus comprising:

a mount body by which to secure the apparatus to a rail, the mount body having a channel sized to receive the rail therethrough, the channel having a sidewall disposed between opposing walls, the sidewall having multiple angled surfaces that determine a full range of angles at which the rail can be secured to the mount body;

a camera assembly attached to the mount body such that the camera has a field of view that faces downwards when the apparatus is secured to the rail; and

a light-guidance assembly movably attached to the mount body, the light-guidance assembly housing one or more light sources, wherein the camera assembly is in electronic communication with a controller to provide to the controller image information captured by the camera and with the lighting assembly to control operation of the one or more light sources in response to the processed image information.

9. The apparatus of claim 8 , wherein one of the surfaces of the channel has a retaining boss extending therefrom, the retaining boss being located and sized to align with and fit within a groove of the rail.

10. The apparatus of claim 9 , further comprising:

a bracket with two arms that end at a mounting surface; and

a channel bar attached between ends of the two arms, the channel bar having dimensions adapted to fit closely within and pass through the channel of the mount body.

11. The apparatus of claim 9 , wherein the camera assembly has a depth sensor fixed to a mounting surface and a plurality of support mounts of different heights attached to a frame of the camera assembly, and wherein the image sensor is mounted to a board supported by the plurality of support mounts and held at a non-zero offset angle relative to the mounting surface to which the depth sensor is fixed.

12. The apparatus of claim 11 , wherein the support mounts have rivet holes, and the camera assembly further comprises push rivets that pass through the board into the rivet holes of the support mounts to secure the image sensor within the camera assembly.

13. The apparatus of claim 9 , wherein the mount body includes a pair of flanges, one flange of the pair on each opposite side of the mount body, each flange having an opening therein, and further comprising a bracket coupled to the mount body, the bracket having two opposing walls and a sidewall disposed therebetween, a first wall of the two walls entering the channel of the mount body and having openings that align with the openings of the flanges for receiving fasteners therethrough that secure the first wall to the flanges, a second wall of the two walls having openings therein for receiving fasteners therethrough that secure the second wall to a surface.

14. The apparatus of claim 9 , wherein the one or more light sources includes a directional light source fixed to a laser assembly, and further comprising a first motor operably coupled to the lighting assembly to pan the directional light source horizontally and a second motor operably coupled to the laser assembly to tilt the directional light source vertically.

15. The computer-vision system of claim 7 , further comprising a guidance system that includes a directional light source of the at least one light source and an electrical and/or mechanical system for operating the directional light source.

16. The computer-vision system of claim 15 , wherein the guidance system directs light from the directional light source to instruct a user where an object should be placed.

17. The computer-vision system of claim 15 , wherein the guidance system directs light from the directional light source to instruct a user where an object is located for removal from the location.

18. The computer-vision system of claim 7 , further comprising:

a bracket with two arms and a mounting surface; and

a channel bar attached between ends of the two arms, the channel bar having dimensions adapted to fit closely within.

19. The computer-vision system of claim 7 , wherein the support mounts have rivet holes, and the camera assembly further comprises push rivets that pass through the board into the rivet holes of the support mounts to secure the RGB camera within the camera assembly.

20. The computer-vision system of claim 7 , further comprising an audio system and a guidance system, the guidance system generating audio from the audio system to instruct a user where an object should be placed or where the object is located for removal from the location.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2025
From: POSITION IMAGING, INC.
To: POSITION IMAGING IP LLC
Reel/Frame 070342/0196 →
SECURITY INTEREST Recorded Aug 23, 2023
From: POSITION IMAGING IP LLC
To: ANKURA TRUST COMPANY, LLC
Reel/Frame 064688/0851 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2021
From: PIOTROWSKI, RAFAL; MARTEL, BRIAN; XIONG, YIFENG; SCHENA, DREW; CHAKRAVARTY, NARASIMHACHARY NALLANA
To: POSITION IMAGING, INC.
Reel/Frame 056802/0077 →
Continuity (3)
Continuation 16740679 · Jan 13, 2020
Provisional Application 62791413 · Jan 11, 2019
Related Publication 20210337103A1 · Oct 28, 2021