IP Library Granted Patent US 10,204,302
Granted Patent B2
US 10,204,302 · App. 15/946,678 · Granted Feb 12, 2019

Neural network applications in resource constrained environments

Inventors: Rocky Chau-Hsiung Lin (Cupertino, CA); Thomas Yamasaki (Anaheim Hills, CA); Koichiro Kanda (San Jose, CA); Diego Rodriguez Risco (Campbell, CA); Alexander Joseph Ryan (Mountain View, CA)
Assignee: Alpine Electronics of Silicon Valley, Inc.
G06N3/08G06N3/04G06N3/063
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,204,302
App. No.
15/946,678
Granted
Feb 12, 2019
Kind
B2
Abstract

Systems and methods are disclosed for applying neural networks in resource-constrained environments. A system may include a sensor located in a resource-constrained environment configured to generate sensor data of the resource-constrained environment. The system may also include a first computing device not located in the resource-constrained environment configured to produce a neural network structure based on the sensor data. The system may further include a second computing device located in the resource-constrained environment configured to provide the sensor data as input to the neural network structure. The second computing device may be further configured to determine a state of the resource-constrained environment based on the input of the sensor data to the neural network structure.

Claims (59)

1. A system comprising:

a sensor located in a resource-constrained environment configured to generate first sensor data of the resource-constrained environment and second sensor data of the resource-constrained environment, wherein the first sensor data and the second sensor data are images of the resource-constrained environment;

a first computing device not located in the resource-constrained environment configured to produce a neural network structure based on the first sensor data;

a second computing device located in the resource-constrained environment configured to provide the second sensor data as input to the neural network structure, wherein the second computing device is further configured to determine a state of the resource-constrained environment based on the input of the second sensor data to the neural network structure; and

a controller located in the resource-constrained environment configured to control an indicator device based on the state of the resource-constrained environment determined by the second computing device,

wherein the second computing device is configured to determine the state of the resource-constrained environment at least in part by determining whether an abandoned item is present in the resource-constrained environment based on the input of the second sensor data to the neural network structure.

2. The system of claim 1 ,

wherein the resource-constrained environment comprises an interior of an automobile, and

wherein the first sensor data and the second sensor data are images of the interior of the automobile.

3. The system of claim 2 ,

wherein the controller is configured to control the indicator device based on the state of the resource-constrained environment determined by the second computing device and further based on an input from a technician.

4. The system of claim 2 ,

wherein the controller is configured to control the indicator device based on the state of the resource-constrained environment determined by the second computing device and further based on a signal received from an electronic transponder located external to the automobile.

5. The system of claim 2 ,

wherein the controller is further configured to perform an autonomous driving operation for the automobile based on the state of the resource-constrained environment determined by the second computing device.

6. The system of claim 2 ,

wherein the controller is configured to control the indicator device based on the state of the resource-constrained environment determined by the second computing device and further based on a presence of the automobile in a predetermined location for a rental car program.

7. The system of claim 1 ,

wherein indicator device is a mobile device, and

wherein the controller is configured to control the indicator device by transmitting information about an abandoned item being present in the resource constrained environment for display on a display component of the mobile device.

8. The system of claim 1 ,

wherein the second computing device is configured to determine whether an abandoned item is present in the resource-constrained environment at least in part by determining whether an article of trash is present in the resource-constrained environment.

9. A method comprising:

generating first sensor data of a resource-constrained environment and second sensor data of the resource-constrained environment using a sensor located in the resource-constrained environment, wherein the first sensor data and the second sensor data are images of the resource-constrained environment;

produce a neural network structure based on the first sensor data using a first computing device not located in the resource-constrained environment;

inputting the second sensor data to the neural network structure using a second computing device located in the resource-constrained environment;

determining a state of the resource-constrained environment using the second computing device based on the input of the second sensor data to the neural network structure; and

controlling an indicator device using a controller located in the resource-constrained environment based on the state of the resource-constrained environment determined by the second computing device,

wherein the determining the state of the resource-constrained environment comprises determining whether an abandoned item is present in the resource-constrained environment based on inputting the second sensor data to the neural network structure.

10. The method of claim 9 ,

wherein the resource-constrained environment comprises an interior of an automobile, and

wherein the first sensor data and the second sensor data are images of the interior of the automobile.

11. The method of claim 10 , wherein the controlling an indicator device is performed based on based on the state of the resource-constrained environment determined by the second computing device and further based on an input from a technician.

12. The method of claim 10 , wherein the controlling an indicator device is performed based on based on the state of the resource-constrained environment determined by the second computing device and further based on a signal received from an electronic transponder located external to the automobile.

13. The method of claim 10 , further comprising:

performing an autonomous driving operation for the automobile based on the state of the resource-constrained environment determined by the second computing device.

14. The method of claim 10 , wherein the controlling an indicator device is performed based on the state of the resource-constrained environment determined by the second computing device and further based on a presence of the automobile in a predetermined location for a rental car program.

15. The method of claim 9 , wherein indicator device is a mobile device, and wherein the controlling an indicator device comprises:

transmitting information about an abandoned item being present in the resource constrained environment for display on a display component of the mobile device.

16. The method of claim 9 , wherein the determining whether an abandoned item is present in the resource-constrained environment comprises:

determining whether an article of trash is present in the resource-constrained environment.

17. A system comprising:

a sensor located in a resource-constrained environment configured to generate first sensor data of the resource-constrained environment and second sensor data of the resource-constrained environment, wherein the first sensor data and the second sensor data are images of the resource-constrained environment;

a first computing device not located in the resource-constrained environment configured to produce a neural network structure based on the first sensor data;

a second computing device located in the resource-constrained environment configured to provide the second sensor data as input to the neural network structure, wherein the second computing device is further configured to determine a state of the resource-constrained environment based on the input of the second sensor data to the neural network structure; and

a controller located in the resource-constrained environment configured to control an indicator device based on the state of the resource-constrained environment determined by the second computing device,

wherein the second computing device is configured to determine the state of the resource-constrained environment at least in part by determining whether the state of the resource-constrained environment deviates from a normal state of the resource-constrained environment.

18. The system of claim 17 ,

wherein the resource-constrained environment comprises an interior of an automobile,

wherein the first sensor data and the second sensor data are images of the interior of the automobile, and

wherein the second computing device is configured to determine whether the state of the resource-constrained environment deviates from a normal state of the resource-constrained environment at least in part by determining the location of a car seat in the automobile.

19. The system of claim 17 ,

wherein the resource-constrained environment comprises an interior of an automobile,

wherein the first sensor data and the second sensor data are images of the interior of the automobile, and

wherein the second computing device is configured to determine whether the state of the resource-constrained environment deviates from a normal state of the resource-constrained environment at least in part by determining the location of a steering wheel in the automobile.

20. The system of claim 17 ,

wherein the resource-constrained environment comprises an interior of an automobile,

wherein the first sensor data and the second sensor data are images of the interior of the automobile, and

wherein the second computing device is configured to determine whether the state of the resource-constrained environment deviates from a normal state of the resource-constrained environment at least in part by determining whether an article of trash is present in the automobile.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2024
From: ALPINE ELECTRONICS OF SILICON VALLEY, INC.
To: REVEAL INNOVATIONS, LLC
Reel/Frame 069042/0477 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2018
From: LIN, ROCKY CHAU-HSIUNG; YAMASAKI, THOMAS; KANDA, KOICHIRO; RISCO, DIEGO RODRIGUEZ; RYAN, ALEXANDER JOSEPH
To: ALPINE ELECTRONICS OF SILICON VALLEY, INC.
Reel/Frame 045453/0245 →
Continuity (4)
Continuation 15699298 · Sep 8, 2017
Continuation 15397715 · Jan 3, 2017
Provisional Application 62365629 · Jul 22, 2016
Related Publication 20180232638A1 · Aug 16, 2018
Cited By (3)
US 12,330,660 US 12,445,790 US 12,522,175