IP Library Patent Application 18350333
Patent Application
App. No. 18/350,333

SEMANTIC MAP UPDATING AND OBJECT SEARCHING USING IOT DEVICE CAMERAS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/350,333
Abstract

In one aspect, a first device includes a processor assembly and storage accessible to the processor assembly. The storage includes instructions executable by the processor assembly to access a semantic map, receive input from a first camera on an Internet of things (IoT) device, and update the semantic map based on the input.

Claims (46)

1 . A first device, comprising:

a processor assembly; and

storage accessible to the processor assembly and comprising instructions executable by the processor assembly to:

access a semantic map;

receive input from a first camera on an Internet of things (IoT) device; and

update, based on the input, the semantic map.

2 . The first device of claim 1 , wherein the instructions are executable to:

responsive to at least one trigger, command the IoT device to provide the input.

3 . The first device of claim 2 , wherein the at least one trigger comprises a recurring period of time ending.

4 . The first device of claim 2 , wherein the at least one trigger comprises receipt of a user command to update the semantic map.

5 . The first device of claim 2 , wherein the at least one trigger comprises a determination using object recognition that part of a real-world space represented in the semantic map has changed.

6 . The first device of claim 2 , wherein the instructions are executable to:

during creation of the semantic map, identify one or more real-world devices that each include a camera, the one or more real-world devices comprising the IoT device;

save data indicating the one or more real-world devices that each include a camera; and

use the data to command the IoT device to provide the input.

7 . The first device of claim 1 , wherein the instructions are executable to:

present a user interface (UI), the UI indicating an object in the semantic map that has not been identified via object recognition;

receive user input indicating a label for the object; and

update the semantic map with the label.

8 . The first device of claim 7 , wherein the instructions are executable to:

present a prompt for a user to use a second camera to capture images of the object from different angles;

receive the images of the object and generate three-dimensional (3D) data for the object based on the images; and

update the semantic map with the 3D data.

9 . The first device of claim 8 , wherein the second camera is different from the first camera.

10 . The first device of claim 7 , wherein the UI comprises a graphical user interface.

11 . The first device of claim 7 , wherein the UI comprises an audible user interface.

12 . The first device of claim 1 , comprising the camera.

13 . The first device of claim 1 , wherein the first device is different from IoT device.

14 . A method, comprising:

accessing, via a first device, a semantic map;

receiving input from a first camera on a second device; and

updating, based on the input, the semantic map.

15 . The method of claim 14 , wherein the second device is an Internet of things (IoT) device.

16 . The method of claim 15 , wherein the IoT device comprises one or more of: a television, a smartphone, a tablet computer, a laptop computer, a headset, a stand-alone camera, a digital assistant device, a cooking appliance, an electronic door lock, an electronic doorbell.

17 . The method of claim 14 , comprising:

updating, at recurring periods of time, the semantic map using one or more cameras.

18 . At least one computer readable storage medium (CRSM) that is not a transitory signal, the at least one CRSM comprising instructions executable by a processor assembly to:

access a semantic map;

receive input from a first camera on a device accessible to the at least one processor; and

update, based on the input, the semantic map.

19 . The CRSM of claim 18 , wherein the instructions are executable to:

request a label from a user for an object that cannot be recognized via object recognition, the object represented in the semantic map;

receive user input indicating the label; and

update the semantic map with the label.

20 . The CRSM of claim 18 , wherein the instructions are executable to:

trigger the first camera to generate the input for updating the semantic map, the first camera being triggered responsive to one or more of: user command, a recurring period of time ending.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2024
From: LENOVO (UNITED STATES) INC.
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 066104/0104 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2023
From: YEBKA, BOUZIANE; WONG, TIN-LUP; JAKES, PHILIP J
To: LENOVO (UNITED STATES) INC.
Reel/Frame 064538/0694 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2023
From: WANG, SONG; WANG, MENGNAN; BECK, KEVIN W; VANBLON, RUSSELL S
To: LENOVO (UNITED STATES) INC.
Reel/Frame 064538/0904 →