Granted Patent B2

US 12,506,807 · App. 18/168,286 · Granted Dec 23, 2025

Inventors: Changwon Jang (Suwon-si, KR); Seungjin Yu (Suwon-si, KR); Seungbum Ju (Suwon-si, KR)

Assignee: Samsung Electronics Co., Ltd.

H04L67/12B60R16/023G06V10/12G06V10/82G06V20/593G06V20/597H04L43/0888

Abstract

Claims (57)

1 . A method performed by an electronic device mounted on a vehicle, the method comprising:

monitoring, by the electronic device, a number of occupants riding in the vehicle;

obtaining, by the electronic device, communication access information comprising number information and use amount information, the number information including information about a number of connectors, from among the occupants, accessing communication circuitry included in the electronic device, the use amount information including information about a use amount of data transmitted to and received from a base station through the communication circuitry;

recognizing, by the electronic device, an operation pattern of the occupants; by using an occupant monitoring system (OMS), the operation pattern of the occupants being recognized by the electronic device based on an occupant image of the occupants riding in the vehicle;

based on the number of occupants, the communication access information, and the operation pattern of the occupants, predicting, by the electronic device, a data throughput to be transmitted and received through the communication circuitry; and

, based on the predicted data throughput, determining, by the electronic device, whether to change a first communication scheme in use to a second communication scheme, the second communication scheme being fifth generation (5G) millimeter wave (mmWave) communication.

2 . The method of claim 1 , wherein the monitoring of the number of occupants comprises:

obtaining, by the electronic device using a camera, the occupant image by capturing, the occupants riding in the vehicle;

detecting, by the electronic device, the occupants from the occupant image via image processing or by using an object detection model; and

counting, by the electronic device, a number of occupants.

3 . The method of claim 1 , wherein the recognizing of the operation pattern of the occupants comprises:

obtaining, by the electronic device using a camera, the occupant image by capturing; the occupants riding in the vehicle; and

recognizing, by the electronic device, the operation pattern of the occupants from the occupant image by using a deep neural network (DNN) model including a pre-trained model parameter.

4 . The method of claim 3 , wherein the DNN model includes an artificial intelligence (AI) model obtained by training by applying a plurality of pre-obtained images as an input and applying a label value with respect to the operation pattern as an output.

5 . The method of claim 1 , wherein the determining of whether to change the first communication scheme comprises:

comparing, by the electronic device, the predicted data throughput with a predetermined threshold value; and

, based on a result of the comparing, determining, by the electronic device, whether to maintain the first communication scheme or change the first communication scheme to the second communication scheme.

6 . The method of claim 5 ,

wherein the determining of whether to change the first communication scheme comprises:

based on the result of the comparing, indicating that the predicted data throughput is less than or equal to the predetermined threshold value, determining, by the electronic device, to continually use the first communication scheme to perform data transmission and reception, and

wherein the first communication scheme comprises any one of 5G Sub 6, long term evolution (LTE), or a third generation (3G) communication scheme.

7 . The method of claim 5 , wherein the determining of whether to change the first communication scheme comprises:

based on the result of the comparing, indicating that the predicted data throughput exceeds the predetermined threshold value, determining, by the electronic device, to change the first communication scheme to the second communication scheme; and

transmitting and receiving, by the electronic device, data by using the second communication scheme.

8 . An electronic device mounted on a vehicle, the electronic device comprising:

a camera configured to obtain an occupant image by capturing occupants riding in the vehicle;

a sensor configured to obtain information regarding a number of occupants by detecting a number of human beings getting on or off the vehicle;

a communication interface configured to perform data transmission and reception by using a predetermined first communication scheme;

memory storing a program comprising one or more instructions to control the electronic device; and

one or more processors communicatively coupled to the camera, the sensor, the communication interface, and the memory,

wherein the one or more instructions, when executed by the one or more processors individually or collectively, cause the electronic device to:

monitor the number of occupants riding in the vehicle, by using the occupant image and the information obtained by the sensor, obtain communication access information comprising number information and use amount information, the number information including information about a number of connectors accessing the communication interface, the use amount information including information about a use amount of data transmitted to and received from a base station through the communication interface,

recognize an operation pattern of the occupants, by using an occupant monitoring system (OMS), the operation pattern of the occupants being recognized by the electronic device based on the occupant image of the occupants riding in the vehicle,

based on the number of occupants, the communication access information, and the operation pattern of the occupants predict a data throughput to be transmitted and received through the communication interface, and

based on the predicted data throughput, determine whether to change a first communication scheme in use to a second communication scheme, is the second communication scheme being fifth generation (5G) millimeter wave (mmWave) communication.

9 . The electronic device of claim 8 , wherein the one or more instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

obtain the occupant image from the camera,

detect the occupants from the occupant image via image processing or by using an object detection model, and

count the number of occupants.

10 . The electronic device of claim 8 , wherein the one or more instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to;

recognize the operation pattern of the occupants from the occupant image by using a deep neural network (DNN) model including a pre-trained model parameter.

11 . The electronic device of claim 10 , wherein the DNN model includes an artificial intelligence (AI) model obtained by training by applying a plurality of pre-obtained images as an input and applying a label value with respect to the operation pattern as an output.

12 . The electronic device of claim 8 , wherein the one or more instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

compare the predicted data throughput with a predetermined threshold value, and

based on a result of the comparing, determine whether to maintain the first communication scheme or change the first communication scheme to the second communication scheme.

13 . The electronic device of claim 12 ,

wherein the one or more instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

based on the result of the comparing, indicating that the predicted data throughput is less than or equal to the predetermined threshold value, determine to continually use the first communication scheme to perform data transmission and reception, and

wherein the first communication scheme comprises any one of 5G Sub 6, long term evolution (LTE), or a third generation (3G) communication scheme.

14 . The electronic device of claim 12 , wherein the one or more instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

based on the result of the comparing, indicating that the predicted data throughput exceeds the predetermined threshold value, determine to change the first communication scheme to the second communication scheme, and control the communication interface to transmit and receive data by using the second communication scheme.

15 . A non-transitory computer program product comprising a computer-readable storage medium including instructions executed by an electronic device mounted on a vehicle, the instructions being configured to execute operations of:

monitoring, by the electronic device, a number of occupants riding in the vehicle;

obtaining, by the electronic device, communication access information comprising number information and use amount information, the number information including information about a number of connectors, from among the occupants, accessing communication circuitry included in the electronic device, the use amount information including information about a use amount of data transmitted to and received from a base station through the communication circuitry;

recognizing, by the electronic device, an operation pattern of the occupants, by using an occupant monitoring system (OMS), the operation pattern of the occupants being recognized by the electronic device based on an occupant image of the occupants riding in the vehicle;

based on the number of occupants, the communication access information, and the operation pattern of the occupants, predicting, by the electronic device, a data throughput to be transmitted and received through the communication circuitry; and

based on the predicted data throughput, determining, by the electronic device, whether to change a first communication scheme in use to a second communication scheme, the second communication scheme being fifth generation (5G) millimeter wave (mmWave) communication.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (35)