IP Library Granted Patent US 12,385,755
Granted Patent B2
US 12,385,755 · App. 17/760,267 · Granted Aug 12, 2025

Method for preparing road guidance instructions

Inventors: Frederic Costa (Gif sur Yvette, FR); Lea Patteyn (La Brede, FR)
Assignees: AMPERE S.A.S.; NISSAN MOTOR CO., LTD.
G01C21/3629G01C21/3602G01C21/3647G01C21/3691
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,385,755
App. No.
17/760,267
Granted
Aug 12, 2025
Kind
B2
Abstract

A method prepares voice guidance instructions for an individual, formulated in the most natural fashion possible. The method includes:—determining, by a computer, a path to be followed, —acquiring, by an image acquisition unit, at least one image of the environment of the individual, —processing the image in order to detect at least one object therein and in order to characterise the object, and —preparing a voice guidance instruction supplying the user with a piece of information for carrying out a manoeuvre in order to follow the path. The method also includes determining a level of complexity of the manoeuvre, and, in the preparation step, the voice guidance instruction is formulated using an indication deduced from the characterisation of the object only if the level of complexity of the manoeuvre is greater than a first threshold.

Claims (70)

1. A method for generating voice guidance instructions intended for an individual of a vehicle, the method comprising:

determining, via a computer, a route to be taken by the vehicle;

acquiring, via a camera located at the vehicle, at least one image of an environment of the individual;

processing, via the computer, said image to detect therein at least one object and to characterize said object;

generating, via the computer, and transmitting a voice guidance instruction informing the individual how to perform a maneuver of the vehicle in order to follow said route; and

determining, via the computer, a level of complexity of said maneuver of the vehicle, wherein

the generating includes formulating said voice guidance instruction using a cue deduced from the characterization of said object only when the level of complexity of said maneuver of the vehicle is higher than a first threshold, such that the voice guidance instruction, which includes the cue, is output via a speaker associated with the vehicle, and

when the level of complexity of said maneuver of the vehicle is higher than a second threshold, which is strictly higher than the first threshold, the generating includes formulating said voice guidance instruction using the cue deduced from the characterization of said object as well as an additional cue that provides additional details associated with said maneuver of the vehicle, such that the voice guidance instruction, which includes both the cue and the additional cue, is output via the speaker associated with the vehicle.

2. The generating method as claimed in claim 1 , wherein the level of complexity is computed depending on at least one of the following criteria:

a position of the vehicle with respect to a zone in which said maneuver must be performed,

a type of road infrastructure present in the zone in which said maneuver must be performed,

a tension felt by the individual,

a density of road traffic,

a number of objects detected in at least one portion of the acquired image,

the individual's knowledge of the road infrastructure,

a phase in which the vehicle is currently,

and, when the road infrastructure is a roundabout, also depending on at least one of the following criteria:

an angle between an axis of arrival of the individual at the roundabout and an axis of exit of the individual from the roundabout,

the angle between at least two roads leading to the roundabout,

a number of roads leading to the roundabout,

a difference between a number of entrances to the roundabout and a number of exits from the roundabout,

a number of lanes present in the roundabout, and

an outside diameter of the roundabout.

3. The generating method as claimed in claim 1 , wherein, said cue being a visual cue visible to the individual, when, between a moment at which the voice guidance instruction was transmitted vocally and a moment when the maneuver must be performed, the visual cue disappears from the environment visible to the individual, provision is made for generating a new voice guidance instruction not using said visual cue.

4. The generating method as claimed in claim 1 , wherein, said cue being a visual cue visible to the individual, when, between a moment at which the voice guidance instruction was transmitted vocally and a moment when the maneuver must be performed, another visual cue that is indistinguishable from the visual cue used in the voice guidance instruction appears in the environment visible to the individual, provision is made for generating a new voice guidance instruction different from the voice guidance instruction that was transmitted vocally.

5. The generating method as claimed in claim 1 , wherein provision is made to determine a cost relating to an additional time or distance that an error in following said route would cause, and wherein the level of complexity is determined depending on said cost.

6. The generating method as claimed in claim 1 , wherein provision is made to distinguish between at least two distinct and successive phases prior to the performance of said maneuver, namely a maneuver-anticipation phase, in which a voice guidance instruction configured to be transmitted to indicate to the individual how to position himself to approach the maneuver, and a description phase, in which a voice guidance instruction is transmitted to indicate to the individual how to perform the maneuver, and wherein the voice guidance instructions transmitted in these phases use distinct cues, provision further being made for at least one other phase which follows the description phase and in which a voice guidance instruction may be generated, said other phase being:

an accompaniment phase simultaneous to said maneuver, or

a reassurance phase subsequent to said maneuver and allowing it to be indicated to the individual whether he has performed the maneuver correctly, or

a continuity phase allowing the individual to be informed of an active character of said generating method.

7. The generating method as claimed in claim 6 , wherein, when the voice guidance instruction transmitted during the description phase did not refer to any visual indicator and the vehicle slows down, provision is made in the accompaniment phase to transmit a voice guidance instruction using a cue.

8. The generating method as claimed in claim 6 , wherein, in the reassurance phase, provision is made to transmit a voice guidance instruction using a visual indicator distinct from the cues used in the one or more voice guidance instructions transmitted during preceding phases.

9. The generating method as claimed in claim 6 , wherein, in the continuity phase, provision is made to generate a different voice guidance instruction depending on whether a radius of curvature of a road taken is lower or higher than a threshold.

10. The generating method as claimed in claim 1 , wherein, the determining the route to be taken comprises retrieving, from a map database, static visual indicators located on said route and attributes associated with said static visual indicators, provision is made to determine an attribute common to a plurality of static visual indicators, the voice guidance instruction being formulated in the generating using a cue comprising the common attribute when the object is characterized as comprising the common attribute in the processing said image.

11. The generating method as claimed in claim 10 , wherein, the static visual indicators being road signs, the common attribute comprises a name that is written on a road sign or a background color of a road sign, the object being a road sign.

12. The generating method as claimed in claim 10 , wherein

the processing said image comprises detecting a plurality of objects, and

the generating method further comprises classifying the detected objects, an object characterized as having the common attribute being prioritized, the object selected for the generating being the prioritized object.

13. A device for generating route guidance instructions that are tailored to an environment of a vehicle, the device comprising:

a camera configured to acquire images of the environment;

a map database;

a navigation and geolocation system;

processing circuitry configured to receive and combine elements originating from the camera, from the map database and from the navigation and geolocation system; and

a voice transmitter configured to transmit an indication to an individual, wherein

the processing circuitry is configured to

determine a route to be taken by the vehicle,

receive, from the camera, at least one image of an environment of the individual,

process the image to detect therein at least one object and to characterize the object,

generate a voice guidance instruction informing the individual how to perform a maneuver of the vehicle in order to follow the route, and

determine a level of complexity of the maneuver of the vehicle,

the processing circuitry is configured to generate by formulating the voice guidance instruction using a cue deduced from the characterization of the object only when the level of complexity of the maneuver of the vehicle is higher than a first threshold, such that the voice guidance instruction, which includes the cue, is output via the voice transmitter, and

when the level of complexity of the maneuver of the vehicle is higher than a second threshold, which is strictly higher than the first threshold, the processing circuitry is configured to generate by formulating the voice guidance instruction using the cue deduced from the characterization of the object as well as an additional cue that provides additional details associated with the maneuver of the vehicle, such that the voice guidance instruction, which includes both the cue and the additional cue, is output via the voice transmitter.

14. The generating method as claimed in claim 1 , wherein the level of complexity is computed depending on:

a position of the vehicle with respect to a zone in which said maneuver must be performed,

a type of road infrastructure present in the zone in which said maneuver must be performed,

a tension felt by the individual,

a density of road traffic,

a number of objects detected in at least one portion of the acquired image,

the individual's knowledge of the road infrastructure,

a phase in which the vehicle is currently, and

when the road infrastructure is a roundabout, also depending on at least one of the following criteria:

an angle between an axis of arrival of the individual at the roundabout and an axis of exit of the individual from the roundabout,

an angle between at least two roads leading to the roundabout,

a number of roads leading to the roundabout,

a difference between the number of entrances to the roundabout and the number of exits from the roundabout,

a number of lanes present in the roundabout, and

an outside diameter of the roundabout.

15. The generating method as claimed in claim 1 , wherein

the processing said image comprises detecting a plurality of objects, and

the generating method further comprises classifying the detected objects using a trained artificial intelligence and performing a statistical computation to assign a weight to each of the detected objects.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2024
From: RENAULT S.A.S.
To: AMPERE S.A.S.
Reel/Frame 067526/0311 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2023
From: COSTA, FREDERIC; PATTEYN, LEA
To: RENAULT S.A.S; NISSAN MOTOR CO., LTD.
Reel/Frame 065636/0205 →
Priority Claims (1)
FR 20 01123 · Feb 5, 2020 · national
Continuity (1)
Related Publication 20230072552A1 · Mar 9, 2023
References Cited (13)
US 6212470B1 · Seymour et al. · 2001 [cited by applicant]
US 20050256635A1 · Gardner · 2005 [cited by examiner]
US 20100250126A1 · Epshtein et al. · 2010 [cited by applicant]
US 20110187515A1 · Saito · 2011 [cited by examiner]
US 20120016586A1 · Epshtein et al. · 2012 [cited by applicant]
US 20130096822A1 · Sempuku et al. · 2013 [cited by applicant]
US 20130311081A1 · Yamakawa · 2013 [cited by examiner]
EP 0577782A1 · 1994 [cited by applicant]
EP 1947421A1 · 2008 [cited by applicant]
FR 2824945A1 · 2002 [cited by applicant]
FR 3078565A1 · 2019 [cited by examiner]
International Search Report issued Apr. 16, 2021 in PCT/EP2021/051068, filed on Jan. 19, 2021, 3 pages. [cited by applicant]
French Preliminary Search Report issued Sep. 10, 2020 in French Application 20 01123, filed on Feb. 5, 2020, 3 pages (with English Translation of Categories of cited documents). [cited by applicant]