IP Library Granted Patent US 11,086,922
Granted Patent B2
US 11,086,922 · App. 14/408,476 · Granted Aug 10, 2021

Farm work support device and method, program, recording medium, and farm work support system

Inventor: Masatoshi Funabashi (Tokyo, JP)
Assignee: Sony Corporation
G06F16/444A01G7/00A01G22/00G06F16/24578G06F16/532G06K7/10297G06Q10/00G06Q50/02H04N5/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,086,922
App. No.
14/408,476
Granted
Aug 10, 2021
Kind
B2
Abstract

Provided is a farm work support device including a reception unit configured to receive designation of plants to be cultivated, a retrieval unit configured to retrieve a vegetation design which is a vegetation combination proper for construction of a mixed and dense growth state of the designated plants, and an output unit configured to output the retrieved vegetation design.

Claims (95)

1. A farm work support device comprising:

at least one hardware processor; and

at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to:

receive a designation of plants to be cultivated, position information of cultivation sites in a field by a marker-less process, at least an image of each of the designated plants, and additional information observed in the field, at least a portion of which is tagged to at least some of the position information for each respective cultivation site to be superimposed as a plurality of augmented reality tags on the respective images of the designated plants to be cultivated at the respective cultivation sites;

retrieve a plurality of stored potential vegetation designs that each include the designated plants to be cultivated, the potential vegetation designs being vegetation combinations proper for construction of a mixed and dense growth state of the designated plants;

calculate a symbiotic score for each of the plurality of potential vegetation designs, the symbiotic score being an average value of weighted scores obtained by evaluating prior interaction of the designated plants, the weighted scores including at least a weighted score for each of the designated plants based on yield and the additional information observed in the field;

select a vegetation design for cultivation from the plurality of potential vegetation designs based on the symbiotic scores, wherein the selected vegetation design for cultivation includes a new combination of plants based on the additional information observed in the field; and

output an image of the selected vegetation design for cultivation with the plurality of augmented reality tags for display on the respective images of the designated plants, wherein at least one augmented reality tag includes information related to a vegetation management task for a respective designated plant in the image of the respective designated plant.

2. The farm work support device according to claim 1 , wherein the instructions cause the at least one hardware processor to select the vegetation design corresponding to a highest symbiotic score of the calculated symbiotic scores.

3. The farm work support device according to claim 1 , wherein the instructions cause the at least one hardware processor to retrieve each of the plurality of stored vegetation designs based on at least one of allelopathy of the plants in a respective stored vegetation design and information regarding crop rotation aptitude of the plants in a respective stored vegetation design.

4. The farm work support device according to claim 1 , wherein the symbiotic score is an average value of crop rotation aptitude scores and allelopathy scores corresponding to each plant in a potential vegetation design.

5. The farm work support device according to claim 1 , wherein the designated plants are to be cultivated according to collaborative farming.

6. The farm work support device according to claim 1 , wherein, after the designated plants are cultivated, the cultivated designated plants are managed based on GPS coordinates of the cultivation sites of the cultivated designated plants.

7. The farm work support device according to claim 6 , wherein, after the designated plants are cultivated, the plurality of augmented reality tags are managed in conjunction with the GPS coordinates of the cultivation sites of the cultivated designated plants.

8. The farm work support device according to claim 7 , wherein, after the designated plants are cultivated, a key event is managed in conjunction with the GPS coordinates of the cultivation sites of the cultivated designated plants.

9. The farm work support device according to claim 8 , wherein a photo of the plants is managed in conjunction with the GPS coordinates of the plants.

10. The farm work support device according to claim 8 , wherein the key event is graphed.

11. The farm work support device according to claim 6 , wherein the field including the cultivation sites is managed hierarchically.

12. The farm work support device according to claim 11 , wherein the field is managed on a map.

13. A farm work support method comprising:

receiving a designation of plants to be cultivated, position information of cultivation sites in a field by a marker-less process, at least an image of each of the designated plants, and additional information observed in the field, at least a portion of which is tagged to at least some of the position information for each respective cultivation site to be superimposed as a plurality of augmented reality tags on the respective images of the designated plants to be cultivated at the respective cultivation sites;

retrieving a plurality of stored potential vegetation designs that each include the designated plants to be cultivated;

calculating a symbiotic score for each of the plurality of potential vegetation designs, the symbiotic score being an average value of weighted scores obtained by evaluating prior interaction of the designated plants, the weighted scores including at least a weighted score for each of the designated plants based on yield and the additional information observed in the field;

selecting a vegetation design for cultivation from the plurality of potential vegetation designs based on the symbiotic score, wherein the selected vegetation design for cultivation includes a new combination of plants based on the additional information observed in the field; and

outputting an image of the selected vegetation design for cultivation with the plurality of augmented reality tags for display on the respective images of the designated plants, wherein at least one augmented reality tag includes information related to a vegetation management task for a respective designated plant in the image of the respective designated plant.

14. A non-transitory, computer-readable medium storing instructions, which when executed by a processor, cause the processor to perform:

receiving a designation of plants to be cultivated, position information of cultivation sites in a field by a marker-less process, at least an image of each of the designated plants, and additional information observed in the field, at least a portion of which is tagged to at least some of the position information for each respective cultivation site to be superimposed as a plurality of augmented reality tags on the respective images of the designated plants to be cultivated at the respective cultivation sites;

retrieving a plurality of stored potential vegetation designs that each include the designated plants to be cultivated;

calculating a symbiotic score for each of the plurality of potential vegetation designs, the symbiotic score being an average value of weighted scores obtained by evaluating prior interaction of the designated plants, the weighted scores including at least a weighted score for each of the designated plants based on yield and the additional information observed in the field;

selecting a vegetation design for cultivation from the plurality of potential vegetation designs based on the symbiotic score, wherein the selected vegetation design for cultivation includes a new combination of plants based on the additional information observed in the field; and

outputting an image of the selected vegetation design for cultivation with the plurality of augmented reality tags for display on the respective images of the designated plants, wherein at least one augmented reality tag includes information related to a vegetation management task for a respective designated plant in the image of the respective designated plant.

15. A farm work support device comprising:

at least one hardware processor; and

at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to:

receive a designation of plants to be cultivated, position information of cultivation sites in a field by a marker-less process, at least an image of each of the designated plants, and additional information observed in the field, at least a portion of which is tagged to at least some of the position information for each respective cultivation site to be superimposed as a plurality of augmented reality tags on the respective images of the designated plants to be cultivated at the respective cultivation sites;

acquire a plurality of stored potential vegetation designs of the designated plants that each include the designated plants to be cultivated;

calculate a symbiotic score for each of the plurality of potential vegetation designs, the symbiotic score being an average value of weighted scores obtained by evaluating prior interaction of the designated plants, the weighted scores including at least a weighted score for each of the designated plants based on yield and the additional information observed in the field;

select a vegetation design for cultivation from the plurality of potential vegetation designs based on the symbiotic score, wherein the selected vegetation design for cultivation includes a new combination of plants based on the additional information observed in the field; and

display an image of the selected vegetation design for cultivation superimposed with at least one of the plurality of augmented reality tags on a respective image of a designated plant, wherein at least one augmented reality tag includes information related to a vegetation management task for a respective designated plant in the image of the respective designated plant.

16. The farm work support device according to claim 15 , wherein the farm work support device is carried and used in the field.

17. The farm work support device according to claim 16 , further comprising:

a photographing unit configured to photograph the designated plants in the field after the designated plants are cultivated at respective cultivation sites.

18. The farm work support device according to claim 17 , further comprising:

a detection unit configured to detect GPS coordinates of the cultivation sites in the field.

19. The farm work support device according to claim 18 , further comprising:

an input unit configured to enable a user to input at least one of an augmented reality tag of the plurality of augmented reality tags to correspond with GPS coordinates of a cultivation site and a key event to correspond with GPS coordinates of a cultivation site.

20. The farm work support device according to claim 19 , wherein a display unit displays an augmented reality tag of the plurality of augmented reality tags to be superimposed on an image of the cultivated designated plants photographed by the photographing unit.

21. The farm work support device according to claim 20 , wherein the display unit hierarchically displays the field in which the designated plants vegetate after being cultivated.

22. The farm work support device according to claim 21 , wherein the display unit displays a position of the field on a map.

23. The farm work support device according to claim 22 , wherein the designated plants are to be cultivated according to collaborative farming.

24. The farm work support device according to claim 15 , wherein a display unit displays the vegetation design corresponding to a highest symbiotic score of the calculated symbiotic scores.

25. The farm work support device according to claim 24 , further comprising an input unit, wherein the input unit designates a number of displayed symbiotic scores which are higher than a value.

26. The farm work support device according to claim 15 , wherein each of the plurality of acquired potential vegetation designs are acquired based on at least one of allelopathy of the designated plants and information regarding crop rotation aptitude of the designated plants.

27. The farm work support device according to claim 15 , wherein the symbiotic score is an average value of all elements of crop rotation aptitude and allelopathy corresponding to the plants in a potential vegetation design.

28. A farm work support method comprising:

receiving a designation of plants to be cultivated, position information of cultivation sites in a field by a marker-less process, at least an image of each of the designated plants, and additional information observed in the field, at least a portion of which is tagged to at least some of the position information to be superimposed as a plurality of augmented reality tags on the respective images of the designated plants to be cultivated at the respective cultivation sites;

acquiring a plurality of stored potential vegetation designs of the designated plants that each include the designated plants to be cultivated;

calculating a symbiotic score for each of the plurality of potential vegetation designs, the symbiotic score being an average value of weighted scores obtained by evaluating prior interaction of the designated plants, the weighted scores including at least a weighted score for each of the designated plants based on yield and the additional information observed in the field;

selecting a vegetation design for cultivation from the plurality of potential vegetation designs based on the symbiotic score, wherein the selected vegetation design for cultivation includes a new combination of plants based on the additional information observed in the field; and

displaying an image of the selected vegetation design for cultivation superimposed with at least one of the plurality of augmented reality tags on a respective image of a designated plant, wherein at least one augmented reality tag includes information related to a vegetation management task for a respective designated plant in the image of the respective designated plant.

29. A non-transitory, computer-readable medium storing instructions, which when executed by a processor, cause the processor to perform:

receiving a designation of plants to be cultivated, position information of cultivation sites in a field by a marker-less process, at least an image of each of the designated plants, and additional information observed in the field, at least a portion of which is tagged to at least some of the position information for each respective cultivation site to be superimposed as a plurality of augmented reality tags on the respective images of the designated plants to be cultivated at the respective cultivate sites;

acquiring a plurality of stored potential vegetation designs of the designated plants that each include the designated plants to be cultivated;

calculating a symbiotic score for each of the plurality of potential vegetation designs, the symbiotic score being an average value of weighted scores obtained by evaluating prior interaction of the designated plants, the weighted scores including at least a weighted score for each of the designated plants based on yield and the additional information observed in the field;

selecting a vegetation design for cultivation from the plurality of potential vegetation designs based on the symbiotic score, wherein the selected vegetation design for cultivation includes a new combination of plants based on the additional information observed in the field; and

displaying an image of the selected vegetation design for cultivation superimposed with at least one of the plurality of augmented reality tags on a respective image of a designated plant, wherein at least one augmented reality tag includes information related to a vegetation management task for a respective designated plant in the image of the respective designated plant.

30. A farm work support system including a processor in communication with a memory, the processor configured to:

receive a designation of plants to be cultivated, position information of cultivation sites in a field by a marker-less process, at least an image of each of the designated plants, and additional information observed in the field, at least a portion of which is tagged to at least some of the position information for each respective cultivation site to be superimposed as a plurality of augmented reality tags on the respective images of the designated plants to be cultivated at the respective cultivation sites;

retrieve a plurality of stored potential vegetation designs of the designated plants that each include the designated plants to be cultivated;

calculate a symbiotic score for each of the plurality of potential vegetation designs, the symbiotic score being an average value of weighted scores obtained by evaluating prior interaction of the designated plants, the weighted scores including at least a weighted score for each of the designated plants based on yield and the additional information observed in the field;

selecting a vegetation design for cultivation from the plurality of potential vegetation designs based on the symbiotic score, wherein the selected vegetation design for cultivation includes a new combination of plants based on the additional information observed in the field; and

display an image of the selected vegetation design for cultivation superimposed with at least one of the plurality of augmented reality tags on a respective image of a designated plant, wherein at least one augmented reality tag includes information related to a vegetation management task for a respective designated plant in the image of the respective designated plant.

31. The farm work support device according to claim 1 , wherein the hardware processor calculates the symbiotic score using the following equation:

SC=ΣEi/n

wherein SC is the symbiotic score, n is a number of weighted scores, and Ei is a weighted score of an i-th plant of a potential vegetation design.

32. The farm work support method of claim 13 , wherein calculating the symbiotic score includes using the following equation:

SC=ΣEi/n

wherein SC is the symbiotic score, n is a number of weighted scores, and Ei is a weighted score of an i-th plant of a potential vegetation design.

33. The non-transitory recording medium of claim 14 , wherein calculating the symbiotic score includes using the following equation:

SC=ΣEi/n

wherein SC is the symbiotic score, n is a number of weighted scores, and Ei is a weighted score of an i-th plant of a potential vegetation design.

34. The farm work support device according to claim 15 , wherein the hardware processor calculates the symbiotic score using the following equation:

SC=ΣEi/n

wherein SC is the symbiotic score, n is a number of weighted scores, and Ei is a weighted score of an i-th plant of a potential vegetation design.

35. The farm work support method of claim 28 , wherein calculating the symbiotic score includes using the following equation:

SC=ΣEi/n

wherein SC is the symbiotic score, n is a number of weighted scores, and Ei is a weighted score of an i-th plant of a potential vegetation design.

36. The non-transitory recording medium of claim 29 , wherein calculating the symbiotic score includes using the following equation:

SC=ΣEi/n

wherein SC is the symbiotic score, n is a number of weighted scores, and Ei is a weighted score of an i-th plant of a potential vegetation design.

37. The farm work support system of claim 30 , wherein the symbiotic score is calculated using the following equation:

SC=ΣEi/n

wherein SC is the symbiotic score, n is a number of weighted scores, and Ei is a weighted score of an i-th plant of a potential vegetation design.

38. The farm work support device according to claim 1 , wherein the selected vegetation design includes a species diversity exceeding a natural state.

39. The farm work support device according to claim 1 , wherein the additional information includes at least names of plants vegetating in the field.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2015
From: FUNABASHI, MASATOSHI
To: SONY CORPORATION
Reel/Frame 034780/0730 →
Priority Claims (1)
JP JP2012-150172 · Jul 4, 2012 · national
Continuity (1)
Related Publication 20150186387A1 · Jul 2, 2015
Cited By (1)
US 12,271,840