农业工程学报2023，Vol.39Issue(18)：172-182,11.DOI:10.11975/j.issn.1002-6819.202305118
基于阵列式ESP32-CAM的番茄根系表型原位测量方法
In-situ measuring tomato root phenotype using array ESP32-CAM
摘要
Abstract
The root is one of the most crucial parts of the plant to affect the overall healthy plant.The leaf can be the corresponding indicator at various stages of growth,even in the ultimate crop.However,some significant challenges still remain in the in-situ detection of soil roots.In this study,an in-situ measurement approach was presented for the tomato root phenotypes using the array ESP32-camera(CAM).Tomato root images were also captured for the in-situ measurement of root phenotypic parameters.A 4×4 array ESP32-CAM combined with 4×4 OV2640 lens module was used for the in-situ automatic wireless acquisition of soil root images.The camera was calibrated and corrected for the aberrations using the Zhang Zhengyou calibration.The image alignment was achieved using scale-invariant feature transform and K-nearest neighbor feature detection matching.The image stitching was obtained for the inter-camera transformation matrix using offline calibration.The semantic segmentation of root images was improved to introduce the efficient multi-head self-attention mechanism.The U-Net model was improved to mix the dice loss and cross-entropy loss.In-situ image acquisition experiments of tomato root systems were also conducted to obtain the images of periodic root changes.The root system was measured manually,i.e.,the root length was measured in sections by a soft ruler,the root diameter was obtained by averaging the points,the root area was approximated by the product of length and average diameter,and the root depth and width were obtained by measuring the vertical longitudinal depth and horizontal longitudinal width.Morphological processing and skeleton extraction were used to measure the root length,root area,and root mean diameter using pixel point scanning.By contrast,the root phenotypic parameters(such as the root depth and root width)were measured using the root convexity package.The results showed that the root mean square error(RMSE)of standard shape image stitching iterations of 4x4 camera array was less than 1.11 mm,and the subjective quality scores of the structural similarity index and difference of edge map of global stitched images were above 0.85,the peak signal-to-noise ratio(PSNR)was greater than 32 dB.The improved U-Net model shared the greater improvement in the search for root system completeness and accuracy.Specifically,the precision,recall,intersection over the union,and Fl value of the improved U-Net model on the tomato root segmentation were 86.06％,78.98％,71.41％,and 82.37％,respectively,which were 18.97 percentage points,13.21 percentage points,21.67 percentage points,and 16.30 percentage points higher than those of the original U-Net model training,respectively.Furthermore,the mean absolute percentage errors of calculated area,length,mean diameter,root depth,and root width of root systems were 7.78％,5.66％,8.48％,2.40％,and 2.23％,respectively,and the coefficients of determination were 0.91,0.93,0.84,0.98,and 0.99,respectively,compared with the manual measurements.In-situ measurement of the root phenotype of tomato plants can also be extended to the other plants or fruit trees.关键词
图像处理/根系/番茄/根系表型/原位/图像拼接/U-Net/ESP32-CAMKey words
image processing/roots/tomato/root phenotype/in-situ/image stitching/U-Net/ESP32-CAM分类
农业科技引用本文复制引用
孙国祥,蔡嘉奇,周新竹,徐乃旻..基于阵列式ESP32-CAM的番茄根系表型原位测量方法[J].农业工程学报,2023,39(18):172-182,11.基金项目
江苏省农业科技自主创新资金项目(CX(22)3097) （CX(22）
