DC-SAM: DILATED CONVOLUTION AND SPECTRAL ATTENTION MODULE FOR WHEAT SALT STRESS CLASSIFICATION AND INTERPRETATION
Abstract
Salt stress can impact wheat production significantly and is difficult to be managed when the condition is critical. Hence, detecting such stress whet it is at an early stage is important. This paper proposed a deep learning method called Dilated Convolution and Spectral Attention Module (DC-SAM), which exploits the difference in spectral responses of healthy and stressed wheat. The proposed DC-SAM method consists of two key modules: (i) a dilated convolution module to capture spectral features with large receptive field; (ii) a spectral attention module to adaptively fuse the spectral features based on their interrelationship. As the dilated convolution module has long receptive fields, it can capture short- and long dependency patterns that exist in hyperspectral data. Our experimental results with four datasets show that DC-SAM outperforms existing state-of-the-art methods. Also, the output of the proposed attention module reveals the most discriminative spectral bands for a given wheat stress classification task.
Full Text:
PDFReferences
M. Sarwat, A. Ahmad, M. Z. Abdin and M. M. Ibrahim, Stress Signaling in Plants: Genomics and Proteomics Perspective, 2 ed., Springer International Publishing, Cham, 2013.
N. Suzuki, R. M. Rivero, V. Shulaev, E. Blumwald and R. Mittler, "Abiotic and biotic stress combinations," New Phytologist, vol. 203, no. 1, pp. 32-43, 7 2014.
Y. Wang, H. Wang and Z. Peng, "Rice diseases detection and classification using attention based neural network and bayesian optimization," Expert Systems with Applications, vol. 178, p. 114770, 9 2021.
A.-K. Mahlein, "Plant Disease Detection by Imaging Sensors – Parallels and Specific Demands for Precision Agriculture and Plant Phenotyping," Plant Disease, vol. 100, no. 2, pp. 241-251, 2016.
A. Graves, A. R. Mohamed and G. Hinton, "Speech recognition with deep recurrent neural networks," ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, pp. 6645-6649, 10 2013.
V. Chow, "Predicting auction price of vehicle license plate with deep recurrent neural network," Expert Systems with Applications, vol. 142, p. 113008, 3 2020.
Z. C. Lipton, J. Berkowitz and C. Elkan, "A Critical Review of Recurrent Neural Networks for Sequence Learning," arXiv preprint arXiv:1506.00019, 5 2015.
F. Zhou, R. Hang, Q. Liu and X. Yuan, "Hyperspectral image classification using spectral-spatial LSTMs," Neurocomputing, vol. 328, pp. 39-47, 2 2019.
Q. Liu, F. Zhou, R. Hang and X. Yuan, "Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification," Remote Sensing, vol. 9, no. 12, p. 1330, 12 2017.
W. Hu, Y. Huang, L. Wei, F. Zhang and H. Li, "Deep Convolutional Neural Networks for Hyperspectral Image Classification," Journal of Sensors, vol. 2015, pp. 1-12, 7 2015.
A. Barredo Arrieta, N. Díaz-Rodríguez, J. Del Ser, A. Bennetot, S. Tabik, A. Barbado, S. Garcia, S. Gil-Lopez, D. Molina, R. Benjamins, R. Chatila and F. Herrera, "Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI," Information Fusion, vol. 58, pp. 82-115, 6 2020.
M. T. Ribeiro, S. Singh and C. Guestrin, ""Why should i trust you?" Explaining the predictions of any classifier," Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Vols. 13-17-Augu, pp. 1135-1144, 8 2016.
A. Moghimi, C. Yang and P. M. Marchetto, "Ensemble Feature Selection for Plant Phenotyping: A Journey from Hyperspectral to Multispectral Imaging," IEEE Access, vol. 6, pp. 56870-56884, 2018.
I. Iliev, D. Krezhova, T. Yanev, E. Kirova and V. Alexieva, "Response of chlorophyll fluorescence to salinity stress on the early growth stage of the soybean plants (Glycine max L.)," 4th International Conference on Recent Advances Space Technologies, pp. 403-407, 2009.
D. Krezhova, I. Iliev, T. Yanev and E. Kirova, "Assessment of the effect of salinity on the early growth stage of soybean plants (Glycine max L.)," RAST 2009 - Proceedings of 4th International Conference on Recent Advances Space Technologies, pp. 397-402, 2009.
S. Lundberg and S.-I. Lee, "A Unified Approach to Interpreting Model Predictions," Advances in Neural Information Processing Systems, Vols. 2017-Decem, pp. 4766-4775, 5 2017.
S. Woo, J. Park, J.-Y. Lee and I. S. Kweon, "CBAM: Convolutional Block Attention Module," Proceedings of the European Conference on Computer Vision (ECCV), pp. 3-19, 2018.
J. Hou, G. Wang, X. Chen, J.-H. Xue, R. Zhu and H. Yang, "Spatial-Temporal Attention Res-TCN for Skeleton-based Dynamic Hand Gesture Recognition," Proceedings of the European Conference on Computer Vision (ECCV) Workshops, p. 0, 2018.
S. Zagoruyko and N. Komodakis, "Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer," 5th International Conference on Learning Representations, ICLR 2017 - Conference Track Proceedings, p. 0, 12 2017.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser and I. Polosukhin, "Attention is all you need," Advances in Neural Information Processing Systems, vol. 30, pp. 5999-6009, 6 2017.
J. Cheng, L. Dong and M. Lapata, "Long Short-Term Memory-Networks for Machine Reading," EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings, pp. 551-561, 1 2016.
Z. Lin, M. Feng, C. N. dos Santos, M. Yu, B. Xiang, B. Zhou and Y. Bengio, "A Structured Self-attentive Sentence Embedding," arXiv preprint arXiv:1703.03130, 3 2017.
A. P. Parikh, O. Täckström, D. Das and J. Uszkoreit, "A Decomposable Attention Model for Natural Language Inference," EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings, pp. 2249-2255, 6 2016.
L. Mou, P. Ghamisi and X. X. Zhu, "Deep recurrent neural networks for hyperspectral image classification," IEEE Transactions on Geoscience and Remote Sensing, vol. 55, no. 7, pp. 3639-3655, 7 2017.
L. Mou and X. X. Zhu, "Learning to Pay Attention on Spectral Domain: A Spectral Attention Module-Based Convolutional Network for Hyperspectral Image Classification," IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 1, pp. 110-122, 1 2020.
Q. Liu, Z. Li, S. Shuai and Q. Sun, "Spectral group attention networks for hyperspectral image classification with spectral separability analysis," Infrared Physics and Technology, vol. 108, p. 103340, 8 2020.
I. Kakogeorgiou and K. Karantzalos, "Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing," International Journal of Applied Earth Observation and Geoinformation, vol. 103, p. 102520, 12 2021.
A. Van Den Oord, S. Dieleman, Zen and H, "WaveNet: A generative model for raw audio," SSW, no. 2, p. 125, 2016.
A. van den Oord, N. Kalchbrenner, O. Vinyals, L. Espeholt, A. Graves and K. Kavukcuoglu, "Conditional Image Generation with PixelCNN Decoders," Advances in Neural Information Processing Systems, pp. 4797-4805, 6 2016.
A. Moghimi, C. Yang, M. E. Miller, S. F. Kianian and P. M. Marchetto, "A Novel Approach to Assess Salt Stress Tolerance in Wheat Using Hyperspectral Imaging," Frontiers in Plant Science, vol. 9, p. 1182, 8 2018.
W. N. Khotimah, M. Bennamoun, F. Boussaid, F. Sohel and D. Edwards, "A high-performance spectral-spatial residual network for hyperspectral image classification with small training data," Remote Sensing, vol. 12, no. 19, p. 3137, 10 2020.
Y. Xu, L. Zhang, B. Du and F. Zhang, "Spectral-Spatial Unified Networks for Hyperspectral Image Classification," IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 10, pp. 5893--5909, 2018.
D. Hong, Z. Han, J. Yao and L. Gao, "SpectralFormer: Rethinking Hyperspectral Image Classification with Transfprmers," IEEE Transactions on Geoscience and Remote Sensing, p. 1, 2021.
DOI: http://dx.doi.org/10.12962/j24068535.v21i2.a1219
Refbacks
- There are currently no refbacks.
