Author:
Fu Yubin,Ma Xiaochuan,Feng Chao,Pei Xingxuan,Li Pengzhuo
Abstract
AbstractThe Doppler shift of low-speed targets is frequently disturbed by the reverberation Doppler spread clutter under the shallow sea. The clutter is generated by underwater scatterers, which increases the difficulty of Doppler estimation. To solve this problem, a reverberation target resolution function based on the Doppler spread clutter statistical model is proposed in this paper. Through the width of reverberation Doppler clutter, this function adjusts the waveform parameters by determining whether the target is discriminable. In addition, the reverberation Doppler spread clutter is time-spatial varying and affected by grazing angle, waves, wind speed, fish and other effects. Thus, the sonar waveform parameters need to be adjusted constantly. Therefore, this paper combines the cognitive sonar based on reinforcement learning with the reverberation target resolution function to evaluate different waveforms in different environments. Consequently, the sonar can adjust the waveform parameters in real-time and obtain the optimal waveform in different environments. Meanwhile, in this paper, the action selection strategy of Dyna-Q reinforcement learning is optimized, and the model-based maximum action selection Dyna-Q algorithm (Dyna-Q-Max-Action) is proposed. Compared with the traditional Dyna-Q and Q-learning algorithms, the proposed algorithm needs fewer episodes. Finally, numerical simulation verified the effectiveness of the proposed algorithm.
Funder
the Deep Sea Observation Project
Publisher
Springer Science and Business Media LLC
Reference24 articles.
1. Z. Hao ke, M. Qu li, L. Hai lin, Study on robust space-time adaptive reverberation suppressing, in IEEE 10th International Conference on Signal Processing Proceedings, pp. 2407–2410 (2010)
2. X. Cui, C. Chi, S. Li, Y. Li, H. Huang, Coprime pulse trains of frequency-modulated for suppressing reverberation, in OCEANS 2021: San Diego Porto, pp. 1–4 (2021)
3. B.W. Choi, E.H. Bae, J.S. Kim, K.K. Lee, Improved prewhitening method for linear frequency modulation reverberation using dechirping transformation. J. Acoust. Soc. Am. 123(3), 21–25 (2008)
4. J.N. Maksym, M. Sandys-Wunsch, Adaptive beamforming against reverberation for a three-sensor array. J. Acoust. Soc. Am. 102(6), 3433–3438 (1997)
5. Y. Li, H. Huang, C. Zhang, S. Li, New schur-type-based pci algorithms for reverberation suppression in active sonar, in Proceedings. (ICASSP ’05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005, vol. 4, pp. 641–6444 (2005)