Abstract
AbstractOrthoptera are insects with excellent olfactory sense abilities due to their antennae richly equipped with receptors. This makes them interesting model organisms to be used as biosensors for environmental and agricultural monitoring. Herein, we investigated if the house cricket Acheta domesticus can be used to detect different chemical cues by examining the movements of their antennae and attempting to identify specific antennal displays associated to different chemical cues exposed (e.g., sucrose or ammonia powder). A neural network based on state-of-the-art techniques (i.e., SLEAP) for pose estimation was built to identify the proximal and distal ends of the antennae. The network was optimised via grid search, resulting in a mean Average Precision (mAP) of 83.74%. To classify the stimulus type, another network was employed to take in a series of keypoint sequences, and output the stimulus classification. To find the best one-dimensional convolutional and recurrent neural networks, a genetic algorithm-based optimisation method was used. These networks were validated with iterated K-fold validation, obtaining an average accuracy of 45.33% for the former and 44% for the latter. Notably, we published and introduced the first dataset on cricket recordings that relate this animal’s behaviour to chemical stimuli. Overall, this study proposes a novel and simple automated method that can be extended to other animals for the creation of Biohybrid Intelligent Sensing Systems (e.g., automated video-analysis of an organism’s behaviour) to be exploited in various ecological scenarios.
Funder
Scuola Superiore Sant'Anna
Publisher
Springer Science and Business Media LLC
Subject
Artificial Intelligence,Computer Vision and Pattern Recognition,Software
Reference37 articles.
1. Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, Laak JAWM, Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. CoRR abs/1702.05747arXiv: 1702.05747
2. Jha K, Doshi A, Patel P, Shah M (2019) A comprehensive review on automation in agriculture using artificial intelligence. Artificial Intell Agricult. https://doi.org/10.1016/j.aiia.2019.05.004
3. Couzin ID, Heins C (2023) Emerging technologies for behavioral research in changing environments. Trends in Ecology & Evolution 38(4):346–354. https://doi.org/10.1016/j.tree.2022.11.008. Special issue: Animal behaviour in a changing world
4. Khanzode KCA, Sarode RD (2020) Advantages and disadvantages of artificial intelligence and machine learning: A literature review. Int J Library Inform Sci (IJLIS) 9(1):3
5. Rolnick D, Donti PL, Kaack LH, Kochanski K, Lacoste A, Sankaran K, Ross AS, Milojevic-Dupont N, Jaques N, Waldman-Brown A, Luccioni A, Maharaj T, Sherwin ED, Mukkavilli SK, Körding KP, Gomes CP, Ng AY, Hassabis D, Platt JC, Creutzig F, Chayes JT, Bengio Y (2019) Tackling climate change with machine learning. CoRR abs/1906.05433arXiv: 1906.05433