Affiliation:
1. Georgia Institute of Technology, USA, NW, Atlanta, Georgia
Abstract
Visual body signals are designated body poses that deliver an application-specific message. Such signals are widely used for fast message communication in sports (signaling by umpires and referees), transportation (naval officers and aircraft marshallers), and construction (signaling by riggers and crane operators), to list a few examples. Automatic interpretation of such signals can help maintaining safer operations in these industries, help in record-keeping for auditing or accident investigation purposes, and function as a score-keeper in sports. When automation of these signals is desired, it is traditionally performed from a viewer's perspective by running computer vision algorithms on camera feeds. However, computer vision based approaches suffer from performance deterioration in scenarios such as lighting variations, occlusions, etc., might face resolution limitations, and can be challenging to install. Our work, ViSig, breaks with tradition by instead deploying on-body sensors for signal interpretation. Our key innovation is the fusion of ultra-wideband (UWB) sensors for capturing on-body distance measurements, inertial sensors (IMU) for capturing orientation of a few body segments, and photodiodes for finger signal recognition, enabling a robust interpretation of signals. By deploying only a small number of sensors, we show that body signals can be interpreted unambiguously in many different settings, including in games of Cricket, Baseball, and Football, and in operational safety use-cases such as crane operations and flag semaphores for maritime navigation, with > 90% accuracy. Overall, we have seen substantial promise in this approach and expect a large body of future follow-on work to start using UWB and IMU fused modalities for the more general human pose estimation problems.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Hardware and Architecture,Human-Computer Interaction
Reference92 articles.
1. 2002. Taxiing Accident involving Arrow Air APWP6L. https://www.mot.gov.sg/docs/default-source/about-mot/investigation-report/28-feb-2002.pdf. 2002. Taxiing Accident involving Arrow Air APWP6L. https://www.mot.gov.sg/docs/default-source/about-mot/investigation-report/28-feb-2002.pdf.
2. 2013. IEEE Standard for Information technology- Telecommunications and information exchange between systemsLocal and metropolitan area networks- Specific requirements-Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications-Amendment 4: Enhancements for Very High Throughput for Operation in Bands below 6 GHz. IEEE Std 802.11ac-2013 (Amendment to IEEE Std 802.11-2012 as amended by IEEE Std 802.11ae-2012 IEEE Std 802.11aa-2012 and IEEE Std 802.11ad-2012) (2013) 1--425. 2013. IEEE Standard for Information technology- Telecommunications and information exchange between systemsLocal and metropolitan area networks- Specific requirements-Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications-Amendment 4: Enhancements for Very High Throughput for Operation in Bands below 6 GHz. IEEE Std 802.11ac-2013 (Amendment to IEEE Std 802.11-2012 as amended by IEEE Std 802.11ae-2012 IEEE Std 802.11aa-2012 and IEEE Std 802.11ad-2012) (2013) 1--425.
3. 2016 . IEEE Standard for Low-Rate Wireless Networks. IEEE Std 802 . 15 .4-2015 (Revision of IEEE Std 802.15.4-2011) (2016), 1--709. https://doi.org/10.1109/IEEESTD.2016.7460875 10.1109/IEEESTD.2016.7460875 2016. IEEE Standard for Low-Rate Wireless Networks. IEEE Std 802.15.4-2015 (Revision of IEEE Std 802.15.4-2011) (2016), 1--709. https://doi.org/10.1109/IEEESTD.2016.7460875
4. 2017. Decawave User Manual. https://www.decawave.com/sites/default/files/resources/dw1000_user_manual_2.11.pdf. 2017. Decawave User Manual. https://www.decawave.com/sites/default/files/resources/dw1000_user_manual_2.11.pdf.
5. 2018. Antenna Delay Calibration of DW1000-based Products and Systems (APS014). https://www.qorvo.com/innovation/ultra-wideband/resources/application-notes. 2018. Antenna Delay Calibration of DW1000-based Products and Systems (APS014). https://www.qorvo.com/innovation/ultra-wideband/resources/application-notes.