Vehicle Activity Dataset: A Multimodal Dataset to Understand Vehicle Emissions with Road Scenes for Eco-Routing

Abstract

In the field of smart mobility, Artificial Intelligence (AI) approaches are influential and can make a highly beneficial contribution. Our project aims to develop a real-time ecological map of road traffic. This map will allow electric vehicles (EVs) and thermal vehicles (TVs) to display the cost of energy consumption and CO2 emissions on different road sections. In urban environments, road traffic emissions are a significant contributor to environmental pollution, with vehicle emissions being a major component. Addressing these impacts requires a thorough understanding of the operational behavior of vehicles on different road infrastructures within the region. This paper presents a novel, comprehensive dataset, the Vehicle Activity Dataset (VAD), designed to assess the emissions and fuel consumption characteristics of vehicles about their actual operating environment. Constructed from a large number of real-world driving scenarios, VAD incorporates emission data collected by an industrial Portable Emission Measurement System (PEMS), road scenes captured by an RGB camera, and the detection of different object classes within these images. The primary objective of VAD is to provide a comprehensive understanding of the relationship between vehicle emissions and the diverse range of objects present on the road. Experimental results in real road traffic environments through different studies demonstrate the robustness of the developed dataset.