WarenstromInfo: a tool for the easy extraction and visualisation of trade flow data

Abstract

Epidemiological outbreak investigations often prove to be lengthy and inconclusive due to the time-consuming nature of the currently-used approaches. An alternative approach to address these challenges could involve the application of algorithms to support authorities and food business operators by providing timely, relevant and reliable information. Algorithms, such as gravity models, could be applied as commodity trade models, but they require a large amount of reliable and consistent data on trade for generating projections at international, national or even regional level. Several trade databases, such as UN COMTRADE, EUROSTAT, BACI, CHELEM and GTAP, provide information on trace, albeit with variations in the provided information and in the structure. However, it is worth noting that not all of these databases are freely accessible and data management can pose challenges, hampering the access to the trade data. WarenstromInfo (WI) was created as a software solution that allows easy trade data extraction and visualisation for application in different areas, such as outbreak investigations. WarenstromInfo (WI) is an application tool that automatically extracts, decodes and visually displays trade flow data from EUROSTAT "EU trade since 2002 by statistical procedure, by HS2-4-6 and CN8 (DS-059322)" (hereinafter referred to EUROSTAT) and the BACI databases, based on user input. WI was developed by using the open-source desktop software KNIME Analytics Platform. WI offers the flexibility to be executed either as a web service on a KNIME Web Server infrastructure or as a local resource. To integrate the BACI database into WI, the database is annually downloaded as csv files, rebuilt as a SQLite database and hosted locally into the KNIME Web Server Infrastructure. In order to optimise storage space on the KNIME server, this SQLite database specifically includes only agrifood data, reflecting the tool´s focus. However, if new objectives are established, this database can be expanded. Further, data of the SQLite database can be customised by executing the WI workflow locally, enabling the user to expand the database at any time. In contrast to BACI, trade data extraction from the EUROSTAT database is performed via the EUROSTAT’s API (Application Programming Interface) applying GET requests and XML data management. WI displays four User-friendly Interfaces (UIs) designed with interactive KNIME nodes that facilitate the input of variables. The extracted trade flow data are shown through interactive tables directly within the UIs. This feature enables users to easily explore the data in a structured and user-friendly manner. Additionally, WI incorporates the extracted trade flow data into maps. These maps provide a visual representation of the data, allowing users to gain insights and identify patterns and trends geographically. Both, the data table and the maps, can be downloaded as a single Excel file (containing multiple preformatted tables) and as png files, respectively.