ARDN data transformations, aggregations, and translations are made possible by annotation files that allow datasets of very different formats, vocabularies, units, and physical locations to be interpreted in an automated way. ARDN tools allow data providers to create these annotations. Additional tools allow end-users to translate any ARDN dataset into useful formats for modeling and data analytics.
The ARDN data interoperability system is comprised of four interacting workflows as shown in the diagram below. In these workflows, tools (orange boxes) are used to create annotation files and AgMIP format files (blue parallelograms) from the original dataset.
The ARDN Data Provider Tools include VMapper, which allows a user to interactively annotate their dataset with ICASA terminology. The product of VMapper is a Sidecar File 2 (SC2). Currently data in Excel and csv formats are supported by VMapper, with a json parser in production.
For more detail, see Workflow for Data Providers.
Links to additional resources for ARDN data providers:
ARDN Data End-User Tools are a suite of translators which convert data from AgMIP ACEB format to various model-specific formats. Most of these translators were originally developed by the AgMIP Data Interoperability Team and are maintained by the model developer teams for each model. The following models maintain AgMIP translators:
All of these model-specific translators have been wrapped into a desktop user interface, QuadUI, developed by AgMIP, which can be downloaded here.
A browser-based version of QuadUI has been developed as part of the ARDN project. The “Data Factory” can be accessed here: data.agmip.org/ardn/tools/data_factory.
For more detail, see Data End User Workflow.
The Data Tranlsation API performs all translation functions, including conversion of a dataset to AgMIP ACEB format, translation from ACEB format to end-user formats, and extraction of a subset of data to be included in Sidecar File 3 (SC3).
ARDN Search and Discovery Tools are used to generate a linkage of dataset terms to ontology terms (Sidecar File 1 or SC1). SC1 provides a means for semantically aware web searches to identify datasets using specific terminology. SC3 provides the data portal (e.g., Ag Data Commons or GARDIAN) to execute advanced searches on ARDN datasets without accessing and translating the data in the archived format and location.