Introduction
Data Management Module
The module is designed to enhance the organization and processing of data by integrating several key sub-modules. It consists of sub-modules designed to streamline data handling. The sub-modules include: Data Harvester, Data Curation and Data Sources
1. Data Harvester
This tool automates data collection from multiple sources, including legacy databases, API integrations, and local file management systems. It also provides a summary report of harvesting activities, featuring a collection viewer and details on harvesting pipelines.
1. Data Integration
Ag-Datahub seamlessly integrates data from multiple sources, including satellite imagery, IoT sensors, and agricultural research, providing users with a holistic view of the agricultural landscape.
1.1. Legacy databases
The platform features an intuitive dashboard that allows users to easily navigate through various data sets, visualize trends, and access actionable insights tailored to their needs.
Click The Add new button from connection manager page
- Register the harversting resources by creating sources connection details
- Save the connection details
- Once the connection is created, a pipeline will be created by selecting the created connected source and clicking the three dots (…) then click the Jobs sub menu under the dots.
Then click on Jobs menue to create a harvesting pipeline
Once navigating to the Jobs page, add new harvesting pipeline by clicking on Add new button.
Then select tables and columns to be harvested
Agricultural data will be treated in to six main categories
Natural Resource
Socio Economic
Agricultural Marketing
Livestock
Crop and
Cross-Sectional
And ofcourse, the data will be unclassified
After selecting the taxonomy of the data, click on Collection Relation to define relationship between collections.
