Welcome to the Ag Datahub - Ethiopia! This platform serves as a centralized data hub that empowers stakeholders in the agricultural sector by providing access to a wealth of data which can be utilized in facilitating data-driven decisions to enhance productivity and sustainability in the agricultural sector. This manual will guide you through the features and functionalities of the system.
Data Management Module
The module is designed to enhance the organization and processing of data by integrating several key sub-modules. It consists of sub-modules designed to streamline data handling. The sub-modules include: Data Harvester, Data Curation and Data Sources
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2F38c8ae55-28d7-4830-9b88-31f66f079535%2FScreenshot_2024-10-25_073730.png?table=block&id=12a81724-7fc6-80ca-9ea2-f3708589301f&cache=v2)
1. Data Harvester
This tool automates data collection from multiple sources, including legacy databases, API integrations, and local file management systems. It also provides a summary report of harvesting activities, featuring a collection viewer and details on harvesting pipelines.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2F7b25ac7e-e2f6-4224-a9e7-befcf187f3bd%2FScreenshot_2024-10-25_075248.png?table=block&id=12a81724-7fc6-8026-b013-e4e6e6747d45&cache=v2)
1. Data Integration
Ag-Datahub seamlessly integrates data from multiple sources, including satellite imagery, IoT sensors, and agricultural research, providing users with a holistic view of the agricultural landscape.
1.1. Legacy databases
The platform features an intuitive dashboard that allows users to easily navigate through various data sets, visualize trends, and access actionable insights tailored to their needs.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2F2c57c083-d2ba-4bf5-ab65-f9902b3069ef%2FScreenshot_2024-10-25_080314.png?table=block&id=12a81724-7fc6-80d9-ba38-c3139209ab49&cache=v2)
Click The Add new button from connection manager page
- Register the harvestin resources by creating sources connection details
- Save the connection details
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2Fe69b6364-82a8-4255-a5a8-171f61b268b6%2FScreenshot_2024-10-25_125107.png?table=block&id=12a81724-7fc6-8051-bc5f-d31eb589043e&cache=v2)
- Once the connection is created, a pipeline will be created by selecting the created connected source and clicking the three dots (…) then click the Jobs sub menu under the dots.
![List of connections](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2F82237c21-1ac6-4773-95da-65eb5bf7bfa4%2FScreenshot_2024-10-25_135356.png?table=block&id=12a81724-7fc6-8021-9bd0-d86f4b554d5e&cache=v2)
Then click on Jobs menu to create a harvesting pipeline
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2F02008449-65df-4a79-bd54-f2a4b2e35702%2FScreenshot_2024-10-25_135454.png?table=block&id=12a81724-7fc6-80cd-9fc3-ecde6d5e4bc5&cache=v2)
Once navigating to the Jobs page, add new harvesting pipeline by clicking on Add new button.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2F1ce01167-fee1-45e2-b18b-cbae3e4eb321%2FScreenshot_2024-10-25_140012.png?table=block&id=12a81724-7fc6-8092-bf45-ccb328911ed5&cache=v2)
Then select tables and columns to be harvested
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2Fc6fd0cf7-d0e5-44ee-8d34-8187eddad5e6%2FScreenshot_2024-10-25_144515.png?table=block&id=12a81724-7fc6-801b-98ae-cbec3ccf4bcd&cache=v2)
Agricultural data will be treated in to six main categories
Natural Resource
Socio Economic
Agricultural Marketing
Livestock
Crop and
Cross-Sectional
And ofcourse, the data will be unclassified
After selecting the taxonomy of the data, click on Collection Relation to define relationship between collections.
![notion image](https://www.notion.so/image/https%3A%2F%2Fprod-files-secure.s3.us-west-2.amazonaws.com%2F3be4ab45-ceed-4664-afe2-63bb4ee68ef7%2Fa4db987e-a42d-4286-b0aa-f6c90bfedce6%2FScreenshot_2024-10-25_142817.png?table=block&id=12a81724-7fc6-80d6-a112-e65c2e6795e9&cache=v2)