Data Import

This guide explains how to import data into the platform, including methods for importing from a local server and from cloud storage.

Importing Data from a Local Server

1. Install IO-Agent Software
   Install the IO-Agent software on your local server. This software manages local data, supports data preprocessing and quality checks, and generates standard file formats such as MCap for uploading to cloud storage.

2. Browse Raw Data Directory
   Use IO-Agent to browse the raw data directory on your local server.
   

3. Data Validation and Packaging
   Perform quality checks on the raw data and compress it into packages.
   

4. Monitor Packaging Task Progress
   Monitor the progress of data packaging tasks in real time.
   

Importing Data from Cloud Storage

The platform supports importing data from major public cloud providers as well as self-hosted private clouds.

1. Add Cloud Storage Access Configuration
   Configure cloud storage access permissions (only list permission is required, download permission is not needed, and read-only access is recommended).
   

2. Browse and Import Cloud Data
   Browse cloud data within the platform and select the data you want to import.