Skip to main content

Data Import

This guide explains how to import data into the platform, including methods for importing from a local server and from cloud storage.

Importing Data from a Local Server

  1. Install IO-Agent Software
    Install the IO-Agent software on your local server. This software manages local data, supports data preprocessing and quality checks, and generates standard file formats such as MCap for uploading to cloud storage.

  2. Browse Raw Data Directory
    Use IO-Agent to browse the raw data directory on your local server.

  3. Data Validation and Packaging
    Perform quality checks on the raw data and compress it into packages.

  4. Monitor Packaging Task Progress
    Monitor the progress of data packaging tasks in real time.

Importing Data from Cloud Storage

The platform supports importing data from major public cloud providers as well as self-hosted private clouds.

  1. Add Cloud Storage Access Configuration
    Configure cloud storage access permissions (only list permission is required, download permission is not needed, and read-only access is recommended).

  2. Browse and Import Cloud Data
    Browse cloud data within the platform and select the data you want to import.