Skip to main content

Create Annotation Task

A project manager creates annotation tasks from selected datasets and assigns annotators and auditors. For task field definitions, status transitions, and list operations, see Annotation Tasks; this page covers the creation and assignment procedure only.

Roles and Prerequisites​

Roles​

RoleCan createNotes
Project ManagerYesRequires the Manage Annotation Tasks module permission
AdministratorYesNot restricted by module permissions
AnnotatorNoManage Annotation Tasks is not granted by default
AuditorNoSame as above
CollectorNoSame as above

Prerequisites​

ItemRequirement
PermissionsManage Annotation Tasks
DatasetsAt least 1 dataset pending annotation
ProjectThe target project exists. If the project is public, the creator must be a member of the project or an administrator; otherwise the API returns 403
AnnotatorsAt least 1 assignable account
AuditorsCan be left empty. When empty, the task has no auditor and one must be added later in the task details
Task nameUnique across the platform. If the name already exists on creation, the API appends a sequence number automatically (for example, Task (2)) and does not return an error; when editing to an existing name, the API returns 400

Procedure​

Creation and Assignment​

There are two equivalent entry points for creation, and both use the same form:

Entry pointPathHow to open
Data page/datasetSelect datasets → Annotation in the bottom action bar
Annotation Tasks page/tasks/newAnnotation Tasks page → Create Annotation Task
  1. Select the datasets to annotate. When entering from the Data page, the selected checkboxes are the selected datasets; when entering from /tasks/new, select them on the left side of the form.
  2. Select the Create Task tab in the form.
  3. Enter a task name. When left empty, the system uses the current date as the task name.
  4. Select the project. A new project can be created within the form.
  5. Select annotators and auditors. Both fields support multiple selection.
  6. Make sure the number of selected datasets is not less than the number of selected annotators; otherwise submission is rejected.
  7. Select Create.

After creation, the task starts in Pending Start. If an administrator has configured a Feishu bot webhook in System Settings, a task notification is pushed on creation.

Annotator Split Rules​

On submission, the system splits the datasets by annotator and creates one task per annotator, named task name_annotator name; the same naming rule applies when a single annotator is selected.

RuleBehavior
DeduplicationDataset IDs are deduplicated first, then used for allocation
Even splitThe dataset count is divided by the annotator count, rounded down to give each annotator a base share
RemainderRemaining datasets are assigned in order to the earliest annotators, at most 1 each
Random orderWhen Distribute Data Randomly is selected, the dataset order is shuffled before allocation so that a single collection batch does not concentrate on one person
Auditor pairingAuditors are paired cyclically in annotator order. When a single auditor is selected, that auditor handles all tasks
Insufficient dataWhen the dataset count is less than the annotator count, submission is rejected with the message "Not enough data for all annotators. Reduce annotators or add data."

Appending Data to an Existing Task​

To add datasets to an existing task, use the Append task tab: select the target task, select the datasets to append, and confirm the submission. Appending does not create a task; it only expands the dataset scope of that task.

Other Form Entries​

TabPurpose
Create TaskCreate a new task and assign people
Append taskAdd datasets to an existing task
Quick AnnotationEnter the annotation interface directly without creating a task

Verification​

CheckExpected result
Task statusA new task is in Pending Start
Task nameThe form task name with a _annotator name suffix
Dataset ownershipAll selected datasets appear on the Annotation Data tab of the task details page
Data allocationThe sum of datasets across the annotators' tasks equals the number of selected datasets, with no duplicates
AuditorsMatches the form selection; when no auditor is selected, the task has no auditor

Error Handling​

SymptomCauseAction
Message "Please select the project for the task"No project selectedSelect a project; create one in the form if none is suitable
Message "Please select annotators and auditors"No annotator selected. Leaving auditors empty does not trigger this checkSelect at least 1 annotator
Message "Not enough data for all annotators"The dataset count is less than the annotator countReduce the annotator count or add datasets
API returns 403Creating a task in a public project while not a project memberHave a project member create it, or ask an administrator to add the account to the project
Message "No tasks created. Check data allocation."All split results are empty setsCheck whether the selected datasets are still valid, select again, and submit
Message "Task could not be appended"No target task was selected when appendingSelect a target task on the Append task tab
PagePurpose
Annotation TasksTask state machine, task details, batch actions
Data managementFilter and select datasets pending annotation
Annotator GuideThe annotator's execution procedure
Auditor GuideReview and rejection procedure
PermissionsRoles and module permissions