Crowdee
Core Concepts

Pipeline Stages

How AI and crowd stages are sequenced within a verification run.

Every verification pipeline is composed of ordered stages. Each stage type has different characteristics, latency profiles, and output shapes. Understanding how stages work helps you interpret verdicts, estimate run duration, and choose the right pipeline tier for your use case.

Stage Types

TypeWho runs itLatencyRequires crowd workers
AILocal LLMSeconds to minutesNo
CrowdVetted human workersMinutes to hoursYes
ExpertSpecialist crowd workersMinutes to hoursYes
SynthesisLocal LLMSecondsNo

Stages execute sequentially. Each stage receives the file's enrichment metadata, any supplied verification context, and the results of all prior stages. This means later stages can build on earlier findings rather than analysing in isolation.

AI Stages

AI stages call a locally-hosted LLM with a context-aware prompt assembled from:

  • The file's enrichment metadata (EXIF, codec info, loudness levels, etc.)
  • Any verification context key-value pairs attached to the run
  • The verdicts and summaries from all prior stages

The LLM output is validated against a strict structured JSON schema before being accepted. If the output fails schema validation, the stage is retried automatically up to a configured limit. On persistent failure the run transitions to failed.

A successful AI stage writes the following to its stage record:

  • verdict — stage-level verdict (authentic, manipulated, synthetic, inconclusive, or unverified)
  • confidence — integer 0–100
  • summary — one or two sentence human-readable description of the finding
  • findings — optional array of structured observations with severity values (info, low, medium, high, critical)

Crowd Stages

Crowd stages distribute an analysis task to eligible vetted workers. The pipeline pauses at a crowd stage until the response threshold is met.

Key parameters for every crowd stage:

ParameterDescriptionTypical values
minResponsesMinimum worker responses required before the stage can complete2–5
consensusThresholdPercentage of responses that must agree on the same verdict60–100%
workerTagsRequired worker specialization tagsSee table below

When a pipeline reaches a crowd stage, the overall run status transitions from running to awaiting_crowd. The pipeline remains paused until both minResponses and consensusThreshold are satisfied, at which point it automatically resumes.

Crowd stage latency depends on worker availability at the time of the request. Tier 2 pipelines (which include one crowd stage) typically complete within the duration estimate shown in the pipeline catalog. Tier 3 pipelines (which include an expert stage) may take longer.

Worker Tags

Each crowd stage specifies the workerTags required to participate. Workers must hold at least one of the listed tags to be eligible for the task.

TagSpecialization
generalGeneral-purpose content review
image_forensicsImage manipulation and forensic analysis
video_forensicsVideo deepfake and temporal analysis
native_speakerLanguage-specific audio review
fact_checkerJournalistic fact-checking and source verification
identity_verificationBackground check and credential verification

Expert Stages

Expert stages are a specialized variant of crowd stages configured for high-stakes verification. They use stricter thresholds than standard crowd stages:

  • minResponses: 2 — exactly two expert workers must respond
  • consensusThreshold: 100% — both experts must agree; if they disagree the stage outcome is inconclusive

Expert stages appear in pipelines where errors carry significant consequences — for example, the Expert Review stage in verify-image-deep and the Expert Assessment stage in verify-identity-claim. Because the pool of qualified experts is smaller than the general crowd, expert stages may take longer than standard crowd stages.

Synthesis Stages

Synthesis stages are the final stage in every pipeline. They are run by the local LLM and have access to the complete record of all prior stages — every verdict, confidence score, summary, and findings array.

A synthesis stage produces:

  • The final pipeline verdict — the single authentic, manipulated, synthetic, inconclusive, or unverified value returned on the top-level run object
  • A confidence score — aggregated from all stage scores
  • A scorecard — a structured breakdown of confidence by analysis dimension (e.g. metadata_consistency, compression_artifacts)
  • A human-readable explanation — a prose summary suitable for display to end users or inclusion in audit reports

Run Status Lifecycle

A verification run moves through the following statuses from creation to completion.

pending — The run has been created and the job has been enqueued. No stages have started yet.

running — Stages are actively executing. AI stages complete within seconds to minutes. The run stays in this state for the duration of all AI-only stages.

awaiting_crowd — The pipeline has reached a crowd or expert stage and is waiting for the minimum number of worker responses. This status only appears in Tier 2 and Tier 3 pipelines.

completed — All stages have finished, the synthesis stage has produced a verdict, and the run record is fully populated. This is the terminal success state.

failed — A stage encountered an unrecoverable error (for example, the LLM returned invalid output after all retries, or a required context key was missing). The error field on the run describes the failure. This is the terminal failure state.

Poll the run endpoint to check the current status:

curl https://api.crowdee.ai/v2/projects/{projectId}/verification-runs/{runId} \
  -H "X-API-Key: crw_YOUR_API_KEY"

How is this guide?

© 2026 Crowdee GmbH. All rights reserved.

On this page