Crowdee
Core Concepts

Verdicts & Confidence Scores

Understanding the five verdict types, confidence scoring, and audit trails.

Every completed verification run produces a verdict — not just a probability score, but a structured, defensible finding that your team can act on and your auditors can inspect. Verdicts are accompanied by a confidence score, a stage-level audit trail, and an optional human-readable explanation.

Verdict Values

Crowdee uses five verdict values. Each has a precise meaning to avoid ambiguity in downstream workflows.

VerdictMeaningWhen used
authenticNo evidence of manipulation; all signals consistentAI and crowd stages agree the content appears genuine
manipulatedEvidence of tampering, deepfake, forgery, or fabricationOne or more stages detected significant anomalies
syntheticContent was generated or substantially rewritten by AIA synthetic-screening stage found strong AI-generation evidence (see Synthetic Data Detection)
inconclusiveMixed or insufficient signalsCrowd consensus not reached, or AI signals conflict across stages
unverifiedPipeline could not complete analysisMissing enrichment, unsupported format, or a stage failure

These values are mutually exclusive — a run produces exactly one verdict. The confidence score conveys how strongly the pipeline arrived at that verdict.

Confidence Score

The confidence score is an integer from 0 to 100. It is computed by aggregating the individual confidence percentages from AI stages and the consensus ratios from crowd stages. Higher scores mean the pipeline's stages were in stronger agreement.

A score of 87 on an authentic verdict means the pipeline arrived at that finding with strong, consistent evidence — it does not mean there is an 87% probability that the content is authentic. Treat the confidence score as a signal quality indicator, not a frequentist probability.

As a rough guide:

RangeInterpretation
90–100Very strong agreement across all stages
75–89Strong agreement; minor uncertainty in one or more stages
60–74Moderate agreement; consider a deeper pipeline or manual review
0–59Weak or conflicting signals; results should be treated with caution

Stage-Level Audit Trail

Every stage in a pipeline appends its own result to the run record. This gives you full visibility into how the final verdict was reached.

Each stage result includes:

FieldTypeDescription
slugstringIdentifier for the stage (e.g. exif-analysis)
typestringStage type: ai, crowd, or synthesis
verdictstringStage-level verdict
confidenceintegerStage-level confidence score (0–100)
summarystringHuman-readable description of what the stage found
findingsarrayOptional structured findings (see below)

When a stage produces findings, each finding has a severity field to indicate its importance:

SeverityMeaning
infoInformational observation; no impact on verdict
lowMinor anomaly noted; unlikely to indicate manipulation
mediumNoteworthy anomaly; warrants attention
highSignificant anomaly strongly associated with manipulation
criticalClear indicator of manipulation or forgery

The full stage log is available in the run response under the stages array.

Example Verdict Response

{
  "id": "run_01j9x...",
  "status": "completed",
  "verdict": "authentic",
  "confidence": 87,
  "pipeline_id": "verify-image-metadata",
  "stages": [
    {
      "slug": "exif-analysis",
      "type": "ai",
      "verdict": "authentic",
      "confidence": 91,
      "summary": "EXIF data consistent with claimed camera model"
    },
    {
      "slug": "format-analysis",
      "type": "ai",
      "verdict": "authentic",
      "confidence": 83,
      "summary": "No evidence of format-level manipulation"
    },
    {
      "slug": "verdict-synthesis",
      "type": "ai",
      "verdict": "authentic",
      "confidence": 87,
      "summary": "All signals consistent; no manipulation detected"
    }
  ]
}

Acting on Verdicts

Use the table below as a starting point for your downstream workflow logic.

VerdictRecommended action
authenticProceed with content; archive the run ID for your audit trail
manipulatedFlag or quarantine the content; escalate for editorial or legal review
syntheticLabel the content as AI-generated before publication, or reject it per your editorial policy
inconclusiveRequest manual review, or re-run using a deeper Tier 2 pipeline
unverifiedCheck the file's enrichmentStatus; retry enrichment if failed, or contact support

Do not automate consequential actions (publication, deletion, legal escalation) on inconclusive verdicts. Inconclusive means the evidence was insufficient to reach a finding — not that the content is safe. Always route inconclusive results to a human reviewer.

How is this guide?

© 2026 Crowdee GmbH. All rights reserved.

On this page