3 roles across the pipeline

Roles in the
annotation workforce

The pipeline runs on three roles. Surgical annotators label the video, QA reviewers hold consistency, and clinical SMEs set the ground truth. Annotators are selected for core skills like visual precision and consistency, then trained on the domain through the SOP, the visual atlas, and a certification exam. Clinical judgment stays with the SMEs.

Surgical Annotator

AnnotationFull-timeRemote
Apply Now

Label surgical video: instruments, anatomy, and phases, following the annotation SOP. We select for core annotation skills and train the domain knowledge. Training and certification are built into the role.

What You'll Do

  • -Label instrument and anatomy regions on surgical frames
  • -Segment procedures into phases using the SOP definitions
  • -Correct AI pre-labels and flag ambiguous frames for review
  • -Hold output to the golden-set standard

What We're Looking For

  • -Careful attention to visual detail and boundary precision
  • -Consistency and the discipline to follow a written rulebook
  • -Domain knowledge is taught through the SOP and visual atlas
  • -Must pass the certification exam before joining production

QA Reviewer

QualityFull-timeRemote
Apply Now

Review annotated batches for accuracy and consistency against the SOP and the golden set. Hold the quality line before work reaches clinical review.

What You'll Do

  • -Review annotator output for label accuracy and boundary quality
  • -Check inter-annotator agreement and resolve disagreements
  • -Return batches with specific, SOP-referenced feedback
  • -Track per-annotator quality trends over time

What We're Looking For

  • -Prior annotation experience or a passed annotator certification
  • -Strong eye for boundary precision and label consistency
  • -Able to give clear, rule-based feedback
  • -Comfortable with agreement metrics such as IoU and kappa

Clinical SME

ClinicalPart-timeRemote
Apply Now

Adjudicate escalated edge cases and validate the golden set. Clinical judgment sets the ground truth the rest of the pipeline is measured against.

What You'll Do

  • -Adjudicate anatomy and phase disagreements escalated by QA
  • -Validate and sign off on golden-set frames
  • -Clarify the SOP where the clinical picture is ambiguous
  • -Spot-check production batches for clinical correctness

What We're Looking For

  • -Clinical background in surgery or a related specialty
  • -Familiarity with the target procedures, such as laparoscopic cholecystectomy
  • -Able to translate clinical judgment into written annotation rules
  • -Consulting or part-time engagement

How the program runs

✓A small clinical-SME core defines the standard; a trained annotator workforce does the volume
✓SOP-driven: every label follows a written rule, applied consistently across annotators
✓Certified against an SME-validated golden set before any production work
✓Inter-annotator agreement tracked continuously (IoU, kappa)
✓Multi-specialty: the same pipeline extends to new procedures
✓Audit trail on every annotation and review decision