3 roles across the pipeline

Roles in the
annotation workforce

The pipeline runs on three roles. Surgical annotators label the video, QA reviewers hold consistency, and clinical SMEs set the ground truth. Annotators need no medical background: the SOP, the visual atlas, and the certification exam do the training.

Surgical Annotator

AnnotationFull-timeRemote
Apply Now

Label surgical video: instruments, anatomy, and phases, following the annotation SOP. No medical background required. Training and certification are built into the role.

What You'll Do

  • -Label instrument and anatomy regions on surgical frames
  • -Segment procedures into phases using the SOP definitions
  • -Correct AI pre-labels and flag ambiguous frames for review
  • -Hold output to the golden-set standard

What We're Looking For

  • -Careful attention to visual detail
  • -No clinical background needed: the SOP and visual atlas teach the vocabulary
  • -Comfortable in a browser-based annotation tool
  • -Must pass the certification exam before joining production

QA Reviewer

QualityFull-timeRemote
Apply Now

Review annotated batches for accuracy and consistency against the SOP and the golden set. Hold the quality line before work reaches clinical review.

What You'll Do

  • -Review annotator output for label accuracy and boundary quality
  • -Check inter-annotator agreement and resolve disagreements
  • -Return batches with specific, SOP-referenced feedback
  • -Track per-annotator quality trends over time

What We're Looking For

  • -Prior annotation experience or a passed annotator certification
  • -Strong eye for boundary precision and label consistency
  • -Able to give clear, rule-based feedback
  • -Comfortable with agreement metrics such as IoU and kappa

Clinical SME

ClinicalPart-timeRemote
Apply Now

Adjudicate escalated edge cases and validate the golden set. Clinical judgment sets the ground truth the rest of the pipeline is measured against.

What You'll Do

  • -Adjudicate anatomy and phase disagreements escalated by QA
  • -Validate and sign off on golden-set frames
  • -Clarify the SOP where the clinical picture is ambiguous
  • -Spot-check production batches for clinical correctness

What We're Looking For

  • -Clinical background in surgery or a related specialty
  • -Familiarity with the target procedures, such as laparoscopic cholecystectomy
  • -Able to translate clinical judgment into written annotation rules
  • -Consulting or part-time engagement

How the program runs

✓SOP-driven: every label follows a written rule, so quality does not depend on scarce experts
✓Certified against an SME-validated golden set before any production work
✓Inter-annotator agreement tracked continuously (IoU, kappa)
✓Multi-specialty: the same pipeline extends to new procedures
✓Remote-first: capacity scales by adding certified annotators
✓Audit trail on every annotation and review decision