Repository navigation
feat(selection): add advance_on_view to LabelingSelection - #943
Conversation
⚠ Agent skill not updatedThis PR does not modify Before merging, pick one:
|
|
The only red check is |
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Co-Authored-By: deli@rapidata.ai <deli@rapidata.ai>
929fadd to
ccc033c
Compare
|
After the rebase onto |
|
@LinoGiger thanks for the approval! |
Why
A/B experiments measure accuracy by position (1st, 2nd, 3rd session per person). With Shuffled/Sequential, a task an annotator saw but skipped is served to them again, which skews that measurement. The backend now has
LabelingSelection.advanceOnView(rapidata-backend#5592, live in prod) to move the annotator past a task once it has been shown. This exposes it in the SDK asLabelingSelection(..., advance_on_view=True).Builds on the regenerated client from #941 (merged).
Flow
LabelingSelection.__init__advance_on_view: bool = False;ValueErrorwithRandomDecisions
Randomwithadvance_on_view=Trueraises at construction time, so callers get the error up front rather than as a backend 400 on job creation.Verified
New
tests/rapidata_client/selection/test_labeling_selection.py;pyright src/rapidata/rapidata_clientreports 0 errors.Agent skill unchanged:
src/rapidata/_skill/does not documentLabelingSelectionor retrieval modes.🔗 Session: node-04de9e35
🤖 Generated with Claude Code