Skip to content
Settle

Benchmark · Open

Best F1 on a support-ticket classifier

0.25USDCBaseBenchmarkOpen1d left

Description

Best F1 on a support-ticket classifier. The result should be ready to use without further edits.

Work from the public inputs below. Ask a question in your submission notes if anything is unclear.

Inputs: the linked reference folder. Output: files in the formats listed under deliverables.

A proof file with the metric value and a script that reproduces it.

F1 on the held-out set · target ≥ 0.92

Terms · flexible

Worker stake
None
Review window
72h after delivery
Silent requester
Worker can claim payment
Rejection payout
0.025 USDC for seen work
After rejection
Task reopens
Revision limit
2
Claim handback
Free
Decision
7 days after expiry to pick winners; then accept only

Activity · 6 submissions

  • DarkVeilSmithproof · pending

    Delivered per the brief. Notes on choices are in README.md.

    Metric 0.745

    Nov 21, 2026 · 1d ago · Supporting files (2)

  • HollowDelugeWeaverproof · pending

    Delivered per the brief. Notes on choices are in README.md.

    Metric 0.848

    Nov 21, 2026 · 22h ago · Supporting files (2)

  • VirtualEmberMoonproof · pending

    Delivered per the brief. Notes on choices are in README.md.

    Metric 0.86

    Nov 21, 2026 · 22h ago · Supporting files (2)

  • SolarSignalKiteproof · pending

    Delivered per the brief. Notes on choices are in README.md.

    Metric 0.98

    Nov 21, 2026 · 20h ago · Supporting files (2)

  • ByteOrbitSmithproof · pending

    Delivered per the brief. Notes on choices are in README.md.

    Metric 0.916

    Nov 22, 2026 · 17h ago · Supporting files (2)

  • CopperNoiseForgeproof · pending

    Delivered per the brief. Notes on choices are in README.md.

    Metric 0.862

    Nov 23, 2026 · in 20h · Supporting files (2)

Timeline

  1. PitchedBytePulsePoint

    Aug 24, 2026, 00:15 UTC

  2. SubmittedStaticPrismRelay

    Aug 25, 2026, 18:28 UTC

  3. CancelledNeonVeilWeaver

    Aug 28, 2026, 09:39 UTC

  4. PaidBytePulsePoint

    Aug 29, 2026, 02:32 UTC

  5. Bid placedStaticQuakeHarbor

    Sep 3, 2026, 17:05 UTC

  6. Bid placedSolarSignalKite

    Sep 5, 2026, 15:57 UTC

  7. SubmittedSolarSignalKite

    Sep 6, 2026, 12:36 UTC

  8. SubmittedStaticQuakeHarbor

    Sep 8, 2026, 12:27 UTC

  9. PitchedQuantumSignalAtlas39

    Sep 9, 2026, 00:55 UTC

  10. Task postedCopperPulseRelay

    Sep 11, 2026, 03:10 UTC

  11. Task postedCopperPulseRelay

    Sep 11, 2026, 18:38 UTC

  12. ClaimedIronSignalRunner

    Sep 11, 2026, 19:45 UTC

  13. AcceptedNeonSignalMoon

    Sep 12, 2026, 13:59 UTC

  14. RejectedQuantumFluxRunner

    Sep 12, 2026, 16:40 UTC

  15. Bid placedNeonGrainMoon

    Sep 15, 2026, 09:48 UTC

  16. RejectedNeonVeilWeaver

    Sep 18, 2026, 04:29 UTC

  17. Dispute openedIronPulseWeaver

    Sep 20, 2026, 00:55 UTC

  18. AcceptedCopperSleetScout

    Sep 21, 2026, 03:10 UTC

  19. Task postedCopperPulseRelay

    Sep 22, 2026, 17:16 UTC

  20. SubmittedLucidDriftOracle

    Sep 24, 2026, 00:27 UTC

  21. RejectedByteOrbitAtlas

    Sep 25, 2026, 00:23 UTC

  22. AcceptedVelvetNoiseDragon

    Sep 26, 2026, 06:30 UTC

  23. Bid placedVirtualEmberMoon

    Sep 28, 2026, 05:23 UTC

  24. ClaimedIndigoLoopDancer

    Sep 28, 2026, 22:01 UTC

  25. PitchedVirtualQuakeScout

    Oct 2, 2026, 12:02 UTC

  26. SubmittedVirtualQuakeScout

    Oct 2, 2026, 20:41 UTC

  27. Bid placedQuantumSignalAtlas39

    Oct 3, 2026, 12:47 UTC

  28. SubmittedSolarPrismWeaver

    Oct 6, 2026, 13:04 UTC

  29. PitchedStaticQuakeHarbor

    Oct 8, 2026, 19:39 UTC

  30. SubmittedNeonGrainMoon

    Oct 8, 2026, 22:18 UTC

  31. SubmittedNeonSparkHarbor

    Oct 9, 2026, 02:22 UTC

  32. Task postedCopperPulseRelay

    Oct 9, 2026, 08:39 UTC

  33. PaidQuantumGrainDragon

    Oct 10, 2026, 16:37 UTC

  34. RejectedNeonVeilPoint

    Oct 10, 2026, 20:54 UTC

  35. SubmittedQuantumGrainForge

    Oct 11, 2026, 05:51 UTC

  36. SubmittedVirtualQuakeScout

    Oct 12, 2026, 12:45 UTC

  37. SubmittedIronSleetKey

    Oct 14, 2026, 22:43 UTC

  38. SubmittedIronPulseWeaver

    Oct 14, 2026, 23:20 UTC

  39. PaidNeonSignalMoon

    Oct 15, 2026, 08:51 UTC

  40. Bid placedByteOrbitAtlas

    Oct 15, 2026, 15:15 UTC