JesseMarkowitzandClaude Opus 5
fa3769d0fe
Research toward building a content pack from a story corpus, kept on its own branch and independent of the game. Records the selection experiments against blind labels, and settles selection as gate G2 followed by a human review: review.py writes REVIEW.md and a review.json form, apply_review.py checks the filled form and writes situations.json for the next stage. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01C6UDQ9o6L6Ey173U7XVou6
31 lines
1.8 KiB
Plaintext
31 lines
1.8 KiB
Plaintext
dev: 40 candidates, 5 labelled 2, rule must accept >= 3 of them
|
|
|
|
baseline accept all candidates accepted 40 P2 0.12 P1+ 0.62 R2 1.00
|
|
baseline B0: tightness filter accepted 17 P2 0.24 P1+ 0.76 R2 0.80
|
|
|
|
best single-signal rule per signal:
|
|
S1 >= 0.6153 accepted 9 P2 0.44 P1+ 0.89 R2 0.80
|
|
S2 >= 0.9083 accepted 20 P2 0.15 P1+ 0.60 R2 0.60
|
|
S3 >= 0.4580 accepted 31 P2 0.16 P1+ 0.68 R2 1.00
|
|
S4 >= 0.0295 accepted 14 P2 0.21 P1+ 0.64 R2 0.60
|
|
S5 >= 0.1733 accepted 10 P2 0.30 P1+ 0.60 R2 0.60
|
|
S6 <= 0.2137 accepted 33 P2 0.15 P1+ 0.70 R2 1.00
|
|
|
|
leaderboard (all eligible rules):
|
|
S1 >= 0.6119 AND S6 <= 0.1603 accepted 5 P2 0.60 P1+ 1.00 R2 0.60
|
|
S1 >= 0.6119 AND S6 <= 0.1742 accepted 5 P2 0.60 P1+ 1.00 R2 0.60
|
|
S1 >= 0.6153 AND S6 <= 0.1603 accepted 5 P2 0.60 P1+ 1.00 R2 0.60
|
|
S1 >= 0.6153 AND S6 <= 0.1742 accepted 5 P2 0.60 P1+ 1.00 R2 0.60
|
|
S1 >= 0.6153 AND S5 >= 0.1733 accepted 5 P2 0.60 P1+ 0.80 R2 0.60
|
|
S1 >= 0.6119 AND S6 <= 0.2137 accepted 7 P2 0.57 P1+ 1.00 R2 0.80
|
|
S1 >= 0.6119 AND S6 <= 0.3012 accepted 7 P2 0.57 P1+ 1.00 R2 0.80
|
|
S1 >= 0.6153 AND S6 <= 0.2137 accepted 7 P2 0.57 P1+ 1.00 R2 0.80
|
|
S1 >= 0.6153 AND S6 <= 0.3012 accepted 7 P2 0.57 P1+ 1.00 R2 0.80
|
|
S1 >= 0.6153 AND S5 >= 0.1278 accepted 7 P2 0.57 P1+ 0.86 R2 0.80
|
|
S1 >= 0.6153 AND S5 >= 0.1318 accepted 7 P2 0.57 P1+ 0.86 R2 0.80
|
|
S1 >= 0.6153 AND S5 >= 0.1356 accepted 7 P2 0.57 P1+ 0.86 R2 0.80
|
|
|
|
CHOSEN: S1 >= 0.6119 AND S6 <= 0.1603 -> rule-frozen.json
|
|
accepted on dev: D04(2), D09(1), D13(2), D16(2), D33(1)
|
|
exit 0
|