JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
74 lines
4.0 KiB
JSON
74 lines
4.0 KiB
JSON
[
|
|
{
|
|
"chunk": 55,
|
|
"story": 4,
|
|
"summary": "A farmer's wife, her husband, and her retired-policeman uncle discuss a stolen brooch; the uncle has been hiding under their bed hoping to catch the thief, and the wife casts suspicion on a neighbour while accusing her husband of not caring.",
|
|
"predicament": "A woman who has lost something valuable suspects the people around her, and resents her spouse for not caring as much."
|
|
},
|
|
{
|
|
"chunk": 56,
|
|
"story": 4,
|
|
"summary": "The uncle declares everyone guilty until proven innocent; the wife recounts missing the brooch, accusing and sacking her servant, who cried on her box.",
|
|
"predicament": "Someone who has lost something accuses the most defenceless person nearby, and punishes her before any proof."
|
|
},
|
|
{
|
|
"chunk": 57,
|
|
"story": 4,
|
|
"summary": "The servant's box held nothing; the husband defends her and is snapped at, while the uncle, pencil and notebook out, pursues the investigation with great ceremony.",
|
|
"predicament": "A man who thinks a household fuss is foolish keeps defending the accused and is scolded for taking her side."
|
|
},
|
|
{
|
|
"chunk": 58,
|
|
"story": 4,
|
|
"summary": "The husband eats a lozenge from the evidence box and cannot stop laughing; the uncle establishes that no one could have entered the bedroom unheard.",
|
|
"predicament": "A man who finds a family inquiry ridiculous cannot keep a straight face in front of its self-important leader."
|
|
},
|
|
{
|
|
"chunk": 59,
|
|
"story": 4,
|
|
"summary": "Suspicion turns to a widow who visited that morning; the uncle finds muddy footprints on the stairs, which are in fact the husband's, and he stays guiltily quiet.",
|
|
"predicament": "A man who sees an innocent neighbour blamed for evidence he himself left must decide whether to own up."
|
|
},
|
|
{
|
|
"chunk": 60,
|
|
"story": 4,
|
|
"summary": "The husband slyly deflects the footprint evidence, then exchanges silent signals with his wife until the uncle demands to know what is funny.",
|
|
"predicament": "A man who knows more than he says can barely hide his amusement from the self-important person running the inquiry."
|
|
},
|
|
{
|
|
"chunk": 61,
|
|
"story": 4,
|
|
"summary": "The husband reveals he thinks the widow is after the uncle, not the brooch; the uncle is outraged, then proposes inviting her to tea to trap her into confessing.",
|
|
"predicament": "A self-important man, teased that a neighbour fancies him, resolves to prove his point by trapping her."
|
|
},
|
|
{
|
|
"chunk": 62,
|
|
"story": 4,
|
|
"summary": "The husband refuses to have a guest trapped in his house; the uncle secretly tells his niece he will search the widow's cottage without leave.",
|
|
"predicament": "A man refuses to let his home be used to entrap a friend, so the schemer plans to go behind his back."
|
|
},
|
|
{
|
|
"chunk": 63,
|
|
"story": 4,
|
|
"summary": "The husband, who resents the uncle living with them for his wife's hopes of an inheritance, plans to let the widow catch the uncle searching her house, and shadows him.",
|
|
"predicament": "A man stuck with an unwelcome relative in his home sees a chance to have him disgraced and driven off."
|
|
},
|
|
{
|
|
"chunk": 64,
|
|
"story": 4,
|
|
"summary": "The husband brings the widow home early; the uncle, trapped inside, hides in the larder, and the husband settles in for beer and begins praising him.",
|
|
"predicament": "A man who has trapped his rival in an embarrassing hiding place decides to make the most of it."
|
|
},
|
|
{
|
|
"chunk": 65,
|
|
"story": 4,
|
|
"summary": "Within the uncle's hearing, the husband tells the widow the uncle is shy and devoted to her, and has been asking whether she likes jewellery.",
|
|
"predicament": "A trapped man must listen in silence while someone tells a neighbour a story about him that he cannot deny."
|
|
},
|
|
{
|
|
"chunk": 66,
|
|
"story": 4,
|
|
"summary": "Asked for bread and cheese, the widow opens the larder, the uncle bursts out, and her friend takes his hiding there as a bashful suitor's courtship.",
|
|
"predicament": "A man caught somewhere he should not be is handed an embarrassing explanation, and has no better one to offer."
|
|
}
|
|
] |