JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
86 lines
4.2 KiB
JSON
86 lines
4.2 KiB
JSON
[
|
|
{
|
|
"chunk": 80,
|
|
"story": 6,
|
|
"summary": "A ragged stranger swaggers into the best inn in a small town, bullies the waiter who tries to turn him out, and demands to see the landlord.",
|
|
"predicament": "A penniless newcomer forces his way into a place he does not belong, counting on a secret to back him."
|
|
},
|
|
{
|
|
"chunk": 81,
|
|
"story": 6,
|
|
"summary": "The stranger greets the landlord by another name, a wanted pirate's, and demands clothes, lodging and money in return for silence.",
|
|
"predicament": "A man who has built a respectable new life is found by an old associate who threatens to expose his past."
|
|
},
|
|
{
|
|
"chunk": 82,
|
|
"story": 6,
|
|
"summary": "The landlord gives him money; the blackmailer draws a pistol, declares he will take half of everything from now on, and settles in.",
|
|
"predicament": "A man pays off a blackmailer and learns the price will be half of everything, for good."
|
|
},
|
|
{
|
|
"chunk": 83,
|
|
"story": 6,
|
|
"summary": "The landlord says he has lived honestly for fifteen years and warns the man not to wake the devil in him; the blackmailer meets the landlord's stepdaughter and says he will stay.",
|
|
"predicament": "A reformed man warns a blackmailer not to push him too far, while the blackmailer sets his sights on the man's family."
|
|
},
|
|
{
|
|
"chunk": 84,
|
|
"story": 6,
|
|
"summary": "The blackmailer orders the best supper and room, and sleeps with his door barricaded and a pistol under his pillow.",
|
|
"predicament": "A man who has seized power over another knows the danger he is in, and guards himself even as he gloats."
|
|
},
|
|
{
|
|
"chunk": 85,
|
|
"story": 6,
|
|
"summary": "He pushes in at the family breakfast table, eyes the stepdaughter, hints at the landlord's past before her, and goes out to buy new clothes.",
|
|
"predicament": "A household must make polite space for someone who holds them hostage."
|
|
},
|
|
{
|
|
"chunk": 86,
|
|
"story": 6,
|
|
"summary": "Within a month the blackmailer runs the inn; the landlord, failing in health, backs him in sacking a loyal old servant, and his daughter demands to know who is master.",
|
|
"predicament": "Someone watches a person she trusts give way at every turn to an intruder, and demands that he stand up for himself."
|
|
},
|
|
{
|
|
"chunk": 87,
|
|
"story": 6,
|
|
"summary": "The landlord sides with the blackmailer, who threatens to ruin the girl and have the landlord hanged; the landlord pleads for peace.",
|
|
"predicament": "A man who is being blackmailed hears his tormentor threaten someone he loves, and must choose between swallowing it and hitting back."
|
|
},
|
|
{
|
|
"chunk": 88,
|
|
"story": 6,
|
|
"summary": "The inn decays under the blackmailer's rule; the landlord collapses with a fit, which upsets the blackmailer's plans.",
|
|
"predicament": "A blackmailer's hold depends on his victim's life, and that victim suddenly collapses."
|
|
},
|
|
{
|
|
"chunk": 89,
|
|
"story": 6,
|
|
"summary": "The landlord lies dying, anxious to please the blackmailer, while his daughter nurses him; the blackmailer resolves to get the hidden money before he dies.",
|
|
"predicament": "A blackmailer whose victim is dying must grab what he can before his hold disappears."
|
|
},
|
|
{
|
|
"chunk": 90,
|
|
"story": 6,
|
|
"summary": "The blackmailer threatens to inform; the dying man begs for time and promises to reveal his money that night if his daughter gets a share.",
|
|
"predicament": "A dying man pressed by his tormentor bargains for time and for provision for someone he loves."
|
|
},
|
|
{
|
|
"chunk": 91,
|
|
"story": 6,
|
|
"summary": "At night the blackmailer drugs the nurse and demands the money; the landlord extracts his promise about the daughter.",
|
|
"predicament": "A man who thinks his helpless victim is at his mercy leans in close to hear the secret."
|
|
},
|
|
{
|
|
"chunk": 92,
|
|
"story": 6,
|
|
"summary": "The 'dying' landlord seizes and strangles him, revealing he has been shamming weakness and planning to blame the killing on the blackmailer's own followers.",
|
|
"predicament": "A man who pretended to be helpless strikes at the tormentor who threatened his family."
|
|
},
|
|
{
|
|
"chunk": 93,
|
|
"story": 6,
|
|
"summary": "He stages the scene as a robbery and returns to bed as the drugged nurse unwittingly provides his alibi.",
|
|
"predicament": "A man who has done a desperate thing arranges things so that suspicion falls elsewhere."
|
|
}
|
|
] |