JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
32 lines
7.3 KiB
JSON
32 lines
7.3 KiB
JSON
[
|
|
{"chunk":145,"story":5,"summary":"A husband gives a fashionable talk arguing that faithfulness to oneself outranks marriage vows; his wife notes that he has recently begun preaching publicly what he used to keep private.","predicament":"Someone watches their partner suddenly start proclaiming in public views they once kept carefully private."},
|
|
{"chunk":146,"story":5,"summary":"The hosts are a couple who trade on an artistic reputation and recruit daring speakers to keep their gatherings fashionable.","predicament":"Someone keeps up a social position by borrowing other people's boldness."},
|
|
{"chunk":147,"story":5,"summary":"The wife, who once urged these views on him, now finds them vulgarised, and resents the hosts' young daughter hearing such talk.","predicament":"Someone who once pushed a daring idea is uneasy now it is being preached, and looks for someone to blame."},
|
|
{"chunk":148,"story":5,"summary":"The young woman asks the wife whether she believes it all; the wife blushes and says the girl doesn't understand.","predicament":"Someone is asked point-blank whether they still believe what they once championed, and cannot answer honestly."},
|
|
{"chunk":149,"story":5,"summary":"The wife sees her husband absorbed in the young woman; walking home, he says he spoke publicly to please her, and she asks him to stop.","predicament":"Someone asks their partner to stop something the partner says they began only to please them."},
|
|
{"chunk":150,"story":5,"summary":"He is solicitous, but that evening presses her to explain her objection, which she cannot.","predicament":"Someone is asked to justify a feeling they cannot put into words."},
|
|
{"chunk":151,"story":5,"summary":"Looking round their home, she feels suddenly estranged; he asks whether she no longer believes the ideas their marriage was founded on.","predicament":"Someone is challenged by their partner over whether they still hold to the terms of their bond."},
|
|
{"chunk":152,"story":5,"summary":"She insists she still believes, but says public talk suits only certain audiences; he reminds her they met in just such a set, and she names the young woman.","predicament":"Someone who has quietly changed their mind argues around it rather than admit it."},
|
|
{"chunk":153,"story":5,"summary":"He defends the young woman's independence of mind and admits she interests him.","predicament":"Someone hears their partner openly confess an interest in someone else."},
|
|
{"chunk":154,"story":5,"summary":"The wife's earlier divorce was accepted by everyone; her first husband was thought impossible, and remarrying a poorer man made her look disinterested.","predicament":"Someone who once left a partner was praised for it, and never had to count the cost."},
|
|
{"chunk":155,"story":5,"summary":"She recalls her first husband as a dull, self-absorbed man who shaped everything around his own needs.","predicament":"Someone looks back on a partner who stifled them, and half wonders whether they judged fairly."},
|
|
{"chunk":156,"story":5,"summary":"She remembers his mute bewilderment when she left, and her conviction that a marriage kept up out of duty is a crime.","predicament":"Someone who once escaped a stifling bond is haunted by the hurt they left behind."},
|
|
{"chunk":157,"story":5,"summary":"She met her second husband in the heat of her revolt; he shared her views, and they agreed either could leave when love ended.","predicament":"Someone enters a new commitment on the promise that either may walk away freely."},
|
|
{"chunk":158,"story":5,"summary":"Ten years of happiness have made her possessive; she now feels their compact could not apply to them, and takes a nerve tonic.","predicament":"Someone finds that the freedom they insisted on would destroy them if used against them."},
|
|
{"chunk":159,"story":5,"summary":"Her husband is unusually gentle, which frightens her; when he plans to continue the talks she reminds him she objected.","predicament":"Someone reads a partner's new kindness as a sign of bad news and presses for the truth."},
|
|
{"chunk":160,"story":5,"summary":"She says she hates hearing him say spouses may leave when tired; he reminds her that was her own reason for leaving her first husband.","predicament":"Someone who once used a principle for their own ends has it turned against them."},
|
|
{"chunk":161,"story":5,"summary":"He accuses her of dropping the doctrine once it had served her, then claims her promise to release him; she says she will not go back on it.","predicament":"Someone is held to a promise they made when they never thought it would be used against them."},
|
|
{"chunk":162,"story":5,"summary":"She guesses he means to marry the young woman, wishes him luck, and is left alone, feeling her home is no longer hers.","predicament":"Someone keeps their word with dignity and is left with nothing they thought was theirs."},
|
|
{"chunk":163,"story":5,"summary":"Hours pass in stupor; every familiar object in the house mocks her.","predicament":"Someone whose life has broken apart finds everything around them unchanged and unbearable."},
|
|
{"chunk":164,"story":5,"summary":"She considers fighting through the law or begging, but sees she is trapped by the code she herself made.","predicament":"Someone looks for a way to fight a loss and realises the rules trapping them are their own."},
|
|
{"chunk":165,"story":5,"summary":"She goes to warn the young woman, finds her out, and wanders the streets.","predicament":"Someone rushes to warn a rival and, finding them gone, is left with nowhere to go."},
|
|
{"chunk":166,"story":5,"summary":"Faint, she takes bitter tea in a shabby eating-house and feels her mind clear.","predicament":"Someone at the end of their strength stops in a strange place to steady themselves."},
|
|
{"chunk":167,"story":5,"summary":"She sees that warning the girl would have been humiliating, and walks the darkening streets not knowing what to do.","predicament":"Someone gives up a rash plan and is left with no idea what to do next."},
|
|
{"chunk":168,"story":5,"summary":"She finds herself outside her first husband's house, watches him go in, and on impulse rings the bell.","predicament":"Someone turns up, unannounced, at the door of a person they once wronged."},
|
|
{"chunk":169,"story":5,"summary":"She talks her way past the footman; her first husband, shocked, receives her to avoid a scene.","predicament":"Someone forces a meeting with a former partner who would rather not see them."},
|
|
{"chunk":170,"story":5,"summary":"In the unchanged room he coldly suggests she speak through lawyers; she says lawyers cannot help this time.","predicament":"Someone asks a former partner for a hearing and is told to go through proper channels."},
|
|
{"chunk":171,"story":5,"summary":"He braces as if for a request for money; she tells him her husband has left her because he tired of her.","predicament":"Someone confesses their humiliation to the very person who once suffered the same thing at their hands."},
|
|
{"chunk":172,"story":5,"summary":"He says she need not grant a divorce; she replies that he did not have to either, and asks whether he, too, never understood.","predicament":"Someone who once inflicted a hurt now feels it themselves, and needs the person they hurt to know it."},
|
|
{"chunk":173,"story":5,"summary":"He admits he never understood; she asks his forgiveness, shakes his hand, and leaves before he can stop her.","predicament":"Someone seeks forgiveness from a person they wronged, and leaves before anything more can be said."}
|
|
]
|