JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
32 lines
7.8 KiB
JSON
32 lines
7.8 KiB
JSON
[
|
|
{"chunk":29,"story":1,"summary":"A newly married man waits eagerly for his wife on their first evening in his own house.","predicament":"Someone starting a new life with a partner hopes the fresh start will be as happy as it feels."},
|
|
{"chunk":30,"story":1,"summary":"The honeymoon is cut short by the illness of the wife's daughter from her first marriage; the husband takes comfort in his wife's calm.","predicament":"Someone's new household is disrupted at once by a crisis inherited from their partner's past."},
|
|
{"chunk":31,"story":1,"summary":"The husband recalls the gossip about his wife's obscure origins and first divorce, which society chose to blame on the unknown first husband.","predicament":"Someone has married a person with a talked-about past and has chosen to believe the kindest version of it."},
|
|
{"chunk":32,"story":1,"summary":"The wife's second marriage bought her social standing, ended in a divorce that made her sympathetic, and friends doubted the wisdom of her third.","predicament":"Someone goes ahead with a choice that friends openly warn against, confident they know better."},
|
|
{"chunk":33,"story":1,"summary":"The wife arrives worried: her first husband's lawyer has written about his right to see the child.","predicament":"Someone's comfortable new start is interrupted by a claim from their partner's former spouse."},
|
|
{"chunk":34,"story":1,"summary":"The first husband has the legal right to visit his sick daughter in the new husband's house; the husband reluctantly agrees.","predicament":"Someone must let an unwelcome person into their home because that person has a right they cannot refuse."},
|
|
{"chunk":35,"story":1,"summary":"Fleeing the house on the visiting day, the husband is squeezed next to his wife's second ex-husband on a crowded train and must make small talk.","predicament":"Someone trying to avoid one awkward encounter is thrown into another with a rival they cannot snub."},
|
|
{"chunk":36,"story":1,"summary":"The ex-husband mentions business with the husband's ailing partner; the husband escapes the train and welcomes the extra work.","predicament":"Someone seeks refuge from a painful private situation in extra work."},
|
|
{"chunk":37,"story":1,"summary":"At lunch the husband sees the ex-husband savouring his coffee with brandy and envies his ease.","predicament":"Someone stewing over an awkward situation watches a rival who seems not to feel it at all."},
|
|
{"chunk":38,"story":1,"summary":"The husband comes home and finds his wife serene and happy, having apparently put the day's visitor out of mind.","predicament":"Someone troubled by a situation finds their partner untroubled and wonders what that means."},
|
|
{"chunk":39,"story":1,"summary":"His wife says she let the nurse receive the visitor, then absent-mindedly pours brandy into her husband's coffee as her ex-husband took it, and blushes.","predicament":"Someone catches an unintended glimpse of their partner's past habits and cannot un-see it."},
|
|
{"chunk":40,"story":1,"summary":"The husband's ill partner asks him to handle an important deal for his wife's ex-husband; for the firm's sake he agrees.","predicament":"Someone is asked by a superior to serve a person they would rather avoid, and cannot refuse without harming the firm."},
|
|
{"chunk":41,"story":1,"summary":"The ex-husband behaves well in the meeting and lets slip that he was once desperate for money; the husband is glad to seem the steadier man.","predicament":"Someone forced to do business with a rival tries to come out of it looking the more composed."},
|
|
{"chunk":42,"story":1,"summary":"Coming home unexpectedly, the husband finds his wife's first husband, a mild shabby man, waiting in his library.","predicament":"Someone comes face to face with a person they had imagined as a villain and finds them harmless."},
|
|
{"chunk":43,"story":1,"summary":"The husband is polite to the first husband, then retreats upset that this man has the run of his house.","predicament":"Someone must be civil to a person whose very presence in their home they resent."},
|
|
{"chunk":44,"story":1,"summary":"Seeing the first husband's cheap manners, the husband pictures his wife's humble former life and is disturbed by how completely she has left it behind.","predicament":"Someone glimpses their partner's hidden origins and begins to doubt who they really married."},
|
|
{"chunk":45,"story":1,"summary":"The husband suspects his wife misrepresented her first marriage; later the first husband asks to speak to him about the child's governess.","predicament":"Someone begins to suspect a partner of misleading them, just as the person misled about asks for their help."},
|
|
{"chunk":46,"story":1,"summary":"The first husband reveals he did see the wife on the first visit, exposing her lie, and says the governess is making the girl dishonest.","predicament":"Someone learns from an outsider that their partner lied to them, while being asked to intervene in a family matter."},
|
|
{"chunk":47,"story":1,"summary":"The first husband asserts his legal right to a voice in the girl's upbringing; the husband, learning of the man's sacrifices for his daughter, grows uneasy about his wife's account.","predicament":"Someone must pass on a claim from a person they have come to respect, against their own partner's wishes."},
|
|
{"chunk":48,"story":1,"summary":"The wife calls the first husband ungentlemanly and cries; the husband sees she knew his rights all along and expects to be pitied.","predicament":"Someone presses a partner to honour an obligation, and the partner responds with tears instead of answers."},
|
|
{"chunk":49,"story":1,"summary":"The first husband uses his rights modestly; meanwhile the husband must keep meeting the second ex-husband on business he cannot pass on.","predicament":"Someone must keep working closely with a person they would rather avoid, because their position demands it."},
|
|
{"chunk":50,"story":1,"summary":"The husband finds his wife chatting with her second ex-husband at a ball; she offers to do whatever he wishes about speaking to him.","predicament":"Someone finds their partner on friendly terms with a former lover and is offered whatever rule they want to set."},
|
|
{"chunk":51,"story":1,"summary":"Sickened by his wife's endless pliancy, the husband agrees she should be civil; society praises her for smoothing an awkward situation.","predicament":"Someone realises the partner they admired for ease simply gives way to everyone, and must decide whether to mind."},
|
|
{"chunk":52,"story":1,"summary":"The husband feels he owns only a share in his wife, with her former husbands as partners, and resents her tactful acquiescence.","predicament":"Someone feels they hold only part of a person whose loyalties are shared with others from their past."},
|
|
{"chunk":53,"story":1,"summary":"Habit dulls the husband's objections; he reckons that his predecessors trained his wife to make him comfortable.","predicament":"Someone trades their scruples for comfort, little by little, and learns to call it a bargain."},
|
|
{"chunk":54,"story":1,"summary":"The husband comes to accept the first husband's visits, and one evening offers him a cigar and a seat by the fire.","predicament":"Someone who once resented an intruder finds themselves at ease with him."},
|
|
{"chunk":55,"story":1,"summary":"The second ex-husband arrives unannounced on business while the first husband sits there; all three men stand awkwardly as tea is laid out.","predicament":"Someone is caught in a room with two people from their partner's past, and no one knows how to behave."},
|
|
{"chunk":56,"story":1,"summary":"The wife enters, greets both former husbands graciously, and the three men stand awkward before her.","predicament":"Someone must host, in one room, people whose claims on them conflict."},
|
|
{"chunk":57,"story":1,"summary":"The wife smooths the moment by pouring tea for all three men, and the husband takes his cup with a laugh.","predicament":"Someone in an absurd position chooses to laugh and go along rather than make a scene."}
|
|
]
|