JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
35 lines
8.2 KiB
JSON
35 lines
8.2 KiB
JSON
[
|
|
{"chunk":88,"story":3,"summary":"A servant weakened by illness and nearly out of money is offered a place by a kindly former acquaintance.","predicament":"Someone down on their luck and unable to find work is offered a way back by a well-wisher."},
|
|
{"chunk":89,"story":3,"summary":"The patron warns that the house is gloomy, the mistress an invalid who lost her children, and the last maid is dead; the servant accepts.","predicament":"Someone who badly needs a place takes one they have been frankly warned will be hard."},
|
|
{"chunk":90,"story":3,"summary":"Told to keep out of the master's way, the servant travels to a large dark country house and is received by the cook.","predicament":"Someone arrives at a new post with an unexplained warning about the person in charge."},
|
|
{"chunk":91,"story":3,"summary":"On her way to her room she sees a pale woman in the passage; the housemaid scolds about a room across the hall that must stay locked.","predicament":"Someone new to a household notices something odd that the others refuse to discuss."},
|
|
{"chunk":92,"story":3,"summary":"The other servants praise the mistress; the maid meets her and is instantly devoted.","predicament":"Someone meets a new employer and feels an immediate loyalty they did not expect."},
|
|
{"chunk":93,"story":3,"summary":"The mistress never uses the bell to her maid's room, always sending the housemaid instead.","predicament":"Someone new notices an unexplained habit in how they are treated and cannot ask why."},
|
|
{"chunk":94,"story":3,"summary":"No one admits to seeing the pale woman; the cook grows confused when asked where the last maid slept.","predicament":"Someone asks innocent questions and finds the people around them evasive."},
|
|
{"chunk":95,"story":3,"summary":"The cook begs her not to use the locked room, the dead maid's, and refuses to describe her; the master's arrival puts the household on edge.","predicament":"Someone senses a household secret, and everyone they ask shuts the conversation down."},
|
|
{"chunk":96,"story":3,"summary":"The master, a coarse, leering man, looks the maid over and dismisses her; the mistress goes cold in his presence and brightens when he leaves.","predicament":"Someone in service must work around a master everyone fears and the mistress shrinks from."},
|
|
{"chunk":97,"story":3,"summary":"A gentle neighbour who shares the mistress's love of books is her only company in winter, and the servants all like him.","predicament":"Someone lonely in an unhappy marriage finds comfort in one kind friend."},
|
|
{"chunk":98,"story":3,"summary":"The master comes and goes, drinks heavily and grumbles; the servants hint the match was unhappy from the start.","predicament":"Someone watches their employer endure a spouse's coarseness and can say nothing."},
|
|
{"chunk":99,"story":3,"summary":"The maid's duties are light and the mistress kind, but she feels a weight whenever she re-enters the house.","predicament":"Someone in a comfortable position cannot shake a sense of dread they cannot explain."},
|
|
{"chunk":100,"story":3,"summary":"Shut in by rain, the maid grows nervous about the locked room; on a trip to town she meets an old colleague who reacts to her employer's name.","predicament":"Someone uneasy in their post learns that others have heard things about it."},
|
|
{"chunk":101,"story":3,"summary":"The colleague says four maids have left in six months; back at the house the master has arrived and the cook is relieved she returned.","predicament":"Someone hears their predecessors all quit, and finds the staff relieved they did not."},
|
|
{"chunk":102,"story":3,"summary":"The cook begs her to be good to the mistress; the maid overhears the master jealously accusing his wife over the neighbour.","predicament":"Someone overhears a jealous quarrel between their employers and must pretend not to have."},
|
|
{"chunk":103,"story":3,"summary":"Uneasy after a tense dinner, the maid is woken at night by her bell ringing for the first time.","predicament":"Someone is called in the night by a summons that should not have come."},
|
|
{"chunk":104,"story":3,"summary":"She hears the locked room open and steps hurry ahead of her; at her mistress's door the master answers, asking how many of them there are.","predicament":"Someone answering a call at night must walk where something frightening has just gone, and is met by a hostile master."},
|
|
{"chunk":105,"story":3,"summary":"The mistress, weak, calls the maid by the dead maid's name; next morning she sends her secretly to fetch medicine and carry a note to the neighbour.","predicament":"Someone is sent on a discreet errand that seems meant to be hidden from the head of the house."},
|
|
{"chunk":106,"story":3,"summary":"Fearing the mistress means to poison herself, the maid rushes to the chemist and learns the medicine is harmless.","predicament":"Someone fears their employer means to harm themselves, and checks quietly without betraying them."},
|
|
{"chunk":107,"story":3,"summary":"Wondering whether the note was the secret errand, the maid delivers it; the master confronts her and she lies to protect her mistress.","predicament":"Someone is questioned by a suspicious superior and must decide whether to lie to protect another."},
|
|
{"chunk":108,"story":3,"summary":"Afraid to stay yet unwilling to abandon her mistress, the maid finds a photograph of the dead maid and recognises the pale woman.","predicament":"Someone who wants to flee a frightening post stays out of loyalty, and then finds proof their fear was real."},
|
|
{"chunk":109,"story":3,"summary":"The cook deflects when shown the photograph; the master stays on, taunting his wife about the neighbour's absence.","predicament":"Someone who brings evidence to a colleague is brushed off, while the tension in the household grows."},
|
|
{"chunk":110,"story":3,"summary":"The neighbour calls and all seem friendly, but the maid lies awake each night, dreading the silence of the locked room, and cannot bring herself to leave.","predicament":"Someone lives in constant dread at their post yet cannot make themselves give notice."},
|
|
{"chunk":111,"story":3,"summary":"The mistress grows weaker and more dependent on the maid; with the master away the servants joke about him.","predicament":"Someone becomes the only support of a failing employer and feels bound to stay."},
|
|
{"chunk":112,"story":3,"summary":"On a cheerful afternoon, for once at ease, the maid looks up and sees the dead maid standing in her doorway.","predicament":"Someone who has just let their guard down is confronted with the thing they feared."},
|
|
{"chunk":113,"story":3,"summary":"The apparition looks at her pleadingly and leads her out of the house into the snow.","predicament":"Someone is silently begged for help by a figure who cannot say what it needs."},
|
|
{"chunk":114,"story":3,"summary":"The figure, leaving no footprints, leads her to the neighbour's gate and waits for her to act.","predicament":"Someone is led to a place where they must act, without knowing what they are meant to do."},
|
|
{"chunk":115,"story":3,"summary":"The neighbour comes out cheerfully; the figure vanishes, and the maid faints, unable to guess the warning.","predicament":"Someone given a warning they cannot interpret is left alone with a secret they cannot name."},
|
|
{"chunk":116,"story":3,"summary":"She makes an excuse to the neighbour, returns home, is sent to bed, and at night hears a door open below.","predicament":"Someone covering for what they saw goes to bed uneasy, sure something is about to happen."},
|
|
{"chunk":117,"story":3,"summary":"Her bell rings; she sees the apparition at the stairhead and hears a key in the front door; the mistress, still dressed, denies ringing and sends her away.","predicament":"Someone who comes to help is sent away by the person they came for, who is plainly hiding something."},
|
|
{"chunk":118,"story":3,"summary":"The maid warns that the master has returned; the mistress collapses, and the master pushes past, heading for the dressing room to meet a friend.","predicament":"Someone must try to stop a furious spouse bursting in on what he believes is a betrayal."},
|
|
{"chunk":119,"story":3,"summary":"The apparition appears in the doorway; the master recoils; the mistress dies. At the funeral the master glares at the pale neighbour, then leaves.","predicament":"Someone who tried to shield their employer's secret sees the confrontation end in death all the same."}
|
|
]
|