JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
62 lines
14 KiB
JSON
62 lines
14 KiB
JSON
[
|
|
{"chunk":271,"story":33,"summary":"Western visitors mope in hotel lobbies; one of them is swept from his companions by the rush hour and backs into a doorway.","predicament":"Someone from far away is separated from their companions and swamped by a crowd."},
|
|
{"chunk":272,"story":33,"summary":"Everything about him marks where he came from; he suddenly hauls a passing man out of the crowd and strikes him affectionately.","predicament":"Someone greets an old friend in the manner of home, which here looks like assault."},
|
|
{"chunk":273,"story":33,"summary":"The friend is now a polished city businessman; the visitor accuses him of becoming tame and orders whiskey against his cocktail.","predicament":"Someone finds an old friend remade by the place they settled in, and says so."},
|
|
{"chunk":274,"story":33,"summary":"At lunch the friend orders delicate dishes and defends the city as comfortable, saying he cannot make himself go back.","predicament":"Someone defends the soft life they chose to a person who knew them hard."},
|
|
{"chunk":275,"story":33,"summary":"The visitor denounces him as a renegade softened by small drinks; the friend half agrees and repeats that the city is comfortable.","predicament":"Someone is told they have been ruined by comfort and can only agree."},
|
|
{"chunk":276,"story":33,"summary":"At an elegant dinner the visitor keeps scorning each refinement while quietly watching the room and its diners.","predicament":"Someone mocking a way of life keeps looking at it more closely than they admit."},
|
|
{"chunk":277,"story":33,"summary":"He admires a woman across the room, muses about selling his ranch, orders two cocktails and says they are on him.","predicament":"Someone who came to scorn a place starts pricing what it would cost to stay."},
|
|
{"chunk":278,"story":34,"summary":"A speculator corners the flour market, adding two cents to every loaf, and retires with two million dollars.","predicament":"Someone grows rich by taking a little from everyone who cannot avoid buying."},
|
|
{"chunk":279,"story":34,"summary":"The speculator's easy-tempered son and his intense socialist friend meet again after college, when the son has inherited everything.","predicament":"Someone inherits a fortune and returns to the friend who despises how it was made."},
|
|
{"chunk":280,"story":34,"summary":"The heir says he wants to pay back the people overcharged for bread; his friend tells him it cannot be done.","predicament":"Someone wanting to undo an inherited wrong is told restitution is impossible."},
|
|
{"chunk":281,"story":34,"summary":"The heir presses for a way; his friend argues that each penny taken from the poor multiplied a thousandfold in harm.","predicament":"Someone offers money to repair harm and is told money cannot reach it."},
|
|
{"chunk":282,"story":34,"summary":"As an instance, a small baker was ruined by the price rise, went mad, burned a building and died in an asylum.","predicament":"One person's profit destroyed a small tradesman and everyone who depended on him."},
|
|
{"chunk":283,"story":34,"summary":"The last item of the instance is the baker's daughter sewing shirts for four dollars a week; she orders the heir out.","predicament":"Someone meets the person their family ruined and is refused even a hearing."},
|
|
{"chunk":284,"story":34,"summary":"Two months later the watchmaker meets her in furs, haggling over the price of bread: she has married the heir.","predicament":"Someone shut out by an injured person returns and marries them instead."},
|
|
{"chunk":285,"story":34,"summary":"A reporter says he could not make a funny column of a violinist's story, and hands the details to his writer friend.","predicament":"Someone cannot make the expected joke of a story and gives it to another."},
|
|
{"chunk":286,"story":34,"summary":"At a wedding twenty years ago the best man climbs the fire escape and begs the bride to run away with him.","predicament":"Someone who lost a rivalry makes a last desperate appeal on the day it is settled."},
|
|
{"chunk":287,"story":34,"summary":"She scorns him, and as he kisses her hand in farewell the bridegroom walks in on the two of them.","predicament":"Someone refuses an advance and is seen at the worst possible instant."},
|
|
{"chunk":288,"story":34,"summary":"The bridegroom throws her down and leaves forever; twenty years pass and she keeps the shop and loves him still.","predicament":"Someone is cast off over an innocent moment and waits decades without explanation."},
|
|
{"chunk":289,"story":34,"summary":"She refuses a suitor because she is still married, lets rooms, and a grey-haired violinist takes the front one.","predicament":"Someone refuses every new offer out of loyalty to a person long vanished."},
|
|
{"chunk":290,"story":34,"summary":"A second lodger with haunting eyes charms her, and she concludes he is her returned husband, but gives no sign.","predicament":"Someone believes a stranger is the person who left them, and waits to be told."},
|
|
{"chunk":291,"story":34,"summary":"The violinist declares his love and admits he knows neither his name nor anything before waking in a hospital.","predicament":"Someone offers marriage while admitting they do not know who they are."},
|
|
{"chunk":292,"story":34,"summary":"She tells him she is married; an hour later the other lodger begs her to forgive the wrong of twenty years.","predicament":"Someone bound by an old vow is asked by two people to choose between them."},
|
|
{"chunk":293,"story":34,"summary":"He confesses that he struck her husband down that night; she cries out, breaks away and runs upstairs toward the music.","predicament":"Someone learns their long loyalty was to the wrong person, and runs to the right one."},
|
|
{"chunk":294,"story":35,"summary":"An overworked lawyer parts from his wife in the usual way, recalling his doctor's warning that his brain may give way.","predicament":"Someone worn down by years of work ignores a warning that they will break."},
|
|
{"chunk":295,"story":35,"summary":"He wakes on a day coach with no memory of who he is, no papers, and three thousand dollars in his pocket.","predicament":"Someone comes to themselves among strangers with money and no idea who they are."},
|
|
{"chunk":296,"story":35,"summary":"Put on the spot by a friendly traveller, he invents a name and a trade on the strength of the man's own talk.","predicament":"Someone with no identity invents one from whatever is nearest to hand."},
|
|
{"chunk":297,"story":35,"summary":"The traveller presses his shelf-bottle reform, and hands him a newspaper item about a supposed case of lost memory.","predicament":"Someone hears their own condition dismissed as a fraud by a stranger."},
|
|
{"chunk":298,"story":35,"summary":"The item describes a prominent lawyer missing from home, who drew money from his bank and is feared broken by overwork.","predicament":"Someone reads a description of a missing person and defends them without recognising themselves."},
|
|
{"chunk":299,"story":35,"summary":"He registers under the invented name and feels a wild sense of freedom, as if just born into the world.","predicament":"Someone cut loose from every obligation finds the feeling exhilarating rather than frightening."},
|
|
{"chunk":300,"story":35,"summary":"Days of theatres, cabarets and crowds teach him that the city's freedom is held inside unwritten rules.","predicament":"Someone tasting complete liberty discovers it is bounded by rules nobody states."},
|
|
{"chunk":301,"story":35,"summary":"A man greets him by his real name; he denies it coldly, calls the man a confidence trickster and moves hotels.","predicament":"Someone recognised by a stranger denies their own name and moves on."},
|
|
{"chunk":302,"story":35,"summary":"A handsome woman stops him in a restaurant, sure of him after fifteen years, and he tells her he has forgotten everything.","predicament":"Someone is claimed by a person from a past they cannot remember."},
|
|
{"chunk":303,"story":35,"summary":"She asks whether he has ever dared look at white roses since that night, and tells him blissfully that he lies.","predicament":"Someone denying their past is told, happily, by another that the denial is false."},
|
|
{"chunk":304,"story":35,"summary":"He repeats the invented name until she goes; that night a quiet man leads him to his wife and his physician.","predicament":"Someone holding to an invention is brought face to face with the people they left."},
|
|
{"chunk":305,"story":35,"summary":"The wife throws herself on him and begs him to say her name; he unwinds her arms and the doctor leads her out.","predicament":"Someone refuses to acknowledge the person who has been searching for them."},
|
|
{"chunk":306,"story":35,"summary":"The doctor explains his name, his profession and his illness; he answers coolly and admires his wife's hair.","predicament":"Someone is told who they are and treats it as a conversation about a stranger."},
|
|
{"chunk":307,"story":35,"summary":"He engages the doctor in confidence, throws the white roses out of the window, and says the cure may happen now.","predicament":"Someone ends a holiday from themselves deliberately, having never lost anything at all."},
|
|
{"chunk":308,"story":36,"summary":"The narrator disputes the claim that only certain cities can hold a story, and arrives in a quiet southern capital.","predicament":"Someone insists that the dull place everyone dismisses can hold anything."},
|
|
{"chunk":309,"story":36,"summary":"He arrives in the drizzle, is driven to a renovated hotel by an ancient vehicle, and finds the service slow and courteous.","predicament":"Someone arrives somewhere expecting nothing and finds nothing to contradict them."},
|
|
{"chunk":310,"story":36,"summary":"A waiter tells him nothing happens after sundown; he walks the streets and finds quiet houses and little else.","predicament":"Someone looks for life in a strange town and is told there is none."},
|
|
{"chunk":311,"story":36,"summary":"In the lobby he meets a red, pulpy loafer with a blabbing lip whom he recognises at once as a type he detests.","predicament":"Someone instantly dislikes a stranger who is determined to be their friend."},
|
|
{"chunk":312,"story":36,"summary":"The loafer apologises for spitting near him, and within four minutes has made a friend of him and dragged him to the bar.","predicament":"Someone is annexed as a friend by a person they cannot easily shake off."},
|
|
{"chunk":313,"story":36,"summary":"The loafer boasts of ancestry and of his wife's income, shows a handful of silver, and the clerk offers to eject him.","predicament":"Someone lives on money that plainly is not theirs, and boasts about it."},
|
|
{"chunk":314,"story":36,"summary":"He declines to complain, asks what the town offers a stranger, and explains his errand to sign a local contributor.","predicament":"Someone tolerates a nuisance rather than take a hand in getting rid of them."},
|
|
{"chunk":315,"story":36,"summary":"Next morning he meets an ancient hack driver in a remarkable old military coat, patched with twine where its braid had been.","predicament":"Someone keeps the ruins of a fine thing repaired with whatever comes to hand."},
|
|
{"chunk":316,"story":36,"summary":"The coat keeps one yellow horn button and is tied shut with string; the carriage is as old as the coat.","predicament":"Someone's whole means of earning is held together by makeshift repairs."},
|
|
{"chunk":317,"story":36,"summary":"He names the address; the driver first bars his way with suspicion, then presses him eagerly into the carriage.","predicament":"Someone asking to visit a household is questioned closely by the person guarding it."},
|
|
{"chunk":318,"story":36,"summary":"At the house the driver demands two dollars instead of fifty cents, insisting not that it is right but that he needs it.","predicament":"Someone overcharges a stranger and admits it, saying only that they must have the money."},
|
|
{"chunk":319,"story":36,"summary":"He pays with a torn and patched dollar, and is received in a bare, decayed mansion by a frail, white-haired lady.","predicament":"Someone of old family receives a visitor with dignity in a house stripped of everything."},
|
|
{"chunk":320,"story":36,"summary":"Charmed by her talk and seeing her poverty, he cannot speak of rates, and sets the business for the next afternoon.","predicament":"Someone sent to strike a hard bargain finds they cannot raise the subject."},
|
|
{"chunk":321,"story":36,"summary":"She answers his platitude about dull towns by saying it is in the still places that things happen.","predicament":"Someone quietly contradicts a visitor's certainty that nothing happens where they live."},
|
|
{"chunk":322,"story":36,"summary":"She lists cruelties she has seen near and far, then answers a knock at the back and returns brighter, offering tea.","predicament":"Someone shows that the quiet place is as cruel as anywhere, then goes to answer a knock."},
|
|
{"chunk":323,"story":36,"summary":"She sends a small servant out with that same torn dollar; a man's voice and a scuffle follow, and the tea is withdrawn.","predicament":"Someone's small store of money is taken from them by force in the next room."},
|
|
{"chunk":324,"story":36,"summary":"The driver says she will not starve, that she has resources; the visitor wires his magazine a lie to raise her rate.","predicament":"Someone lies to their employer to get a poor person paid more than they asked."},
|
|
{"chunk":325,"story":36,"summary":"That evening the loafer slaps down the same torn and patched dollar at the bar, and the visitor recognises it.","predicament":"Someone sees the money they gave away turn up in the hands of a wastrel."},
|
|
{"chunk":326,"story":36,"summary":"She faints after signing the contract; the doctor calls it starvation, and names her as the loafer's wife.","predicament":"Someone is starving inside a marriage that everyone around them can see."},
|
|
{"chunk":327,"story":36,"summary":"The doctor says the husband takes even what her old servant gives her; the visitor advances her fifty dollars anyway.","predicament":"Someone gives money to a person they know will be robbed of it."},
|
|
{"chunk":328,"story":36,"summary":"The driver's last horn button is gone; two hours later the loafer is found dead in a street after a violent struggle.","predicament":"A person everyone despised is found dead, and nobody can find a good word."},
|
|
{"chunk":329,"story":36,"summary":"The dead hand drops a yellow horn button; the visitor pockets it and, leaving town, throws it into the river.","predicament":"Someone finds proof of who killed a hated man and quietly destroys it."}
|
|
]
|