JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
266 lines
11 KiB
JSON
266 lines
11 KiB
JSON
[
|
|
{
|
|
"chunk": 90,
|
|
"story": 12,
|
|
"summary": "A young woman about to sail receives the suitor who wronged her coldly, and produces a keepsake motto as evidence against him.",
|
|
"predicament": "Someone facing the person who wronged them keeps the proof of the promise that was broken."
|
|
},
|
|
{
|
|
"chunk": 91,
|
|
"story": 12,
|
|
"summary": "The suitor draws a second motto counselling forgiveness and pleads to be taken back, renouncing the woman who lured him away.",
|
|
"predicament": "Someone begs forgiveness for a betrayal, using whatever chance puts in their hand."
|
|
},
|
|
{
|
|
"chunk": 92,
|
|
"story": 12,
|
|
"summary": "A street seller rests his cart nightly under the window where a celebrated dancer sits while her maids dress her hair.",
|
|
"predicament": "A working person and an admired one share a place daily without either being anything to the other."
|
|
},
|
|
{
|
|
"chunk": 93,
|
|
"story": 12,
|
|
"summary": "The dancer asks the street seller whether she is beautiful; he refuses to flatter her and talks about the weather.",
|
|
"predicament": "Someone used to admiration meets a person who will not give it, and keeps asking."
|
|
},
|
|
{
|
|
"chunk": 94,
|
|
"story": 12,
|
|
"summary": "The street seller mocks the dancer's fishing for compliments, says his plain evening contents him, and goes in to read.",
|
|
"predicament": "Someone declines another's power over them and states plainly what they would rather have."
|
|
},
|
|
{
|
|
"chunk": 95,
|
|
"story": 12,
|
|
"summary": "Piqued, the dancer works daily on the seller until she makes him look into her eyes; next evening he comes dressed up.",
|
|
"predicament": "Someone pursues another only to prove that they can, and succeeds."
|
|
},
|
|
{
|
|
"chunk": 96,
|
|
"story": 12,
|
|
"summary": "Bored the moment he is won, the dancer laughs at the seller's offer of his savings until he leaves; then she screams.",
|
|
"predicament": "Someone wins another's devotion, finds it worthless, and is undone by news of their own."
|
|
},
|
|
{
|
|
"chunk": 97,
|
|
"story": 13,
|
|
"summary": "Nature moves in circles and the city in straight lines, and the city remakes whatever comes into it to its angles.",
|
|
"predicament": "A place remakes everyone who enters it into its own shape."
|
|
},
|
|
{
|
|
"chunk": 98,
|
|
"story": 13,
|
|
"summary": "Two mountain families kill each other over forty years until one man of each remains, and one of them disappears.",
|
|
"predicament": "An inherited quarrel consumes everyone until only its two last holders are left."
|
|
},
|
|
{
|
|
"chunk": 99,
|
|
"story": 13,
|
|
"summary": "The last survivor of one family learns his enemy lives in the city, packs a revolver and a knife, and follows him.",
|
|
"predicament": "Someone carries an old obligation of vengeance into a place where it has no standing."
|
|
},
|
|
{
|
|
"chunk": 100,
|
|
"story": 13,
|
|
"summary": "Hunting his enemy along the crowded avenues, the mountain man finds a world of straight lines and rushing strangers.",
|
|
"predicament": "Someone arrives to do what they came for and finds the place itself defeats them."
|
|
},
|
|
{
|
|
"chunk": 101,
|
|
"story": 13,
|
|
"summary": "Unseen by thousands of passing faces, the stranger fails even to open a door and is moved along by a policeman.",
|
|
"predicament": "Someone surrounded by people is more alone than they have ever been, and unwanted."
|
|
},
|
|
{
|
|
"chunk": 102,
|
|
"story": 13,
|
|
"summary": "Jostled and abused by traffic and passers-by, the stranger meets his hereditary enemy at last and shakes his hand gladly.",
|
|
"predicament": "Someone meets the enemy they came to destroy and finds them the only familiar face."
|
|
},
|
|
{
|
|
"chunk": 103,
|
|
"story": 14,
|
|
"summary": "A poet throws down a magazine and declares romance dead, cataloguing its contents to a cheerful clerk who disagrees by existing.",
|
|
"predicament": "Someone declares the thing they live for extinct, to a listener who does not care."
|
|
},
|
|
{
|
|
"chunk": 104,
|
|
"story": 14,
|
|
"summary": "A plain-dressed clerk sits at the poet's window above an old garden, where an old gentleman refuses to sell his house.",
|
|
"predicament": "Someone holds out against every offer to give up what they love."
|
|
},
|
|
{
|
|
"chunk": 105,
|
|
"story": 14,
|
|
"summary": "The clerk visits often as a useful foil, and the poet reads him his printed verses about four roses.",
|
|
"predicament": "Someone keeps a companion around chiefly to feel superior to them."
|
|
},
|
|
{
|
|
"chunk": 106,
|
|
"story": 14,
|
|
"summary": "The clerk cuts the reading short and leaves; next day the poet sees a beautiful young woman at the opposite window.",
|
|
"predicament": "Someone whose work goes unheard is consoled by a stranger glimpsed at a distance."
|
|
},
|
|
{
|
|
"chunk": 107,
|
|
"story": 14,
|
|
"summary": "Four roses appear in the young woman's window and the poet reads them as her answer to his published verses.",
|
|
"predicament": "Someone reads a message meant for another as a sign addressed to themselves."
|
|
},
|
|
{
|
|
"chunk": 108,
|
|
"story": 14,
|
|
"summary": "A flower book tells the poet a meeting is expected; the clerk arrives, checks his watch and hurries off to an appointment.",
|
|
"predicament": "Someone assembles proof of their good fortune while the truth walks in and out of the room."
|
|
},
|
|
{
|
|
"chunk": 109,
|
|
"story": 14,
|
|
"summary": "The clerk explains that the roses are his fiancee's signal of the hour, and that the flowerpot means half-past.",
|
|
"predicament": "Someone's private sign is explained away by the ordinary arrangement of two other people."
|
|
},
|
|
{
|
|
"chunk": 110,
|
|
"story": 15,
|
|
"summary": "Officials proclaim that during the heat the people may sleep in the parks, and whole neighbourhoods move out into one.",
|
|
"predicament": "An order given for people's good turns them out of their homes."
|
|
},
|
|
{
|
|
"chunk": 111,
|
|
"story": 15,
|
|
"summary": "Tenants pack bedding and household goods, protesting to the janitor, while an officer orders everyone out to the park.",
|
|
"predicament": "Someone is told by an official to leave a comfortable home and has no appeal."
|
|
},
|
|
{
|
|
"chunk": 112,
|
|
"story": 15,
|
|
"summary": "The narrator praises the mixed and companionable life of the tenement on hot nights, then describes being herded into the dark park.",
|
|
"predicament": "Someone is rescued from a life they were content with, by people who never asked."
|
|
},
|
|
{
|
|
"chunk": 113,
|
|
"story": 15,
|
|
"summary": "The officer threatens imprisonment for refusal, and the tenants pass the night in the dark judging strangers by feel.",
|
|
"predicament": "People forced together in the dark can tell friend from stranger only by touch."
|
|
},
|
|
{
|
|
"chunk": 114,
|
|
"story": 15,
|
|
"summary": "Two tenants complain that the rent runs on while they lie in the grass, and joke that this is the city's charity.",
|
|
"predicament": "Someone pays for a home they are not allowed to sleep in."
|
|
},
|
|
{
|
|
"chunk": 115,
|
|
"story": 15,
|
|
"summary": "In the dark the social distinctions of the building collapse into a heap, and by morning five engagements have been announced.",
|
|
"predicament": "Forced together, people who despised each other by daylight find they can pair off."
|
|
},
|
|
{
|
|
"chunk": 116,
|
|
"story": 15,
|
|
"summary": "A well-dressed man stops his car to ask why the people lie in the grass, and takes the answer down in a book.",
|
|
"predicament": "Someone comfortable asks why others are suffering, and promises to see to it."
|
|
},
|
|
{
|
|
"chunk": 117,
|
|
"story": 16,
|
|
"summary": "A big idle striker wakes restless and unaccountably disturbed, knocks his brothers aside, and cannot say what ails him.",
|
|
"predicament": "Someone is unsettled by a feeling they cannot name and will not admit."
|
|
},
|
|
{
|
|
"chunk": 118,
|
|
"story": 16,
|
|
"summary": "His mother says the season is in his bones; he denies every sign of spring and goes to his usual idle corner.",
|
|
"predicament": "Someone denies a change that everyone around them can feel."
|
|
},
|
|
{
|
|
"chunk": 119,
|
|
"story": 16,
|
|
"summary": "He looks for signs of the season, orders a drink and leaves it untasted, and snaps at the bartender who mocks him.",
|
|
"predicament": "Someone's usual pleasures stop satisfying them, and they take it out on bystanders."
|
|
},
|
|
{
|
|
"chunk": 120,
|
|
"story": 16,
|
|
"summary": "A friendly barber insists the season is coming; the restless man denies it, then fights a standing enemy in the street.",
|
|
"predicament": "Someone denies what is happening to them and picks a fight instead."
|
|
},
|
|
{
|
|
"chunk": 121,
|
|
"story": 16,
|
|
"summary": "He hunts a sentimental song under a pretext, then knocks at the young woman's door and asks her opinion of the weather.",
|
|
"predicament": "Someone approaches the person they want with a pretext instead of a reason."
|
|
},
|
|
{
|
|
"chunk": 122,
|
|
"story": 16,
|
|
"summary": "He names the feeling as her, says he starts work Monday, and she accepts; snow falls and he calls it springtime anyway.",
|
|
"predicament": "Someone finally names what they want, and the weather no longer decides anything."
|
|
},
|
|
{
|
|
"chunk": 123,
|
|
"story": 17,
|
|
"summary": "A southern saying summons an imaginary old man who kills fools, invoked in every household with a smile or a tear.",
|
|
"predicament": "People invoke an imagined punisher for the foolishness they see in each other."
|
|
},
|
|
{
|
|
"chunk": 124,
|
|
"story": 17,
|
|
"summary": "A writer explains how an illustrator wrecks a story with details he never wrote, and how far an artist stands from an author.",
|
|
"predicament": "Someone's work is handed to another who remakes it wrongly and publicly."
|
|
},
|
|
{
|
|
"chunk": 125,
|
|
"story": 17,
|
|
"summary": "The writer befriends a cheerfully melancholy artist who is engaged to a factory worker earning eight dollars a week.",
|
|
"predicament": "Someone loves a person far below their family's expectations, and does not hide it."
|
|
},
|
|
{
|
|
"chunk": 126,
|
|
"story": 17,
|
|
"summary": "The artist's rich father objects to the match, so the artist gives up the inheritance and lives on credit and sausages.",
|
|
"predicament": "Someone gives up a fortune rather than give up the person they intend to marry."
|
|
},
|
|
{
|
|
"chunk": 127,
|
|
"story": 17,
|
|
"summary": "The young woman proves natural and unpretending at a cheap cafe, and the writer still tells the artist he is a fool.",
|
|
"predicament": "Someone judges another's choice foolish even after meeting what they chose."
|
|
},
|
|
{
|
|
"chunk": 128,
|
|
"story": 17,
|
|
"summary": "The artist plans to marry within the week on the price of one picture, while the writer drinks and repeats his verdict.",
|
|
"predicament": "Someone commits to a plan they cannot afford, and is told so by a friend."
|
|
},
|
|
{
|
|
"chunk": 129,
|
|
"story": 17,
|
|
"summary": "A grey old man appears and orders the artist to give up the young woman and come home; the artist seems not to hear.",
|
|
"predicament": "Someone is given a last ultimatum by an authority whose threat no longer reaches them."
|
|
},
|
|
{
|
|
"chunk": 130,
|
|
"story": 17,
|
|
"summary": "The artist insists nobody spoke to him; the writer, believing he alone can see the visitor, follows the old man out.",
|
|
"predicament": "Someone believes they alone can see a danger and rushes to avert it."
|
|
},
|
|
{
|
|
"chunk": 131,
|
|
"story": 17,
|
|
"summary": "The writer accuses the old man of destroying youth and talent for old standards, and calls the artist the wisest man he knows.",
|
|
"predicament": "Someone confronts the old power that punishes the young for choosing differently."
|
|
},
|
|
{
|
|
"chunk": 132,
|
|
"story": 17,
|
|
"summary": "The old man asks about the young woman, hears her defended, and asks to have the artist brought out to him.",
|
|
"predicament": "Someone asks about the person they objected to, and begins to reconsider."
|
|
},
|
|
{
|
|
"chunk": 133,
|
|
"story": 17,
|
|
"summary": "The old man gives in and asks the artist to bring her home; he is the father, unspoken to for a year.",
|
|
"predicament": "An estranged parent yields, and the quarrel that cost a fortune ends with a handshake."
|
|
}
|
|
] |