JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
50 lines
11 KiB
JSON
50 lines
11 KiB
JSON
[
|
|
{"chunk":330,"story":37,"summary":"From a rooftop the people below look like insects, and the watcher's mind expands to the immensity of the universe.","predicament":"Someone high above others finds it easy to think them insignificant."},
|
|
{"chunk":331,"story":37,"summary":"A candy-store clerk earning six dollars a week is courted by the man who keeps the smallest store in the city.","predicament":"Someone with nothing is courted by another with almost as little."},
|
|
{"chunk":332,"story":37,"summary":"She teases him daily about the size of his store, and lives herself in a room barely wider than her arms.","predicament":"Someone mocks another's smallness while living no larger themselves."},
|
|
{"chunk":333,"story":37,"summary":"A second suitor arrives at her boarding house, stuffed with facts and figures which he uses to dominate any table.","predicament":"Someone courts another by displaying knowledge instead of affection."},
|
|
{"chunk":334,"story":37,"summary":"The pair stop at the little store for chewing gum before going up to see the view, and she teases him again.","predicament":"Someone is shown their rival in front of them, and makes a joke of it."},
|
|
{"chunk":335,"story":37,"summary":"On the roof the philosopher calls the people below crawling insects; she says they are folks and asks to go down.","predicament":"Someone is shown a grand view and finds the people in it more real than the view."},
|
|
{"chunk":336,"story":37,"summary":"He presses on about the smallness of human affairs and the distance of the stars; she says she is afraid up here.","predicament":"Someone tries to impress another by making everything they care about seem small."},
|
|
{"chunk":337,"story":37,"summary":"A meteor blazes over the roof; she screams, demands to be taken down, and vanishes outside the door below.","predicament":"Someone's display of grandeur frightens off the person it was meant to win."},
|
|
{"chunk":338,"story":38,"summary":"A street runs north through grandeur and antique shops into a mediaeval gloom before diving into a tunnel.","predicament":"A place holds the leavings of grander lives and is passed through by everyone."},
|
|
{"chunk":339,"story":38,"summary":"A restaurant keeper of half-noble descent works by day and walks the city by night in search of mysteries.","predicament":"Someone of small means gives themselves the role of a great benefactor."},
|
|
{"chunk":340,"story":38,"summary":"He carries cards good for meals at his own place, and finds a melancholy young man flinging silver into the street.","predicament":"Someone whose only wealth is what they can give away goes looking for someone to help."},
|
|
{"chunk":341,"story":38,"summary":"He takes the young man's arm and leads him to a park bench to learn what drives him to such waste.","predicament":"Someone sees another destroying what they have and stops them to ask why."},
|
|
{"chunk":342,"story":38,"summary":"He explains that he studies people and seeks to relieve distress in city streets, and invites the young man's confidence.","predicament":"Someone offers help in grand terms to a stranger who has not asked for it."},
|
|
{"chunk":343,"story":38,"summary":"The young man works in a harness shop; the owner's daughter will go to whichever man answers his riddle first.","predicament":"Someone's chance at marriage is made to depend on a foolish test set by another."},
|
|
{"chunk":344,"story":38,"summary":"The riddle is what kind of hen lays the longest, and the young man asks the would-be benefactor to answer it.","predicament":"Someone's whole future turns on a trivial question they cannot answer."},
|
|
{"chunk":345,"story":38,"summary":"The benefactor cannot solve it and, humiliated, presses one of his meal cards on the young man as they part.","predicament":"Someone who promised to help anyone finds they cannot, and gives what they have."},
|
|
{"chunk":346,"story":38,"summary":"Next morning the rival fails; reading the card in his pocket, the young man answers a dead one and wins the party.","predicament":"Someone's answer comes by accident from the help that seemed to be worthless."},
|
|
{"chunk":347,"story":39,"summary":"A rich child of five loses the cheap rag-doll she loves, and the whole household cannot find it.","predicament":"Someone grieves for a worthless thing that all their family's money cannot replace."},
|
|
{"chunk":348,"story":39,"summary":"Expensive toys and doctors fail to console her; parents and servants are helpless as the season comes on.","predicament":"Someone's money buys every substitute and none of them is the thing wanted."},
|
|
{"chunk":349,"story":39,"summary":"The terrier had buried the doll in a corner of the lawn; meanwhile a decently drunk tramp walks the neighbouring street.","predicament":"The thing everyone is hunting lies in plain reach of a passing stranger."},
|
|
{"chunk":350,"story":39,"summary":"The tramp digs out the doll, takes it into a saloon and earns drinks by addressing it as his lady friend.","predicament":"Someone with nothing finds a prop that earns them attention and drink."},
|
|
{"chunk":351,"story":39,"summary":"Three local toughs read of a hundred-dollar reward for the doll, and one offers the tramp fifty cents for it.","predicament":"Someone holding something valuable is offered a pittance by people who know its worth."},
|
|
{"chunk":352,"story":39,"summary":"The tramp laughs and refuses, saying money cannot buy her; he is drunk on his first success as a performer.","predicament":"Someone refuses a good price because what they hold has given them something better."},
|
|
{"chunk":353,"story":39,"summary":"The toughs show him the advertisement; he agrees to claim the reward, and they follow him armed to the gate.","predicament":"Someone is helped toward a prize by people who mean to take it from them."},
|
|
{"chunk":354,"story":39,"summary":"He rings, the doll is restored, and the child screams hatred at the ragged man who brought her treasure back.","predicament":"Someone's one good act is received with disgust by the person it was for."},
|
|
{"chunk":355,"story":39,"summary":"A secretary counts him a hundred dollars and has him shown out, while the three wait beyond the gate.","predicament":"Someone receives what they came for and is walked toward the people waiting to take it."},
|
|
{"chunk":356,"story":39,"summary":"At the door the holly and the harp music stir old memories, and he insists on paying his compliments to the lady.","predicament":"Someone far fallen is reminded of the manners of the life they came from."},
|
|
{"chunk":357,"story":39,"summary":"The lady receives him, wine is brought, and he begins the old family salutation before his memory fails.","predicament":"Someone tries to perform a courtesy from a past they can no longer fully recall."},
|
|
{"chunk":358,"story":39,"summary":"As he is shown out she orders the motor car brought round to take him wherever he wishes to go.","predicament":"Someone is saved from waiting danger by a kindness that was never meant as rescue."},
|
|
{"chunk":359,"story":40,"summary":"The city swarms with rich men in search of people to relieve, and the poor hide from their attentions.","predicament":"People with more than they need hunt for someone to receive their generosity."},
|
|
{"chunk":360,"story":40,"summary":"A retired magnate declares that squaring one old ten thousand dollars would do the trick; he rose from a breaker boy.","predicament":"Someone rich decides one specific old debt is what stands between them and peace."},
|
|
{"chunk":361,"story":40,"summary":"Rich beyond counting, he builds a palace and begins to worry about his soul's salvation.","predicament":"Someone with more money than they can use starts worrying about how they got it."},
|
|
{"chunk":362,"story":40,"summary":"His million to a charity is misreported and his laboratory gift is built as a lavatory, and he is given a degree.","predicament":"Someone's large gifts go astray and bring them no credit at all."},
|
|
{"chunk":363,"story":40,"summary":"Overhearing professors mock him, he wearies of giving on a large scale and decides to see gratitude himself.","predicament":"Someone giving generously overhears what the receivers really think of them."},
|
|
{"chunk":364,"story":40,"summary":"A district boss corners him and says the poor there belong to him, and warns him to keep to his own part of town.","predicament":"Someone offering charity is told the people they meant to help are already spoken for."},
|
|
{"chunk":365,"story":40,"summary":"He doubles his donations, buys a young woman a stage part, and still finds no relief; his sister and daughter keep his house.","predicament":"Someone tries every way of giving money away and none of it eases them."},
|
|
{"chunk":366,"story":40,"summary":"The daughter, plain, loud and healthy, looks out of a window and gives her heart to the grocer's young man.","predicament":"Someone with every advantage falls for a person who has not noticed them."},
|
|
{"chunk":367,"story":40,"summary":"She watches the confident young driver three days running and then consults the housemaid who is her friend.","predicament":"Someone plans an approach to a person they have only watched from a window."},
|
|
{"chunk":368,"story":40,"summary":"She borrows a cap and apron, passes as a maid, and he stops for her whistling and gives his name.","predicament":"Someone conceals their wealth to be liked for something other than money."},
|
|
{"chunk":369,"story":40,"summary":"They whistle duets and he talks of sixteen dollars a week and flats, while she never counts on her father's money.","predicament":"Two people plan a life on wages one of them could cover in an afternoon."},
|
|
{"chunk":370,"story":40,"summary":"Raised to eighteen a week, he tells her to untie the apron strings, and they count up what she can do.","predicament":"Two people persuade themselves that a small wage is enough to marry on."},
|
|
{"chunk":371,"story":40,"summary":"The old debt was a hillside bought for a trifle from a miner and sold a month later for ten thousand.","predicament":"Someone's fortune began with a bargain that ruined the person who sold it."},
|
|
{"chunk":372,"story":40,"summary":"Detectives trace the heir to the grocer's man; the magnate pays him the ten thousand as another man's agent.","predicament":"Someone makes restitution while hiding that they were the one who took it."},
|
|
{"chunk":373,"story":40,"summary":"Invited to call and meet the daughter, the young man says he is engaged to a parlour maid and must deliver his goods.","predicament":"Someone refuses an opening into a higher life because they are already promised."},
|
|
{"chunk":374,"story":40,"summary":"She confesses she is the heiress; he says her father will refuse, and she says she will marry him tonight.","predicament":"Someone confesses the fortune they hid, and proposes to act before it can matter."},
|
|
{"chunk":375,"story":40,"summary":"The father's car runs the cab down; two years later he refuses every charity and cuts salaries to save money.","predicament":"Someone who gave money away freely stops the moment they have an heir."},
|
|
{"chunk":376,"story":40,"summary":"He shows the mark his grandson's new tooth made, and raises the price of vinegar three cents instead of two.","predicament":"Someone's new devotion to one person makes them harder on everyone else."}
|
|
]
|