JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
46 lines
10 KiB
JSON
46 lines
10 KiB
JSON
[
|
|
{"chunk":773,"story":89,"summary":"A police captain dismissed in a reform scandal has fallen to begging, and befriends another man as low as himself.","predicament":"Someone thrown out of a powerful post has sunk to the bottom with nothing left."},
|
|
{"chunk":774,"story":89,"summary":"His companion was thrown out of a rich uncle's house; the two sit on a park bench, one cursing, one silent.","predicament":"Two people fallen from very different heights share the same bench and the same hunger."},
|
|
{"chunk":775,"story":89,"summary":"Starving after a failed attempt at a free lunch, the former captain goes off to try one more scheme for food.","predicament":"Someone desperate for food goes out to try one last plan."},
|
|
{"chunk":776,"story":89,"summary":"Left alone, the young man goes to the police to ask whether there is a reward for his friend; the sergeant throws him out.","predicament":"Someone starving tries to sell out the friend who shares their bench."},
|
|
{"chunk":777,"story":89,"summary":"The captain returns splattered, having proposed to a fruit seller for her business; he would do anything, he says, except betray a friend.","predicament":"Someone willing to stoop to anything draws the line at betraying a friend."},
|
|
{"chunk":778,"story":89,"summary":"A political agent offers the captain five hundred dollars to testify against his old superior; he refuses and drives the man off.","predicament":"Someone starving refuses a fortune for betraying a person who was once their friend."},
|
|
{"chunk":779,"story":89,"summary":"The young man calls him a fool; then an agent tells the young man his uncle will restore him if he marries an heiress.","predicament":"Someone is offered their old life back on condition of a marriage they do not want."},
|
|
{"chunk":780,"story":89,"summary":"The young man refuses the heiress and her fortune, and the two join the midnight bread line together.","predicament":"Someone who would sell a friend refuses to sell themselves, and stays poor."},
|
|
{"chunk":781,"story":90,"summary":"The city swelters through a summer so hot that everyone talks of heat, baths and cool diets.","predicament":"People stuck in a hot city pretend they prefer it to the places they cannot afford."},
|
|
{"chunk":782,"story":90,"summary":"A harassed man insists loudly that the city is the finest summer resort, and refuses a friend's invitation to go fishing.","predicament":"Someone loudly praises the place they are stuck in to hide that they cannot leave."},
|
|
{"chunk":783,"story":90,"summary":"Alone at his desk he wonders about his friend's trout, and drifts into memory of a mountain summer long ago.","predicament":"Someone who denies wanting a thing can think of nothing else when alone."},
|
|
{"chunk":784,"story":90,"summary":"At a mountain hotel, two young men, one rich and one not, compete for the same beautiful young woman.","predicament":"Someone with little money competes against a rich rival for the same person."},
|
|
{"chunk":785,"story":90,"summary":"At a mock tournament she climbs a rock; he races his rich rival up the face and reaches her first to crown her.","predicament":"Someone outpaces a richer rival by effort and nerve for the person they love."},
|
|
{"chunk":786,"story":90,"summary":"His clerk wakes him at his desk; he insists again that the city beats the country, and turns to the letters.","predicament":"Someone wakes from a memory of what they gave up and repeats the story they tell."},
|
|
{"chunk":787,"story":90,"summary":"A letter from his wife reveals he stays in the hot city working so she and the sick children can stay in the mountains.","predicament":"Someone pretends to prefer hardship so the people they love will accept their sacrifice."},
|
|
{"chunk":788,"story":91,"summary":"Two young women share a cheap studio in an artists' quarter; in November pneumonia strikes one of them down.","predicament":"Someone far from home falls gravely ill with only a friend to care for them."},
|
|
{"chunk":789,"story":91,"summary":"The doctor says she has one chance in ten, and only if she wants to live; she has made up her mind to die.","predicament":"Someone gravely ill has given up, and their friend must find a reason for them to live."},
|
|
{"chunk":790,"story":91,"summary":"The sick girl lies counting the leaves falling from an old vine on the wall outside, and says she will die with the last.","predicament":"Someone fixes on a sign and ties their own survival to it."},
|
|
{"chunk":791,"story":91,"summary":"Her friend scolds her for the fancy and asks her to close her eyes; she says she is tired and wants to let go.","predicament":"Someone tries to talk another out of despair and cannot reach them."},
|
|
{"chunk":792,"story":91,"summary":"The friend goes down to an old drunken painter who has always promised a masterpiece, to ask him to pose.","predicament":"Someone asks help of a failure who has talked for decades of one great work."},
|
|
{"chunk":793,"story":91,"summary":"The old man scorns the fancy but agrees to pose; the two look fearfully at the vine as cold rain and snow begin.","predicament":"Someone gruff about another's weakness quietly resolves to help them."},
|
|
{"chunk":794,"story":91,"summary":"Next morning one leaf still clings to the wall; it survives another stormy night, and the girl watches it.","predicament":"Someone who expected the sign to fail watches it hold against all likelihood."},
|
|
{"chunk":795,"story":91,"summary":"She says it was wicked to want to die and asks for broth; the doctor mentions the old painter downstairs has pneumonia too.","predicament":"Someone recovers their will to live, not knowing the cost to another."},
|
|
{"chunk":796,"story":91,"summary":"Her friend tells her the old painter has died of pneumonia: he painted that last leaf on the wall the night the real one fell.","predicament":"Someone who never achieved their great work gives their life to make one small act of hope."},
|
|
{"chunk":797,"story":92,"summary":"A rising young man ignores a plain new boarder, until he sees her one evening dressed in deep mourning, beautiful and sad.","predicament":"Someone overlooked becomes interesting to another the moment they appear to be grieving."},
|
|
{"chunk":798,"story":92,"summary":"He speaks to her on the steps; she hints that death has claimed not a relative but someone closer, and he sympathises.","predicament":"Someone uses grief, real or not, to be noticed by a person they want."},
|
|
{"chunk":799,"story":92,"summary":"In the park she tells him her fiance was a real count with a castle, and that her father kept them apart.","predicament":"Someone tells an impressive story about a past love to someone they want to impress."},
|
|
{"chunk":800,"story":92,"summary":"The count, she says, was killed abroad and her heart lies in his grave; he resolves to be her friend and more.","predicament":"Someone claims a dead love to make themselves more desirable to a living one."},
|
|
{"chunk":801,"story":92,"summary":"She shows him the count's photograph in her locket and a larger one framed; he studies it with inscrutable eyes.","predicament":"Someone shows proof of a story to a person who recognises the proof."},
|
|
{"chunk":802,"story":92,"summary":"Engaged a month later, he turns gloomy and explains that a great political boss has promised to come to the wedding.","predicament":"Someone wants a powerful patron at their wedding but has a secret reason to keep them away."},
|
|
{"chunk":803,"story":92,"summary":"He says the patron must not come, for reasons he will not give, and asks whether she loves him as she loved the count.","predicament":"Someone asks their partner to choose them over a rival who may never have existed."},
|
|
{"chunk":804,"story":92,"summary":"She confesses she invented the count to wear becoming black; he forgives her, since the photograph was the political boss himself.","predicament":"Someone confesses a lie the other had already seen through and forgiven."},
|
|
{"chunk":805,"story":93,"summary":"A weary magazine sub-editor seeks relief in the artists' world of the city, and calls for a woman who belongs to it.","predicament":"Someone tired of their work seeks escape in a looser crowd."},
|
|
{"chunk":806,"story":93,"summary":"Her flat is strewn with the wreckage of last night's party; she appears radiant and they go to a famous bohemian restaurant.","predicament":"Someone lives in the careless disorder that their circle calls freedom."},
|
|
{"chunk":807,"story":93,"summary":"The restaurant's owner rose from a cheap eating-house by staging eccentricities that fashionable diners took for authentic bohemia.","predicament":"Someone grows rich by selling others an imitation of the freedom they crave."},
|
|
{"chunk":808,"story":93,"summary":"At the round table sit painters, poets and a mourning widow; the woman is one of the acknowledged princesses of their circle.","predicament":"Someone holds a high place in a circle whose rules demand constant performance."},
|
|
{"chunk":809,"story":93,"summary":"Dinner proceeds by courses of humour, wit, repartee and brag, each guest ready with their prepared performance.","predicament":"Someone must keep up with a crowd where every remark is a test."},
|
|
{"chunk":810,"story":93,"summary":"The strain of seeming at ease shows between her brows; freedom there is a tyrant that forbids anyone to object.","predicament":"Someone exhausts themselves keeping up the appearance of being free and easy."},
|
|
{"chunk":811,"story":93,"summary":"After the party she takes a midnight train to her parents' bare country cottage, and greets her stern father at sunrise.","predicament":"Someone leads a double life, escaping their free circle for a strict and silent home."},
|
|
{"chunk":812,"story":93,"summary":"She peels potatoes, lies about her work, and sits two hours on a hard chair hearing theology read aloud, blissfully happy.","predicament":"Someone finds rest in the rules and hardships that others would flee."},
|
|
{"chunk":813,"story":93,"summary":"The sermon damns her and she rejoices; that evening at dinner she tells her friends she has been away in bohemia.","predicament":"Someone escapes from freedom into strictness and calls that their holiday."},
|
|
{"chunk":814,"story":93,"summary":"When a painter tries to kiss her she slaps him hard, breaking the one law of their circle, and the party breaks up.","predicament":"Someone refreshed by strict rules breaks the unwritten rule of a permissive crowd."},
|
|
{"chunk":815,"story":93,"summary":"A village girl in the city, hearing the story, says that had the woman stayed home a week the painter would have got his kiss.","predicament":"Someone points out that the cure for one excess is simply too much of the other."}
|
|
]
|