JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
49 lines
11 KiB
JSON
49 lines
11 KiB
JSON
[
|
|
{"chunk":180,"story":24,"summary":"An out-of-work actress darns stockings in a cheap hotel above the theatre district, wanting only to be back on a stage.","predicament":"Someone out of work waits in cheap lodgings for the only work they want."},
|
|
{"chunk":181,"story":24,"summary":"The hotel is full of resting players besieging managers for next season, and she wonders aloud where her old friend is.","predicament":"Someone among many in the same trade waits, with all of them chasing the same few places."},
|
|
{"chunk":182,"story":24,"summary":"Her friend's act was throwing a garter to the audience nightly; after two years she quit for a village on the shore.","predicament":"Someone abandons a profitable performance because of what it required them to be."},
|
|
{"chunk":183,"story":24,"summary":"The friend arrives travel-stained and agitated, drops her bag, and says she has come straight up to talk.","predicament":"Someone returns abruptly from the life they left, upset and not yet saying why."},
|
|
{"chunk":184,"story":24,"summary":"She says she left the stage sick of the life, and above all of the men the work forced her to meet.","predicament":"Someone leaves good work because of what they must endure from the people around it."},
|
|
{"chunk":185,"story":24,"summary":"She describes the suppers, the leering men and the middling actress who hangs on for the chance that never comes.","predicament":"Someone knows they will never rise, and keeps at it anyway for want of a better hope."},
|
|
{"chunk":186,"story":24,"summary":"She took a room by the sea, met a young clergyman lodging there, and within a month they were engaged.","predicament":"Someone starting a new life quickly finds the respectable future they thought impossible."},
|
|
{"chunk":187,"story":24,"summary":"She hides her stage past; the landlady tells her he treasures a keepsake of an unhappy love in a locked box.","predicament":"Someone hiding their own past learns the person they love keeps a locked one."},
|
|
{"chunk":188,"story":24,"summary":"Questioned, he says his earlier love was ideal: a woman he never met, seen from a distance, far above him.","predicament":"Someone questions a partner about an old attachment and is given an answer too good to doubt."},
|
|
{"chunk":189,"story":24,"summary":"His answer raises him in her eyes; then, left alone with his forgotten keys, she opens the drawer out of curiosity.","predicament":"Someone's admiration for another leads them to look at the one thing kept from them."},
|
|
{"chunk":190,"story":24,"summary":"One look inside the box sends her packing; she pays the landlady, declares all men alike, and takes the next train.","predicament":"Someone discovers the truth in a keepsake and ends everything without saying what they saw."},
|
|
{"chunk":191,"story":25,"summary":"Outsiders hold cheap and lurid ideas about stage people, while privately practising gestures in front of their own mirrors.","predicament":"People look down on a trade they secretly wish they were fit for."},
|
|
{"chunk":192,"story":25,"summary":"A performer has toured four years with a mixed act, working to the approval of the musicians below the stage.","predicament":"Someone works a trade for years, competent and unremarkable, waiting for the thing that lifts them."},
|
|
{"chunk":193,"story":25,"summary":"Bored by the whole bill, the performer sits up when a young woman does character songs and impersonations.","predicament":"Someone weary of their own trade is stopped short by one person doing it well."},
|
|
{"chunk":194,"story":25,"summary":"She exactly fits the part in the sketch he has kept hidden in his trunk, so he calls at her lodgings next day.","predicament":"Someone finds the one person who fits the plan they have kept to themselves for years."},
|
|
{"chunk":195,"story":25,"summary":"He reads her the sketch; she names its weak points and he accepts every change without argument.","predicament":"Someone offers their guarded work and finds it improved by the person they offered it to."},
|
|
{"chunk":196,"story":25,"summary":"She asks his salary, names her lower one, and says she works for money and means to save for a country home.","predicament":"Someone states plainly that they are in this for money, before agreeing to anything."},
|
|
{"chunk":197,"story":25,"summary":"She insists the partnership be strictly business with no nonsense; he agrees and describes his own dream of a quiet house.","predicament":"Two people agree to work together on the condition that nothing personal enters it."},
|
|
{"chunk":198,"story":25,"summary":"The pair cut, rewrite and rehearse the sketch through every known improvement until it is ready.","predicament":"Two people grind a shared piece of work into shape over many months."},
|
|
{"chunk":199,"story":25,"summary":"The act uses a real revolver and a live cartridge in a melodrama of a ranch, a theft and a jealous woman.","predicament":"Two people build their living on a performance that requires one of them to shoot accurately."},
|
|
{"chunk":200,"story":25,"summary":"In the story the ranch owner dies, a fortune vanishes, and the woman is convinced her lover is the thief.","predicament":"Someone concludes the person they love has robbed them, on the evidence of who was there."},
|
|
{"chunk":201,"story":25,"summary":"At the climax she fires through a rival's photograph; the bullet strikes a hidden spring and the missing fortune appears.","predicament":"Someone aims a shot to prove mercy, and hits the thing that clears the accused."},
|
|
{"chunk":202,"story":25,"summary":"The act triumphs and books at five hundred a week; she asks him inside to hear a proposal that will cut their expenses.","predicament":"Someone proposes an arrangement to another on the grounds that it will save them both money."},
|
|
{"chunk":203,"story":25,"summary":"For two years the act tours to full houses, the pair known everywhere as quiet, hard workers who go straight home.","predicament":"Two people build savings and a spotless name by never once being seen to enjoy themselves."},
|
|
{"chunk":204,"story":25,"summary":"Nervous at a first night, she fires wide and the bullet enters her partner's neck; the audience applauds the supposed comedy.","predicament":"Someone's nerve fails once at the exact thing they have done perfectly a thousand times."},
|
|
{"chunk":205,"story":25,"summary":"A fellow performer tells the wounded man that his partner is frantic with love for him; he calls it impossible.","predicament":"Someone is told that the person nearest them loves them, and cannot believe it."},
|
|
{"chunk":206,"story":25,"summary":"He insists it is too late, and reveals that the two of them have been quietly married for two years.","predicament":"Someone hears that love has arrived and answers that the arrangement was settled long ago."},
|
|
{"chunk":207,"story":26,"summary":"A quarter of the city gathers exiles from the south, who plot, raise funds and buy arms from a favourite cafe.","predicament":"Exiles gather in one place to plan a return that most of them will never make."},
|
|
{"chunk":208,"story":26,"summary":"A general arrives by liner from the south, short, grand and important, and makes for the quarter where his countrymen gather.","predicament":"Someone arrives in a strange city on an errand for their country, conspicuous in every way."},
|
|
{"chunk":209,"story":26,"summary":"He takes rooms at a hotel whose blond landlady charms him, and reminds himself that his country claims his devotion.","predicament":"Someone on an errand is distracted at once by what they find where they lodge."},
|
|
{"chunk":210,"story":26,"summary":"Bewildered by traffic, the general is marked by two street predators, and the smoother of them rescues him and gains his trust.","predicament":"Someone helpless in a strange place is helped by the person planning to rob them."},
|
|
{"chunk":211,"story":26,"summary":"Over bottles the general loudly confides that he carries drafts for twenty-five thousand to buy rifles for a revolution.","predicament":"Someone announces a secret errand and its funds to a stranger at the top of their voice."},
|
|
{"chunk":212,"story":26,"summary":"The stranger promises to introduce him to the Secretary of War, and tells him to keep the drafts in his pocket.","predicament":"Someone is promised access to a great official by the one person who has befriended them."},
|
|
{"chunk":213,"story":26,"summary":"The stranger telephones a confidence man and casts him as the Secretary of War for the following afternoon.","predicament":"Someone arranges for an accomplice to impersonate the authority their mark is expecting."},
|
|
{"chunk":214,"story":26,"summary":"On the way out the stranger insults the landlady with a joke she overhears; the false official then plays his part.","predicament":"Someone insults, in passing, the one person able to ruin their scheme."},
|
|
{"chunk":215,"story":26,"summary":"Cases are filled with bricks for the sale, and the landlady takes the general aside to ask about his new friend.","predicament":"Someone about to be cheated is taken aside by the person who sees through it."},
|
|
{"chunk":216,"story":26,"summary":"The general buys the hotel's furnishings and lease with the money and proposes to the landlady; the swindler chokes with rage.","predicament":"Someone abandons the cause they were entrusted with for a comfortable life and a marriage."},
|
|
{"chunk":217,"story":26,"summary":"The general calls it politics, says war is not nice, and asks whether the swindler has tasted the landlady's cooking.","predicament":"Someone explains away a betrayal as good sense, and recommends the life they chose."},
|
|
{"chunk":218,"story":27,"summary":"A confidence man follows an old partner's advice and comes to the city, meeting him again on the street.","predicament":"Someone past their best moves to richer ground on a colleague's advice."},
|
|
{"chunk":219,"story":27,"summary":"The partner insists the city's people beg to be robbed, and proposes they work the town together as in old times.","predicament":"Someone is urged into a scheme by a partner who insists it cannot fail."},
|
|
{"chunk":220,"story":27,"summary":"He recounts schemes abandoned for being too easy; the newcomer says the people here do not look easy to him.","predicament":"Someone doubts a partner's confidence about a place they do not yet know."},
|
|
{"chunk":221,"story":27,"summary":"The partner mocks the newcomer's caution, who says he wishes he had stayed with the small sure business at home.","predicament":"Someone doubts the large opportunity and misses the modest certainty they left."},
|
|
{"chunk":222,"story":27,"summary":"They pool their money, and an acquaintance brings a famous financier to their room to meet men from the West.","predicament":"Two people pool everything they have and are promptly introduced to a great man."},
|
|
{"chunk":223,"story":27,"summary":"The financier rages that a painting cannot be found and would pay seventy-five thousand; afterwards they stroll past a pawnshop.","predicament":"Someone hears what a rich person desperately wants, moments before appearing to find it."},
|
|
{"chunk":224,"story":27,"summary":"The partner has seen that very picture in the pawnshop, and next morning they go in to bargain for it.","predicament":"Someone spots the chance that has been placed in front of them and hurries to take it."},
|
|
{"chunk":225,"story":27,"summary":"They pay two thousand for the picture; the financier has been abroad a month, and the same print sells everywhere for dollars.","predicament":"Two people spend everything on a certainty and find they were the marks all along."}
|
|
]
|