JesseMarkowitzandClaude Opus 5
e5617b86ba
The pipeline's embed-and-cluster step is dead, and this commit holds both the evidence for that and the step proposed to replace it. Predicaments. Scenes are re-described as "what the person is up against", with no names, jobs or places, then embedded and clustered (redescribe.py, topic_words.py, topic_share.py). The pilot chose qwen3:14b over 3b by reading both side by side. Two defects the pilot exposed are fixed: split.py missed titles in quotes and a contents subtitle after a dash, so three stories had been merged into their neighbours, and strip_names.py read New York place names as people. The corrected corpus is probe/v2 (97 stories, 839 scenes); carry_summaries.py reuses the 829 unchanged v1 summaries. Topic share fell from 20% to 13% at k=60, short of the pre-registered 10%. Hand references. Three corpora were read scene by scene and written up by hand, under the same prompt rules the local models get, as a baseline to judge them against: O. Henry (probe/v2/claude, 839 scenes, 20 situations), Wharton's Descent of Man (probe/wharton, 262 scenes, 16 groups) and Jacobs's The Lady of the Barge (probe/jacobs, 157 scenes, 19 groups). Each has its own README and a readable page. No inference was used for any of them. Catalogue. probe/catalogue maps every hand group in the three references onto 36 situation entries, with an answer key per corpus and one recurrence rule applied to all three. classify.py assigns a scene one entry or none, leave-one-corpus- out; score.py checks it against the key, with a self-test on random labels. Why clustering is out: hand-written predicaments, embedded and clustered exactly as the model's were, agree with the hand grouping at ARI 0.05 — no better than the 14B text's 0.07. Better rewriting cannot rescue it. Embeddings cannot even shortlist: the hand label is the nearest entry 13% of the time and in the top 8 half the time. The classification runs are not here. The dev and test runs are pre-registered in probe/catalogue/README.md with the bar set beforehand, and are blocked on the inference host, whose GPU has fallen off the PCIe bus three times. The 30-scene partial output in out/ is not a result. Review page. The situation review is now a browser page rather than JSON edited by hand (review_page.py, review_page_logic.cjs with Node tests, format schema v2). It has never been rendered in a real browser. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014BygvsUXV9eU6oHkTCkKZ1
28 lines
6.2 KiB
JSON
28 lines
6.2 KiB
JSON
[
|
|
{"chunk":237,"story":9,"summary":"An old man's tale begins with his younger self, just of age, sighting a fabled foreign city from his father's merchant ship.","predicament":"Someone young and newly free arrives in a place they have dreamed of all their life."},
|
|
{"chunk":238,"story":9,"summary":"The youth recalls a childhood print of the city's crowded square, full of foreigners, performers and pickpockets.","predicament":"Someone brings a child's romantic picture of a place to the real thing."},
|
|
{"chunk":239,"story":9,"summary":"The city has always stood in his mind for a place of magic where the rules of his strict upbringing do not hold.","predicament":"Someone raised under strict rules longs for a place where the rules do not apply."},
|
|
{"chunk":240,"story":9,"summary":"His tutor insists on finishing a sermon before going ashore; the youth slips away alone.","predicament":"Someone under a guardian's supervision slips away to do what they want."},
|
|
{"chunk":241,"story":9,"summary":"In the crowded square he overpays a pedlar through ignorance of the coinage, and a pleasant English-speaking stranger offers help.","predicament":"Someone who shows they are a naive newcomer with money is approached by a helpful stranger."},
|
|
{"chunk":242,"story":9,"summary":"The friendly stranger, calling himself a count, shows him the town and points out its great personages in their odd costumes.","predicament":"Someone new in a strange place gratefully accepts a guide whose credentials they cannot check."},
|
|
{"chunk":243,"story":9,"summary":"Bound to return by sunset, he gives the count a costly gift, is led into the cathedral, and meets a pretty girl whose dress catches on his sword.","predicament":"Someone who has promised to be back on time lets a new acquaintance talk them into one more detour."},
|
|
{"chunk":244,"story":9,"summary":"The count names her as a senator's daughter; a page slips the youth a note begging his help, and an officer seizes him.","predicament":"Someone receives a secret appeal for help and is immediately caught holding it."},
|
|
{"chunk":245,"story":9,"summary":"The count warns him the officer serves the dreaded council and that the letter compromises a great family, and arranges for him to be taken privately to the father.","predicament":"Someone accused of an offence they do not understand is steered by a friend towards a private settlement."},
|
|
{"chunk":246,"story":9,"summary":"He asks to send word to his ship and is refused; the count urges him not to resist.","predicament":"Someone being led away is denied the chance to tell anyone where they are."},
|
|
{"chunk":247,"story":9,"summary":"He breaks free and runs, is cornered in an alley, and is pulled through a gate by a servant girl.","predicament":"Someone who has escaped their captors is cornered, and must trust an unknown rescuer."},
|
|
{"chunk":248,"story":9,"summary":"He is led to the girl from the cathedral, who seems dismayed to see him; the page was her maid in disguise.","predicament":"Someone who answered a call for help is told they were not the one it was meant for."},
|
|
{"chunk":249,"story":9,"summary":"She says the letter was meant for an ambassador to save her from a forced marriage; her father is heard coming.","predicament":"Someone learns they have been caught up in another person's desperate plan by mistake."},
|
|
{"chunk":250,"story":9,"summary":"The father and his noble friends burst in with drawn swords; the count arrives and mediates, and says the youth is in great trouble.","predicament":"Someone is confronted by an angry family and depends on a go-between who speaks for them."},
|
|
{"chunk":251,"story":9,"summary":"He is accused of secret correspondence with the girl, now repudiated by her betrothed; he refuses to hide behind her word.","predicament":"Someone accused of compromising another must defend themselves without exposing them."},
|
|
{"chunk":252,"story":9,"summary":"Asked to clear her by showing the letter, he sees her silently beg him not to.","predicament":"Someone could clear themselves by producing evidence, but the person it would expose begs them not to."},
|
|
{"chunk":253,"story":9,"summary":"He refuses to show his private letters; the count says honour now demands he marry the girl.","predicament":"Someone who keeps another's secret is told the price is a lifelong obligation."},
|
|
{"chunk":254,"story":9,"summary":"He is told he must marry her within the hour, and is locked in with her while the chaplain is fetched.","predicament":"Someone is trapped and given an hour before a forced commitment they never sought."},
|
|
{"chunk":255,"story":9,"summary":"She weeps with shame, thanks him for keeping her secret, and says her father is forcing her to marry a brute.","predicament":"Someone trapped alongside another hears their tale of being forced into a match and wants to save them."},
|
|
{"chunk":256,"story":9,"summary":"She says she cannot be saved but he can, if he will do as she says without looking at her.","predicament":"Someone is offered a way out, provided they accept terms they will not like."},
|
|
{"chunk":257,"story":9,"summary":"She explains that everyone involved can be bought, and begs him to offer a ransom to go free.","predicament":"Someone learns they can buy their way out of a trap, and that is exactly what the trap was for."},
|
|
{"chunk":258,"story":9,"summary":"He offers to marry her himself instead; she refuses and insists she must marry the other man.","predicament":"Someone offers themselves to rescue another and is refused."},
|
|
{"chunk":259,"story":9,"summary":"He declares his love; she kisses him, takes a trinket from his watch-chain, and laughs strangely that she will get none of the money.","predicament":"Someone who has fallen for another begins to sense they are being played."},
|
|
{"chunk":260,"story":9,"summary":"He realises the whole thing was a swindle; she admits it but says her love was real, just as his ship's captain and tutor arrive with the police.","predicament":"Someone discovers they were the mark in a confidence trick just as rescue arrives."},
|
|
{"chunk":261,"story":9,"summary":"The captain exposes the tricksters as known confidence men, softens towards the girl, and takes the youth back to his ship.","predicament":"Someone who has been swindled is rescued by their elders and must walk away from a person they had fallen for."}
|
|
]
|