https://github.com/bibliotechy/dirty-poetry Skip to content Toggle navigation Sign up * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code + Explore + All features + Documentation + GitHub Skills + Blog * Solutions + For + Enterprise + Teams + Startups + Education + By Solution + CI/CD & Automation + DevOps + DevSecOps + Case Studies + Customer Stories + Resources * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles + Repositories + Topics + Trending + Collections * Pricing [ ] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this user All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up {{ message }} bibliotechy / dirty-poetry Public * Notifications * Fork 0 * Star 41 poetry from dirty ocr 41 stars 0 forks Star Notifications * Code * Issues 0 * Pull requests 0 * Actions * Projects 0 * Security * Insights More * Code * Issues * Pull requests * Actions * Projects * Security * Insights bibliotechy/dirty-poetry This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. master Switch branches/tags [ ] Branches Tags Could not load branches Nothing to show {{ refName }} default View all branches Could not load tags Nothing to show {{ refName }} default View all tags Name already in use A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch? Cancel Create 1 branch 0 tags Code * Local * Codespaces * Clone HTTPS GitHub CLI [https://github.com/b] Use Git or checkout with SVN using the web URL. [gh repo clone biblio] Work fast with our official CLI. Learn more. * Open with GitHub Desktop * Download ZIP Sign In Required Please sign in to use Codespaces. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching Xcode If nothing happens, download Xcode and try again. Launching Visual Studio Code Your codespace will open once ready. There was a problem preparing your codespace, please try again. Latest commit @bibliotechy bibliotechy Typo ... 1575f4c Apr 29, 2021 Typo 1575f4c Git stats * 3 commits Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time dirty_poetry Readme and such April 28, 2021 22:08 poems Readme and such April 28, 2021 22:08 5k.txt Readme and such April 28, 2021 22:08 Pipfile Readme and such April 28, 2021 22:08 Pipfile.lock Readme and such April 28, 2021 22:08 README.md Typo April 28, 2021 22:10 parser.py Readme and such April 28, 2021 22:08 poet.py Readme and such April 28, 2021 22:08 test_functions.py Readme and such April 28, 2021 22:08 words_alpha.txt Readme and such April 28, 2021 22:08 View code Dirty Poetry wat now? y tho? SHOW ME THE POEMS I'm afraid to ask this but...how? Yeah, but OCR on old newspapers is HARD! README.md Dirty Poetry wat now? Poems made from the dirtiest OCR data available from the Library of Congress's Chronicling America dataset of historical Newspapers. And by dirty, I mean OCR that looks like: J t- IV .'J tv -'-' 3:i;t-'-' i.M iipnUcntioo to, , ' .1 J. .Viwifint,. N,.'.A.,17; Vahiitoatit.,Iks.ul. J to, 5 ;S0 p. in. and l.'. 'll .. in. Trains connect at and aouttt, ot ! a. in., !?..; and 3.1ft p. m. The (."tli tour, iloii, lm-me-fi in ;ih istiite-. y tho? Every data project starts with a long slog of cleaning up the data to be useful. Well, this project is conceived under the idea of "What if we leaned into our bad data? What if we took it on it's own terms, and didn't judge it. Where might it take us?" And the answer is: this absolute nonsense right here. SHOW ME THE POEMS They looks like this: >>-,,aI obituary poetry not be submitted for publi i Groceries at No. Mnu, Street "(..L u^ Fred a Brown and *oe Willian kj i u si vie ta.-. ,y-,,jin luring the last half centur; . Not le..-l soiac of tin ir make :i: .!. - iin Rheumatism, gout, obesity and nenrous diseases =^PSl , i pi',. I II llr'llllll. lei Hllls.hl.il roiicr.il strike order to he o(T...-'l\o Mnn should ('(Pine directly from th,* Island**. Tbe b-!a.'. n.a ii,!i. n tor the e.ir. il, G. L. Ouklns, Or W ';: Miss attie Mors, r," "Yes, sir, we got a parrot."--E covi ?:\.-? loi: a BOX U BEBT LIT. upon ?getting away at eon .? i??? tibie upon ?getting away at eon .? i??? tibie Tsmphlet i-ont Irio I y t ? ..;lil.i!ir v :. fra la vie 25. ma e .'> <<>>*d hf are --and II they hay* / BC_of, .?uuiiii | ;_? all u tiiau- a. i_ 1 ii- booka of ii.... . i p. n. 1. UMBSEN A C 0.,-1 Montgomery st. . 1 95 Columbus street......... New Orleans. r.o,u!r<<>d da?n: Th<<- hour of >-<<.ur birth a. m. More examples I'm afraid to ask this but...how? Right! I've poured over ((ok, grepped) ~500GB of Chroincling America data to find lines that meet my low standard for nonsene, basically ones that match egrep "[^a-zA-Z0-9 ]{3,}". Having found the absolute bottom of the barrel, I then ran each line through some parsing and analysis to determine each lines: * nonsense metre. Essentiall looking at each "term" in a line and asking "is this even a word"! * nonsense percentage * final phonemes to use for "rhyming" (You ever try rhyming nonsenical gibberish before. Take it from me: DONT START!) * and some other stuff. And then I stuffed it all in a postgres database so I could try writing poetry by writing SQL. SELECT idiot from PEBCAK HAVING count(problems)= 2) Yeah, but OCR on old newspapers is HARD! Damn right it is. This project isn't meant to diminish orthe hard work put in by the Library of Congress and it's partners. It's a love letter to working with what you are given and finding ricness in it's weirdest folds. Literally though, I could not have done this without the great work of all the folks who have contribued to Chronicling America! About poetry from dirty ocr Resources Readme Stars 41 stars Watchers 2 watching Forks 0 forks Releases No releases published Packages 0 No packages published Languages * Python 100.0% Footer (c) 2023 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.