[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"nav-categories":3,"article-talkie-1930-the-largest-vintage-llm-ever-built-trained-exclusively-on-a-world-that-ended-in-1930":70},{"data":4},[5,37,57,64],{"name":6,"slug":7,"categories":8},"Productivity","productivity",[9,13,17,21,25,29,33],{"id":10,"title":11,"slug":12},17,"Branding","branding",{"id":14,"title":15,"slug":16},19,"Marketing","marketing",{"id":18,"title":19,"slug":20},20,"Work","work",{"id":22,"title":23,"slug":24},34,"Community","community",{"id":26,"title":27,"slug":28},21,"For newbies","for-newbies",{"id":30,"title":31,"slug":32},24,"Investment","investment",{"id":34,"title":35,"slug":36},22,"Finance","finance",{"name":38,"slug":39,"categories":40},"Tech","tech",[41,45,49,53],{"id":42,"title":43,"slug":44},28,"Technology","technology",{"id":46,"title":47,"slug":48},32,"Artificial Intelligence","artificial-intelligence",{"id":50,"title":51,"slug":52},26,"Security and protection","security-and-protection",{"id":54,"title":55,"slug":56},31,"YouTube Blog","youtube-blog",{"name":58,"slug":59,"categories":60},"News","news",[61],{"id":62,"title":58,"slug":63},18,"quasanews",{"name":65,"slug":66,"categories":67},"Business","business",[68],{"id":69,"title":65,"slug":66},16,{"post":71,"published_news":95,"popular_news":149,"categories":220},{"title":72,"description":73,"meta_title":72,"meta_description":74,"meta_keywords":75,"text":76,"slug":77,"created_at":78,"publish_at":79,"formatted_created_at":80,"category_id":46,"links":81,"view_type":86,"video_url":87,"views":69,"likes":88,"lang":89,"comments_count":88,"category":90},"Talkie-1930: The Largest “Vintage” LLM Ever Built, Trained Exclusively on a World That Ended in 1930","The roadmap is ambitious. The team aims to release a GPT-3-class vintage model by summer 2026. If they can grow the pre-1931 corpus beyond one trillion tokens, they believe they can reach the capability level of the original ChatGPT.","A team of researchers including Alec Radford, Nick Levine, and David Duvenaud has released talkie-1930-13b","Talkie-1930-13b-base and its instruction-tuned sibling talkie-1930-13b-it are available today on Hugging Face","\u003Cp>A team of researchers including Alec Radford (co-creator of GPT, CLIP, and Whisper), Nick Levine, and David Duvenaud has released \u003Cstrong>talkie-1930-13b\u003C/strong> — a 13-billion-parameter language model trained from scratch on nothing but 260 billion tokens of English-language text published before December 31, 1930. Books, newspapers, periodicals, scientific journals, patents, and court decisions — all strictly pre-1931 public-domain material. No internet. No Wikipedia. No World War II. No New Deal. No United Nations.\u003C/p>\n\n\u003Cp>\u003Cpicture>\u003Csource srcset=\"https://cdn.quasa.io/photos/0001/image-2026-05-04t204549149.webp\" type=\"image/webp\">\u003Cimg alt=\"Talkie-1930: The Largest “Vintage” LLM Ever Built, Trained Exclusively on a World That Ended in 1930\" class=\"image-align-left\" height=\"447\" src=\"https://cdn.quasa.io/photos/0001/image-2026-05-04t204549149.jpg\" width=\"300\" />\u003C/picture>It is, by the authors’ knowledge, the largest “vintage” language model ever created.\u003C/p>\n\n\u003Cp>The project is deliberately provocative. Modern LLMs are trained on the messy, contaminated firehose of the contemporary web. Talkie is the opposite: a clean historical snapshot designed to let researchers study what large language models can actually \u003Cstrong>reason\u003C/strong> about rather than simply regurgitate. As the team puts it, “Vintage LMs are contamination-free by construction, enabling unique generalization experiments.”\u003C/p>\n\n\u003Cp>On standard benchmarks, the model behaves exactly as one would expect from a 1930-era intelligence. It underperforms its “modern twin” — an identical 13B model trained on the same compute budget but using today’s FineWeb dataset — particularly on knowledge-heavy evaluations. The gap shrinks dramatically once questions that would be anachronistic to a 1930 reader are filtered out. On core language understanding and numeracy tasks, however, the vintage model stays surprisingly competitive.\u003C/p>\n\n\u003Cp>Coding ability tells a fascinating story. On HumanEval, talkie lags far behind modern models — but it can still produce correct, simple Python solutions when given in-context examples. It does so not by memorizing code (there is none in its training data), but by reasoning from 19th-century mathematics and logic texts. Scale clearly helps: larger vintage models show steady improvement.\u003C/p>\n\n\u003Cp>\u003Cpicture>\u003Csource srcset=\"https://cdn.quasa.io/photos/0001/image-2026-05-04t204551646.webp\" type=\"image/webp\">\u003Cimg alt=\"Talkie-1930: The Largest “Vintage” LLM Ever Built, Trained Exclusively on a World That Ended in 1930\" class=\"image-align-right\" height=\"447\" src=\"https://cdn.quasa.io/photos/0001/image-2026-05-04t204551646.jpg\" width=\"300\" />\u003C/picture>The development process was harder than it sounds. Standard OCR on century-old documents proved disastrous — it cut training efficiency to roughly 30 % of clean, human-transcribed text. Aggressive regex-based cleaning brought performance back up to about 70 %.\u003C/p>\n\n\u003Cp>The team also built a custom n-gram-based anachronism classifier to catch post-1930 contamination. Even so, early versions occasionally “knew” about the Roosevelt administration or World War II, revealing just how insidious temporal leakage can be.\u003C/p>\n\n\u003Cp>Post-training was equally inventive. Because modern chat data was off-limits, the team constructed an entirely historical instruction dataset drawn from 1930-era etiquette manuals, letter-writing guides, encyclopedias, and poetry collections. They used Claude Sonnet 4.6 as a judge for online DPO and Claude Opus 4.6 to generate synthetic multi-turn conversations — an ironic but carefully flagged step they plan to eliminate in future versions.\u003C/p>\n\n\u003Cp>The roadmap is ambitious. The team aims to release a GPT-3-class vintage model by summer 2026. If they can grow the pre-1931 corpus beyond one trillion tokens, they believe they can reach the capability level of the original ChatGPT.\u003C/p>\n\n\u003Cp>\u003Cpicture>\u003Csource srcset=\"https://cdn.quasa.io/photos/0001/image-2026-05-04t204554162.webp\" type=\"image/webp\">\u003Cimg alt=\"Talkie-1930: The Largest “Vintage” LLM Ever Built, Trained Exclusively on a World That Ended in 1930\" class=\"image-align-left\" height=\"447\" src=\"https://cdn.quasa.io/photos/0001/image-2026-05-04t204554162.jpg\" width=\"300\" />\u003C/picture>Beyond the technical achievement, talkie offers something rare in today’s AI race: a scientific instrument. By freezing knowledge at a precise historical moment, researchers can now ask cleaner questions about generalization, forecasting, invention discovery, and the very nature of what LLMs actually learn.\u003C/p>\n\n\u003Cp>Can a model trained only on pre-Turing texts “invent” the idea of a universal computing machine? How well can it predict — or be surprised by — events after 1930? These are questions modern web-trained models can never answer cleanly.\u003C/p>\n\n\u003Cp>Talkie-1930-13b-base and its instruction-tuned sibling talkie-1930-13b-it are available today on Hugging Face under the Apache 2.0 license, \u003Ca href=\"https://talkie-lm.com/introducing-talkie\">with inference code on GitHub and a live demo at talkie-lm.com\u003C/a>.\u003C/p>\n\n\u003Cp>You can chat with a mind that genuinely believes the most exciting technological frontiers still lie in radio, aviation, and the orderly progress of Western civilization — and has never heard of smartphones, the internet, or artificial intelligence itself.\u003C/p>\n\n\u003Cp>In an era when every new model seems trained on the same ever-growing pile of contemporary data, talkie reminds us that sometimes the most interesting insights come from looking backward — all the way back to a world that ended on the last day of 1930.\u003C/p>\n\n\u003Cp>Also read:\u003C/p>\n\n\u003Cul>\n\t\u003Cli>\u003Ca href=\"https://quasa.io/media/artisan-ai-the-most-controversial-ai-sdr-in-tech-from-provocative-billboards-to-linkedin-bans\">Artisan AI: The Most Controversial AI SDR in Tech, From Provocative Billboards to LinkedIn Bans\u003C/a>\u003C/li>\n\t\u003Cli>\u003Ca href=\"https://quasa.io/media/logitech-s-epic-fail-expired-certificate-bricks-millions-of-mac-mice-and-keyboards\">Logitech's Epic Fail: Expired Certificate Bricks Millions of Mac Mice and Keyboards\u003C/a>\u003C/li>\n\t\u003Cli>\u003Ca href=\"https://quasa.io/media/onlyfans-models-and-influencers-dominate-u-s-extraordinary-talent-visas-sparking-debate-on-immigration-priorities\">OnlyFans Models and Influencers Dominate U.S. 'Extraordinary Talent' Visas, Sparking Debate on Immigration Priorities\u003C/a>\u003C/li>\n\u003C/ul>\n\n\u003Cp>Thank you!\u003C/p>","talkie-1930-the-largest-vintage-llm-ever-built-trained-exclusively-on-a-world-that-ended-in-1930","2026-05-04T18:48:16.000000Z","2026-05-09T11:40:00.000000Z","09.05.2026",{"image":82,"image_webp":83,"thumb":84,"thumb_webp":85},"https://cdn.quasa.io/images/news/6bm4kJDAVGZ91qAYwOKGdBOrQtJYqP0ODYbsgxVY.jpg","https://cdn.quasa.io/images/news/6bm4kJDAVGZ91qAYwOKGdBOrQtJYqP0ODYbsgxVY.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/6bm4kJDAVGZ91qAYwOKGdBOrQtJYqP0ODYbsgxVY.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/6bm4kJDAVGZ91qAYwOKGdBOrQtJYqP0ODYbsgxVY.webp","small",null,0,"en",{"id":46,"title":47,"slug":48,"meta_title":91,"meta_description":92,"meta_keywords":92,"deleted_at":87,"created_at":93,"updated_at":94,"lang":89},"Artificial Intelligence | AI Breakthroughs, Agents & Tools | QUASA","Artificial Intelligence, ai, ml, machine learning, chatgpt, future","2024-09-22T08:08:27.000000Z","2026-04-22T14:56:34.000000Z",[96,100,111,123,136],{"title":72,"description":73,"slug":77,"created_at":78,"publish_at":79,"formatted_created_at":80,"category":97,"links":98,"view_type":86,"video_url":87,"views":69,"likes":88,"lang":89,"comments_count":88,"is_pinned":99},{"title":47,"slug":48},{"image":82,"image_webp":83,"thumb":84,"thumb_webp":85},false,{"title":101,"description":102,"slug":103,"created_at":104,"publish_at":104,"formatted_created_at":80,"category":105,"links":106,"view_type":86,"video_url":87,"views":26,"likes":88,"lang":89,"comments_count":88,"is_pinned":99},"SpAItial AI Echo-2: The Free “World Generator” That Turns One Image Into an Interactive 3D Reality","If you tried the original Echo on the waitlist and thought “cool, but not quite there,” Echo-2 is the version that crosses the threshold from demo to daily tool.","spaitial-ai-echo-2-the-free-world-generator-that-turns-one-image-into-an-interactive-3d-reality","2026-05-09T10:37:48.000000Z",{"title":43,"slug":44},{"image":107,"image_webp":108,"thumb":109,"thumb_webp":110},"https://cdn.quasa.io/images/news/D0LD11AvxGr9DP9FqRz5Dz5ZvzgOFwWkEIaYK46f.jpg","https://cdn.quasa.io/images/news/D0LD11AvxGr9DP9FqRz5Dz5ZvzgOFwWkEIaYK46f.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/D0LD11AvxGr9DP9FqRz5Dz5ZvzgOFwWkEIaYK46f.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/D0LD11AvxGr9DP9FqRz5Dz5ZvzgOFwWkEIaYK46f.webp",{"title":112,"description":113,"slug":114,"created_at":115,"publish_at":116,"formatted_created_at":80,"category":117,"links":118,"view_type":86,"video_url":87,"views":42,"likes":88,"lang":89,"comments_count":88,"is_pinned":99},"Trump’s AI Push Collides with Rural America: Data Centers Become a Political Headache Ahead of the Midterms","The Trump administration’s aggressive drive to build America’s AI future is running straight into a wall of resistance from the very voters who put him back in the White House.","trump-s-ai-push-collides-with-rural-america-data-centers-become-a-political-headache-ahead-of-the-midterms","2026-05-04T18:38:11.000000Z","2026-05-09T09:29:00.000000Z",{"title":43,"slug":44},{"image":119,"image_webp":120,"thumb":121,"thumb_webp":122},"https://cdn.quasa.io/images/news/giy342UlhE4Sr8viadfwWc2486qNzlG6rkfybdGD.jpg","https://cdn.quasa.io/images/news/giy342UlhE4Sr8viadfwWc2486qNzlG6rkfybdGD.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/giy342UlhE4Sr8viadfwWc2486qNzlG6rkfybdGD.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/giy342UlhE4Sr8viadfwWc2486qNzlG6rkfybdGD.webp",{"title":124,"description":125,"slug":126,"created_at":127,"publish_at":128,"formatted_created_at":80,"category":129,"links":130,"view_type":86,"video_url":87,"views":135,"likes":88,"lang":89,"comments_count":88,"is_pinned":99},"Flipbook: The AI-Powered “Visual Browser” That Turns the Entire Internet into Generated Images","Flipbook is still a prototype, explicitly labeled as experimental. The team openly acknowledges current limitations: occasional hallucinations, imperfect text rendering, and the fact that it’s not yet ready for complex actions like filling forms or persistent data storage.","flipbook-the-ai-powered-visual-browser-that-turns-the-entire-internet-into-generated-images","2026-05-04T18:26:01.000000Z","2026-05-09T06:21:00.000000Z",{"title":43,"slug":44},{"image":131,"image_webp":132,"thumb":133,"thumb_webp":134},"https://cdn.quasa.io/images/news/MfD2V3FmKzGbuergUxju5JMECg6CoM7crmrjsUkj.jpg","https://cdn.quasa.io/images/news/MfD2V3FmKzGbuergUxju5JMECg6CoM7crmrjsUkj.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/MfD2V3FmKzGbuergUxju5JMECg6CoM7crmrjsUkj.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/MfD2V3FmKzGbuergUxju5JMECg6CoM7crmrjsUkj.webp",45,{"title":137,"description":138,"slug":139,"created_at":140,"publish_at":141,"formatted_created_at":80,"category":142,"links":143,"view_type":86,"video_url":87,"views":148,"likes":88,"lang":89,"comments_count":88,"is_pinned":99},"Switzerland Signals Shift from Microsoft: A Long-Term Push for Open-Source Independence Amid Lingering Dependencies","The Federal Chancellery of Switzerland has announced plans to gradually reduce the federal administration’s heavy reliance on Microsoft products and explore a transition to open-source alternatives.","switzerland-signals-shift-from-microsoft-a-long-term-push-for-open-source-independence-amid-lingering-dependencies","2026-05-04T18:15:35.000000Z","2026-05-09T03:06:00.000000Z",{"title":58,"slug":63},{"image":144,"image_webp":145,"thumb":146,"thumb_webp":147},"https://cdn.quasa.io/images/news/pofAud4JbTXcALcl77aWcAbWhvQH0j7Jjxn3TvCU.jpg","https://cdn.quasa.io/images/news/pofAud4JbTXcALcl77aWcAbWhvQH0j7Jjxn3TvCU.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/pofAud4JbTXcALcl77aWcAbWhvQH0j7Jjxn3TvCU.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/pofAud4JbTXcALcl77aWcAbWhvQH0j7Jjxn3TvCU.webp",63,[150,163,179,191,206],{"title":151,"description":152,"slug":153,"created_at":154,"publish_at":155,"formatted_created_at":156,"category":157,"links":158,"view_type":86,"video_url":87,"views":161,"likes":162,"lang":89,"comments_count":88,"is_pinned":99},"The Anatomy of an Entrepreneur","Entrepreneur is a French word that means an enterpriser. Enterprisers are people who undertake a business or enterprise with the chance of earning profits or suffering from loss.","the-anatomy-of-an-entrepreneur","2021-08-04T15:18:21.000000Z","2025-12-14T06:09:00.000000Z","14.12.2025",{"title":65,"slug":66},{"image":159,"image_webp":87,"thumb":160,"thumb_webp":160},"https://cdn.quasa.io/images/news/mVsXPTMuHZuI7UXCsENgL1Qwp1uSOf7Rz3uVPMfm.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/mVsXPTMuHZuI7UXCsENgL1Qwp1uSOf7Rz3uVPMfm.webp",73420,2,{"title":164,"description":165,"slug":166,"created_at":167,"publish_at":168,"formatted_created_at":169,"category":170,"links":171,"view_type":176,"video_url":87,"views":177,"likes":178,"lang":89,"comments_count":88,"is_pinned":99},"Advertising on QUASA","QUASA MEDIA is read by more than 400 thousand people a month. We offer to place your article, add a link or order the writing of an article for publication.","advertising-on-quasa","2022-07-06T07:33:02.000000Z","2025-12-15T17:33:02.000000Z","15.12.2025",{"title":58,"slug":63},{"image":172,"image_webp":173,"thumb":174,"thumb_webp":175},"https://cdn.quasa.io/images/news/45SvmdsTQbiyc3nxgbyHY1mpVbisYyub2BCHjqBL.jpg","https://cdn.quasa.io/images/news/45SvmdsTQbiyc3nxgbyHY1mpVbisYyub2BCHjqBL.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/45SvmdsTQbiyc3nxgbyHY1mpVbisYyub2BCHjqBL.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/45SvmdsTQbiyc3nxgbyHY1mpVbisYyub2BCHjqBL.webp","large",73221,4,{"title":180,"description":181,"slug":182,"created_at":183,"publish_at":184,"formatted_created_at":185,"category":186,"links":187,"view_type":86,"video_url":87,"views":190,"likes":178,"lang":89,"comments_count":88,"is_pinned":99},"What is a Startup?","A startup is not a new company, not a tech company, nor a new tech company. You can be a new tech company, if your goal is not to grow high and fast; then, you are not a startup. ","what-is-a-startup","2021-08-04T12:05:17.000000Z","2025-12-17T13:02:00.000000Z","17.12.2025",{"title":65,"slug":66},{"image":188,"image_webp":87,"thumb":189,"thumb_webp":189},"https://cdn.quasa.io/images/news/EOsQhSW3VXyG7a6NPdE1oZd00xfJXe3bjY5aJGb7.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/EOsQhSW3VXyG7a6NPdE1oZd00xfJXe3bjY5aJGb7.webp",70756,{"title":192,"description":193,"slug":194,"created_at":195,"publish_at":196,"formatted_created_at":197,"category":198,"links":199,"view_type":86,"video_url":87,"views":204,"likes":162,"lang":89,"comments_count":205,"is_pinned":99},"Top 5 Tips to Make More Money as a Content Creator","Content creators are one of the most desired job titles right now. Who wouldn’t want to earn a living online?","top-5-tips-to-make-more-money-as-a-content-creator","2022-01-17T17:31:51.000000Z","2026-01-17T11:30:00.000000Z","17.01.2026",{"title":19,"slug":20},{"image":200,"image_webp":201,"thumb":202,"thumb_webp":203},"https://cdn.quasa.io/images/news/gP8kiumBPpJmQv6SMieXiX1tDetx43VwFfO1P4Ca.jpg","https://cdn.quasa.io/images/news/gP8kiumBPpJmQv6SMieXiX1tDetx43VwFfO1P4Ca.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/gP8kiumBPpJmQv6SMieXiX1tDetx43VwFfO1P4Ca.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/gP8kiumBPpJmQv6SMieXiX1tDetx43VwFfO1P4Ca.webp",44558,1,{"title":207,"description":208,"slug":209,"created_at":210,"publish_at":211,"formatted_created_at":212,"category":213,"links":214,"view_type":176,"video_url":87,"views":219,"likes":162,"lang":89,"comments_count":88,"is_pinned":99},"8 Logo Design Tips for Small Businesses","Your logo tells the story of your business and the values you stand for.","8-logo-design-tips-for-small-businesses","2021-12-04T21:59:52.000000Z","2025-05-05T03:30:00.000000Z","05.05.2025",{"title":15,"slug":16},{"image":215,"image_webp":216,"thumb":217,"thumb_webp":218},"https://cdn.quasa.io/images/news/Wbx2NtS1CnTupgoQbpFMGspJ5jm4uob2hDOq33r0.jpg","https://cdn.quasa.io/images/news/Wbx2NtS1CnTupgoQbpFMGspJ5jm4uob2hDOq33r0.webp","https://cdn.quasa.io/thumbs/news-thumb/images/news/Wbx2NtS1CnTupgoQbpFMGspJ5jm4uob2hDOq33r0.jpg","https://cdn.quasa.io/thumbs/news-thumb/images/news/Wbx2NtS1CnTupgoQbpFMGspJ5jm4uob2hDOq33r0.webp",43507,[221,222,223,224,225,226,227,228,229,230,231,232,233],{"title":23,"slug":24},{"title":47,"slug":48},{"title":55,"slug":56},{"title":43,"slug":44},{"title":51,"slug":52},{"title":31,"slug":32},{"title":35,"slug":36},{"title":27,"slug":28},{"title":19,"slug":20},{"title":15,"slug":16},{"title":58,"slug":63},{"title":11,"slug":12},{"title":65,"slug":66}]