AI researchers launch talkie, a 13B vintage language model trained on historical text with a 1930 cutoff, to see if it can replicate scientific breakthroughs (talkie)
AI researchers release Talkie, a 13B language model trained exclusively on pre-1930 text to test whether vintage training data can replicate historical scientific reasoning patterns.
Excerpt
<a href="https://talkie-lm.com/introducing-talkie"><img align="RIGHT" border="0" hspace="4" src="http://www.techmeme.com/260428/i16.jpg" vspace="4" /></a>
<p><a href="http://www.techmeme.com/260428/p16#a260428p16" title="Techmeme permalink"><img height="12" src="http://www.techmeme.com/img/pml.png" style="border: none; padding: 0; margin: 0;" width="11" /></a> <a href="https://talkie-lm.com/">talkie</a>:<br />
<span style="font-size: 1.3em;"><b><a href="https://talkie-lm.com/introducing-talkie">AI researchers launch talkie, a 13B vintage language model trained on historical text with a 1930 cutoff, to see if it can replicate scientific breakthroughs</a></b></span> — Why vintage language models? — Have you ever daydreamed about talking to someone from the past? What would you ask someone with no knowledge of the modern world?</p>
Read at source: http://www.techmeme.com/260428/p16#a260428p16