Episode 31 · · 13:08
Many, many signs of life for preference fine-tuning beyond spoofing chat evaluation tools.This is AI generated audio with Python and 11Labs.Source code: https://github.com/natolamber...
Episode 30 · · 09:46
Models that seem totally out of scope from recent open LLMs give us a sneak peek of where the industry will be in 6 to 18 months.This is AI generated audio with Python and 11Labs.Sou...
Episode 29 · · 10:38
Certain definitions of AGI are backing people into a pseudo-religious corner.This is AI generated audio with Python and 11Labs.Source code: https://github.com/natolambert/interconnec...
Episode 28 · · 15:05
Meta shows that scaling won't be a limit for open LLM players in the near future.This is AI generated audio with Python and 11Labs.Source code: https://github.com/natolambert/interco...
Episode 27 · · 07:32
Integrating some non computing science into reinforcement learning from human feedback can give us the models we want.This is AI generated audio with Python and 11Labs.Source code: h...
Episode 26 · · 06:45
Modeling the compute versus performance tradeoff of many open LLMs.This is AI generated audio with Python and 11Labs.Source code: https://github.com/natolambert/interconnects-toolsOr...
Episode 25 · · 08:57
Last minute title change from: The tech industry can't agree on what open-source AI means. That's the process.How to read what multiple people mean by the word openness and see throu...
Episode 24 · · 16:33
Databricks' new model is surpassing the performance of Mixtral and Llama 2 while still being in a size category that's reasonably accessible.This is AI generated audio with Python an...
Episode 23 · · 12:40
Evaluation is not only getting harder with modern LLMs, it's getting harder because it means something different.This is AI generated audio with Python and 11Labs. Music generated by...
Episode 22 · · 10:56
Where moats are tested now that so many people have trained GPT4 class models. Claude 3, Gemini 1.5, Inflection 2.5, and Mistral Large are here to party.This is AI generated audio wi...
Episode 21 · · 23:06
A proposal for a new definition of an "open source" LLM and why no definition will ever just work.This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGe...
Episode 20 · · 01:26:28
Louis recently has been founding a new startup focused on synthetic data for alignment, Synth Labs, and is a researcher at Eleuether AI. This interview should speak for itself, and i...
Episode 19 · · 10:46
Basic tips on how to assess inbound ML content and cultivate your news feed.This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source code: https:/...
Episode 18 · · 17:17
Google rejoins the open model party and gets some backlash for a frequent problem for generative AI.This is AI generated audio with Python and 11Labs. Music generated by Meta's Music...
Episode 17 · · 14:58
10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and moreThis is AI generated audio with Python and 11Labs. Music generated by Meta...
Episode 16 · · 09:07
Emergency blog! Three things you need to know from the ML world that arrived yesterday.This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source co...
Episode 15 · · 07:44
In an era dominated by direct preference optimization and LLMasajudge, why do we still need a model to output only a scalar reward?This is AI generated audio with Python and 11Labs. ...
Episode 14 · · 10:19
Scale's making over $750 million per year selling data for RLHF, who's coming to take it?This is AI generated audio with Python and 11Labs. Music generated by Meta's MusicGen.Source ...
Episode 13 · · 09:28
A small model at the beginning of big changes.This is AI generated audio with Python and 11LabsSource code: https://github.com/natolambert/interconnects-toolsOriginal post: https://w...
Episode 12 · · 19:05
Note: some of the audio in the second half is a little wonky, but the general voice was upgraded so hopefully it's a little less "poppy" until then!I'm trying to fix little pronuncia...
Episode 11 · · 09:59
Local LLMs: the latency solution, Meta's open AGI, personalization myth, and moats X factorThe deployment path that'll break through in 2024. Plus, checking in on strategies across B...
Episode 10 · · 08:18
A fun demo on how generative AI can transform content creation, and tools for my fellow writers on Substack!This is AI generated audio with Python and 11LabsSource code: https://gith...
Episode 9 · · 15:59
A sampling of recent happenings in the multimodal space. Be sure to expect more this year.This is AI generated audio with Python and 11LabsSource code: https://github.com/natolambert...
Episode 8 · · 13:41
And why the comparisons don't really matter. Repeated patterns in the race for reproducing ChatGPT, another year of evaluation crises, and people who will take awesome news too far.T...
Episode 7 · · 09:57
The state of the ML communities big and small starting 2024. My general expectations for the year.This is AI generated audio with Python and 11LabsSource code: https://github.com/nat...
Episode 6 · · 14:45
The core themes of ML and the blog this year. What changes in 2024.This is AI generated audio with Python and 11Labs. Source code can be found here: https://github.com/natolambert/in...
Episode 5 · · 35:47
Michael Poli is a PhD student at Stanford and a researcher at Together AI. https://zymrael.github.io/Tri Dao is the Chief Scientist at Together AI and an incoming assistant professor...
Episode 4 · · 10:31
Big Tech's LLM evals are just marketingA PSA everyone needs. The importance of a wait and see attitude when it comes to new models, big and small, open and closed.Read the post here:...
Episode 3 · · 16:46
(some buggy audio in this one, from MoE rather than Mixtral lol)Mixtral: The best open model, MoE trade-offs, release lessons, Mistral raises $400mil, Google's loss, vibes vs marketi...
Episode 2 · · 17:27
Direct vs. RL methods for preferences, more RLHF models, and hard truths in open RLHF work. We have more questions than answers.Read the full post here.
