Skip to content
Episode from the podcast Programming Throwdown
172: Transformers and Large Language Models artwork

Episode

172: Transformers and Large Language Models

Released Monday, March 11th 2024 1 hr 26 min

Show notes

About this episode

Patrick and Jason explain transformers and large language models from the ground up. They cover attention, encoders and decoders, self-supervised learning, RLHF, and the key architectural ideas that made modern LLMs possible.

More from Programming Throwdown

All episodes

187: Agentic Coding

1 hr 38 min

In this episode, Patrick and Jason cover Agentic Coding!

186: Becoming a Manager

1 hr 27 min

Patrick and Jason discuss what it means to become a manager and how the role differs from individual engineering work. They cover hiring, coaching, performance management, team goals, and when moving into management is or is not the right choice.

185: Workflow Orchestrators

1 hr 32 min

Patrick and Jason break down workflow orchestrators and why they matter for batch jobs, long-running tasks, and resumable distributed systems. They compare tools such as Airflow, Dagster, Temporal, Ray, and Kubeflow while explaining the infrastructure patterns behind them.

This podcast, its content and its artwork are not owned by, affiliated with, or endorsed by Castquire.

Up next

  1. Nothing queued. Use + Queue on any episode to line it up.

0:00 0:00