Today's clip is from Episode 151 of the podcast, with Jonas Arruda
In this conversation, Jonas Arruda explains how diffusion models generate data by learning to reverse a noise process. The idea is to start from a simple distribution like Gaussian noise and gradually remove noise until the target distribution emerges. This is done through a forward process that adds noise to clean parameters and a backward process that learns how to undo that corruption. A noise schedule controls how much noise is added or removed at each step, guiding the transformation from pure randomness back to meaningful structure.
Get the full discussion here
• Join this channel to get access to perks:
https://www.patreon.com/c/learnbayesstats
• Intro to Bayes Course (first 2 lessons free): https://topmate.io/alex_andorra/503302
• Advanced Regression Course (first 2 lessons free): https://topmate.io/alex_andorra/1011122
Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !
Today's clip is from Episode 168 of Learning Bayesian Statistics, featuring Santiago Barreda, who joins host Alex Andorra to discuss Bayesian multilevel models and their applications in speech perception and linguistics.
Santiago explains how tools like BRMS have made Bayesian modelling much more accessible, lowering the barrier to entry for researchers working in linguistics and speech perception. He also addresses some common concerns around Bayesian methods, particularly the choice of priors, arguing that these concerns are often overstated and that their influence can be examined directly.
He highlights the value of multilevel models in understanding listener variation within speech communities, as well as their flexibility in handling outliers, heteroscedasticity, ordinal data and multinomial data. Alex adds to the discussion by sharing a practical example of fitting mixed-effects models using PyMC, including how different prior choices can affect the results.
Full discussion here
Support & Resources
→ Support the show on Patreon
→ Bayesian Modeling Course (first 2 lessons free):
Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!
Support & Resources
→ Support the show on Patreon
→ Bayesian Modeling Course (first 2 lessons free)
Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!
Takeaways:
Q: Why would a linguist switch from lme4 to Bayesian multilevel models?
A: For Santiago, it was purely practical. Mixed-effects models fit with lme4 kept failing to converge, and they couldn't handle the complex repeated-measures structures his experiments needed. His friend Noah Silbert got him into Bayesian modeling around 2015, and only afterwards did he realize he agreed with the philosophy too. His analogy: the frequentist toolbox is a furniture store, and if it doesn't sell the bed you need, you settle for the nearest one; Bayesian modeling teaches you carpentry, so the model can match what you believe is going on in your data instead of squeezing the data into a standard structure.
Q: Why teach Bayesian multilevel models before t-tests and ANOVA?
A: Because in linguistics essentially all data are repeated measures: listeners judge hundreds of trials, and speakers produce many tokens. Yet students traditionally spend a year or more on one-sample t-tests, paired t-tests and ANOVAs they will never use in their own research. Santiago's book jumps straight to the multilevel version of the simplest case, a one-group model with many observations per listener, which he finds no harder to grasp than a t-test since there are no reference distributions or degrees of freedom to explain.
Q: Do Bayesian and frequentist analyses give different results on typical phonetics data?
A: With analogous models, largely no, at least with the amount of data phonetics experiments usually have. That's why the early chapters of Santiago's book end with a comparison to the equivalent frequentist analysis, to reassure readers. His rule of thumb: if you get dramatically different results, something has probably gone wrong. The gain from going Bayesian is not different p...
This one is a bonus episode, where I was the guest, on a podcast called One Thing That Worked! Get all the insights and takeaways here. In the meantime, here is how they described it:
In this insightful episode of One Thing That Worked, my guest is Alex Andorra, host of Learning Bayesian Statistics Podcast. Alex reveals how he built a top-tier show that ranks among the top 1.5% of podcasts globally out of nearly 4 million shows.
Discover how Alex leveraged "The Selfish Method"—creating the exact show he needed for his own career growth—to attract a hyper-dedicated audience of technical experts. We explore his core podcast growth strategy, focusing on a specialized niche and publishing biweekly episodes like clockwork since 2019.
Alex also opens up about podcast revenue, handling podcast sponsors, and funding operations via Patreon while keeping the content independent. In this conversation, we break down the power of relentless consistency, the value of solving your own problems, and why learning through public failure is a superpower for creators looking to master podcasting and build an engaged community.
Chapters
0:00 - Intro
01:25 - About Learning Bayesian Statistics Podcast
05:35 - What Bayesian Statistics Is
08:44 - The Main Thing That Worked
11:03 - Building Network & Community
13:23 - Monetizing The Show
16:17 - Main Lessons from Alex
Hope you like it, my dear Bayesians! As usual, you can support the show on Patreon, and reach out to me with fun ideas 🖖
Today’s clip is from Episode 167 of Learning Bayesian Statistics, featuring Paul-Christian Bürkner and Steve Bronder, recorded live at StanCon 2026 in Uppsala, Sweden.
Paul Bürkner, creator of brms and a leading researcher behind BayesFlow, explains how neural networks can replace MCMC for Bayesian inference. Instead of evaluating likelihood and prior densities, the networks are trained on simulated data, so you can do simulation-based inference (SBI) even when the likelihood is intractable. Once trained, they give you amortized, real-time posteriors for new datasets, and they have made SBI scalable well beyond what approximate Bayesian computation could handle.
Paul is also candid about the limits. Neural methods come with unstable training and no guarantees, and they can be unreliable on out-of-distribution or misspecified data, which is why MCMC is still the more trustworthy option wherever you can apply it. He ends with how his group is building diagnostics to flag when a neural posterior can’t be trusted.
Full discussion here
Support & Resources
→ Support the show on Patreon
→ Bayesian Modeling Course (first 2 lessons free):
Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!
Support & Resources
→ Support the show on Patreon
→ Bayesian Modeling Course (first 2 lessons free)
Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!
Takeaways:
Q: What is amortized Bayesian inference and how does it differ from MCMC?
Instead of running MCMC on each dataset, you train neural networks on data simulated from the model, so you don't need likelihood or prior densities. Once training is done, inference on a new dataset is essentially instant: new data in, posterior out. The price is everything neural networks bring with them, from unstable training to a lack of guarantees. Paul's stated goal is to make these methods as reliable and robust as MCMC while staying orders of magnitude faster, and he's candid that he doesn't know whether the field will ever get there.
Q: Why would a Bayesian model not have a usable likelihood?
A: Usually not because the likelihood can't be written down in principle, but because computing it is so expensive or numerically unstable that it's intractable in practice. Paul gives two cases. First, mechanistic models built on complicated differential equations, as in physical chemistry or biology, where you can't solve through the equations to get densities and gradients in a stable, fast way. Second, big latent variable models with thousands of latent variables between the parameters and the data, where marginalizing them out is hopeless. In both cases, simulating from the model is easy: simulate the parameters, the latents and the data, throw the latents away, and learn the relation between parameters and data from the simulations.
Full takeaways here!
Chapters:
15:33 What is amortized Bayesian inference and when should you use it instead of MCMC?
23:18 Why would a Bayesian model not have a usable likelihood?
26:03 What's holding back GPU computing in Stan?
31:14 What are sum-to-zero constraints and why do they make models sample faster?
35:55 What is a Jacobian adjus...
This podcast, its content and its artwork are not owned by, affiliated with, or endorsed by Castquire.