Lewis Tunstall: Hugging Face, SetFit and Reinforcement Learning | Learning from Machine Learning #6

This episode features Lewis Tunstall, machine learning engineer at Hugging Face and author of the best selling book Natural Language Processing with Transformers. He currently focuses on one of the hottest topic in NLP right now reinforcement learning from human feedback (RLHF). Lewis holds a PhD in quantum physics and his research has taken him around the world and into some of the most impactful projects including the Large Hadron Collider, the world's largest and most powerful particle accelerator. Lewis shares his unique story from Quantum Physicist to Data Scientist to Machine Learning Engineer. Resources to learn more about Lewis Tunstall https://www.linkedin.com/in/lewis-tunstall/ https://github.com/lewtun References from the Episode https://www.fast.ai/ https://jeremy.fast.ai/ SetFit - https://arxiv.org/abs/2209.11055 Proximal Policy Optimization InstructGPT RAFT Benchmark Bidirectional Language Models are Also Few-Shot Learners Nils Reimers - Sentence Transformers Jay Alammar - Illustrated Transformer Annotated Transformer Moshe Wasserblat, Intel, NLP, Research Manager Leandro von Werra, Co-Author of NLP with Transformers, Hugging Face Researcher LLMSys - https://lmsys.org/ LoRA - Low-Rank Adaptation of Large Language Models Resources to learn more about Learning from Machine Learning https://www.linkedin.com/company/learning-from-machine-learning https://mindfulmachines.substack.com/ https://www.linkedin.com/in/sethplevine/ https://medium.com/@levine.seth.p