Ross Taylor
I am the CTO and co-founder of a new hard tech startup.
Previously I led the reasoning team at Meta AI, working on Llama 3 and Llama 2. I was also the research lead on the Galactica language model in 2022. Before language models, I co-founded the startup behind Papers with Code, which was acquired by Meta in 2019. Before that I worked on several things, including as a quant building models for football, an open source developer building time series libraries for Python, a policy advisor at HM Treasury, and a web developer in my early teens.
I grew up in Ipswich, UK and have lived in London since 2013. I studied at Warwick and Cambridge.
Research
Interviews and Talks
- The Hitchhiker's Guide to Reasoning - November 2024
- Interconnects with Nathan Lambert - August 2024
- Teaching LLMs to Reason - July 2023
Posts
- Notes on the Membrane - 9 December 2024
- QK Norm and the Curious Case of Logit Drift - 3 October 2024
- Synthetic Data: Escaping the Ouroboros - 21 April 2023