An ever evolving list of links. This page will keep getting cleaned, organized, appended, disorganized.
If something becomes inaccessible/unavailable, use the Internet Archive's Wayback Machine
People
- Database Doctor - Thomas Kejser
- I like this guy. Dude is neuro-atypical (autistic, but in a good way) with a focus on databases. So you know his stuff is going to be good.
- philippdubach.com - Quantitative Finance, AI & Technology
- https://justinjaffray.com/posts/ Justin Jaffray - datadog guy
- ben-evans.com - Benedict Evans
- wippler.dev/posts/
- meltingasphalt.com/archive/ by Kevin Simler -
- leopard.in.ua/ - Alexey Vasiliev (Postgres stuff)
- matthewstrom.com/writing - Matthew Ström - head of design stripe
- ludic.mataroa.blog/ - Australian guy writing some of the best ranty posts I've read on the internet
- sirupsen.com/ - Simon Horup Eskildsen
ajaydwivedi.com/ - sql server guy
eli.thegreenplace.net/archives/all - has covered almost all topics in cs. Recommended by Phil Eaton.
- one2n's stories - https://playbook.one2n.in/pragmatic-software-engineering-stories
- startdataengineering.com/post/ - around 1 post per month on data engineering
- practical, actionable posts. not just theoritical.
- manthanguptaa.in/manthan gupta - (3 articles on replication in distrisys articles)
- copyninja.in/ - has a nice blog
- jack-vanlightly.com/ Jack Vanlightly - Works on kafka
- justinjaffray.com/posts/ - Justin Jaffray - a database guy
- two-wrongs.com/A quant tech guy's blog. EXCELLENT articles.
- shekhargulati.com - Shekhar gulati - writes summaries of papers, blog posts etc
- rohanverma.net/archives/ - rohan verma (zerodha)
- starship-knowledge.com/- EXPERT KNOWLEDGE AT A GLANCE -
- notes.eatonphil.com/ - tigerbeetle guy
- vitalik.eth.limo/ - vitalik buterin (Ethereum)
- mitchellh.com/writing- mitchell hashimoto (hashicorp)
- davidgomes.com/ - David Gnomes - Director of Engineering at SingleStore
brooker.co.za/blog/ - Mark Brooker, AWS
- Alexey Guzey
- Gwern Branwen
Recommended reading
- 🌟 The Grug Brained Developer - A layman's guide to thinking like the self-aware smol brained
- Choose boring technology
Company engineering blogs
Podcasts
Notable blog posts
Infra
- Scaling Kubernetes to 7,500 nodes - OpenAI
- Imbue - From bare metal to a 70B model: infrastructure set-up and scripts
Software engineering
- Modal: Linear Programming for Fun and Profit - constraint-solver class of problems
- We really don't know how to compute - Gerald
Causality blog - the concurrency problem (series of articles)
Papers
- 1948 - A Mathematical Theory of Communication - Claude Shannon
- Paper - 1985 - Programming as theory building - Peter Naur
- Paper - 1986 - No Silver Bullet —Essence and Accident in Software Engineering - Frederick P. Brooks, Jr.
- Paper - 2007 - What Every Programmer Should Know About Memory
Talks
- ⭐ Talk - 2011 - Simple made easy - Rich Hickey
- ⭐ Talk - 2013 - Hammock Driven Development - Rich Hickey
- ⭐ Talk - 2016 - The Silver Bullet Syndrome by Hadi Hariri
- Talk - 2014 - The mess we are in - Joe Armstrong
- Talk - 2011 - We really don't know how to compute - Gerald
- 2017 - How I program C - Eskil Steenberg
Books
- ⭐ A Philosophy of Software Design by John Ousterhout
- Computer systems : a programmer's perspective by Randal E. Bryant and David R. O'Hallaron
- Structure and Interpretation of Computer Programs - Gerald Jay Sussman, Hal Abelson, and Julie Sussman
- Grokking Simplicity: Taming Complex Software with Functional Thinking (Simplify software using Functional Programming principles)
articles
Lecture - 2017 - How I program C - Eskil Steenberg
Architecture
- Talks
- 2025 - Architecting LARGE software projects - Eskil Steenberg
- 2024 - Failure is always an option - Dylan Beetle
API design
- Talk - 2021 - Correct by Construction: APIs That Are Easy to Use and Hard to Misuse - Matt Godbolt [ C++ on Sea ]
Human
Talks/videos
- Video - 2020 - Developing Open Source Software is a Political Act
- ⭐ Talk - 2012 - Inventing on Principle - Bret Victor
- ⭐ Interview - 2018 - Money as an Instrument of Change - Chamath Palihapitiya, Founder and CEO Social Capital
Blog posts
- 🌟How to drop out
- ⭐ Worse is better (Essay, 1989)
- ⭐Buried Talents - How elites betray their own potential by Edan Kroolewicz
- The Golden Handcuffs: Why Our Brightest Minds Retreat into “Pragmatic Emptiness” by Edan Kroolewicz
Papers
- Why do we do astrophysics? (gist- the output is the person, not the research output)
Career
- No, you don't want to hire "the best engineers"
- Salary Negotiation: Make More Money, Be More Valued by patio11
- Don't Call Yourself A Programmer, And Other Career Advice by patio11
Management
- Awesome engineering management - Github
- Modern Agile is Stupid: on why all great ideas are killed by simple-minded idiots, why Jira kills software, and how to be a good manager
- Statistical Process Control: A Practitioner’s Guide (2wrongs) (was as two-wrongs.com, now redirecting to entropicthoughts.com)
- Kelly criterion (2 wrongs) (was as two-wrongs.com, now redirecting to entropicthoughts.com)
- ⭐How to Give a Status Update To Executives - Jacob Kaplan-Moss (also has a lot of great articles in his blog)
Math
- ⭐Number theory explained from first principles by Kaspar Etter
Things
AI (not theory)
- Paper - 2018 - Ray: A Distributed Framework for Emerging AI Applications
- Article - 2020 - GPT3 and the scaling hypothesis - Gwern
- Article - 2019 - Complexity is not bar to AI - Gwern
- Article - 2022 - The Scaling Hypothesis
Data platforms
Data structures
- CRDT introduction (Excellent)
- B+Tree index structures in InnoDB by the living MySQL legend Jeremy Cole -
Distributed systems
- Murat Buffalo - Foundational distributed systems papers
- A distributed systems reliability glossary by Antithesis and Aphyr (Jespen)
Aws
- tools
- AWS EC2 single core benchmarks by runs-on.com
- Instances by Vantage - pricing of EC2 instances, RDS etc
Linux
Networking
- Papers
Security
- Talk - 2018 - Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? - James Mickens - USENIX Security
Web 3
- Talks
Python
Articles
Books
- Cosmic python - book for software architecture when using python
Websites
- pythonspeed.com - in depth python articles
- mathspp.com - deeper python
Data stores
- Lectures
- ⭐ 2018 - Dr. Michael Stonebraker - 10 fears about the future of dbms field
- Will help in thinking about the overall database meta.
- ⭐ 2018 - Dr. Michael Stonebraker - 10 fears about the future of dbms field
Papers
Articles
- ⭐Kafka's Broken Promise: There is No Goldilocks Log - Jason Gustafson, Almog Gavra
- Iceberg, The Right Idea - The Wrong Spec - Part 1 of 2: History
- What Does a Database for SSDs Look Like? - Marc Brooker
- The Log: What every software engineer should know about real-time data's unifying abstraction - Jay Kreps (THE blog post for kafka)
Books - [How Query Engines Work](https://www.howqueryengineswork.com/
Unclassified
- Lectures
- ⭐ 2018 - Dr. Michael Stonebraker - 10 fears about the future of dbms field
- Will help in thinking about the overall database meta.
- ⭐ 2018 - Dr. Michael Stonebraker - 10 fears about the future of dbms field
Papers
Articles
- ⭐Kafka's Broken Promise: There is No Goldilocks Log - Jason Gustafson, Almog Gavra
- What Does a Database for SSDs Look Like? - Marc Brooker
- The Log: What every software engineer should know about real-time data's unifying abstraction - Jay Kreps (THE blog post for kafka)
Books - [How Query Engines Work](https://www.howqueryengineswork.com/
Opendata
General theory
- Papers
- Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age
- Qd-tree: Learning Data Layouts for Big Data Analytics
- 2005 - “One Size Fits All”: An Idea Whose Time Has Come and Gone - Michael Stonebraker
- 2014 - Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age
- In practice leads to complexity and head of line blocking
- C-Store: A Column-oriented DBMS -
Bigtable
- Paper - 2006 - Bigtable: A Distributed Storage System for Structured Data
Databricks
- Photon: A Fast Query Engine for Lakehouse Systems - SIGMOD ACM (Berkeley url)
- Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores - VLDB
The Data Lakehouse: Data Warehousing and More - arxiv
DynamoDb
Paper - 2007 - Dynamo: Amazon’s Highly Available Key-value Store
- Paper -2022 - Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service - Usenix
MySQL
- Presentation - 2012 - Vitess: Scaling MySQL at YouTube Using Go
Postgres
- Talks
- Videos
- Tools
- Resources
Redshift
- Paper - 2024 - Intelligent Scaling in Amazon Redshift
ScaleDB
Snowflake
Automatic clustering at Snowflake
- Covers the greatest greatest magic of snowflake (In my opinion)
Paper - Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing - VLDB
Spanner
Blog posts
- My subconscious doesn't like LLMs 2025 Jul 16 | ~7 pages
- Computers understanding humans makes codebases irrelevant 2023 Apr 08 | ~5 pages
- Own your email's domain 2023 Feb 12 | ~4 pages
- Isolates + storage over http + orchestrators is the future that has arrived 2023 Jan 03 | ~4 pages
Articles
I learn through writing, so I write a lot. Most of these are ever evolving pieces.
DATA ENGINEERING
- The Spark Field Manual 2025 Oct 16 | ~23 pages
PYTHON
- Unicode string normalization schemes in Python 2024 May 06 | ~5 pages
RESOURCES
- Bookmarks 2025 Jun 02 | ~6 pages
WORK
- Lecture - You and your research by Dr. Richard Hamming 2024 Oct 14 | ~49 pages