Niraj Zade

About

I build centralized data lakeshouses for companies - data ingestion pipelines, distributed processing platforms, and the infra around them. While engineering for extreme levels of fault tolerance.
Without breaking the bank.

If you have data coming in at scale, and having trouble with it - contact me.

I've spent over a decade solving problems via software, 4.5+ years of it within tech companies, including Coditas, Konverge.ai, DecisivEdge, and stealth startups here and there. I'm a very high-agency person and operate like a manager of one.

Tech stack: Spark, Databricks, Azure, AWS, FastAPI, Python, SQL, Linux, Docker etc
I typically work across stacks. Your existing tech choices won't be a barrier at all.

Contact

Email (preferred): niraj[at]theniraj[dot]com
LinkedIn: linkedin.com/in/nirajzade/
Coffee: If you know me via a mutual friend, whatsapp me. We can simply meet over a nice cup of coffee in Pune.

Blog

2026-09-18 Brain itch - If Python's for-loop is slow, and list-comprehension is fast - then by how much?
2025-07-16 My subconscious doesn't like LLMs
2023-04-08 Computers understanding humans makes codebases irrelevant
2023-02-12 Own your email's domain
2023-01-03 Isolates + storage over http + orchestrators is the future that has arrived

Articles

created	category	title	length
2026-10-18	api	HTTP API design handbook API design guidelines #spark #bigdata	3 pages 4 mins
2025-10-16	data engineering	The Spark Field Manual An engineer-focused field manual on Spark internals for new data engineers and seasoned experts who need a refresher. #spark #bigdata	23 pages 37 mins
2024-05-06	python	Unicode string normalization schemes in Python Universally applicable string comparison in python. For string comparisons, and for de-duplication in datasets. #python	5 pages 7 mins
2025-06-02	resources	Bookmarks A centralized collection of papers, talks, lectures around computer science, engineering, and the overall industry #resources	4 pages 5 mins
2026-09-10	resources	PVLDB - links only A convenient centralized list of all PVLDB papers till date #resources	162 pages 4 hrs 25 mins
2026-09-10	resources	PVLDB - links with abstracts (large document) A convenient centralized list of all PVLDB papers till date, and their abstract #resources	3377 pages 92 hrs 14 mins
2024-10-14	work	Lecture - You and your research by Dr. Richard Hamming The lecture by Richard Hamming #advice	49 pages 1 hr 18 mins
7 rows · last processed on 2026-10-01

Tools

Day info