Niraj Zade
Sr. Data Engineer | Architect | Consultant
~ whoever owns storage, owns computing ~
About
I build centralized data lakehouses for companies by building data ingestion pipelines and designing the distributed processing platforms & infra around them. While engineering for extreme levels of fault tolerance.
Without breaking the bank.
If you have data coming in at scale, and having trouble with it - contact me.
I've spent over a decade solving problems via software, 4.5+ years of it within tech companies, including Coditas, Konverge.ai, DecisivEdge, and stealth startups here and there. I'm a very high-agency person and operate like a manager of one.
Tech stack: Spark, Databricks, Azure, AWS, FastAPI, Python, SQL, Linux, Docker etc
I typically work across stacks. Your existing tech choices won't be a barrier at all.
Contact
- Email (preferred)
- niraj[at]theniraj[dot]com
- linkedin.com/in/nirajzade/
- Coffee
- If you know me via a mutual friend, whatsapp me. We can simply meet over a nice cup of coffee in Pune.
Blog
- Brain itch - If Python's for-loop is slow, and list-comprehension is fast - then by how much?
- Code is communication - more for humans, less for computers
- My subconscious doesn't like LLMs
- Computers understanding humans makes codebases irrelevant
- Own your email's domain
- Isolates + storage over http + orchestrators is the future that has arrived
Articles
| created | category | title | length |
|---|---|---|---|
| api |
HTTP API design handbook
API design guidelines
|
3 pages 4 mins |
|
| data engineering |
The Spark Field Manual
An engineer-focused field manual on Spark internals for new data engineers and seasoned experts who need a refresher.
|
23 pages 37 mins |
|
| python |
Unicode string normalization schemes in Python
Universally applicable string comparison in python. For string comparisons, and for de-duplication in datasets.
|
5 pages 7 mins |
|
| resources |
Bookmarks
A centralized collection of papers, talks, lectures around computer science, engineering, and the overall industry
|
5 pages 8 mins |
|
| resources |
PVLDB - links only
A convenient centralized list of all PVLDB papers till date
|
162 pages 4 hrs 25 mins |
|
| resources |
PVLDB - links with abstracts (large document)
A convenient centralized list of all PVLDB papers till date, and their abstract
|
3377 pages 92 hrs 14 mins |
|
| work |
Lecture - You and your research by Dr. Richard Hamming
The lecture by Richard Hamming
|
49 pages 1 hr 18 mins |
|
| 7 rows · last processed on 2026-10-18 | |||