Niraj Zade
Senior Data Engineer | Software Engineer
Niraj Zade
Senior Data Engineer | Software Engineer
I help companies build centralized data lakehouses, by gathering data from disparate sources (APIs, databases etc), to enable AI, Data Science & Data Driven Business Decisions.
All this without breaking the bank.
Tech I most frequently work with: Spark, FastAPI, Python, SQL, Azure (and also AWS), Airflow, Docker
I simply enjoy computers. A LOT. Way too much actually.
If computing wasn't a career - I'd be doing some other job in the day, and be glued to computers at the night.
Haven't found any other line of work that's so (frustratingly) loveable. I'm glad that the world has a path to turn software engineering into a career.
(Most of these are ever evolving pieces)
Spark Microbook
2025 Oct 16 | 26min (4,801 words)
Spark performance optimization compendium
2025 Oct 11 | 4min (887 words)
Spark join strategies
2024 Jan 22 | 13min (2,450 words)
Unicode string normalization schemes in Python
2024 May 06 | 7min (1,303 words)
Python gotchas compilation
2023 Sep 17 | 5min (1,058 words)
Lecture - You and your research by Dr. Richard Hamming
2024 Oct 14 | 1hr 18min (14,441 words)
Why charge more as an engineer
2025 Oct 13 | 6min (1,253 words)
Catalyzing research within India
2025 Aug 25 | 1min (239 words)
Links collection
2025 Jun 15 | 3min (586 words)
Papers, books, talks etc
2025 Jun 02 | 3min (710 words)
JWT - a quick overview of its working and encryption algorithms
2024 Apr 02 | 12min (2,321 words)
Isolates+storage over http+orchestrators is the future that has arrived
2023 Jan 03 | 5min (1,026 words)
My subconscious doesn't like LLMs
2025 Jul 16 | 10min (1,969 words)
Why interpreted languages make superior scripting languages
2023 Jan 03 | 1min (287 words)
Own your email's domain
2023 Feb 12 | 5min (934 words)
Computers understanding humans makes codebases irrelevant
2023 Apr 08 | 6min (1,267 words)
Engineering tools:
Other tools: