I'm Niraj Zade,
Data Engineer

I help companies build up data platforms and pipelines on the cloud.

Email me :

“ Niraj is great contributor for the projects he has worked on. He is really good in structural way of solving and finding solution for any specific problem. He has well written codes which are very generic and well structured.
The level of capabilty he has shown in his tenture of 1,2 years is impeccable. He is aware of all technology trends in industry. I wish him all the best for future endeavours and he can contribute something great in field of Computer Science.
”

DecisivEdge Logo
Uttanka Hazarika Development Manager at DecisivEdge

 Blog

2023/12/04
Resilient linux setup via dual SSD
2023/11/18
Quick tip- Clearly communicate ranges in your functions' documentation using mathematical notations
2023/11/07
Proving the Monty Hall Problem, by simulating 1 million runs in python
2023/09/06
Why do we even use computers
2023/08/29
Good stupid questions
2023/07/31
You can hire knowledge
2023/04/08
Computers understanding humans kills the concept of codebases
2023/02/25
Personal computing hardware for linux in 2023
2023/02/12
Own your email's domain
2023/01/03
Why interpreted languages make superior scripting languages

 Library

Hosted on pySparkReference.com

databricks infra

→  Why do we need smaller executors, and why databricks can get away with one executor per node

meta

→  Single node spark notebook setup using docker

performance

→  Dealing with data skew using salting - work in progress

io

→  Loading data from files

reference

→  Dataframe api reference - work in progress

Hosted on Dataputing.com

python

→  Every python date and time formatter
→  Mathematical range notations of python functions
→  Why python needs virtual environments
→  Scope of variables in python

sql

→  How database engines interpret null data
→  Logical clause execution order
→  Window functions - inner behaviors and optimization

Tools

Infinite Pomodoro

🔗 Spark Memory Calculator - WORK IN PROGRESS - Get the max partition size your executors can handle

Investment Visualizer To see tommorow's money in today's value

Rough Income Sensemaker India Give annual earnings (INR), quickly get hourly rates (INR and USD)