Niraj Zade
Senior Data Engineer | Software Engineer
Niraj Zade
Senior Data Engineer | Software Engineer
I help companies build centralized data lakehouses, by gathering data from disparate sources (APIs, databases etc), to enable AI, Data Science & Data Driven Business Decisions.
All this without breaking the bank.
Tech I most frequently work with: Spark, FastAPI, Python, SQL, Azure (and also AWS), Airflow, Docker
I simply enjoy computers. A LOT. Way too much actually.
If computing wasn't a career - I'd be doing some other job in the day, and be glued to computers at the night.
Haven't found any other line of work that's so (frustratingly) loveable. I'm glad that the world has a path to turn software engineering into a career.
I learn through writing. Most of these are ever evolving pieces.
SqlServer reference - All date & time formatters
SqlServer time formatters, to use in convert() function. Used to convert date time objects into string of appropriate formats.
Contents:A collection of spark knowledge - AQE details, join strategies
Contents:Delta Lake - performance optimization and maintenance
Delta lake optmization and maintenance techniques
Contents:Spark performance optimization compendium
Speed up data reads from sql databases, joins, column generation
Contents:Spark join strategies
Contents:Unicode string normalization schemes in Python
Universally applicable string comparison in python. For string comparisons, and for de-duplication in datasets.
Contents:Variable scope leakage, global variable read-write issues
Contents:SSH tunneling templates, how to diagnose errors, quick fixes for usual errors
Contents:Lecture - You and your research by Dr. Richard Hamming
The lecture by Richard Hamming
Contents:Why charge more as an engineer
Why you should charge more as an engineer
Contents:Catalyzing research within India
Ongoing notes and opinions on creating an ecosystem for research within India
Contents:An ever evolving list of links. Will keep on getting cleaned, organized, appended, disorganized.
Contents:A centralized collection of papers, talks, lectures around computer science, engineering, and the overall industry
Contents:JWT - a quick overview of its working and encryption algorithms
A quick overview on the workings of JWT
Contents:Engineering tools:
Other tools: