And yes, there is a better way …. — If you are a data-driven company, then you are probably familiar with CDPs. This is because, in recent years, third-party Customer Data Platforms (or “CDPs”) have become a popular way to centralize and activate customer data. Alongside it, we have also seen the widespread adoption of data warehouses like Snowflake…

Using dynamically generated DAGs for scaling airflow — If you’ve been on the hunt for a workflow management platform, my guess is you’ve come across Apache Airflow already. Originally hailing from the corner of Airbnb, this widely used project is now under the Apache banner and is the tool of choice for many data teams. …

Hold your pitchforks and hear me out first… — Just reading the title of this article might have gotten your blood boiling but hold on to your pitchforks for a second and hear me out. A well-placed comment can be immensely useful but nothing clutters code more than frivolous comments. In some situations, I would venture far enough to…

Yes, yes, it does — In my never-ending quest to find harmony between speed of doing things (development speed) and speed of the thing (performance), I came across a project in its incubation phases which had me thinking: “This could be the one language for me.” It was infatuation at first sight with Crystal, a…

How to make Rails scale to millions of requests per minute. — Ruby on Rails is a tremendous framework when you want high development velocity for your project or startup. It’s useful right out of the box and comes with a plethora of behind-the-scenes magic to make your life easier. However, it’s not considered the fastest framework out there in terms of…