This is my last week at Goldsky as a full-time employee (I’ll still be involved as an advisor and part-time consultant).
I’m not looking for a job. Instead, I’ve decided to become a solopreneur. What does it mean?
For a while, I’ve been writing down ideas in the data infrastructure space. Things I wish existed. Things I’d like to build. Open-source projects I’d like to improve. And now, I’m going to dedicate most of my time to focusing on these ideas and trying to build a sustainable business.
In addition to that, I’m going to be working as a part-time consultant in the data streaming space. I’m not looking for projects right now, but feel free to reach out in the future!
What Ideas?
You might be wondering what exactly I have on my mind. Some people still call me a data engineer, but it’s been a while since I authored a data pipeline. At Goldsky, the team I led mostly focused on building a platform that allowed our users to author streaming data pipelines. However, I kept finding myself to be most interested and engaged when solving lower-level system and performance challenges (query processing, data formats, performance optimizations, instrumentation, etc. come to mind).
I became a big fan of Andy Pavlo and Andy Grove. I’ve been religiously studying the Advance Database Systems course by Andy Pavlo for the past few months. I read tons of papers. And I’ve realized that many techniques employed by modern databases are not always present in streaming systems. I see this as a huge opportunity. This is all I can share right now, but stay tuned!
More Writing
I also hope that focusing on these problems will allow me to write more, both in this blog and in my Data Streaming Journey newsletter. My writing will likely cover deeper levels of the stack, which I believe is a welcome change (do let me know otherwise).