Figured I could start executing on 2022 plans for the System Design Meetup before 2022 has begun: https://dimakorolev.substack.com/p/happy-2021-holidays
TL;DR: Yours truly and the System Design Meetup now have our own Substack.
TL;DR: Yours truly and the System Design Meetup now have our own Substack.
Dima Korolev
Happy 2021 Holidays
And thank you for the first full year together.
Hi! We will meet soon, likely next week.
In the meantime, I've got the permission to publish some of our real work's research, and decided my Substack would be a good place for it: https://dimakorolev.substack.com/p/open-policy-agent-musings
Would be very curious, both on the topic, and overall on whether you think it's an acceptable use of the Substack / this Slack / this meetup.
Thanks in advance!
In the meantime, I've got the permission to publish some of our real work's research, and decided my Substack would be a good place for it: https://dimakorolev.substack.com/p/open-policy-agent-musings
Would be very curious, both on the topic, and overall on whether you think it's an acceptable use of the Substack / this Slack / this meetup.
Thanks in advance!
Dima Korolev
Open Policy Agent Musings
The OPA / Rego feasibility analysis.
Wrote a post on whether using geospatial sharding for Yelp is such a good idea, or is it an overkill.
Dima Korolev
Does Yelp Need Geospatial Sharding?
Or would storing the data in a SQL DB just do the job?
Strive to build a product so novel and technically challenging that a system design interview question is named after you!
#Yelp, #Telegram, #Uber, #Waze, #Ticketmaster, #Twitter, #Bitly / #TinyURL — 🥳
#Yelp, #Telegram, #Uber, #Waze, #Ticketmaster, #Twitter, #Bitly / #TinyURL — 🥳
Twitter
System Design Meetup
Strive to build a product so novel and technically challenging that a system design interview question is named after you! #Yelp, #Telegram, #Uber, #Waze, #Ticketmaster, #Twitter, #Bitly / #TinyURL — 🥳
Not sure how likely this is to be the best competitive analysis of #Kafka and #RabbitMQ out there: video, slides.
But it should come very close, especially if you, like me, respect the fundamentals and think from first principles.
Thanks folks!
But it should come very close, especially if you, like me, respect the fundamentals and think from first principles.
Thanks folks!
YouTube
Kafka and RabbitMQ :: Educational System Design Meetup :: 2022-Feb-19
In preparation to tackling the Distributed Task Queue problem, an episode on message queues got forked out. And talking about message queues has a lot to do with the Kafka / RabbitMQ choice, hence the title.
Slides: https://tinyurl.com/sdm-kafka-rabbit-slides…
Slides: https://tinyurl.com/sdm-kafka-rabbit-slides…
My Mobile Podcast Studio
After a year of trial and error, here's the setup that works for me.
https://dimakorolev.substack.com/p/my-mobile-podcast-studio
After a year of trial and error, here's the setup that works for me.
https://dimakorolev.substack.com/p/my-mobile-podcast-studio
Dima Korolev
My Mobile Podcast Studio
After a year of trial and error, here's the setup that works for me.
I'm looking into setting up open source reproducible blueprints / performance tests. So that they can be run on the hardware paid by the company, but the code remains open & reusable. Is this a crazy idea?
Dima Korolev
Reproducible Performance Tests
Kept in a personal, open, repo, run on a company-hosted, cloud, K8S infra.
My post for Inteviewing.io about the differences in various interview scores.
interviewing.io
Does communication matter in technical interviewing? We looked at 100K interviews to find out.
We looked at the outcomes of over 100k interviews, and it turns out that talk is cheap.
New episode, Leveraging the Cores: from CPU and the OS kernel to coroutines, green threads, and actor models.
YouTube
Coroutines :: SysDesignMeetup :: 2022-May-21
We get into coroutines and green threads from first principles: CPU internals, user/kernel space, schedulers, I/O blockers. Actors for dessert.
#NoWar is obligatory now, as this is recorded and released in May 2022. I am hoping for the madness that is unfolding…
#NoWar is obligatory now, as this is recorded and released in May 2022. I am hoping for the madness that is unfolding…
And the Distributed Task Queue episode is now released!
YouTube
Distributed Task Queue :: SysDesignMeetup :: 2022-July-02
Distributed Task Queue. We talk about different ways to postulate and reason about the problem, effectively from how would a junior engineer approach the Task Queue problem to how would a Cloud Architect view it.
Thank you for 1K YouTube subscribers!
#NoWar…
Thank you for 1K YouTube subscribers!
#NoWar…
image_2022-07-03_13-25-59.png
213 KB
Also, we are now at 1K YouTube subscribers, yay!
image_2022-07-05_20-21-54.png
70.7 KB
Nothing extraordinary, just the SysDesign Meetup creating time loops.
Our OPA C++ Transpilation blog post, thanks to Max.
Dima Korolev
High-Performance OPA
Transpiling Rego policies into C++.
Forwarded from Not boring, and a bit of a condescending prick
I keep reading more and more about GraphQL [1]. It's useful both for my meetup and for my work, so keeping up is more and more of my professional duties than intellectual curiosity these days.
Originally — say, ~three years ago — I was quite skeptical about the prospects of this "language". Back then, it didn't even have mutations, after all, and "JOIN"-ing data between, say, PostgreSQL and Redis was remarkably inefficient. Besides, the query language is not standard and not mapped 1:1 to JavaScript or anything else popular, and type checking was semi-strict. So it did look like an interesting pet project, but I was not convinced it would have a future.
Today, after hearing more and more about GraphQL's power, and after doing more research, I'm ready to concede I was largely wrong. With
In a way, the role of a "GraphQL DBA" should be emerging as we speak.
And then it clicked. I blogged about such a future back in 2014. My prediction back then [2] was that SQL would:
• Exist in 5 years,
• Exist as legacy in 10 years, and
• Go extinct in 15 years.
Well, I have to be rooting for GraphQL now. Because it may well be the force that proves my vision to be right 😊
[1]: New features in GraphQL: Batch, defer, stream, live, and subscribe. 2021.
[2]: The Future of Data Engineering, What would happen after SQL is no more. 2014.
Originally — say, ~three years ago — I was quite skeptical about the prospects of this "language". Back then, it didn't even have mutations, after all, and "JOIN"-ing data between, say, PostgreSQL and Redis was remarkably inefficient. Besides, the query language is not standard and not mapped 1:1 to JavaScript or anything else popular, and type checking was semi-strict. So it did look like an interesting pet project, but I was not convinced it would have a future.
Today, after hearing more and more about GraphQL's power, and after doing more research, I'm ready to concede I was largely wrong. With
@defer
, @stream
and `@live`GraphQL may well be the future Data API language. Yes, some of these features are still deeply experimental, and I've got quite a few concerns about their theoretical performance.In a way, the role of a "GraphQL DBA" should be emerging as we speak.
And then it clicked. I blogged about such a future back in 2014. My prediction back then [2] was that SQL would:
• Exist in 5 years,
• Exist as legacy in 10 years, and
• Go extinct in 15 years.
Well, I have to be rooting for GraphQL now. Because it may well be the force that proves my vision to be right 😊
[1]: New features in GraphQL: Batch, defer, stream, live, and subscribe. 2021.
[2]: The Future of Data Engineering, What would happen after SQL is no more. 2014.
Very proud of this episode we’ve recorded with Interviewing.io.
May well be the best SysDesign interview prep video out there today.
Enjoy responsibly!
https://www.youtube.com/watch?v=IJSVmyhq2i0
May well be the best SysDesign interview prep video out there today.
Enjoy responsibly!
https://www.youtube.com/watch?v=IJSVmyhq2i0
YouTube
System Architect Breaks Down System Design Interview [ex Google/Microsoft]
In this video, Dima Korolev, a system architect at Miro and senior engineer (previously at Google and Microsoft), uses his extensive experience to break down...
Another video with Interviewing.io, codename "two experts design the system". Extremely well moderated by both Kevin & Mike, and pleasure working with Bruno & the broader team on this one.
YouTube
Two Ex-Google System Design Experts Compete: Who will design the better system? [Part 1]
🏆 In this video, two Ex-Google system design experts put their skills to the test in a race against time to see who will come out victorious. The task set is to recreate interviewing.io, which, in this scenario, consists of designing Google Docs, a remote…
Folks, it's time to get back on track with SysDesign Meetup!
We've been gathering off the record, but haven't released an episode in a while. We even recorded one in December, but there was a fluke with recording, so it's only released as "unlisted", as our faces are half-in. (Thx Maxim for cropping them away back then!)
Let's make the next event happen. Topic: Benchmarking Production Systems.
We're shooting this Saturday, March the 25th. It turns out the best time is Pacific morning, Eastern afternoon, Europe evening. Please vote in #general in Slack, ref. https://tinyurl.com/sdm-slack-invite.
We've been gathering off the record, but haven't released an episode in a while. We even recorded one in December, but there was a fluke with recording, so it's only released as "unlisted", as our faces are half-in. (Thx Maxim for cropping them away back then!)
Let's make the next event happen. Topic: Benchmarking Production Systems.
We're shooting this Saturday, March the 25th. It turns out the best time is Pacific morning, Eastern afternoon, Europe evening. Please vote in #general in Slack, ref. https://tinyurl.com/sdm-slack-invite.
Benchmarking Production Systems.
We open the can of worms of how much is there to cover on the topic of performance testing beyond measuring the peak RPS that a service can handle.
Video: https://tinyurl.com/sdm-benchmarking
Slides: https://tinyurl.com/sdm-benchmarking-slides
We open the can of worms of how much is there to cover on the topic of performance testing beyond measuring the peak RPS that a service can handle.
Video: https://tinyurl.com/sdm-benchmarking
Slides: https://tinyurl.com/sdm-benchmarking-slides
YouTube
Benchmarking Production Systems :: SysDesign Meetup :: 2023-March-25
Benchmarking Production Systems. We open the can of worms of how much there is to cover on the topic of performance testing beyond measuring the peak RPS that a service can handle.
Slides: https://tinyurl.com/sdm-benchmarking-slides
#NoWar is obligatory…
Slides: https://tinyurl.com/sdm-benchmarking-slides
#NoWar is obligatory…
The event dedicated to interviewing.io's SysDesign guide, of which I'm one of the authors, is happening!
Pls join #iio-sd-guide on our Slack if you're interested, and please ask your questions in Slido, regardless of whether you plan to be there live. And here's a Google Calendar link.
Very much looking forward to!
San Francisco, USA Fri, 7 Apr 2023 at 11:00 PDT
New York, USA Fri, 7 Apr 2023 at 14:00 EDT
London, United Kingdom Fri, 7 Apr 2023 at 19:00 BST
Amsterdam, Netherlands Fri, 7 Apr 2023 at 20:00 CEST
Tbilisi, Georgia Fri, 7 Apr 2023 at 22:00 GET
Kuala Lumpur, Malaysia Sat, 8 Apr 2023 at 02:00 MYT
Pls join #iio-sd-guide on our Slack if you're interested, and please ask your questions in Slido, regardless of whether you plan to be there live. And here's a Google Calendar link.
Very much looking forward to!
interviewing.io
Anonymous mock interviews with engineers from FAANG and more | interviewing.io
Get actionable feedback, get awesome at technical interviews, and get fast-tracked at top companies.