Essential Components of a Production Web Application.
1 - It all starts with CI/CD pipelines that deploy code to the server instances.
2 - The user requests originate from the web browser. After DNS resolution, the requests reach the app servers.
3 - Load balancers and reverse proxies (such as Nginx & HAProxy) distribute user requests evenly across the web application servers.
4 - The requests can also be served by a Content Delivery Network (CDN).
5 - The web app communicates with backend services via APIs.
6 - The backend services interact with database servers or distributed caches to provide the data.
7 - Resource-intensive and long-running tasks are sent to job workers using a job queue.
8 - The full-text search service supports the search functionality.
9 - Monitoring tools (such as Sentry, Grafana, and Prometheus) store logs and help analyze data to ensure everything works fine.
10 - In case of issues, alerting services notify developers through platforms like Slack for quick resolution.

Karpenter is the best assistant with questions on capacity and allocation of power for workloads! If you use amazon web services and eks (kubernetes) there, then it is better to take a closer look at karpenter, since in the future he will greatly minimize operating costs from your project.

#aws #eks #infrastructure

https://opsguru.io/post/karpenter

Introduction to Systems Design

#SystemsDesign #DevOps
#infrastructure #Architecture

https://www.youtube.com/watch?v=F2FmTdLtb_4

How Container Networking Works

When you need to understand a complex piece of tech, creating a toy version of it can be an efficient learning trick 🏓
That's exactly how I mastered container networking - by creating a Docker bridge network from scratch.
And with this interactive tutorial, you can get such experience 👉 https://labs.iximiuz.com/tutorials/container-networking-from-scratch

#Container #Networking
#infrastructure

An article about the most important alerts for Karpenter

https://www.perfectscale.io/blog/karpenter-monitoring-with-prometheus

#monitoring #infrastructure
#aws #DevOps

A picture is worth a thousand words: 9 best practices for developing microservices.

When we develop microservices, we need to follow the following best practices:

1. Use separate data storage for each microservice
2. Keep code at a similar level of maturity
3. Separate build for each microservice
4. Assign each microservice with a single responsibility
5. Deploy into containers
6. Design stateless services
7. Adopt domain-driven design
8. Design micro frontend
9. Orchestrating microservices

#microservices #architecture
#application

Think like an architect: a mental model for designing your softwares

🍏What You'll Learn:
- How to transition your architectural knowledge to serverless
- The importance of modularity in serverless design and how to implement it
- A step-by-step example of moving from business requirements to a high-level architecture, and finally to a detailed serverless architecture

#microservices #architecture
#application #CloudComputing
#DevOps #CloudArchitect #ArchitecturePatterns
#AWSServices #CloudSolutions

🧩part1
https://www.youtube.com/watch?v=9gEtY4Pb_8g

🧩part2
https://www.youtube.com/watch?v=Gp_Cmv1Tams

Advanced Kubernetes: From GitOps to Resource Optimization and Quantum Computing

#infrastructure #kubernetes #gitops

https://youtube.com/live/aCWq-CYLHuI

🌱These tips will give you an understanding of what characteristics a reliable application should meet.

#Architecture #application #SystemsDesign

https://12factor.net/

🦶🏼How do message queue architectures evolve?
🔹 IBM MQ - was launched in 1993. It was originally called MQSeries and was renamed WebSphere MQ in 2002. It was renamed to IBM MQ in 2014. IBM MQ is a very successful product widely used in the financial sector. Its revenue still reached 1 billion dollars in 2020.

🔹 RabbitMQ - architecture differs from IBM MQ and is more similar to Kafka concepts. The producer publishes a message to an exchange with a specified exchange type. It can be direct, topic, or fanout. The exchange then routes the message into the queues based on different message attributes and the exchange type. The consumers pick up the message accordingly.

#infrastructure #DevOps #Architecture
#application #microservices

🔹 Kafka
In early 2011, LinkedIn open sourced Kafka, which is a distributed event streaming platform. It was named after Franz Kafka. As the name suggested, Kafka is optimized for writing. It offers a high-throughput, low-latency platform for handling real-time data feeds. It provides a unified event log to enable event streaming and is widely used in internet companies.

Kafka defines producer, broker, topic, partition, and consumer. Its simplicity and fault tolerance allow it to replace previous products like AMQP-based message queues.

🔹 Pulsar
Pulsar, developed originally by Yahoo, is an all-in-one messaging and streaming platform. Compared with Kafka, Pulsar incorporates many useful features from other products and supports a wide range of capabilities. Also, Pulsar architecture is more cloud-native, providing better support for cluster scaling and partition migration, etc.

There are two layers in Pulsar architecture: the serving layer and the persistent layer. Pulsar natively supports tiered storage, where we can leverage cheaper object storage like AWS S3 to persist messages for a longer term.

#infrastructure #DevOps #Architecture
#application #microservices

#DevOps #application #linux #humor

Why gRPC is Popular 🚀

Here's why:
🔍 Speed - gRPC is built on HTTP/2 and Protobufs for maximum throughput and minimal latency. Much faster than JSON over HTTP.
🔍 Efficiency The compact Protobuf binary format means smaller payloads than JSON. Less data sent = better performance.
🔍 Type Safety Protobufs are strongly typed, eliminating many bugs.
🔍 Polyglot Write services in many popular languages, the IDL works across them all.
🔍 Streaming gRPC supports bidirectional streaming for real-time data transmission.
🔍 Great Ecosystem Tons of tools exist for code gen, load balancing, monitoring, and more.

Of course, gRPC has some drawbacks:
🖍 More Complex Defining Protobuf schemas and setting up gRPC can have a learning curve.
🖍 Not Human Readable Protobufs are binary, so not as easy to troubleshoot as JSON. Tools like grpcurl help a little bit.
🖍 Limited Browser Support gRPC works best for backend microservices, not front-end apps.

#DevOps #Architecture #application #microservices #Architecture

#infrastructure #devops #terraform

Book: 📚 Development Techniques for Serverless and Kubernetes Applications

#infrastructure #aws #devops

🧑🏼‍💻Leveraging Cilium in its Kubernetes platform has lowered Kakao’s network and performance costs
🏃🏻‍♂️and enabled faster debugging of network issues.

#cloudnative #network
#kubernetes #cilium

https://www.cncf.io/case-studies/kakao/?utm_content=303207023&utm_medium=social&utm_source=linkedin&hss_channel=lcp-12893459

How can Redis be used?

There is more to Redis than just caching.

Redis can be used in a variety of scenarios as shown in the diagram.

🔹Session
We can use Redis to share user session data among different services.
🔹Cache
We can use Redis to cache objects or pages, especially for hotspot data.
🔹Distributed lock
We can use a Redis string to acquire locks among distributed services.
🔹Counter
We can count how many likes or how many reads for articles.
🔹Rate limiter
We can apply a rate limiter for certain user IPs.
🔹Global ID generator
We can use Redis Int for global ID.
🔹Shopping cart
We can use Redis Hash to represent key-value pairs in a shopping cart.
🔹Calculate user retention
We can use Bitmap to represent the user login daily and calculate user retention.
🔹Message queue
We can use List for a message queue.
🔹Ranking
We can use ZSet to sort the articles.

#redis #application #devops

Top 10 kubernetes Design Patterns

#kubernetes #infrastructure
#systemDesign

10 Key Data Structures We Use Every Day

🔸list: keep your Twitter feeds
🔸stack: support undo/redo of the word editor
🔸queue: keep printer jobs, or send user actions in-game
🔸hash table: cashing systems
🔸Array: math operations
🔸heap: task scheduling
🔸tree: keep the HTML document, or for AI decision
🔸suffix tree: for searching string in a document
🔸graph: for tracking friendship, or path finding
🔸r-tree: for finding the nearest neighbor
🔸 vertex buffer: for sending data to GPU for rendering

#devops #algorithms

Grafana LOKI one of the best tools for log collection, with good and reliable distributed architecture 🧗‍♂

#grafana #devops #loki

https://youtu.be/0B-yQdSXFJE?si=pNp00yotpJCcmT-n