✨7 must-know strategies to scale your database.

1️⃣ Indexing:
Check the query patterns of your application and create the right indexes.
2️⃣ Materialized Views:
Pre-compute complex query results and store them for faster access.
3️⃣ Denormalization:
Reduce complex joins to improve query performance.
4️⃣ Vertical Scaling
Boost your database server by adding more CPU, RAM, or storage.
5️⃣ Caching
Store frequently accessed data in a faster storage layer to reduce database load.
6️⃣ Replication
Create replicas of your primary database on different servers for scaling the reads.
7️⃣ Sharding
Split your database tables into smaller pieces and spread them across servers. Used for scaling the writes as well as the reads.

#architecture #systemdesign #optimization #highloads #databases

Let's get started with Terraform
🧤 a tool provided by HashiCorp for writing, planning
and creating infrastructure as code (IaC) in various cloud services.

🔬Well, let's start with an excellent course
Which is basically not big and you will need a trial access
to educative.io to complete it. This course is perfect for those
who want to understand the basics of Terraform and start
confidently creating infrastructure in AWS and beyond with a declarative approach.

🥷🏻 Terraform: From Beginner to Master with Examples in AWS
https://www.educative.io/courses/terraform-beginner-master-aws?affiliate_id=5073518643380224

#AWS #Terraform #devops
#training #learning

🗣 Load balancers improve application performance, availability, and scalability 💪🏼
🔹Traffic Distribution:
Load balancers evenly distribute incoming traffic among a pool of servers, ensuring optimal resource utilization and preventing any single server from becoming overwhelmed.
🔸High Availability:
If a server fails, the load balancer automatically redirects traffic to the remaining healthy servers.
🔹SSL Termination:
Load balancers can handle SSL/TLS encryption and decryption, offloading this CPU-intensive task from backend servers.
🔸Session Persistence:
For applications that require maintaining user sessions on a specific server, load balancers support session persistence.
🔹Scalability:
Load balancers facilitate horizontal scaling by allowing easy addition of servers to the pool.
🔸Health Monitoring:
Load balancers continuously monitor server health and performance. They exclude unhealthy servers from the pool, ensuring that only healthy servers handle in requests.
#HighAvailability #Architecture #DevOps

👨‍🏫Roadmap to master machine learning

#machine_learning #devops #infrastructure #learning

▶️ We are starting to learn AWS and I think it is better to start with this course ( Prepare for the AWS Certified Solutions Architect - Associate (SAA-C03) Certification)

➡️ This is a great course for those who want to dive into the world of Amazon Web Services and acquire perhaps the best cloud tools for implementing the best DevOps practices in the future, creating a dynamic infrastructure platform for your projects.

#learning #aws #devops
#infrastructure #training

https://www.linkedin.com/learning/paths/prepare-for-the-aws-certified-solutions-architect-associate-saa-c03-certification

Hello everyone ✋A very tasty 🍯 video from Victor arrived, a very cool concept of a continuous delivery pipeline with gitops approaches on my favorite today's stack of technology
#crossplane #argocd #aws #github_actions #eks

💎 "Automate Everything: How One Manifest Powers Your Entire DevOps Pipeline"

https://youtu.be/IEgXJEkjBZ0

What does API gateway do?🕵🏼

👣 (1) The client sends an HTTP request to the API gateway.
👣 (2) The API gateway parses and validates the attributes in the HTTP request.
👣 (3) The API gateway performs allow-list/deny-list checks.
👣 (4) The API gateway talks to an identity provider for authentication and authorization.
👣 (5) The rate limiting rules are applied to the request. If it is over the limit, the request is rejected.
👣 (6,7) Now that the request has passed basic checks, the API gateway finds the relevant service to route to by path matching.
👣 (8) The API gateway transforms the request into the appropriate protocol and sends it to backend microservices.
👣 (9-12) The API gateway can handle errors properly, and deals with faults if the error takes a longer time to recover (circuit break). It can also leverage ELK (Elastic-Logstash-Kibana) stack for logging and monitoring. We sometimes cache data in the API gateway.

#api #app #architecture
#SystemDesign #HTTP

How its Linux Boot Process works ? 🕵🏻‍♂️

🔌 When we turn on the power, BIOS or UEFI firmware is loaded from non-volatile memory, and executes POST (Power On Self Test).
💽 BIOS/UEFI detects the devices connected to the system, including CPU, RAM, and storage.
💿 Choose a booting device to boot the OS from. This can be the hard drive, the network server, or CD ROM.
📀 BIOS/UEFI runs the boot loader (GRUB), which provides a menu to choose the OS or the kernel functions.
🖥 After the kernel is ready, we now switch to the user space. The kernel starts up systemd as the first user-space process, which manages the processes and services, probes all remaining hardware, mounts filesystems, and runs a desktop environment.
📟 systemd activates the default. target unit by default when the system boots. Other analysis units are executed as well.
🎚The system runs a set of startup scripts and configure the environment.
📱The users are presented with a login window. The system is now ready.

#linux #boot #systemdesign

Unleashing the Power of Cluster API: Extensibility and Customization - Zain Malik & Nibir Bora

#presentation #kubecon2024 #china #kubernetes

https://www.youtube.com/watch?v=nIWy1Hzl_oQ

Kubernetes as a Platform Framework: Journey from IaC Pipelines to K8s APIs - Christina Andonov, AWS

#presentation #kubernetes #gitops

https://www.youtube.com/watch?v=TBzy0QPOyY4

There are more than 500+ Kubernetes Certified Service Providers and tons of Kubernetes Certified distributions. Choosing a right distribution can be a daunting task. Kubetools is built with a purpose to build a curated list of popular Kubernetes tools🙈

#kubernetes #devops #infrastructure

https://collabnix.github.io/kubetools

😇In my opinion, KCL is a very promising thing for reliable and fast writing of configuration for any purpose, be it the cloud or just for applications

KCL: Simplifying Kubernetes Manifests Management

#devops #configuration #infrastructure

https://www.kcl-lang.io/blog/2024-08-29-kubecon2024

🌱 Typical AWS Network Architecture in one diagram.

🟣Internet Gateway (IGW) serves as the doorway between your AWS VPC and the internet.
🟣Remote Workers AWS offers a Client VPN service that enables remote workers to access securely over the internet.
🟣VGW is the VPN concentrator on the Amazon side of the Site-to-Site VPN connection between your network and your VPC.
🟣VPC Peering allows you to connect two VPCs.
🟣AWS Transit Gateway acts as a network transit hub, enabling you to connect multiple VPCs, VPNs, and AWS accounts together.
🟣VPC Endpoint (Gateway type) allows you to privately connect your VPC to supported AWS services and VPC endpoint services powered by PrivateLink without requiring an internet gateway, VPN.
🟣Interface VPC Endpoint enables private connections between your VPC and supported AWS services.
🟣SaaS AWS Private Link Connection provides private connectivity between VPCs and services hosted on AWS or on-premises.
#aws #infrastructure #network

What does ACID mean? For SQL 🗄
🔹 Atomicity
The writes in a transaction are executed all at once and cannot be broken into smaller parts. If there are faults when executing the transaction, the writes in the transaction are rolled back.
🔹 Consistency
Unlike “consistency” in CAP theorem, which means every read receives the most recent write or an error, here consistency means preserving database invariants. Any data written by a transaction must be valid according to all defined rules and maintain the database in a good state.
🔹 Isolation
When there are concurrent writes from two different transactions, the two transactions are isolated from each other. The most strict isolation is “serializability”, where each transaction acts like it is the only transaction running in the database. However, this is hard to implement in reality, so we often adopt loser isolation level.
🔹 Durability
Data is persisted after a transaction is committed even in a system failure.

#databases #infrastructure #devops #SQL

What happens when a junior DevOps specialist is forced into the main branch of the production infrastructure ? 🤪

#humor #git #devops