DevBrainOps
110 subscribers
99 photos
5 videos
23 files
226 links
The group whose goal is to find the best approaches and solve problems of #DevOps practice.
Download Telegram
🚀 Modern CI/CD with Dagger, Argo CD, and Kubernetes!

This flexible architecture leverages Dagger for portable CI/CD pipelines, Argo CD for GitOps-driven deployments, and AWS EKS with Karpenter for dynamic scaling 🧨

* Run pipelines in containers for isolation and portability.
* Automate infrastructure with Git as the single source of truth.
* Scale efficiently with ephemeral Dagger Engines and Karpenter.
* Integrate seamlessly with GitHub via Actions Runner Controller.

Cost-effective and cloud-native, it optimizes resources and supports modern DevOps.

#CICD #GitOps #Kubernetes #DevOps

https://dagger.io/blog/argo-cd-kubernetes
👍1🔥1
Hello, awesome folks of the interwebs! 😎 Curious about who's behind the keyboard, churning out these spicy posts? It's just me, your friendly neighborhood DevOps engineer, slinging code and automating chaos at a pretty famous company (no big deal, right? 😜). This channel started as my personal stash for epic tips, tricks, and brain-meltingly useful info that helps me streamline processes and make life easier for companies building the coolest projects in the galaxy. 🚀

Stick around, because I’m cooking up a storm of mind-blowingly helpful content—think automation hacks, DevOps wizardry, and maybe a few memes to keep it real. Expect a wild ride of useful, quirky, and downright awesome posts that’ll level up your tech game! 🎉 Hit that follow button, and let’s make some magic together! #DevOpsLife #AutomateAllTheThings
👍3
2🔥1
1👍1
🚀 Ever wonder how a packet actually travels inside Amazon EKS?

This detailed session will walk you through each step of a packet's journey in Amazon EKS:

🐛 Pod-to-Pod Traffic on the Same Node: Explore veth pair communication and routing table intricacies.

🧩 Cross-Node Networking: See how SNAT and DNAT come into play when pods talk across nodes in a subnet.

🌐 Ingress Flow: Follow a packet from a Route 53 lookup, through the Internet Gateway, ALB, ENI, and into the public subnet.

📡 Service Types Uncovered: Understand how ClusterIP, NodePort, and LoadBalancer differ at OSI Layer 4 in real-world EKS setups.

If you run EKS or just want to truly understand Kubernetes networking, this is a must-watch. 🎯

🎥 Watch the talk now
https://www.youtube.com/watch?v=LZahLhuuxSQ

#AWS #EKS #Kubernetes #Networking #CloudNative
👍1🔥1
Imagine CQRS as the over-caffeinated coder who insists on reading AND writing data at the speed of light, while Microservices are like that friend who splits the group project into a million tiny tasks—total chaos but somehow it works! Event-Driven? That’s the guy who reacts to every ping like it’s a party invite.

#DevOps #Architecture #application
1👍1
💡 Using AWS EKS? Watch out - cross-AZ control plane traffic might hit your wallet 💸

Yes - even inside the same AWS region, some traffic can be billed and other clouds are in the same situation. These costs are often hard to detect, and it's tricky to know which traffic you're paying for or who's generating it.
Let’s take a closer look at when and why this happens - and how the EKS architecture plays into it 👉

https://docs.aws.amazon.com/images/eks/latest/best-practices/images/reliability/eks-data-plane-connectivity.jpeg

🧱 Understanding the EKS Control Plane
To get to the root of the issue, we first need to understand how Amazon EKS sets up its control plane. By default, the EKS control plane is distributed across two Availability Zones (e.g., AZ A and AZ B), even when there's no load yet on the cluster. Meanwhile, when you create your cluster, you likely spread your worker nodes (like managed node groups or Karpenter node pools) across three Availability Zones for high availability - something AWS strongly recommends for reliability.

🧮 When Traffic is Free - and When It’s Not
Here’s where cost comes in. According to AWS:
Traffic within the same Availability Zone is free
Traffic between different Availability Zones, even in the same region, is billed
So, what does this mean in practice?
💰 Pods in AZ A communicating with the control plane in AZ A = free
💰 Pods in AZ B communicating with the control plane in AZ B = free
But...
💳 Pods in AZ C trying to talk to the control plane (which only exists in AZ A and B) = 💸 paid inter-AZ traffic

This kind of traffic might happen frequently - especially for workloads that constantly interact with the Kubernetes API server (like CI/CD tools, controllers, or operators), and there may also be work on the Amazon side, for example, rolling out patches to the control plane, which will lead to a change in zones for the control plane servers.

🛠 How to Reduce Inter-AZ Costs
To avoid or minimize these charges:
☘️ Align your worker node placement with control plane AZs (e.g., only use AZ A and B if cost is a concern)
☘️ Pin high-frequency API consumers (e.g., system pods or controllers) to AZs where the control plane resides
☘️ Use VPC Flow Logs + Athena or CloudWatch, KubeCost, CloudWatch + Usage Reports with Athena, CostExplorer, AWS CUR (Cost and Usage Report) with Athena or QuickSight(Cudos dashboards), or custom metrics to monitor traffic patterns.

Of course, I don’t think that with the increase in loads you will encounter this problem, since the control plane is automatically scaled and you will be in all availability zones. But it's good to have knowledge in this area and understanding these details can help you make better architecture choices - and avoid surprise costs ☀️

If you have any cool ways to find network traffic prices by source that I didn't list above, please share them in the comments 🤑

#aws #eks #network #AmazonEKS #CloudNative
#CloudCosts #AWSBilling #FinOps #InterAZTraffic
#AWSNetworking #DevOps #SRE #Observability
👍2
🚨Running Aws EKS in production is not just about launching a cluster !

😶It’s about engineering for scale, reliability, and application-specific behavior and that only comes with real production experience.
Creating effective solutions based on AWS EkS requires deep production experience. It’s not enough to "spin up a cluster"- you must design, adapt, and operate for real workloads.

Good cloud services are just a set of tools, to create good architectural solutions for applications and then their excellent performance to work on a global scale, you need cool engineers who have experience with such tools🧑‍💻

Here is a good article confirming my words: https://engineering.probo.in/production-grade-pain-lessons-from-scaling-kubernetes-on-eks-03571838c7a3

#K8s #AmazonEKS #application #architecture #infrastructure
#Kubernetes #CloudComputing #DevOps #CloudArchitecture #SiteReliabilityEngineering #ProductionReady #InfrastructureAsCode #CloudNative #SRE #Observability #PlatformEngineering #Scalability
1👍1
The article “LLM Serving with BentoML” is a free, in-depth textbook 📚 that guides you through deploying and serving Large Language Models (LLMs) using BentoML. For DevOps professionals, this resource is a game-changer: it covers real-world workflows for packaging, automating, and scaling LLMs in production with modern CI/CD, containerization, and cloud-native best practices. As LLMs become a core part of future infrastructure, learning BentoML is a future-proof skill that will help you efficiently manage and operate AI-powered services. 🚀

https://bentoml.com/llm/

#DevOps #AI #LLM #BentoML #OpenSource #FutureSkills #FreeLearning #CloudNative #MLOps #Automation 🤖
👍1🔥1
🛡 Securing Your Kubernetes Cluster? Start with OWASP Top 10!

Whether you're running production clusters or just getting started with Kubernetes, security missteps can cost you - especially when it comes to workload misconfigurations, excessive privileges, or vulnerable images.

To help teams harden their environments, OWASP published the Kubernetes Top 10. Here's a breakdown of 🔟 critical risks - and the best open-source tools you can adopt right now to stay protected:

🔥 K01, K03, K04, K09 – Misconfigurations & Overly Permissive Access
➡️ Kube-bench: CIS benchmark audits
➡️ Kube-hunter: Cluster penetration testing
➡️ Open Policy Agent (OPA): Policy enforcement
➡️ KubeFence: Fine-grained access control

🧪 K02 – Supply Chain Vulnerabilities
➡️ Trivy: Image and IaC scanner
➡️ Syft: SBOM generation
➡️ Chain-bench: Supply chain compliance

🔍 K05 – Inadequate Monitoring & Logging
➡️ Falco: Runtime security & anomaly detection
➡️ Sysdig: Visibility and threat detection
➡️ Wiz: Posture management + threat detection

🔐 K06 – Broken Authentication
➡️ OPA + cloud-native IAM + dashboard hardening
➡️ Wiz: IAM misconfiguration detection

🌐 K07 – Network Segmentation Lapses
➡️ Calico: Network policies and microsegmentation
➡️ Cilium: eBPF-powered networking
➡️ Istio: service meshe for zero-trust enforcement, mutual TLS (mTLS), and traffic inspection

🔑 K08 – Secrets Management Failures
➡️ Vault: Secrets storage
➡️ Kubernetes External Secrets
➡️ K8s Pro Sentinel (operator)

🧱 K10 – Outdated Kubernetes Components
➡️ Trivy
➡️ Kube-bench

🚧 Build your own security stack from these tools — and make OWASP K8s Top 10 part of your DevSecOps DNA!

👉 Full list of risks: https://owasp.org/www-project-kubernetes-top-ten/

🎯 Extra tip: Drift Detection + RBAC Auditing
Even the best GitOps pipelines can’t stop a manual kubectl patch at 2 AM. Drift detection spots these out-of-band changes and restores declared state. RBAC audits ensure your roles aren’t granting more than they should - no surprises.

🛡 Why it matters:
Over time, "temporary fixes" turn into permanent vulnerabilities.
Drift and privilege creep are silent killers of cluster security.

🔧 Tools like Kubescape, OPA, and GitOps frameworks (e.g., Crossplane) handle drift elegantly - aligning live state with Git or Terraform.
Keep your cluster clean. Let Git rule.

#Kubernetes #DevSecOps #CloudNative #K8sSecurity #OWASP #OpenSource #ZeroTrust #CNAPP
👍2
Cluster API vs Crossplane ⚔️ Which Kubernetes Deployment Tool Should You Choose? 🤔

Just had an interesting deep-dive conversation about Kubernetes deployment strategies. Here's what I've learned about choosing the right tool for deploying K8s clusters across any platform 💼

Cluster API (CAPI) - Most universal, Kubernetes-native approach
Crossplane + CAPI - Choice for unified management
Terraform + K8s Provider - DevOps favorite
Rancher - User-friendly management platform
Kubeadm - DIY approach for full control

You CAN use just Cluster API alone if your goal is purely cluster lifecycle management. But here's when you should consider adding Crossplane.

Cluster API Only is Enough When:
You just need to create/upgrade/scale clusters
Your infrastructure scope is limited to what CAPI providers handle
You're comfortable with CAPI CRDs and clusterctl
Your team is primarily ops/platform-focused

One of CAPI's biggest strengths is its ability to deploy Kubernetes on bare metal hardware servers through specialized providers. This opens up powerful on-premises and edge computing possibilities.

Some of the cool capi's providers for hardware deployment:
Tinkerbell - Bare metal provisioning engine for physical servers
KubeVirt - Virtual machines on Kubernetes
Proxmox - Virtualization platform with KVM/LXC
vSphere - VMware virtualization platform
Metal3 - Bare metal host management

Add Crossplane When You Need:
🚀 Broader infrastructure management (VPCs, databases, storage, etc.)
🔐 Self-service APIs for application teams
🌍 Multi-cloud governance and policy enforcement
🔄 Unified GitOps workflows for both clusters and cloud services

For most enterprise environments, Crossplane + Cluster API gives you the best of both worlds: Crossplane manages the cloud infrastructure, CAPI manages the Kubernetes clusters on top of it.

If you're already using Crossplane (like I am), consider whether you want managed control planes (EKS/GKE/AKS via Crossplane) or self-managed clusters (via CAPI) based on your operational preferences.

Cluster API Only = You're just managing cluster lifecycles (create/upgrade/scale) - basic stuff
🚀 Crossplane + CAPI = You're building a full infrastructure stack

💊 PS: From the latest trends it will also be a good choice for an independent approach and with controller minimization without crossplane deployment of such clusters with the help of these controllers and tools -
* Where can crossplane replace and improve these controllers - https://github.com/flux-iac/tofu-controller, https://github.com/pulumi/pulumi-kubernetes-operator, https://github.com/kro-run/kro
* Gardener can enhance the Сluster API and provide a cool user experience - https://gardener.cloud/blog/2025/08/08-04-cluster-api-provider-gardener/

What's your experience with these tools?

#Kubernetes #DevOps #CloudNative #Crossplane #ClusterAPI #GitOps #PlatformEngineering #MultiCloud #Infrastructure
👍2
🤖 Hey tech builders & AI explorers!

Just found a gem on GitHub: 500+ AI Agent Use Cases 👉 https://github.com/ashishpatel26/500-AI-Agents-Projects

This repo is packed with practical AI agents — from health diagnostics 🏥 and trading bots 💹 to smart farming 🌱 and logistics automation 🚚.

Frameworks spotlighted:
CrewAI – workflow automation (emails, meetings, resumes, Instagram content)
Autogen – code generation, LLM debugging, web-browsing agents
Agno – helpers like support chat, market insights, study companions
Langgraph – multi-agent orchestration, RAG workflows, chatbot eval, SQL agents

💡 Why it matters for your career:
Learning how to design and integrate AI agents isn’t just “cool tech” — it’s a future-proof skill. Whether you’re into DevOps, cloud, data, or app engineering, these agents show how automation + AI can free you from repetitive tasks, sharpen your problem-solving, and even open doors to new roles in AI-driven infrastructure and operations.

Dive in, experiment, and maybe even contribute your own use case. The more you play with agents today, the more valuable you’ll be tomorrow.

#AI #AIAgents #Automation #DevOps #MLOps #Cloud #Kubernetes #CICD #CareerGrowth #OpenSource
👍3
System-Design-Alex-Xu-Vol-1 (1).pdf
22 MB
🍬Want to master the creation of complex system architectures and confidently ace system design interviews at top companies?

📘This book is your key:
System Design Interview – Vol. 1 (Alex Xu)

It breaks down real-world system design challenges step by step.
Gives you the mental models to reason about scalability, reliability, performance, and trade-offs.
Prepares you for high-stakes interviews, where system design is often the hardest part.
Helps you think like an architect, not just an implementer.

Many engineers call this book the “Bible of System Design” — a foundation every serious DevOps and Platform Engineer should know.

👉 Start reading today, and you’ll not only grow as an engineer but also unlock career-defining opportunities.
#architecture #book #CareerGrowth
#CloudArchitecture #books #DevOps #learning #systemdesign
1👍1
💥 Curious about how to actually build agentic apps, or what AI agents and MCP servers really mean?

🚀 Dive into this curated set of fresh, practical resources - learn faster, experiment smarter, and start shipping real projects today!

1. Blog: Effectively Building AI Agents on AWS Serverless https://aws.amazon.com/ru/blogs/compute/effectively-building-ai-agents-on-aws-serverless/ Co-authored with the awesome Dhiraj Mahapatro.
2. Webinar: Building Serverless AI Agents https://www.youtube.com/watch?v=OuiUEPO7PB8 - deep dive into architectures and patterns.
3. Webinar: Building Serverless MCP Servers https://www.youtube.com/watch?v=q3JgDJPeXJY- understand how MCP works, when to use stateless vs. stateful, and how to run them on AWS.
4. Code: Sample MCP Servers and AI Agents https://github.com/aws-samples/sample-serverless-mcp-servers - ready-to-run examples using AWS Serverless services.

#aws #serverless #lambda #fargate #agents #genai
#bedrock #awesome #mcp #architecture
👍3
Looking to break into Linux System Administration but currently only know how to ls and pray?
Don’t worry — we’ve all been there. 🙃

Here’s a completely free course to get you started: https://training.linuxfoundation.org/training/introduction-to-linux/

💻 60+ hours of content
🧪 Hands-on labs (because we learn by breaking things)
🏅 Completion badge (so you can flex on LinkedIn)
♾️ Lifetime access (for when you forget a command and Google betrays you)
💰 $0 (finally something in tech that doesn’t require a credit card)

Fun fact: Linux runs over 90% of servers and cloud infrastructure.
Translation: If you want to be in DevOps, CyberSec, or a SysAdmin, Linux is like oxygen… you kinda need it.

Also, once you understand Linux, your AWS bill will still be high — but at least you’ll know why. 😅

#DevOps #Linux #SysAdmin #ITCareer #CareerGrowth #SRE
👍2
🚀 Kubernetes at Massive Scale – Lessons for Real Production

This experiment shows that Kubernetes can be pushed all the way to 1,000,000 nodes. While it’s not production-ready, the project gives powerful insights:

Think about network design early (IPv6 becomes a must at scale)

etcd writes and API load are the real bottlenecks — optimize them

Sharding + horizontal scaling of control plane components is the key

Every “small overhead” becomes huge at scale — design clean & simple

Even if your cluster is 100 or 1,000 nodes - these patterns help you build reliable, efficient, and future-proof production systems.

🔗 https://bchess.github.io/k8s-1m/

#kubernetes #k8s #production #devops #sre #cloudnative
#scalability #infrastructure #etcd #clusters #platformengineering
👍2