๐ What is Docker?
Docker allows you to package an application with all its dependencies into a standardized unit for software development and deployment.
Key Concepts:
๐ช Containers
- Lightweight, standalone executable packages
- Include everything needed to run an application
- Ensure consistency across different environments
๐ซ Images
- Read-only templates used to create containers
- Built from layers, each representing an instruction in the Dockerfile
- Can be shared via Docker Hub or private registries
๐ญ Dockerfile
- Text file containing instructions to build a Docker image
- Defines the environment inside the container
- Automates the image creation process
๐Getting Started:
1. Install Docker
2. Familiarize yourself with basic commands (docker run, build, pull, push)
3. Create your first Dockerfile and build an image
4. Experiment with Docker Compose for multi-container setups
5. Explore Docker Hub for pre-built images and inspiration
Docker allows you to package an application with all its dependencies into a standardized unit for software development and deployment.
Key Concepts:
๐ช Containers
- Lightweight, standalone executable packages
- Include everything needed to run an application
- Ensure consistency across different environments
๐ซ Images
- Read-only templates used to create containers
- Built from layers, each representing an instruction in the Dockerfile
- Can be shared via Docker Hub or private registries
๐ญ Dockerfile
- Text file containing instructions to build a Docker image
- Defines the environment inside the container
- Automates the image creation process
๐Getting Started:
1. Install Docker
2. Familiarize yourself with basic commands (docker run, build, pull, push)
3. Create your first Dockerfile and build an image
4. Experiment with Docker Compose for multi-container setups
5. Explore Docker Hub for pre-built images and inspiration
๐2
๐ค The choice of an API architecture can have significant implications on the efficiency, flexibility, and robustness of an application.
Letโs examine some prominent styles:
๐ฅ๐๐ฆ๐ง
A cornerstone in web services, REST leverages HTTP methods for streamlined operations and a consistent interface.
๐๐ฟ๐ฎ๐ฝ๐ต๐ค๐
Whilst REST uses multiple endpoints for each resource and necessitates multiple requests to obtain interconnected data
๐ฆ๐ข๐๐ฃ
Once dominant, SOAP remains vital in enterprises for its security and transactional robustness.
๐ด๐ฅ๐ฃ๐
gRPC is efficient in distributed systems, offering bidirectional streaming and multiplexing.
๐ช๐ฒ๐ฏ๐ฆ๐ผ๐ฐ๐ธ๐ฒ๐๐
For applications demanding real-time communication, WebSockets provide a full-duplex communication channel over a single, long-lived connection.
It's popular for applications requiring low latency and continuous data exchange.
๐ ๐ค๐ง๐ง
MQTT is a lightweight messaging protocol optimized for high-latency or unreliable networks.
Letโs examine some prominent styles:
๐ฅ๐๐ฆ๐ง
A cornerstone in web services, REST leverages HTTP methods for streamlined operations and a consistent interface.
๐๐ฟ๐ฎ๐ฝ๐ต๐ค๐
Whilst REST uses multiple endpoints for each resource and necessitates multiple requests to obtain interconnected data
๐ฆ๐ข๐๐ฃ
Once dominant, SOAP remains vital in enterprises for its security and transactional robustness.
๐ด๐ฅ๐ฃ๐
gRPC is efficient in distributed systems, offering bidirectional streaming and multiplexing.
๐ช๐ฒ๐ฏ๐ฆ๐ผ๐ฐ๐ธ๐ฒ๐๐
For applications demanding real-time communication, WebSockets provide a full-duplex communication channel over a single, long-lived connection.
It's popular for applications requiring low latency and continuous data exchange.
๐ ๐ค๐ง๐ง
MQTT is a lightweight messaging protocol optimized for high-latency or unreliable networks.
๐3
DevOps warming๐ฅ๐ฅ๐ฅ ( kubernetes pod's disruptions )
Which one from this list is the voluntary pod's disruptions ? #kubernetes #devops #interview
Which one from this list is the voluntary pod's disruptions ? #kubernetes #devops #interview
Final Results
25%
A kernel panic
8%
Spot interruption from AWS EC2
33%
SysAdmin makes node updates
33%
The node ran out of resources
โค2
โญ๏ธCourse: Computer Networking Fundamentals For Developers, DevOps, and Platform Engineers
I went through this tutorial on networking fundamentals and found it very useful. This is a good excursion into understanding networks for further knowledge in this area.
#network #infrastructure #devops #courses
https://labs.iximiuz.com/courses/computer-networking-fundamentals
I went through this tutorial on networking fundamentals and found it very useful. This is a good excursion into understanding networks for further knowledge in this area.
#network #infrastructure #devops #courses
https://labs.iximiuz.com/courses/computer-networking-fundamentals
iximiuz Labs
Computer Networking Fundamentals For Developers, DevOps, and Platform Engineers (course) | iximiuz Labs
A heavily illustrated introduction to the first two layers of Computer Networking: Ethernet and IP. A must for any developer or DevOps engineer who wants to build solid understanding of computer networking before they move to the higher-level protocols likeโฆ
๐3
Forwarded from Kubernative by Palark | Kubernetes news and goodies
If youโre interested in running local/private LLMs (leveraging Ollama and similar solutions) on Kubernetes, take a look at this new project.
KubeAI serves an OpenAI-compatible HTTP API in Kubernetes, providing you with a drop-in OpenAI replacement and simplifying the needed operations. The projectโs authors call it โa Model Operator that manages vLLM and Ollama servers [inside Kubernetes].โ Most noticeable KubeAI features include:
- Support for various Open Source model servers, including vLLM, Ollama, FasterWhisper, and Infinity. (Speech-to-Text and Text-Embedding are supported.)
- An option to preload LLMs in custom container images.
- Autoscaling based on load.
- A Chat UI based on OpenWebUI.
- An ability to work in the CPU-only mode and with GPUs. TPU support is planned.
- No dependencies (such as service meshes) and installable in regular K8s clusters, OpenShift, and managed K8s solutions (currently, thereโs an instruction for GKE with Autopilot).
โถ๏ธ GitHub repo
#tools #ai
KubeAI serves an OpenAI-compatible HTTP API in Kubernetes, providing you with a drop-in OpenAI replacement and simplifying the needed operations. The projectโs authors call it โa Model Operator that manages vLLM and Ollama servers [inside Kubernetes].โ Most noticeable KubeAI features include:
- Support for various Open Source model servers, including vLLM, Ollama, FasterWhisper, and Infinity. (Speech-to-Text and Text-Embedding are supported.)
- An option to preload LLMs in custom container images.
- Autoscaling based on load.
- A Chat UI based on OpenWebUI.
- An ability to work in the CPU-only mode and with GPUs. TPU support is planned.
- No dependencies (such as service meshes) and installable in regular K8s clusters, OpenShift, and managed K8s solutions (currently, thereโs an instruction for GKE with Autopilot).
โถ๏ธ GitHub repo
#tools #ai
๐3
https://www.youtube.com/watch?v=yntg0J5xxO8
30 Days Of CNCF Projects | Day 1: What is Kyverno + Demo
#video #infrastructure #cncf
30 Days Of CNCF Projects | Day 1: What is Kyverno + Demo
#video #infrastructure #cncf
YouTube
30 Days Of CNCF Projects | Day 1: What is Kyverno + Demo ๐
Links:
- Demo GitHub - https://github.com/guymenahem/how-to-devops-tools/tree/main/kyverno
- Kyverno Docs - https://kyverno.io/
Connect on Linkedin โก๏ธ - https://www.linkedin.com/in/guy-menahem/
Subscribe to the channel โ - https://youtube.com/@the_good_guyโฆ
- Demo GitHub - https://github.com/guymenahem/how-to-devops-tools/tree/main/kyverno
- Kyverno Docs - https://kyverno.io/
Connect on Linkedin โก๏ธ - https://www.linkedin.com/in/guy-menahem/
Subscribe to the channel โ - https://youtube.com/@the_good_guyโฆ
๐3
๐ฆ Netflix architecture - they use full amazon services, not shown in this diagram, but they use ec2 for all their workload.๐ So knowledge of aws services will be very relevant in the near future.
#devops #infrastructure #netflix
#devops #infrastructure #netflix
๐3
๐ง๐ปHow OpenAI Scaled Kubernetes to 7,500 Nodes by Removing One Plugin
https://newsletter.betterstack.com/p/how-openai-scaled-kubernetes-to-7500?utm_campaign=Newsletter%2B(all)&utm_source=linkedin&utm_medium=paid&hsa_acc=508938321&hsa_cam=703813944&hsa_grp=322223894&hsa_ad=484900844&hsa_net=linkedin&hsa_ver=3&li_fat_id=9375742f-ec7c-439f-98ba-6d4dbd09ba27
#infrastructure #ai #kubernetes
https://newsletter.betterstack.com/p/how-openai-scaled-kubernetes-to-7500?utm_campaign=Newsletter%2B(all)&utm_source=linkedin&utm_medium=paid&hsa_acc=508938321&hsa_cam=703813944&hsa_grp=322223894&hsa_ad=484900844&hsa_net=linkedin&hsa_ver=3&li_fat_id=9375742f-ec7c-439f-98ba-6d4dbd09ba27
#infrastructure #ai #kubernetes
Betterstack
How OpenAI Scaled Kubernetes to 7,500 Nodes by Removing One Plugin
The one change that improved OpenAI's network.
๐ฅ3
๐ฆContainer monitoring with Grafana: Helpful resources to get started
https://grafana.com/blog/2024/10/02/container-monitoring-with-grafana-helpful-resources-to-get-started/?camp=blog&cnt=containers_might_be_light&mdm=social&src=li
#infrastructure #observability #grafana #devops
https://grafana.com/blog/2024/10/02/container-monitoring-with-grafana-helpful-resources-to-get-started/?camp=blog&cnt=containers_might_be_light&mdm=social&src=li
#infrastructure #observability #grafana #devops
Grafana Labs
Container monitoring with Grafana: Helpful resources to get started | Grafana Labs
Looking to kickstart your container monitoring strategy with Grafana? Here are some best practices and valuable resources to help you do just that.
๐4
๐Rust is not only for writing drivers and system things, Rust is developing and gives the opportunity to write any powerful UI ๐ฒ
https://www.thoughtworks.com/radar/languages-and-frameworks/summary/rust-for-ui
#rust #devops #application
https://www.thoughtworks.com/radar/languages-and-frameworks/summary/rust-for-ui
#rust #devops #application
Thoughtworks
Languages and Frameworks | Technology Radar | Thoughtworks
This Technology Radar quadrant explores programming languages and frameworks
๐2๐ฅ1
๐Cloud gives you great power, but like any great power has its risks and dangers.
The AWS these risks are associated with prices, since you can spend and find out about it in the invoice at the end of the month๐ฒ
But now a very good tool has appeared for solving issues with Finops for AWS, meet ๐๐ผโโ๏ธ CUDOS
https://aws.amazon.com/ru/blogs/awsmarketplace/using-cudos-dashboard-visualizations-aws-marketplace-spend-visibility-optimization/
#infrastructure #monitoring #finops #DevOps #AWSServices
The AWS these risks are associated with prices, since you can spend and find out about it in the invoice at the end of the month๐ฒ
But now a very good tool has appeared for solving issues with Finops for AWS, meet ๐๐ผโโ๏ธ CUDOS
https://aws.amazon.com/ru/blogs/awsmarketplace/using-cudos-dashboard-visualizations-aws-marketplace-spend-visibility-optimization/
#infrastructure #monitoring #finops #DevOps #AWSServices
Amazon
Using CUDOS Dashboard visualizations for AWS Marketplace spend visibility and optimization | Amazon Web Services
In this post, Yuriy and I show how to use the changes to the CUDOS Dashboard in Amazon QuickSight to analyze your AWS Marketplace costs, gain insights, and spot trends.
๐ฅ2๐1
๐ฃVery interesting talk about solving the problem with nailing ci/cd, if #dagger solves this problem it will be a revolution in software development
#infrastructure #devops #application
https://kubernetespodcast.com/episode/236-dagger/
#infrastructure #devops #application
https://kubernetespodcast.com/episode/236-dagger/
Kubernetespodcast
Kubernetes Podcast from Google: Episode 236 - Dagger, with Solomon Hykes
Solomon Hykes is the co-founder of Dagger. He is probably best known as the creator of Docker. The tool that changed how developers package, run and distribute software in the last 11 years. His impact on our industry is undeniable. Today, we discuss hisโฆ
๐ฅ2๐1
โ How does Git Work โ
The diagram below shows the Git workflow.
Git is a distributed version control system.
Every developer maintains a local copy of the main repository and edits and commits to the local copy.
The commit is very fast because the operation doesnโt interact with the remote repository.
If the remote repository crashes, the files can be recovered from the local repositories.
#systemdesign #git #devops
The diagram below shows the Git workflow.
Git is a distributed version control system.
Every developer maintains a local copy of the main repository and edits and commits to the local copy.
The commit is very fast because the operation doesnโt interact with the remote repository.
If the remote repository crashes, the files can be recovered from the local repositories.
#systemdesign #git #devops
๐2๐ฅ1
๐โ๐จStateful vs Stateless Design โ What's the Difference?
Stateless design is a powerful model that has led to the development of simple yet highly scalable and efficient applications.
โStateโ refers to stored information that systems use to process requests. This information can change over time as users interact with the application or as system events occur.
๐ช๐ต๐ฎ๐ ๐ฎ๐ฟ๐ฒ ๐๐๐ฎ๐๐ฒ๐ณ๐๐น ๐ฎ๐ฝ๐ฝ๐น๐ถ๐ฐ๐ฎ๐๐ถ๐ผ๐ป๐?
Stateful applications store data like user IDs, session information, configurations, and preferences to help process requests for a given user. A stateful design allows applications to provide a personalized experience to their users while removing the need to share data across multiple requests.
#applications #systemdesign
Stateless design is a powerful model that has led to the development of simple yet highly scalable and efficient applications.
โStateโ refers to stored information that systems use to process requests. This information can change over time as users interact with the application or as system events occur.
๐ช๐ต๐ฎ๐ ๐ฎ๐ฟ๐ฒ ๐๐๐ฎ๐๐ฒ๐ณ๐๐น ๐ฎ๐ฝ๐ฝ๐น๐ถ๐ฐ๐ฎ๐๐ถ๐ผ๐ป๐?
Stateful applications store data like user IDs, session information, configurations, and preferences to help process requests for a given user. A stateful design allows applications to provide a personalized experience to their users while removing the need to share data across multiple requests.
#applications #systemdesign
๐2๐ฅ1
๐จโ๐จโ๐ฆโ๐ฆ Welcome to the EKS scalability guide, where your Kubernetes clusters can expand faster than your coffee consumption during a code freeze!
This documentation is for developers, devops, admins ready to dive deep into the world of EKSโyour ultimate cheat sheet for scaling tips. Manage your Control Plane like a PRO ๐ธ, wielding its power without getting lost in API calls.
Where the DataPlane is your clusterโs workout planโbecause even pods need to hit the gym! ๐ช๐ผ When it comes to Workloads, remember: theyโre the main event, not just an excuse for more YAML files. If youโre scaling beyond 1,000 nodes, reach out to AWS support ๐ to avoid turning your cluster into chaos. So gear up, embrace the challenge, and may your pods never crashโunless itโs scheduled maintenance! Happy scaling!
#AWS #eks #HighAvailability #kubernetes
https://docs.aws.amazon.com/eks/latest/best-practices/scalability.html
This documentation is for developers, devops, admins ready to dive deep into the world of EKSโyour ultimate cheat sheet for scaling tips. Manage your Control Plane like a PRO ๐ธ, wielding its power without getting lost in API calls.
Where the DataPlane is your clusterโs workout planโbecause even pods need to hit the gym! ๐ช๐ผ When it comes to Workloads, remember: theyโre the main event, not just an excuse for more YAML files. If youโre scaling beyond 1,000 nodes, reach out to AWS support ๐ to avoid turning your cluster into chaos. So gear up, embrace the challenge, and may your pods never crashโunless itโs scheduled maintenance! Happy scaling!
#AWS #eks #HighAvailability #kubernetes
https://docs.aws.amazon.com/eks/latest/best-practices/scalability.html
Amazon
EKS Scalability best practices - Amazon EKS
This guide provides advice for scaling EKS clusters. The goal of scaling an EKS cluster is to maximize the amount of work a single cluster can perform. Using a single, large EKS cluster can reduce operational load compared to using multiple clusters, butโฆ
๐3โค1