Hello everyone βA very tasty π― video from Victor arrived, a very cool concept of a continuous delivery pipeline with gitops approaches on my favorite today's stack of technology
#crossplane #argocd #aws #github_actions #eks
π "Automate Everything: How One Manifest Powers Your Entire DevOps Pipeline"
https://youtu.be/IEgXJEkjBZ0
#crossplane #argocd #aws #github_actions #eks
π "Automate Everything: How One Manifest Powers Your Entire DevOps Pipeline"
https://youtu.be/IEgXJEkjBZ0
YouTube
Automate Everything: How One Manifest Powers Your Entire DevOps Pipeline
Dive into the essentials of setting up developer platform and enabling developers to start new projects effortlessly. In this video, we explore how to create a seamless interface for developers using Crossplane, GitHub, and Argo CD. Learn how to automateβ¦
π2
What does API gateway do?π΅πΌ
π£ (1) The client sends an HTTP request to the API gateway.
π£ (2) The API gateway parses and validates the attributes in the HTTP request.
π£ (3) The API gateway performs allow-list/deny-list checks.
π£ (4) The API gateway talks to an identity provider for authentication and authorization.
π£ (5) The rate limiting rules are applied to the request. If it is over the limit, the request is rejected.
π£ (6,7) Now that the request has passed basic checks, the API gateway finds the relevant service to route to by path matching.
π£ (8) The API gateway transforms the request into the appropriate protocol and sends it to backend microservices.
π£ (9-12) The API gateway can handle errors properly, and deals with faults if the error takes a longer time to recover (circuit break). It can also leverage ELK (Elastic-Logstash-Kibana) stack for logging and monitoring. We sometimes cache data in the API gateway.
#api #app #architecture
#SystemDesign #HTTP
π£ (1) The client sends an HTTP request to the API gateway.
π£ (2) The API gateway parses and validates the attributes in the HTTP request.
π£ (3) The API gateway performs allow-list/deny-list checks.
π£ (4) The API gateway talks to an identity provider for authentication and authorization.
π£ (5) The rate limiting rules are applied to the request. If it is over the limit, the request is rejected.
π£ (6,7) Now that the request has passed basic checks, the API gateway finds the relevant service to route to by path matching.
π£ (8) The API gateway transforms the request into the appropriate protocol and sends it to backend microservices.
π£ (9-12) The API gateway can handle errors properly, and deals with faults if the error takes a longer time to recover (circuit break). It can also leverage ELK (Elastic-Logstash-Kibana) stack for logging and monitoring. We sometimes cache data in the API gateway.
#api #app #architecture
#SystemDesign #HTTP
π3
How its Linux Boot Process works ? π΅π»ββοΈ
π When we turn on the power, BIOS or UEFI firmware is loaded from non-volatile memory, and executes POST (Power On Self Test).
π½ BIOS/UEFI detects the devices connected to the system, including CPU, RAM, and storage.
πΏ Choose a booting device to boot the OS from. This can be the hard drive, the network server, or CD ROM.
π BIOS/UEFI runs the boot loader (GRUB), which provides a menu to choose the OS or the kernel functions.
π₯ After the kernel is ready, we now switch to the user space. The kernel starts up systemd as the first user-space process, which manages the processes and services, probes all remaining hardware, mounts filesystems, and runs a desktop environment.
π systemd activates the default. target unit by default when the system boots. Other analysis units are executed as well.
πThe system runs a set of startup scripts and configure the environment.
π±The users are presented with a login window. The system is now ready.
#linux #boot #systemdesign
π When we turn on the power, BIOS or UEFI firmware is loaded from non-volatile memory, and executes POST (Power On Self Test).
π½ BIOS/UEFI detects the devices connected to the system, including CPU, RAM, and storage.
πΏ Choose a booting device to boot the OS from. This can be the hard drive, the network server, or CD ROM.
π BIOS/UEFI runs the boot loader (GRUB), which provides a menu to choose the OS or the kernel functions.
π₯ After the kernel is ready, we now switch to the user space. The kernel starts up systemd as the first user-space process, which manages the processes and services, probes all remaining hardware, mounts filesystems, and runs a desktop environment.
π systemd activates the default. target unit by default when the system boots. Other analysis units are executed as well.
πThe system runs a set of startup scripts and configure the environment.
π±The users are presented with a login window. The system is now ready.
#linux #boot #systemdesign
π3
Unleashing the Power of Cluster API: Extensibility and Customization - Zain Malik & Nibir Bora
#presentation #kubecon2024 #china #kubernetes
https://www.youtube.com/watch?v=nIWy1Hzl_oQ
#presentation #kubecon2024 #china #kubernetes
https://www.youtube.com/watch?v=nIWy1Hzl_oQ
YouTube
Unleashing the Power of Cluster API: Extensibility and Customization - Zain Malik & Nibir Bora
Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the educationβ¦
π3
Kubernetes as a Platform Framework: Journey from IaC Pipelines to K8s APIs - Christina Andonov, AWS
#presentation #kubernetes #gitops
https://www.youtube.com/watch?v=TBzy0QPOyY4
#presentation #kubernetes #gitops
https://www.youtube.com/watch?v=TBzy0QPOyY4
YouTube
Kubernetes as a Platform Framework: Journey from IaC Pipelines to K8s APIs - Christina Andonov, AWS
Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the educationβ¦
π3
There are more than 500+ Kubernetes Certified Service Providers and tons of Kubernetes Certified distributions. Choosing a right distribution can be a daunting task. Kubetools is built with a purpose to build a curated list of popular Kubernetes toolsπ
#kubernetes #devops #infrastructure
https://collabnix.github.io/kubetools
#kubernetes #devops #infrastructure
https://collabnix.github.io/kubetools
π₯3
πIn my opinion, KCL is a very promising thing for reliable and fast writing of configuration for any purpose, be it the cloud or just for applications
KCL: Simplifying Kubernetes Manifests Management
#devops #configuration #infrastructure
https://www.kcl-lang.io/blog/2024-08-29-kubecon2024
KCL: Simplifying Kubernetes Manifests Management
#devops #configuration #infrastructure
https://www.kcl-lang.io/blog/2024-08-29-kubecon2024
www.kcl-lang.io
KCL at KubeCon China 2024 | KCL programming language.
At KubeCon China 2024, held from August 21st to 23rd, a 3-day event in Hong Kong, KCL participated in the event and shared its efforts in simplifying Kubernetes manifests management.
π4
π± Typical AWS Network Architecture in one diagram.
π£Internet Gateway (IGW) serves as the doorway between your AWS VPC and the internet.
π£Remote Workers AWS offers a Client VPN service that enables remote workers to access securely over the internet.
π£VGW is the VPN concentrator on the Amazon side of the Site-to-Site VPN connection between your network and your VPC.
π£VPC Peering allows you to connect two VPCs.
π£AWS Transit Gateway acts as a network transit hub, enabling you to connect multiple VPCs, VPNs, and AWS accounts together.
π£VPC Endpoint (Gateway type) allows you to privately connect your VPC to supported AWS services and VPC endpoint services powered by PrivateLink without requiring an internet gateway, VPN.
π£Interface VPC Endpoint enables private connections between your VPC and supported AWS services.
π£SaaS AWS Private Link Connection provides private connectivity between VPCs and services hosted on AWS or on-premises.
#aws #infrastructure #network
π£Internet Gateway (IGW) serves as the doorway between your AWS VPC and the internet.
π£Remote Workers AWS offers a Client VPN service that enables remote workers to access securely over the internet.
π£VGW is the VPN concentrator on the Amazon side of the Site-to-Site VPN connection between your network and your VPC.
π£VPC Peering allows you to connect two VPCs.
π£AWS Transit Gateway acts as a network transit hub, enabling you to connect multiple VPCs, VPNs, and AWS accounts together.
π£VPC Endpoint (Gateway type) allows you to privately connect your VPC to supported AWS services and VPC endpoint services powered by PrivateLink without requiring an internet gateway, VPN.
π£Interface VPC Endpoint enables private connections between your VPC and supported AWS services.
π£SaaS AWS Private Link Connection provides private connectivity between VPCs and services hosted on AWS or on-premises.
#aws #infrastructure #network
β€3
What does ACID mean? For SQL π
πΉ Atomicity
The writes in a transaction are executed all at once and cannot be broken into smaller parts. If there are faults when executing the transaction, the writes in the transaction are rolled back.
πΉ Consistency
Unlike βconsistencyβ in CAP theorem, which means every read receives the most recent write or an error, here consistency means preserving database invariants. Any data written by a transaction must be valid according to all defined rules and maintain the database in a good state.
πΉ Isolation
When there are concurrent writes from two different transactions, the two transactions are isolated from each other. The most strict isolation is βserializabilityβ, where each transaction acts like it is the only transaction running in the database. However, this is hard to implement in reality, so we often adopt loser isolation level.
πΉ Durability
Data is persisted after a transaction is committed even in a system failure.
#databases #infrastructure #devops #SQL
πΉ Atomicity
The writes in a transaction are executed all at once and cannot be broken into smaller parts. If there are faults when executing the transaction, the writes in the transaction are rolled back.
πΉ Consistency
Unlike βconsistencyβ in CAP theorem, which means every read receives the most recent write or an error, here consistency means preserving database invariants. Any data written by a transaction must be valid according to all defined rules and maintain the database in a good state.
πΉ Isolation
When there are concurrent writes from two different transactions, the two transactions are isolated from each other. The most strict isolation is βserializabilityβ, where each transaction acts like it is the only transaction running in the database. However, this is hard to implement in reality, so we often adopt loser isolation level.
πΉ Durability
Data is persisted after a transaction is committed even in a system failure.
#databases #infrastructure #devops #SQL
β€2π1π₯1
This media is not supported in your browser
VIEW IN TELEGRAM
What happens when a junior DevOps specialist is forced into the main branch of the production infrastructure ? π€ͺ
#humor #git #devops
#humor #git #devops
π₯3
Kubernetes question for devops interview?
#kubernetes #containers #interview
What computing resources can we allocate for pods (containers) in limits?
#kubernetes #containers #interview
What computing resources can we allocate for pods (containers) in limits?
Final Results
0%
Memory, Cpu, Inodes
22%
Memory, Cpu, Gpu
67%
Memory, Cpu
11%
Memory, Cpu, Inodes, Iops
π1
The_Practical_Guide_to_Internal_Developer_Portals_compressed_1.pdf
26.3 MB
π I bring to your attention some very interesting thoughts from the mini-guide from the Port https://www.getport.io/ , in which you will find out.
ππΌ The next big thing in DevOps is platform engineering, and the main tool it uses is the internal developer portal. Read this guide to understand what can be done with portals and why they matter.
#books #guide #devops #platformengineering
ππΌ The next big thing in DevOps is platform engineering, and the main tool it uses is the internal developer portal. Read this guide to understand what can be done with portals and why they matter.
#books #guide #devops #platformengineering
π1
πΎA Linux file system is the method and data structure that Linux uses to control how data is stored and retrieved on a disk. Without a file system, data placed in a storage device would be a large body of data with no way to tell where one piece of data ends and the next begins. The file system is what allows Linux to organize data into files and directories, making it easier to access and manage
π² Main Directory's Structure:
/root directory (
/bin Essential user binaries
/etc Configuration files
/home User home directories
/var Variable files
/tmp Temporary files.
Linux's flexible file system design allows for multiple types of file systems to coexist and be used according to the needs of the system or storage.
#infrastructure #linux #devops
π² Main Directory's Structure:
/root directory (
/) is the topmost directory in the Linux file system hierarchy. It serves as the starting point from which all other files and directories branch out. Every file and directory on a Linux system can be accessed by following a path from //bin Essential user binaries
/etc Configuration files
/home User home directories
/var Variable files
/tmp Temporary files.
Linux's flexible file system design allows for multiple types of file systems to coexist and be used according to the needs of the system or storage.
#infrastructure #linux #devops
β€2
π« Very useful tips that you need to follow when developing an application that works with AWS S3, in order to avoid large expenses in the future.
#aws #devops #infrastructure #application
https://medium.com/@paulgoll/how-to-lose-money-with-aws-s3-a-cautionary-tale-c48549bee6ac
#aws #devops #infrastructure #application
https://medium.com/@paulgoll/how-to-lose-money-with-aws-s3-a-cautionary-tale-c48549bee6ac
Medium
How to Lose Money with AWS S3: 2024 Cost and Price Update
Amazon S3 is a powerful and cost-effective cloud storage solution, but without proper cost control measures, your monthly bill can quicklyβ¦
π2π₯1
π This post contains up-to-date information on sites for finding a it (devops) remotely job in companies and startups.
1οΈβ£ Of course, https://www.linkedin.com/. This social network is one of the most important broadcasters of vacancies in the IT sphere. In order to receive more offers, it would be nice to pump up your profile.
2οΈβ£ https://angel.co/jobs - Platform for finding jobs in startups.
3οΈβ£ https://weworkremotely.com/ - The largest remote work community in the world. With over 4.5 million visitors, WWR is the number one place to find work.
4οΈβ£ https://indeed.com - Will help you find remote work all over the world.
5οΈβ£ https://www.fiverr.com/ - Work for IT specialists, mostly freelance.
6οΈβ£ https://remotive.com/ - Large community to help remote workers.
7οΈβ£ https://remoteok.com/ - Not a bad job search engine. No need to create an account, you will simply be asked to send your resume or portfolio to email addresses after you fill out the form.
8οΈβ£ https://www.idealist.org/ - A good platform with a large number of different internships, including remote ones.
9οΈβ£ https://dribbble.com/ - Site mainly for designers, lots of remote vacancies.
π https://www.glassdoor.com/ - The site offers the ability to search for vacancies in most countries.
1οΈβ£1οΈβ£ https://www.jobisjob.com/ - I would especially like to highlight this - an excellent resource that collects offers from all sites practically from all over the world.
1οΈβ£2οΈβ£ https://www.monster.com/ - Large international portal. First, it offers to decide on the geography of future work, and then look at the results.
1οΈβ£3οΈβ£ https://www.dice.com/ - Similar to the previous one, it is considered one of the best resources for finding technical and engineering jobs.
1οΈβ£4οΈβ£ https://www.careerbuilder.com/regional_sites - An interesting portal for finding work in the USA.
I hope this post will be useful to start your career! π€
1οΈβ£ Of course, https://www.linkedin.com/. This social network is one of the most important broadcasters of vacancies in the IT sphere. In order to receive more offers, it would be nice to pump up your profile.
2οΈβ£ https://angel.co/jobs - Platform for finding jobs in startups.
3οΈβ£ https://weworkremotely.com/ - The largest remote work community in the world. With over 4.5 million visitors, WWR is the number one place to find work.
4οΈβ£ https://indeed.com - Will help you find remote work all over the world.
5οΈβ£ https://www.fiverr.com/ - Work for IT specialists, mostly freelance.
6οΈβ£ https://remotive.com/ - Large community to help remote workers.
7οΈβ£ https://remoteok.com/ - Not a bad job search engine. No need to create an account, you will simply be asked to send your resume or portfolio to email addresses after you fill out the form.
8οΈβ£ https://www.idealist.org/ - A good platform with a large number of different internships, including remote ones.
9οΈβ£ https://dribbble.com/ - Site mainly for designers, lots of remote vacancies.
π https://www.glassdoor.com/ - The site offers the ability to search for vacancies in most countries.
1οΈβ£1οΈβ£ https://www.jobisjob.com/ - I would especially like to highlight this - an excellent resource that collects offers from all sites practically from all over the world.
1οΈβ£2οΈβ£ https://www.monster.com/ - Large international portal. First, it offers to decide on the geography of future work, and then look at the results.
1οΈβ£3οΈβ£ https://www.dice.com/ - Similar to the previous one, it is considered one of the best resources for finding technical and engineering jobs.
1οΈβ£4οΈβ£ https://www.careerbuilder.com/regional_sites - An interesting portal for finding work in the USA.
I hope this post will be useful to start your career! π€
Wellfound
Find Startup Jobs Near You and Remote Jobs
Search through thousands of startup jobs, across any location or remote, hiring for software engineers, product managers, designers, marketing, sales, and more.
π2β€1
π What is Docker?
Docker allows you to package an application with all its dependencies into a standardized unit for software development and deployment.
Key Concepts:
πͺ Containers
- Lightweight, standalone executable packages
- Include everything needed to run an application
- Ensure consistency across different environments
π« Images
- Read-only templates used to create containers
- Built from layers, each representing an instruction in the Dockerfile
- Can be shared via Docker Hub or private registries
π Dockerfile
- Text file containing instructions to build a Docker image
- Defines the environment inside the container
- Automates the image creation process
πGetting Started:
1. Install Docker
2. Familiarize yourself with basic commands (docker run, build, pull, push)
3. Create your first Dockerfile and build an image
4. Experiment with Docker Compose for multi-container setups
5. Explore Docker Hub for pre-built images and inspiration
Docker allows you to package an application with all its dependencies into a standardized unit for software development and deployment.
Key Concepts:
πͺ Containers
- Lightweight, standalone executable packages
- Include everything needed to run an application
- Ensure consistency across different environments
π« Images
- Read-only templates used to create containers
- Built from layers, each representing an instruction in the Dockerfile
- Can be shared via Docker Hub or private registries
π Dockerfile
- Text file containing instructions to build a Docker image
- Defines the environment inside the container
- Automates the image creation process
πGetting Started:
1. Install Docker
2. Familiarize yourself with basic commands (docker run, build, pull, push)
3. Create your first Dockerfile and build an image
4. Experiment with Docker Compose for multi-container setups
5. Explore Docker Hub for pre-built images and inspiration
π2