90 Days Of DevOps.

#devops #kubernetes #ansible #backup #networking #containers #terraform #iac #learning #k8s

Asynq is a Go library for queueing tasks and processing them asynchronously with workers. It's backed by Redis and is designed to be scalable yet easy to get started.

Highlevel overview of how Asynq works:

- Client puts tasks on a queue
- Server pulls tasks off queues and starts a worker goroutine for each task
- Tasks are processed concurrently by multiple workers

#golang #go #async #queueing #tasks #processing #redis

PocketBase is an open source Go backend, consisting of:


— embedded database (SQLite) with realtime subscriptions
— built-in files and users management
— convenient Admin dashboard UI
— and simple REST-ish API

#golang #go #backend #rest #api #realtime

Today mimesis has been designated as a critical project on PyPI.

It's ain't much, but I feel warm when I think about how many people use think I built.

Thank you everyone!

P.S If you don't know what the hell mimesis is, then go and check it out. Maybe you'll find it useful for you.

#mimesis #pypi #python

croc is a tool that allows any two computers to simply and securely transfer files and folders. AFAIK, croc is the only CLI file-transfer tool that does all of the following:

• allows any two computers to transfer data (using a relay)
• provides end-to-end encryption (using PAKE)
• enables easy cross-platform transfers (Windows, Linux, Mac)
• allows multiple file transfers
• allows resuming transfers that are interrupted
• local server or port-forwarding not needed
• ipv6-first with ipv4 fallback
• can use proxy, like tor

#golang #go #cli #e2e

Poem Framework is a full-featured and easy-to-use web framework with the Rust programming language.

#rust #web #framework

Polars is a blazingly fast DataFrames library implemented in Rust using Apache Arrow Columnar Format as memory model.

Features:

• Lazy | eager execution
• Multi-threaded
• SIMD
• Query optimization
• Powerful expression API
• Rust | Python | Node

#rust #python #dataframes #arrow #apache

Ludwig is an open-source, declarative machine learning framework that makes it easy to define deep learning pipelines with a simple and flexible data-driven configuration system. Ludwig is suitable for a wide variety of AI tasks, and is hosted by the Linux Foundation AI & Data.

Ludwig allows users to define their deep learning pipeline by simply providing a configuration file, which lists the inputs and outputs, and their respective data types. Ludwig will then assemble and train a deep learning model and based on the configuration file, determine how inputs and outputs are preprocessed, encoded, decoded and which metrics and loss criterion to use.


#python #learning #datascience #machinelearning #nlp #cv #pytorch

Modin is a drop-in replacement for pandas. While pandas is single-threaded, Modin lets you instantly speed up your workflows by scaling pandas so it uses all of your cores. Modin works especially well on larger datasets, where pandas becomes painfully slow or runs out of memory.

#python #pandas #datascience #sql #analytics #distributed #dataframe

just is a handy way to save and run project-specific commands.

#rust #make #commands

Itertools in Python 3, By Example.

It has been called a “gem” and “pretty much the coolest thing ever,” and if you have not heard of it, then you are missing out on one of the greatest corners of the Python 3 standard library: itertools.

A handful of excellent resources exist for learning what functions are available in the itertools module. The docs themselves are a great place to start. So is this post.

The thing about itertools, though, is that it is not enough to just know the definitions of the functions it contains. The real power lies in composing these functions to create fast, memory-efficient, and good-looking code.

This article takes a different approach. Rather than introducing itertools to you one function at a time, you will construct practical examples designed to encourage you to “think iteratively.” In general, the examples will start simple and gradually increase in complexity.

#python #realpython #article #itertools

CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.

#rust #database #high #performance #distributed #cloud

Tokio is an event-driven, non-blocking I/O platform for writing asynchronous applications with the Rust programming language. At a high level, it provides a few major components:

- A multithreaded, work-stealing based task scheduler.
- A reactor backed by the operating system's event queue (epoll, kqueue, IOCP, etc...).
- Asynchronous TCP and UDP sockets.

These components provide the runtime components necessary for building an asynchronous application.

#rust #async #io #tokio #tcp #udp #multithreaded #asynchronous #rs

Building an API with Rust using Tokio and Warp.

A sample project that uses Warp and Tokio to build a simple asynchronous API.

This tutorial introduces the Warp framework by building an asynchronous CRUD API. I wrote this with the following goals in mind:

1. Become familiar with the Warp framework.
2. Become more familiar with using async/await in Rust
3. Get a better understanding of API design in Rust

#rust #article #tokio #web #medium

Practical Cryptography With Go.

This is a book about cryptography: how to communicate securely. There are several objectives that cryptography aims to solve: confidentiality, integrity, and authenticity. It also helps solve some other problems that come up in secure communications, but it’s important to remember that it isn’t a complete solution to security problems. In this book, we’ll look at how to build secure systems; some of the problems that cryptography does not solve will also be pointed out. This book will attempt to guide you in your attempt to understand how to use cryptography to secure your services, and illustrate it using the Go programming language.

#go #book #free #cryptography

Joy of Elixir is a gentle introduction to programming, aimed at people who already know some things about computers, but who have little-to-no programming experience. If you think you don't know enough about computers, well you got here already and that's enough!

This book will teach you the core concepts of the Elixir programming language in a fun and enjoyable way. If you're completely new to programming and you want to learn how to make a computer do things using the power of programming and you want to experience some joy while doing it, then read on!

#elixir #otp #erlang #book #free

Git Immersion is a guided tour that walks through the fundamentals of Git, inspired by the premise that to know a thing is to do it.

#book #git #guide #tour

Tortoise ORM is an easy-to-use asyncio ORM (Object Relational Mapper) inspired by Django.

Tortoise ORM was built with relations in mind and admiration for the excellent and popular Django ORM. It's engraved in its design that you are working not with just tables, you work with relational data.

#python #asyncio #async #orm #database #postgres #sqlite #mysql

aiofiles is a library for handling local disk files in asyncio applications.

Ordinary local file IO is blocking, and cannot easily and portably made asynchronous. This means doing file IO may interfere with asyncio applications, which shouldn't block the executing thread. aiofiles helps with this by introducing asynchronous versions of files that support delegating operations to a separate thread pool.

#python #asyncio #io #files

There are almost 1000 of us now. If you enjoy this channel, share it with your friends, coulleges and cats.

I’ll be posting 10 great tools and libraries a day during the week when we reach 1000.

Thank you all, fellows! 🍻