Running large language models on a single GPU for throughput-oriented scenarios. - FMInference/FlexLLMGen

This management tendency is the worst part of being a developer. Software development is not carpentry. Almost everything a developer writes is unique, they have never built that particular thing b...

Today was update day1. Then the expected unexpected happened: The ZFS module was missing from initramfs. Desktop's dead in the water. I boot up my laptop to quickly flash an Arch live ISO onto a USB drive, and while at it also upgrade that one. Knowing that…

The $2 trillion venture capital industry could see portfolio markdowns of 25% to 30% — a “haircut” of possibly $500 billion — following the Silicon Valley Bank debacle, according to Bloomberg Intelligence.

Tech chief says the development of chatbots is a more worthwhile use of processing power than crypto mining

My personal website and blog

Free your Apple Notes data from Notes.app. Contribute to HamburgChimps/apple-notes-liberator development by creating an account on GitHub.

An apologia of lazy evaluation As a programming language, laziness is the definitive feature of Haskell. Every other quality such as: highe...

Doubts about both China and the United States are driving an arms race in the Indo-Pacific with echoes of World War II and new levels of risk.

Augment GPT-4 Environment Access. Contribute to refcell/run-wild development by creating an account on GitHub.

Up to 18% of the population suffer from misophonia, or an increased intolerance to certain sounds such as a person chewing. Some people with misophonia report more than simple frustration when exposed to certain noises, they say they feel trapped and helpless…

Since the start of 2023, more than 150,000 people have been laid off at tech companies, large and small. That’s a staggering number of people who have been put out of work.

Mired in debt, a mild-mannered hobbyist becomes an international arms dealer. Soon the UK is flooded with untraceable antique guns and ammunition and police are baffled.

A machine learning researcher writes me in response to yesterday’s post, saying:I still think GPT-2 is a brute-force statistical pattern matcher which blends up the internet and gives you bac…

Cristiano Ronaldo makes 100 times more money than Pelé did in his prime. If you understand why, you’ll know when to expect an AI to take your job.

That is what a book is for.