Byte by Byte
35 subscribers
14 photos
3 videos
1 file
51 links
Bite your bit of tech information and news here. Discuss in our Chip Chat group!
Download Telegram
Valve will support Arch Linux working on critical projects on a freelance basis.
in the meantime, Nvidia are about to open-source and release their multimodal model

https://nvlm-project.github.io/
LLMs don't do any formal reasoning...

A new research on LLMs by six Apple researchers found “no evidence of formal reasoning in language models …. Their behavior is better explained by sophisticated pattern matching—so fragile, in fact, that changing names can alter results by ~10%!”.
👍1
This media is not supported in your browser
VIEW IN TELEGRAM
Microsoft just opensourced a blazing fast inference framework for 1-bit LLMS. Now you can run up to 100B LLMS locally on your CPU (GPU and NPU support coming in the future) and get 5-7 tokens/second.

https://github.com/microsoft/BitNet
Brilliant article on Arm's approach for the future, challenges (AI, Qualcomm and Apple turning into competitors, AMD and Intel joining forces to improve x86) and mini-interview to Christopher Bergey, senior VP and GM of the Client Line of Business at Arm. A very good read.

https://www.theregister.com/AMP/2024/10/22/arm_custom_silicon_interview/
Thomas Eugene Kurtz, father of BASIC, has died peacefully today in his retirement home. He was 96. Thank you, Thomas, for enabling at least two generations of human beings to get to learn and use a personal computer.
This is truly the best time for retro gaming and emulation. Ten years ago I would have sworn we'd never see a working emulator for extremely complex systems such as the PS3 and its IBM Cell, a PowerPC-based CPU. Now RPCS3 runs even on ARM64 CPUs, including Apple Silicon, thus opening a new landscape for PS3 emulation even on extremely portable devices.

For more information on the specific RPCS3 case, read this blog post on their website.
Find your favourite telegram channel admin at FOSDEM 2025 (01-02/February)!
The research paper "All You Need Is Attention" from the Google Research Team that came up with transformers (which radically changed and improved artificial intelligence and gave rise to genAI as we know it) might have found its successor.

https://arxiv.org/abs/2501.00663

Some good discussion and interpretation of results can be found in the comments section here.
Imagine playing a simple game of Hangman with an AI.

You'd think that explaining the game mechanics step-by-step would be enough, but my favorite benchmark test for Large Language Models (LLMs) has consistently highlighted their limitations.

Most LLMs can't successfully play Hangman—even after a detailed explanation. They end up accepting all guesses as correct, fail to understand the turn-based nature of the game, and often mix up who should come up with the blank word or provide guesses. In my recent tests, between the commercially available LLMs, only ChatGPT 4o has been able to play Hangman correctly.

This quirky but telling failure shows that while these models can seem incredibly smart, there's still a big gap between surface-level understanding and actually grasping logical, step-by-step processes. Read more about it in my latest post on Substack.
New post on Substack. Just in time for a good lunch read, I suppose. Don't miss it!

https://atsetilam.substack.com/p/the-fabled-ai-on-the-edge
Asahi Lina left the Asahi Linux project for “personal reasons”. We lost a fantastic developer who was focused on an incredibly difficult and extremely important work - bringing Linux onto the Apple Silicon platform. Such a pity. She says she is “safe”, luckily.
😢3
We got GIMP 3.0 before GTA 6
🔥1
"Model Context Protocol (MCP) is an AI tool calling standard that has been rapidly gaining adoption over the past few months. MCP tools give LLMs a standardized way to call functions, look up data, and interact with the world. Anthropic created the protocol and built the first GitHub MCP server, which grew to be one of the most popular MCP servers in the expanding ecosystem. We are excited to take ownership of the server and continue its development."

https://github.blog/changelog/2025-04-04-github-mcp-server-public-preview/
OpenAI has just released a FOSS CLI tool for “developers who already live in the terminal and want ChatGPT‑level reasoning plus the power to actually run code, manipulate files, and iterate – all under version control”.

https://github.com/openai/codex
Babe wake up, Microsoft released a 1-bit LLM under MIT that is optimized for running on CPUs: microsoft/bitnet-b1.58-2B-4T
Salvatore Sanfilippo (aka antirez) is back!
After stepping away from Redis for some time, he's returned with a major contribution: a brand-new data type called vector sets. This addition brings semantic similarity search to Redis, making it possible to query based on meaning rather than exact matches.

Check it out: https://redis.io/blog/announcing-vector-sets-a-new-redis-data-type-for-vector-similarity