build the code that builds physical objects!
also a thread with a lot of solid experience
https://x.com/seveibar/status/1905443905979715725?s=46
also a thread with a lot of solid experience
https://x.com/seveibar/status/1905443905979715725?s=46
X (formerly Twitter)
Seve (@seveibar) on X
13 things I would have told myself before building an autorouter đ§”
Iâve spent about a year working on an autorouter for tscircuit (an open-source electronics CAD kernel written in Typescript). If I could go back a year, these are the 13 things I would tellâŠ
Iâve spent about a year working on an autorouter for tscircuit (an open-source electronics CAD kernel written in Typescript). If I could go back a year, these are the 13 things I would tellâŠ
glimpse of ASI (narrow domain, still interesting as a workflow)
https://www.pnas.org/doi/10.1073/pnas.2406675122
https://www.pnas.org/doi/10.1073/pnas.2406675122
PNAS
Bridging the humanâAI knowledge gap through concept discovery and transfer in AlphaZero | PNAS
AI systems have attained superhuman performance across various domains. If the hidden
knowledge encoded in these highly capable systems can be leve...
knowledge encoded in these highly capable systems can be leve...
backpropagation-free training, this time much more efficient. small datasets tho.
https://arxiv.org/abs/2503.24322
https://arxiv.org/abs/2503.24322
arXiv.org
NoProp: Training Neural Networks without Back-propagation or...
The canonical deep learning approach for learning requires computing a gradient term at each layer by back-propagating the error signal from the output towards each learnable parameter. Given the...
Karpathy delivers: while LLMs ship slop 90% of the time they empower individuals with access to skill diversity previously available to corporations only.
the catch? your job now is to filter thru all that slop.
No, you can't delegate that.
https://x.com/karpathy/status/1909308143156240538?s=46
the catch? your job now is to filter thru all that slop.
No, you can't delegate that.
https://x.com/karpathy/status/1909308143156240538?s=46
llm "hallucinations", human anxiety and a lot of other things have one thing in common: trying to do something when the optimal decision would be to do nothing this time
https://www.evanmiller.org/attention-is-off-by-one.html
https://www.evanmiller.org/attention-is-off-by-one.html
www.evanmiller.org
Attention Is Off By One
Letâs fix these pesky Transformer outliers using Softmax One and QuietAttention.
this looks like a nice middle ground between rigid electrode arrays and [very finicky] external EM field/electricity BCI interfaces.
still needs survery but i guess we might eventually get to the implants that just grow into you [just a speculation though]
https://actu.epfl.ch/news/soft-brainstem-implant-delivers-high-resolution--2/
still needs survery but i guess we might eventually get to the implants that just grow into you [just a speculation though]
https://actu.epfl.ch/news/soft-brainstem-implant-delivers-high-resolution--2/
actu.epfl.ch
Soft brainstem implant delivers high-resolution hearing
EPFL researchers have developed a flexible auditory brainstem implant (ABI) that closely conforms to the curved surface of the brainstem. The technology has been successfully demonstrated high-resolution âprosthetic hearingâ in macaques.
i'd say if you take the model far enough OOD from the sequence of chat sentences it will do whatever you want
in other words, the space of jailbreaks is infinite.
https://hiddenlayer.com/innovation-hub/novel-universal-bypass-for-all-major-llms/
in other words, the space of jailbreaks is infinite.
https://hiddenlayer.com/innovation-hub/novel-universal-bypass-for-all-major-llms/
HiddenLayer | Security for AI
Novel Universal Bypass for All Major LLMs
HiddenLayerâs latest research uncovers a universal prompt injection bypass impacting GPT-4, Claude, Gemini, and more, exposing major LLM security gaps.
Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
nice paper, what's interesting is that graph databases make almost no difference in their tests, compared to just a vector store of facts distilled from history
https://mem0.ai/research
nice paper, what's interesting is that graph databases make almost no difference in their tests, compared to just a vector store of facts distilled from history
https://mem0.ai/research
This media is not supported in your browser
VIEW IN TELEGRAM
https://github.com/jessevig/bertviz is an interactive llm visualizer; be sure to play with it while i'm trying to find the time to >_<
programmable matter/software defined labs is the future of R&D
https://arxiv.org/abs/2408.09171
https://arxiv.org/abs/2408.09171
arXiv.org
Chemputer and Chemputation - A Universal Chemical Compound...
Chemputation, the execution of code controlled reaction pathways on universally reconfigurable hardware, offers a route to treating chemical synthesis as a formally computable i.e. chemputable...
self-contained software engineering company as a benchmark
https://arxiv.org/abs/2412.14161
https://arxiv.org/abs/2412.14161
arXiv.org
TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
We interact with computers on an everyday basis, be it in everyday life or work, and many aspects of work can be done entirely with access to a computer and the Internet. At the same time, thanks...
turns out pre-training on 4chan is an important part of aligning the LLMs
https://arxiv.org/abs/2505.04741
https://arxiv.org/abs/2505.04741
arXiv.org
When Bad Data Leads to Good Models
In large language model (LLM) pretraining, data quality is believed to determine model quality. In this paper, we re-examine the notion of "quality" from the perspective of pre- and post-training...
Terence Tao shows how to use LLMs for math.
Interesting because making formal spec drafts from informal descriptions to feed into discrete solvers is the way to get results that are exact, not approximate.
https://www.youtube.com/watch?v=zZr54G7ec7A
Interesting because making formal spec drafts from informal descriptions to feed into discrete solvers is the way to get results that are exact, not approximate.
https://www.youtube.com/watch?v=zZr54G7ec7A
YouTube
Formalizing a proof in Lean using Claude and o4
Following on from the previous video at https://www.youtube.com/watch?v=cyyR7j2ChCI, I now attempt to formalize a different proof of the same assertion using the large language models Claude 3.4 Sonnet and o4-mini-high, after giving them the informal andâŠ
for all (surveyed) large enough models, embeddings converge to projections legible/interpretable without access to the model itself, not even as a blackbox đ€Ż
https://arxiv.org/abs/2505.12540
https://arxiv.org/abs/2505.12540
arXiv.org
Harnessing the Universal Geometry of Embeddings
We introduce the first method for translating text embeddings from one vector space to another without any paired data, encoders, or predefined sets of matches. Our unsupervised approach...
https://eprint.iacr.org/2025/118 interesting preprint re ZK vulnerability
IACR Cryptology ePrint Archive
How to Prove False Statements: Practical Attacks on Fiat-Shamir
The Fiat-Shamir (FS) transform is a prolific and powerful technique for compiling public-coin interactive protocols into non-interactive ones. Roughly speaking, the idea is to replace the random coins of the verifier with the evaluations of a complex hashâŠ
https://engineering.fb.com/2025/04/29/security/whatsapp-private-processing-ai-tools/
who would've thought
who would've thought
Engineering at Meta
Building Private Processing for AI tools on WhatsApp
We are inspired by the possibilities of AI to help people be more creative, productive, and stay closely connected on WhatsApp, so we set out to build a new technology that allows our users around âŠ
raw sensors are kind of hard to improve right now (they're effectively photon counters for some time already), but CPUs are improved so we can combine the data acquired in much more clever ways than just averaging
https://www.science.org/doi/10.1126/scirobotics.adj8124
https://www.science.org/doi/10.1126/scirobotics.adj8124
Science Robotics
Microsaccade-inspired event camera for robotics
An artificial microsaccadeâenhanced event camera for varied vision tasks in challenging scenarios is proposed.
not your weights - not your data
i wonder if openai will just disable logging while the case is in progress because rn the order is to preserve the logs, not to log
https://simonwillison.net/2025/Jun/5/openai-court-order/
i wonder if openai will just disable logging while the case is in progress because rn the order is to preserve the logs, not to log
https://simonwillison.net/2025/Jun/5/openai-court-order/
Simon Willisonâs Weblog
OpenAI slams court order to save all ChatGPT logs, including deleted chats
This is very worrying. The New York Times v OpenAI lawsuit, now in its 17th month, includes accusations that OpenAI's models can output verbatim copies of New York Times content âŠ
effects lasting for at least a month, interesting
https://www.ucsf.edu/news/2025/04/429906/how-magic-mushrooms-could-help-parkinsons-disease-patients
https://www.ucsf.edu/news/2025/04/429906/how-magic-mushrooms-could-help-parkinsons-disease-patients
How âMagic Mushroomsâ Could Help Parkinsonâs Disease Patients | UC San Francisco
How âMagic Mushroomsâ Could Help Parkinsonâs Disease Patients
A first-of-its-kind study tested the safety of psilocybin on patients with mild to moderate Parkinsonâs disease and found that patients experienced clinically significant improvements in mood, cognition, and motor function that lasted for weeks after theâŠ
This media is not supported in your browser
VIEW IN TELEGRAM
4D video. right in your browser. works on modern phones as well
https://www.4dv.ai/viewer/salmon_10s?showdemo=4dv
reminds me of my voxel experiments back in 2008. little did i know how much more compute would be required to get it to be real-time, yet here we are
https://www.4dv.ai/viewer/salmon_10s?showdemo=4dv
reminds me of my voxel experiments back in 2008. little did i know how much more compute would be required to get it to be real-time, yet here we are