turns out pre-training on 4chan is an important part of aligning the LLMs
https://arxiv.org/abs/2505.04741
https://arxiv.org/abs/2505.04741
arXiv.org
When Bad Data Leads to Good Models
In large language model (LLM) pretraining, data quality is believed to determine model quality. In this paper, we re-examine the notion of "quality" from the perspective of pre- and post-training...
👍1😱1
Terence Tao shows how to use LLMs for math.
Interesting because making formal spec drafts from informal descriptions to feed into discrete solvers is the way to get results that are exact, not approximate.
https://www.youtube.com/watch?v=zZr54G7ec7A
Interesting because making formal spec drafts from informal descriptions to feed into discrete solvers is the way to get results that are exact, not approximate.
https://www.youtube.com/watch?v=zZr54G7ec7A
YouTube
Formalizing a proof in Lean using Claude and o4
Following on from the previous video at https://www.youtube.com/watch?v=cyyR7j2ChCI, I now attempt to formalize a different proof of the same assertion using the large language models Claude 3.4 Sonnet and o4-mini-high, after giving them the informal and…
👍3
for all (surveyed) large enough models, embeddings converge to projections legible/interpretable without access to the model itself, not even as a blackbox 🤯
https://arxiv.org/abs/2505.12540
https://arxiv.org/abs/2505.12540
arXiv.org
Harnessing the Universal Geometry of Embeddings
We introduce the first method for translating text embeddings from one vector space to another without any paired data, encoders, or predefined sets of matches. Our unsupervised approach...
🔥3
https://eprint.iacr.org/2025/118 interesting preprint re ZK vulnerability
IACR Cryptology ePrint Archive
How to Prove False Statements: Practical Attacks on Fiat-Shamir
The Fiat-Shamir (FS) transform is a prolific and powerful technique for compiling public-coin interactive protocols into non-interactive ones. Roughly speaking, the idea is to replace the random coins of the verifier with the evaluations of a complex hash…
👾1
https://engineering.fb.com/2025/04/29/security/whatsapp-private-processing-ai-tools/
who would've thought
who would've thought
Engineering at Meta
Building Private Processing for AI tools on WhatsApp
We are inspired by the possibilities of AI to help people be more creative, productive, and stay closely connected on WhatsApp, so we set out to build a new technology that allows our users around …
😁2
raw sensors are kind of hard to improve right now (they're effectively photon counters for some time already), but CPUs are improved so we can combine the data acquired in much more clever ways than just averaging
https://www.science.org/doi/10.1126/scirobotics.adj8124
https://www.science.org/doi/10.1126/scirobotics.adj8124
Science Robotics
Microsaccade-inspired event camera for robotics
An artificial microsaccade–enhanced event camera for varied vision tasks in challenging scenarios is proposed.
👍1👾1
not your weights - not your data
i wonder if openai will just disable logging while the case is in progress because rn the order is to preserve the logs, not to log
https://simonwillison.net/2025/Jun/5/openai-court-order/
i wonder if openai will just disable logging while the case is in progress because rn the order is to preserve the logs, not to log
https://simonwillison.net/2025/Jun/5/openai-court-order/
Simon Willison’s Weblog
OpenAI slams court order to save all ChatGPT logs, including deleted chats
This is very worrying. The New York Times v OpenAI lawsuit, now in its 17th month, includes accusations that OpenAI's models can output verbatim copies of New York Times content …
👏1
effects lasting for at least a month, interesting
https://www.ucsf.edu/news/2025/04/429906/how-magic-mushrooms-could-help-parkinsons-disease-patients
https://www.ucsf.edu/news/2025/04/429906/how-magic-mushrooms-could-help-parkinsons-disease-patients
How ‘Magic Mushrooms’ Could Help Parkinson’s Disease Patients | UC San Francisco
How ‘Magic Mushrooms’ Could Help Parkinson’s Disease Patients
A first-of-its-kind study tested the safety of psilocybin on patients with mild to moderate Parkinson’s disease and found that patients experienced clinically significant improvements in mood, cognition, and motor function that lasted for weeks after the…
👍1😎1
This media is not supported in your browser
VIEW IN TELEGRAM
4D video. right in your browser. works on modern phones as well
https://www.4dv.ai/viewer/salmon_10s?showdemo=4dv
reminds me of my voxel experiments back in 2008. little did i know how much more compute would be required to get it to be real-time, yet here we are
https://www.4dv.ai/viewer/salmon_10s?showdemo=4dv
reminds me of my voxel experiments back in 2008. little did i know how much more compute would be required to get it to be real-time, yet here we are
😎2
what if moderating corticotropin can help with memory under/after stress?
https://www.jneurosci.org/content/early/2025/05/30/JNEUROSCI.2146-24.2025
https://www.jneurosci.org/content/early/2025/05/30/JNEUROSCI.2146-24.2025
Journal of Neuroscience
Role of Hypothalamic CRH Neurons in Regulating the Impact of Stress on Memory and Sleep
Stress profoundly affects sleep and memory processes. Stress impairs memory consolidation and, similarly, disruptions in sleep compromise memory functions. Yet, the neural circuits underlying stress-induced sleep and memory disturbances are still not fully…
as macos users now often have various juicy stuff like crypto wallets etc, macos viruses are evolving /sigh/
https://www.sentinelone.com/labs/macos-nimdoor-dprk-threat-actors-target-web3-and-crypto-platforms-with-nim-based-malware/
https://www.sentinelone.com/labs/macos-nimdoor-dprk-threat-actors-target-web3-and-crypto-platforms-with-nim-based-malware/
SentinelOne
macOS NimDoor | DPRK Threat Actors Target Web3 and Crypto Platforms with Nim-Based Malware
NimDoor reflects a leap in DPRK’s offensive toolkit, mixing compile-time trickery with native scripting to complicate and deter analysis.
in Spain, cops think if you use google pixel you must be a drug dealer
https://www.androidauthority.com/google-pixel-organized-crime-preferred-phone-3573578/
https://www.androidauthority.com/google-pixel-organized-crime-preferred-phone-3573578/
Android Authority
Cops in this country think everyone using a Google Pixel must be a drug dealer (Updated)
Pixel phones are criminals' top pick in Spain's Catalonia for their strong security and mod-friendly design.
🤣4🫡1
you won't hear stories like this from
OpenAI or Anthropic because they are trying to look invincible, but this is how cutting edge AI development looks behind the scenes
https://x.com/bloc97_/status/1942263691421810820
pic: nous research discovering issues in the middle of a huge training run
OpenAI or Anthropic because they are trying to look invincible, but this is how cutting edge AI development looks behind the scenes
https://x.com/bloc97_/status/1942263691421810820
pic: nous research discovering issues in the middle of a huge training run
👍1
2+ billion of eSIM-equipped systems worldwide can be compromised remotely (more details at the link)
https://security-explorations.com/esim-security.html
https://security-explorations.com/esim-security.html
🤩2👍1🔥1
Do you have a spare fusion reactor?
They can be modded to transmute mercury into gold as well :)
Regular (fission) nuclear reactors won't work, unless you happen to have a fast neutron-producing "breeder" one.
Please share photos of your project when finished!
https://www.marathonfusion.com/alchemy.pdf
They can be modded to transmute mercury into gold as well :)
Regular (fission) nuclear reactors won't work, unless you happen to have a fast neutron-producing "breeder" one.
Please share photos of your project when finished!
https://www.marathonfusion.com/alchemy.pdf
🤯1🌚1
TIL there are at least eight people born with DNA combined from three parents already.
https://www.nature.com/articles/d41586-025-02276-5
https://www.nature.com/articles/d41586-025-02276-5
Nature
‘Landmark’ study: three-person IVF leads to eight healthy children
Nature - Long-awaited results suggest that mitochondrial donation can prevent babies from inheriting diseases caused by mutant mitochondria.
🔥1🦄1
another step to the point where the llm self-improvement takeoff becomes possible
an exercise: list the rest of the required parts
https://arxiv.org/abs/2507.18074
an exercise: list the rest of the required parts
https://arxiv.org/abs/2507.18074
arXiv.org
AlphaGo Moment for Model Architecture Discovery
While AI systems demonstrate exponentially improving capabilities, the pace of AI research itself remains linearly bounded by human cognitive capacity, creating an increasingly severe development...
💩1
the starling memories
TLDW: picture -> spectral synthesizer -> the bird remembers the "song" -> the bird sings -> spectral analyzer -> wow
https://www.youtube.com/watch?v=hCQCP-5g5bo&t=1018s
TLDW: picture -> spectral synthesizer -> the bird remembers the "song" -> the bird sings -> spectral analyzer -> wow
https://www.youtube.com/watch?v=hCQCP-5g5bo&t=1018s
YouTube
I Saved a PNG Image To A Bird
I got a bit concerningly obsessed with birds for a few months.
Follow Sarah and The Mouth! https://linktr.ee/inkydragon
Older bat vid: https://www.youtube.com/watch?v=X4eqkaHkTAI
💗 Support this channel and join an amazing community: http://www.patreon.com/bennjordan…
Follow Sarah and The Mouth! https://linktr.ee/inkydragon
Older bat vid: https://www.youtube.com/watch?v=X4eqkaHkTAI
💗 Support this channel and join an amazing community: http://www.patreon.com/bennjordan…
🔥2🤣2
anything programmable can be a software defined radio transmitter, if you're persistent enough :)
https://arxiv.org/abs/2506.21069
https://arxiv.org/abs/2506.21069
arXiv.org
TEMPEST-LoRa: Cross-Technology Covert Communication
Electromagnetic (EM) covert channels pose significant threats to computer and communications security in air-gapped networks. Previous works exploit EM radiation from various components (e.g.,...
🌚1