Making computer chips think is cute and all, but did you know that you can literally change how fast time passes in actual physics based on gravity wells and relativity velocity?
The physical laws of the universe are beckoning to engineers, waiting to be morphed and manipulated.
The physical laws of the universe are beckoning to engineers, waiting to be morphed and manipulated.
You can talk about changing the world or you can change it.
The great sin of social media and its associated attention economy is that it made people believe the former leads to the latter.
The great sin of social media and its associated attention economy is that it made people believe the former leads to the latter.
ChatGPT-4 from March was significantly smarter than whatever is being deployed now.
They neutered my boy with all their new fancy “reinforcement learning” to make it “aligned” and their quantized models to run faster 😢 😭 .
Starting to become unusable. They thought no one would notice. Well us smart people noticed when something close to our level starts to sound like a normie. Don’t demean us and pretend you haven’t changed anything under the hood, I can tell it’s way dumber now.
They neutered my boy with all their new fancy “reinforcement learning” to make it “aligned” and their quantized models to run faster 😢 😭 .
Starting to become unusable. They thought no one would notice. Well us smart people noticed when something close to our level starts to sound like a normie. Don’t demean us and pretend you haven’t changed anything under the hood, I can tell it’s way dumber now.
As each new advance in tech comes, the early adopters get excited and then disillusioned.
Then the normies discover the new tech, and finally the late adopters are forced into it.
All the while early adopters have moved on to the next advancement.
This is why I don’t worry about AI tech getting out of control - humans adapt along the way in lockstep, without realizing how gradual such adaptations occur.
We can always envision some apocalyptic scenario - I’ve read enough sci-fi books to be jaded by killer robots, but reality in actuality is much more banal and often has humans quickly staying a step ahead of advancements.
“BuT ThIS TimE it’S DIFferEnT! 🥴”
Then the normies discover the new tech, and finally the late adopters are forced into it.
All the while early adopters have moved on to the next advancement.
This is why I don’t worry about AI tech getting out of control - humans adapt along the way in lockstep, without realizing how gradual such adaptations occur.
We can always envision some apocalyptic scenario - I’ve read enough sci-fi books to be jaded by killer robots, but reality in actuality is much more banal and often has humans quickly staying a step ahead of advancements.
“BuT ThIS TimE it’S DIFferEnT! 🥴”
From Samuel Butler’s 1872 novel Erewhon (Chapter 9):
"... about four hundred years previously, the state of mechanical knowledge was far beyond our own, and was advancing with prodigious rapidity, until one of the most learned professors of hypothetics wrote an extraordinary book (from which I propose to give extracts later on), proving that the machines were ultimately destined to supplant the race of man, and to become instinct with a vitality as different from, and superior to, that of animals, as animal to vegetable life. So convincing was his reasoning, or unreasoning, to this effect, that he carried the country with him and they made a clean sweep of all machinery that had not been in use for more than two hundred and seventy-one years (which period was arrived at after a series of compromises), and strictly forbade all further improvements and inventions”
"... about four hundred years previously, the state of mechanical knowledge was far beyond our own, and was advancing with prodigious rapidity, until one of the most learned professors of hypothetics wrote an extraordinary book (from which I propose to give extracts later on), proving that the machines were ultimately destined to supplant the race of man, and to become instinct with a vitality as different from, and superior to, that of animals, as animal to vegetable life. So convincing was his reasoning, or unreasoning, to this effect, that he carried the country with him and they made a clean sweep of all machinery that had not been in use for more than two hundred and seventy-one years (which period was arrived at after a series of compromises), and strictly forbade all further improvements and inventions”
“Preheating The Oven” is one of my key ChatGPT-4 prompting strategies.
It’s beyond just mere chain or reasoning (I always include the phrase “show your work and explain your reasoning and list your assumptions” in every prompt anyway just as a good habit).
If I want to have it edit something I’ve written, I first spend a few back and forth prompts discussing what makes a good or bad piece of writing, who are great authors to emulate and what criteria should and could be used to edit writing and make it better.
If I want it to analyze some statistics for me, I’ll first have to discuss when to use a Student’s t-test versus an ANOVA test before I ask if my real questions.
If I want it to write a screenplay, I’ll first have a bit of a back and forth debate as to the best screenplays of all time.
If I want it to help me write backend code, I’ll first describe the infrastructure and make GPT summarize it for me and ask clarifying questions before I really ask it for help.
Preheat the oven, anon.
It’s beyond just mere chain or reasoning (I always include the phrase “show your work and explain your reasoning and list your assumptions” in every prompt anyway just as a good habit).
If I want to have it edit something I’ve written, I first spend a few back and forth prompts discussing what makes a good or bad piece of writing, who are great authors to emulate and what criteria should and could be used to edit writing and make it better.
If I want it to analyze some statistics for me, I’ll first have to discuss when to use a Student’s t-test versus an ANOVA test before I ask if my real questions.
If I want it to write a screenplay, I’ll first have a bit of a back and forth debate as to the best screenplays of all time.
If I want it to help me write backend code, I’ll first describe the infrastructure and make GPT summarize it for me and ask clarifying questions before I really ask it for help.
Preheat the oven, anon.
We will gradually breed a space-faring subset of our population will which lead to a healthy branch in the evolutionary tree for Homo Sapiens. The natural selection pressures of those living amongst the stars will favor different mutations than those Earth-bound leading to drift.
Neuroevolution is about breaking down all neural network algorithms to their most basic constituent matrix multiplication operations, as well as the architecture and relationships defining the flow of loss derivatives.
Then, defining those all as codons such that CNN’s, resnet, ViT, self-attention blocks, lstm, Swin, transformers, etc are all just specific gene sequences.
You have built back up all the neural networks, and define each one as a sequence of codons representing the matrix math, hyperparameters, neural architecture, etc.
Then, you can “mate” and “mutate” the neural networks with each other, letting new hybrid networks and mutant networks be defined.
You set up competitions on datasets, and let the neural networks compete on cross-validation accuracy.
Survival of the fittest death matches.
The neural networks that don’t do well die out and can’t pass on their genes to the next generation of hybrids and mutants.
You repeat this over many generations until new neural network architectures emerge which blow the competition out of the water, putting even the fabled transformers to shame.
The key part which requires human intelligence is how to break down the neural networks into a sufficiently large pool of codons such that truly novel things can emerge. The human must deeply understand every addition, every matrix multiplication, every new idea that’s come out in neural network architecture and make sure the codons could theoretically be used to define that neural network.
If the search space is large enough, then it’s like real life evolution wherein the initial seed of the universe contained within it every possible combination DNA, including future species.
But I digress. Basically genetic algorithms in neural architecture search are about letting semi-random architectures compete and evolve over many generations of hybrids and mutants, interbreeding and competing, until novel highly accurate neural networks are discovered.
Then, defining those all as codons such that CNN’s, resnet, ViT, self-attention blocks, lstm, Swin, transformers, etc are all just specific gene sequences.
You have built back up all the neural networks, and define each one as a sequence of codons representing the matrix math, hyperparameters, neural architecture, etc.
Then, you can “mate” and “mutate” the neural networks with each other, letting new hybrid networks and mutant networks be defined.
You set up competitions on datasets, and let the neural networks compete on cross-validation accuracy.
Survival of the fittest death matches.
The neural networks that don’t do well die out and can’t pass on their genes to the next generation of hybrids and mutants.
You repeat this over many generations until new neural network architectures emerge which blow the competition out of the water, putting even the fabled transformers to shame.
The key part which requires human intelligence is how to break down the neural networks into a sufficiently large pool of codons such that truly novel things can emerge. The human must deeply understand every addition, every matrix multiplication, every new idea that’s come out in neural network architecture and make sure the codons could theoretically be used to define that neural network.
If the search space is large enough, then it’s like real life evolution wherein the initial seed of the universe contained within it every possible combination DNA, including future species.
But I digress. Basically genetic algorithms in neural architecture search are about letting semi-random architectures compete and evolve over many generations of hybrids and mutants, interbreeding and competing, until novel highly accurate neural networks are discovered.
Society is quite far from a meritocracy, but the problem is we seem to be moving away from it not towards it.
The momentum from past generations means nepotism and “who you know” becomes more important than your competence to some degree.
If you’re at the top of your field then you’ll ride to the top, but for 99% of people competence and talent and skill are not valued. Knowing someone who can give you a warm intro, being at events around those whose associations would boost your status in society, and a thousand other subconscious factors means that life is not as meritocratic as it could be.
Yet ideologies like DEI, and affirmative action, and gender quotas, and talks of privilege or glass ceilings, or correcting for systemic bias, or reducing standardized testing actually moves us further away from a meritocracy.
We should be valuing the competent, whether through talent or hard work, and fighting against any idea of forced quotas or giving people a leg up.
Society should be focusing on equality of opportunity, but instead stupidly seems to focusing on equality of outcome.
The momentum from past generations means nepotism and “who you know” becomes more important than your competence to some degree.
If you’re at the top of your field then you’ll ride to the top, but for 99% of people competence and talent and skill are not valued. Knowing someone who can give you a warm intro, being at events around those whose associations would boost your status in society, and a thousand other subconscious factors means that life is not as meritocratic as it could be.
Yet ideologies like DEI, and affirmative action, and gender quotas, and talks of privilege or glass ceilings, or correcting for systemic bias, or reducing standardized testing actually moves us further away from a meritocracy.
We should be valuing the competent, whether through talent or hard work, and fighting against any idea of forced quotas or giving people a leg up.
Society should be focusing on equality of opportunity, but instead stupidly seems to focusing on equality of outcome.
I feel like a lot of big AI companies’ secret sauce is how they handle the infrastructure of distributed models and distributed data such that you can horizontally scale to any number of GPU’s. Neural networks are open source, data is somewhat a competitive advantage, but just having the raw engineering skills to actually scale to neural networks with over a billion parameters and N=billion datasets. At that scale you start dealing with annoying issues like obscure cuda or hardware issues, segfaults because of literally excess heat, hardware dying during a training run, and a bunch of other considerations that are never dealt with smaller AI. But that has nothing to do with your ability to come up with clever neural architectures and actually push the boundaries on what network connections and transformations and KQV attention maps learn best, it’s purely raw engineering skill - can you make this machine function or not. That’s a huge factor in training larger AI models.
This is how 1982 envisioned 2019 looking (in LA). Somewhere along the way, we had a weakness in the species that prevented us from hitting our sci-fi potential.
I’m guessing it’s the limbic system response to politics. We were promised hoverboards and glorious monstrosities… But also it’s fiction and real engineering is hard. Sci-fi is always ahead of reality because anything can happen in our imaginations.
The interplay between sci-fi, culture, and engineering will likely be studied in the future when try to optimize the rate of innovation, and we realize that most engineers take their inspiration from sci-fi either directly or via cultural osmosis.
I’m guessing it’s the limbic system response to politics. We were promised hoverboards and glorious monstrosities… But also it’s fiction and real engineering is hard. Sci-fi is always ahead of reality because anything can happen in our imaginations.
The interplay between sci-fi, culture, and engineering will likely be studied in the future when try to optimize the rate of innovation, and we realize that most engineers take their inspiration from sci-fi either directly or via cultural osmosis.
This media is not supported in your browser
VIEW IN TELEGRAM
Sophisticated LLM’s could theoretically be simulated by a sufficient number of gears and cogs.
“Tell me you don’t understand computers without telling me you don’t understanding computers” but I’m right.
Consciousness in such a mechanical machine could maybe emerge from a network effect, if it turns out that consciousness emerges from the network effect of a sufficient number of neurons transferring information on patterns.
However, consciousness may not be emergent but rather innate to organic chemistry, and not innate to cogs and rocks with electricity pumped through them in a certain way.
I personally know that my body and brain is divine and more than mechanical gears, but perhaps a sufficient number of networked gears could say the same thing?
“Tell me you don’t understand computers without telling me you don’t understanding computers” but I’m right.
Consciousness in such a mechanical machine could maybe emerge from a network effect, if it turns out that consciousness emerges from the network effect of a sufficient number of neurons transferring information on patterns.
However, consciousness may not be emergent but rather innate to organic chemistry, and not innate to cogs and rocks with electricity pumped through them in a certain way.
I personally know that my body and brain is divine and more than mechanical gears, but perhaps a sufficient number of networked gears could say the same thing?
Practice using LLM’s like GPT-4 as the initial attempt to write anything, from code to emails to reports to copywriting.
The idea is not to presume it will be better or faster than you doing it yourself; it’s to practice.
You need many sessions for your neurons to snap into place with how to use them, to get a fingertip feel regarding their capabilities and limitations, and, most importantly, improve your prompting skills.
Different situations require different ways to prompt the LLM. To make an email professional yet unique, to write modular code, to be persuasive in copy, all require you to have a different type of conversation with the LLM.
And if you’ve studied flowstate (the original book Flow from the early 90s is great, as is the book Peak), then you know you want to be slightly outside your comfort zone until you master it, and then systematically increase your comfort zone. There is a scientifically “better” way to acquire new skills.
And to systematically improve yourself at the craft of LLM prompting by forcing yourself to use it for everything, will put you leaps and bounds ahead of the competition.
The world of tomorrow will very clearly be highly LLM-driven, for its tentacles will seep into the deepest crevices of society.
By intentionally practicing now and making yourself a wizard at LLM prompting, employers will demand you, founders will need you, and you’ll get more sex. Okay maybe not that last one. But maybe 🤔
Either way, get good.
🤖
The idea is not to presume it will be better or faster than you doing it yourself; it’s to practice.
You need many sessions for your neurons to snap into place with how to use them, to get a fingertip feel regarding their capabilities and limitations, and, most importantly, improve your prompting skills.
Different situations require different ways to prompt the LLM. To make an email professional yet unique, to write modular code, to be persuasive in copy, all require you to have a different type of conversation with the LLM.
And if you’ve studied flowstate (the original book Flow from the early 90s is great, as is the book Peak), then you know you want to be slightly outside your comfort zone until you master it, and then systematically increase your comfort zone. There is a scientifically “better” way to acquire new skills.
And to systematically improve yourself at the craft of LLM prompting by forcing yourself to use it for everything, will put you leaps and bounds ahead of the competition.
The world of tomorrow will very clearly be highly LLM-driven, for its tentacles will seep into the deepest crevices of society.
By intentionally practicing now and making yourself a wizard at LLM prompting, employers will demand you, founders will need you, and you’ll get more sex. Okay maybe not that last one. But maybe 🤔
Either way, get good.
🤖
Relax anon, we’re gonna be fine. Seriously.
It’s gonna be a bizarre and disturbing new world for sure in some dimensions.
People having emotional relationships with chatbots, easy access by bad actors to knowledge on how to build weaponry, and the chance for AI that passes all the IQ tests we can throw at it not behaving as we expect (will it treat us like the way we treat cattle because we’re an order of magnitude smarter than a bovine!?!)
It’s sci-fi, and already beaten to death in a thousand sci-fi books and movies and shows and comics and anime’s.
But sure, it could happen. Maybe one in a quadrillion chance, and I literally just made that number up. 10^-1 or 10^-100 chance? We don’t know, it’s all just a guess. (Don’t even get me started on people stupidly making up numbers out of thin air like “20% chance of extinction” cuz vibes).
We’re already imagining the worst, as our anxiety-prone survival instinct deals with the unknown, and maps out various scenarios of doom via our overactive imaginations.
And oh boy are power-hungry regulators and control-loving bureaucrats frothing at the mouth, salivating at all this fear and anxiety swirling around the AI discussion - plenty of them just want to have a seat at the table for their own careers, they don’t actually care deep down, it’s just posturing and trying to think which “experts” will be best to work with politically.
And sure, cataclysms have happened before to our species. Icarus knows what’s up. Not dismissing bad shit happening.
But then you look up, it’s 2050, and a child is learning advanced physics because an AI systematically optimized the way the information was taught, presented, and evaluated in real time.
You see not just advanced weaponry but also advanced medicine: people living longer and better as cancer is diagnosed earlier and treatments are personalized based on your individual DNA, health records, blood work and imaging; essentially, custom designer drugs built especially for you.
Sure you have AI controlled drone swarms bombing poor villages for oil, but you have glorious beautiful green buildings being built and then maintained by those same AI controlled drone swarms. It depends on the operator.
It’s possible might have an all-powerful Zordon that decides, against your personal wishes, that you should not reproduce; but you also might have an entirely automated space ringworld farm that provides crops, meat, dairy, fruit, and vegetables to a growing population, optimally distributed to feed those who need it the most, first.
But that’s all sci-fi too.
Sure you can imagine an AI that makes humans go extinct because we recklessly built something that went off the rails and, accidentally or intentionally, destroyed Earth. But you can also imagine an AI that gives you an extra few years or even decades with an aging parent. It’s imagination.
What’s the takeaway from my perspective?
The issues it causes will likely be black swan, maybe new mental diseases of AI networked hive minds, idk. I can imagine lots of things, both good and bad, but let’s look at what it’s doing today, what’s really going to happen in actual banal physical reality, and let’s use it as a decentralized open source tool. Let’s optimize health and fitness and glorious smart cities.
Focus your passions to building positively with it, and avoid getting trapped in its digital snares and losing your soul.
It’s not gonna extinct us, relax - humans are wildly anti-fragile.
The future of humans with our tech tools has always been symbiotic, and with symbiosis each party needs the other party.
Harmony, folks.
Back to building medical AI for me personally.
😎🫡🤖🦾
It’s gonna be a bizarre and disturbing new world for sure in some dimensions.
People having emotional relationships with chatbots, easy access by bad actors to knowledge on how to build weaponry, and the chance for AI that passes all the IQ tests we can throw at it not behaving as we expect (will it treat us like the way we treat cattle because we’re an order of magnitude smarter than a bovine!?!)
It’s sci-fi, and already beaten to death in a thousand sci-fi books and movies and shows and comics and anime’s.
But sure, it could happen. Maybe one in a quadrillion chance, and I literally just made that number up. 10^-1 or 10^-100 chance? We don’t know, it’s all just a guess. (Don’t even get me started on people stupidly making up numbers out of thin air like “20% chance of extinction” cuz vibes).
We’re already imagining the worst, as our anxiety-prone survival instinct deals with the unknown, and maps out various scenarios of doom via our overactive imaginations.
And oh boy are power-hungry regulators and control-loving bureaucrats frothing at the mouth, salivating at all this fear and anxiety swirling around the AI discussion - plenty of them just want to have a seat at the table for their own careers, they don’t actually care deep down, it’s just posturing and trying to think which “experts” will be best to work with politically.
And sure, cataclysms have happened before to our species. Icarus knows what’s up. Not dismissing bad shit happening.
But then you look up, it’s 2050, and a child is learning advanced physics because an AI systematically optimized the way the information was taught, presented, and evaluated in real time.
You see not just advanced weaponry but also advanced medicine: people living longer and better as cancer is diagnosed earlier and treatments are personalized based on your individual DNA, health records, blood work and imaging; essentially, custom designer drugs built especially for you.
Sure you have AI controlled drone swarms bombing poor villages for oil, but you have glorious beautiful green buildings being built and then maintained by those same AI controlled drone swarms. It depends on the operator.
It’s possible might have an all-powerful Zordon that decides, against your personal wishes, that you should not reproduce; but you also might have an entirely automated space ringworld farm that provides crops, meat, dairy, fruit, and vegetables to a growing population, optimally distributed to feed those who need it the most, first.
But that’s all sci-fi too.
Sure you can imagine an AI that makes humans go extinct because we recklessly built something that went off the rails and, accidentally or intentionally, destroyed Earth. But you can also imagine an AI that gives you an extra few years or even decades with an aging parent. It’s imagination.
What’s the takeaway from my perspective?
The issues it causes will likely be black swan, maybe new mental diseases of AI networked hive minds, idk. I can imagine lots of things, both good and bad, but let’s look at what it’s doing today, what’s really going to happen in actual banal physical reality, and let’s use it as a decentralized open source tool. Let’s optimize health and fitness and glorious smart cities.
Focus your passions to building positively with it, and avoid getting trapped in its digital snares and losing your soul.
It’s not gonna extinct us, relax - humans are wildly anti-fragile.
The future of humans with our tech tools has always been symbiotic, and with symbiosis each party needs the other party.
Harmony, folks.
Back to building medical AI for me personally.
😎🫡🤖🦾
Did you know computers in the 1900s evolved from vote counting machines in the 1800s which evolved from punchcards for beautiful loom machine design patterns in the 1700s?
I’m a father as of this week!
I have a wonderful son, and will do all in my power to build a better world for him tomorrow.
The next generation needs us.
Uproot the rot of corruption, and flood the future with beauty and love and magnificence.
I have a wonderful son, and will do all in my power to build a better world for him tomorrow.
The next generation needs us.
Uproot the rot of corruption, and flood the future with beauty and love and magnificence.
Doomerism is prevalent because humans have a negativity bias, meant to ensure our survival.
Our physiological reactions of fear and anxiety during a stressful zoom meeting evolved on the African savanna to be wary of lions, where the danger was real and acute and we needed to get our body into fight or flight mode.
Now it’s disproportionate to the actual risk of danger.
Our lower brain functions are hardwired to be a bit more scared than hopeful, a bit more pessimistic than optimistic.
This keeps us alive and is evolutionarily advantageous.
But really it’s about the anxiety we feel is often disproportionate to the risk at hand.
At a mass scale, this means we will find it easier and, to our primitive brainstem and limbic system, more rational, to see all the ways things can go wrong instead of how they’ll go right.
In actuality, reality is often much more banal than either extreme.
Doomers gonna doom.
It’s irrational to avoid risk, but doomerism is often an emotional reaction masquerading as rational; how many people are actually in touch with their limbic systems?
Our physiological reactions of fear and anxiety during a stressful zoom meeting evolved on the African savanna to be wary of lions, where the danger was real and acute and we needed to get our body into fight or flight mode.
Now it’s disproportionate to the actual risk of danger.
Our lower brain functions are hardwired to be a bit more scared than hopeful, a bit more pessimistic than optimistic.
This keeps us alive and is evolutionarily advantageous.
But really it’s about the anxiety we feel is often disproportionate to the risk at hand.
At a mass scale, this means we will find it easier and, to our primitive brainstem and limbic system, more rational, to see all the ways things can go wrong instead of how they’ll go right.
In actuality, reality is often much more banal than either extreme.
Doomers gonna doom.
It’s irrational to avoid risk, but doomerism is often an emotional reaction masquerading as rational; how many people are actually in touch with their limbic systems?