The analysis, published Friday, is called “Consent in Crisis: The Rapid Decline of the AI Data Commons,” and has found that, in the last year, “there has been a rapid crescendo of data restrictions from web sources” restricting web scraper bots (sometimes called “user agents”) from training on their websites.
Specifically, about 5 percent of the 14,000 websites analyzed had modified their robots.txt file to block AI scrapers. That may not seem like a lot, but 28 percent of the “most actively maintained, critical sources,” meaning websites that are regularly updated and are not dormant, have restricted AI scraping in the last year. An analysis of these sites’ terms of service found that, in addition to robots.txt restrictions, many sites also have added AI scraping restrictions to their terms of service documents in the last year.
This change has happened almost entirely within the last year, the researchers found. In mid 2023, about 1 percent of websites in the researchers’ sample had fully restricted AI scraping. Now, they estimate about 5-7 percent do, and say that the number only captures “full restricted” domains meaning their robots.txt file does not allow for any AI scraping.
The study, led by Shayne Longpre of MIT and done in conjunction with a few dozen researchers at the Data Provenance Initiative, called this change an “emerging crisis” not just for commercial AI companies like OpenAI and Perplexity, but for researchers hoping to train AI for academic purposes. The New York Times said this shows that the data used to train AI is “disappearing fast.”
https://www.404media.co/the-backlash-against-ai-scraping-is-real-and-measurable/
Specifically, about 5 percent of the 14,000 websites analyzed had modified their robots.txt file to block AI scrapers. That may not seem like a lot, but 28 percent of the “most actively maintained, critical sources,” meaning websites that are regularly updated and are not dormant, have restricted AI scraping in the last year. An analysis of these sites’ terms of service found that, in addition to robots.txt restrictions, many sites also have added AI scraping restrictions to their terms of service documents in the last year.
This change has happened almost entirely within the last year, the researchers found. In mid 2023, about 1 percent of websites in the researchers’ sample had fully restricted AI scraping. Now, they estimate about 5-7 percent do, and say that the number only captures “full restricted” domains meaning their robots.txt file does not allow for any AI scraping.
The study, led by Shayne Longpre of MIT and done in conjunction with a few dozen researchers at the Data Provenance Initiative, called this change an “emerging crisis” not just for commercial AI companies like OpenAI and Perplexity, but for researchers hoping to train AI for academic purposes. The New York Times said this shows that the data used to train AI is “disappearing fast.”
https://www.404media.co/the-backlash-against-ai-scraping-is-real-and-measurable/
404 Media
The Backlash Against AI Scraping Is Real and Measurable
In the last year, the number of websites specifically restricting OpenAI and other AI scraper bots has gone through the roof.
According to a first of its kind study on “corporate carbon damages”, firms would lose 44% of their profits if they had to pay for the damages attributable to their climate pollution. When one of the researchers was asked what the total amount in dollars would be for such damages, co-author Christian Leuz revealed that “At $190 [the U.S. EPA’s current cost per ton of carbon], the utility industry averaged damages more than twice its profits. Materials manufacturing, energy and transportation industries all had average damages that exceeded their profits.” An additional analysis from 2013 that focused on pricing in environmental externalities came to a similar conclusion that does not bode well for “climate capitalism.” Influential climate analyst David Roberts, writing for Grist at the time, concludes: “Of the top 20 region-sectors ranked by environmental impacts, none would be profitable if environmental costs were fully integrated. Ponder that for a moment: None of the world’s top industrial sectors would be profitable if they were paying their full freight. Zero.”
https://sublationmedia.com/making-graphs-to-flatter-the-global-elite/
https://sublationmedia.com/making-graphs-to-flatter-the-global-elite/
Sublation Media
Making Graphs to Flatter the Global Elite
Two new books argue that capitalism will solve the climate and ecological crisis. While making such an argument with different styles and focuses, Bloomberg journalist Akshat Rathi’s Climate Capitalism: winning the race to zero emissions and solving the crisis…
A new Sludge analysis finds that Big Oil and fossil fuel industry donors have showered more than $34 million on the super PACs tied to Republican leaders in Congress.
https://readsludge.com/2024/07/26/the-fossil-fuel-industry-is-spending-millions-to-help-republicans-take-control-of-congress/
https://readsludge.com/2024/07/26/the-fossil-fuel-industry-is-spending-millions-to-help-republicans-take-control-of-congress/
Sludge
The Fossil Fuel Industry Is Spending Millions to Help Republicans Take Control of Congress
A new Sludge analysis finds that Big Oil and fossil fuel industry donors have showered more than $34 million on the super PACs tied to Republican leaders in Congress.
The Pentagon, Congress, the defense industry, think tanks, lobbyists, and industry-sponsored media outlets are all very real. When combined, they make up what is better termed the “National Security Establishment,” which Americans see in action all the time.
https://responsiblestatecraft.org/military-industrial-complex-2668809022/
https://responsiblestatecraft.org/military-industrial-complex-2668809022/
Responsible Statecraft
Time to retire the phrase 'Military Industrial Complex'
Sorry Ike: it's a bit too dated and no longer the right moniker to describe what we're up against
Pantopia Reading Nook 📰🚩
The Pentagon, Congress, the defense industry, think tanks, lobbyists, and industry-sponsored media outlets are all very real. When combined, they make up what is better termed the “National Security Establishment,” which Americans see in action all the time.…
https://www.tumblr.com/cathkaesque/748567491164372992
Link contains sources to tweets, article, full report
Link contains sources to tweets, article, full report
Administrative detention in Isreal
Administrative detention is based on secret suspicions, secret evidence and no charges being brought. To conceal its inherent absurdity, hearings are held in-camera and away from the public eye. As such, even the little that is revealed to the defense remains prohibited for publication.
"Like all administrative detention hearings, it was held in-camera, to obscure the fact that detainees' lawyers do their job without access to the facts of the case. Even the few details that are not secret are prohibited for publication. The administrative detention order was approved in full for a period of six months"
" In the past, it was considered, at least officially, a measure reserved for the most extreme of cases. This hypocritical position has always been false, but now there is no longer any need to save face. According to the Israeli army's own data, almost 5,000 arrests were made in the West Bank in the past eight months. These are very conservative numbers, as they don't include the many thousands arrested and released without being indicted.
The data shows that administrative detention, this so-called extreme of extremes, is now the norm. According to Israeli Prison Service numbers, Israel now holds 7016 people who have not yet been convicted in its jails – either awaiting trial or under administrative detention. Of these, 4,299 – more than 60%! – are held without charge or trial. And all that is without saying a single word about the torture, hunger and humiliation to which all Palestinian prisoners held by Israel are subjected these days."
Administrative detention is based on secret suspicions, secret evidence and no charges being brought. To conceal its inherent absurdity, hearings are held in-camera and away from the public eye. As such, even the little that is revealed to the defense remains prohibited for publication.
"Like all administrative detention hearings, it was held in-camera, to obscure the fact that detainees' lawyers do their job without access to the facts of the case. Even the few details that are not secret are prohibited for publication. The administrative detention order was approved in full for a period of six months"
" In the past, it was considered, at least officially, a measure reserved for the most extreme of cases. This hypocritical position has always been false, but now there is no longer any need to save face. According to the Israeli army's own data, almost 5,000 arrests were made in the West Bank in the past eight months. These are very conservative numbers, as they don't include the many thousands arrested and released without being indicted.
The data shows that administrative detention, this so-called extreme of extremes, is now the norm. According to Israeli Prison Service numbers, Israel now holds 7016 people who have not yet been convicted in its jails – either awaiting trial or under administrative detention. Of these, 4,299 – more than 60%! – are held without charge or trial. And all that is without saying a single word about the torture, hunger and humiliation to which all Palestinian prisoners held by Israel are subjected these days."
Tumblr
A Matter of the Most Pleasant Fraternal Confidence
Haaretz did this:
The full thing is under the cut, in case this link is paywalled for other people. The actual text has blocked out portions as well, to highlight what it's like to report on cases o…
The full thing is under the cut, in case this link is paywalled for other people. The actual text has blocked out portions as well, to highlight what it's like to report on cases o…
https://www.theguardian.com/world/article/2024/may/28/spying-hacking-intimidation-israel-war-icc-exposed
+ Article on the threats that Israel made against the journalist writing about this
+ Article on the threats that Israel made against the journalist writing about this
the Guardian
Spying, hacking and intimidation: Israel’s nine-year ‘war’ on the ICC exposed
Exclusive: Investigation reveals how intelligence agencies tried to derail war crimes prosecution, with Netanyahu ‘obsessed’ with intercepts
A large-scale nuclear power station in China is the first in the world to be completely impervious to dangerous meltdowns, even during a full loss of external power. The design can’t be adapted to existing nuclear reactors around the world, but could be a blueprint for future ones.
https://www.newscientist.com/article/2440388-chinese-nuclear-reactor-is-completely-meltdown-proof/
https://www.newscientist.com/article/2440388-chinese-nuclear-reactor-is-completely-meltdown-proof/
New Scientist
Chinese nuclear reactor is completely meltdown-proof
The first ever full-scale demonstration of a nuclear reactor designed to passively cool itself in an emergency was a success, showing that it should be possible to build nuclear plants without the risk of dangerous meltdown
Recognising the limitations of techno-economism, focused on markets (price adjustments) and technology (efficiency gains), this contribution introduces sufficiency corridors as a concept, research field, and policy approach. Sufficiency corridors represent the space between a floor of meeting needs and a ceiling of ungeneralisable excess, i.e. within the sufficiency corridor everyone has enough (to satisfy needs) while no one has too much (to endanger planetary boundaries and need satisfaction). Establishing such corridors entails a process over time that continuously narrows the gap between floors and ceilings, lifting the former and pushing down the latter by strengthening forms of consumption and production that contribute to need satisfaction while shrinking those that do not.
https://link.springer.com/article/10.1007/s13280-024-02027-2
https://link.springer.com/article/10.1007/s13280-024-02027-2
SpringerLink
When enough is enough: Introducing sufficiency corridors to put techno-economism in its place
Ambio - Today's ecological crises are entwined with inequality dynamics, yet prevailing techno-economic approaches in climate research and policy fall short in addressing the ecological crisis...