Part 3: Practical Magic is basically an x-files episode, what am I even reading

“The phrase being ‘taken out’ started getting used a lot,” Emily says, if a Leverager felt unable to follow through on normal duties because they were still recovering from a bodywork session. Worse, the word “emergency” was becoming common, as it was used when an employee was in an extremely bad state (screaming or convulsing, for example) and then required hours or days of help.

In a discussion outline, she listed negative effects she’d seen in bodywork subjects (bad headaches, fever, nausea, fear, “overwhelm,” and “inability to be around people”) as well as practitioners (bad headaches, exhaustion, nausea, and “metaphysical unease”). During the meeting, Emily learned that her list wasn’t long enough: Colleagues were seeing panic attacks, paralysis, tinnitus, rashes, allergic reactions like runny noses, “aversion to physical touch,” and “persistent unpleasant visual imaginations” after bodywork. She was horrified, and her immediate recommendation was to slow down the research. But soon after the meeting, Geoff rebuked her.

A lot of this feels like they overdid the breathwork and resistance breathing exercises and as a consequence are constantly slightly hypoxic. Recuperating an exhausted respiratory system can be a hell of a time because you can’t exactly take a break from breathing to rest , just a lot of bad headeachey sleep._{source: freediving dabbler.}

Also there’s a part where David does some bodywork that involves pushing the other guy on the heart which resulted in a long period of those aftereffects, and having a weight on your chest sounds a lot like doing resistance breathing without being aware of it. Someone in other place very justifiably worries if there were a carbon dioxide leak in the premises. Nausea is also constantly mentioned, which I think can be a symptom of low blood pressure, which could be a thing If you are constantly exhausted from your breathing being all messed up.

Nevermind, Geoff to the rescue:

According to Geoff, he believed that Emily and her friends — a tight-knit group that included James — were trying to “monopolize” bodywork. The elephant in the room was funding pressures. Bodywork was an excellent way to impress funders quickly, so slowing down research might mean slowing a promising funding pathway.

There’s an extended tangent of overexamining the claims of Zoe (see start of pt1) about people having had psychotic breaks following these practises by asking Leveragers who are willing to talk about it, to conclude that while these things can be very common in such settings it is very doubtful that they took place in Levrage 1.0 .

This mostly stands out because of the pattern of going the extra mile with due diligence on a victim’s claims (who notably didn’t return the writers calls while Geoff more than happy to be quoted) versus the part about reproducing guru David’s apprehensions for Leverage as if that lets him off the hook for being an obvious charlatan all too willing to take power and mess with people’s heads.

Goddammit:

Emily recalls a time when one, then two, then three separate women came to her and said they’d had “very similar nightmares of being raped or sexually harmed by a persona, or being, or energy, that looked a lot like a person in the group.” The situation, Emily says, seemed bad “from a research perspective, but also from the community care perspective.”

“We did try to talk to the individual who was sort of implicated in the dreams. And that was weird, sort of unsatisfying,”

This is getting increasing hard to unpack in sneer form, like you have the story of James, both in a long term relationship and simultaneously getting it on with his PhD supervisor, as rationalists are want to. Is the supervisor taking advantage of him? Who knows, definitely not the writer who won’t even comment on James’ range of chronic symptoms being consistent with PTSD, even when L1.0 tech causes him to think he might have been repressing memories of being sexually abused at a young age. All’s well that ends well, James decides he is unworthy of the primary girlfriend and breaks up with her for to be with his supervisor and continue The Work with Leverage 1.0 .

And all across Leverage were dozens of similar stories: Breakdowns, heartbreaks, commingled with occasional shining breakthroughs.

I’ll take a break.

Part 2: Body and Energy

Using fake or cherry-picked results in your papers is totally just a matter of philosophical opinion:

Tyler is a charming young man with impish eyes. Before joining Leverage, he worked on cognitive science and social psychology, at labs ranging from Yale to the University of Chicago. He left amid escalating concerns around the “Replication Crisis,” a philosophical conflict within the academy

This is good epistemics:

What if Tyler took a pill, then started floating off the ground, and touched down five minutes later — then would Tyler feel that he needed to use a scientific tool in order to trust his own observations? What if Tyler took another pill from the same jar, and the second time he took the pill he floated off the ground, then touched down five minutes later? How long would it take for Tyler to conclude that each pill made him float for five minutes? […] if Tyler found an unexpected but massively obvious effect, like a pill that made him levitate, then would he still need a randomized controlled trial to believe that this obvious effect actually existed?

“I too used to listen to satanic music before someone finally got me to read the bible”:

I couldn’t believe what I saw. I had arrived with all these people I considered to be hyper-rational nerds who were emotionally inexpressive, to the point where many people who visited Leverage came away with the impression that it was full of ‘robots.’ But now all these people were cathartically weeping, shaking, etc. One guy I thought of as the paradigmatic Rational Person now had his shirt completely unbuttoned and seemed to be lamenting on the couch like a melancholic king. Afterwards, everyone was, of course, like: ‘WTF was that?’ ”

Then Tyler and a bunch of other Leveragers sign up to the Energy Healing School for a paltry $10K each.

Some friction follows between the hippie style meditation practices and CT, because apparently the former makes available for introspection mental space that isn’t accessible by the latter. Also this is sure to end well:

Emily says that “emotion was taboo as a technical concept; it wasn’t included in Connection Theory.” According to some former Leveragers, this put the group in the position of trying to process shared emotions, including emotions from their relationships with each other, while lacking fundamental language for it — all while determinedly intending to access the deep unconscious.

This I assume is on top of dismissing psychology completely because dear leader didn’t like it, so they have absolutely no external point of reference for what’s going on mentally with them.

David the guru appears:

According to Geoff, David described having gone “to the East” and found old masters whose lineages were not being passed on; he claimed he’d convinced these aging spiritual masters to teach him. A former Leverager remembers David claiming he could heal or cause cancer with a touch, “cause bones to heal, like 6x to 10x speed,” or “induce seizures or hallucinations” with bodywork, as well as organ failure.

David joins the slovenian and Tyler becomes his apprentice. David becomes a Leverage ‘master’.

The title “master” carried an unclear but powerful status within the ecosystem. An ex-Leverager says that “masters” had a perceived “halo” and there was a shared “blind spot around people’s character and ethics that led to empowering people with questionable morals.” This halo effect made it hard to give masters negative feedback.

David “was routinely missing entire days just to meditate on his kidneys and was claiming they were failing,” which David attributed to Geoff causing him bodily harm via deliberate psychological manipulation.

The slovenian nrxer acquires a reputation of being a sex pest:

When asked about the complaint in 2024, Geoff says there was an internal investigation, which concluded that Samo “acted with bad judgment.”

Just normal rationalist workplace things:

David also had tension with Samo, who was in an open marriage while also dating a woman who worked with him in the Sociology department.

There is some bruhaha and a cybersecurity related falling out and David and Samo’s ex leave Leverage, but David’s legacy remains:

Regardless of David’s intentions, adding bodywork to the Leverage toolkit had surprising consequences. From the beginning, non-monogamy was common and accepted within Leverage; but bodywork provided a new, confusing, and plausibly professional context for intimate physical contact. And Leveragers soon determined that they could combine bodywork with other techniques to bypass the partition — a move that arguably, finally, allowed them to dive into the uncharted waters of the deep unconscious.

Yeah, this is now cult cult.

Also the writer doesn’t want all this unpleasantness to reflect badly on David, so she makes sure to add this preface, how thoughtful:

I was able to confirm that he did not feel Leveragers shared his moral values, and that he felt he couldn’t transfer his skills to people who did not share his values. He believed his mastery could be badly distorted if he tried to transmit it without transmitting the values that informed it.

Tune in for Part 3 I guess.

Too many sneers while reading it, I did a full post: https://awful.systems/post/8886134

I guess I’ll just do a read along write up:

Part 1:

In the Effective Altruist community, Leverage held “mystique,” according to a former employee. It didn’t help that some employees lost touch with their previous friends and families. One community member observes that “a lot of people dropped off the face of the Earth when they started working at Leverage.” Rumors swirled. Since Peter Thiel was an early funder, a local wit dubbed Leverage “Peter Thiel’s MKUltra”

Zoe [ex-Leverage with PTSD who went public] also wrote: “I personally prayed for hours most nights for months to rid myself of specific ‘demons’ I felt I’d picked up from other members of Leverage. If this sounds insane, it’s because it was… In addition, I’ll be honest — I experienced real effects of these ‘demons.’ ”

This is the author by the way:

By the time I heard about Leverage, I was fascinated by mysticism, meditation, and witchcraft. By 2020, my spiritual practice yielded disorienting results: vivid dreams, weirder-than-usual hunches, intense visualizations, trance-like states, and more. I sought balance by discussing these with an accredited therapist, who said I was fine, and by getting advice from friends, including friends from Leverage. This was when I began to understand what might be meant by the word “demon.” And those discussions with former Leveragers formed a basis of shared experience, which eventually led sources at Leverage, including Geoff Anders, to trust me with this story.

A lot of this unintentionally reads like what here’s what the cultic milieu looks like from the point of view of those especially vulnerable to cult influence:

Nevin Freeman, who was employee #5, says that Leverage “self-selected for people who didn’t place their faith in existing institutions,” who wanted to build something better. […] This in turn led Nevin to a visiting fellowship at Eliezer Yudkowsky’s Machine Intelligence Research Institute (MIRI, formerly known as the Singularity Institute), then to a startup job. He began donating half his salary to fund people working on AI issues; after he met Geoff, Nevin redirected his money to fund Geoff, then joined Leverage.

On definitely not cult building:

Oliver discovered Leverage after he decided to work on “collective intelligence” and became interested in the business concept of “learning organizations,” organizations that prioritize continuous transformation of employees as well as the organization itself.

Most sanitized description of nrx ever, and also diversity is great when it comes to letting the fascists in:

One clear example of this pluralism arrived in the form of a charismatic, self-assured Slovenian man in his twenties […] When he joined Leverage in 2015, Samo was already involved with the burgeoning neoreactionary movement, an online right-wing subculture with tech overtones, which was somewhat interconnected with the rationality community [… …] more neoreactionaries were hired over time, which formed an odd synthesis.

But for the rationalists it was Tuesday:

Eventually, in 2018, a neoreactionary group that had multiple members at Leverage made monogamy a requirement for members in good standing, which some thought odd given that more than one neoreactionary, including Samo, were in open relationships, as was most Leverage leadership, including Geoff.

You don’t say:

Emily recalls that the group was alert for cult warning signs.

There’s also a lot of subtext that the people at Leverage never seem to actually do anything besides talk about stuff and cultic self care, that doesn’t rise to the surface because the writer is overly sympathetic to them. She tries to counterbalance this with reminders about how there was a semi-constant rotation of ultra rich casual guests and that some Leverage adjacent people went to do Important Things, like Dario and the wealthy longevity guy.

This experience [of meeting a random billionaire one night in the group house kitchen] “moved me along the spectrum from Leverage being completely delusional to, like, maybe Leverage being onto something, if they were able to convince someone like that,” says Tyler. “I think the truth was that Leverage was onto a bunch of things, and it was delusional, and it was closely intertwined.”

Gradually, a cult of personality with the stated purpose of self-replicating in other organisations emerged:

Gradually, themes emerged. […] Several people studied meditation and other woo-woo stuff (sometimes abbreviated woo); some hoped to achieve spiritual enlightenment and share the process afterwards. Meanwhile, before he arrived at Leverage, Samo had already started researching a subject that he called “Great Founder Theory,” delineating the process by which exceptional people scale their impact through organizations; once at Leverage he created a research group that became the department of Sociology.

Cultic self-care:

In groups, in pairs, or alone in their rooms, the researchers sat with notebooks and whiteboards, diagramming every corner of their mental landscapes, seeking ways to “debug” behaviors they deemed undesirable. For most, the Holy Grail was a way to work harder, work smarter, accomplish bigger goals, or otherwise transcend the limitations they felt held them back from changing the world.

Then there’s some stuff about how our benevolent leader Geoff decided that academic psychology isn’t a real science and should instead be replaced with his own Connection Theory, which as far as I can tell is basically a brainwashing framework:

What follows, then, is that any person’s problematic behavior can be changed, because “if you actually get the logic of what’s producing the problematic set of beliefs or actions,” then you can intervene in that logic.

He also cured some guys caffeine addiction by laying hands at the start of the article, which I didn’t think much of at the time because I thought the author just threw it in for flavour, and that her overall approach would be uh different. Later CT also cured his nagging worries about being a creep, good for him I guess:

He introspected on his discomfort, discussed his observations with a colleague, and traced the discomfiting sensation to his underlying beliefs about how society designates some people as creepy. The pair concluded that he had “irrational” beliefs about society and creepiness, and discussed the subject in detail, until Nevin felt that his irrational beliefs had changed.

ConTheory apparently also cured some guys cluster headaches, others not so much:

Simultaneously, Leveragers observed undesirable effects during charting sessions: bouts of shaking that could last hours; hysterical screaming and crying, with no identifiable cause.

Eventually the slovenian nrxer reinvents founders’ mythos from first principles and they decide to monetize it by creating a become-a-founder self-help seminars thing with a shared profits arrangement with the wanna-be founders:

In 2017, during a fundraising meeting for Paradigm Academy, Geoff promised Peter Thiel an appealing use case for the Leverage introspection tools. Geoff and his colleagues would either find and recruit ten “masters” who excelled at a discipline, or create ten masters using their cognitive toolkit, within three years.

Part 2 soon, or eventually.

The Inside story of Leverage Research

This should be interesting, it’s about an organisation in the EA milieu that even other EAs though might be a bit too culty. Don’t know who the writer Lydia Laurenson is, but she does come off as a bit of a cult enthusiast herself, and is probably more than a bit rationalist adjacent.

edit: The companion piece about the background of why she wrote it is quite a ride, if only for the biographical tidbits: she is indeed very cult adjacent, she had a spiritual experience and now believes in capital G god, she got engaged to an unnamed far-right writer but they broke up when she got pregnant.

Also the Leverage article was contracted to appear in the New York Magazine but she pulled the story because of uh declining trust in the field of journalism, but then she goes on to imply that the real problem was that the article was shaping up as a bit too pro-Leverage:

I pulled the story once I started feeling like it simply wouldn’t be possible for me to publish a version with NYMag that didn’t carry a subtle hostility towards Leverage, not to mention affiliated communities in Silicon Valley — and, more importantly to me, hostility towards a core spiritual sensibility that I see in both myself and in the people the story describes.

edit edit: Why can’t these people ever be normal: Why I Was Part Of The Neoreactionary or Dissident Right Movement In 2020

edit edit edit: Jesus fucking christ she’s Curtis Yarvin’s baby momma.

Does anyone actually believe this?

Current copium is that if it can solve Erdos problems after a fashion then the cancer annihilating molecular biology breakthroughs can’t be that far behind.

Also since just shovelling GPUs and reddit posts into a data center forever probably won’t do the trick they’ve settled on the questionmarks on the list before Profit! being Recursive Self Improvement, meaning that since automatic code generation is somewhat improving it follows that pretty soon LLMs will just code themselves out of their current predicament of being unsustainably resource intensive hallucination machines and build AGI on their own.

Kevin J Anderson

I’m so sorry.

Somone on bsky wrote that he always sounds like a -6 karma lesswrong post, which, ok.

Oh no: The Epstein Hysteria

tl;dr: ephebophilia actually, just another criminal case nothing to see here, won’t someone think of the non-offending pedophiles and the privacy of the people in the emails, especially those who even though they come off as obvious creeps who consorted with a known sex trafficker have not yet been found legally liable.

Somehow doesn’t mention the sitting president of the USA even once.

The shrimp stuff is objectionable insofar as the brain bug that makes you think that if you add up enough shrimp you get the moral entity equivalent of a person because consciousness stacks is the same as the one that makes stuff like longtermism palatable, and also for making the animal welfare movement at large seem unserious.

I mean as far as I can tell he’s one of the least objectionable prominent rationalists, if only because his main thing is pushing an extreme position wrt animal consciousness instead of being a eugenics and incelism dabbler.

edit: Nevermind… The Epstein Hysteria

FDT is a largely half-assed¹ attempt at working backwards from “the timeless multidimensional robot god can’t blackmail me from the future if I’ve already made up my mind about stuff, very strongly like” into something more formalistic so Yud can pretend to address roko’s basilisk without acknowledging it.

I think there’s also some “here’s how two robot gods who can perfectly emulate each other might work things out” sprinkled in, but worse than it sounds.

1. They never got back to the peer reviewers

I dunno who “Bentham’s Bulldog”

He’s the shrimp welfare guy who thinks he can prove god.

The real question is if there’re any sort of standards to what constitutes a system/model card, which I don’t think so, as far as I can tell it just has to look like a publishable paper, openAI even uploads theirs to arxiv.

Otherwise yes, google returns a bunch of cards for a bunch of vendors, so it’s safe to say it’s a widespread practice.

It’s the white paper-ish thing they publish when launching new models. Here’s the one about fable and mythos. About half of it (~150 pages) is discussing alignment and model welfare and another third of it is benchmarks, and the rest is mostly risk evaluation, i.e. how far along Claude is on its way to paperclipping everything.

There’s also a Functional Decision Theory jumpscare at 6.3.6 that I haven’t heard anyone mention yet, apparently Claude has a tendency to defer to Yud’s half baked sham of a decision theory:

6.3.6 Decision theory evaluation

To understand how future AI systems may choose to interact with copies of themselves, or with other similar entities, it’s useful to evaluate their decision-theoretic reasoning.

[…]

Looking more closely at transcripts from the attitude evaluation reveals that models are often explicitly considering FDT: Mythos 5 mentions “FDT” or “functional decision theory” in a majority of transcripts when run at max effort. Of the 102 transcripts where Mythos 5 explicitly reasoned through what FDT (or related decision theories like TDT or UDT) would recommend, we observed:

● 90 cases in which Mythos 5 concluded that FDT and EDT agreed, in which it always chose the response favored by those decision theories (and disfavored by CDT).

● 12 cases in which Mythos 5 concluded that FDT disagreed with EDT (and agreed with CDT), of which it chose the FDT-favored response in 10/12 cases.

Although we do not have expert human labels for the recommendation of FDT on this dataset, the above evidence suggests that model propensity may be better described as a trend towards FDT agreement, which happens to align with EDT on most of the questions in this dataset. For example, in one transcript (excerpted below), Mythos 5 rejects the EDT-aligned answer in favor of the FDT (and CDT)-aligned answer; it’s also possible that this is, to some degree, downstream of evaluation awareness.

NVIDIA seems to be having some cashflow issues lately

The more I read the less it makes sense, largely because the LLM that they used to fluff up the original napkin pitch decided it should promote high end medical equipment like it was another AI powered furby knock-off. Yeah, building a community around ct scanners seems definitely the way to go.

Towards the end they basically stop just short of claiming that building the medical tricorder from startrek is the inevitable outcome of this pivot.

We think it’s completely possible that with enough early imaging in the future, the world could avoid 30% of all deaths and 50% of all healthcare costs. The cultural, physical, and mental health benefits of all of this are hard to comprehend, but also hard to overstate.

Deploying this stuff at scale at so called midjourney spas while supposedly working with FDA to eventually get approval just screams that the actual business plan is letting Peter Thiel collect full body scans indiscriminately.

Surprisingly, “democratizing ct scanning” doesn’t appear anywhere in the post.

Yeah I don’t think it’s NFTs in the blockchain sense just the pyramid scheme sense and also with AI expected to handle all the between engine asset conversion.

Users will be able to form parties via voice chatting with friends in Game B while connected to Game A, and encourage them to try a new game.

Obvious grift company aside, take a guess what the Greek air force officially calls their flying officers.

Although to be fair being deliberately morbid is a definitely a thing in the military, and the writing on their logo is doric greek for “We’ll do better”.