Why YSK: Because intuitive explanations are few and far between, and the technical explanations often present too many “trees” and not enough “forest”, which is just how technically-minded people are trained to approach things. Forests are, after all, made of trees, and it’s not their fault we don’t care about individual “trees”. This then, is my unprofessional attempt to consolidate everything I’ve read over the past three days into one, easy-to-understand explanation of how all this shit works in lay-person’s terms. Due to my amateur background, I may have details incorrect, and I would request that anyone who catches anywhere where I have made a mistake, even a small detail, to please correct me. I will also include a few links to my best sources at the bottom. tl;dr style explanations will be included after every paragraph in parenthesis. So, let’s begin:

Imagine you have reddit. Fantastic, it’s a giant forum composed of a whole bunch of smaller, sub-forums. But let’s take this one step further. Why have just one reddit? Why can’t we have lots of reddits, each capable of having its own complete set of subs, where each reddit is independent of every other one and has its own web address? Okay, let’s do this, and push it to the extreme. Let’s make it so everyone can make their own reddit, even individuals. So you, if you wanted, could set up your own complete reddit, with just you in it. You could have all the subs, r/TIL, r/TIHI, r/pics, etc etc, all with just you in them. You have total control! But you have no content and are probably pretty lonely, right? We’ll get to that. Let’s call this Self-Hosting though.

(So, we now have a situation where many whole reddits can individually exist, each in the vacuum of space.)

Now let’s fix that content and loneliness problem. What if we allowed each reddit to communicate and share content with every other reddit, similar to how subs can communicate with each other? Boom. We just created a spider-webbed network, of countless individual reddits, each composed of subs, that can now all share content back and forth. Let’s call this big spiderweb an over-reddit, to contrast it with subreddits.

(Now instead of a two-tier system of isolated reddits and their subs, we have a three-tier system, of over-reddit [the “Lemmy-verse”], reddits [Lemmys or Instances or Servers], and subs [communities or sub-lemmies].)

But, we actually have a technical problem. How do these individual reddits find each other? How do they know the other ones even exist? They could be on servers on opposite sides of the planet, with random web addresses. Obviously we can’t just guess. So, okay, let’s let users solve this for us via crowd-sourced labor. We don’t have to find all the reddits for them. Let’s just design the system so that the reddits only find out about each other after any random-ass user introduces them to each other. We’ll call this batching, they can do it with the reddit search bar. Then, we’ll wait for that random-ass user to actually subscribe to any new sub/community over there, which they’ll only do if it’s any good. Once this is done, now the two reddits and that one sub become connected, not just for that user, but their whole reddit userbase too. The rando doing the search and subscribing simply introduced two good reddits to each other. Now that they know about each other though, they’ll share content back and forth freely, with comments, votes and posts all being visible to both reddits. Let’s call this “federating with each other”. It’s not too different from neurons in the brain reaching out to each other, really.

(To find and connect the disparate, scattered reddits into our over-reddit, we use crowd-sourced labor.)

Well, that’s it. That’s the Lemmy-verse. But what about this Fediverse? Well, okay, remember what we did with reddit, and giving it a third tier of over-reddit? Let’s do the same exact thing with twitter, facebook, youtube and every other thing we can pull out of our asses. Let’s let all of them share and access each other’s content with the exact same structure and system, so now you, hanging out in your reddit, can get all the tweets too. We’ve made a fourth tier now. The Fediverse, which is most comparable to the internet itself, and includes the Mastadon-verse, the PeerTube-verse, etc etc.

(Why stop there…? reddit is chump change, let’s just do this to everything.)

So, that’s it in a nutshell. That’s how this shit works. And the next time someone says it’s like email, I’m going to climb through their computer screen and smack them. It’s only like email at that technical, “trees” level, and when you go up to the more intuitive “forest” level, this just serves to confuse the ever-living hell out of everyone.

(I’m a bit of a dick.)

One last detail: Admins can whitelist (allow-list) or blacklist (shadowban) other Instances/servers. As an example, one of the other largest Instances has blacklisted (shadowbanned) us here at lemmy.world, because we were producing too much spam. As a result, until they undo this, all of us here are shadowbanned from their Instance/server. We can see their content, they can’t see ours. This enables them to control how much connection they have to the rest of the Fediverse.

(Let’s not forget to give admins the power to stop people from other places bothering them, if they do not approve of the content. Very important feature.)

Sources: https://join-lemmy.org/docs/users/01-getting-started.html https://en.wikipedia.org/wiki/Lemmy_(software) https://github.com/amirzaidi/lemmy https://news.ycombinator.com/item?id=36387939

Again, if I’ve made any errors, regardless of how small, please let me know below. This is intended to be another reference material for lay-people, so accuracy is important. However, outside of major errors, I will not be editing this post to correct it, as I would prefer any corrections to be delivered from the full perspective of someone’s individual expertise, instead of being translated into my own words.

(I don’t actually know what I’m talking about. Scroll down for people who do.)

Hope this helps.

edit for grammar/cleanup

  • Empyreus@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 year ago

    Definitely a nicely written explanation. Though I still feel it will be too much for the general population to understand and adopt.

      • infotainment@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        1 year ago

        I think the problem is that you have to have at least some understanding of how the federation aspect functions to make sense of Lemmy. I’d love to contribute to their UX, there’s a lot of room for improvement IMO.

        • Candelestine@lemmy.worldOP
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          I’m definitely hoping a lot of technical solutions to current problems will be arriving in the coming months.

          • Phaeolus@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            I have a basic question I’m hoping someone can answer. I want to read this post, but when I follow the link, it takes me to a Game Thread every time., but with the comment section of the YSK post. Even when I go to Candelestine’s profile and click on the post, I instead get some Game Thread (last time it was Braves @Reds) with comments about Lemmy and federation. What am I doing wrong?

            • Candelestine@lemmy.worldOP
              link
              fedilink
              English
              arrow-up
              2
              ·
              1 year ago

              That is a bug. Something something websockets something next update. Maybe.

              It’s an inconsistent bug. If you keep trying you will get through eventually.

    • DoctorTYVM@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Yeah, unless one of the fediverse sites can simplify I don’t see it taking off among regular people.

      • Falmarri@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        I think the search just needs to get better. The large instances should already have connections to the most popular instances and communities. So the average person isn’t likely going to need to be doing the linking. But the search right now just feels clunky

      • JackFrostNCola@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        So i may have understood wrong here but i think the analogy is like saying something like:
        instead of reddit being a central hub with “rooms” (subreddits) branching off, we instead have multiple reddit hubs which have their own sets of rooms. But a lot of those rooms have little back doors or hallways to the same room at the other reddits, so the users in a particular room can see eveything in all the other alternate version of the same room as if it was the same one.
        Like being in the same subreddit without realising its a compilation of contant from all the other rooms across the lemmyverse.

        But also that if the people in a particular room start getting rowdy or dangerous then the other rooms can lock their backdoor connecting the rooms so the unruly users cant come in from that other room until they decide to unlock the door again.

        Have i got this all right?

      • justhach@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        2
        ·
        1 year ago

        Good. Getting “regular people” to use reddit is what ruined it. Let them keep reddit and we can stick to the fediverse.

        • FuntyMcCraiger@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          1 year ago

          Yeah, it certainly lost its charm when comment sections became more like Facebook’s/YouTube’s/Your-local-newspapers-website’s.

  • jalda@kbin.social
    link
    fedilink
    arrow-up
    4
    ·
    1 year ago

    Then, we’ll wait for that random-ass user to actually subscribe to any new sub/community over there, which they’ll only do if it’s any good

    [citation needed]

  • wizel10@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    I do recognize this post is mostly directed to redditors (include myself) but could sound more neutral not using reddit as example all the time. You can refer to a more neutral “web page”. Just a suggestion.

  • yaaaaayPancakes@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    1 year ago

    This is a great writeup, but if someone could elaborate on how a piece of content in the Lemmyverse gets into the Mastadon-verse, and how interaction on that piece of content in both -verses is handled across the verses, I would appreciate it.

    From what I’ve seen, it sounds like since everything in the fediverse shares the ActivityPub APIs under the hood, it’s possible to share the same piece of content across verses. But I can’t wrap my head around how interactions with the content across -verses is possible.

    • warmaster@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 year ago

      Imagine a UN gathering with government officials of different countries speaking English as common language, simultaneously CNN of each country streams the translated message in local language.

      Same thing happens between different Fediverse apps. Within the app, the info is stored differently, but it gets mapped to the common ActivityPub fields.

      You will fully grasp this concept after a quick read of this page on how does Bookwyrm interact with Mastodon:

      https://docs.joinbookwyrm.com/activitypub.html

  • Dark_Blade@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    Honestly, the ‘email’ analogy is still the best one for most people. Takes less time too, which is important when most people have an attention span of less than a femtosecond.

    • Candelestine@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Honestly, I just don’t think there is a single easy analogy that actually works for most people. That one or any other one. That was why I slipped in the neurology analogy. Different analogies for different folks.

      But most people think in terms of features and experience, not mechanism. So, if this was like email, it would be secure, private, one-on-one and more annoying than fun.

      • Dark_Blade@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I dunno, whenever I use the email analogy to explain the interoperability aspect, it makes people feel more at-ease with the whole ‘federation’ thing. Most people, after all, get email.

              • Dark_Blade@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                ·
                1 year ago

                I basically use it to explain how accounts work: ‘It’s kinda like having a Gmail account. You have a Gmail address and can only login through Gmail or apps that support it, but you can send Emails to people with Yahoo accounts. Similarly, having a lemmy.world account will only let you login through lemmy.world, but you still have full interaction with lemmy.ml users, or even entirely different ‘platforms’ like Kbin.’

                Sure, it’s extremely dumbed down and not entirely accurate, but it’s easy enough for people to relate to, and it puts them at ease about the whole ‘fediverse’ thing.

                • Candelestine@lemmy.worldOP
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  1 year ago

                  Hm. That is admittedly worded in a simpler way than I usually see, perhaps. I’ll keep it in my back pocket, thanks for sharing it.

                  I may have been too hasty in my dismissal of the analogy.

  • UltraHamster64@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Thanks for the explanation! Although I consider myself somewhat techsavy, the whole system was confusing at first and only after a couple of weeks of using it/researching/trying to understand how shit works (in parallel to uni finals) I am starting to get a hang of it. Your post really helped to get the overall picture of how this federation works!

  • Venicon@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Thanks. I am using Memmy on TestFlight and it’s made the Lemmy experience so much easier.

    One question I have though. Can I search for a kbin ’subreddit’ or whatever they are called or a Squabble sub to my Lenny profile so it brings all of them into one or so I need the account I have on each of them and treat them as 3 independent sites?

    • Candelestine@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      You only ever need to make one account. From that main server where your account is, you should be able to go into the search bar and punch in the URL (or a special Fediverse link, they always start with a !) of anything else on the entire Fediverse. Once there, you should be able to subscribe to that new place without having to create any new accounts. Once the process finishes, the new content should start appearing in your feed back in your home community.

      Do be aware that the process is a little buggy, and here on lemmy.world via web browser, I often get “No Results” even though it actually is in the searching process and will eventually find them. It does take a few minutes though.

  • Cadenza@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Thanks for this ! I learned quite a few things, even on stuff I thought I had already understood !

  • Lifecoach5000@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    Ok I understood most of this already and it all is pretty neat. However, I did not know this “batching” part. So if I started up my own lemmy today with a few other subreddits underneath it, I would be able to search/find those from lemmy.world later today?

  • ginerel@kbin.social
    link
    fedilink
    arrow-up
    0
    ·
    1 year ago

    We can see their content, they can’t see ours.

    Wasn’t defederation a two-way thing? Basically the whole instance (website, in laymen terms) blocked you. Nothing goes in, nothing goes out between you two.

    • Falmarri@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Even if that’s the case, I THINK this instance can get the content transitively through the other lemmies it does federate with. I could be wrong there as well though

    • Candelestine@lemmy.worldOP
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Thank you for asking this. I believe it works as I described, but I myself am hoping for either a correction or a confirmation from a knowledgeable expert. My understanding mainly came from the ycombinator thread, which is not a perfectly reliable source.

    • wols@lemmy.ml
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Not an expert, just relaying what I read elsewhere. TLDR: “nothing goes in, nothing goes out between you two” is about right, but it’s not entirely symmetrical.

      Instance A defederates from instance B. This means that (let instance C be a neutral third party that is federated with both A and B):

      • no posts or comments by users from B anywhere on lemmy are visible to users from A
      • existing posts and comments in communities on A are still visible to users from B
      • new posts and comments by users from A and C in communities on A are not visible to users from B
      • new comments by users from B to existing posts in communities on A are not visible to users from C
      • new and existing posts and comments by users from A in communities on C are still visible to users from B