Been looking into resource constraining Kopia through systemd to prevent the Go binary from eating through too many resources. Anyone running a system like this?

  • deffard@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    11 days ago

    I have run it for several years overnight without issue, backing up around 10GiB, but can only vouch for the stability of the solution and not its behaviour under constrained resources. I had come from duplicati which always ended up with a corrupt database I could not restore from. This project has been a solid replacement, so I would recommend giving it a go.

      • deffard@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        10 days ago

        I run the schedule through the server, which also allows you to browse the snapshots, restore individual files from them, and validate what has been backed up.

  • scrion@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    11 days ago

    In general, if you want to decrease CPU and memory usage, the first and foremost thing you should do is decrease parallelism via the kopia settings (i. e. either as a global policy for scheduled backups, or directly as parameter when creating a snapshot). No idea about kopia-ui, but the settings are probably exposed there? Not a ui user.

    You can also decrease resource usage by tweaking compression settings, or disabling compression completely.

    Once that is done, you can experiment with hard limits. I’m not sure how resilient kopia is in the presence of those, or how performance might suffer - all I can say is I backed up 2TB of data just 3 or 4 days ago using reasonable settings, and it did not tax the host overly much.

  • Victor@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    10 days ago

    How come you don’t want it to use resources? Unused RAM is wasted RAM etc. I’m sure you have legitimate reasons, I’m just curious what they might be. 😁

    • kiol@discuss.onlineOP
      link
      fedilink
      arrow-up
      2
      ·
      10 days ago

      I was considering trying it on resource constrained machines, with 2 - 8gb ram available. Been looking at Kopia or Borg. Borg is limited to single core.

    • kiol@discuss.onlineOP
      link
      fedilink
      arrow-up
      1
      ·
      10 days ago

      I’m concerned about resource usage spikes while trying to run other services on same device.

      • Victor@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        10 days ago

        Ah okay. Like in the sense that those other services might not survive, or just performance degradation?

        Cause I’m thinking otherwise I’d just run the backup overnight or something. 😅 But that might still not be feasible of course.

        • kiol@discuss.onlineOP
          link
          fedilink
          arrow-up
          1
          ·
          10 days ago

          Performance degradation, but figured I’d ask outside opinions. So far, sounds like performance is solid relative to resource usage. I’ll give it a go and play around with letting it run mult-core vs single core.

            • kiol@discuss.onlineOP
              link
              fedilink
              arrow-up
              2
              ·
              10 days ago

              Thanks! I’ll be sure to share results here, and as part of my Linux Prepper podcast. Right now I’m building up documentation, and trying it out, with info in my dokuwiki.