I’m trying to fix this annoying slowness when posting to larger communities. (Just try replying here…) I’ll be doing some restarts of the docker stack and nginx.

Sorry for the inconvenience.

Edit: Well I’ve changed the nginx from running in a docker container to running on the host, but that hasn’t solved the posting slowness…

    • Ruud@lemmy.worldOPM
      link
      fedilink
      English
      arrow-up
      12
      ·
      2 years ago

      Hmm. I guess the delay in posting is not related to nginx. I now have the same conf as a server that doesn’t have this issue.

      • Acetamide@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        arrow-down
        1
        ·
        2 years ago

        I’m only familiar with the high-level Lemmy architecture, but could it be related to database indices being rebuilt?

  • 00Lemming@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    ·
    edit-2
    2 years ago

    Godspeed to you over the coming days man. Really appreciate you putting this together and the extra work it takes when tackling something like this (both being new to the platform and the tech still being in relative infancy) - not to mention the crazy scaling happening. I will definitely be pitching in to help make sure the server stays up!!

  • necrxfagivs@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    ·
    2 years ago

    Keep up the good work!
    I joined this instance and also mastodon.social, first time using the Fediverse and as excited as confused lol

      • azura@fedia.io
        link
        fedilink
        arrow-up
        14
        ·
        2 years ago

        You got this. <3
        I don’t have experience scaling Lemmy, but I do have experience scaling stuff in general. I’m sure you’ve got a few people here who’d be willing to talk things through with you if you get too frustrated.
        And don’t forget to breathe and step back if you have to. Your well being is more important.

  • slimerancher@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    2 years ago

    Something is weird.

    I opened this post from main page “subscribed listing”, but the title showed “I can’t find any cannabis cultivation community”, but the comments were same. I initially thought I have opened a wrong post, but the comments were mentioning “Good work Ruud”, so I refreshed and it fixed post’s title.

    Have you noticed the issue?

    • TRBoom@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      ·
      2 years ago

      I’ve noticed a couple oddities as well.

      • I refresh a page and a completely different page loads instead
      • An autorefresh hits the community tab, but it loads up 10 posts from a single community I’m sure it’ll get sorted out eventually lol
    • TeaHands@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      2 years ago

      It’s happened to me a few times as well (not just on this instance, think it’s a bug in Lemmy itself). So far I’e not found a reproducible pattern though so it’s a tricky one to bug report effectively.

        • csos95@lemmy.world
          link
          fedilink
          English
          arrow-up
          7
          ·
          edit-2
          2 years ago

          I had something similar happen yesterday.

          I opened a thread about pokemon, browsed it for a bit, did some stuff in other tabs, and clicked back to the pokemon tab maybe an hour later to browse some more.

          The post had changed to one where a user was asking for relaxing game recommendations and it was loading in new comments that seemed to be from that post, but I could still see the comments that had already loaded from the pokemon post when I scrolled down.

          When I refreshed it changed back to the pokemon post and only showed comments from that.

  • animist@lemmy.one
    link
    fedilink
    English
    arrow-up
    9
    ·
    2 years ago

    Since I have you here, if I start my own instance do I absolutely have to use docker? I’ve never had good experiences with it and would rather just install programs the old-fashioned way

  • veroxii@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    2 years ago

    Any progress on this. I’ve been thinking about it too. Couple of ideas:

    Too many indexes needing to update when an insert occurs?

    Are there any triggers running upon insert?

    Unlikely but there isn’t a disk write bottleneck? Might be worth running some benchmarks from the VM shell.

    • Gompje@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 years ago

      I was thinking that as well, it’s like the post gets “checked” or something like that and that gives a timeout of 20secs. It could be an api or database but somehow my spidey sense says this could well be in code. Some extra calls to filter things maybe? Using an external server? Or even the propagation to the others? (Idk how this federation thing connects to the others, could be just that; maybe another server that is the bottleneck) I just found the 20 seconds suspicious given that is the default timeout

      • veroxii@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 years ago

        Didn’t know about the timeout but that makes sense. Would be easy to test by changing the nginx timeout.

    • veroxii@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 years ago

      Another thought: how many db connections do you have? Could it be starved because there are so many selects happening and it needs to wait for them to finish first?