• adam@kbin.pieho.me
    link
    fedilink
    arrow-up
    54
    arrow-down
    5
    ·
    1 year ago

    ITT people who don’t understand that generative ML models for imagery take up TB of active memory and TFLOPs of compute to process.

    • hotdoge42@feddit.de
      link
      fedilink
      English
      arrow-up
      23
      arrow-down
      3
      ·
      edit-2
      1 year ago

      That’s wrong. You can do it on your home PC with stable diffusion.

      • ᗪᗩᗰᑎ@lemmy.ml
        link
        fedilink
        English
        arrow-up
        23
        arrow-down
        3
        ·
        1 year ago

        And a lot of those require models that are multiple Gigabytes in size that then need to be loaded into memory and are processed on a high end video card that would generate enough heat to ruin your phones battery if they could somehow shrink it to fit inside a phone. This just isn’t feasible on phones yet. Is it technically possible today? Yes, absolutely. Are the tradeoffs worth it? Not for the average person.

        • diomnep@lemmynsfw.com
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          1 year ago

          “He’s off by multiple orders of magnitude, and he doesn’t even mention the resource that GenAI models require in large amounts (GPU), but he’s not wrong”

    • AlmightySnoo 🐢🇮🇱🇺🇦@lemmy.worldM
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      edit-2
      1 year ago

      You can for example run some upscaling models on your phone just fine (I mentioned the SuperImage app in the photography tips megathread). Yes the most powerful and memory-hungry models will need more RAM than what your phone can offer but it’s a bit misleading if Google doesn’t say that those are being run on the cloud.

  • weew@lemmy.ca
    link
    fedilink
    English
    arrow-up
    55
    arrow-down
    9
    ·
    1 year ago

    So much for the brilliant AI-specialized Tensor processor

    It’s basically just a mediocre processor that offloads interesting things to the mothership.

    • DoucheBagMcSwag@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      7
      ·
      1 year ago

      Yep. What a joke. Goes to show you that google could Make these pixel features available to all android devices if they wanted to.

  • Steeve@lemmy.ca
    link
    fedilink
    English
    arrow-up
    37
    arrow-down
    1
    ·
    1 year ago

    Yeah, obviously. The storage and compute required to actually run these AI generative models is absolutely massive, how would that fit in a phone?

        • smoothbrain coldtakes@lemmy.ca
          link
          fedilink
          English
          arrow-up
          21
          arrow-down
          2
          ·
          edit-2
          1 year ago

          Using Google products has always been a “privacy nightmare” - it’s not like this is some mega open source phone or anything it’s literally Google’s flagship. Is this really surprising? Playing with fire gets you burned.

            • KISSmyOS@lemmy.world
              link
              fedilink
              English
              arrow-up
              11
              arrow-down
              1
              ·
              1 year ago

              And if you do, they won’t upload your stuff to the cloud anymore.
              But if you use Google’s OS and services, you really shouldn’t be surprised they upload your data to Google.

        • Mojojojo1993@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          In what way ? Everything you do on phone Google has access to and therefore any govt body as well.

          Privacy on a phone is a myth unless you use a modded phone

      • 9point6@lemmy.world
        link
        fedilink
        English
        arrow-up
        12
        arrow-down
        3
        ·
        1 year ago

        Even ignoring all the privacy issues with that, it’s kinda shit to unnecessarily lose phone features when you’ve got no signal

        • Eldritch@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          1 year ago

          That’s how phones have always worked. As long as they are not automatically ingesting data from people without permission. I don’t see an issue with this. At least in this instance we have some choice in what we send or don’t. It’s no more privacy nightmare than mid-Journey doll-e or any of the others.

  • Mojojojo1993@lemmy.world
    link
    fedilink
    English
    arrow-up
    25
    arrow-down
    8
    ·
    1 year ago

    Isn’t that kinda the dream. We have devices that remote the os. So we get a super powerful device that keeps getting updated and upgraded. We just need a receiver ?

    Isn’t that what we want. Can reduce down the bulk on devices. Just a slab with battery, screen and modem and soc that can power the remote application ?

    • botengang@feddit.de
      link
      fedilink
      English
      arrow-up
      45
      ·
      1 year ago

      Sometimes that’s what people dream about. On the other hand that hybrid cloud model is giving up the last remnants of computing autonomy and control over devices we own.

      • Uli@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        9
        ·
        1 year ago

        What I would like is something that gives me the framework to host my own server-side computations at home.

    • soulfirethewolf@lemdro.id
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      2
      ·
      1 year ago

      That would be, if Google wasn’t constantly killing things that didn’t do good enough. Especially given how expensive generative AI can be to run remotely. Just look at what happened with Stadia

      Also, it just feels disappointing. Ever since chatGPT, they’ve been pouring near infinite budget into stuff like this by hiring the top talent, and working them to the latest hours of the night. And the best that they could come up with for the pixel 8 is feeding it data from the cloud.

      And I can’t even really believe the whole “consumer hardware isn’t powerful enough” thing given that there’s quite a few ARM processors, Apple especially, That’s been able to build consumer hardware capable of performing generative AI (I’ve personally been able to run stable, diffusion and whisper on my M1 MacBook). Maybe not at the scale or quality of the cloud, but still capable of doing so regardless.

      • random65837@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        2
        ·
        1 year ago

        Google has a bad track record there, but they wouldn’t kill things that were working on their end. What % of the population do you think even knew was Stadia ever was?

        Especially given how expensive generative AI can be to run remotely.

        Great point, except it proves the opposite of what you meant by it.

        Aside from the fact the phones dont even remotely have the resources to do anything like that without sucking their batteries dry and over heating in record time, do you seriously think given the insane workload, hardware dedication, network bandwidth, and that many more people on the payroll, that Google is (choosing) to just do that to be nice? If they could offload all that to the users they would in a second! Even if the mindset is that its about the data mining, they could simply do that after the fact and send themselves the end result, and save themselves hundreds of millions in equipment, power needs, physical buildings, cooling costs and the never ending hardware costs. Ever work in a data center? Ever see how much shit breaks every single day even when everything’s going as planned? Its insane.

    • amenotef@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      1 year ago

      I mean it sucks for offline situations or for actions that need very good latency.

      But the phone’s battery would be happier if the processing is not done locally.

      For some things I prefer to do the stuff locally, for other things on the cloud.

      Some cloud Vs local examples I’m thinking about:

      1. For example (example not related to the Pixel) if I’m generating an image with stable diffusion at home I prefer to use my RX 6800 on my private local Linux rather than a cloud computer with a subscription. But if I had to do the same on a mobile phone with tiny processing power and battery capacity I’d prefer to do it on the cloud.

      2. (Another non AI example): for gaming, I prefer to run things natively. At least until it is possible to stream a game without added latency. Obviously I don’t play games on a phone.

      3. Another example (Google photos): I would prefer to connect Google photos to a local NAS server at home, and “own the storage on premise” and then pay a lower fee to Google photos for the extra services it brings. Browsing, face and objects recognition, etc. But this is not an option. With this I would be able invest on my own storage, even if I had dozens of gigabytes in 4K60FPS videos.

      • Mojojojo1993@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        2
        ·
        1 year ago

        Funny you should say that. I’m basing this on GeForce which I use exclusively. It runs games from the cloud. I play Valhalla on my TV. I love rural and don’t have don’t have fibre.

        Yes you read that. No fibre.

        I recently got starlink and have been loving life. Living on a farm playing GeForce games. I loved stadia and bought into the whole thing. Raged that they cancelled it. But I got my money’s worth.

        Now it’s not perfect but I live in rural NZ. So I have streaming to Aus to use GeForce since GeForce isn’t native to NZ.

        It’s insane how good this cloud gaming is.

        So fuck Google but first company to get a phone running on remote I will be buying

        • amenotef@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          1 year ago

          I mean I didn’t mean it to be funny…so apologies if you took it as a bad joke.

          But basically I just meant that I prefer (for gaming) to run the game locally than on a cloud. I barely tried remote gaming. I tried on WLAN the one from steam but only for 5 minutes. Then I tried PS Remote play last week streaming FF16 (just for testing) to my steam deck running W11 but at the home I was there was not enough bandwidth because there was a delay while moving the camera.

          I usually play at 144Hz 1440p (on PC) and also at 2160p 60Hz (TV, although the PS5 gives crappy 30 FPS in many heavy games).

          I also play some online games like Warzone with some friends. So if the experience of cloud gaming works for games like these then of course I’d be more happy with it.

          • Mojojojo1993@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            Yeah nah. You ain’t getting anything like this. Nobody who plays that kinda high level would be Happy with cloud. I’m trying to live on the cheap and since I’m nomad with no house or fixed abode.

            Yoid not get that can off power from GeForce. You can’t really play any competition games as latency would be too high.

            I suggest everyone gives it a go as it’s been great for me. But we need more people involved and more competition. If it’s just GeForce then they can price it through the roof with no improvements

            • amenotef@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              1 year ago

              I’ll definitely give it a shot. At least to the ones I have at home (the one from steam that uses my desktop and the one from the PS5).

              • Mojojojo1993@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                ·
                1 year ago

                I think everyone playing with it would be good. Can force them to work for the consumers and not just give us what is cheap or best for them.

                Cloud works well for me as I don’t need the best graphics and can’t really justify buying an expensive console. Especially with how good GeForce has been. Tried Luna and it was honest just as good. Sat on my lawn playing ac origins. Was glorious

      • Mojojojo1993@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        2
        ·
        1 year ago

        Stadia was great. People were just attacking it. Bad marketing from the get go. Have you tried it ? Did you just follow what everyone else says or actually try things for yourself

        • dustyData@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          1 year ago

          No, how could I try it? it doesn’t exist anymore. Poor tiny little startup Google, bullied by the big bad user mob who paid for the service they sold and actually expected to receive what they had bought.

            • dustyData@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              2
              ·
              edit-2
              1 year ago

              I’m not from the USA, how could I possibly have tried it? It died before it could’ve even become a product. Even if they would’ve gone to rural areas or the developing world it would’ve failed because there’s not sturdy enough infrastructure to support the service. And as the experience proved, not even South California has enough infrastructure to support the service without massive lag. I remember reading that even people with Google Fiber had issues. So it was a failed service for a strong technical reason, not just the awful marketing and even worse service offering. Paying a subscription and buying games was the most retarded move Google made at the moment, but they make so many stupid moves so frequently that it’s hard to tell if it was the worst.

        • VR20X6@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I tried it. It worked reasonably well when wired and pretty terribly wireless, which isn’t that surprising. The free starter kits they gave out came with a Chromecast Ultra for a reason: it had Ethernet on the power brick.

          On the other hand, I hated it ideologically from the start. You bought games that were only available on their service and could only play with an active Internet connection. That’s also to be expected. Not ideal, but not a big deal in itself so long as you know what you’re getting into. What isn’t okay is that you could lose access to the service permanently and there was no guarantee you would be compensated in any way whatsoever. At most they gave vague “don’t worry about it wink wink” answers when asked in Reddit AMAs. Fortunately they did refund everyone when they shut it down, but they were under no legal obligation to do so. People who bought in were lucky. I wish I could say it was purely out of goodwill, but it’s more likely that a bean counter at Google decided it was cheaper to refund everyone than to shoulder the bad press from not doing so.

          Thank goodness there were also no notable exclusives on the service. The idea of games just completely disappearing from history just because Google got bored with a product like they always do is nauseating. It’s bad enough that they bought out Typhoon Studios only to pretty much immediately shut them down. Again, thank goodness they were able to rise from the ashes and reform the studio under a new name.

          • Mojojojo1993@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            Interesting. I only had access to it wireless. I used a OnePlus one VPN to North America and HDMI to a screen. It wasn’t flawless but I didn’t expect it to be.

            Oh I agree but also I don’t. Ubisoft games are still the same. They can drop access at any point and they likely wouldn’t refund. Unfortunately unless we build an open source internet that is backward compatible I think we are fucked.

            Will Xbox and PS5 games work without a patch. Could they yank a game and stop it being playable? Can steam epic gog ?

            Yeah there was a game that was exclusive? Was that the one you mentioned?

            Fuck Google but I loved the idea and now use GeForce. Similar concept I suppose

  • Bloved Madman@lemmy.world
    link
    fedilink
    English
    arrow-up
    19
    arrow-down
    3
    ·
    edit-2
    1 year ago

    This just strengthens the argument to install privacy/security first operating systems like CalyxOS and GrapheneOS. I don’t was a phone that’s more a service subscription than it is hardware. I have the pixel 8 and didn’t get the pro due to the offloading to Google servers for some “features”.

    Just waiting for GrapheneOS to be released for the 8… Until then, I’m sitting uncomfortable knowing my phone is uploading telemetry to Google servers…

    • ReginaPhalange@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 year ago

      I’ve bitten the bullet, replaced my Redmi 13 to a Pixel 7 + GrapheneOS - because the MIUI spyware and google spyware are just too much… I still don’t get why , as an owner of a phone , I’m not the owner of the phone.

      • random65837@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        arrow-down
        1
        ·
        1 year ago

        You’re very much the owner of the phone, which is why you were able to put Graphene on it.

        • MrPoopbutt@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          I can’t put grapheneOS on my p7 since at&t sells phones with locked bootloaders. I didn’t know this when I bought it or I wouldn’t have bought it.

          • /home/pineapplelover@lemm.ee
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            Oh yeah, only unlocked phones can boot custom os, carrier locked are not. Unfortunate you had to find out the hard way. I could’ve sworn it was on graphene’s website or something.

        • Bloved Madman@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          1 year ago

          Well, yes, however, installing GrapheneOS may mean not having access to “features” which were part of the marketing for the phone… Which begs the question around what are you paying for? To me, it’s like you are paying for a product and also for services. Although the p8 and p8p both have 7 years of support, I wonder if that extends to features and services that are cloud based?

          • random65837@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            1 year ago

            Fair enough when its out of context, but a privacy advocate doesnt but a Pixel for anything thats touted as a Google feature, what they’re paying for, is the hardware that ironically allows them to most effectively cut ties with Google as a whole.

            People who dont do that could care less how its happening, only that it is, and they their battery lasts.

            • Bloved Madman@lemmy.world
              link
              fedilink
              English
              arrow-up
              4
              ·
              1 year ago

              Yea, Google features are very anti privacy, it’s funny how it’s still one of the most secure phones on the market. I got the pixel 8 for the fact its going to be supported with GrapheneOS, and get 7 years of security updates.

      • Bloved Madman@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        Yea I was tempted for a second to get it, but there was a comment that it “should” be possible to upgrade to the released version when available, I don’t want to have to mess around in the event that it’s not. So I’m just going to wait a week or so.

    • Contend6248@feddit.de
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      1 year ago

      When some company praises the ground braking AI capability of a new SoC they have been built, you might get the idea that it’s doing these tasks on said SoC.

      Why would you think otherwise?

      A list of what this phone does offline and what not would be great.

      • random65837@lemmy.world
        link
        fedilink
        English
        arrow-up
        10
        arrow-down
        1
        ·
        1 year ago

        People are literally clueless. But then they’d complain when an on phone AI capable model came out, maybe from the fan noise equivalent to a rack server and the backpack battery it needed to run for a couple hours.

        Thats how you tell the difference from actual privacy advocates. Somebody with half a clue would NEVER actually expect this stuff to be able to happen on device.

    • random65837@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      2
      ·
      1 year ago

      So “no more pixel phones for you” because it needs to upload shit that literally cant be done on a phone? LOL. If you cared abkut privacy to the level youre pretending you do, that ONLY leaves Pixels as a choice, and Graphene.

      Not a privacy conscious person alive buys a Pixel, and then runs it stock.

      • Miclux@lemmings.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        I think you have no clue what the g3 is capable of. Magic eraser for example can be used entirely on device. THAT’S what even Google admits.

        So now tell me why it needs to upload the pictures…just for computing? 🤡

        • G020B@lemmy.zip
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          Well, the Magic Eraser is just an algorithmic fill. It’s not an actual generative ai. So it doesn’t require so much compute power. If Pixel 8 had the new generative Magic Eraser on device, it would be either really bad or take minutes to process.

          • Miclux@lemmings.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            1 year ago

            It is generative ai via ml. What are you talking about… If it wasn’t then it proves even more my point. Why uploading it for computing?!

            • G020B@lemmy.zip
              link
              fedilink
              English
              arrow-up
              2
              ·
              1 year ago

              It’s obvious that you don’t understand this topic at all. So it would be better to end this discussion. But I will try to explain. Old Magic Eraser: definitely not generative ai, because it doesn’t “generate” anything - just completes the missing part with the other parts of the image. So it’s not that resource heavy and can be processed on device. It doesn’t require complex diffusion generative models. New Magic Eraser: uses actual generative ai, because it generates whole new objects that replace the part you want to erase. And that requires a lot of processing, because it needs large image generation models that currently can’t be run on the device. Although, Pixel 8 could run some small image generation models, they would be far worse than the large models that Google runs on their servers. In the future, the technology will get better and more lightweight. So in a few years, it will be possible to run a good image gen models on device. But that’s not the current focus of the industry.

              • Miclux@lemmings.world
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                1 year ago

                Are you not capable to read the press statement from Google itself? GOOGLE SAYS THEY COMPUTE MAGIC ERASER ENTIRLY ON G3.

                Now they also upload the photos AFTER the process.

                • G020B@lemmy.zip
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  1 year ago

                  I think we both misunderstood each other. I looked up the press release and they say that there were some generative improvements to Magic Eraser that run on device. But that’s not in the “Magic Editor” UI I meant, when I was talking about the new features of Pixel 8. You were mad at Google because of the upload to the cloud. That happens ONLY if you use the Magic Editor that uses large models in their datacenters for best results. But if you use the normal Magic Eraser it will work on device and hence offline. Although it does use some generative AI now - I 100% guarantee you that it will be worse than the Magic Editor, which uses image models that are too powerful for the Tensor G3. So you were angry for nothing.

    • 0x2d@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Pixels have never been “stock android” instead they have been close to stock but with extra AI features over it (e.g Magic Eraser, Now Playing, etc)

      Surprisingly they’re the easiest phones to degoogle as well