• 👍Maximum Derek👍@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    52
    ·
    1 year ago

    Maybe it’s because I’m only using it as plan B or C (after the documentation has already failed me), but I have never gotten any usable code out of chatGPT.

    And yet co-pilot is able to finish my code perfectly after I type the first few characters… even though they’re the same model.

    • AmbientChaos@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      14
      ·
      1 year ago

      I think co-pilot works better because it has the context of the whole project for reference when suggesting auto completion. I’ve gotten a lot of unusable junk from it too though

      • JimmyMcGill@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        1 year ago

        It can go from great to absolute junk.

        But sometimes I need some weird terminal command and it’s weirdly good at it.

        Also I get a buddy that can put log messages like “AAAAAAAA” all over the place so at least I don’t go crazy on my own

    • dan@upvote.au
      link
      fedilink
      English
      arrow-up
      12
      ·
      1 year ago

      Co-pilot isn’t using the same model. They’re using a model that’s been trained on a LOT of open-source code.

        • dan@upvote.au
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          Not that I’m aware of. Even if the input is public data, the actual training scripts and resulting model tend to be closed-source. Meta’s one of the only major companies I know of to release their models under a somewhat-open-source license.

    • garyyo@lemmy.world
      link
      fedilink
      arrow-up
      11
      arrow-down
      1
      ·
      1 year ago

      ChatGPT is amazing for describing what you want, getting a reasonable output, and then rewriting nearly the whole thing to fit your needs. It’s a faster (shittier) stack overflow.

      • chicken@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        7
        ·
        1 year ago

        I normally have it output toy examples of the syntax I don’t want to bother learning and then remix that into what I need. IMO it’s better than stackoverflow because stackoverflow code is more likely to be not really what you were searching for or not actually run because the author didn’t bother testing it and there’s a typo or something.

    • legion02@lemmy.world
      link
      fedilink
      arrow-up
      5
      ·
      1 year ago

      I go the other way with it. Give me something broken but close and I’ll use the documentation to fix it.

      • MotoAsh@lemmy.world
        link
        fedilink
        arrow-up
        10
        arrow-down
        20
        ·
        1 year ago

        The irony of you being upvoted when reality is the exact opposite…

        Model collapse IS NOT from them consuming more human-based knowledge. It is from them consuming AI-generated content it thinks is human.

        This has been all over the news. How can you utterly fail to understand a basic phenominon? Because you like using the AIs?

        Stop lying about reality if you want them to continue giving you any truth.

    • RightHandOfIkaros@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      I remember about 10 months ago or so ChatGPT used to output some surprisingly top-tier code. I’d ask it to create a method with some required functionality and it would output the code, fully commented and everything. I didn’t have to edit the code, it just worked, and it was more or less efficient.

      Now? I can’t even get it to write comments for code I give to it.

    • voxel@sopuli.xyz
      link
      fedilink
      arrow-up
      4
      ·
      1 year ago

      yeah the response quality is so much worse and it has that weird “take my answer and shut up” attitude now.

    • dan@upvote.au
      link
      fedilink
      arrow-up
      4
      arrow-down
      2
      ·
      1 year ago

      The free version or the paid version? Part of it is that they’re trying to push people towards the paid version, which is a much more sophisticated model.

      • garyyo@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        1 year ago

        Both, I was using gpt4 for some processing of text. The July 20th update came about and for the exact same input it could nolonger follow my directions, I had to tweak the prompt a bunch to handle a whole new set of edge cases.

  • Gompje@lemmy.world
    link
    fedilink
    arrow-up
    47
    arrow-down
    1
    ·
    1 year ago

    Haha indeed!

    It’s funny when it starts to just invent things. Like packages, with version number!, that… do not exists…

    Or when it outputs code without using the variables …

    The most annoying thing is imho that it keeps explaining everything al the time. Even when I prompt “you have a working app with vuejs…” and others it sometimes still explains how to setup the app.

    That said: the tool has become a staple in my workflow whenever I need a starting point. Or have to do some math algorithmic things

  • AdamEatsAss@lemmy.world
    link
    fedilink
    arrow-up
    16
    arrow-down
    1
    ·
    1 year ago

    I feel like for simple algorithms chatGPT could be good. Like as a reference for how to code something. But if it’s simple code I often find it faster to just write it myself then reorganize whatever it makes to work with and match the style of other code in my codebase. And if it’s complex code I often find it harder to describe what I want then to just make it.

    • flossdaily@lemmy.world
      link
      fedilink
      arrow-up
      29
      ·
      1 year ago

      In my experience, what makes gpt-4 great for coding is its astonishing knowledge of available software libraries, built-in interface features, etc.

      I’ll tell it the task I want done, and it will tell me where to find, and how to install the necessary dependencies.

      With zero experience in browser extension design, gpt-4 helped me to build an incredibly complicated Chrome extension, using vector database; creating a custom, cloud-based server; web scraping with headless browsers, voice recognition, speech synthesis, wake-word capabilities, and a sophisticated user interface. I had ZERO experience with ANY of these.

      For me, using gpt-4 was like collaborating with a just okay programmer, but one who had extensive experience with literally every programming language, API, protocol, etc.

      And it was a collaboration. We would talk through problems together. I would make observations and guesses about why a block of code wasn’t working, and it would tell me why I was wrong, or alternately tell me I was right, and produce a fixed version.

        • flossdaily@lemmy.world
          link
          fedilink
          arrow-up
          7
          ·
          edit-2
          1 year ago

          I’m not ready to talk about it in detail. Even my boss doesn’t know. But you’re in the right ballpark.

          I’m actually building a proof-of-concept prototype for what I want to work on… and I’m using a browser extension so that I can build it independently without anyone from the tech team being involved and slowing me down.

          • Pantoffel@feddit.de
            link
            fedilink
            arrow-up
            2
            ·
            1 year ago

            That sounds nice. I’ve been looking at serenade.ai and thought about extending their STT with an option to use another third-party STT engine. I would then like to extend their command engine with LLM command recognition. In my experience, maybe also with my pronunciation as a non-english speaker, their STT and command recognition really doesn’t work that well.

        • flossdaily@lemmy.world
          link
          fedilink
          arrow-up
          5
          arrow-down
          1
          ·
          1 year ago

          Yes it is the paid version, and you should not wait until your budget loosens up.

          This is an absolutely CRITICAL new technology. Think of it the way we think of the boomer generation when the computer revolution hit.

          Some of them got on board and learned to use this new tech, and some decided it was too hard and assumed they’d never really need it.

          I shit you not, learning how to really use gpt-4 has made me probably 100x more efficient at my job in all kinds of ways… most of them unexpected.

          Within a few years the workforce is going to be divided between people who are super workers using gpt-4, and people who aren’t.

          Someone out there is going to figure out how to use gpt-4 to take your job. So, if you’re smart, you still decide to be that someone.

          And you’re already 5 or 6 months late to the party.

  • kropeper@lemmy.ml
    link
    fedilink
    arrow-up
    8
    arrow-down
    1
    ·
    1 year ago

    If there are even any docs… I usechatgpt when i can find no usefull docs. Quite often it can find some information somewhere.

  • Patient_runner@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    1 year ago

    This is so apt ! though it does help to get difficult syntax for small fragments working quickly so you can get some proof for your concept instead of struggling with syntax errors for an hour

  • MajorHavoc@lemmy.world
    link
    fedilink
    arrow-up
    5
    ·
    1 year ago

    Programming with AI help is like having the expert chef at my shoulder, giving me tips, but he’s high as hell on three different mild altering drugs.

    Then he’s like “That cake needs some lemon juice. Trust me.”

  • flashgnash@lemm.ee
    link
    fedilink
    arrow-up
    7
    arrow-down
    2
    ·
    edit-2
    1 year ago

    Unless it’s Microsoft documentation in which case it feels more like bill gates beating me over the head with the frying pan until I give up and find an alternative way to achieve my goal

    • SpicaNucifera@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      Or AWS documentation. Trying to use it feels like getting tortured with thumbscrews.

      I hate it so much. It’s a cyclical maze of ignorance and frustration.

      Google, on the other hand, may have my hand in marriage.