• Rikudou_Sage@lemmings.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    I’d like that as well, but my problem with that is that it can rack up cost real quick because you’re billed per every token in the conversation, I once managed to incur cost of $5 in a single conversation of about 37 messages.

    I’m planning for the bot to have the ability to set a custom api key, meaning every user could potentially provide their own api key and pay for their own responses and in that case using the whole chain is possible, but as long as I’m paying for all the responses of everyone on Lemmy, that’s unlikely to happen.

    • varsock@programming.dev
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      i didnt know you paid for it 😯. thank you 🥹 if I was in the position to contribute I would. for now I’ll just refrain from using to to drive up your costs

      • Rikudou_Sage@lemmings.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        Feel free to use it, that’s why I made it! I have measures in place to make sure I don’t spend more than I’m willing to.