• jet@hackertalks.comEnglish
    83·
    5 months ago

    Honestly, I’m really impressed… Ddg works across VPN, and TOR. That includes these chatbots. That’s a great improvement for privacy

  • sabreW4K3@lazysoci.alEnglish
    30·
    5 months ago

    Is there a YouTube video under 10 minutes that compares the different AI models available from DuckDuckGo?

    • simple@lemm.eeEnglish
      21·
      5 months ago

      Dunno, but Llama 3 is the best open source model and Claude 3 is the best overall model they offer.

    • mynamesnotrick@lemmy.zipEnglish
      18·
      5 months ago

      I use mixtral8x7b locally and it’s been great. I am genuinely excited to see ddg offering it and the service in general. Now I can use this service when not on my network.

      • rutrum@lm.paradisus.dayEnglish
        5·
        5 months ago

        What GPU are you using to run it? And what UI are you using to interface with it? (I know of gpt4all and the generic sounding ui-text-generation program or something)

        • mynamesnotrick@lemmy.zipEnglish
          9·
          5 months ago

          I am using this: https://github.com/oobabooga/text-generation-webui … It is running great with my AMD 7900XT. It also ran great with my 5700xt. It sets up itself within a conda virtual environment so it takes all mess out of getting the packages to work correctly. It can use NVIDIA cards too.

          Once you get it installed you can then get your models from huggingface.co

          I’m on arch, btw. ;)

          Edit: I just went and reinstalled it and saw it supports these gpus

        • pflanzenregal@lemmy.worldEnglish
          5·
          5 months ago

          Open-webui is the best self hosted LLM chat interface IMO. It works seamlessly with Ollama, but also supports other openAI-API compatible APIs AFAIK.

          I’m using both in combination with each other and both downloading and using models is super easy. Also integrates well with VSCode extension “Continue”, an open source Copilot alternative (setup might require editing the extension’s config file).

    • Otter@lemmy.caOPEnglish
      11·
      5 months ago

      A lot of it might come down to individual tasks or personal preference.

      Personally I liked Claude better than GTP3.5 for general queries, and I have yet to explore the other two

  • Showroom7561@lemmy.caEnglish
    15·
    5 months ago

    It still amazes me just how quickly these models can spit out complex answers pretty much instantly.

      • Showroom7561@lemmy.caEnglish
        4·
        5 months ago

        LOL. Yeah, sometimes, answers can be very much “I’m winging it today”, but certain prompts, especially for story ideas, can be very interesting and usable.

        I’ve always said that if you know a lot about a subject, you can easily spot how AI generally tries to fake it until it makes it.

        But if you have no idea about something, the answers you get are certainly better than what your buddy might tell you 😂

        But to my point, it comes up with long form content so fast that you wonder how the hell it actually processed the question that quickly.

  • mynamesnotrick@lemmy.zipEnglish
    11·
    5 months ago

    Do we think they are going to charge for this once out of beta? Even though they have done great work on making it anonymous, I don’t see anything about them not using the input/output as data to “better” their service. So perhaps it would remain free?

  • smileyhead@discuss.tchncs.deEnglish
    7·
    5 months ago

    Who needs to spend 10s installing a dedicated AI chatbot assistant app, when every app you have can be an AI assistant app!