So far I tested deepseek r1:7b and llama3.2 post on the fediverse and on detecting AI content (I have no shortage of AI content). Seems like llama3.2 takes preforms worse at detecting AI content compared to deepseek but works quicker. I’m not working with any graphics cards. Deepseek model be really good at generating replies with the right prompt, but it does take several minutes to run. No one has said anything about AI text I submitted other than reply I made to the wrong person and people are even sharing and liking the AI produced text

  • cronenthal@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    3
    ·
    6 hours ago

    Doing this research transparently is a good idea, it will only be a matter of time before other actors will try and use LLMs to influence lemmy. Like spam, bots and farms, this is a reality the fediverse will have to deal with eventually. Better start preparing now.

    • PixelPilgrim@lemmings.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 hour ago

      It’s interesting that the deepseek AI can blend in. It made a post like it really visited a waterfall. It didn’t say anything too specific as to make it obvious it wasn’t there(maybe that the weather was good in this time of year in March). So it will require looking at multiple posts or maybe even interacting to spot the bot.

      These boys can definitely blend in and then run script that can push an ideology. I won’t make more than 1 since I don’t have the resources

  • regrub@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    2
    ·
    9 hours ago

    How does generating engagement using AI do anything but add to the noise that actual people have to filter though?

    • hisao@ani.social
      link
      fedilink
      English
      arrow-up
      3
      ·
      8 hours ago

      With technology like this, it’s only a matter of time before big players start using it all over the internet, whether for commerce, propaganda, or pushing their agenda. So it’s interesting to observe an amateur trying it right now and sharing their findings. If anything, it might give us a glimpse of what the future holds.

    • PixelPilgrim@lemmings.worldOP
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      3
      ·
      9 hours ago

      I’ll give you some advice. It’s better to state why you don’t want me to test so at all. Asking questions just comes off as standoffish. Plus the way you phrases your question exposes that you have no intention of understanding me

      • lordnikon@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        9 hours ago

        I don’t want it as it makes posts feel hollow and evaporates any desire to engage. Since the Ai is not going to have a real option i value. So it just adds to noise and just looks like more sophisticated spam.

          • lordnikon@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            3 hours ago

            Yeah you are right, i blocked them . thanks I guess I lost my head there for a second.

        • PixelPilgrim@lemmings.worldOP
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          9 hours ago

          You can’t know any of that since you most likely haven’t interacted with the bot. Plus I don’t know “real option” is supposed to mean

  • hisao@ani.social
    link
    fedilink
    English
    arrow-up
    3
    ·
    9 hours ago

    Do you generate replies in a custom way every time, adjusting the prompt and supervising the result, or do you have fully-automatic system? If you do use any sort of manual intervention on per post basis, whatever you’re doing is not going to work as a bot.

    • PixelPilgrim@lemmings.worldOP
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      9 hours ago

      Rn I’m supervising the response and iterating the prompt. I haven’t even implemented a scraper or api. I haven’t fully botted it yet because I don’t know the architecture I want. Like do I even want ai detector or a script that puts in grammar mistakes or an basic algorithm to pick prompts