• Soyweiser@awful.systems
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 day ago

    You ask it for bugs, it’ll give you bugs!

    This is also going be the same issue which has iirc happened before. People who write automatic bug finding software (like ‘network intrusion detection’ software, which tended to create a lot of useless reports) are at this immature stage incentivized to create the max amount of potential bugs. As that is how people will evaluate the tools. One bots finds 400 bugs 80% cve of 9+ vs other tool that finds 40 none 9+. With nobody around to evaluate 440 bugs, the higher number is better.

    (Note im speculating here based on how it went in the past).

    • o7___o7@awful.systems
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 day ago

      Reminds me of twenty years ago when the old folks would download Super Malware Scanner from a banner ad and it would find 241 SEVERE viruses which it would “quarantine” if only you would buy a subscription.

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        3
        ·
        17 hours ago

        This is iirc even a problem now, a virus scanner that gives a ‘I found something’ and then ruins some small program without a virus in as a false positive is seen as more productive and effective than a virus scanner that finds no false positives. As for most people a virus/malware is quite rare.