The other day, I was talking to someone who had apparently won a competitive CTF tournament at my college. With the arrival of AI in such tournaments, I asked him what he thought about its use in these environments, since CTFs had started to become less about putting technical knowledge to the test

Some people are dumb enough to confuse competency with merely following AI instructions, without thinking deeply about the problem.

For this reason, I wrote the article "Prompt Monkey: When AI creates the Illusion of Technical Skill "

And what do you think about it? Agree or disagree? Share your comments below.

(Alternative link: https://oupsz.github.io/prompt-monkey/ )

  • mr_blueBannedOP
    27·
    7 days ago

    Dude, you should read the first few paragraphs first because I contextualize what I meant by “Illusion of Technical Skill” I’m not referring to AI faking Technical Skill, but people not thinking by themselves and using AI to do so.

    Stating what is already in the article that if you read it, you will find:

    • “However, even if an LLM is not able to understand a situation as a human would, that doesn’t make it irrelevant to the discussion about technical competence. A system does not need consciousness to perform part of a cognitive task. If the AI identifies the vulnerability, chooses the tools, generates the commands, interprets the errors and decides the next step, then most of the problem-solving process came from the AI, not from the user. Therefore, the important question is not whether the AI is truly thinking. The important question is: How much thinking is still done by the person using it?””*