PPhying中文
Curated security research, vulnerabilities, advisories and tools for practitioners.

Ready to Hack an LLM? Our Top CTF Recommendations

bishopfox.com | blog | #ai-security | #ctf | #prompt-injection | #jailbreak | #llm-security | #training | #ai-red-teaming
📄 Raw .md⬇️ Download .md🔗 Original ↗

Summary

Curated LLM security CTFs and playgrounds: Bishop Fox's Local LLM CTF, OWASP FinBot, Steve's Chat Playground, PortSwigger's Web LLM Attacks, and Wild LLaMa cover prompt injection and jailbreaks.
Published
Collected

Related coverage

tool · github.com
LLM SecRange: Open-Source Penetration Testing Playground for Large Language Models & Vulnerable Agents
Offers security researchers and penetration testers an out-of-the-box, comprehensive environment to practice prompt injection, OWASP LLM Top 10 risks, and agent tool-abuse exploitation against real models.
blog · hackerone.com
Inside the AI Red Teaming CTF: What 200+ Players Taught Us About Breaking and Defending LLMs
In a 10-day AI red teaming CTF with 217 active players, output manipulation succeeded ~82.5% and data extraction ~74.6%; layered defenses cut completion to ~34% on the hardest multi-step challenge.
blog · hackerone.com
AI Security 101: What is AI Red Teaming?
AI red teaming stress-tests AI systems against adversarial attacks, targeting jailbreaks, prompt injection and over-permissioned agents so flaws are fixed before attackers can exploit them.
blog · hackerone.com
LLMs adversarial testing with HackerOne: Join the CTF!
HackerOne and Hack The Box launch a 10-day AI red teaming CTF built from real engagement scenarios: indirect prompt injection, safety filter bypasses, and privilege escalation via language alone.
blog · hackerone.com
How Anthropic’s Jailbreak Challenge Put AI Safety Defenses to the Test
Anthropic and HackerOne ran an AI red teaming challenge on a demo Claude 3.5 Sonnet to validate Constitutional Classifiers that block CBRN-related jailbreaks, awarding $55,000 to four teams.
blog · blog.sentry.security
ChatML Role Injection (CRI)
Attackers can inject system roles into ChatML message arrays to override developer instructions, invoke hidden tools, and pad payloads for denial-of-wallet DoS; strict schema validation is key.
Back