LLMs for CyberSecurity

LLMs for CyberSecurity References

1. Generative AI and Large Language Models for Cyber Security: All Insights You Need, May 2024
2. A Comprehensive Review of Large Language Models in Cyber Security, September 2024
3. Large Language Models in Cybersecurity: State-of-the-Art, January 2024
4. How Large Language Models Are Reshaping the Cybersecurity Landscape | Global AI Symposium talk, September 2024
5. Large Language Models for Cyber Security: A Systematic Literature Review, July 2024
6. Using AI for Offensive Security, June 2024

Agents for CyberSecurity References

1. Blueprint for AI Agents in Cybersecurity - Leveraging AI Agents to Evolve Cybersecurity Practices
2. Building AI Agents: Lessons Learned over the past Year

Comparing LLMs

There are several sites that allow comparisons of LLMs e.g.

1. https://artificialanalysis.ai/
   1. Independent analysis of AI models and API providers. Understand the AI landscape to choose the best model and provider for your use-case
2. https://llmpricecheck.com/
   1. Compare and calculate the latest prices for LLM (Large Language Models) APIs from leading providers such as OpenAI GPT-4, Anthropic Claude, Google Gemini, Mate Llama 3, and more. Use our streamlined LLM Price Check tool to start optimizing your AI budget efficiently today!
3. https://openrouter.ai/rankings?view=day
   1. Compare models used via OpenRouter
4. https://github.com/vectara/hallucination-leaderboard
   1. LLM Hallucination Rate leaderboard
5. https://lmarena.ai/?leaderboard
   1. Chatbot Arena is an open platform for crowdsourced AI benchmarking
6. https://aider.chat/docs/leaderboards/
7. Benchmark to evaluate an LLM’s ability to follow instructions and edit code successfully without human intervention
8. https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro
9. Benchmark to evaluate language understanding models across broader and more challenging tasks

See also Economics of LLMs: Evaluations vs Pricing - Looking at which model to use for which task