Get in Touch
 Duration 14 hours

Course Outline

Introduction to AI Red Teaming

  • Grasping the AI threat landscape
  • The role of red teams in AI security
  • Ethical and legal frameworks

Adversarial Machine Learning

  • Attack categories: evasion, poisoning, extraction, and inference
  • Generating adversarial examples using techniques like FGSM and PGD
  • Comparing targeted versus untargeted attacks and measuring success

Testing Model Robustness

  • Assessing robustness against various perturbations
  • Identifying model blind spots and failure patterns
  • Stress testing classification, vision, and NLP models

Red Teaming AI Pipelines

  • Mapping the attack surface across data, models, and deployment
  • Exploiting vulnerabilities in insecure model APIs and endpoints
  • Reverse engineering model behavior and outputs

Simulation and Tooling

  • Utilizing the Adversarial Robustness Toolbox (ART)
  • Conducting red teaming with tools such as TextAttack and IBM ART
  • Implementing sandboxing, monitoring, and observability solutions

AI Red Team Strategy and Defense Collaboration

  • Designing red team exercises and defining objectives
  • Effectively communicating findings to blue teams
  • Embedding red teaming into AI risk management processes

Summary and Next Steps

Requirements

  • A solid grasp of machine learning and deep learning architectures
  • Practical experience with Python and major ML frameworks such as TensorFlow and PyTorch
  • Familiarity with cybersecurity principles or offensive security methodologies

Target Audience

  • Security researchers
  • Offensive security teams
  • AI assurance and red team specialists

Number of participants


Price per participant

Testimonials (3)

Upcoming Courses

Related Categories