10 · 1 expert
Human & AI Cognitive Synergy
Protecting people, businesses and digital infrastructure from the risks that arise when artificial intelligence is developed, deployed and used: AI agents, large language models, autonomous systems, corporate AI services and generative AI.
Key threats
- Leaks of confidential data through AI services
- Trade secrets handed to public models
- Prompt injection and manipulation of AI agents
- Unauthorised actions by autonomous AI agents
- Erroneous or fabricated model output
- Deepfakes, voice cloning and synthetic identities
- AI phishing and automated social engineering
- Poisoning or tampering with model data and knowledge
- Use of insecure third-party models and AI services
- Excessive permissions of AI agents
- Erroneous automated decisions
- Breaches of confidentiality and personal data protection
- Uncontrolled use of AI by employees (shadow AI)
- New AI attacks on information systems
- Reputational, legal and operational risks of using AI
Typical tasks
- Organisation-wide AI security audit
- Audit of employees' use of generative AI
- Audit of AI agents and their permissions
- Corporate policy for the safe use of AI
- Classification of data allowed and prohibited for AI systems
- Threat modelling of AI systems
- Vetting AI solutions before deployment
- Red teaming of AI models and AI agents
- Testing resilience to prompt injection
- Setting up human-in-the-loop for critical operations
- Managing AI agents' access to corporate systems
- AI incident response procedures
- Training executives and staff in the safe use of AI
- Assessment of AI solution vendors
- Expert assessment of emerging AI threats
Experts in this sector
Learning materials of the sector
The sector's experts have no materials in Learning yet.