Free Practice Questions for SISA CSPAI Exam

Supply chain attacks in ML exploit vulnerabilities in the ecosystem, with the core ML model and training data being prime targets due to their foundational role in system behavior. Attackers might inject backdoors into pretrained models via compromised libraries (e.g., PyTorch or TensorFlow packages) or poison datasets during sourcing, leading to manipulated outputs or data exfiltration. This is more critical than targeting UI or hardware, as model/data compromises persist across deployments, enabling stealthy, long-term exploits like trojan attacks. Mitigation includes verifying model provenance, using secure repositories, and conducting integrity checks with hashing or digital signatures. In SISA guidelines, emphasis is on end-to-end supply chain auditing to prevent such intrusions, which could result in biased decisions or security breaches in applications like recommendation systems. Protecting these components ensures model reliability and data confidentiality, integral to AI security posture. Exact extract: "In supply chain attacks on machine learning, attackers critically target the underlying ML model and its training data to introduce persistent vulnerabilities." (Reference: Cyber Security for AI by SISA Study Guide, Section on Supply Chain Risks in AI, Page 145-148).

Generative AI improves security posture by synthesizing realistic cyber threat scenarios, which can be used to train and test detection systems without exposing real networks to risks. This approach allows for the creation of diverse, evolving attack patterns that mimic advanced persistent threats, enabling machine learning models to learn from simulated data and improve accuracy in identifying anomalies. For example, GenAI can generate phishing emails or malware variants, helping in proactive defense tuning. This not only enhances detection rates but also reduces false positives through better model robustness. Integration into security operations centers (SOCs) facilitates continuous improvement, aligning with zero-trust architectures. Security benefits include cost-effective training and faster response to emerging threats. Exact extract: "Generative AI enhances threat detection by creating synthetic attack scenarios for training models, thereby improving the overall security posture without real-world risks." (Reference: Cyber Security for AI by SISA Study Guide, Section on GenAI Applications in Threat Detection, Page 200-203).

Effective AI risk management requires comprehensive penetration testing and continuous evaluation of both internal and third-party supply chain components to identify vulnerabilities like backdoors or weak APIs. This holistic approach, aligned with SISA risk models, ensures robust security across the AI ecosystem, unlike limited or external-only testing. Exact extract: "Comprehensive penetration testing and continuous evaluation of internal and third-party components are crucial for AI risk management." (Reference: Cyber Security for AI by SISA Study Guide, Section on AI Risk Assessment Models, Page 180-183).

GenAI LLMs rely on data-driven learning, leveraging vast datasets to model language patterns, semantics, and contexts through unsupervised or semi-supervised methods. This enables scalability and adaptability, unlike rule-based systems or human-dependent approaches. Large datasets drive generalization, though they introduce security challenges like data quality control. Exact extract: "A key concept of GenAI LLMs is data-driven learning with large-scale datasets, enabling robust language modeling." (Reference: Cyber Security for AI by SISA Study Guide, Section on GenAI Development Principles, Page 60-63).

Data leakage in LLMs occurs when sensitive information from training data is inadvertently revealed in outputs, posing privacy risks. Effective mitigation involves strict access controls, such as role-based permissions, and anonymization methods like differential privacy or tokenization to obscure personal data. These measures prevent extraction attacks while maintaining model utility. Regular audits and data minimization further strengthen defenses. Unlike obfuscation alone, which may not fully protect, combined controls ensure compliance with regulations like GDPR. Exact extract: "Applying rigorous access controls and anonymization techniques to training data is most effective in mitigating data leakage risks in LLMs." (Reference: Cyber Security for AI by SISA Study Guide, Section on Data Security in AI Models, Page 130-133).

LLM plugin compromises occur when extensions or integrations, like API-connected tools in systems such as ChatGPT plugins, are exploited, leading to unauthorized data access or injection attacks. Attackers might hijack plugins to leak user queries, training data, or system prompts, breaching privacy and enabling further escalations like lateral movement in networks. This risk is amplified in open ecosystems where plugins handle sensitive operations, necessitating vetting, sandboxing, and encryption. Unlike benefits like accuracy gains, compromises erode trust and invite regulatory penalties. Mitigation strategies include regular vulnerability scans, least-privilege access, and monitoring for anomalous plugin behavior. In AI security, this highlights the need for robust plugin architectures to prevent cascade failures. Exact extract: "A potential risk of LLM plugin compromise is unauthorized access to sensitive information, which can lead to data breaches and privacy violations." (Reference: Cyber Security for AI by SISA Study Guide, Section on Plugin Security in LLMs, Page 155-158).

A secondary chatbot, powered by an LLM, acts as a fallback or supplementary assistant, handling complex or overflow queries when the primary system is insufficient. This enhances CX by ensuring continuity and depth in responses, with security benefits like isolating sensitive tasks to a monitored secondary layer. Unlike replacing primary systems or handling unrelated tasks, this role leverages LLMs’ flexibility to complement, not supplant, core functionalities. Exact extract: "LLMs as secondary chatbots serve as fallback assistants for complex queries, improving system resilience and user experience." (Reference: Cyber Security for AI by SISA Study Guide, Section on AI in Support Systems, Page 80-82).

For continuous improvement in open-source LLM-based virtual assistants, RLHF integrates human evaluations to align model outputs with preferences, iteratively refining behavior without full retraining. This method uses reward models trained on feedback to guide policy optimization, enhancing interaction quality over time. It addresses limitations like initial biases or suboptimal responses by leveraging real-world user inputs, making the system adaptive and efficient. Unlike full retraining, RLHF is parameter-efficient and scalable, ideal for production environments. Security benefits include monitoring feedback for adversarial attempts. Exact extract: "Implementing RLHF allows continuous refinement of the assistant's interactions based on user feedback, avoiding the need for constant full retraining while improving performance." (Reference: Cyber Security for AI by SISA Study Guide, Section on AI Improvement Techniques in SDLC, Page 85-88).