Secure AI-Assisted Software Engineering: A Technical Survey of Prompt Injection Defense, Tool-Use Security, and Agentic SDLC Hardening
Modern LLM coding assistants have evolved into tool-using agents that can read repositories, execute commands, modify infrastructure, and trigger external side effects, expanding the attack surface far beyond classic prompt misuse. This project will produce a deep technical survey that systematizes prompt-injection and related agentic risks across runtime execution and offline codebase design, with a focus on coding, CI/CD, MCP, RAG, and plugin ecosystems. The survey will pair threat taxonomy with defense taxonomy, clearly separating prevention, detection, containment, observability, and recovery controls, and distinguishing model-level mitigations from mandatory architectural controls. It will deliver practical secure workflows, configuration patterns, red-team suites, and a maturity model for teams moving from basic assistants to production-grade semi-autonomous engineering agents. The expected impact is a concrete, implementation-oriented reference that helps organizations deploy AI-assisted development safely without relying on prompt-only security assumptions.
Problem Workspace
Problem Statement
Scope: This work will produce a state-of-the-art technical survey and practitioner playbook on securing AI-assisted coding and automation systems against prompt injection and adjacent risks. It will cover direct and indirect prompt injection, tool-output injection, retrieval poisoning, memory/context contamination, jailbreak-driven tool misuse, and cross-tool/plugin attack chains in environments where LLMs interact with repositories, terminals, APIs, browsers, CI/CD pipelines, cloud systems, databases, email, MCP servers, and skills/plugins. The survey will explicitly analyze how risk changes across capability stages, from autocomplete assistants to production automation agents, and will map each stage to required controls and human-approval boundaries. Technical depth and constraints: The work will prioritize sources and practices from 2023–2026, emphasizing high-quality primary references (standards, vendor documentation, peer-reviewed papers, and reputable…Read more
Read less
Execution plan
(1) coverage score across required attack/defense/workflow sections, (2) actionability score based on whether controls are directly implementable in policy/CI/runtime, (3) traceability score mapping each attack class to prevention/detection/containment/recovery, (4) quality-of-evidence score for source rigor and recency, and (5) reproducibility score for red-team and regression procedures. Baselines: compare against existing high-level LLM security overviews and generic secure-SDLC checklists that do not model tool-using coding agents in depth. Data/splits: curate a source corpus partitioned into standards/guidance, academic literature, vendor docs, security research blogs, and tool documentation; maintain a held-out validation subset for completeness and consistency checks. Acceptance criteria: all required sections completed; every major attack class linked to concrete mitigations and residual risk; runtime and offline protections both fully specified; CI/CD design includes mandated security gates and human-review boundaries; and no unsupported claims without attributable sources.
Related work
- OWASP Top 10 for LLM ApplicationsLinkOWASP Top 10 for LLM Applications
- NIST AI Risk Management Framework (AI RMF)LinkNIST AI Risk Management Framework (AI RMF)
- MITRE ATLASLinkMITRE ATLAS
- OpenAI documentation on tool calling and structured outputsLinkOpenAI documentation on tool calling and structured outputs
- Model Context Protocol (MCP) specification and security guidanceLinkModel Context Protocol (MCP) specification and security guidance