Position: Artificial Intelligence Governance, Assurance and TEVV Specialist

Security clearance: NV1

Job details

The AI TEVV Specialist will provide specialist technical leadership to establish and mature Army's AI TEVV capability. The role will support the development of AI assurance frameworks, testing methodologies, governance processes and evaluation activities to ensure AI-enabled systems are secure, reliable, trustworthy, operationally effective and compliant with Defence policy, regulatory and assurance requirements. The position will also review AI-related policies, submissions and proposals, and provide governance and assurance advice to support Army decision-making, capability development and the implementation of AI-enabled capabilities.

Deliverables

The specified person will support Army's AI Governance and Assurance function through the development of governance and assurance artefacts, interpretation of policy and governance requirements, provision of advice to decision-makers, and engagement with internal and external stakeholders. The role will also contribute to Army's growing AI assurance and TEVV capability through technical assessment activities, analysis of AI-enabled systems, interpretation of technical evidence, and oversight of third-party evaluation activities.

The contractor is expected to:

• Develop, maintain and review Army AI governance and assurance artefacts, including AI Use Cases, System Cards, Model Cards and related documentation.
• Review AI-related policies, submissions, technical papers and proposals, and provide advice on their implications for Army.
• Support the implementation and continuous improvement of Army's AI governance and assurance arrangements.
• Analyse complex technical, operational and policy issues and provide evidence-based advice to Army decision-makers.
• Engage with stakeholders across Defence, industry, academia and other government organisations to support AI governance, assurance and capability activities.
• Build and maintain productive stakeholder relationships and coordinate stakeholder contributions to AI-related initiatives.
• Support Army's AI assurance and Test, Evaluation, Verification and Validation (TEVV) activities, including assessment of AI-enabled systems, technical evidence, performance claims, limitations and risks.
• Contribute to the planning, coordination and oversight of evaluation activities undertaken by Defence, industry, DSTG and other organisations.
• Assist Army in acting as an informed customer and assurance authority for AI-related activities conducted by third parties.
• Translate technical findings into clear, concise and actionable advice, reports and decision-support products for senior stakeholders.
• Identify risks, issues and opportunities associated with AI-enabled capabilities and recommend appropriate mitigation or management strategies.
• Capture and transfer corporate knowledge, stakeholder relationships and lessons learned to support workforce continuity and capability development.

Mandatory Qualifications and Experience

Candidates should demonstrate one or more of the following:

• Relevant tertiary qualification in Engineering, Computer Science, Artificial Intelligence, Data Science, Machine learning, Operational Analysis, Systems Engineering, Software Engineering, Mathematics, Physics, Statistics, or another relevant STEM discipline, or equivalent demonstrated professional experience.
• Minimum five years' experience developing, implementing, managing, assuring, testing, evaluating, or governing AI, machine learning, data-driven, or other advanced technology solutions.
• Demonstrated experience applying engineering, systems engineering, risk, assurance, operational analysis, experimentation, test and evaluation, or similar methodologies to complex real-world problems.
• Demonstrated ability to review technical information, assess evidence, and provide recommendations to support informed decision-making.
• Experience preparing reports, briefs, submissions, or advice for senior stakeholders and decision-makers.
• Demonstrated ability to translate business, operational, and capability requirements into practical technology-enabled outcomes.
• Experience engaging and collaborating with diverse stakeholder groups across technical, operational, and governance functions.
• Demonstrated experience applying AI governance, assurance, risk management, ethics, privacy, security or related frameworks to support technology-enabled capabilities.
• Australian citizenship and the ability to obtain and maintain an appropriate Defence security clearance.
• Demonstrated understanding of AI and machine learning systems, including an ability to assess technical documentation, performance claims, evidence and risks.
• Demonstrated experience developing, reviewing or applying governance frameworks, policies, assurance frameworks, standards or risk-management approaches in a technology, engineering, capability, regulatory or operational context.
• Demonstrated ability to interpret policy, governance and regulatory requirements and translate them into practical implementation approaches and decision-support advice.
• Demonstrated experience planning, conducting, supporting, assessing or overseeing assurance, verification, validation, test and evaluation, systems engineering, experimentation or operational analysis activities.
• Demonstrated ability to critically assess technical evidence, assumptions, claims and recommendations, and provide balanced, risk-informed advice to senior decision-makers.
• Demonstrated experience working at the intersection of technical, governance, operational or policy functions.

Highly Desirable Qualifications and Experience

Candidates should demonstrate one or more of the following:

• Postgraduate qualification in Artificial Intelligence, Machine Learning, Data Science, Systems Engineering, Test and Evaluation, Operational Analysis, or a related discipline.
• Experience delivering AI, machine learning, data science, advanced analytics, or technology-enabled solutions within Defence, Defence Industry, DSTG, National Security, Commonwealth Government, or other complex organisations.
• Experience with Generative AI technologies, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), prompt engineering, autonomy, computer vision, machine learning systems, or advanced analytics capabilities.
• Experience supporting verification, validation, assurance, certification, accreditation, test and evaluation, or capability assurance activities.
• Experience developing or implementing AI governance, responsible AI, assurance, risk management, compliance, privacy, security, or ethical AI frameworks.
• Experience using cloud-based AI and machine learning platforms, including Microsoft Azure AI, AWS AI/ML, Google Cloud AI, or equivalent technologies.
• Demonstrated project management, technical leadership, or delivery experience for AI, digital, data, or emerging technology initiatives.
• Experience assessing contractor, vendor, or supplier technical performance, capability claims, and solution effectiveness.
• Experience acting as a customer representative, technical authority, assurance authority, evaluator, or Independent Verification and Validation (IV&V) function.
• Relevant industry certifications in AI, machine learning, cloud AI services, systems engineering, or related disciplines (e.g. Microsoft Azure AI Engineer Associate, AWS Machine Learning Specialty).
• Experience with AI and machine learning frameworks, such as TensorFlow, PyTorch, or Scikit-learn, and proficiency in Python or similar programming languages.
• Experience developing, maintaining or applying assurance artefacts such as Model Cards, System Cards, Use Case documentation, Assurance Cases or equivalent governance and assurance products.