Job Purpose
The QA testing is the department responsible for the Quality Assurance and delivery of high-quality data and products.
We are seeking an experienced Director of QA for Mortgage Data and AI to lead our comprehensive quality assurance strategy for our mortgage data and artificial intelligence platforms. This is a strategic leadership role responsible for ensuring the highest standards of data integrity, system reliability, and AI model performance across our mortgage technology ecosystem. The ideal candidate will combine deep expertise in QA methodologies with knowledge of mortgage industry requirements, data validation, and AI/ML systems testing.
Responsibilities
- Lead and manage a team of QA engineers, test automation specialists, and data quality analysts across multiple mortgage data and AI initiatives
- Develop and implement comprehensive QA strategy and testing frameworks for mortgage data pipelines, ensuring 99.95%+ data accuracy and compliance
- Establish quality standards and best practices for AI/ML model validation, including performance testing, bias detection, and edge case analysis
- Oversee end-to-end testing of mortgage products including loan origination systems, pricing engines, risk assessment models, and data analytics platforms
- Partner with engineering, product, and business teams to define quality requirements, acceptance criteria, and success metrics for all mortgage data and AI initiatives
- Design and deploy automated testing solutions for data ingestion pipelines, ETL processes, and real-time mortgage data processing systems
- Establish data governance and quality assurance processes to ensure compliance with regulatory requirements (MISMO, FNMA, FHLMC, GNMA standards)
- Lead risk assessment and mitigation strategies for mortgage AI systems, including model drift detection, fairness auditing, and regulatory compliance validation
- Manage QA budget, resource allocation, and vendor relationships for testing tools and infrastructure
- Drive continuous improvement initiatives to reduce defect escape rate, improve test coverage, and accelerate time-to-market
- Establish metrics and KPIs for QA team performance and provide regular reporting to executive leadership
- Mentor and develop QA team members, fostering a culture of quality and continuous learning
Knowledge and Experience
- Bachelor’s degree in computer science, Software Engineering, Information Technology, or related field
- 12+ years of QA experience, with at least 5 years in a leadership/management role
- Proven experience managing QA teams and driving organizational quality standards
- Deep understanding of mortgage industry, loan processes, and mortgage technology ecosystem
- Strong background in data quality assurance, data validation, and ETL testing
- Experience with AI/ML systems testing, model validation, and performance evaluation
- Expertise in test automation frameworks, continuous integration/continuous deployment (CI/CD) pipelines
- Proficiency in programming languages (Java, Python, C#, JavaScript) for test automation
- Knowledge of API testing, database testing, and performance/load testing tools
- Understanding of regulatory compliance requirements in financial services (FNMA, FHLMC, SEC, CFPB regulations)
- Strong analytical and problem-solving skills with attention to detail
- Excellent communication and stakeholder management abilities
- Test Automation: Selenium, UFT/QTP, TestComplete, Cucumber, Robot Framework
- Programming Languages: Java, Python, C#, JavaScript, SQL
- Testing Tools: JIRA, TestRail, LoadRunner, JMeter, Postman, SoapUI
- CI/CD Tools: Jenkins, GitLab CI, Azure DevOps, GitHub Actions
- Databases: SQL Server, Oracle, PostgreSQL, MongoDB, data validation techniques
- API Testing: RESTful APIs, SOAP, GraphQL, OAuth/security testing
- Data Testing: ETL validation, data profiling, data quality tools
- Cloud Platforms: AWS, Azure, Google Cloud Platform
- AI/ML Testing: Model validation tools, performance metrics, bias detection frameworks
Preferred Knowledge and Experience
- MBA or advanced degree in related field
- ISTQB Certified Test Manager or equivalent QA certification
- Experience with mortgage-specific platforms and systems (pricing engines, AUS systems, LOS)
- Knowledge of machine learning algorithms and model evaluation techniques
- Experience with data warehousing and big data testing (Hadoop, Spark, Cloud platforms)
- Familiarity with Agile/Scrum methodologies and DevOps practices
- Experience with open-source testing frameworks (Selenium, TestNG, JUnit, pytest)
- Background in building quality assurance centers of excellence
- Experience with test data management and synthetic data generation
- Knowledge of financial regulations and compliance testing requirements
Core Competencies
- Strategic Leadership & Visioning
- Team Building and Talent Development
- Process Improvement and Continuous Optimization
- Risk Management and Compliance
- Stakeholder Management and Communication
- Technical Expertise and Problem-Solving
- Data-Driven Decision Making
- Agile & DevOps mindset
- Change Management
- Cross-functional Collaboration
Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics.