Staff Quality Assurance Engineer Job at Pearson, Hoboken, NJ

  • Pearson
  • Hoboken, NJ

Job Description

We are seeking a Senior Expert, Quality Engineer (QE) with deep expertise in quality engineering for AI-powered systems. In this role, you will own and lead end-to-end quality for your project while playing a key role in testing and evaluating complex, non-deterministic AI systems. You will help shape the quality strategy for the project and raise the overall quality bar for the teams you work with.What You’ll DoCore Quality EngineeringDefine quality strategies and own test planning from requirements through release, partnering closely with cross-functional teamsDesign and execute scalable functional, regression, and integration testing strategiesApply hands-on automation framework expertise across UI, API, and backend layers to support major product initiativesAI & LLM System TestingTest AI-driven functionality, including LLM agents, multi-agent workflows, and RAG pipelinesValidate AI outputs for accuracy, relevance, consistency, and edge cases across non-deterministic systemsOwn evaluation frameworks (e.g., RAGAS), test datasets, and regression baselines for AI featuresStay current with the evolving landscape of LLM evaluation, agent testing, and AI observability, and translate emerging techniques into practical testing approachesTechnical Leadership & DeliveryLead QE team for your project by setting technical direction, defining quality strategy, and ensuring delivery confidenceContribute to QE standards and frameworks within your project scope, establishing practices that other engineers can adoptIntegrate automated tests into CI/CD pipelines and partner with engineering leads to embed quality into the delivery processLeverage data, risk signals, and production insights to continuously improve test coverage and effectivenessWhat You’ll Bring8+ years of experience in Quality Engineering or Quality AssuranceProven hands-on experience testing AI/LLM-based systems, including agents, multi-agent workflows, and RAG pipelinesExperience with AI evaluation approaches (e.g., RAGAS, LLM-as-judge, regression baselines) and non-deterministic testing strategiesStrong automation skills using Playwright or a comparable frameworkProficiency in JavaScript/TypeScript and/or JavaSolid experience with API testing and data validationDemonstrated track record of leading quality end-to-end for complex projects, from strategy through executionAbility to define and drive QE technical direction within a project or product areaExperience working in Agile delivery environments and contributing to fast-moving release cyclesNice to HaveHands-on experience with prompting, embeddings, or vector databasesCloud experience (AWS preferred)Exposure to AI-assisted development or testing tools (e.g., Cursor, Copilot)Experience with AI observability or monitoring tools for production LLM systemsThis is a hybrid role based in Hoboken, NJ. The ideal candidate should be able to work from the Hoboken office at least 2–3 days per week.Applications will be accepted through July 7. This window may be extended depending on business needs. Compensation at Pearson is influenced by a wide array of factors including but not limited to skill set, level of experience, and specific location. As required by the California, Colorado, Hawaii, Illinois, Maryland, Minnesota, New Jersey, New York State, New York City, Vermont, Washington State, and Washington DC laws, the pay range for this position is as follows: The full-time salary range for this position is between $130,000 - $150,000This position is eligible to participate in an annual incentive program, and information on benefits offered is here.Full timePosting Date: 2026-07-08

Job Tags

Full time, Work at office, 2 days per week, 3 days per week

Similar Jobs

Aogarciaagency

Remote Benefits Advisor (Part-Time) Job at Aogarciaagency

 ...financial services sector. Youll have the chance to earn an extra $1,000$2,000 each month while keeping your current position.Work from home, with the earning potential of a trillion-dollar industry, and enjoy a flexible schedule that fits your life. Through providing... 

Fisher Industries

Heavy Haul CDL Truck Driver Job at Fisher Industries

 ...Class A Heavy Haul Truck DriverFisher Industries is a vertically integrated family of businesses that provides heavy civil construction and...  ...values of a family-owned company.The Class A Heavy Haul Truck Driver will be responsible for transporting oversize and overweight... 

Accenture

Life Sciences MedTech R&D, Management Consulting Principal Director Job at Accenture

Accenture is a leading solutions and services company that helps the worlds leading enterprises reinvent by building their digital core and unleashing the power of AI to create value at speed across the enterprise, bringing together the talent of our approximately 786,... 

Alter Trading Corp

Manufacturing Supervisor / Non-Ferrous Job at Alter Trading Corp

 ...Materials shipped meet the exact requirements of the customers order and maintain traceability. Requirements ~3-5 years of supervisor experience. Previous experience in metals recycling operations or heavy manufacturing environment, preferred. ~ Must be familiar... 

NFP

Performance Analyst Job at NFP

 ...commitment to putting people first - our clients, our colleagues, and our communities.For more information, visit and The Performance Analyst is responsible for calculating and analyzing a diverse performance and analytical tools.Responsibilities: Calculate, verify,...