Pooja Nagpal
Sydney,NSW
Summary
Educational measurement specialist with 15+ years of experience in large-scale assessments, psychometric modeling, and test validity research. Former Associate Director at a leading education non-profit in India, leading national and state-level assessment initiatives in collaboration with central education bodies to ensure fair testing practices and drive policy impact. Currently pursuing a PhD at the Centre for Educational Measurement and Assessment (CEMA), University of Sydney, focusing on addressing systemic inequities through cultural and linguistic validity in assessments. Expertise in IRT, Rasch modeling, DIF analysis, response process validation, and large-scale test design. Proficient in data analytics and capacity building.
Overview
18
18
years of professional experience
Work History
Research Scholar
Center for Educational Measurement & Assessment, University of Sydney
07.2024 - Current
- Conducting research on cultural and linguistic validity in assessments, focusing on psychometric methods, including Rasch modeling
- Leveraging advanced statistical tools (R, RUMM) and mixed-methods research to ensure fairness in educational assessments for diverse student populations
- Supporting the Center on grants, assessment related projects and conferences
Associate Director- Evaluation & Assessments
Central Square Foundation
11.2019 - 05.2024
- Company Overview: a BMGF-funded non-profit focused on improving foundational literacy, numeracy, and large-scale assessments through government partnerships and policy-driven reforms in India.
- Strategic Leadership in Large-Scale Assessments: Collaborate closely with Central educational bodies, to provide both strategic and technical support for large student assessment initiatives at national and state levels in India. Key Projects include- National Achievement Survey 2021, National Foundational Learning Study 2022, Structured Assessment for Analysing Learning (2021-ongoing).
- Further, enhance the program's efficacy through robust partnerships with global agencies including the American Institute of Research and UNICEF
- State Program Design & Implementation: Lead the design and implementation of large-scale assessment programs for foundational literacy and numeracy, working with State Education Departments and their program partners
- Capacity Building: Provide comprehensive training programs to national and state education stakeholders for designing high-quality, robust assessment frameworks and tools, as well as guidelines for implementation and data utilization
- Data Analytics & Reporting: Provide technical support for descriptive and inferential analyses on data amassed from large-scale assessments, including foundational learning assessments
- Additionally, develop frameworks for effective data reporting and broad-based dissemination, ensuring stakeholders receive clear, actionable insights
- Psychometric-related Support: Applied methodologies such as Classical Test Theory (CTT) and Item Response Theory (IRT) to enhance the validity and reliability of assessments across projects
- Public Goods Development & Dissemination: Co-developed resources such as the EGRA/EGMA-based frameworks, widely adopted for foundational learning assessments
Associate Director- Assessment Design & Delivery
Gray Matter India (now ConveGenius Insights)
12.2018 - 11.2019
- Assessment Design Leadership: Strengthen large-scale assessments by managing the design of assessment framework and instruments for high-quality, reliable and valid assessments
- Technical and Strategic Guidance: Collaborate with government partners and education operators to enhance assessments within their impact and M&E programs
- Establish reliable and valid measurement systems to gauge intended outcomes
- Data Analytics Support: Offer technical assistance to the data analytics team, ensuring the creation of robust datasets for clients
- Translate assessment results to benefit both internal and external stakeholders
- Assessment Management System Implementation: Implement systems that maintain assessment content quality
- Streamline test development processes, reducing administrative overheads and increasing efficiency
Deputy General Manager- Product & Marketing
NIIT Limited
12.2016 - 11.2018
- Strategic Technical Support: Champion the development of online education assessment capabilities for the School Division
- Delve into research on learning sciences and measurement methodologies
- Portfolio & Financial Oversight: Take ownership of the P&L for the School assessment product portfolio
- Strategize based on in-depth customer feedback and core business requirements
- Product Development & Strategy: Led the product design and evolution of online student assessment tools utilizing agile methodologies
- Collaborate with internal and external stakeholders and develop a company-wide go-to-market strategy, partnering with various functions for execution
- Technical Team Collaboration: Assist the in-house technology team with online assessment products
- Define business requirements, plan product releases, and oversee rigorous product testing
Senior Manager-Centre of Excellence (Assessments)
Pearson Education India
02.2015 - 11.2016
- Product Design Leadership: Spearheaded the product design for Pearson India’s K-12 student assessment solutions, leveraging principled frameworks
- Continuously refine processes to amplify the accuracy of measurement outcomes and strengthen product efficacy
- Assessment Execution & Management: Develop assessment designs in collaboration with cross-functional teams and external vendors
- Led the comprehensive Assessment process, from curriculum mapping and item creation to final question paper development for both Pearson Schools and MyPedia Schools
- Technology Team Collaboration: Offer guidance to the technology team in constructing resilient platforms for item banking, question paper delivery, data analytics, and comprehensive reporting
Program Manager
Educomp Solutions Limited
10.2010 - 07.2012
- Product Development/Project Management: Managing the end-to-end product design and development for in-house psychometric assessment tools and career counseling modules grades 8-12
- Conceptualizing the design and implementation of an online assessment model with the aid of wireframing
- Evolving the assessment and career guidance processes to maximize consistency, measurability, and scalability of each metric/process
Consultant- Talent Assessment
Right Management Ltd-Manpower Group
01.2010 - 05.2010
- Content Design and Delivery and Project Management for the key assignments pertaining to the following areas- Talent Assessment/Development (Individual, Team and Organizational Assessment), Competency Modeling, Leadership Development
Assistant Consultant- Assessment Practice
MaFoi Randstad Limited
09.2007 - 01.2010
- Content Design and Delivery and Project Management for the key assignments pertaining to the following areas- Behavioral Profiling/Competency Mapping, Organization Diagnostics (360 Degree/Culture Surveys/ESS), Succession Planning/ Leadership Acceleration Programs, Assessment/Development Centers (Design and Execution), Career Management and Guidance
Associate Consultant
Hughes Communications India Ltd.
05.2007 - 09.2007
- Responsible for developing aptitude tests for pre-employment selection
- The assignment involved developing, customizing and standardizing a test battery of aptitude tests - measuring cognitive abilities including reasoning, numerical, verbal and spatial ability, to be used as a part of employee selection procedures
Education
Ph.D. - Education Assessment & Measurement
University of Sydney
Sydney, NSW12-2027
Education Research Methodology Online Certificate Program - Educational Measurement & Assessment
University of Illinois
Chicago01.2016
Masters of Arts - Industrial/Organizational Psychology
Delhi University
India01.2007
Bachelors of Arts (Honours) - Industrial/Organizational Psychology
Delhi University
India01.2005
Skills
- Educational Assessment and Measurement
- Rasch Measurement Theory
- Research and Impact Evaluation
- Proficient in R, RUMM20230
- Quantitative analysis
Tools and Software
Working Knowledge of R and RUMM for item functioning using Rasch and IRT for item calibration and vertical scaling.
Projects and workshops
- Indian Statistical Institute, Kolkata, India, Psychometrics & Statistical Analysis, Certification Workshop-Data Analysis for Psychometric Test Development
- Centre for Psychological Assessment and Management, Delhi, India, Psychometrics and Profiling, Took active participation in organizing workshops and seminars.
- Work Psychology and HR Forum-India, Psychometrics and HR Profiling, Took active participation in organizing workshops and seminars.
Publications
- Improving mathematics assessment readability: Do large language models help?, Patel, N., Nagpal, P., et al., Journal of Computer Assisted Learning, 39, 3, 2023, https://doi.org/10.1111/jcal.12776
- Handbook of Assessment and Evaluation: Best Practices in Item Design and Test Development, Nagpal, P., et al., CBSE, 2021, https://cbseacademic.nic.in/web_material/Manuals/Assessment-Evaluation_handbook.pdf
Languages
English
Native or Bilingual
Hindi
Native or Bilingual
Timeline
Research Scholar
Center for Educational Measurement & Assessment, University of Sydney
07.2024 - Current
Associate Director- Evaluation & Assessments
Central Square Foundation
11.2019 - 05.2024
Associate Director- Assessment Design & Delivery
Gray Matter India (now ConveGenius Insights)
12.2018 - 11.2019
Deputy General Manager- Product & Marketing
NIIT Limited
12.2016 - 11.2018
Senior Manager-Centre of Excellence (Assessments)
Pearson Education India
02.2015 - 11.2016
Program Manager
Educomp Solutions Limited
10.2010 - 07.2012
Consultant- Talent Assessment
Right Management Ltd-Manpower Group
01.2010 - 05.2010
Assistant Consultant- Assessment Practice
MaFoi Randstad Limited
09.2007 - 01.2010
Associate Consultant
Hughes Communications India Ltd.
05.2007 - 09.2007
Ph.D. - Education Assessment & Measurement
University of Sydney
Education Research Methodology Online Certificate Program - Educational Measurement & Assessment
University of Illinois
Masters of Arts - Industrial/Organizational Psychology
Delhi University
Bachelors of Arts (Honours) - Industrial/Organizational Psychology
Delhi University
Similar Profiles
Ramla EIERamla EIE
Customer Service Representative at Pearson Educational MeasurementCustomer Service Representative at Pearson Educational Measurement
Claudia McCoyClaudia McCoy
Assessment Scorer at Pearson Educational MeasurementAssessment Scorer at Pearson Educational Measurement
OMA GRACE AMADIOMA GRACE AMADI
Office Administrator & Proctoring Specialist at Pearson Educational MeasurementOffice Administrator & Proctoring Specialist at Pearson Educational Measurement