Psychometrics Manager

Location
Portland, OR, US
Salary
Competitive
Posted
Mar 06, 2019
Ref
275
Description

Psychometric s Manager

About this role....

In the Psychometrics Manager position, you will be responsible for managing a team of research scientists and statistical analysts. You must have experience in knowing when (a) to provide guidance to project teams in completing their work and acquiring skills, with special attention to working with and mentoring junior staff and (b) allowing senior staff to work independently and lead work.

This position requires proactive problem-solving skills, ability to escalate issues appropriately, an ability to dig in and get work done, in-depth knowledge of classical and item response testing theory, argument-based claims for test scores, operational leadership experience with a variety of assessment types and proposal development, strong internal cross-functional communication and external customer communication, mentorship and presentation skills, and an understanding of the intersection of educational policy and psychometrics.

About the Psychometric Solutions team ....

The team provides psychometric services for NWEA's products and state contracts. These services include providing input on test development; conducting weekly item review for MAP Growth ; completing linking studies to connect MAP Growth scores to state summative assessments; planning and leading standard settings to establish cut scores; conducting data analyses to ensure an assessment's validity, reliability, and fairness; and developing technical documentation of designs and processes for existing and new summative state assessments.

Must haves...

  • Managing a team of scientists and statistical analysts who work on complex projects in a fast-paced environment
  • Experience independently leading large-scale psychometric production activities including, but not limited to, sampling design, DIF analysis, item calibration, linking, scaling, and equating with 1PL, 2PL, 3PL and partial credit models, and standard setting analyses
  • Expanding documentation of operational best practices and uniform evaluation guidelines across projects
  • Ensuring quality control processes of deliverables.
  • Independently providing consulting support to both internal and external clients.
  • Presenting technical issues clearly to other divisions of the organization, clients, technical advisory committees, professional associations, and other agencies as necessary
  • Engaging in a program of research, publication, and presentations at professional conferences on measurement issues that contribute to the field
  • Demonstrated experience of clear written communication with ability to adapt technical writing to the audience needs for RFPs, technical reports, research briefs, and standard operating procedures
  • Performing other duties as assigned to ensure the success of the team and the entire organization, with particular attention to leading cross functional discussions across the company
  • Responding to RFPs
  • Supporting staff in preparing for presentations
  • Travel required, approximately 25%
Traits for success...

  • Strong knowledge in psychometric techniques-including classical test theory, item response theory, test equating, scaling, and linking.
  • Ability to conduct independent research with a demonstrated specialization in an area such as principled assessment design, automated scoring, CAT, learning progressions, standard setting, or integration of data analytics with psychometrics
  • Experience and use of computer software packages commonly used in psychometric work and research (e.g., SAS, R, Python, WINSTEPS, BILOG, MULTILOG, PARSCALE).
  • Ability to work with cross-functional teams using AGILE assist in documenting and clarifying psychometric requirements
  • Demonstrated ability to navigate and problem solve quickly and efficiently in a highly collaborative environment
  • Ability to explain complex measurement and statistical concepts to a variety of audiences.
  • Ability to work collaboratively and provide innovative solutions.
  • Excellent interpersonal skills as evidenced with a successful partnering and consulting with clients
  • Experience conducting standard setting a plus
  • Excellent written and verbal communication skills
  • Must be able to perform the physical and intellectual requirements of the role, with or without accommodation

Competencies
  • Customer Focus
  • Directs Work
  • Ensures Accountability
  • Drives Results
  • Builds Effective Teams
  • Develops Talent
  • Communicates Effectively
  • Instills Trust

Education and experience...

  • A Ph.D. in Educational Measurement, Psychometrics, Psychological Measurement, or in related field
  • A progressive record of leading increasingly complex projects in large-scale assessment over a sustained time period that would typically be obtained at minimum over five to seven years
  • Relevant experience includes developing practical solutions to applied educational assessment problems and working as lead psychometrician on large-scale educational testing projects.
  • Demonstrated professional achievement through presentations at professional conferences and publications in professional journals or equivalent.
  • Client facing experience required
  • Experience in responding to RFPs
  • Excellent written, verbal, and presentation skills.
  • Strong interpersonal skills including working effectively in teams


About us....

NWEA® is a research-based, not-for-profit organization that supports students and educators worldwide by creating assessment solutions that precisely measure growth and proficiency-and provide insights to help tailor instruction. For 40 years, NWEA has developed innovative pre-K-12 assessments, including our flagship interim assessment, MAP® Growth™; our progress monitoring and skills mastery tool, MAP® Skills™; and our reading fluency and comprehension assessment, MAP® Reading Fluency™. Educators trust our professional learning offerings to accelerate student learning and our research to support assessment validity and data interpretation. Our tools are trusted by educators in more than 9,500 schools, districts, and education agencies in 145 countries.

What we can offer you....

At NWEA w e not only offer a competitive base salary , we offer a 15% contribution of eligible employees' base salary to a defined contribution 403(b) retirement savings plan; c areer development opportunities; an awesome work culture and environment; we also offer industry leading benefits and perks that are focused on supporting our employees' holistic wellbeing. To learn more about what we can offer more, click here.

NWEA endeavors to make www.nwea.org accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please call us at (503) 624-1951 or e-mail us at onlineaccommodations@nwea.org and let us know the nature of your request, your location and your contact information. This is for accommodation requests only and cannot be used to inquire about the status of applications.

NWEA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please visit our website. If you'd like more information on your EEO rights under the law, please visit the EEOC website

Similar jobs

Similar jobs