Psychometrician

CAL Classification: Research Associate
Division/Program: PreK-12 ELL Assessment
Hours Per Week: 35 hrs/wk (full time)
Position Available: Immediately

DESCRIPTION OF DUTIES:
Under the Director of Psychometrics and Quantitative Research, the Psychometrician is responsible for designing psychometric analyses of test performances; conducting psychometrics analyses related to test construction, validity, reliability, equating, and scoring; preparing technical reports; developing, maintaining, and applying quality control procedures; providing quantitative guidance to professional research staff at CAL; and coordinating external quantitative resources on behalf of the organization. The Psychometrician will also provide quantitative guidance to other researchers at CAL and coordinate external quantitative resources on behalf of the organization. 

PRIMARY RESPONSIBILITIES:

  • Plan, conduct, document and present psychometric and statistical analyses using classical test theory and the Rasch model with Winsteps and Facets software, including analyses related to item quality, rater performance, DIF, reliability and classification consistency, standard setting, equating, scoring, and reporting.
  • Investigate and evaluate new approaches to conducting psychometric analyses.
  • Establish and monitor quality control procedures related to quantitative analyses, from data cleaning to the final report, ensuring the reliability and integrity of results.
  • Provide guidance to professional researchers on proposal design and quantitative analytical approaches upon request, and participate in writing quantitatively-oriented portions of proposals as required.
  • Maintain contacts with individuals with specific quantitative expertise outside the organization who may be called on as needed for specific tasks.
  • Other duties as assigned.

MINIMUM QUALIFICATIONS:

  • Doctoral degree (PhD) in Educational Measurement, Psychometrics, or related field, and 2+ years of experience; ABD and 4+ years of experience; or Master’s degree (MA/MS) and 6+ years of experience.

DESIRED QUALIFICATIONS:

  • Experience with language assessment.
  • Experience in an operational testing program.
  • Experience with computerized adaptive assessments.
  • Experience creating replicable procedures for routine psychometric work.
  • Experience working as a member of a team in producing timely high quality deliverables for clients.
  • Ability to use technology to automate repetitive tasks and processes.
  • Ability to work with a diverse, multi-disciplinary professional team of researchers and scholars.
  • Ability to communicate both orally and in writing with a wide variety of audiences, including researchers, test developers, and educators.
  • Strong demonstrated experience in conducting statistical and psychometric analyses.
  • Strong demonstrated experience in applying the Rasch model to a variety of psychometric issues.
  • Demonstrated proficiency in using SPSS, Winsteps, Facets, R and other statistical and psychometric software.
  • Demonstrated knowledge and application of quality control procedures in creating and maintaining databases, conducting statistical and psychometric analyses, conducting other quantitative research, and producing technical reports.

IF INTERESTED, SEND RESUME AND COVER LETTER:

Mail:
Center for Applied Linguistics
4646 40th Street NW
Washington, D.C. 20016-1859
ATTN: Human Resources, Recruitment 17-07

Electronically:
jobs@cal.org
Attn: Recruitment 17-07


CAL offers a comfortable work environment with competitive compensation and an excellent benefits package. We are conveniently located two blocks from the Tenleytown/AU Metro Station on the Red Line.

The Center for Applied Linguistics is an equal opportunity employer and does not discriminate in hiring or employment based upon race, color, religion, national origin, sex, age, marital status, handicap, or any other reason not related to employment.

In accordance with USCIS regulations, all successful applicants will be required to show proof of their legal right to accept employment in the United States.