The Johns Hopkins Center for Talented Youth is a nonprofit dedicated to identifying and developing the talents of academically advanced K-12 students around the world. We provide today's brightest students with fun, challenging courses; a community of engaged learners; and a strong foundation for future success in college and their careers.
Want to join our team? We are looking for mission-driven problem-solvers who can thrive in CTY's diverse, collaborative, fast-paced, and results-driven work environment. We value innovation, creativity, integrity, and a shared commitment to the bright young people we serve. In return, we offer employees the opportunity to be part of the Johns Hopkins community and to take advantage of our generous benefits package, which includes affordable health-care options and tuition assistance for employees and their families.
We are seeking a Director of Test Development & Assessment who will provide strategic development, direction and execution of a new Testing and Assessment department. This role will balance team management and cross-functional collaboration with the development of research studies and public-facing testing and assessment product resources. Candidates require a hands-on familiarity with formative, interim, and summative assessments; solid quantitative and analytical skills; a deep understanding of K-12 core curriculum; and exceptional skills and experience with psychometric analytic tools and methods.
The position is accountable for developing and managing a department of 3-5 personnel and for tests construction and development, item development and banking, field testing, test materials and administration, scoring, data and database management, technical reporting, developing protocols, procedures, and programs for CTY. Ensures a professional testing program delivering 50,000+ tests per year and to include all aspects of the testing life cycle are undertaken with quality. This position works closely with the Associate Dean of Research, JHU School of Education, Executive Director of CTY and the Sr. Director Finance and Business Affairs at CTY.
Specific Duties & Responsibilities:
CTY will need a 3-phase approach to the overall testing and assessment strategy: 1) revise and re-norm the current SCAT, 2) Modify SCAT to include age groups beginning with kindergarten 3.) Develop, implement, and revise the new AI-based assessment tool based on spatial skill and creativity tests delivered in variable modalities.
This position will be critical contributor to the success of the development and global delivery of our new assessment tools working with collaborators from the School of Education and Whiting School of Engineering.
Responsible for developing scaling and scoring methodologies and be responsible for methodology knowledge transfer to team members.
Responsible for developing an item bank of questions for continuous deployment, investment strategy for continuous additions and refinement overall management.
Ensure that diversity, equity, inclusion and anti-racism elements and strategies are built into assessment and develop metrics which will support program effectiveness.
Managing overall delivery of assessment starting with 50,000 testers annually, growing to 100,000 over the next 5 years. Annual expected revenue $6 million.
Develop a data and data management infrastructure, procedures, governance, protection, and release policies.
Work with the CTY research team to provide foundational research for assessment innovation.
Lead the Technical Advisory Committee, an external subject matter experts to review committee on protocols and findings. Meet 2-3 times a year.
Participate and assist with additional responsibilities and projects as directed.
Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.
Minimum Qualifications (Mandatory)
PhD required and 8 to 10 years of progressively responsible hands-on assessment development, leadership, and operational management experience.
Five to eight years' professional supervisory experience required.
Three to five years' experience working with a senior executive team recommending and implementing best/new practices and managing change.
Experience in an academic environment is a plus.
International experience a plus.
* Applicants who do not meet the posted requirements but are completing their final academic semester/quarter will be considered eligible for employment and may be asked to provide additional information confirming their academic completion date.
Special Knowledge, Skills & Abilities:
Expertise in psychometrics and standardized testing.
Proficiency using statistical software and online resources to research and analyze education data.
Excellent written, verbal and presentation skills.
Outstanding interpersonal skills.
Strong knowledge of formative, interim and summative assessment formats, and objectives.
Strong knowledge of national and international learning standards.
Ability to sit in a normal seated position for extended periods of time.
Dexterity of hands to operate a computer keyboard, mouse pad and other office machinery.
The incumbent will be required to communicate regularly via telephone and face to face with internal and external customers and must be able to exchange accurate and timely information in these settings.
Position also requires a degree of mobility common to working in an office environment; bending, kneeling, or standing during events and presentations may be required.
Supervise approximately 3-5 staff including a Psychometrician, Manager of Testing Services& Operations, Manager of Data & Systems, Lead Analyst, Tech Writer (Organizational Chart attached.)
The professional ability to act as a catalyst for change through positive energy.
Ability to effectively articulate goals and objectives and help others to clearly understand their value.
Proficiency in interaction with and influencing senior leaders in a highly matrixed organization.
Critical and strategic thinking, oral/written communication, organizational and talent development, relationship building and interpersonal skills.
Flexibility and ability to manage change in ways that result in productive performance.
Must be able to work effectively and independently in an environment with multiple priorities.
The ability to maintain confidentiality and work appropriately with highly sensitive information.
Applicants must be authorized to work in the US, and must either live in the US or another area in which JHU has a business entity.
All employees participating in or serving children in University programs must participate in mandatory Child Abuse Prevention online training on the appropriate conduct around children, protecting children from abuse and neglect, and reporting of known or suspected child abuse and neglect.
Classified Title: Director Test Development & Assessment Working Title: Director Test Development & Assessment Role/Level/Range: L/04/LF Starting Salary Range: Commensurate with Experience Employee group: Full Time Schedule: M-F/8:30-5pm Exempt Status: Exempt Location: Telework Department name: 10000116-Research Personnel area: Academic and Business Centers
The successful candidate(s) for this position will be subject to a pre-employment background check.
If you are interested in applying for employment with The Johns Hopkins University and require special assistance or accommodation during any part of the pre-employment process, please contact the HR Business Services Office at [email protected]. For TTY users, call via Maryland Relay or dial 711.
The following additional provisions may apply, depending on campus. Your recruiter will advise accordingly.
The pre-employment physical for positions in clinical areas, laboratories, working with research subjects, or involving community contact requires documentation of immune status against Rubella (German measles), Rubeola (Measles), Mumps, Varicella (chickenpox), Hepatitis B and documentation of having received the Tdap (Tetanus, diphtheria, pertussis) vaccination. This may include documentation of having two (2) MMR vaccines; two (2) Varicella vaccines; or antibody status to these diseases from laboratory testing. Blood tests for immunities to these diseases are ordinarily included in the pre-employment physical exam except for those employees who provide results of blood tests or immunization documentation from their own health care providers. Any vaccinations required for these diseases will be given at no cost in our Occupational Health office.
Equal Opportunity Employer Note: Job Postings are updated daily and remain online until filled.
Johns Hopkins University remains committed to its founding principle, that education for all students should be grounded in exploration and discovery. Hopkins students are challenged not just to learn but also to advance learning itself. Critical thinking, problem solving, creativity, and entrepreneurship are all encouraged and nourished in this unique educational environment. After more than 130 years, Johns Hopkins remains a world leader in both teaching and research. Faculty members and their research colleagues at the university's Applied Physics Laboratory have each year since 1979 won Johns Hopkins more federal research and development funding than any other university. The university has nine academic divisions and campuses throughout the Baltimore-Washington area. The Krieger School of Arts and Sciences, the Whiting School of Engineering, the School of Education and the Carey Business School are based at the Homewood campus in northern Baltimore. The schools of Medicine, Public Health, and Nursing share a campus in east Baltimore with The Johns Hopkins Hospital. The Peabody Institute, a leading professional school of music, is located on Mount Vernon Place in downtown Bal...timore. The Paul H. Nitze School of Advanced International Studies is located in Washington's Dupont Circle area.