Test Response Data Collection Form Update
We have recently made several changes to the layout of the blue Test Response Data Collection Form that is included with every test order.
What’s changed?
To more efficiently collect data for test validation studies, we have updated our Test Response Data Form to not only collect score and demographic data, but also collect candidate identification data (e.g. candidate name, candidate ID number). (more…)
Are Tests Valid for Public Safety Jobs?
Number 4 in the Validity of Public Safety Assessments Series
The idea for this primer series germinated from a simple question – “Could you do an article looking at the validity of tests used in public safety assessment?” In response, I decided to do a series of articles aimed to inform, but also designed to keep things simple. The blogs in this series were intended to cover:
- What are the characteristics of a good test?
- What are some authoritative references human resource and assessment professionals can rely upon in evaluating the worthiness of tests?
- What is validity?
- Finally, trying to address the original question I was asked, are public safety assessments valid?
The first three blogs in the primer series have been published and are available by clicking the links above.
This is the fourth and final article in the series and is intended to answer the question regarding the validity of tests for public safety jobs. I define public safety jobs here as including police, fire, and emergency medical services (EMS). In addition, human resource professionals are usually interested in the use of tests in both entry level screening and for arriving at promotion decisions. (more…)
RFP for Entry-level Police Officer Selection Test Due Date Extended to September 15
The International Public Management Association for Human Resources (IPMA-HR) invites fixed-price proposals from qualified consulting firms to develop a multiple-choice entry-level police officer selection test for its stock testing service.
This includes the creation of an exam plan from the job analysis data collected by IPMA-HR, and the utilization of questions from IPMA-HR’s test item bank. The consulting firm chosen is expected to conduct a criterion-based validation study that includes having participating police departments administer the test to incumbents and gathering performance evaluation ratings to statistically show that the test predicts performance on the job. This also includes a test item analysis to select the final test questions, criterion validation statistics, and a fairness analysis.
The firm is expected to prepare validation study materials and assist in getting police departments to participate by making calls and sending correspondence. Further, the firm will prepare a technical report summarizing the steps taken during the test development and validation study project.
Proposals are due by September 15, 2017, 5:00 PM, ET.
Learn more about the full scope of the project and obtain contact information on our website. (more…)
New Assessment Products Catalog Available Now!
We’re pleased to announce the release of our new Assessment Products Catalog! Here you’ll find descriptions of all our testing products — including some new ones! Download your FREE copy or view the PDF online here.
What is Validity?
Number 3 in the Validity of Public Safety Assessments Series
The idea for this primer series germinated from a simple question – “Could you do an article looking at the validity of tests used in public safety assessment?” In response, I decided to do a series of articles aimed to inform, but also designed to keep things simple. The blogs in this series are intended to cover:
- What are the characteristics of a good test?
- What are some authoritative references human resource and assessment professionals can rely upon in evaluating the worthiness of tests?
- What is validity?
- Are public safety assessments good tests and are they valid?
The first two blogs in the primer series has been published and are available by clicking the links above.
This is the third in the series and is intended to provide a basic introduction into the various kinds of validity evidence. By validity evidence, I do not mean the obvious distinction between the big four of:
- Content
- Criterion-related
- Construct
- Transfer or Transportability
Understanding the distinctions between the four types of validity listed above is important. However, in this blog, I mean something different by types of validity evidence. As our ultimate purpose or goal is to respond to the question as to whether tests are valid for purposes of public sector assessment, we can consider the following five types of validity evidence as relevant:
- Local Validation Based on Criterion-Related Evidence
- Validity Generalization Evidence Based on Tests in General
- Validity Generalization Evidence Based on Specific Occupation
- Validity Generalization Evidence Based on Specific Test
- Other
Request for Proposals for the Creation of an Entry-level Police Officer Selection Test
The International Public Management Association for Human Resources (IPMA-HR) invites fixed-price proposals from qualified consulting firms to develop a multiple-choice entry-level police officer selection test for its stock testing service.
This includes the creation of an exam plan from the job analysis data collected by IPMA-HR, and the utilization of questions from IPMA-HR’s test item bank. The consulting firm chosen is expected to conduct a criterion-based validation study that includes having participating police departments administer the test to incumbents and gathering performance evaluation ratings to statistically show that the test predicts performance on the job. This also includes a test item analysis to select the final test questions, criterion validation statistics, and a fairness analysis.
The firm is expected to prepare validation study materials and assist in getting police departments to participate by making calls and sending correspondence. Further, the firm will prepare a technical report summarizing the steps taken during the test development and validation study project.
Proposals are due by July 31, 2017, 5:00 PM, ET.
Learn more about the full scope of the project and obtain contact information on our website. (more…)