About Andrey Pankov

This author has not yet filled in any details.
So far Andrey Pankov has created 18 blog entries.

We need YOUR help – New ECC test enters validation phase

YOU ARE KEY – We can’t do it without you…

If you had not yet heard we are hard at work on bringing you 3 new entry-level Emergency Communication Center (ECC) tests. As you know all of our tests go through a thorough validation phase that gets documented in the free Technical Report available with every test. Now your agency can be a part of the process, have a test with direct evidence for use within your organization, and enjoy a deep discount on your next test order (plus other benefits).

All the detailed information can be found on our ECC Validation page. But to summarize, we’d need your to get together a group of your incumbent ECC staff to take the test, then have their first and second line supervisors fill out a brief evaluation for each incumbent taking the test. If you can’t commit to a large group, that’s OK, even 5-6 staff can make a huge difference if multiple agencies get on board.

If you’d like more information or want to participate, fill out the form below:

[contact-form-7 404 "Not Found"]
By |2015-01-21T12:34:45-04:00January 21st, 2015|Announcements|Comments Off on We need YOUR help – New ECC test enters validation phase

Introducing OTAS – Your new online test implementation solution!

Online Test Administration Service

IPMA-HR’s Assessment Services Department would like to announce a new method of test implementation, the Online Test Administration Service, or OTAS for short!

It has taken many years to find the right partner to allow us to take our tests to the online space and a few more after that to test out and tinker with it, in order to get it just right.

So it brings us great pleasure that starting today, you can administer the following tests via OTAS:

Police Supervisor (PSUP) Series

Our goal is to get most of our test catalog up and ready for OTAS implementation by the end of 2014.

To get started, you can visit the OTAS landing page, read through the FAQs, or take a sample test, from the candidate perspective.

We want you to keep in mind that the OTAS system will change and improve with your use and feedback. This will be an evolving product, so get excited for the future.

Stay tuned to the ASR for followup posts detailing additional features and details about this new system. We are very excited to finally be able to share it with you.

By |2014-04-07T15:50:49-04:00April 2nd, 2014|Announcements|Comments Off on Introducing OTAS – Your new online test implementation solution!

New Test Development Project: Customer Service Representative

Customer ServiceIPMA-HR is currently in the process of creating a computer-based selection test for customer service positions throughout government agencies.  This would include any position that has front line interaction with the public (e.g., customer service representative, front desk positions, clerks, 311 center representative, etc.).

We anticipate that the computer-based test will be a job simulation that will include audio/video recordings of customer contacts with candidates indicating how they would handle the issues presented, using reference materials that would typically be available to them. The format of the test would be multiple-choice as well as data-entry.

This is where we need your help.  In order to create a useful test we need agencies to participate in the test development process.  (more…)

By |2013-04-08T11:57:42-04:00April 8th, 2013|Announcements|Comments Off on New Test Development Project: Customer Service Representative

Update to Promotional Test Reading List – February 2013

The reading lists for the PSUP Series, PDET Series, and PL 301 test has been updated to reflect the release of a new edition of one of the books that appear on the list.

The updated reading list table is below:

TYPE TEST NAME LAST UPDATED
Police PSUP 301/302/303 Feb 2013
PL 301 Feb 2013
PDET 201 Feb 2013
Fire FCO 101-EM/102-EM June 2012
FCO 103/104 Mar 2011
Corrections CF-FLS 102 Sept 2012
ECC ECC-FLS 102 Oct 2010

Request a reading list.

By |2013-02-08T16:24:28-04:00February 11th, 2013|Housekeeping|Comments Off on Update to Promotional Test Reading List – February 2013

2012 Needs Assessment Results

As many of you know we conducted our annual Needs Assessment from July 19th to August 3rd. I would like to personally thank over 400 of you that responded. This is the second year in a row that such a large percentage of our customer base has participated and we appreciate your feedback.

This year’s needs assessment focused on some of the new products that are currently under development as well as some new resources we have in the pipeline.  We also asked specifically about this ASR blog and what topics you want to see covered in the future. We were excited to see many responses and will be using one particular recommendation for an article series, running a successful recruitment process, in the next few months. (more…)

By |2012-12-10T13:03:31-04:00August 28th, 2012|Announcements|Comments Off on 2012 Needs Assessment Results

Test Security and Cheating: Part 3

Test security agreements are the first line of defense protecting our tests, our customers and our candidates from test security breaches.

As a signer, the individual agrees on behalf of their agency they will conduct due diligence to protect the content found on all test materials. For example:

Beware of storing test materials in a locked car. We dealt with a situation where a vehicle was stolen with our tests inside. While the individuals responsible may not have been interested in the test materials, it would be very difficult for your department to administer a test without them.

  • Signers will not share test materials with anyone in the agency who is not a signer (barring an exception discussed below).
  • When not in direct possession of the tests, signers must ensure all physical testing materials are stored under lock and key in a location only the signer can access (e.g. in a locked closet that only a signer can access, a locked file drawer or a signer’s office, which remains locked anytime the signer is not present).
  • Electronic files related to our tests should be stored on computers protected with a login and password. If files are stored on a shared network drive, they should be in a protected folder that can only be accessed by the test security agreement signer.

As Robert Burd mentioned in his previous article, cheating is not only a problem from candidates outside the agency, but also from inside personnel trying to help their friends or colleagues. That is why it is paramount to follow and abide by the guidelines outlined in our security agreements.

The most important thing to remember is that non-signers should never be allowed to handle or see IPMA-HR test products.

In addition to following the terms of our security agreements, every department should have a policy outlining what steps to take when dealing with a cheating situation. Without a policy in place, it may prove difficult to act upon an incident of cheating.

The lack of a clear security policy caused confusion during one test administration where a proctor noticed a candidate copying answers from another candidate’s answer sheet. The proctor did nothing to stop the situation because they were not sure of the department’s policy for dealing with a situation like this. The proctor ultimately submitted a written report of the incident after the administration was complete, but this report was deemed inconclusive and no further action was taken.

Your policy should take into consideration the course of action your agency will take in both an entry-level situation, where candidates will primarily be new potential hires, as well as during a promotional test, where a significant number of candidates will likely be staff currently employed by your department.

You should also familiarize yourself with our item review and challenge procedures. Details are freely available to TSA signers in our publication Considerations in Handling Item Challenges, which reviews the precise steps your agency must take if a candidate requests to review or challenge promotional test questions. These procedures are extremely important to the security of our tests.

Key Points from Considerations in Handling Item Challenges:

  • Candidates may not review their answer sheet or the test answer key.
  • Test materials cannot be left unsupervised with candidates.
  • Under no circumstances should test material be removed from the designated review area.

It is extremely important to remember that entry-level tests may not be challenged under any circumstances.

Test Security Agreement (TSA)

This is the primary security document that every agency must have on file before they receive inspection copies, test materials, documentation, or publications. The document itself is a very thorough review of security expectations for all individuals handling IPMA-HR test materials.

All signers should watch the following video before signing the agreement.

Also, please make sure to check with us to see if your TSA is up to date, before placing a test order.

Who should sign a TSA:

All Test Security Agreements need to have a Principal Signer who agrees to the terms of the agreement on behalf of their agency. We require that the Principal Signer be a top-level staff member at the agency, such as an HR Director or Manager, a Civil Service Chairperson, or Chief of Police or Fire.

With a Principal Signer in place, that individual may then appoint appropriate subordinates as Alternate Signers. Alternate signers are employees who are entrusted to order, receive, store and/or administer tests; they may include HR staff (e.g. HR Analysts), administrative ranks within police and fire, as well as Training and Testing Coordinators. The Test Administrator is often an alternate signer, as this individual may handle the whole testing process.

In terms of ordering power and ability to receive test materials, there is generally little to no difference between principals and alternates. However, we strongly feel that it is important for top-level management staff at your agency to be knowledgeable about our security requirements and to make a decision as to which staff members receive direct access to our test materials.

It is important to note that IPMA-HR does not recommend operating departments receive test shipments directly because having candidates working in the area presents a security risk. We strongly recommend that test orders from operating departments be channeled through a centralized HR department or civil service commission.

Key TSA Points:

  • IPMA-HR is the owner of all test materials with signer agencies using materials on a lease only basis
  • Materials should only be opened by a signer, not administrative staff.
  • No test material may be reproduced for any reason (photocopied, photographed, or otherwise)
  • All candidates must be provided with a new, sealed test booklet. Under no circumstances may a test booklet be re-used to test additional candidates.
  • Test materials should never be made available to candidates before the testing process.

Limited Access Security Agreement (LASA)

The LASA is available to provide unsupervised access to our test materials to individuals who play a part in the testing process, but should not have the authority to receive those materials directly.

A test proctor who will be required to maintain the security of test materials but who is not involved with the process of selecting or ordering that test is a perfect example of an individual who should sign a LASA.

The LASA is also an important agreement to consider for public safety operating departments that conduct their own testing. An administrative Sergeant heavily involved with the process of testing entry-level candidates, but should not have the ability to order a promotional test that he or she may one day take, should sign a LASA.

Key LASA points:

  • The security requirements outlined in the TSA regarding the use of our materials apply to LASA signers as well.
  • Individuals who have signed a LASA may handle test materials, but not directly receive them. A TSA signer must provide the LASA signer with test materials.

The New York and New Jersey Port Authority Police recently had to deal with a subject matter expert going rogue by taking cell phone pictures of the test with his phone. Be careful, keep an eye on how your SME’s review test materials.

What about Subject Matter Experts (SMEs)?

SMEs have their own category within IPMA-HR security policies. Since your agency may have a large number of SMEs involved in selecting a test, we do not require each of those individuals to complete a security agreement. Instead, we require that a TSA or LASA signer be present during a group review with SMEs. Test materials should not be left alone with the group, nor should they be allowed to leave the area being monitored by the signer. If such a situation arises, the SME should sign a Limited Access Security Agreement.

What about test proctors?

IPMA-HR defines proctors as individuals chosen by the signing agency to assist an administrator in carrying out various tasks during the testing session, such as handing out test materials, keeping time and monitoring the testing room.

Like SMEs, test proctors should never receive unsupervised access to test materials. They are not test administrators, so they should not be responsible for keeping or handling test materials outside of the test administration.

Prior to administration, a TSA or LASA signer should train all proctors on security procedures you’ve instituted based on IPMA-HR security requirements and your agency’s established rules.

The following video discusses the above information in more detail.

By |2012-12-10T13:08:33-04:00June 1st, 2012|Assessment, Test Security & Cheating|Comments Off on Test Security and Cheating: Part 3

Best Practice Standards: IPMA-HR Resources

Today, I would like to discuss how IPMA-HR’s assessment resources can be used to ensure your organization’s practices adhere to professional standards of practice.

Adverse impact is at the center of an increasing number of news stories written about selection practices. Unfortunately, a large number of departments and agencies don’t do enough to protect themselves. Over time, HR and assessment professionals have learned that it nearly impossible to eliminate adverse impact within cognitive testing. More than ever, it is important that your organization protect itself in situations where adverse impact may surface, opening the door to possible litigation.

(more…)

By |2012-04-03T16:49:59-04:00January 5th, 2012|Resources|1 Comment

In this New Year, don’t let your agency take a tumble back in time.

The recent article by Rich Tonowski certainly brought to the surface some of the thoughts I have had when reading and hearing about public safety departments all over the United States getting into large scale legal battles in regard to their selection processes.

Some of these litigation cases are certainly deep and complicated, such as Dukes v. Wal-Mart Stores, Inc. and Ricci v. DeStefano. However, others like Easterling v. Connecticut Department of Corrections and United States v. New Jersey Civil Service, are lessons in assessment basics that should always be at the forefront of an HR or assessment professional’s mind. Basics like ensuring that job analysis of a target position includes opinions and ratings from a diverse group of personnel and making sure to test candidates in areas that are directly related to job tasks.

During the month of January the ASR will focus on establishing standards you should keep in mind to ensure your department doesn’t end up as the lead story on tomorrow’s evening news. Our coverage kicks off with the next series from Robert Burd, on the topic of issues that might arise during test administration. Specifically he will discuss using successive hurdles, weighing different parts of the selection process and certification rules for eligibility lists. You can also look forward to a piece on the importance of Test Response Data, both to IPMA-HR and your agency as a whole. We will also be highlighting outside professional resources that are important for you and your staff to review and understand. Concluding the month long theme, we will bring you an in-depth look into non-cognitive testing, and how it can be implemented within your assessment process.

By |2012-10-19T16:32:30-04:00December 31st, 2011|Resources|Comments Off on In this New Year, don’t let your agency take a tumble back in time.