<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=353110511707231&amp;ev=PageView&amp;noscript=1">
2019 ATP Innovations in Testing
March 17 - 20 | Orlando, FL BOOTH #112
Sign up to the right to receive post-conference articles and other news from PSI.
View PSI 16pf® Sixth Edition Reports Now Available

Enhancing the Candidate Test-taking Experience: What Are We Doing?

Monday, March 18, 2019, 11:30 AM - 12:30 PM
Room: Celebration 12 & 13
Topic: Test Administration and Delivery Models

Panelists representing four test publishers that span employment, workforce, and certification assessments will share their expert perspectives, experiences, and best practices. Topics addressed will include: Why is candidate experience important to publishers and organizations? What sort of features are important when thinking about candidate/examinee experience? (How) does the candidate experience affect measurement? How have you, as a publisher, enhanced candidate/examinee experience? How is candidate/examinee experience measured? 

Presenters:
John Weiner, PSI Services
Kelly Dages, Fifth Theory LLC
Kimberly Nei, Hogan Assessments

Lessons learned from Delivering a Performance Based Test in China

Monday, March 18, 2019, 4:00 PM - 5:00 PM
Room: Celebration 14 & 15
Topic: Test Administration and Delivery Models

A test sponsor has a growing market in China. Remote proctoring has been an effective solution but with the growing need for certified professionals in China, the sponsor needed to reevaluate its operations. This session will explore the cultural, business, operational, and technical aspects of converting a remotely proctored program to a test center program in China. We will discuss the implications to remote proctoring and the challenges faced during implementation.

Presenters:
Beth Kalinowski, PSI Services
Liz Kline, The Linux Foundation

Technology-Based Assessment Guidelines: Present and Future

Tuesday, March 19, 2019, 1:15 PM - 2:15 PM
Room: Bayhill 21 & 22
Topic: Measurement and Psychometrics

Assessment methods are evolving rapidly as organizations make use of the latest technologies to design, deliver, and process the results of testing instruments in a range of educational, employment, and credentialing applications. To keep pace with these changing practices and the need for guidance in this area, the Association of Test Publishers (ATP) and the International Test Commission (ITC) have joined forces to develop new international guidelines to promote best practices in the development, delivery, and use of assessments in a global technology-based environment. The presenters in this session will discuss current ATP (2002) and ITC (2005) guidelines for computer-based and internet-based testing, advances in technology-based assessment, and the new joint ATP-ITC Guidelines initiative. An interactive audience discussion will be included, as well as a call for participation in future activities. 

Presenters:
John Weiner, PSI Services
Steve Sireci, University of Massachusetts

SPONSOR SESSION: Innovations in Security: Tried, True & Evolving Methods

Tuesday, March 19, 2019, 4:15 PM - 5:15 PM
Room: Bayhill 19

With every digital innovation in our industry comes the corresponding security question: “How do we secure this?” In this interactive session, attendees will hear from a panel of PSI experts and customers on how PSI has challenged the status quo of testing security and evolved its technology and products for today and tomorrow, including: 

  • Using data forensics to create a proactive auditing and channel management strategy
  • Creating Linear on-the-fly testing that can even be used for lower volume programs 
  • Leveraging next-gen security technology like facial recognition biometrics and AI/machine learning in proctoring concepts. 

Two PSI customers will share their experiences with PSI’s products and the successes they have seen and are looking forward to implementing. Be prepared to share your thoughts, too, as we will poll the audience on trending security concerns, innovations, and more.

Presenters:
John Weiner, PSI Services
Rory McCorkle, PSI Services
Amin Saiar, PSI Services
Kim Cohen, ISACA
Jerry Gorham, Ascend Learning

Standard Setting from the Perspective of Facilitator, Participant, and Decision Maker

Wednesday, March 20, 2019, 9:45 AM - 10:45 AM
Room: Celebration 12 & 13
Topic: Measurement and Psychometrics

Issues related to standard-setting studies from the perspective of a psychometrician, a panelist, and the organization's board will be discussed. The psychometrician's role will include an overview of the steps involved in a criterion-referenced passing point study, highlighting psychometric standards related to such studies. The panelist's role will report on research on resolving the cognitive complexity required for a study, including a potential solution for managing that complexity. The need for the board to maintain accountability for a final decision related to the standard will be emphasized. All three presenters will address controversies related to the role of each participant in the process. 

Presenters:
Lawrence Fabrey, PSI Services
Jerry Reid, American Registry of Radiologic Technologists
Robbie Furter, American Board of Pediatrics

FEATURED SPEAKER SESSION: A Survey of Recertification and Renewal Practices in Credentialing

Monday, March 18, 2019, 2:00 PM - 3:00 PM
Room: Celebration 1 & 2
Topic: Program Design

The Association of Test Publishers (ATP) Certification and Licensure division subcommittee on Recertification and Renewal surveyed credentialing organizations to identify trends and innovative ideas in recertification and renewal. The session presenters will discuss the fundamentals of recertification and renewal from a psychometric, program management, and technology perspective. The presenters will highlight key decision points regarding the development and communication of recertification and renewal requirements, as well as opportunities to engage credential-holders. The session presenters will also present findings from the Association of Test Publishers (ATP) Certification and Licensure division survey along with a live polling of the audience on selected questions from the survey. 

Presenters:
Amin Saiar, PSI Services
E.W. Looney, Brightlink
Michael Peabody, American Board of Family Medicine
Kevin Bradley, HumRRO

The Debate Goes On: Differing Perspectives on Recertification and Maintenance of Certification

Tuesday, March 19, 2019, 8:30 AM - 10:00 AM
Room: Celebration 5 & 6
Topic: Program Design 

Recertification practices differ widely across the measurement industry and have come under increased public scrutiny and opinions appear to have become increasingly entrenched. The session presenters will engage in a debate on issues related to recertification. The session moderator will begin with polling the audience on the following four questions, invite the debate team to discuss the questions, and close with repeat audience polling and final remarks. Should an assessment component be required for recertification? If used, should the recertification exam be the same as the initial certification exam or a different exam? Should continuing education be a requirement for recertification? Should recertification models differ by subgroup characteristics, such as years of experience, specialty area, or work setting? 

Presenters:
Rory McCorkle, PSI Services
Amin Saiar, PSI Services
Andrew Dwyer, American Board of Pediatrics
Anjali Weber, Board of Pharmacy Specialties
Brett Foley, Alpine

Analyze That! Managing Multiple Job Analyses for a Complex Organization

Tuesday, March 19, 2019, 1:15 PM - 2:15 PM
Room: Celebration 7 & 8
Topic: Measurement and Psychometrics

During this session, the presenters will share lessons learned from conducting job analysis studies for 11 specialty certification programs, spanning three levels of expertise, within the same professional field. This case study highlights similarities and unique aspects across programs, emphasizing the need for a standardized, yet flexible approach to studying each job role, according to methodology that complies with three sets of testing and accreditation standards. Attendees will gain awareness of the possible intersecting and distinctive aspects of multiple certification programs within the same field and insight into the benefits of initiating and maintaining an active dialogue and partnership with colleagues and consultants throughout the job analysis process. 

Presenters:
Pamela Ing Stemmer, PSI Services
Anthony Wilson, American Nurses Credentialing Association

Assessment Innovation and the Validity-Diversity Dilemma: Challenges and Opportunities

Wednesday, March 20, 2019, 9:45 AM - 10:45 AM
Room: Celebration 5 & 6
Topic: Measurement and Psychometrics

Organizations that use test scores to make high stakes decisions about people, such as college admissions and employee selection, often face challenges in balancing competing goals. For example, validity in predicting scholarship and effectiveness, utility, and diversity. This is especially true with cognitively-loaded assessments that tend to be the most predictive of important outcomes related to academic and job success. At the same time, these measures by themselves may manifest exclusionary impact for certain demographic groups with respect to test performance, resulting in lower selection rates and less diversity (i.e., adverse impact). In this session, three experts in Education, Credentialing and Workplace assessment will examine recent trends, such as technology-enhanced measurement, increased use of noncognitive measures, and scoring techniques (e.g., stealth measurement), and their potential to help address the validity-diversity dilemma.

Presenters:
John Weiner, PSI Services
Wayne Camara, ACT
Neal Schmitt, Michigan State University

View Full Schedule
Trusted for Reliable Science. Enhanced by Advanced Technology.
Learn More