PSI logo Testing Excellence

ATP 2021: PSI Sessions

April 27-29 | Virtual

Engaging Contributor Sponsor

PSI will be presenting in ten sessions at this year's ATP Virtual Conference.

One of these sessions is a special networking discussion, hosted by Dr. Rory McCorkle, entitled, "The New Normal: How COVID-19 has Driven Credentialing Organizations to Adopt Online Proctoring."  Start off your Thursday with this virtual coffee talk.  All participants will receive their next Starbucks coffee on us, so be sure to add it to your calendar!  

Calendar

 

See below details for all of the sessions our PSI experts will be delivering and make sure you join us to learn more about innovations in testing.

 

Add our sessions to your agenda!

Tuesday, April 27th

Link to Session

About:
PSI has been delivering multi-modal testing since 2016 with many leading organizations, so this form of testing is not a recent trend. However, many credentialing organizations adopted multi-modal testing in response to COVID-19. The large-scale migration to online assessment provides a wealth of data that strongly supports the adoption of multi-modal testing. From our research, testing modality has no impact on candidate performance. Although mixed mode testing allows for candidate flexibility and reliable and secure testing, we have to consider that any change made to the way tests are delivered, comes with its challenges.
In this session we would like you to join us to discuss the following:

• What to expect when you are adopting remote proctoring as part of your test delivery
• What are the typical challenges reported by candidates
• What and how to communicate with your candidates

Presenter:
• Heather Richards / PSI Services

Link to Session

About:
Psychometricians representing different operational perspectives from a variety of testing programs offering certificates, certifications, and licenses will field a range of test development and psychometric questions from audience members. Questions may range from the first steps of designing a program to item development to standard setting to equating to exam maintenance to accreditation or anything in between. Bring your questions because this session will be 100% in a question and answer format.

Presenters:
• Amanda Wolkowitz / Alpine Testing Solutions
• Amin Saiar / PSI Services
• Andrew Dwyer / American Board of Pediatrics
• Amanda Dainis / Dainis and Company
• Brett Foley / Alpine Testing Solutions

Wednesday, April 28th

Link to Session

About:
Automated item generation (AIG) is an innovative practice that is gaining increasing attention as a viable method to create virtually unlimited test content using algorithms in lieu of humans. The benefits are apparent: cost efficiency and security chief among them, making test items disposable and obviating the risks of test item exposure, harvesting, and compromise. In the era of online testing, this capability becomes increasingly important. This session will examine the current state of practice in the use of AIG, key considerations and issues in the application of AIG, and unresolved questions and future capabilities to be addressed. A diverse panel of experts representing four different organizations will discuss their approaches to AIG, applications to various industry segments (education, credentialing), research agendas and roadmaps for future product capabilities.

Presenters:
• John Weiner / PSI Services
• Saad Khan / Finetune Learning
• Kim Brunnert / Elsevier
• Alina Von Davier / Duolingo

Link to Session

About:
In this session, the editors of ATP’s Journal of Applied Testing Technology will serve as a panel to discuss a collection of articles in a special edition devoted to empirical research and theory-driven discussions examining key issues in the use of online remote proctored assessment in a range of high stakes assessing organizations. The special issue addresses open questions and provides evidence to guide best practices for consideration by professionals and organizations that design, implement, establish standards or accredit high stakes assessment programs, such as educational admissions, certification, licensure, and employment.
Presenters:
• John Weiner / PSI Services
•Dianne Henderson / ACT
• Holly Garner / Kaplan

 

Link to Session

About:
We live in an age where we have become accustomed to clicking a button and having things arrive the next day, if not within hours. To meet the demands of professionals looking to quickly demonstrate their skills through certification, the current test development cycle model needs to be reevaluated. One organization took a new approach to psychometrics and test development to greatly reduce the time to market, all the while adhering to best practices. This presentation will be given in four parts: identifying the need for rapid development, a case study of new exam development, the process applied, and lessons learned. While the case study is specific to a new title, this rapid process can be applied to existing programs and may solve the issue of exam versioning as well as allow a rapid response after a security incident. There is a seemingly eternal problem of how do we do things better, faster, cheaper without sacrificing quality. Is there a way to have it all?

Presenters:
• Beth Kalinowski / PSI Services
• Clyde Seepersad / The Linux Foundation
• Jill Burroughs / Certiverse

Thursday, April 29th

Add to Calendar

or 

Link to Session

About:
Take a break from the main sessions and share ideas and experiences regarding multi-modal testing in this virtual coffee talk with a PSI expert. Grab a hot beverage and join us for an informal discussion and light networking. 

Your next coffee is on us! All who join will receive a $5 Starbuck's eGift card for participating.

Presenter:
• Rory McCorkle / PSI Services

Link to Session

About:
This session will outline considerations that credentialing programs should make when contemplating the transition to Linear-on-the-Fly (LOFT) testing. The characteristics and benefits of LOFT will be discussed along with the evaluations programs should make while making this determination. Evaluation can be accomplished by assessing the status of several aspects of the examination program, including annual candidate volume, item bank needs/deficiencies, risk tolerance, subject matter expert requirements, and logistical challenges of implementation. Key questions and considerations that will be addressed from the viewpoint of a certifying organization are:

• Is the program in a mature enough state to begin utilizing LOFT?
• Does LOFT make sense as a testing option based on the program’s annual candidate volume?
• Is the program’s item bank in a position to support LOFT?
• What is the program’s tolerance for risk vis-à-vis item exposure?
• How will the program benefit from utilizing LOFT?

Presenters:
• Cyrus Mirza / PSI Services
• Kate Kahoa / PSI Services
• Laura McNamara / AACN

Link to Session

About:
Equity and inclusion have come to the forefront of discussions of high stakes assessments, particularly in educational admissions and employment contexts. Questions are being raised about the fairness of tests and potential bias against various demographic subgroups, such as race/ethnicity, gender, culture and national origin; as well as individuals with disabilities. This discussion session will explore fundamental concepts of test fairness and bias, how they differ, and their roles in understanding challenges and solutions for assuring equity, diversity and inclusion in the use of assessments.

Presenter:
• John Weiner / PSI Services


Link to Session

About:
Many organizations adopted multi-modal testing in response to COVID-19, giving us an unprecedented ability to examine meta trends across in-person testing and remote proctoring within multiple programs.

In this session, we review trends, research, and lessons learned in the past year with the pandemic-driven transition of high stakes testing programs to multi-mode delivery. Specifically, we review adoption rates, candidate experience, and additional technical findings.

Join us to learn about:
• Trends in the adoption of multi-modal testing
• Research on how the global pandemic has shifted the testing industry and candidate needs and expectations
• Candidate satisfaction data regarding multi-modal testing options
• Psychometric results for test scores across modes
• Considerations in the use of multi-mode testing

Presenters:
• Nicole Tucker / PSI Services
• John Weiner / PSI Services
• Scott Hazlett / PSI Services


Link to Session

About:
In this panel discussion we will discuss the potential impact compromised test items may have on program policies, test development activities, test administration, and forensic analysis. We will speak with leaders representing certification programs who have with encountered and responded to incidents of compromised test content, a psychometrician to discuss options for adjusting test development plans, and a forensic analyst for detailing post-hoc analyses for the detection of cheating activity. The group will also discuss ways to proactively prevent exam content from becoming compromised and discourage cheating activity.

Presenters:
• Beth Kalinowski / PSI Services
• Nicole Tucker / PSI Services
• Jon Hall / Nutanix
• Scott Frohn / PSI Services

Subscribe to our blog:

Most Popular Reads

Check Out Our Resources on Multi-Modal Test Delivery:

Webinar

Going Multi-Modal With Testing In 2020 And Beyond

Assessment technology, in particular the adoption of online proctoring, has meant the choice of delivery channel is broader than ever. In this webinar, we compare modalities and share early research findings to help you develop a new test delivery strategy for the ‘new normal.’ 

Watch Now
Infographic

The Current State of Multi-Modal Testing

Our latest infographic examines meta trends across in-person testing and remote proctoring within multiple programs since COVID-19. You can use the data to reconsider your organization's overall testing program and strategize best practices for the future.

Download Now
White Paper

Online Remote vs Onsite Proctored High-Stakes Exams

Remote online proctoring has become increasingly sophisticated and is gaining wider consideration for high-stakes testing. However, there is an absence of published research examining remote online proctoring and its effects on test scores and the examinee experience.

Download Now

© 2024 PSI Services LLC, All Rights Reserved