Compass Consultants, LLC offers a variety of onsite workshops as well as training tailored to meet your challenges. Do you have new or inexperienced test question developers who need to learn more about the basics of test development? How about experienced staff who want to go that extra mile and learn how to write test questions that test more than memorized knowledge? Is your test item database in need of repair or reorganization? Do you need a presenter at a meeting or conference to talk about testing, training or performance improvement?
Compass Consultants, LLC is here to guide you in new directions!
See the list below for a sampling of what's available.
New! Click HERE to download a copy of a research paper by James R. Parry: Ensuring Fairness in Difficulty and Content Among Parallel Assessments Generated From a Test-Item Database
EFFECTIVE test development
Learn the deep, dark, secrets of testing.
See how students can spot the answers!
Two Day Workshop
All tests should be well developed and testing practices beneficial. There is extensive evidence documenting the effectiveness of well-constructed tests in relation to supporting the validity of the test. Improper use of tests or interpretation of scores, however, can cause considerable harm to test takers as well as others affected by test-based decisions. This powerful two-day workshop provides instruction and engages participants in the design and development of test items and assessments. The workshop includes the following topics:
See how students can spot the answers!
Two Day Workshop
All tests should be well developed and testing practices beneficial. There is extensive evidence documenting the effectiveness of well-constructed tests in relation to supporting the validity of the test. Improper use of tests or interpretation of scores, however, can cause considerable harm to test takers as well as others affected by test-based decisions. This powerful two-day workshop provides instruction and engages participants in the design and development of test items and assessments. The workshop includes the following topics:
- The Testing Process
- The Test Development Process
- Development of Learning Objectives
- Topic Structure Development
- Importance and Development of a Test Plan
- Cognitive Levels of Testing and Item Complexity
- Use of Correct Grammar and Effective Language
- Test Item Development
- Determining Cut/Passing Scores
- Reporting and Analytics
- Developing Pre- and Posttests
advanced test development workshop
Learn how to make mountains out of molehills.
One Day Workshop
Writing test items is difficult, but trying to make them check more than knowledge is a huge challenge. This workshop will provide hands-on practice to help you turn low complexity, knowledge-based test items into higher complexity, performance-based items following Bloom’s Taxonomy and Gagne’s Nine Events of Instruction. Topics covered include:
One Day Workshop
Writing test items is difficult, but trying to make them check more than knowledge is a huge challenge. This workshop will provide hands-on practice to help you turn low complexity, knowledge-based test items into higher complexity, performance-based items following Bloom’s Taxonomy and Gagne’s Nine Events of Instruction. Topics covered include:
- Types of Tests
- Levels of Complexity
- Matching Complexity to Cognitive Performance
- Item Writing Practice
- Ensuring Test Quality
Setting fair, defensible cut (passing) scores
One Day Workshop
Note: Compass Consultants can also facilitate cut score determination sessions with your staff.
Note: Compass Consultants can also facilitate cut score determination sessions with your staff.
The main rationale behind criterion-referenced test cutoff scores is that one must be able to distinguish between candidates who can demonstrate sufficient knowledge to be advanced, licensed, or certified and those who cannot. The cutoff score creates two classifications of candidates: those who are competent to perform the duties in a safe and effective/definitive manner and those who may not perform at this level.
The Angoff method defines the cutoff score as the lowest score the minimally acceptable candidate is likely to achieve. Candidates scoring below this level are believed to lack sufficient knowledge, skills, or abilities to be certified. (Moritsch, 2000).
Topics include:
The Angoff method defines the cutoff score as the lowest score the minimally acceptable candidate is likely to achieve. Candidates scoring below this level are believed to lack sufficient knowledge, skills, or abilities to be certified. (Moritsch, 2000).
Topics include:
- Identify various methods of determining a fair, defensible cut score
- Discuss the advantages and disadvantages of each
- Combine several methods to set an initial cut score and verify its accuracy after sufficient data is gathered
- Using the Modified Angoff Method to set an initial cut score
- Hands on practice using your test items to establish a fair cut score for a test
Sampling of short presentations
|
why use performance-based testing?
|
|