Innovative Solutions
No two programs are the same. When the right methodology doesn’t exist, our team of experts creates it.
The Caviart Group is widely recognized as a leader in the development and implementation of innovative and advanced item types. We have extensive experience in human-scored performance tests as well as computer-delivered interactive and simulation examinations. We have developed various computer-delivered simulations including the simulations for the architects licensing examination and for use in certifying health professionals in diagnostic medical sonography.
Case Analysis Items
These items ask candidates to apply their professional judgment to real-world scenarios that unfold over a series of steps. Just as in real professional practice, information may be limited and the situation may change as the case evolves. Candidates are assessed on their ability to synthesize the available information and to make judgments as to how to proceed. They are also assessed on their ability to adapt as they learn new information. These items are seen as real-world assessments by candidates. They are also very efficient items requiring significantly less item writer time than traditional multiple-choice items.
Hot Spot Items
Candidates use a computer mouse to locate areas or items within a real-world image. These items have been used extensively in medical situations, including identification of areas of concern. The interface may also be able to be used to determine measurement between two locations on an image.
Sign Language Interpreter Performance Exam
In some cases, it is necessary for candidates to actually perform a task in order to assess their skills. For candidates for certification as interpreters for the Deaf, we created a system that allowed for candidates to be videotaped performing sign language interpretation of a set of stimulus presentations. These recordings are then uploaded to an online system which distributes them for scoring by trained interpreter raters. The system automatically monitors the scoring process and distributes examination videos for multiple ratings as required by the scoring algorithm.
Simulations
Simulated Sonogram Console
Many professions, such as medical sonography, require the correct use of complex equipment to obtain the information required to make decisions such as medical diagnoses. Since the use of actual sonographic imaging equipment and real patients is impracticable for a large scale testing program, a simulated sonogram console was developed that could be imbedded in a computer-based examination.
Our interactive console design allows candidates to set a number of the parameters including transducer type, system modality, velocity settings and scale parameters, etc. to simulate the process that would be used in a real examination to obtain and optimize the image captured.
The video above shows the Architecture Graphic Design Simulation.
Architecture Graphic Design Simulation
For many years, candidates for architectural licensing were required to create architectural designed by hand in a testing environment. These drawings were then scored by trained architect raters. This process was very time consuming and expensive.
In the architectural graphic design simulation, candidates are able to manipulate elements on a computer to achieve the goals specified. Although the potential set of responses is huge, the resulting renderings are scored by a computer program which assesses the interrelationships between the elements as compared to a predetermined set of relationships.
Nuclear Density Gauge Simulation
Engineering technologists must have a thorough understanding of this highly dangerous and complex gage which contains radioactive materials. We created the computer simulated gauge that completely recreates the experience of interacting with the nuclear density gauge without the risk associated with a real-world exercise.
Mainframe Wiring Simulation
Installing complex computer equipment, such as a mainframe computer, requires a thorough understanding of the how to correctly link all of the various system components. By simulating the experience in 3-D images, the candidate can be tested under conditions that are very similar to the actual experience.
“We converted our four-part paper-based certification program to computer-based testing. Complicating the conversion, the exam was offered in multiple languages in over 100 countries. The Caviart Group provided the expertise that ensured the conversion was successful.”
The Institute of Internal Auditors