Developing typical performance tests
15 important questions on Developing typical performance tests
Which administration modes are there for a typical performance test?
Telephone
Paper and pencil in person
Paper and pencil by mail
Computerized administration
Computerized adaptive administration
When creating a conceptual framework, which methods are there to do this, and when should you use which method?
- Intuitive method; No/informal theory/knowledge about construct
- Inductive method; Weak theory/knowledge about construct
- Deductive method; Strong theory/knowledge about construct
How does the intuitive prototypical method work?
- Test is constructed based on a prototype;
- subjects are asked to report all behavior, thoughts, emotions on the construct (the prototype)
- use these responses to base questions on.
- Higher grades + faster learning
- Never study anything twice
- 100% sure, 100% understanding
How does the rational intuitive method work?
- Use everything you can find about the construct e.g., (expert) opinions, informal sources, etc
- use this information to create items
Within the inductive method, which strategies are there?
- internal method
- external method
How does the internal inductive method work?
– Adminster, and select the items that are correlated with eachother
--- Validity is doubtful
– E.g., Insecurity
• “At parties, I’m always sitting lonely in a corner” (extraversion)
• “I am not interested to meet new people” (openess to experience)
How does the external inductive method work?
– Adminster, and select the items that correlate highly with a criterion
– E.g.,insecurity
• Citerion: expert judgements about someone’s insecurity
Within the deductive method, which strategies are there?
- the construct method
- the facet method
Which distinguishment can be made within close ended response mode?
endorsement (bevestiging) response mode.
How does the construct deductive method work?
- items are designed through construction on basis of a strong theory about the construct and its relation to other constructs
- so the theory states the construct is based on multiple components, each component is measured.
How does the facet deductive method work?
- the construct is analyzed, items are generated that have to be measured
- observable behavior that applies to the construct is classified according to a number of aspects called facets
- also situations that apply to the construct are classified according to situational facets.
- every situational-behavioral facet combination is measured through item generation for that combination.
Which kinds of endorsement close ended response modes are there?
- all or none endorsement close ended responses
- intensity endorsement close ended responses
Which kind of intensity endorsement close ended response mode are there?
continuous intensity endorsement close ended responses.
How do we also call a close ended endorsement intensity discrete response mode?
What are the item writing guidelines for a typical performance test?
- Focus on one aspect per item; “At parties, I drink a lot, and go totally crazy”
- Avoid making assumptions about the test taker; “When did you stop beating your wife?”
- Use positive statements; “In my relationship, I don’t feel stressed
- Put the situation or conditional part of a statement at the beginning and the behavioral part at end
- Also use contra-indicative items; items of which a high score is indicative of a low level on the construct.
- Recode contra-indicative questions, and Recode contra-indicative questions
The question on the page originate from the summary of the following study material:
- A unique study and practice tool
- Never study anything twice again
- Get the grades you hope for
- 100% sure, 100% understanding