Developing typical performance tests

15 important questions on Developing typical performance tests

Which administration modes are there for a typical performance test?

Face to face
Telephone
Paper and pencil in person
Paper and pencil by mail
Computerized administration
Computerized adaptive administration

When creating a conceptual framework, which methods are there to do this, and when should you use which method?

  • Intuitive method; No/informal theory/knowledge about construct
  • Inductive method; Weak theory/knowledge about construct
  • Deductive method; Strong theory/knowledge about construct

How does the intuitive prototypical method work?

  • Test is constructed based on a prototype;
  • subjects are asked to report all behavior, thoughts, emotions on the construct (the prototype)
  • use these responses to base questions on.
  • Higher grades + faster learning
  • Never study anything twice
  • 100% sure, 100% understanding
Discover Study Smart

How does the rational intuitive method work?

  • Use everything you can find about the construct e.g., (expert) opinions, informal sources, etc
  • use this information to create items

Within the inductive method, which strategies are there?

  • internal method
  • external method

How does the internal inductive method work?

– Gather items that seem related to the construct of interest
– Adminster, and select the items that are correlated with eachother
--- Validity is doubtful
– E.g., Insecurity
• “At parties, I’m always sitting lonely in a corner” (extraversion)
• “I am not interested to meet new people” (openess to experience)

How does the external inductive method work?

– Select different items
– Adminster, and select the items that correlate highly with a criterion
– E.g.,insecurity
• Citerion: expert judgements about someone’s insecurity

Within the deductive method, which strategies are there?

  • the construct method
  • the facet method

Which distinguishment can be made within close ended response mode?

frequency close ended response mode
endorsement (bevestiging) response mode.

How does the construct deductive method work?

  • items are designed through construction on basis of a strong theory about the construct and its relation to other constructs
  • so the theory states the construct is based on multiple components, each component is measured.

How does the facet deductive method work?

  • the construct is analyzed, items are generated that have to be measured
  • observable behavior that applies to the construct is classified according to a number of aspects called facets
  • also situations that apply to the construct are classified according to situational facets.
  • every situational-behavioral facet combination is measured through item generation for that combination.

Which kinds of endorsement close ended response modes are there?

  • all or none endorsement close ended responses
  • intensity endorsement close ended responses

Which kind of intensity endorsement close ended response mode are there?

discrete intensity endorsement close ended responses
continuous intensity endorsement close ended responses.

How do we also call a close ended endorsement intensity discrete response mode?

an ordinal-polytomous response

What are the item writing guidelines for a typical performance test?

  • Focus on one aspect per item; “At parties, I drink a lot, and go totally crazy”
  • Avoid making assumptions about the test taker; “When did you stop beating your wife?”
  • Use positive statements; “In my relationship, I don’t feel stressed
  • Put the situation or conditional part of a statement at the beginning and the behavioral part at end
  • Also use contra-indicative items; items of which a high score is indicative of a low level on the construct.
  • Recode contra-indicative questions, and Recode contra-indicative questions

The question on the page originate from the summary of the following study material:

  • A unique study and practice tool
  • Never study anything twice again
  • Get the grades you hope for
  • 100% sure, 100% understanding
Remember faster, study better. Scientifically proven.
Trustpilot Logo