Modes and Sampling
Modes and Sampling
Modes of evaluation
- The paper-pencil test, for prior knowledge, writing, reading, vocabulary, and verbal problems.
- Observation, for personal-social adjustment, habits, and operation skills.
Sampling
- Evidence is gathered by sampling reactions, written work, and interviews.
- It covers attitudes, behaviours, interests, intellectual skills, and appreciations.
Sampling a curriculum
- To appraise a curriculum, study a carefully chosen, representative sample of learners.
- This avoids interviewing or probing too many learners.
Once a developer knows they must appraise behaviour change over time, the practical question is how to gather the evidence. There are several modes, and there is a technique, sampling, that makes evaluating a whole curriculum manageable.
Modes of evaluation
The most familiar mode is the paper-pencil test, so familiar that evaluation is often treated as a synonym for it. It is a practicable way to gather evidence about several kinds of learner behaviour. It can assess prior knowledge, writing, and reading, and through multiple-response and other formats it can measure a learner’s ability to handle verbal problems, vocabulary, and reading.
But the paper-pencil test cannot reach everything. Some objectives call for other ways of getting evidence, above all observation of learners under conditions where the behaviour shows itself. Observation is how a developer gathers evidence of personal-social adjustments, habits, and operation skills, the kinds of behaviour a written test cannot capture. A learner’s ability to cooperate in a group, or to handle a tool, is seen, not written.
The paper-pencil test and observation
The paper-pencil test suits prior knowledge, writing, reading, and vocabulary. Observation suits personal-social adjustment, habits, and operation skills, which a written test cannot capture.
Sampling
Gathering evidence almost always involves sampling: collecting a sample of learners’ reactions, written work, or interviews rather than every possible piece. Sampling applies across all kinds of human behaviour worth evaluating, including attitudes, behaviours, interests, intellectual skills, and appreciations. You cannot capture all of a learner’s attitudes, so you sample them.
Sampling also operates at a larger scale, and this is its most useful role for a curriculum developer. To appraise the effectiveness of a whole curriculum, a developer does not need to test every learner. They can take a sample of learners, chosen carefully to be representative of the target group. A well-designed appraisal of such a sample means that not too many learners need to be interviewed or probed, yet the result still describes the curriculum’s effect on the group.
This pairs naturally with follow-up studies. To judge the permanence of learning, a developer takes a representative sample of learners, studies their behaviour intensively, and draws conclusions about the group. Sampling makes a thorough, lasting check affordable.
Study a carefully chosen, representative sample rather than every learner
Sampling appraises the effectiveness of the curriculum on the group while keeping the number of learners interviewed or probed manageable. It pairs naturally with intensive follow-up studies.
How was this article?