It is important to understand the distinction between direct and indirect evidence of student learning.Direct evidence of student learning is tangible, visible, and measureable and tends to be more compelling evidence of exactly what students have and have not learned.This is because you can directly look at students’ work or performances to determine what they’ve learned.
Indirect evidence tends to be composed of proxy signs that students are probably learning.An example of indirect evidence is a survey asking students to self-report what they have learned.This is evidence that students probably are learning what they report to have learned, but is not as compelling as a faculty member actually looking at students’ work.It is not uncommon in students’ self-reports to either inflate or undervalue what they have actually learned.
Distinguishing Between Direct and Indirect Assessment
While it is easy to distinguish between what is direct evidence of student learning and what is indirect, some evidence of learning is less clear.For example, peer reviews of student work.While students are actually submitting work to demonstrate what they have learned, a faculty member may not ever see this work or have an opportunity to evaluate it.Would this be an example of direct or indirect evidence?There are a few considerations that can be helpful in determining whether an assessment is direct or indirect evidence of student learning.
Considerations
1. Does the assessment measure the learning or is it a proxy for learning?
Direct Evidence: Students have completed some work or product that demonstrates they have achieved the learning outcome. Examples: project, paper, performance
Indirect Evidence: A proxy measure was used, such as participation in a learning activity, students’ opinions about what was learned, student satisfaction, etc. Examples: teaching evaluations, surveys asking students how much they think they learned, course grades
2. Who decides what was learned or how well it was learned?
Direct Assessment: a professional makes a decision regarding what a student learned and how well it was learned. Examples: faculty evaluated papers, tests, or performances
Indirect Assessment: the student decides what he or she learned and how well it was learned. Examples: surveys, teaching evaluations
Frequently Asked Questions
How are grades indirect measurement of student learning outcomes?
Course grades are based on many iterations of directmeasurement. But grades are an indirect measurement of anyone course learning outcome because:
They represent a combination of course learningoutcomes;performance on these outcomesare averaged out in a final grade
They frequently include corrections not relatedto learning outcomes, such as extra credit or penalties for unexcused absences.
When should direct assessment be used?
Direct assessment is the most effective form of assessmentwhen you are measuring a single learning outcome, objective, or goal. This type of assessment gives you the most clear, compelling, and actionable information when determining, for example, how well your students are developing their writing skills, abilities to reflect critically, or integrate theory into practice.
Is it ever appropriate to use indirect assessment?
Yes. Indirect assessment provides valuable information and is an appropriate and valid form of assessment. A few examples of whenindirect assessment is particularly valuable:
As a complement to direct assessmentmethods. Indirect assessment is often an extremely useful tool in combination with direct assessment to offer a more comprehensive view of student learning. Direct assessment may tell you what students learned and how well they learned it, but indirect assessment can give you information about how a student feels about what they know – for example, does that student feel confident in his or her ability to apply the knowledge in the future?
In program or curriculum review. Indirect assessment provides valuable insight and feedback of students’ views of what they are learning, how programs and services are administered, etc.
Peer review of student work. Although peer review is indirect assessment,it is often a useful teaching and learning tool.
Direct assessment may tell you what students learned and how well they learned it, but indirect assessment can give you information about how a student feels about what they know – for example, does that student feel confident in his or her ability to apply the knowledge in the future?
Direct Assessment refers to any method of collecting data that requires students to demonstrate a knowledge, skill, or behavior. Indirect Assessment refers to any method of collecting data that requires reflection on student learning, skills, or behaviors, rather than a demonstration of it.
Direct assessment involves looking at actual samples of student work produced in our programs. These include capstone projects, senior theses, exhibits or performances (see below). Indirect assessment is gathering information through means other than looking at actual samples of student work.
Direct instruction is frequently utilized for presentation of preparatory material to be incorporated when utilizing other forms of instruction. Indirect instruction is utilized for a higher level of student involvement incorporating activities such as observation and investigation.
Direct measures are usually most useful for course level assessment of student learning outcomes. Indirect measures of student learning imply that learning occurred and include perceptions or attitudes related to a student abilities. They assess opinions or thoughts about student knowledge or skills.
For example, surveys and questionnaires are usually thought of as indirect assessment methods where we ask the respondents to give us their opinions about certain topics. However, if we prepare the survey for an internship supervisor who has directly observed a student's performance, then it would be a direct measure.
Indirect assessment methods require that faculty infer actual student abilities, knowledge, and values rather than observe direct evidence. Among indirect methods are surveys, exit interviews, focus groups, and the use of external reviewers.
Direct assessment involves measures of student learning that ask students to directly demonstrate or perform the desired knowledge or skill. Examples include papers; quizzes and exams; music, theater, or dance performances; or execution of safety procedures.
Examples of indirect instruction methods include reflective discussion, concept formation, concept attainment, cloze procedure, problem solving, and guided inquiry. Indirect instruction seeks a high level of student involvement in observing, investigating, drawing inferences from data, or forming hypotheses.
Indirect instruction is a student-centered approach to learning where students observe, investigate and draw inferences from data. In this instructional model, professors take on the role of a facilitator or supporter as opposed to offering direct instruction.
The main advantage of direct vs. indirect assessment measures is that direct measurements more clearly connect to specific learning outcomes. Therefore, they provide the clearest insight into a student's level of mastery.
Generally, 34 CFR 668.10 includes the following requirements: A direct assessment program is a program that, in lieu of using credit hours or clock hours as a measure of student learning, utilizes direct assessment of student learning, or recognizes the direct assessment of student learning by others.
Direct Assessment: a professional makes a decision regarding what a student learned and how well it was learned. Examples: faculty evaluated papers, tests, or performances. Indirect Assessment: the student decides what he or she learned and how well it was learned. Examples: surveys, teaching evaluations.
Examples of indirect assessments are parent, teacher, or child interviews and behavior rating scales or checklists. Descriptive assessments encompass direct observation of the individual in the natural setting (classroom, cafeteria, playground, etc), ABC data collection, and scatter plots.
Some indirect assessments include structured or open-ended parent interviews as well as rating scales such as the Questions About Behavior Function (QABF) or the Motivation Assessment Scale (MAS). Pros: Quick and easy to use. Low risk as behaviors don't have to occur.
Direct assessment involves measures of student learning that ask students to directly demonstrate or perform the desired knowledge or skill. Examples include papers; quizzes and exams; music, theater, or dance performances; or execution of safety procedures.
Introduction: My name is Annamae Dooley, I am a witty, quaint, lovely, clever, rich, sparkling, powerful person who loves writing and wants to share my knowledge and understanding with you.
We notice you're using an ad blocker
Without advertising income, we can't keep making this site awesome for you.
