Question
Difficulty: easy. Skill: recognize. Type: experimental design critique.
The team wants stronger evidence before scaling a plan for following a visual schedule. Which design decision best fits threats to internal validity? The case file includes 3 recent sessions, 1 implementer, and 3 settings.
AUse a familiar protocol even though it does not address measurement quality and procedural integrity
BRely on teacher's report alone and stop collecting direct evidence
CChange the intervention immediately based on the concern alone
DCheck measurement quality, observer agreement, and procedural integrity before making a major decision in relation to student's calling out during independent workCorrect answer
Explanation
Answer DThe clue is the combination of frequency data that vary from 3 to 11 responses per session, calling out during independent work, and the required task: Threats to internal validity. The case file includes 3 recent sessions, 1 implementer, and 3 settings. Check measurement quality, observer agreement, and procedural integrity before making a major decision in relation to student's calling out during independent work is best because it answers that clue through measurement quality and procedural integrity instead of treating the scenario as a generic behavior problem. On exam items like this, name the decision point first, then eliminate options that rely on one report, a label, a familiar protocol, or an action that skips the relevant data check.
Why this question is hard
ClueKey scenario clueThe clue is the combination of frequency data that vary from 3 to 11 responses per session, calling out during independent work, and the required task: Threats to internal validity. The case file includes 3 recent sessions, 1 implementer, and 3 settings.
TrapCommon trapA familiar protocol is not enough unless it matches the assessed variables and the current decision question.
NextIf you missed it, review Internal validity and confoundsThen answer a few related scenarios before moving back to broad practice.
Why the other choices are weaker
AChoice AA familiar protocol is not enough unless it matches the assessed variables and the current decision question.
BChoice BStakeholder input matters, but direct data, context, and integrity checks are still needed for a defensible answer.
CChoice CThis is weaker because it skips the assessment, integrity, or decision rule needed before changing procedures.
Study tags
Measurement quality and procedural integrityThreats to internal validityvalidityreliability
Related concept pages
Turn this into a study plan
If this question felt difficult, practice a short drill from Experimental Design and use the review page to turn missed items into a weak-area plan.
Practice interactively
Try more BCBA scenario questions in the interactive practice mode, then use review tools to track missed domains and flagged items.