Question
Difficulty: hard. Skill: analyze. Type: experimental design critique.
The team wants stronger evidence before scaling a plan for following a visual schedule. Which design decision best fits threats to internal validity? The case file includes 12 recent sessions, 4 implementers, and 1 setting.
ATreat the most recent data point as proof of the final conclusion
BBase the decision on the descriptive label for calling out during independent work and bypass threats to internal validity
CUse a familiar protocol even though it does not address measurement quality and procedural integrity
DCheck measurement quality, observer agreement, and procedural integrity before making a major decision in relation to student's calling out during independent workCorrect answer
Explanation
Answer DThe clue is the combination of frequency data that vary from 3 to 11 responses per session, calling out during independent work, and the required task: Threats to internal validity. The case file includes 12 recent sessions, 4 implementers, and 1 setting. Check measurement quality, observer agreement, and procedural integrity before making a major decision in relation to student's calling out during independent work is best because it answers that clue through measurement quality and procedural integrity instead of treating the scenario as a generic behavior problem. On exam items like this, name the decision point first, then eliminate options that rely on one report, a label, a familiar protocol, or an action that skips the relevant data check.
Why this question is hard
ClueKey scenario clueThe clue is the combination of frequency data that vary from 3 to 11 responses per session, calling out during independent work, and the required task: Threats to internal validity. The case file includes 12 recent sessions, 4 implementers, and 1 setting.
TrapCommon trapA single point rarely supports a strong conclusion without considering trend, variability, and context.
NextIf you missed it, review Internal validity and confoundsThen answer a few related scenarios before moving back to broad practice.
Why the other choices are weaker
AChoice AA single point rarely supports a strong conclusion without considering trend, variability, and context.
BChoice BThis is weaker because the label does not answer the Threats to internal validity decision point or test Measurement quality and procedural integrity.
CChoice CA familiar protocol is not enough unless it matches the assessed variables and the current decision question.
Study tags
Measurement quality and procedural integrityThreats to internal validityvalidityreliability
Related concept pages
Turn this into a study plan
If this question felt difficult, practice a short drill from Experimental Design and use the review page to turn missed items into a weak-area plan.
Practice interactively
Try more BCBA scenario questions in the interactive practice mode, then use review tools to track missed domains and flagged items.