upgrade
upgrade

🔬Communication Research Methods

Key Concepts of Experimental Research Designs

Study smarter with Fiveable

Get study guides, practice questions, and cheatsheets for all your subjects. Join 500,000+ students with a 96% pass rate.

Get Started

Why This Matters

Experimental design is the backbone of causal research in communication studies—it's how we move beyond "these two things are related" to "this actually causes that." You're being tested on your ability to distinguish between design types, understand their trade-offs, and recommend the right approach for different research scenarios. The core tensions you'll encounter repeatedly are internal validity vs. external validity, control vs. realism, and statistical power vs. practical constraints.

Don't just memorize design names. Know what problem each design solves, what it sacrifices in the process, and when a researcher would choose one over another. FRQs love asking you to justify design choices or identify threats to validity—so think like a researcher making strategic decisions, not a student reciting definitions.


Foundational Design Types: The Control Question

The most fundamental distinction in experimental research is how much control the researcher has over participant assignment. This determines whether you can make causal claims with confidence or must hedge your conclusions.

True Experimental Design

  • Random assignment is the defining feature—participants have an equal chance of being placed in any condition, which distributes confounding variables evenly across groups
  • Establishes cause-and-effect relationships by isolating the independent variable as the only systematic difference between groups
  • Maximizes internal validity but may sacrifice external validity if the controlled conditions feel artificial to participants

Quasi-Experimental Design

  • Uses pre-existing groups instead of random assignmentcomparing communication styles across different university departments, for example
  • Essential for real-world research where randomization is unethical, impractical, or impossible
  • Selection bias is the primary threat—differences between groups may exist before the study begins, making causal claims weaker

Compare: True experimental vs. quasi-experimental design—both manipulate an independent variable, but only true experiments use random assignment. If an FRQ asks about studying workplace communication interventions across existing teams, quasi-experimental is your answer; if it asks about maximizing causal certainty, go with true experimental.


Measurement Timing: When Do You Assess?

How and when you measure participants shapes what conclusions you can draw. Pre-testing can strengthen your analysis but may also contaminate your results.

Pre-Test/Post-Test Control Group Design

  • Measures participants before and after intervention—the pre-test establishes a baseline for comparison
  • Control group receives no treatment, allowing researchers to attribute post-test differences to the intervention rather than external factors
  • Detects change over time but introduces the risk that the pre-test itself sensitizes participants to the treatment

Solomon Four-Group Design

  • Adds two groups without pre-tests to detect whether pre-testing itself affects outcomes—did participants change because of the treatment or because the pre-test primed them?
  • Four groups total: pre-test + treatment, pre-test + no treatment, no pre-test + treatment, no pre-test + no treatment
  • Gold standard for controlling pre-test effects but requires significantly more participants and resources

Compare: Pre-test/post-test vs. Solomon four-group—both use control groups, but Solomon specifically isolates pre-test sensitization effects. When an exam question mentions concerns about testing effects or reactivity, Solomon is the design that addresses this.


Participant Assignment: Who Experiences What?

The decision about whether participants experience one condition or multiple conditions affects everything from sample size requirements to the types of bias you'll encounter.

Between-Subjects Design

  • Each participant experiences only one conditionGroup A sees persuasive message version 1, Group B sees version 2, and never the two shall meet
  • Eliminates carryover effects since participants can't be influenced by prior exposure to other conditions
  • Requires larger sample sizes because you need enough participants in each group to detect effects statistically

Within-Subjects Design

  • Every participant experiences all conditions, serving as their own control group
  • Increases statistical power dramatically by eliminating individual differences as a source of variability
  • Order effects are the major threat—fatigue, practice, or sensitization from earlier conditions can contaminate later responses

Repeated Measures Design

  • A specific type of within-subjects design where the same participants are measured multiple times across conditions or time points
  • Reduces error variance by using participants as their own baseline, making it easier to detect true treatment effects
  • Counterbalancing is essential—varying the order of conditions across participants helps control for sequence effects

Compare: Between-subjects vs. within-subjects—the trade-off is carryover effects vs. sample size. Between-subjects needs more participants but avoids contamination; within-subjects is more efficient but requires careful counterbalancing. Know which threats each design faces.


Complexity and Efficiency: Testing Multiple Variables

Sometimes researchers need to examine how multiple factors work together. These designs allow for more sophisticated questions about interaction effects.

Factorial Design

  • Tests two or more independent variables simultaneouslya 2×2 design might examine message type (emotional vs. rational) crossed with source credibility (high vs. low)
  • Reveals interaction effects that single-variable designs would miss—maybe emotional appeals only work when source credibility is high
  • Efficient use of participants since every subject provides data relevant to multiple hypotheses in one study

Compare: Factorial vs. single-factor designs—factorial designs answer more complex questions about how variables combine, but they require careful interpretation. If an FRQ describes a study examining how two message features work together, factorial design is the answer.


Research Setting: Control vs. Realism

Where you conduct your experiment creates a fundamental trade-off between the precision of your measurements and the applicability of your findings to the real world.

Laboratory Experiments

  • Conducted in controlled environments where researchers can isolate variables and eliminate extraneous influences
  • Maximizes internal validity through precise manipulation and measurement of variables
  • May lack ecological validityparticipants watching political ads in a sterile lab may respond differently than when scrolling through social media at home

Field Experiments

  • Conducted in natural settings—workplaces, classrooms, online platforms, public spaces
  • Enhances ecological validity because participants behave more naturally in familiar environments
  • Sacrifices control since researchers cannot eliminate all extraneous variables or ensure consistent conditions

Compare: Laboratory vs. field experiments—this is the classic internal vs. external validity trade-off. Lab experiments tell you if something can work under ideal conditions; field experiments tell you whether it actually works in the real world. Strong research programs often use both.


Quick Reference Table

ConceptBest Examples
Random assignment (causal claims)True experimental design
Pre-existing groups (real-world constraints)Quasi-experimental design
Controlling for pre-test effectsSolomon four-group design, pre-test/post-test control group
Eliminating carryover effectsBetween-subjects design
Maximizing statistical powerWithin-subjects design, repeated measures design
Testing interaction effectsFactorial design
Maximizing internal validityLaboratory experiments, true experimental design
Maximizing ecological validityField experiments

Self-Check Questions

  1. A researcher wants to study how a new crisis communication training affects employee responses, but company policy requires using intact departments rather than randomly assigning individuals. Which design type is appropriate, and what validity threat should the researcher address?

  2. Compare within-subjects and between-subjects designs: What specific threat does each design face, and how do researchers typically mitigate these threats?

  3. A study finds that a persuasive message only changes attitudes when participants completed a pre-test questionnaire first. Which design would have detected this problem, and how does it work?

  4. If an FRQ asks you to design a study examining how both message framing (gain vs. loss) and messenger identity (celebrity vs. expert) affect health behavior intentions, which design allows you to test these factors efficiently and examine their combined effects?

  5. A communication researcher finds strong effects for a media literacy intervention in the lab but no effects when the same intervention is tested in actual classrooms. Explain this discrepancy using the concepts of internal and external validity.