Sampling Techniques

Why This Matters

In AP Research, your methodology section lives or dies by your sampling choices. When you select participants, data points, or cases for your study, you're making a fundamental decision about external validity—whether your findings can be generalized beyond your specific sample. The College Board evaluates whether you understand why you chose your sampling method, not just what method you used. A well-justified sampling strategy demonstrates methodological sophistication; a poorly chosen one undermines even the most compelling findings.

Every sampling technique involves trade-offs between representativeness, feasibility, and precision. You're being tested on your ability to match the right technique to your research question, acknowledge limitations honestly, and explain how your sample affects the scope of your conclusions. Don't just memorize definitions—know which techniques allow for statistical inference, which introduce systematic bias, and when practical constraints justify non-probability approaches. Your defense panel will ask about these choices.

---

Probability Sampling: The Foundation of Statistical Inference

Probability sampling methods give every member of your population a known, non-zero chance of selection. This mathematical property is what allows you to calculate margins of error, confidence intervals, and p-values—the backbone of quantitative generalization.

Simple Random Sampling

• Every population member has an equal selection probability—this is the gold standard for eliminating selection bias and the baseline against which other methods are compared
• Implementation requires a complete sampling frame (a list of all population members), which you'll generate using random number generators or lottery methods
• Enables direct generalization to the entire population, making it ideal when your research question demands broad applicability

Stratified Sampling

• Divides the population into homogeneous subgroups (strata) before random selection—think demographics, regions, or any characteristic relevant to your research question
• Increases precision by reducing within-group variability, often producing tighter confidence intervals than simple random sampling with the same sample size
• Guarantees representation of key subgroups, critical when you need to make comparisons across categories (e.g., comparing outcomes by grade level or geographic region)

Systematic Sampling

• Selects every $k$th member after a random starting point—where $k$ equals population size divided by desired sample size
• Simpler to implement than simple random sampling when you have an ordered list but no digital sampling frame
• Vulnerable to periodicity bias—if your list has a hidden pattern matching your sampling interval, you'll systematically over- or under-represent certain groups

Cluster Sampling

• Randomly selects entire groups (clusters) rather than individuals—typically geographic units like schools, neighborhoods, or clinics
• Dramatically reduces costs and logistics when populations are large and dispersed, making large-scale studies feasible
• Trades precision for practicality—clusters are rarely perfectly homogeneous, so variability increases compared to simple random sampling

---

Non-Probability Sampling: When Randomization Isn't Possible

Non-probability methods don't give every population member a known chance of selection. This means you cannot calculate true margins of error or make statistical inferences to the broader population. However, these methods are often essential for qualitative research, exploratory studies, or when no sampling frame exists.

Convenience Sampling

• Selects participants based on accessibility and availability—whoever is easiest to reach becomes your sample
• Fast and inexpensive but produces systematic bias toward accessible populations (e.g., college students, online users)
• Severely limits generalizability—acknowledge this limitation explicitly in your methodology and scope your conclusions accordingly

Purposive Sampling

• Deliberately selects participants with specific characteristics relevant to your research question—you're choosing for a reason
• Essential for qualitative research seeking depth over breadth, such as case studies or phenomenological investigations
• Requires transparent justification of your selection criteria; your defense panel will ask why these participants and not others

Quota Sampling

• Sets predetermined quotas for subgroup representation but fills those quotas non-randomly—the researcher chooses who fits each category
• Mimics stratified sampling's structure without the randomization, making it faster but introducing selection bias
• Common in market research and journalism but insufficient for studies requiring statistical inference

Snowball Sampling

• Uses existing participants to recruit additional participants through their social networks—one referral leads to another
• Invaluable for hidden or hard-to-reach populations where no sampling frame exists (e.g., undocumented immigrants, underground communities)
• Introduces network bias—your sample will overrepresent well-connected individuals and underrepresent isolates

Voluntary Response Sampling

• Participants self-select into the study, typically by responding to open calls, online surveys, or polls
• Highly susceptible to response bias—people with strong opinions (positive or negative) are more likely to participate
• Produces systematically unrepresentative samples; avoid this method unless you explicitly study motivated respondents

---

Sampling Variations: Fine-Tuning Your Approach

These techniques modify or combine basic methods to address specific research challenges. Understanding when to apply these variations demonstrates methodological sophistication.

Proportional Sampling

• Draws from subgroups in proportion to their population size—if 30% of your population is female, 30% of your sample should be female
• Ensures accurate representation when subgroup sizes vary significantly
• Standard practice within stratified sampling unless you have specific reasons to deviate

Disproportional Sampling

• Deliberately oversamples smaller subgroups to ensure adequate cases for subgroup analysis
• Requires statistical weighting during analysis to restore proportionality for population-level estimates
• Essential when studying minority populations or rare characteristics that would otherwise yield too few cases

Multistage Sampling

• Combines multiple sampling methods in sequential stages—typically cluster sampling first, then random sampling within selected clusters
• Balances efficiency and representativeness for large, complex populations like national surveys
• Compounds sampling error at each stage, requiring larger overall samples to maintain precision

Random Digit Dialing

• Generates random telephone numbers to reach households without requiring a pre-existing list
• Historically important for survey research but increasingly problematic due to mobile phones, caller ID, and declining response rates
• Demonstrates the principle that sampling methods must adapt to changing population characteristics

---

The Probability vs. Non-Probability Distinction

This is the most fundamental division in sampling methodology. Your choice here determines what kinds of claims your research can support.

Probability Sampling (Category)

• Defines methods where every population member has a known, calculable selection probability—this mathematical property enables statistical inference
• Includes simple random, stratified, systematic, and cluster sampling as well as their combinations
• Required for quantitative studies claiming generalizable findings with confidence intervals and significance tests

Non-Probability Sampling (Category)

• Defines methods where selection probabilities are unknown or zero for some members—no mathematical basis for calculating sampling error
• Includes convenience, purposive, quota, snowball, and voluntary response sampling
• Appropriate for qualitative research, pilot studies, and exploratory work but requires explicit acknowledgment of generalizability limits

---

Quick Reference Table

---

Self-Check Questions

1. Your research question requires comparing outcomes across four demographic subgroups with statistical precision. Which two sampling methods would best ensure adequate representation of each subgroup, and how do they differ in their approach?

2. A classmate plans to study attitudes among undocumented immigrants but has no sampling frame. Which sampling technique is most appropriate, and what limitation must they acknowledge in their methodology section?

3. Compare and contrast stratified sampling and cluster sampling: both divide populations into groups, but how does what happens next differ, and what does each method prioritize?

4. You've conducted a study using convenience sampling and found statistically significant results. Why might your defense panel challenge your conclusions, and how should you address this in your limitations section?

5. An FRQ presents a scenario where a researcher uses systematic sampling on an alphabetized class roster. Under what conditions would this produce a representative sample, and what hidden pattern could introduce bias?