Research · Evidence and Explanation

Laboratory Effects and Real-World Behaviour

Controlled experiments can reveal genuine causal relations without, by themselves, establishing how strongly, frequently or consequentially those relations operate under the conditions of everyday life.

By Yona Ole Lobulu ·

Research note15 min readD2.9

Topic
Evidence and Explanation
Read first
2 pieces should be read before this one
Reading time
About 15 minutes of reading
Difficulty
Advanced reading: this page assumes a fair amount of earlier reading

The question

When, and under what conditions, can effects demonstrated in controlled research settings be expected to describe behaviour in the complexity of everyday life?

Definition

Experimental demonstration is evidence that an effect, causal relation or process operates under the conditions created by a study. Ecological expression is how that demonstrated relation appears under the conditions relevant to the target behaviour beyond the controlled demonstration. Ecological expression is Library-level descriptive language rather than universally standardised methodological terminology.

Imagine a tightly controlled experiment.

Participants are assigned to different conditions. One feature of the situation is manipulated. A measurable behaviour changes.

Suppose the design is strong enough to support a causal conclusion:

changing X affected Y under these study conditions.

That is a meaningful scientific result.

But it answers a narrower question than people often assume.

It tells us something about what happened under the conditions that were created and measured. It does not, by itself, tell us how strongly the same causal relation will appear in ordinary life, how often the relevant conditions arise, whether other influences amplify or weaken the effect, or whether the effect is large enough to matter practically.

Demonstrating that a process can influence behaviour is not the same as establishing how much that process explains outside the conditions of the demonstration.

That distinction does not weaken experimental science.

It clarifies what the evidence has established—and what still needs to be inferred.

Why Simplifying Reality Can Improve Science

Everyday behaviour occurs under many simultaneous influences.

Goals compete. Environments vary. Prior learning matters. Social relationships change what actions are available. Bodily states fluctuate. Several causes can act at once.

That complexity is part of the phenomenon.

It is also part of what makes causal explanation difficult.

Controlled experiments deliberately simplify this problem. Researchers may standardise instructions, control timing, restrict environmental variation, manipulate one factor while keeping others relatively stable, or remove competing influences.

When that simplification successfully isolates the relation being tested, it can increase causal clarity.

A study may therefore be artificial because it has been engineered to answer a specific question.

If the question is:

Can changing X affect Y?

then arranging conditions that make the influence of X identifiable can be scientifically powerful.

This is one reason Correlation, Prediction, Causation and Mechanism distinguishes causal evidence from mere association.

But control is not a guarantee of validity.

A controlled study can still suffer from poor measurement, failed manipulation, attrition, bias or other design problems.

Control provides leverage.

The quality of the inference still depends on how well the study actually uses it.

Internal Validity and Generalisation Answer Different Questions

A strong experiment can provide good evidence about what happened under the conditions actually studied.

That is the source problem:

What does the evidence support here?

Generalisation asks another question:

What does this evidence support somewhere else, or under different conditions?

That is the target problem.

Strong causal identification within a study does not automatically establish strong generalisation beyond it.

This is not a claim that internal and external validity must trade off.

They concern different inferential questions, and a study can sometimes support both well.

Nor does experimental control automatically damage generalisation.

The point is narrower: successfully answering the source question does not automatically answer the target question.

A study may convincingly establish that X affects Y under one set of conditions while leaving uncertainty about whether the same causal relation remains present elsewhere, whether its direction stays the same, whether its magnitude changes, whether the causal conditions occur frequently enough to matter, whether other influences modify its expression, and whether the resulting effect has practical consequence.

Generalisation therefore requires additional justification.

Artificial Does Not Mean Irrelevant

Laboratory experiments are often criticised because they are artificial.

Sometimes the criticism identifies something important.

But artificiality by itself is not enough.

A study does not have to reproduce everyday life in full to reveal a causal relation that also matters beyond the laboratory.

A study does not have to reproduce everyday life in full to reveal a process that matters beyond the laboratory.

Suppose an experiment uses a highly constrained attention task.

No normal workday looks exactly like it.

Yet the experiment may still reveal a genuine relation between competing information and performance.

The useful question is therefore not:

Does this experiment look like everyday life?

It is:

Which features of the experimental situation matter for the relation being studied, and are those features relevant to the target conditions?

Artificiality becomes a threat to generalisation when the features changed by the artificial setting are themselves causally relevant to the claim being transported.

That is a much more precise criticism than:

It happened in a laboratory, so it is not real.

Realistic Does Not Mean Automatically Better

The opposite shortcut is equally misleading.

Suppose a study takes place in an ordinary school, workplace or public environment.

The setting may resemble the target context more closely.

That can increase relevance to those particular conditions.

But realism does not automatically strengthen causal identification.

A naturalistic setting may introduce more uncontrolled variation, confounding, implementation differences or measurement difficulties.

Resemblance to everyday life and strength of causal identification are different properties.

A field study may tell us a great deal about behaviour under the conditions actually observed while leaving more uncertainty about why the effect occurred.

A controlled experiment may answer a narrower causal question more cleanly while leaving more uncertainty about cross-setting expression.

Neither design is automatically superior.

They provide different kinds of evidential leverage.

And a "real-world" study is still conducted somewhere.

Evidence from one workplace does not automatically generalise to another workplace. Evidence from one school does not automatically travel to every school.

Field evidence can increase relevance to the conditions studied without automatically establishing generalisation beyond them.

The move from laboratory to everyday life is therefore one instance of a broader source-to-target problem.

Generalisation can fail between two laboratories, two field settings, or any other conditions that differ in causally relevant ways.

From Experimental Demonstration to Ecological Expression

This node distinguishes two evidential achievements.

Experimental demonstration. Evidence that an effect, causal relation or process operates under the conditions created by the study.

Ecological expression. How that relation appears under conditions relevant to the target behaviour outside the controlled demonstration.

Ecological expression is a Library-level descriptive phrase, not a claim that this is one standard technical term across scientific fields.

The distinction allows us to say two things at once:

The experimentally demonstrated causal relation can be real.

and:

Its expression under other conditions can remain uncertain.

Generalisation can concern several different features of a finding.

We may ask whether the causal relation remains present, whether the direction is preserved, whether the magnitude changes, whether relevant conditions occur often enough for the effect to matter, whether the same moderators remain important, and whether the result has comparable practical consequences.

A finding does not have to generalise identically in every respect.

Experimental demonstration and ecological expression are different evidential achievements.

The laboratory may establish that a process can operate.

Additional inference is needed to determine how that process expresses under the target conditions.

What Changes When the Conditions Change?

Everyday environments may reintroduce influences that were controlled, standardised or absent in an experiment.

These may include competing goals, social relations, prior learning, environmental constraints, changing bodily states, fluctuating attention, repeated interactions and different incentives.

But none of these should be assumed to modify every laboratory effect.

Whether changed conditions alter the effect is an empirical question.

A demonstrated effect might remain similar outside the study.

It might become smaller.

It might become larger.

It might become more variable or appear only under particular conditions.

There is no general rule that laboratory effects shrink in ordinary life.

Effect magnitude across settings is an empirical question.

This matters because "real-world complexity" is sometimes described as if it merely adds noise around an underlying laboratory effect.

Sometimes it does add noise.

But sometimes the variables restored outside the laboratory interact with the causal relation itself.

If so, the target setting is not merely making the same effect harder to see.

It is changing the causal conditions under which the effect is expressed.

That connects directly to the earlier architecture of Causes, Conditions, Triggers and Constraints.

Context is not a generic explanation.

The scientific question is which changed condition matters, and how.

Boundary Conditions Are Part of the Explanation

Suppose an effect appears reliably under one set of conditions but changes under another.

One possibility is that the relation has a genuine boundary condition.

Perhaps the effect depends on timing, demand, social context, environmental structure or another moderator.

If evidence supports that dependence, the causal claim becomes more precise.

Instead of:

X influences Y.

we may be able to say:

X influences Y under conditions A and B, but differently under C.
Knowing where an effect changes can be part of understanding the effect.

But the evidential standard matters.

A condition becomes a boundary condition only when evidence supports that the causal relation changes with that condition; an unexplained discrepancy is not enough.

A finding may fail to transport because of measurement differences, implementation failure, statistical error, design problems or changes in operationalisation.

Those possibilities must be separated from true conditionality.

Likewise, a weaker effect in a target setting does not automatically show that the source-study relation was false.

A weaker effect outside the laboratory may reflect a boundary condition rather than show that the original process was unreal.

Target-setting evidence can also force revision of how the original finding is interpreted.

If repeated evidence outside the laboratory conflicts with the exported explanation, researchers may need to reconsider the assumed causal process, relevant moderators, measurement or transport assumptions.

The relationship between source and target evidence therefore runs both ways.

Ecological Validity Is Not Surface Realism

The term ecological validity has multiple historical and contemporary uses.

This node does not impose one universal technical definition.

For this node, the operative issue is whether the evidence supports the behavioural claim being made under the target conditions.

That cannot be reduced to whether the study looks realistic.

Surface resemblance is not the same as evidential relevance.

A realistic-looking study can omit the feature that actually matters for the target causal relation.

An artificial-looking study can preserve that feature very well.

The more useful questions are which environmental features matter for the relation, whether those features were represented or manipulated, which relevant forms of variation were restricted, how the target environment differs, and whether those differences are causally important.

This is close to the logic behind representative design: if researchers want to generalise across environments, the variation in those environments may need methodological representation.

Representative design is one influential approach to this problem, not a universal solution to external validity.

Other approaches may use different evidence and assumptions.

The deeper principle remains:

A claim about generalisation must be tied to the conditions toward which the claim is intended.

A Process Can Be Real Without Being Dominant

Suppose a strong experiment establishes that changing X causally changes Y.

That establishes a causal effect under the studied conditions.

It does not automatically establish a fully characterised mechanism.

Mechanistic claims require additional evidence about how the effect is produced.

This distinction matters because effect, causal relation, process and mechanism are not interchangeable.

Where the evidence genuinely supports a mechanistic account, that mechanism can still be real without being a dominant determinant of everyday behaviour.

A demonstrated causal effect need not establish a fully characterised mechanism.

And more generally:

Evidence that a process can matter is not yet evidence about how much it matters.

One reason is exposure.

A laboratory may deliberately create the causal conditions necessary for an effect.

Outside the study, those conditions may occur frequently—or rarely.

The size of an effect when its causal conditions are present and the frequency with which those conditions arise in everyday life are separate quantities.

This distinction can radically change real-world importance.

A large conditional effect may contribute little to ordinary behaviour if the relevant conditions are rare.

A smaller effect may matter more if it occurs frequently or accumulates.

Other causes matter too.

A causal process can be genuine while accounting for only a small part of the variation in ordinary behaviour.

Where a mechanistic claim is justified:

A mechanism can be real without being dominant.

Likewise, experimental detectability does not settle practical importance.

Detecting an effect and establishing its practical importance are different inferential tasks.

The fuller distinction belongs to Statistical Significance and Practical Importance.

Replication and Generalisation Are Different Questions

Suppose a laboratory finding is reproduced repeatedly.

That matters.

Successful replication can increase confidence that the finding is not a one-study accident.

But replication and generalisation are different questions, although the same study programme can sometimes inform both.

Replication asks whether a finding recurs; generalisation asks whether it travels.

If many studies recreate broadly similar conditions, repeated success can strengthen confidence in the effect under that family of conditions while leaving its behaviour elsewhere uncertain.

But replication programmes can also deliberately vary samples, settings, operationalisations and procedures.

When they do, they may provide evidence about both recurrence and generalisation.

The distinction is therefore conceptual rather than a rigid division between types of studies.

A finding can reproduce under one family of conditions while remaining uncertain under another.

And contextual variation in a target setting does not automatically imply replication failure in the source conditions.

Broader questions of robustness, replication and accumulated confidence belong to Replication, Robustness and Scientific Confidence.

Different Methods Can Answer Different Parts of the Problem

No single research setting needs to answer every scientific question.

A controlled experiment may provide strong evidence that changing X can causally affect Y.

A field study may show how the relation behaves amid ordinary environmental demands.

Observational evidence may help establish how often relevant conditions and outcomes occur outside deliberate manipulation.

Longitudinal evidence may clarify how relations unfold over time.

These methods differ in both strengths and vulnerabilities.

The aim is not to rank them universally.

It is to match evidence to the question.

Different methods can answer different parts of the same explanatory problem.

This is why triangulation can be useful.

Triangulation is not merely several studies reaching the same conclusion.

Convergence is especially informative when the methods involved rely on meaningfully different assumptions or are vulnerable to different sources of bias.

Convergence across methods with different assumptions and vulnerabilities can strengthen an inference.

Agreement among studies sharing the same weakness may add less confidence than their number suggests.

Disagreement can also be productive.

It can reveal possible boundary conditions, measurement differences, implementation differences, bias or unresolved causal structure.

No single method needs to carry the entire explanatory burden.

Generalisation Is Another Inference to Justify

When researchers move from:

this relation was demonstrated here

to:

this relation describes behaviour there,

they make an additional inferential move.

Generalisation is not what remains after an experiment; it is another inference to justify.

That justification does not always require a second field experiment.

It may draw on study design, theory, knowledge about causal structure, evidence from target settings, cross-setting studies and combinations of methods.

But the target must be specified.

A claim about generalisation is incomplete until the target of generalisation is specified.

Generalisation to what? Another laboratory? An ordinary workplace? Repeated daily exposure? A different implementation? Another population? Another social environment?

The source and target may differ in many ways.

The important question is which differences matter for the relation being transported.

What is being transported must also be clear.

Is the claim about a causal effect, an association, a frequency, a measurement relation or a mechanistic account?

This node is primarily concerned with experimentally demonstrated causal effects, but the broader principle applies to other empirical relations too.

A useful conceptual structure is:

Source. Where and under what conditions was the evidence generated?

Target. Where and under what conditions is the claim being applied?

Difference. What changes between them?

Relevance. Which of those differences matter for the empirical relation?

Target claim. What part of the original finding is expected to travel?

This is not a formal transportability procedure.

It is an interpretive discipline.

Generalisation can also be partial.

The direction of an effect may travel while its magnitude changes.

A process may operate in both environments while the conditions needed to evoke it occur much less frequently in one.

A finding may therefore generalise in one respect and not another.

This also distinguishes this node from Group Averages and Individual Lives.

D2.6 asks:

What does group-level evidence allow us to infer about an individual?

This node asks:

What does evidence under one set of conditions allow us to infer under another?
Generalising across people and generalising across settings are related but different questions.

They can occur together.

They should not be confused.

What Exactly Travels Beyond the Laboratory?

Return to the opening experiment.

A controlled manipulation changed behaviour, and suppose the causal interpretation is sound.

The experiment has established something real under the conditions studied.

The remaining question is what part of that result can be carried into the target setting.

Does the causal relation remain present?

Does its magnitude change?

Do the relevant causal conditions occur often enough for the effect to matter?

Do other influences alter its expression?

Those questions require evidence beyond the bare fact that the laboratory effect occurred.

A laboratory effect can establish that a process can operate without establishing how strongly, reliably or consequentially it operates in everyday life.

Controlled research can reveal causal structure that would otherwise be difficult to isolate.

Evidence from less controlled settings can show how that structure expresses when conditions change—and can sometimes revise how the original laboratory finding should be understood.

Neither task replaces the other.

The strongest explanations connect them.

The useful question is therefore not simply:

Does this laboratory finding generalise to real life?

It is:

Which parts of the finding generalise—and under what conditions?

Behind this page

The claims this research note makes, the evidence behind them, and the limits it accepts.

Evidence status

High confidence

Strongly supported, though resting on synthesis or principle rather than a single decisive body of evidence.

Claims

  1. Causal identification and generalisation are distinct inferential problems

    High confidence

    What this does not assert: A study can answer the first well while leaving the second unresolved.

  2. Representative sampling of situations can improve environmental generalisation

    High confidence

    What this does not assert: Conditional; representative design is one influential approach, not a universal solution to external validity.

  3. Genuine boundary conditions can refine causal explanation

    High confidence

    What this does not assert: Conditional; the dependence must be demonstrated, not inferred from an unexplained discrepancy.

  4. Laboratory and field evidence can complement one another

    High confidence

    What this does not assert: Conditional; each carries different strengths and vulnerabilities, and neither ranks above the other universally.

  5. Target-domain evidence can refine or revise interpretations derived from source studies

    High confidence

    What this does not assert: Conditional; source and target evidence constrain one another in both directions.

  6. Convergence across differently biased methods can strengthen inference

    High confidence

    What this does not assert: Conditional; agreement among methods sharing the same weakness adds less than study count suggests.

  7. Experimental demonstration and ecological expression are different evidential achievements

    Canonical inference

    What this does not assert: A Library-level synthesis about evidence, expressed in Library-level descriptive terminology.

  8. A process can be experimentally real while its everyday expression remains uncertain

    Canonical inference

    What this does not assert: Uncertainty about expression is not doubt about the demonstrated relation.

  9. Evidence that a process can matter is not yet evidence about how much it matters

    Canonical inference

    What this does not assert: Existence, dominance and practical importance are separate questions.

  10. Generalisation is another inference to justify

    Canonical inference

    What this does not assert: It is not what remains once an experiment is complete.

  11. Effect magnitude across settings is an empirical question

    Canonical inference

    What this does not assert: No default direction of change outside the laboratory is canonical.

  12. Experimental control can provide causal leverage without guaranteeing validity

    High confidence

    What this does not assert: Measurement, manipulation, attrition and bias still govern the quality of the inference.

  13. The size of an effect under its causal conditions and the frequency of those conditions are separate quantities

    Canonical inference

    What this does not assert: A large conditional effect may contribute little where its conditions are rare.

  14. A demonstrated causal effect need not establish a fully characterised mechanism

    Canonical inference

    What this does not assert: Mechanistic claims require additional evidence about how the effect is produced.

  15. Generalising across people and generalising across settings are related but different questions

    Canonical inference

    What this does not assert: Population-to-individual inference remains D2.6's territory.

  16. Artificiality alone does not make a finding irrelevant

    High confidence

    What this does not assert: It threatens generalisation only when the altered features are causally relevant to the target claim.

  17. Surface realism is not a sufficient criterion for cross-setting inference

    High confidence

    What this does not assert: A realistic-looking study can omit the feature that matters for the relation.

  18. Source-to-target generalisation requires additional justification

    High confidence

    What this does not assert: The justification need not be a second field experiment.

  19. Causal effects can differ across settings when causally relevant conditions differ

    High confidence

    What this does not assert: No direction of change is assumed; effects may hold, weaken, strengthen or become conditional.

  20. A weaker target-setting effect does not automatically negate a valid source-study effect

    High confidence

    What this does not assert: Transport failure may reflect measurement, implementation or design differences rather than an unreal process.

  21. Replication and generalisation are distinguishable questions

    High confidence

    What this does not assert: One research programme can nonetheless inform both.

  22. Generalisation requires a specified target

    High confidence

    What this does not assert: A generalisation claim is incomplete until setting, conditions and transported aspect are named.

Where to go from here

Next published piece

Measurement Changes the System

Measurement can sometimes do more than record human behaviour: observation, assessment and monitoring can become causal conditions influencing what happens next.

Continue through the Library →See where this sits in the graph →

Back to the Library →