Evidence-Type Competition: When Can Interventional Data Teach Language Models Causal Direction?

In 30 Sekunden

Was passiert ist

Research shows language models trained on interventional causal data still copy observational correlations at inference time, contradicting assumptions about causal learning.

Warum es zählt

Matters for engineers building systems requiring reliable causal reasoning, especially when training data mixes observational and interventional examples.

Achtung

The findings use synthetic environments with Simpson's paradox; real-world applicability and scaling behavior beyond 0.93B parameters remain unclear.