Nakamura, Kentaro, Adam Breuer, Michael H. Crespin, Bryce J. Dietrich, and Kosuke Imai. (2026). ``Causal Inference with Video Features as Treatments.''

Abstract

We develop the first statistical methodology for causal inference with video features as treatments. Video is the most engaging content modality on the internet. A central causal question is how audience reactions change in response to treatment features that unfold over the course of a video. Unfortunately, standard causal inference methods are not applicable because confounding features are latent, high-dimensional, and dynamically related to both the treatment sequence and the outcome trajectory. To address these challenges, we first reproduce each video using a deep generative model and leverage the model’s internal representations as learned, low-dimensional summaries of video content for causal estimation. We then establish that the average potential-outcome trajectory under dynamic stochastic interventions is nonparametrically identified. Lastly, we propose a consistent and asymptotically normal estimator based on a longitudinal neural network architecture. We empirically validate our approach by constructing a new causal inference benchmark consisting of 10,000 Super Mario Bros. levels played by fixed Mario AI agents, where ground-truth causal effects are known by construction. Finally, we apply our method to television advertisements from the 2020 U.S. presidential campaign and find that increasing the probability of a candidate appearing over time leads to higher average viewer evaluations. With the proposed methodology, researchers can ask which visual features, appearing at which points in a video, influence audience responses, while benchmarking new methods against datasets with known ground-truth causal effects.

Software

gpi: Gen-AI Powered Inference — GitHub / PyPI

Related Papers

Imai, Kosuke and Kentaro Nakamura ``Causal Inference with Generative Artificial Intelligence: Application to Texts as Treatments.'' Journal of the American Statistical Association, Forthcoming.
Chasalow, Kyla, Noah Dasanaike, and Kosuke Imai (2026). ``Probabilistic Race and Ethnicity Prediction Using Group-Specific Name Lists.''
Imai, Kosuke and Kentaro Nakamura (2026). ``Leveraging generative AI for causal inference with unstructured data.'' Proceedings of the National Academy of Sciences, Vol. 123, No. 36, e2530532123.
Nakamura, Kentaro and Kosuke Imai (2026). ``GenAI Powered Dynamic Causal Inference with Unstructured Data.''
Dasanaike, Noah and Kosuke Imai (2026). ``Using Embedding Models to Improve Probabilistic Race Prediction.''
Shi, Wenqi, Kosuke Imai, and Yi Zhang (2026). ``Privacy-preserving Meta-analysis through Low-Rank Basis Hunting.''
Breuer, Adam, Bryce J. Dietrich, Michael H. Crespin, Matthew Butler, J.A. Pyrse, Kosuke Imai (2025). ``Using AI to Summarize US Presidential Campaign TV Advertisement Videos, 1952-2012.'' Scientific Data, Vol. 12, No. 1552.
Goplerud, Max, Kosuke Imai, Nicole E. Pashley (2025). ``Estimating Heterogeneous Causal Effects of High-Dimensional Treatments: Application to Conjoint Analysis.'' Annals of Applied Statistics, Vol. 19, No. 2 (June), pp. 866-888.
Imai, Kosuke and Michael Lingzhi Li (2025). ``Statistical Inference for Heterogeneous Treatment Effects Discovered by Generic Machine Learning in Randomized Experiments.'' Journal of Business & Economic Statistics, Vol. 43, No. 1, pp. 256-268.
Jia, Zeyang, Kosuke Imai, and Michael Lingzhi Li (2025). ``Cramming Contextual Bandits for On-policy Statistical Evaluation.''
Ham, Dae Woong, Kosuke Imai, and Lucas Janson (2024). ``Using Machine Learning to Test Causal Hypotheses in Conjoint Analysis.'' Political Analysis, Vol. 32, No. 3 (July), pp. 329-344.
Li, Michael Lingzhi and Kosuke Imai (2024). ``Neyman Meets Causal Machine Learning: Experimental Evaluation of Individualized Treatment Rules.'' Journal of Causal Inference, Vol 12, No. 1, pp. 1-20. Special Issue on Neyman (1923) and its influences on causal inference
Eshima, Shusei, Kosuke Imai, and Tomoya Sasaki (2024). ``Keyword-Assisted Topic Models.'' American Journal of Political Science, Vol. 68, No. 2 (April), pp. 730-750.
Tarr, Alexander, June Hwang, and Kosuke Imai (2023). ``Automated Coding of Political Campaign Advertisement Videos: An Empirical Validation Study.'' Political Analysis, Vol. 31, No. 4 (October), pp. 554-574.
Imai, Kosuke and Michael Lingzhi Li (2023). ``Experimental Evaluation of Individualized Treatment Rules.'' Journal of the American Statistical Association, Vol. 118, No. 541, pp. 242-256.
Ning, Yang, Sida Peng, and Kosuke Imai (2020). ``Robust Estimation of Causal Effects via High-Dimensional Covariate Balancing Propensity Score.'' Biometrika, Vol. 107, No. 3 (September), pp. 533-554.
Kim, In Song, Steven Liao, and Kosuke Imai (2020). ``Measuring Trade Profile with Granular Product-level Trade Data.'' American Journal of Political Science, Vol. 64, No. 1 (January), pp. 102-117.
Egami, Naoki, and Kosuke Imai (2019). ``Causal Interaction in Factorial Experiments: Application to Conjoint Analysis.'' Journal of the American Statistical Association, Vol. 114, No. 526 (June), pp. 529-540.
Svyatkovskiy, Alexey, Kosuke Imai, Mary Kroeger, and Yuki Shiraito (2016). ``Large-scale text processing pipeline with Apache Spark.'' IEEE International Conference on Big Data, Washington, DC, pp. 3928-3935.
Imai, Kosuke and Marc Ratkovic (2013). ``Estimating Treatment Effect Heterogeneity in Randomized Program Evaluation.'' Annals of Applied Statistics, Vol. 7, No. 1 (March), pp. 443-470. Winner of the Tom Ten Have Memorial Award. Reprinted in Advances in Political Methodology, R. Franzese, Jr. ed., Edward Elger, 2017.
Imai, Kosuke, and Aaron Strauss (2011). ``Estimation of Heterogeneous Treatment Effects from Randomized Experiments, with Application to the Optimal Planning of the Get-out-the-vote Campaign.'' Political Analysis, Vol. 19, No. 1 (Winter), pp. 1-19. Winner of Political Analysis Editors' Choice Award.
© Kosuke Imai