How Differently Do Farms Respond to Agri-environmental Policies? A Probabilistic Machine-Learning Approach

References

1. ↵
   1. Afriat, S. N.

   1972. “Efficiency Estimation of Production Function.” International Economics Review 13 (3): 568–98.

   OpenUrl
2. ↵
   1. Angrist, J. D., and
   2. J. S. Pischke

   . 2008. Mostly Harmless Econometrics. Princeton, NJ: Princeton University Press.
3. ↵
   1. Arata, L., and
   2. P. Sckokai

   . 2016. “The Impact of Agri-environmental Schemes on Farm Performance in Five EU Member States: A DID-Matching Approach.” Land Economics 92 (1): 167–86. https://doi.org/10.3368/le.92.1.167.

   OpenUrlAbstract/FREE Full Text
4. ↵
   1. Athey, S., and
   2. G. W. Imbens

   . 2016. “Recursive Partitioning for Heterogeneous Causal Effects.” Proceedings of the National Academy of Sciences 113 (27): 7353–60.

   OpenUrlAbstract/FREE Full Text
5. ↵
   1. Athey, S., and
   2. G. W. Imbens

   . 2019. “Machine Learning Methods that Economists Should Know About.” Annual Review of Economics 11: 685–725.

   OpenUrl
6. ↵
   1. Athey, S.,
   2. J. Tibshirani, and
   3. S. Wager

   . 2019. “Generalised Random Forests.” Annals of Statistics 47 (2): 1148–78.

   OpenUrl
7. ↵
   1. Baldoni, E.,
   2. S. Coderoni, and
   3. R. Esposti

   . 2021. “Immigrant Workforce and Agriculture Productivity: Evidence from Italian Farm-Level Data,” European Review of Agricultural Economics 48 (4): 805–34.

   OpenUrl
8. ↵
   1. Bertoni, D.,
   2. G. Aletti,
   3. D. Cavicchioli,
   4. A. Micheletti, and
   5. R. Pretolani

   . 2021. “Estimating the CAP Greening Effect by Machine Learning Techniques: A Big Data Ex-Post Analysis.” Environmental Science and Policy 119: 44–53.

   OpenUrl
9. ↵
   1. Bertoni, D.,
   2. D. Curzi,
   3. G. Aletti, and
   4. A. Olper

   . 2020. “Estimating the Effects of Agri-environmental Measures Using Difference-in-Difference Coarsened Exact Matching.” Food Policy 90: 101790. https://doi.org/10.1016/j.foodpol.2019.101790.

   OpenUrl
10. ↵
    1. Breiman, L.

    1984. Classification and Regression Trees. New York: Routledge.
11. ↵
    1. Brown, C.,
    2. E. Kovács,
    3. I. Herzon,
    4. S. Villamayor-Tomas,
    5. A. Albizua,
    6. A. Galanaki,
    7. I. Grammatikopoulou

    , et al. 2021. “Simplistic Understandings of Farmer Motivations Could Undermine the Environmental Potential of the Common Agricultural Policy.” Land Use Policy 101: 105136. https://doi.org/10.1016/j.landusepol.2020.105136.

    OpenUrl
12. ↵
    1. Burton, R., and
    2. G. Schwarz

    . 2013. “Result-Oriented Agri-environmental Schemes in Europe and Their Potential for Promoting Behavioural Change.” Land Use Policy 30 (1): 628–41.

    OpenUrl
13. ↵
    1. Carnagie, N.,
    2. V. Dorie, and
    3. J. J. Hill

    . 2019. “Examining Treatment Effect Heterogeneity Using BART.” Observational Studies 5 (2): 52–70.

    OpenUrl
14. ↵
    1. Carvalho, C.,
    2. A. Feller,
    3. J. Murrary,
    4. S. Woody, and
    5. D. Yeager

    . 2019. “Assessing Treatment Effect Variation in Observational Studies: Results from a Data Challenge.” Observational Studies 5 (2): 21–35.

    OpenUrl
15. ↵
    1. Chabé-Ferret, S., and
    2. J. Subervie

    . 2013. “How Much Green for the Buck? Estimating Additional and Windfall Effects of French Agri-environmental Schemes by DID-Matching.” Journal of Environmental Economics and Management 65 (1): 12–27.

    OpenUrl
16. ↵
    1. Chavas, J. P., and
    2. T. L. Cox

    . 1995. “On Nonparametric Supply Response Analysis.” American Journal of Agricultural Economics 77 (1): 80–92.

    OpenUrlCrossRefWeb of Science
17. ↵
    1. Chernozhukov, V.,
    2. D. Chetverikov,
    3. M. Demirer,
    4. E. Duflo,
    5. C. Hansen,
    6. W. Newey, and
    7. J. Robins

    . 2018. “Double/Debiased Machine Learning for Treatment and Structural Parameters.” Econometrics Journal 21 (1): C1–68. https://doi.org/10.1111/ectj.12097.

    OpenUrl
18. ↵
    1. Chipman, H. A.,
    2. E. I. George, and
    3. R. E. McCulloch

    . 1998. “Bayesian CART Model Search.” Journal of the American Statistical Association 93 (443): 935–48.

    OpenUrlCrossRef
19. ↵
    1. Chipman, H. A.,
    2. E. I. George, and
    3. R. E. McCulloch

    . 2010. “Bart: Bayesian Additive Regression Trees.” Annals of Applied Statistics 4 (1): 266–98.

    OpenUrl
20. ↵
    1. Chipman, H. A., and
    2. H. Gu

    . 2005. “Interpretable Dimension Reduction.” Journal of Applied Statistics 32 (9): 969–87.

    OpenUrlCrossRef
21. ↵
    1. Coderoni, S., and
    2. R. Esposti

    . 2018. “CAP Payments and Agricultural GHG Emissions in Italy. A Farm-Level Assessment.” Science of the Total Environment 627: 427–37.

    OpenUrl
22. ↵
    1. Coderoni, S.,
    2. J. Helming,
    3. M. Pérez-Soba,
    4. P. Sckokai, and
    5. A. Varacca

    . 2021. “Key Policy Questions for Ex-Ante Impact Assessment of European Agricultural and Rural Policies.” Environmental Research Letters 16 (9): 094044. https://doi.org/0.1088/1748-9326/ac1f45.

    OpenUrl
23. ↵
    Commission of European Communities. 2000. “Communication from the Commission to the Council and the European Parliament. Indicators for the Integration of Environmental Concerns into the Common Agricultural Policy.” Brussels.
24. ↵
    1. Dabkiene, V.,
    2. T. Balezentis, and
    3. D. Streimikiene

    . 2021. “Development of Agri-environmental Footprint Indicator Using the FADN Data: Tracking Development of Sustainable Agricultural Development in Eastern Europe.” Sustainable Production and Consumption 27: 2121–33.

    OpenUrl
25. ↵
    1. Dessart, F. J.,
    2. J. Barreiro-Hurlé, and
    3. R. van Bavel

    . 2019. “Behavioural Factors Affecting the Adoption of Sustainable Farming Practices: A Policy-Oriented Review.” European Review of Agricultural Economics 46 (3): 417–71.

    OpenUrlCrossRef
26. ↵
    1. Dorie, V.,
    2. M. Harada,
    3. N. B. Carnegie, and
    4. J. Hill

    . 2016. “A Flexible, Interpretable Framework for Assessing Sensitivity to Unmeasured Confounding.” Statistics in Medicine 35 (20): 3453–70.

    OpenUrlCrossRef
27. ↵
    1. Dorie, V.,
    2. J. Hill,
    3. U. Shalit,
    4. M. Scott, and
    5. D. Cervone

    . 2019. “Automated versus Do-It-Yourself Methods for Causal Inference: Lessons Learned from a Data Analysis Competition.” Statistical Science 34 (1): 43–68.

    OpenUrlCrossRef
28. ↵
    1. Ehlers, M. H.,
    2. R. Huber, and
    3. R. Finger

    . 2021. “Agricultural Policy in the Era of Digitalisation.” Food Policy 100: 102019. https://doi.org/10.1016/j.foodpol.2020.102019.

    OpenUrl
29. ↵
    1. Erjavec, K., and
    2. E. Erjavec

    . 2015. “Greening the CAP: Just a Fashionable Justification? A Discourse Analysis of the 2014–2020 CAP Reform Documents.” Food Policy 51: 53–62.

    OpenUrl
30. ↵
    1. Esposti, R.

    2000. “The Impact of Public R&D and Extension Expenditure on Italian Agriculture. An Application of a Mixed Parametric/Nonparametric Approach.” European Review of Agricultural Economics 27 (3): 365–84.

    OpenUrl
31. ↵
    1. Esposti, R.

    2017a. “The Empirics of Decoupling: Alternative Estimation Approaches of the Farm-Level Production Response.” European Review of Agricultural Economics 44 (3): 499–537.

    OpenUrl
32. ↵
    1. Esposti, R.

    2017b. “The Heterogeneous Farm-Level Impact of the 2005 CAP-First Pillar Reform: A Multivalued Treatment Effect Estimation.” Agricultural Economics 48 (3): 373–86.

    OpenUrl
33. ↵
    1. Esposti, R.

    2022a. “The Coevolution of Policy Support and Farmers Behaviour and Performance. An Investigation on Italian Agriculture over the 2008–2019 Period.” Bio-Based and Applied Economics 11 (3): 231–64.

    OpenUrl
34. ↵
    1. Esposti, R.

    2022b. “Non-monetary Motivations of Agri-environmental Policies Adoption. A Causal Forest Approach.” Quaderno di Ricerca no. 459. Ancona, Italy: Dipartimento di Scienze Economiche e Sociali, Università Politecnica delle Marche.
35. ↵
    European Council. 2009. “Council Regulation (EC) No. 1217/2009 of 30 November 2009: Setting Up a Network for the Collection of Accountancy Data on the Incomes and Business Operation of Agricultural Holdings in the European Community.” OJ L 328. Brussels.
36. ↵
    1. Finn, J. A.,
    2. F. Bartolini,
    3. D. Bourke,
    4. I. Kurz, and
    5. D. Viaggi

    . 2009. “Ex-post Environmental Evaluation of Agri-environment Schemes Using Experts’ Judgements and Multicriteria Analysis.” Journal of Environmental Planning and Management 52: 717–37.

    OpenUrl
37. ↵
    1. Gelman, A.,
    2. H. S. Stern,
    3. J. B. Carlin,
    4. D. B. Dunson,
    5. A. Vehtari, and
    6. D. B. Rubin

    . 2013. Bayesian Data Analysis. Boca Raton, FL: Chapman and Hall/CRC.
38. ↵
    1. Guerrero, S.

    2021. “Characterising Agri-environmental Policies: Towards Measuring Their Progress.” OECD Food, Agriculture and Fisheries Paper 155. Paris: OECD.
39. ↵
    1. Hahn, P. R.,
    2. C. M. Carvalho,
    3. D. Puelz, and
    4. J. He

    . 2018. “Regularisation and Confounding in Linear Regression for Treatment Effect Estimation.” Bayesian Analysis 13 (1): 163–82.

    OpenUrl
40. ↵
    1. Hahn, P. R.,
    2. J. S. Murray, and
    3. C. M. Carvalho

    . 2020. “Bayesian Regression Tree Models for Causal Inference: Regularisation, Confounding, and Heterogeneous Effects (With Discussion).” Bayesian Analysis 15 (3): 965–1056.

    OpenUrl
41. ↵
    1. Heiler, P., and
    2. M. Knaus

    . 2022. “Effect or Treatment Heterogeneity? Policy Evaluation with Aggregated and Disaggregated Treatments.” IZA Discussion Paper 15580. Bonn, Germany: IZA.
42. ↵
    1. Hill, J. L.

    2011. “Bayesian Nonparametric Modelling for Causal Inference.” Journal of Computational and Graphical Statistics 20 (1): 217–40.

    OpenUrl
43. ↵
    1. Hill, J.,
    2. A. Linero, and
    3. J. Murray

    . 2020. “Bayesian Additive Regression Trees: A Review and Look Forward.” Annual Review of Statistics and Its Application 7: 251–78.

    OpenUrl
44. ↵
    1. Hill, J., and
    2. Y. S. Su

    . 2013. “Assessing Lack of Common Support in Causal Inference Using Bayesian Nonparametrics: Implications for Evaluating the Effect of Breastfeeding on Children’s Cognitive Outcomes.” Annals of Applied Statistics 7 (3): 1386–1420.

    OpenUrl
45. ↵
    1. Hudec, B.,
    2. C. Kaufmann,
    3. R. Landgrebe-Trinkunaite, and
    4. S. Naumann

    . 2007. “Evaluation of Soil Protection Aspects in Certain Programmes of Measures Adopted by Member States.” Final Report. Brussels: European Commission.
46. ↵
    1. Hünermund, P.,
    2. B. Louw, and
    3. I. Caspi

    . 2023. “Double Machine Learning and Automated Confounder Selection: A Cautionary Tale.” Journal of Causal Inference 11 (1): 20220078. https://doi.org/10.1515/jci-2022-0078.

    OpenUrl
47. ↵
    1. Imai, K., and
    2. M. Ratkovic

    . 2013. “Estimating Treatment Effect Heterogeneity in Randomised Program Evaluation.” Annals of Applied Statistics 7(1): 443–70.

    OpenUrl
48. ↵
    1. Imbens, G. W., and
    2. D. B. Rubin

    . 2015. Causal Inference in Statistics, Social, and Biomedical Sciences. Cambridge, UK: Cambridge University Press.
49. ↵
    1. Kapelner, A., and
    2. J. Bleich

    . 2016. “bartMachine: Machine Learning with Bayesian Additive Regression Trees.” Journal of Statistical Software 70 (4): 1–40.

    OpenUrl
50. ↵
    1. Knaus, M. C.,
    2. M. Lechner, and
    3. A. Strittmatter

    . 2021. “Machine Learning Estimation of Heterogeneous Causal Effects: Empirical Monte Carlo Evidence.” Econometrics Journal 24 (1): 134–61.

    OpenUrl
51. ↵
    1. Knaus, M. C.,
    2. M. Lechner, and
    3. A. Strittmatter

    . 2022. “Heterogeneous Employment Effects of Job Search Programmes: A Machine Learning Approach.” Journal of Human Resources 57 (2): 597–636.

    OpenUrlAbstract/FREE Full Text
52. ↵
    1. Künzel, S. R.,
    2. J. S. Sekhon,
    3. P. J. Bickel, and
    4. B. Yu

    . 2019. “Metalearners for Estimating Heterogeneous Treatment Effects Using Machine Learning.” Proceedings of the National Academy of Sciences 116 (10): 4156–65. https://doi.org/10.1073/pnas.1804597116.

    OpenUrlAbstract/FREE Full Text
53. ↵
    1. Lechner, M.

    2018. “Modified Causal Forests for Estimating Heterogeneous Causal Effects.” arXiv preprint arXiv:1812.09487. https://doi.org/10.48550/arXiv.1812.09487.
54. ↵
    1. Lee, K.,
    2. F. J. Bargagli-Stoffi, and
    3. F. Dominici

    . 2020. “Causal Rule Ensemble: Interpretable Inference of Heterogeneous Treatment Effects.” arXiv preprint arXiv:2009.09036. https://doi.org/10.48550/arXiv.2009.09036.
55. ↵
    1. Li, F.,
    2. P. Ding, and
    3. F. Mealli

    . 2022. “Bayesian Causal Inference: A Critical Review.” arXiv preprint arXiv:2206.15460. https://doi.org/10.48550/arXiv.2206.15460.
56. ↵
    1. Lopez, M. J., and
    2. R. Gutman

    . 2017. “Estimation of Causal Effects with Multiple Treatments: A Review and New Ideas.” Statistical Science 32 (3): 432–54.

    OpenUrl
57. ↵
    1. McElreath, R.

    2020. Statistical Rethinking: A Bayesian Course with Examples in R and Stan. Boca Raton, FL: CRC Press.
58. ↵
    1. Mennig, P., and
    2. J. Sauer

    . 2020. “The Impact of Agri-environment Schemes on Farm Productivity: A DID-Matching Approach.” European Review of Agricultural Economics 47 (3): 1045–93.

    OpenUrl
59. ↵
    National Rural Network. 2010. “Report on Cross Compliance Implementation in Italy.” Available at http://www.reterurale.it.
60. ↵
    1. Nie, X., and
    2. S. Wager

    . 2021. “Quasi-oracle Estimation of Heterogeneous Treatment Effects.” Biometrika 108 (2): 299–319.

    OpenUrlCrossRef
61. ↵
    1. ÓhUallacháin, D.,
    2. J. A. Finn,
    3. B. Keogh,
    4. R. Fritch, and
    5. H. Sheridan

    . 2016. “A Comparison of Grassland Vegetation from Three Agri-environment Conservation Measures.” Irish Journal of Agricultural and Food Research 55: 176–91.

    OpenUrl
62. OECD (Organisation for Economic Co-operation and Development) 2003. “Agriculture and Biodiversity: Developing Indicators for Policy Analysis.” Proceedings from an OECD Expert Meeting, Zurich, November 2001. Paris.
63. 1. Pascucci, S.,
    2. T. de-Magistris,
    3. L. Dries,
    4. F. Adinolfi, and
    5. F. Capitanio

    . 2013. “Participation of Italian Farmers in Rural Development Policy.” European Review of Agricultural Economics 40 (4): 605–31.

    OpenUrlCrossRef
64. ↵
    1. Pufahl, A., and
    2. C. R. Weiss

    . 2009. “Evaluating the Effects of Farm Programmes: Results from Propensity Score Matching.” European Review of Agricultural Economics 36 (1): 79–101.

    OpenUrlCrossRefWeb of Science
65. ↵
    1. Purvis, G.,
    2. G. Louwagie,
    3. G. Northey,
    4. S. Mortimer,
    5. J. Park,
    6. A. Mauchline,
    7. J. Finn

    , et al. 2009. “Conceptual Development of a Harmonised Method for Tracking Change and Evaluating Policy in the Agri-environment: The Agri-environmental Footprint Index.” Environmental Science and Policy 12: 321–37.

    OpenUrlCrossRef
66. ↵
    1. Shapley, L. S.

    1953. “A Value for n-Person Games.” Contributions to the Theory of Games 2 (28): 307–17.

    OpenUrl
67. ↵
    1. Stetter, C.,
    2. P. Mennig, and
    3. J. Sauer

    . 2022. “Using Machine Learning to Identify Heterogeneous Impacts of Agri-environment Schemes in the EU: A Case Study.” European Review of Agricultural Economics 49 (4): 723–39.

    OpenUrl
68. ↵
    1. Storm, H.,
    2. K. Baylis, and
    3. T. Heckelei

    . 2020. “Machine Learning in Agricultural and Applied Economics.” European Review of Agricultural Economics 47 (3): 849–92.

    OpenUrl
69. ↵
    1. Uehleke, R.,
    2. M. Petrick, and
    3. S. Hüttel

    . 2022. “Evaluations of Agri-environmental Schemes Based on Observational Farm Data: The Importance of Covariate Selection.” Land Use Policy 114: 105950.

    OpenUrl
70. 1. VanderWeele, T. J., and
    2. P. Ding

    . 2017. “Sensitivity Analysis in Observational Research: Introducing the E-Value.” Annals of Internal Medicine 167 (4): 268–74.

    OpenUrlCrossRefPubMed
71. ↵
    1. VanderWeele, T. J., and
    2. M. A. Hernán

    . 2013. “Causal Inference under Multiple Versions of Treatment.” Journal of Causal Inference 1 (1): 1–20.

    OpenUrl
72. 1. Vanslembrouck, I.,
    2. G. Van Huylenbroeck, and
    3. W. Verbeke

    . 2002. “Determinants of the Willingness of Belgian Farmers to Participate in Agri-environmental Measures.” Journal of Agricultural Economics 53 (3): 489–511.

    OpenUrlCrossRef
73. 1. Varacca, A.,
    2. L. Arata,
    3. E. Castellari, and
    4. P. Sckokai

    . 2023. “Does CAP Greening Affect Farms’ Economic and Environmental Performances? A Regression Discontinuity Design Analysis.” European Review of Agricultural Economics 50 (2): 272–303.

    OpenUrl
74. ↵
    1. Varian, H.

    1984. “The Nonparametric Approach to Production Analysis.” Econometrica 52 (3): 579–97.

    OpenUrlCrossRefWeb of Science
75. ↵
    1. Wager, S., and
    2. S. Athey

    . 2018. “Estimation and Inference of Heterogeneous Treatment Effects Using Random Forests.” Journal of the American Statistical Association 113 (523): 1228–42. https://doi.org/10.1080/01621459.2017.1319839.

    OpenUrl
76. 1. Wąs, A.,
    2. A. Malak-Rawlikowska,
    3. M. Zavalloni,
    4. D. Viaggi,
    5. P. Kobus, and
    6. P. Sulewski

    . 2021. “In Search of Factors Determining the Participation of Farmers in Agri-environmental Schemes: Does Only Money Matter in Poland?” Land Use Policy 101: 105190. https://doi.org/10.1016/j.landusepol.2020.105190.

    OpenUrl
77. ↵
    1. Wascher, D. M.

    2003. “Overview of Agricultural Landscape Indicators across OECD Countries.” Proceedings of the NIJOS/OECD Expert Meeting on Agricultural Landscape, 7–9 October 2002, Oslo, Norway. Available at https://research.wur.nl/en/publications/overview-on-agricultural-landscape-indicators-across-oecd-countri.
78. ↵
    1. Westbury, D. B.,
    2. J. R. Park,
    3. A. L. Mauchline,
    4. R. T. Crane, and
    5. S. R. Mortimer

    . 2011. “Assessing the Environmental Performance of English Arable and Livestock Holdings Using Data from the Farm Accountancy Data Network (FADN).” Journal of Environmental Management 92 (3): 902–9.

    OpenUrlPubMed
79. ↵
    1. Woody, S.,
    2. C. M. Carvalho, and
    3. J. S. Murray

    . 2021. “Model Interpretation through Lower-Dimensional Posterior Summarisation.” Journal of Computational and Graphical Statistics 30 (1): 144–61.

    OpenUrl
80. ↵
    1. Wooldridge, J. M.

    2010. Econometric Analysis of Cross Section and Panel Data. Cambridge, MA: MIT Press.
81. ↵
    1. Yeager, D. S.,
    2. P. Hanselman,
    3. G. M. Walton,
    4. J. S. Murray,
    5. R. Crosnoe,
    6. C. Muller, and
    7. C. S. Dweck

    . 2019. “A National Experiment Reveals Where a Growth Mindset Improves Achievement.” Nature 573 (7774): 364–69.

    OpenUrlPubMed
82. ↵
    1. Zhen, H.,
    2. Y. Qiao,
    3. H. Zhao,
    4. X. Ju,
    5. R. Zanoli,
    6. M. A. Waqas,
    7. F. Lun, and
    8. M. T. Knudsen

    . 2022. “Developing a Conceptual Model to Quantify Eco-compensation Based on Environmental and Economic Cost-Benefit Analysis for Promoting Ecologically Intensified Agriculture.” Ecosystem Services 56: 101442.

    OpenUrl
83. ↵
    1. Zimmermann, A., and
    2. W. Britz

    . 2016. “European Farms’ Participation in Agri-environmental Measures.” Land Use Policy 50: 214–28.

    OpenUrl