Research ArticleArticles

The Reliability of Delphi Surveys and Benefit Transfer to Predict Outcomes of Contingent Valuation Surveys

Anders Dugstad and Ståle Navrud
Land Economics, August 2023, 99 (3) 413-432; DOI: https://doi.org/10.3368/le.99.3.051922-0037R

References

  1. ↵
    1. Amiran, E. Y., and
    2. D. A. Hagen
    . 2010. “The Scope Trials: Variation in Sensitivity to Scope and WTP with Directionally Bounded Utility Functions.” Journal of Environmental Economics and Management 59 (3): 293–301.
    OpenUrlCrossRefWeb of Science
  2. ↵
    1. Andersen, L. E.,
    2. C. W. Granger,
    3. E. J. Reis,
    4. D. Weinhold, and
    5. S. Wunder
    . 2002. The Dynamics of Deforestation and Economic Growth in the Brazilian Amazon. Cambridge, UK: Cambridge University Press.
  3. ↵
    1. Artell, J.,
    2. H. Ahtiainen, and
    3. E. Pouta
    . 2019. “Distance Decay and Regional Statistics in International Benefit Transfer.” Ecological Economics 164: 106383. https://doi.org/10.1016/j.ecol econ.2019.106383.
    OpenUrl
  4. ↵
    1. Bakhtiari, F.,
    2. J. B. Jacobsen,
    3. B. J. Thorsen,
    4. T. H. Lundhede,
    5. N. Strange, and
    6. M. Boman
    . 2018. “Disentangling Distance and Country Effects on the Value of Conservation across National Borders.” Ecological Economics 147: 11–20.
    OpenUrl
  5. ↵
    1. Bateman, I. J.,
    2. R. Brouwer,
    3. S. Ferrini,
    4. M. Schaafsma,
    5. D. N. Barton,
    6. A. Dubgaard,
    7. B. Hasler
    , et al. 2011. “Making Benefit Transfers Work: Deriving and Testing Principles for Value Transfers for Similar and Dissimilar Sites Using a Case Study of the Non-market Benefits of Water Quality Improvements across Europe.” Environmental and Resource Economics 50 (3): 365–87.
    OpenUrlCrossRef
  6. ↵
    1. Bishop, R. C., and
    2. K. J. Boyle
    . 2019. “Reliability and Validity in Nonmarket Valuation.” Environmental and Resource Economics 72 (2): 559–82.
    OpenUrlCrossRef
  7. ↵
    1. Bliem, M.,
    2. M. Getzner, and
    3. P. Rodiga-Laßnig
    . 2012. “Temporal Stability of Individual Preferences for River Restoration in Austria Using a Choice Experiment.” Journal of Environmental Management 103: 65–73.
    OpenUrlPubMed
  8. ↵
    1. Boyle, K. J.,
    2. N. V. Kuminoff,
    3. C. F. Parmeter, and
    4. J. C. Pope
    . 2010. “The Benefit-Transfer Challenges.” Annual Review of Resource Economics 2 (1): 161–82.
    OpenUrlCrossRefWeb of Science
  9. ↵
    1. Brouwer, R.
    2006. “Do Stated Preference Methods Stand the Test of Time? A Test of the Stability of Contingent Values and Models for Health Risks When Facing an Extreme Event.” Ecological Economics 60 (2): 399–406.
    OpenUrlCrossRefWeb of Science
  10. ↵
    1. Brouwer, R.,
    2. R. Pinto,
    3. A. Dugstad, and
    4. S. Navrud
    . 2022. “The Economic Value of the Brazilian Amazon Rainforest Ecosystem Services: A Meta-analysis of the Brazilian Literature.” PLoS ONE 17 (5): e0268425. https://doi.org/10.1371/journal.pone.0268425.
    OpenUrl
  11. ↵
    1. Brouwer, R., and
    2. F. A. Spaninks
    . 1999. “The Validity of Environmental Benefits Transfer: Further Empirical Testing.” Environmental and Resource Economics 14 (1): 95–117.
    OpenUrlCrossRef
  12. ↵
    1. Bullock, E. L.,
    2. C. E. Woodcock,
    3. C. Souza Jr., and
    4. P. Olofsson
    . 2020. “Satellite-Based Estimates Reveal Widespread Forest Degradation in the Amazon.” Global Change Biology 26 (5): 2956–69.
    OpenUrl
  13. ↵
    1. Cameron, A. C., and
    2. P. K. Trivedi
    ,. 2005. Microeconometrics: Methods and Applications. Cambridge, UK: Cambridge University Press.
  14. ↵
    1. Carson, R. T.,
    2. M. B. Conaway, and
    3. S. Navrud
    . 2013. “Preliminary Valuation of a Cultural Heritage Site of Global Significance: A Delphi Contingent Valuation Study.” In Handbook on the Economics of Cultural Heritage, edited by I. Rizzo and A. Mignosa, 583–612. Cheltenham, UK: Edward Elgar.
  15. ↵
    1. Carson, R. T., and
    2. T. Groves
    . 2011. “Incentive and Information Properties of Preference Questions: Commentary and Extensions.” In The International Handbook on Non-market Environmental Valuation, edited by J. Bennett, 300–21. Cheltenham, UK: Edward Elgar.
  16. ↵
    1. Carson, R. T.,
    2. W. M. Hanemann,
    3. R. J. Kopp,
    4. J. A. Krosnick,
    5. R. C. Mitchell,
    6. S. Presser,
    7. P. A. Rudd
    , et al. 1997. “Temporal Reliability of Estimates from Contingent Valuation.” Land Economics 73 (2): 151–63.
    OpenUrlCrossRefWeb of Science
  17. ↵
    1. Czajkowski, M.,
    2. H. Ahtiainen,
    3. J. Artell, and
    4. J. Meyerhoff
    . 2017. “Choosing a Functional Form for an International Benefit Transfer: Evidence from a Nine-Country Valuation Experiment.” Ecological Economics 134: 104–13.
    OpenUrl
  18. ↵
    1. Dalkey, N., and
    2. O. Helmer
    . 1963. “An Experimental Application of the Delphi Method to the Use of Experts.” Management Science 9 (3): 458–67.
    OpenUrl
  19. ↵
    1. de Oliveira, G.,
    2. J. M. Chen,
    3. G. A. Mataveli,
    4. M. E. Chaves,
    5. H. T. Seixas,
    6. F. d. S. Cardozo,
    7. Y. E. Shimabukuro
    , et al. 2020. “Rapid Recent Deforestation Incursion in a Vulnerable Indigenous Land in the Brazilian Amazon and Fire-Driven Emissions of Fine Particulate Aerosol Pollutants.” Forests 11 (8): 829.
    OpenUrl
  20. ↵
    1. Downing, M., and
    2. T. Ozuna Jr.
    1996. “Testing the Reliability of the Benefit Function Transfer Approach.” Journal of Environmental Economics and Management 30 (3): 316–22.
    OpenUrlCrossRefWeb of Science
  21. ↵
    1. Dugstad, A.,
    2. K. M. Grimsrud,
    3. G. Kipperberg,
    4. H. Lindhjem, and
    5. S. Navrud
    . 2021. “Scope Elasticity of Willingness to Pay in Discrete Choice Experiments.” Environmental and Resource Economics 80 (1): 21–57.
    OpenUrl
  22. ↵
    1. Foley, J. A.,
    2. G. P. Asner,
    3. M. H. Costa,
    4. M. T. Coe,
    5. R. DeFries,
    6. H. K. Gibbs,
    7. E. A. Howard
    , et al. 2007. “Amazonia Revealed: Forest Degradation and Loss of Ecosystem Goods and Services in the Amazon Basin.” Frontiers in Ecology and the Environment 5 (1): 25–32.
    OpenUrlCrossRefWeb of Science
  23. ↵
    1. Hanley, N.,
    2. D. MacMillan,
    3. R. E. Wright,
    4. C. Bullock,
    5. I. Simpson,
    6. D. Parsisson, and
    7. B. Crabtree
    . 1998. “Contingent Valuation versus Choice Experiments: Estimating the Benefits of Environmentally Sensitive Areas in Scotland.” Journal of Agricultural Economics 49 (1): 1–15.
    OpenUrlCrossRefWeb of Science
  24. ↵
    1. Horton, B.,
    2. G. Colarullo,
    3. I. J. Bateman, and
    4. C. A. Peres
    . 2003. “Evaluating Non-user Willingness to Pay for a Large-Scale Conservation Programme in Amazonia: A UK/Italian Contingent Valuation Study.” Environmental Conservation 30 (2): 139–46.
    OpenUrlCrossRefWeb of Science
  25. ↵
    1. Hsu, C.-C., and
    2. B. A. Sandford
    . 2007. “The Delphi Technique: Making Sense of Consensus.” Practical Assessment, Research, and Evaluation 12 (1): 10.
    OpenUrl
  26. ↵
    1. Hynes, S.,
    2. D. Campbell, and
    3. P. Howley
    . 2011. “A Choice Experiment versus a Contingent Valuation Approach to Agri-environmental Policy Valuation.” Working Paper 173. Galway: National University of Ireland. Available at https://aran.library.nuigalway.ie/handle/10379/2311.
  27. ↵
    1. Hynes, S.,
    2. D. Norton, and
    3. N. Hanley
    . 2013. “Adjusting for Cultural Differences in International Benefit Transfer.” Environmental and Resource Economics 56 (4): 499–519.
    OpenUrl
  28. ↵
    1. Johnston, R. J.,
    2. K. J. Boyle,
    3. W. Adamowicz,
    4. J. Bennett,
    5. R. Brouwer,
    6. T. A. Cameron,
    7. W. M. Hanemann
    , et al. 2017. “Contemporary Guidance for Stated Preference Studies.” Journal of the Association of Environmental and Resource Economists 4 (2): 319–405.
    OpenUrlCrossRef
  29. ↵
    1. Johnston, R. J.,
    2. K. J. Boyle,
    3. M. L. Loureiro,
    4. S. Navrud, and
    5. J. Rolfe
    . 2021. “Guidance to Enhance the Validity and Credibility of Environmental Benefit Transfers.” Environmental and Resource Economics 79 (3): 575–624.
    OpenUrl
  30. ↵
    1. Johnston, R. J., and
    2. P. J. Thomassin
    . 2010. “Willingness to Pay for Water Quality Improvements in the United States and Canada: Considering Possibilities for International Meta-analysis and Benefit Transfer.” Agricultural and Resource Economics Review 39 (1): 114–31.
    OpenUrl
  31. ↵
    1. Jusys, T.
    2016. “Fundamental Causes and Spatial Heterogeneity of Deforestation in Legal Amazon.” Applied Geography 75: 188–99.
    OpenUrl
  32. ↵
    1. Kehl, T. N.,
    2. V. Todt,
    3. M. R. Veronez, and
    4. S. C. Cazella
    . 2015. Real Time Deforestation Detection Using ANN and Satellite Images: The Amazon Rainforest Study Case. Cham, Switzerland: Springer.
  33. ↵
    1. Kling, C. L., and
    2. D. Phaneuf
    . 2018. “How Are Scope and Adding Up Relevant for Benefits Transfer?” Environmental and Resource Economics 69 (3): 483–502.
    OpenUrl
  34. Kommuneprofilen. 2018a. “Befolkning fordelt på kvinner og menn: Antall og andel. 2000–2018: Landet i alt” [Population Distributed by Females and Males: Quantity and Shares. 2000–2018: National Statistics for Norway Overall]. Available at http://www.kommuneprofilen.no/profil/.
  35. Kommuneprofilen. 2018b. “Gjennomsnittlig inntekt, formue, gjeld og skatt per innbygger: Landet i alt” [Average Income, Wealth, Debt and Tax per Inhabitant: National Statistics for Norway Overall]. Available at http://www.kommuneprofilen.no/Profil/Inntekt/DinRegion/innt_hovedposter_re gion.aspx.
  36. Kommuneprofilen. 2018c. “Gjennomsnittlig alder: 2000–2018. Landet i alt” [Average Age: 2008–2018. National Statistics for Norway Overall]. Available at http://www.kommuneprofilen.no/Profil/Befolkning/DinRegion/bef_alder_region.aspx.
  37. ↵
    1. Kramer, R. A., and
    2. D. E. Mercer
    . 1997. “Valuing a Global Environmental Good: US Residents’ Willingness to Pay to Protect Tropical Rain Forests.” Land Economics 73 (2): 196–210.
    OpenUrlCrossRef
  38. ↵
    1. Kristófersson, D., and
    2. S. Navrud
    . 2007. “Can Use and Non-use Values Be Transferred across Countries?” In Environmental Value Transfer: Issues and Methods, edited by S. Navrud and R. Ready, 207–25. Dordrecht, Netherlands: Springer.
  39. ↵
    1. León, C. J.,
    2. F. J. Vázquez-Polo, and
    3. R. L. González
    . 2003. “Elicitation of Expert Opinion in Benefit Transfer of Environmental Goods.” Environmental and Resource Economics 26 (2): 199–210.
    OpenUrl
  40. ↵
    1. Lew, D. K., and
    2. K. Wallmo
    . 2017. “Temporal Stability of Stated Preferences for Endangered Species Protection from Choice Experiments.” Ecological Economics 131: 87–97.
    OpenUrl
  41. ↵
    1. Lindhjem, H., and
    2. S. Navrud
    . 2008. “How Reliable Are Meta-analyses for International Benefit Transfers?” Ecological Economics 66 (2–3): 425–35.
    OpenUrlCrossRefWeb of Science
  42. ↵
    1. Lindhjem, H., and
    2. S. Navrud
    . 2009. “Asking for Individual or Household Willingness to Pay for Environmental Goods?” Environmental and Resource Economics 43 (1): 11–29.
    OpenUrl
  43. ↵
    1. Navrud, S., and
    2. O. Bergland
    . 2004. “Value Transfer and Environmental Policy.” In The International Yearbook of Environmental and Resource Economics 2004/5: A Survey of Current Issues, edited by Tom Tietenberg and Henk Folmer, 189–217. Cheltenham, UK: Edward Elgar.
  44. ↵
    1. Navrud, S., and
    2. R. Ready
    . 2007. “Review of Methods for Value Transfer.” In Environmental Value Transfer: Issues and Methods, edited by S. Navrud and R. Ready, 1–10. Dordrecht, Netherlands: Springer.
  45. ↵
    1. Navrud, S., and
    2. J. Strand
    . 2018. “Valuing Global Ecosystem Services: What Do European Experts Say? Applying the Delphi Method to Contingent Valuation of the Amazon Rainforest.” Environmental and Resource Economics 70 (1): 249–69.
    OpenUrl
  46. ↵
    1. Pascual, U.,
    2. R. Muradian,
    3. L. Brander,
    4. E. Gómez-Baggethun,
    5. B. Martín-López,
    6. M. Verma,
    7. P. Armsworth
    , et al. 2010. “The Economics of Valuing Ecosystem Services and Biodiversity.” In The Economics of Ecosystems and Biodiversity: Ecological and Economic Foundations, edited by P. Kumar, 183–256. London: Taylor and Francis.
  47. ↵
    1. Ready, R., and
    2. S. Navrud
    . 2006. “International Benefit Transfer: Methods and Validity Tests.” Ecological Economics 60 (2): 429–34.
    OpenUrlCrossRefWeb of Science
  48. ↵
    1. Ready, R.,
    2. S. Navrud,
    3. B. Day,
    4. R. Dubourg,
    5. F. Machado,
    6. S. Mourato,
    7. F. Spanninks, and
    8. M. X. V. Rodriquez
    . 2004. “Benefit Transfer in Europe: How Reliable Are Transfers between Countries?” Environmental and Resource Economics 29 (1): 67–82.
    OpenUrl
  49. ↵
    1. Richardson, L., and
    2. J. Loomis
    . 2009. “The Total Economic Value of Threatened, Endangered and Rare Species: An Updated Meta-analysis.” Ecological Economics 68 (5): 1535–48.
    OpenUrlCrossRefWeb of Science
  50. ↵
    1. Rosenberger, R. S.
    2015. “Benefit Transfer Validity and Reliability.” In Benefit Transfer of Environmental and Resource Values, edited by R. J. Johnston, J. Rolfe, R. S. Rosenberger, and R. Brouwer, 307–26. Dordrecht, Netherlands: Springer.
  51. ↵
    1. Rosenberger, R. S., and
    2. J. B. Loomis
    . 2017. “Benefit Transfer.” In A Primer on Nonmarket Valuation. 2nd ed., edited by P. A. Champ, K. J. Boyle, and T. C. Brown, 431–62. Dordrecht, Netherlands: Springer.
  52. ↵
    1. Ryan, M., and
    2. V. Watson
    . 2009. “Comparing Welfare Estimates from Payment Card Contingent Valuation and Discrete Choice Experiments.” Health Economics 18 (4): 389–401.
    OpenUrlCrossRefPubMed
  53. ↵
    1. Sackman, H.
    1974. Delphi Assessment: Expert Opinion, Forecasting, and Group Process. Santa Monica, CA: RAND Corporation.
  54. ↵
    1. Siikamaki, J. V.,
    2. A. J. Krupnick,
    3. J. Strand, and
    4. J. Vincent
    . 2019. “International Willingness to Pay for the Protection of the Amazon Rainforest.” World Bank Policy Research Working Paper 8775. Washington, DC: World Bank.
  55. ↵
    1. Skourtos, M.,
    2. A. Kontogianni, and
    3. P. Harrison
    . 2010. “Reviewing the Dynamics of Economic Values and Preferences for Ecosystem Goods and Services.” Biodiversity and Conservation 19 (10): 2855–72.
    OpenUrl
  56. SSB. 2017a. “Befolkningens utdanningsnivå” [Norwegians’ Education Level]. Available at https://www.ssb.no/utdanning/statistikker/utniv.
  57. SSB. 2017b. “Familier og husholdninger” [Families and Households]. Available at https://www.ssb.no/familie/.
  58. SSB. 2017c. “Folkemengd, etter land, kjønn og alder: Nordiske land. 1. januar 2017: Tal og prosent” [Population by Country, Gender and Age: The Nordic Countries. January 1, 2017 to the Present]. Available at https://www.ssb.no/314742/folkemengd-etter-land-kjonn-og-alder.nordiske-land.1.januar-2017.tal-og-prosent-sa-63(1).
  59. SSB. 2017d. “Inntekts- og formuesstatistikk for husholdninger” [Income and Wealth Statistics]. Available at https://www.ssb.no/inntekt-og-forbruk/statistikker/ifhus.
  60. ↵
    1. Strand, J.,
    2. R. T. Carson,
    3. S. Navrud,
    4. A. Ortiz-Bobea, and
    5. J. Vincent
    . 2014. “A ‘Delphi Exercise’ as a Tool in Amazon Rainforest Valuation.” World Bank Policy Research Working Paper 7143. Washington, DC: World Bank.
  61. ↵
    1. Strand, J.,
    2. R. T. Carson,
    3. S. Navrud,
    4. A. Ortiz-Bobea, and
    5. J. Vincent
    . 2017. “Using the Delphi Method to Value Protection of the Amazon Rainforest.” Ecological Economics 131: 475–84.
    OpenUrl
  62. ↵
    1. Strand, J.,
    2. B. Soares-Filho,
    3. M. H. Costa,
    4. U. Oliveira,
    5. S. C. Ribeiro,
    6. G. Pires,
    7. A. Oliveira
    , et al. 2018. “Spatially Explicit Valuation of the Brazilian Amazon Forest’s Ecosystem Services.” Nature Sustainability 1 (11): 657–64.
    OpenUrl
  63. ↵
    1. Uhl, C.
    1987. “Factors Controlling Succession Following Slash-and-Burn Agriculture in Amazonia.” Journal of Ecology 75 (2): 377–407.
    OpenUrlCrossRefWeb of Science
  64. ↵
    1. Veisten, K.,
    2. H. F. Hoen,
    3. S. Navrud, and
    4. J. Strand
    . 2004. “Scope Insensitivity in Contingent Valuation of Complex Environmental Amenities.” Journal of Environmental Management 73 (4): 317–31.
    OpenUrlCrossRefPubMedWeb of Science
  65. ↵
    1. Whitehead, J. C.
    2016. “Plausible Responsiveness to Scope in Contingent Valuation.” Ecological Economics 128: 17–22.
    OpenUrl
Back to top

In this issue

Print
Download PDF
Article Alerts
Email Article
Citation Tools
The Reliability of Delphi Surveys and Benefit Transfer to Predict Outcomes of Contingent Valuation Surveys
Anders Dugstad, Ståle Navrud
Land Economics Aug 2023, 99 (3) 413-432; DOI: 10.3368/le.99.3.051922-0037R
Twitter logo Facebook logo Mendeley logo
Bookmark this article

Jump to section

Keywords