A Choice Matching Approach for Discrete Choice Analysis: An Experimental Investigation in the Laboratory

Simone Cerroni, Daniel W. Derbyshire, W. George Hutchinson and Rodolfo M. Nayga Jr.

Article Figures & Data

  • Figure 1

    An Example Choice Situation Shown to Respondents in the Experimental Instructions

    Note: Light gray corresponds to yellow in the instructions; medium gray corresponds to green in the instructions; dark gray corresponds to red in the instructions.

  • Figure 2

    An Example Choice Situation Shown to Respondents in the Experimental Instructions

    Note: Light gray corresponds to yellow in the instructions; medium gray corresponds to green in the instructions; dark gray corresponds to red in the instructions.

  • Table 1

    Synthesis of Contributions to the Discrete Choice Experiment Literature by Discipline

    DisciplineReliabilityConvergent ValidityCriterion Validity
    Environmental economicsBliem, Getzner, and Rodiga-Laßnig 2012; Schaafsma et al. 2014; Czajkowski, Barczak, and Budziñski 2016; Rakotonarivo, Schaafsma, and Hockley 2016; Brouwer, Logar, and Sheremet 2017; Matthews, Scarpa, and Marsh 2017Hanley et al. 1998; Boyle et al. 2001; Caparros, Oviedo, and Campos 2008; Christie, and Azevedo 2009Bateman et al. 2009; Vossler, Doyon, and Rondeau 2012; Czajkowski et al. 2017; Howard et al. 2017; Jacquemet et al. 2017; Carson et al. 2020
    Agri-food economicsMørkbak and Olsen 2015; Rigby, Burton, and Pluske 2016Asioli et al. 2016; Yangui et al. 2019Carlsson, Frykblom, and Lagerkvist 2005; de-Magistris, Gracia, and Nayga 2013; de-Magistris and Pascucci 2014; Bello and Abdulai 2016; Lewis, Grebitus, and Nayga 2017; Kemper, Popp, and Nayga 2017; Wuepper, Clemm, and Wree 2019; Fang et al. 2020
    Health economicsBryan et al. 2000; Ryan et al. 2006; Skjoldborg, Lauridsen, and Junker 2009; Janssen et al. 2017; Price, Dupont, and Adamowicz 2017Van der Pol et al. 2008; Ryan and Watson 2009Özdemir, Johnson, and Hauber 2009
    Energy economicsLiebe, Meyerhoff, and Hartje 2012McNair, Bennett, and Hensher 2011Oehlmann and Meyerhoff 2017; Zawojska, Bartczak, and Czajkowski 2019
    Transportation economicsBörjesson 2014Raffaelli et al. 2021Fifer, Rose, and Greaves 2014; Haghani and Sarvi 2019; Mamkhezri et al. 2020
    Cross-sector studiesJohnston et al. 2017; Bishop and Boyle 2019; Mariel et al. 2021Holmes, Adamowicz, and Carlsson 2017; Johnston et al. 2017; Bishop and Boyle 2019; Lloyd-Smith, Zawojska, and Adamowicz 2021; Mariel et al. 2021List and Gallet 2001; Murphy et al. 2005; Johnston et al. 2017; Penn and Hu 2018; Bishop and Boyle 2019; Mariel et al. 2021
    • Note: This is far from an exhaustive list of works in the selected areas of research. The “Criterion Validity” column includes all the literature related to hypothetical bias and ex ante correction methods.

  • Table 2

    Steps in Each Experimental Treatment

    Discrete Choice Experiment (DCE) TreatmentChoice Matching Treatment
    StepDescriptionStepDescription
    1Prequestionnaire: respondents answer questions about how hungry and how full they feel1Prequestionnaire: respondents answer questions about how hungry and how full they feel
    N/A2Practice: respondents take part in a practice preference task and belief task
    2Preference task: respondents make choices in the 12 choice situations of the DCE (direct questioning, individual-level choices elicited)3Preference task: respondents make choices in the 12 choice situations of the DCE (direct questioning, individual-level choices elicited)
    N/A4Belief task: respondents make predictions about other respondents’ choice behavior (indirect questioning, population-level choices elicited)
    3Postquestionnaire: final questionnaire5Postquestionnaire: final questionnaire
    N/A6Payoff disclosure: respondents are informed regarding their additional payoff
    N/A7Payment respondents are given additional payment (if any)
  • Table 3

    Description and Interpretation of Testable Hypotheses

    ValidityReliability
    Null Hypothesis (Ho)InterpretationNull Hypothesisinterpretation
    ωOPT_OUT, MEAN, DCE≥ωOPT_OUT, MEAN, CMaRejecting H0 means that mWTP for the opt-out alternative is higher in CMa than in the DCE; CMa reduces HB when compared with the DCEωOPT_OUT, SD, DCE≤ωOPT_OUT, SD, CMaRejecting H0 means that standard deviations of price and nonprice coefficients are lower in CMa than in the DCE; CMa provides less dispersed coefficient values than the DCE
    ωFAT_A, MEAN, DCE≤ωFAT_A, MEAN, CMaRejecting H0 means that mWTP for the nonprice attributes are greater in the DCE than in CMa; CMa reduces HB when compared with the DCEωFAT_A, SD, DCE≤ωFAT_A, SD, CMa
    ωFAT_G, MEAN, DCE≤ωFAT_G, MEAN, CMaωFAT_G, SD, DCE≤ωFAT_G, SD, CMa
    ωSALT_A, MEAN, DCE≤ωSALT_A, MEAN, CMaωSALT_A, SD, DCE≤ωSALT_A, SD, CMa
    ωSALT_G, MEAN, DCE≤ωSALT_G, MEAN, CMaωSALT_G, SD, DCE≤ωSALT_G, SD, CMa
    ωPRICE, MEAN, DCE≥ωPRICE, MEAN, CMaRejecting H0 means that the impact of price on respondents’ decisions is lower in the DCE than in CMa; CMa reduces HB when compared with the DCEωPRICE, SD, DCE≤ωPRICE, SD, CMa
    τDCEτCMaRejecting H0 means that error variance in CMa is lower than in the DCE; CMa provides more deterministic choices than the DCE
    • Note: CMa, choice matching; DCE, discrete choice experiment; HB, hypothetical bias.

  • Table 4

    Random Parameter Logit Models Estimated in Willingness-to-Pay Space

    Dependent VariableModel 1 (CMa)Model 2 (DCE)
    ChoiceChoice
    CoefficientCoefficient
    ωOPT_OUT, MEAN1 342***1.865***
    (0.391)(0.477)
    ωFAT_A, MEAN1.320***1.569***
    (0.198)(0.353)
    ωFAT_G, MEAN2.406***2.584***
    (0.311)(0.464)
    ωSALT_A, MEAN0.783***0.459*
    (0.188)(0.251)
    ωSALT_G, MEAN1.571***1.633***
    (0.188)(0.316)
    ωANT, MEAN0.861***0.879***
    (0.141)(0.179)
    ωMEAN−0.981***−1.344**
    (0.135)(0.566)
    ωOPT_OUT, SD2.297***4.698***
    (0.384)(0.862)
    ωFAT_A, SD0.352*0.653***
    (0.194)(0.224)
    ωFAT_G, SD0.673**1.970***
    (0.257)(0.389)
    ωSALT_A, SD0.881***1.602***
    (0.223)(0.328)
    ωSALT_G, SD0.4902.345***
    (0.345)(0.450)
    ωANT, SD0.919***2.579***
    (0.206)(0.504)
    αSD0.800**1.741
    (0.398)(1.326)
    τ0.611***0.993***
    (0.160)(0.232)
    Subjects6664
    Observations2,3762,304
    Log-likelihood−648.447−645.453
    BIC1,413.4921,407.042
    • Note: Robust standard errors are in parentheses. BIC, Bayesian information criterion; CMa, choice matching; DCE, discrete choice experiment.

    • * p < 0.10;

    • ** p < 0.05;

    • *** p < 0.01.

  • Table 5

    Comparison of Distributional Means and Standard Deviation of Estimated Coefficients across Treatments

    CoefficientsChoice MatchingDiscrete Choice ExperimentH0 (Null Hypothesis)p-value
    ωOPT_OUT,MEAN1.345
    (0.677; 1.975)
    1.875
    (1.037; 2.648)
    ωOPT_OUT,MEAN,DCE≥ωOPT_OUT,MEAN,CMa0.802
    ωFAT_A,MEAN1.317
    (1.004; 1.636)
    1.584
    (1.002; 2.157)
    ωFAT_A,MEAN,DCE≤ωFAT_A,MEAN,CMa0.252
    ωFAT_G,MEAN2.408
    (1.897; 2.915)
    2.585
    (1.795; 3.343)
    ωFAT_G,MEAN,DCE≤ωFAT_G,MEAN,CMa0.376
    ωSALT_A,MEAN0.788
    (0.479; 1.107)
    0.465
    (0.048; 0.874)
    ωSALT_A,MEAN,DCE≤ωSALT_A,MEAN,CMa0.845
    ωSALTT_A,MEAN1.573
    (1.253; 1.880)
    1.645
    (1.089; 2.170)
    ωSALTT_A,MEAN,DCE≤ωSALT_A,MEAN,CMa0.419
    ωANT,MEAN0.866
    (0.636; 1.093)
    0.879
    (0.599; 1.185)
    ωANT,MEAN,DCE≤ωANT,MEAN,CMa0.479
    ωPRICE,MEAN−1.033
    (−1.540; −0.674)
    −1.556
    (−2.988; −0.704)
    ωPRICE,MEAN,DCE≤ωPRICE,MEAN,CMa0.754
    ωOPT_OUT,SD2.300
    (1.674; 2.934)
    4.722
    (3.184; 6.119)
    ωOPT_OUT,SD,DCE≤ωOPT_OUT,SD,CMa0.007
    ωFAT_A,SD0.358
    (0.031; 0.686)
    0.662
    (0.289; 1.033)
    ωFAT_A,SD,DCE≤ωFAT_A,SD,CMa0.156
    ωFT_G,SD0.671
    (0.221; 1.144)
    1.975
    (1.305; 2.625)
    ωFT_G,SD,DCE≤ωFAT_G,SD,CMa0.005
    ωSALT_A,SD0.886
    (0.506; 1.240)
    1.613
    (1.050; 2.154)
    ωSALT_A,SD,DCE≤ωSALT_A,SD,CMa0.363
    ωSALT_G,SD0.469
    (0.106; 1.045)
    2.355
    (1.603; 3.121)
    ωSALT_G,SD,DCE≤ωSALT_G,SD,CMa0.001
    ωANT,SD0.922
    (0.554; 1.727)
    2.603
    (1.691; 3.416)
    ωANT,SD,DCE≤ωANT,SD,CMa0.002
    ωPRICE,SD0.847
    (0.470; 1.439)
    1.840
    (0.533; 4.756)
    ωPRICE,SD,DCE≤ωPRICE,SD,CMa0.203
    τ0.721
    (0.462; 0.974)
    1.010
    (0.627; 1.417)
    τDCEτCMa0.845
    • Note: The comparison uses the test in Poe, Giraud, and Loomis (2005); 5% and 95% percentiles are in parentheses.