Article
Licensed
Unlicensed Requires Authentication

A Model of Heterogeneous Multicategory Choice for Market Basket Analysis

  • EMAIL logo and
Published/Copyright: September 28, 2013

Abstract

Based on market basket data, using multicategory purchase incidence models, we analyze demand interdependencies between product categories. We propose a finite mixture multivariate logit model to derive segment-specific intercategory effects of market basket purchase. Under the assumption that only a fraction of intercategory effects are significant, we exclude irrelevant effects by variable selection. This leads to a detailed description of consumers’ shopping behavior that varies over segments not only with respect to (w.r.t.) parameters’ values but also w.r.t. included interaction effects. As the high number of product categories in the model prohibits exact maximum likelihood estimation, we adopt pseudo-likelihood estimation. We apply our model to a data set with 31 product categories and 1,794 households purchasing 17,280 baskets in one store. The best fitting model is determined by predictive model selection. We find that a homogeneous model would overestimate the intensity of interaction between product categories.

Appendix: pseudo-likelihood estimation

The FM-MVL model is estimated in iterations each consisting of three sampling steps. First, the membership probability of each household h for segment k is sampled. Given an assignment of households to components based on the probabilities in step 1, components are independent (Shi, Murray-Smith, and Titterington 2005). As mentioned before, we assume that not all interaction effects contribute to the explanation of purchase behavior and include a variable selection step that determines which effects are not significantly different from zero, that is, which categories are pairwise independent (step 2). This step is located between segmentation and parameter estimation. Afterward, component-specific parameters are drawn by a hybrid Monte Carlo step (Duane et al. 1987; Horowitz 1991; Neal 1996) that simulates a dynamical (Hamiltonian) system (step 3). The advantage of a hybrid MC algorithm is the possibility to suppress random walks for a sequence of steps L thus enabling a guided search for new parameter values (Neal 1996). In each iteration, step 2 and step 3 are performed for every component k. If possible, we suppress the iteration index t in the following for ease of exposition.

Sampling details

Step 1: The membership probability of household h for component k given the component assignments z of all other households is evaluated by a Gibbs sampling step according to

[15]
[15]

with and (Shi, Murray-Smith, and Titterington 2005). With these probabilities, the complete household assignment to segments z is sampled for one iteration resulting in K subsets of households with a total of market baskets that are assigned to a segment k. The intractable joint basket probability is replaced with the respective PL value . is calculated as in Shi, Murray-Smith, and Titterington (2005).

Step 2: We make use of an algorithm explained in Geweke (2005) for linear regression which Dippold and Hruschka (2013) applied to a homogeneous logit model. Given its contribution to the explanation of purchase behavior, the probability of being zero is determined for every single interaction18 parameter conditioned on the other parameters determined as significant within the component as

[16]
[16]

being the stochastic utility of a purchase in category j for a market basket i given segment k with random uniform numbers , as proposed in Tüchler (2008). The precision is distributed as

[17]
[17]

with the sum of squared errors and the number of baskets assigned to category k, , as well as prior values for variance and free parameters .

Only if this probability is smaller than a random uniform number , the respective interaction parameter is sampled in the next step.

Step 3: Assuming an a priori independence of parameters across segments, we can sample segment-specific significant parameters independently for each segment with

[18]
[18]

where serves as prior. Again, is replaced with . In a hybrid MC, the conditional parameter sampling density is conceived to be as proportional to a fictitious potential energy , that is,

[19]
[19]

treating the parameters like position parameters in a dynamical system. For every parameter within , a respective momentum vector with npar elements is defined. Together with the associated kinetic energy (mass as suggested by Rasmussen (1996)), we get the total energy of the system . This total energy H facilitates draws from the joint distribution of the parameters in the dynamical system, because

[20]
[20]

This relation is used for updating position and momentum parameters in a stepwise process. Holding the total energy H constant within one iteration allows for a sequence of L directed improvements of values. These substeps L are called leap-frog steps. With one leap-frog step and step size , the parameter update for one parameter of , for example, with respective momentum variable , reads as (Shi, Murray-Smith, and Titterington 2005)

[21]
[21]

We use and for burn-in, afterward and . After one iteration, the value for the kinetic and consequently also the total system energy are slightly changed by perturbating thus exploring the whole phase space (Neal 1996). In a Metropolis–Hastings step, the new estimates are proposed as new parameters with probability . Further details on these sampling steps can be found in Neal (1996) and Shi, Murray-Smith, and Titterington (2005).

References

Abramson, C., R. L.Andrews, I. S.Currim, and M.Jones. 2000. “Parameter Bias from Unobserved Effects in the Multinomial Logit Model of Consumer Choice.” Journal of Marketing Research37(4):41026.10.1509/jmkr.37.4.410.18791Search in Google Scholar

Ainslie, A., and P. E.Rossi. 1998. “Similarities in Choice Behavior across Product Categories.” Marketing Science17(2):91106.10.1287/mksc.17.2.91Search in Google Scholar

Akaike, H.. 1974. “A New Look at the Statistical Model Identification.” IEEE Transactions on Automatic Control19(6):71623.10.1109/TAC.1974.1100705Search in Google Scholar

Allenby, G. M., N.Arora, and J.Ginter. 1998. “On the Heterogeneity of Demand.” Journal of Marketing Research35(3):3849.10.1177/002224379803500308Search in Google Scholar

Allenby, G. M., and P. E.Rossi. 1999. “Marketing Models of Consumer Heterogeneity.” Journal of Econometrics89(1–2):5778.10.1016/S0304-4076(98)00055-4Search in Google Scholar

Andrews, R. L., A.Ainslie, and I. S.Currim. 2002. “An Empirical Comparison of Logit Choice Models with Discrete Versus Continuous Representations of Heterogeneity.” Journal of Marketing Research39(4):47987.10.1509/jmkr.39.4.479.19124Search in Google Scholar

Andrews, R. L., and I. S.Currim. 2002. “Identifying Segments with Identical Choice Behaviors across Product Categories: An Intercategory Logit Mixture Model.” International Journal of Research in Marketing19(1):6579.10.1016/S0167-8116(02)00048-4Search in Google Scholar

Andrews, R. L., and I. S.Currim. 2003. “A Comparison of Segment Retention Criteria for Finite Mixture Logit Models.” Journal of Marketing Research40(2):23543.10.1509/jmkr.40.2.235.19225Search in Google Scholar

Besag, J.1974. “Spatial Interaction and the Statistical Analysis of Lattice Systems.” Journal of the Royal Statistical Society Series B36(2):192236.10.1111/j.2517-6161.1974.tb00999.xSearch in Google Scholar

Besag, J.1975. “Statistical Analysis of Non-Lattice Data.” The Statistician24(3):17995.10.2307/2987782Search in Google Scholar

Besag, J.1977. “Efficiency of Pseudolikelihood Estimation for Simple Gaussian Fields.” Biometrika64(3):61618.10.1093/biomet/64.3.616Search in Google Scholar

Betancourt, R., and D.Gautschi. 1990. “Demand Complementarities, Household Production, and Retail Assortments.” Marketing Science9(2):14661.10.1287/mksc.9.2.146Search in Google Scholar

Boatwright, P., S.Dhar, and P. E.Rossi. 2004. “The Role of Retail Competition, Demographics and Account Retail Strategy as Drivers of Promotional Sensitivity.” Quantitative Marketing and Economics2(2):16990.10.1023/B:QMEC.0000027777.29554.8bSearch in Google Scholar

Boztuğ, Y., and L.Hildebrandt. 2008. “Modeling Joint Purchases with a Multivariate MNL Approach.” Schmalenbach Business Review60(October):40022.10.1007/BF03396777Search in Google Scholar

Boztuğ, Y., and T.Reutterer. 2008. “A Combined Approach for Segment-Specific Market Basket Analysis.” European Journal of Operational Research187(1):294312.10.1016/j.ejor.2007.03.001Search in Google Scholar

Boztuğ, Y., and N.Silberhorn. 2006. “Modellierungsansätze in Der Warenkorbanalyse Im Überblick.” Journal Für Betriebswirtschaft56(2):10528.10.1007/s11301-006-0008-5Search in Google Scholar

Bronnenberg, B. J., M. W.Kruger, and C. F.Mela. 2008. “The IRI Marketing Data Set.” Marketing Science27(4):7458.10.1287/mksc.1080.0450Search in Google Scholar

Carlin, B. P., and T. A.Louis. 2000. Bayes and Empirical Bayes Methods for Data Analysis. Boca Raton, FL: Chapman & Hall/CRC.10.1201/9781420057669Search in Google Scholar

Carreira-Perpiñán, M. A., and G. E.Hinton. 2005. “On Contrastive Divergence Learning.” In Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, edited by R. G.Cowell and Z.Ghahramani. Barbados:Savannah Hotel.Search in Google Scholar

Celeux, G.. 1998. “Bayesian Inference for Mixtures: The Label Switching Problem.” In COMPSTAT 98, edited by R.Payne and P.Green, 22732. Heidelberg: Physica.10.1007/978-3-662-01131-7_26Search in Google Scholar

Chiang, J.1991. “A Simultaneous Approach to the Whether, What and How Much to Buy Question.” Marketing Science10(4):297315.10.1287/mksc.10.4.297Search in Google Scholar

Chib, S., P. B.Seetharaman, and A.Strijnev. 2002. “Analysis of Multi-Category Purchase Incidence Using IRI Market Basket Data.” In Econometric Models in Marketing, edited by P. H.Franses and A. L.Montgomery, vol. 16, 5792. Amsterdam: JAI.10.1016/S0731-9053(02)16004-XSearch in Google Scholar

Cox, D. R.1972. “The Analysis of Multivariate Binary Data.” Journal of the Royal Statistical Society Series C (Applied Statistics)21(2):11320.10.2307/2346482Search in Google Scholar

Cressie, N. C.1993. Statistics for Spatial Data. Revised Edition. New York: John Wiley & Sons.10.1002/9781119115151Search in Google Scholar

Dippold, K., and H.Hruschka. 2013. “Variable Selection for Market Basket Analysis.” Computational Statistics and Data Analysis, 28(2):519539.10.1007/s00180-012-0315-3Search in Google Scholar

Duane, S., A. D.Kennedy, B. J.Pendleton, and D.Roweth. 1987. “Hybrid Monte Carlo.” Physics Letters B195(2):21622.10.1016/0370-2693(87)91197-XSearch in Google Scholar

Duvvuri, S. D., A.Ansari, and S.Gupta. 2007. “Consumers’ Price Sensitivities across Complementary Categories.” Management Science53(12):193345.10.1287/mnsc.1070.0744Search in Google Scholar

Efron, B., and R. J.Tibshirani. 1998. An Introduction to the Bootstrap: Monographs on Statistics and Applied Probability, vol. 57. Boca Raton, FL: Chapman & Hall/CRC.Search in Google Scholar

Frühwirth-Schnatter, S.2006. Finite Mixture and Markov Switching Models. New York: Springer.Search in Google Scholar

Geweke, J.2005. Contemporary Bayesian Econometrics and Statistics. Hoboken, NJ: John Wiley & Sons.10.1002/0471744735Search in Google Scholar

Guadagni, P. M., and J. D. C.Little. 1983. “A Logit Model of Brand Choice Calibrated on Scanner Data.” Marketing Science2(3):20338.10.1287/mksc.2.3.203Search in Google Scholar

Gupta, S.1988. “Impact of Sales Promotions on When, What, and How Much to Buy.” Journal of Marketing Research25(4):34255.10.1177/002224378802500402Search in Google Scholar

Gupta, S., and P. K.Chintagunta. 1994. “On Using Demographic Variables to Determine Segment Membership in Logit Mixture Models.” Journal of Marketing Research31(1):2836.Search in Google Scholar

Hansen, K. T., V.Singh, and P. K.Chintagunta. 2006. “Understanding Store-Brand Purchase Behavior across Categories.” Marketing Science25(1):7590.10.1287/mksc.1050.0151Search in Google Scholar

Hoch, S. J., B. -D.Kim, A. L.Montgomery, and P. E.Rossi. 1995. “Determinants of Store-Level Price Elasticity.” Journal of Marketing Research32(1):1729.10.1177/002224379503200104Search in Google Scholar

Horowitz, A. M.1991. “A Generalized Guided Monte Carlo Algorithm.” Physics Letters B268(2):24752.10.1016/0370-2693(91)90812-5Search in Google Scholar

Hruschka, H.1991. “Bestimmung Der Kaufverbundenheit Mit Hilfe Eines Probabilistischen Meßmodells.” Zfbf Zeitschrift Für Betriebswirtschaftliche Forschung43:41834.Search in Google Scholar

Hruschka, H.2013. “Comparing Small and Large Scale Models of Multicategory Buying Behavior.” International Journal of Forecasting, 423434.Search in Google Scholar

Hruschka, H., M.Lukanowicz, and C.Buchta. 1999. “Cross-Category Sales Promotion Effects.” Journal of Retailing and Consumer Services6(2):99105.10.1016/S0969-6989(98)00026-5Search in Google Scholar

Huang, F., and Y.Ogata. 2002. “Generalized Pseudo-Likelihood Estimates for Markov Random Fields on Lattice.” Annals of the Institute of Statistical Mathematics54(1):118.10.1023/A:1016170102988Search in Google Scholar

Hyvärinen, A.2006. “Consistency of Pseudolikelihood Estimation of Fully Visible Boltzmann Machines.” Neural Computation18(10):228392.10.1162/neco.2006.18.10.2283Search in Google Scholar

Kim, B.-D., K.Srinivasan, and R. T.Wilcox. 1999. “Identifying Price Sensitive Consumers: The Relative Merits of Demographic vs. Purchase Pattern Information.” Journal of Retailing75(2):17393.10.1016/S0022-4359(99)00003-2Search in Google Scholar

Kruger, M. W., and D.Pagni. 2008. IRI Academic Data Set Description, Version 1.31. Chicago: Information Resources Incorporated.Search in Google Scholar

Laud, P. W., and J. G.Ibrahim. 1995. “Predictive Model Selection.” Journal of the Royal Statistical Society Series B57(1):24762.10.1111/j.2517-6161.1995.tb02028.xSearch in Google Scholar

Magnussen, S., and R.Reeves. 2007. “Sample-Based Maximum Likelihood Estimation of the Autologistic Model.” Journal of Applied Statistics34(5):54761.10.1080/02664760701234967Search in Google Scholar

Manchanda, P., A.Ansari, and S.Gupta. 1999. “The ‘Shopping Basket’: A Model for Multi-Category Purchase Incidence Decisions.” Marketing Science18(2):95114.10.1287/mksc.18.2.95Search in Google Scholar

McFadden, D.1974. “Conditional Logit Analysis of Qualitative Choice Behavior.” In Frontiers in Econometrics, edited by P.Zarembka, 10542. New York: Academic Press.Search in Google Scholar

Mild, A. and Reutterer, T. 2003. “An improved collaborative filtering approach for predicting cross-category purchases based on binary market basket data.” Journal of Retailing and Consumer Services10(3):123133.10.1016/S0969-6989(03)00003-1Search in Google Scholar

McLachlan, G. J., and D.Peel. 2000. Finite Mixture Models. New York: John Wiley & Sons.10.1002/0471721182Search in Google Scholar

Moon, S., and G. J.Russell. 2004. A Spatial Choice Model for Product Recommendations. Working Paper, Tippie School of Business, University of Iowa.Search in Google Scholar

Neal, R. M.1996. Bayesian Learning for Neural Networks. Lecture Notes in Statistics 118. New York: Springer.10.1007/978-1-4612-0745-0Search in Google Scholar

Niraj, R., V.Padmanabhan, and P. B.Seetharaman. 2008. “Research Note: A Cross-Category Model of Households’ Incidence and Quantity Decisions.” Marketing Science27(2):22535.10.1287/mksc.1070.0299Search in Google Scholar

Nylund, K. L., T.Asparouhov, and B. O.Muthen. 2007. “Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation Study.” Structural Equation Modeling14(4):53569.10.1080/10705510701575396Search in Google Scholar

Osindero, S., M.Welling, and G. E.Hinton. 2006. “Topographic Product Models Applied to Natural Scene Statistics.” Neural Computation18(2):381414.10.1162/089976606775093936Search in Google Scholar

Rasmussen, C. E.1996. “Evaluation of Gaussian Processes and Other Methods for Non-Linear Regression.” PhD Thesis, University of Toronto.Search in Google Scholar

Rossi, P. E., R. E.McCulloch, and G. E.Allenby. 1996. “The Value of Purchase History Data in Target Marketing.” Marketing Science15(4):32140.10.1287/mksc.15.4.321Search in Google Scholar

Russell, G. J., and A.Petersen. 2000. “Analysis of Cross Category Dependence in Market Basket Selection.” Journal of Retailing76(3):31932.10.1016/S0022-4359(00)00030-0Search in Google Scholar

Russell, G. J., S.Ratneshwar, A. D.Shocker, D.Bell, A.Bodapati, A.Degeratu, L.Hildebrandt, N.Kim, S.Ramaswami, and V. H.Shankar. 1999. “Multi-Category Decision-Making: Review and Synthesis.” Marketing Letters10(3):31932.10.1023/A:1008143526174Search in Google Scholar

Schwarz, G.1978. “Estimating the Dimension of a Model.” The Annals of Statistics6(2):4614.10.1214/aos/1176344136Search in Google Scholar

Seetharaman, P. B., A.Ainslie, and P. K.Chintagunta. 1999. “Investigating Household State Dependence Effects across Categories.” Journal of Marketing Research36(4):488500.10.1177/002224379903600407Search in Google Scholar

Seetharaman, P. B., C.Siddhartha, A.Ainslie, P.Boatwright, T.Chan, S.Gupta, N.Mehta, V.Rao, and A.Strijnev. 2005. “Models of Multi-Category Choice Behavior.” Marketing Letters16(3–4):23954.10.1007/s11002-005-5888-ySearch in Google Scholar

Sherman, M., T. V.Apanasovich, and R. J.Carroll. 2006. “On Estimation in Binary Autologistic Spatial Models.” Journal of Statistical Computation and Simulation76(2):16779.10.1080/00949650412331320873Search in Google Scholar

Shi, J. Q., R.Murray-Smith, and D. M.Titterington. 2005. “Hierarchical Gaussian Process Mixtures for Regression.” Statistics and Computing15(1):3141.10.1007/s11222-005-4787-7Search in Google Scholar

Singh, V. P., K. T.Hansen, and S.Gupta. 2005. “Modeling Preferences for Common Attributes in Multi-Category Brand Choice.” Journal of Marketing Research42(2):195209.10.1509/jmkr.42.2.195.62282Search in Google Scholar

Song, I., and P. K.Chintagunta. 2007. “A Discrete-Continuous Model for Multicategory Purchase Behavior of Households.” Journal of Marketing Research44(4):595612.10.1509/jmkr.44.4.595Search in Google Scholar

Spiegelhalter, D. J., N. G.Best, B. P.Carlin, and A.van der Linde. 2002. “Bayesian Measures of Model Complexity and Fit.” Journal of the Royal Statistical Society Series B64(4):583639.10.1111/1467-9868.00353Search in Google Scholar

Tüchler, R.2008. “Bayesian Variable Selection for Logistic Models Using Auxiliary Mixture Sampling.” Journal of Computational and Graphical Statistics17(1):7694.10.1198/106186008X289849Search in Google Scholar

Varki, S., and P. K.Chintagunta. 2004. “The Augmented Latent Class Model: Incorporating Additional Heterogeneity in the Latent Class Model for Panel Data.” Journal of Marketing Research41(2):22633.10.1509/jmkr.41.2.226.28666Search in Google Scholar

Wang, H. D., M. U.Kalwani, and T.Akcura. 2007. “A Bayesian Multivariate Poisson Regression Model of Cross-Category Store Brand Purchasing Behavior.” Journal of Retailing and Consumer Service14(6):36982.10.1016/j.jretconser.2007.02.004Search in Google Scholar

Wang, L., J.Liu, and S. Z.Li. 2000. “MRF Parameter Estimation by MCMC Method.” Pattern Recognition33(11):191925.10.1016/S0031-3203(99)00178-8Search in Google Scholar

Wedel, M., and W. A.Kamakura. 1998. Market Segmentation: Conceptual and Methodological Foundations. International Series in Quantitative Marketing. Boston, MA: Kluwer Academic Publishers.Search in Google Scholar

Wedel, M., W. A.Kamakura, N.Arora, A.Bemmaor, J.Chiang, T.Elrod, R.Johnson, P.Lenk, S.Neslin, and C. S.Poulsen. 1999. “Discrete and Continuous Representations of Unobserved Heterogeneity in Choice Modeling.” Marketing Letters10(3):21932.10.1023/A:1008054316179Search in Google Scholar

  1. 1

    Examples for this approach which deal with another multicategory problem by focusing on the covariance of coefficients across categories are the probit models of Ainslie and Rossi (1998) and Seetharaman, Ainslie, and Chintagunta (1999) or the logit models of Hansen, Singh, and Chintagunta (2006) and Singh, Hansen, and Gupta (2005). In the latter two studies, a factor analytic structure is imposed on the covariance matrix of coefficients.

  2. 2

    There has been a long discussion on the performance of finite vs continuous mixture models (e.g. Wedel et al. 1999; for a short summary, see Varki and Chintagunta 2004). Whereas Allenby, Arora, and Ginter (1998) and Allenby and Rossi (1999) argue that FM models do not sufficiently represent consumer heterogeneity, especially when the number of segments is small and complete homogeneity within a segment is an unrealistic assumption, Andrews, Ainslie, and Currim (2002) do not find any performance superiority of the continuous over the FM models. Even for a very limited number of segments (one to three), the continuous and the discrete model recover parameters and forecast holdout data equally well. Additionally, Wedel and Kamakura (1998) and Wedel et al. (1999) stress the consistency of the FM model with the way management thinks about consumers in segments.

  3. 3

    Segment is the marketing interpretation of a component in a FM model. Therefore, the terms segment and component are used interchangeably in the text.

  4. 4

    In contrast to probit models, there is no biasing effect of joint non-purchase that would be the most frequently occurring event. We also remark that we follow the cross-category effect definition by Hruschka, Lukanowicz, and Buchta (1999). In contrast to Russell and Petersen (2000), cross-category effects do not depend on a household’s typical basket size. This modeling decision is justified, because (1) the inclusion of basket size resulted only in a weak improvement of the LL value for holdout data in the RP model and (2) our model already accounts for interaction effect variability by estimating different effects for different segments.

  5. 5

    We thank one anonymous reviewer who suggested to discuss this issue and drew our attention to the latent variable interpretation of co-incidence. We also thank the editor for suggesting relevant references.

  6. 6

    With , Z has elements, that is, all possible market baskets. Huang and Ogata (2002) observe exponents between 9 and 15 to be the limit of computation.

  7. 7

    The general disadvantage of wrong standard errors can be easily adjusted for, as correct standard errors can be computed with bootstrapping (e.g. Efron and Tibshirani 1998).

  8. 8

    This two-step approach is conventionally used in FM models for multicategory choice (e.g. Song and Chintagunta 2007).

  9. 9

    See, for example, Andrews and Currim (2002) for a complete tabulation including formulas for calculations.

  10. 10

    We argue that the homogeneous model smoothes interaction effects. The lower number of interaction effects included for the heterogeneous model might also contribute to such results. Boztuğ and Reutterer (2008) formulate a similar hypothesis, though they motivate it differently. Chib, Seetharaman, and Strijnev (2002) present the opposite effect.

  11. 11

    Our model specification does not include RP’s category-specific household variables time since last category purchase (TIME) and loyalty (LOYAL). As this model is estimated over the purchases within one shop only neglecting purchases in other stores, we do not have complete information on a consumer’s shopping history. Therefore, the values of TIME and LOYAL would not be meaningful. Besides, we already account for heterogeneity with the FM model and do not need auxiliary measures of consumer diversity.

  12. 12

    Test runs showed that the model parameters and especially the household assignment to segments stabilize quickly.

  13. 13

    For reasons of comparability, PLL is also calculated for the independence model whose parameters are estimated by ML.

  14. 14

    We only consider interaction effects larger than 0.001 in absolute size.

  15. 15

    We thank one anonymous reviewer who recommended to compare the results of our model to those obtained by a correlational analysis.

  16. 16

    Household income in thousand US$.

  17. 17

    HS: high school; C: college; TS: technical school; PG: postgraduate work. SC: some college, what means that the person left college without a degree.

  18. 18

    For model stability, variable selection is not applied to category constants or marketing-mix coefficients.

Published Online: 2013-09-28

©2013 by Walter de Gruyter Berlin / Boston

Downloaded on 11.4.2026 from https://www.degruyterbrill.com/document/doi/10.1515/roms-2012-0001/html
Scroll to top button