Approximate Posterior Inference for Multiple Testing using a Hierarchical Mixed-effect Poisson Regression Model


We present an approximate posterior inference  methodology for a Bayesian hierarchical mixed-effect Poisson regression model. The model serves us to address the multiple testing problem in the presence of many group or cluster effects. This is carried out through a specialized Bayesian false discovery rate procedure.
The likelihood is simplified by an approximation based on Laplace's approximation for integrals and a trace approximation for the determinants. The posterior marginals are estimated using this approximated likelihood. In particular, we obtain credible regions for the parameters, as well as probability estimates for the difference between risks (Poisson intensities) associated with different groups or clusters, or different levels of the fixed effects. The methodology is illustrated through an application to a vaccine trial.

DOI Code: 10.1285/i20705948v11n2p622

Keywords: Laplace's approximation; multiple comparison; pseudo-likelihood; Bayesian false discovery rate; vaccine trial


Albert, J. (1992). A Bayesian analysis of a Poisson random effects model for home run hitters. The American Statistician, 46:246-253.

Allan, J., Carbonell, J., Doddington, G., Yamron, J., and Yang, Y. (1998). Topic detec-tion and tracking pilot study: Final report. In Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop, pages 194-218.

Barndord-Nielsen, O. E. and Cox, D. R. (1994). Inference and Asymptotics. Chapman & Hall.

Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57:289-300.

Berry, S. M. and Berry, D. A. (2004). Accounting for multiplicities in assessing drug safety: a three-level hierarchical mixture model. Biometrics, 60:418-426.

Brazzale, A. R., Davison, A. C., and Reid, N. (2007). Applied Asymptotics: Case Studies in Small-Sample Statistics. Cambridge University Press.

Breslow, N. E. and Lin, X. (1995). Bias-correction in generalized linear mixed models with a single component of dispersion. Biometrika, 82:81-91.

Carlin, B. and Gelfand, A. (1991). A sample reuse method for accurate parametric empirical Bayes confidence intervals. Journal of the Royal Statistical Society, Series B, 53:189-200.

Christiansen, C. L. and Morris, C. (1996). Fitting and checking a two-level Poisson model: modeling patient mortality rates in heart transplant patients, pages 467-501.

Marcel Dekker, New York. Berry, D. and Stangl, D., editors. Christiansen, C. L. and Morris, C. (1997). Hierarchical Poisson regression modeling. Journal of the American Statistical Association, 92:618-632.

Davison, A. C. (1986). Approximate predictive likelihood. Biometrika, 73(2):323-332.

Frome, E. L. (1983). The analysis of rates using Poisson regression models. Biometrics, 39:665-674.

Gaver, D. P. and O'Muircheartaigh, I. G. (1987). Robust empirical Bayes analysis of event rates. Technometrics, 29:1-15.

Guihenneuc-Jouyaux, C. and Rousseau, J. (2007). Laplace expansions in Markov chain Monte Carlo algorithms. Journal of Computational and Graphical Statistics, 14(1):75-94.

Holford, T. R. (1980). The analysis of rates and of survivorship using log-linear models. Biometrics, 36:299-305.

Joe, H. (2008). Accuracy of Laplace approximation for discrete response mixed models. Computational Statistics and Data Analysis, 52:5066-5074.

Johnson, V. E. (1992). A technique for estimating marginal posterior densities in hierarchical models using mixtures of conditional densities. Journal of the American Statistical Association, 87:852-860.

Kuk, A. Y. C. (1999). Laplace Important Sampling for generalized linear mixed models. Journal of Statistical Computation and Simulation, 63:143-158.

Lunn, D., Spiegelhalter, D., Thomas, A., and Best, N. (2009). The bugs project: evolution, critique and future directions. Statistics in Medicine, 28:3049-67.

Mehrotra, D. V. and Heyse, J. F. (2004). Use of the false discovery rate for evaluating clinical safety data. Statistical Methods in Medical Research, 13:227-238.

Morokoff, W. J. and Caisch, R. E. (1995). Quasi-Monte Carlo integration. Journal of Computational Physics, pages 218-230.

Morris, C. N. (1983). Parametric empirical Bayes confidence intervals, pages 25-50. Academic Press, New York.

Nott, J. D., Fielding, M., and Leonte, D. (2009). On a generalization of the Laplace approximation. Statistics and Probability Letters, 79:1397-1403.

Pinheiro, J. C. and Bates, D. M. (1995). Approximations to the log-likelihood function in the non-linear mixed-effects model. Journal of Computational and Graphical Statistics, 4:12-35.

Plummer, M. (2013). rjags: Bayesian graphical models using MCMC. R package version 3-10.

Raudenbush, S. W., Yang, M. L., and Yosef, M. (2000). Maximum likelihood for generalized linear models with nested random effects via high-order, multivariate Laplace approximation. Journal of Computational and Graphical Statistics, 9:141-157.

Santamaria, R., Quintales, L., and Theron, R. (2007). Methods to bicluster validation and comparison in microarray data. IDEAL 07 Proceedings of the 8th international conference on Intelligent data engineering and automated learning, pages 780-789.

Severini, T. (2000). Likelihood Methods in Statistics. Oxford University Press.

Skaug, H. J. and Fournier, D. A. (2006). Automatic approximation of the marginal likelihood in non-Gaussian hierarchical models. Computational Statistics and Data Analysis, 51:699-709.

Sutradhar, B. C. and Zhende, Q. (1998). On approximate likelihood inference in a Poisson mixed model. The Canadian Journal of Statistics, 26:169-186.

Tempelman, R. J. and Gianola, D. (1996). A mixed effects model for overdispersed count data in animal breeding. Biometrics, 52:265-279.

The BUGS Project (2012). Hosted by the MRC Biostatistics Unit, Cambridge, UK.

Full Text: pdf

Creative Commons License
This work is licensed under a Creative Commons Attribuzione - Non commerciale - Non opere derivate 3.0 Italia License.