# Maximum likelihood estimation in log-linear models

@article{Fienberg2012MaximumLE, title={Maximum likelihood estimation in log-linear models}, author={Stephen E. Fienberg and Alessandro Rinaldo}, journal={Annals of Statistics}, year={2012}, volume={40}, pages={996-1023} }

We study maximum likelihood estimation in log-linear models under conditional Poisson sampling schemes. We derive necessary and sufficient conditions for existence of the maximum likelihood estimator (MLE) of the model parameters and investigate estimability of the natural and mean-value parameters under a nonexistent MLE. Our conditions focus on the role of sampling zeros in the observed table. We situate our results within the framework of extended exponential families, and we exploit the… Expand

#### Figures and Tables from this paper

#### 83 Citations

MAXIMUM LIKELIHOOD ESTIMATION IN LOG-LINEAR

- 2012

We study maximum likelihood estimation in log-linear models under conditional Poisson sampling schemes. We derive necessary and sufficient conditions for existence of the maximum likelihood estimator… Expand

Log-Linear Models: Estimation

- Mathematics
- 2018

Maximum likelihood estimation of log-linear models is considered as a special case of maximum likelihood estimation in exponential families, with the mixed parameterization used in the definition of… Expand

Maximum Likelihood Estimate in Discrete Hierarchical Log-Linear Models

- Mathematics
- 2017

Hierarchical log-linear models are essential tools used for relationship identification between variables in complex high-dimensional problems. In this thesis we study two problems: the computation… Expand

Explorer Parameter redundancy and the existence of the maximum likelihood estimates in log-linear models

- 2018

In fitting log-linear models to contingency table data, the presence of zero cell entries can have an adverse effect on the estimability of parameters, due to parameter redundancy. We describe a… Expand

Maximum lilkelihood estimation in the $\beta$-model

- Mathematics, Computer Science
- 2013

This work derives necessary and sufficient conditions, based on the polytope of degree sequences, for the existence of the maximum likelihood estimator (MLE) of the model parameters, and forms conditions that guarantee that the MLE exists with probability tending to one as the number of nodes increases. Expand

Toric invariant theory for maximum likelihood estimation in log-linear models

- Mathematics
- 2020

We establish connections between invariant theory and maximum likelihood estimation for discrete statistical models. We show that norm minimization over a torus orbit is equivalent to maximum… Expand

Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist

- Mathematics
- 2018

In a regular full exponential family, the maximum likelihood estimator (MLE) need not exist, in the traditional sense, but the MLE may exist in the Barndorff-Nielsen completion of the family.… Expand

A local approach to estimation in discrete loglinear models

- Mathematics
- 2015

We consider two connected aspects of maximum likelihood estimation of the parameter for high-dimensional discrete graphical models: the existence of the maximum likelihood estimate (mle) and its… Expand

Accurate directional inference for vector parameters

- Mathematics
- 2016

We consider statistical inference for a vector-valued parameter of interest in a regular asymptotic model with a finite-dimensional nuisance parameter. We use highly accurate likelihood theory to… Expand

Distributed parameter estimation of discrete hierarchical models via marginal likelihoods

- Mathematics
- 2013

We consider discrete graphical models Markov with respect to a graph $G$ and propose two distributed marginal methods to estimate the maximum likelihood estimate of the canonical parameter of the… Expand

#### References

SHOWING 1-10 OF 101 REFERENCES

MAXIMUM LIKELIHOOD ESTIMATION IN LOG-LINEAR

- 2012

We study maximum likelihood estimation in log-linear models under conditional Poisson sampling schemes. We derive necessary and sufficient conditions for existence of the maximum likelihood estimator… Expand

Computing Maximum Likelihood Estimates in Log-Linear Models

- Mathematics
- 2006

We develop computational strategies for extended maximum likelihood estimation, as defined in Rinaldo (2006), for general classes of log-linear models of widespred use, under Poisson and… Expand

Maximum Likelihood Estimation in Network Models

- Mathematics, Computer Science
- ArXiv
- 2011

By reparametrizing the beta model as a log-linear model under product multinomial sampling scheme, this work is able to provide usable algorithms for detecting nonexistence of the MLE and for identifying non-estimable parameters. Expand

The Log-Linear Group Lasso Estimator and Its Asymptotic Properties

- Mathematics
- 2007

We define the group-lasso estimator for the natural parameters of the exponential families of distributions representing hierarchical log-linear models under multinomial sampling scheme. Such… Expand

The mode oriented stochastic search (MOSS) algorithm for log-linear models with conjugate priors

- Mathematics
- 2010

Abstract We describe a novel stochastic search algorithm for rapidly identifying regions of high posterior probability in the space of decomposable, graphical and hierarchical log-linear models. Our… Expand

Homogeneous Linear Predictor Models for Contingency Tables

- Mathematics
- 2005

Maximum likelihood (ML) inference for the class of homogeneous linear predictor (HLP) models for contingency tables is described. HLP models constrain the expected table counts m through L(m) = Xβ,… Expand

Maximum Likelihood Estimation in Log-Linear Models Supplementary Material

- 2012

This document contains supplementary material to the article “Maximum Likelihood Estimation in LogLinear Models” by S.E. Fienberg and A. Rinaldo, henceforth referred to as FR. In section 2 we provide… Expand

Goodness-of-fit tests for log-linear models in sparse contingency tables

- Mathematics
- 1986

Abstract The asymptotic normality of the likelihood ratio goodness-of-fit statistic is demonstrated for testing the fit of log-linear models with closed form maximum likelihood estimates in sparse… Expand

On the comparison of multinomial and Poisson log-linear models

- Mathematics
- 1996

SUMMARY We introduce a method for comparing multinomial and Poisson log-linear models which affords an explicit description of their equivalences and differences. The method involves specifying the… Expand

Polyhedral conditions for the nonexistence of the MLE for hierarchical log-linear models

- Computer Science, Mathematics
- J. Symb. Comput.
- 2006

This work provides a polyhedral description of the conditions for the existence of the maximum likelihood estimate (MLE) for a hierarchical log-linear model and gives an algorithm for determining if the MLE exists. Expand