A new factor analysis model for factors obeying a Gamma distribution

The traditional factor analysis model assumes that the factors obey a normal distribution, which is not appropriate in fields whose data are nonnegative. For this kind of problem, we construct a more practical factor model, assuming that the factors obey a Gamma distribution. We develop a new factor analysis model and discuss its true loading matrix. Then we study its parameter estimation with the maximum likelihood estimation (MLE) method based on an Expectation-Maximization (EM) algorithm, where step E is realized by the Metropolis-Hastings (M-H) algorithm in the Markov Chain Monte Carlo (MCMC) method. We use the new model to empirically study real data, and evaluate its information extraction ability, using the defined true loading matrix to calculate the true loading of the factor. We compare the new model and traditional factor analysis models on simulated and real data, respectively, whose results show that the new model has better information extraction ability for nonnegative data when the number of factors is the same.