Article Version of Record

What sample sizes are needed to get correct significance levels for log-linear models? - A Monte Carlo Study using the SPSS-procedure "Hiloglinear"

Author(s) / Creator(s)

Stelzl, Ingeborg

Abstract / Description

Pearson's C2 and the Likelihood-ratio statistic G2 are the most common and widely used test statistics for log-linear models. They are both asymptotically distributed as chi-Squared variables. The present article reports the results of a Monte-Carlo study which compares the two test statistics for two-, three- and four-dimensional contingency tables, employing conditions which may be judged reasonable for psychological research and using one of the most prominent computer programs (SPSS "Hiloglinear"). Our results are consistent with previous research in that, on the whole, Pearson's C2 behaves better than G2. As a rule of thumb one may state that Pearson's C2 will not result in severely inflated alpha values (empirical values of .075 or larger for a nominal level of .05) if the total sample size equals five times the number of cells and the smallest expec-ted cell frequency is larger than 0.50. On contrast, the Likelihood-ratio statistic G2 yields in some cases severely inflated empirical alpha values for the higher interactions even if the total sample size equals ten times the number of cells and the smallest expec-ted cell frequency is larger than one. In those cases where sample size is large enough to use Pearson's C2, Pearson's C2 is preferable to G2, as it is generally closer to the nominal alpha. For cases not covered by this rule parametric bootstrapping is recommended.

Keyword(s)

contingency tables log-linear models significance tests Pearson's C^2 Likelihood ratio G^2 Monte Carlo study simulation SPSS Hiloglinear

Persistent Identifier

Date of first publication

2000

Journal title

Methods of Psychological Research

Volume

5

Issue

2

Page numbers

95-116

Publisher

IPN - Institute for Science Education at the University of Kiel, Germany

Publication status

publishedVersion

Review status

unknown

Citation

  • Author(s) / Creator(s)
    Stelzl, Ingeborg
  • PsychArchives acquisition timestamp
    2023-04-25T14:26:00Z
  • Made available on
    2023-04-25T14:26:00Z
  • Date of first publication
    2000
  • Abstract / Description
    Pearson's C2 and the Likelihood-ratio statistic G2 are the most common and widely used test statistics for log-linear models. They are both asymptotically distributed as chi-Squared variables. The present article reports the results of a Monte-Carlo study which compares the two test statistics for two-, three- and four-dimensional contingency tables, employing conditions which may be judged reasonable for psychological research and using one of the most prominent computer programs (SPSS "Hiloglinear"). Our results are consistent with previous research in that, on the whole, Pearson's C2 behaves better than G2. As a rule of thumb one may state that Pearson's C2 will not result in severely inflated alpha values (empirical values of .075 or larger for a nominal level of .05) if the total sample size equals five times the number of cells and the smallest expec-ted cell frequency is larger than 0.50. On contrast, the Likelihood-ratio statistic G2 yields in some cases severely inflated empirical alpha values for the higher interactions even if the total sample size equals ten times the number of cells and the smallest expec-ted cell frequency is larger than one. In those cases where sample size is large enough to use Pearson's C2, Pearson's C2 is preferable to G2, as it is generally closer to the nominal alpha. For cases not covered by this rule parametric bootstrapping is recommended.
    en
  • Publication status
    publishedVersion
  • Review status
    unknown
  • ISSN
    1432-8534
  • Persistent Identifier
    https://hdl.handle.net/20.500.12034/8275
  • Persistent Identifier
    https://doi.org/10.23668/psycharchives.12752
  • Language of content
    eng
  • Publisher
    IPN - Institute for Science Education at the University of Kiel, Germany
  • Keyword(s)
    contingency tables
    en_US
  • Keyword(s)
    log-linear models
    en_US
  • Keyword(s)
    significance tests
    en_US
  • Keyword(s)
    Pearson's C^2
    en_US
  • Keyword(s)
    Likelihood ratio G^2
    en_US
  • Keyword(s)
    Monte Carlo study
    en_US
  • Keyword(s)
    simulation
    en_US
  • Keyword(s)
    SPSS Hiloglinear
    en_US
  • Dewey Decimal Classification number(s)
    150
  • Title
    What sample sizes are needed to get correct significance levels for log-linear models? - A Monte Carlo Study using the SPSS-procedure "Hiloglinear"
    en_US
  • DRO type
    article
  • Issue
    2
  • Journal title
    Methods of Psychological Research
  • Page numbers
    95-116
  • Volume
    5
  • Visible tag(s)
    Version of Record