Population and
Sustainable Development

Phase 2 - defining the problem

  1. Can official statistics and administrative data from different government agencies help with problem definition?

    What are the relative strengths and weaknesses of this data?
  2. What are the features and limitations of the statistics we are working with, in the context of the specific application they are being used for?

    Do we need to consult a statistics expert?
  3. Are we combining statistics from different sources?

    If so, ensure the definitions are consistent, or that differences have been understood and allowed for. For instance, the definition and quality of data for some variables change over time within particular collections, while coverage, sampling errors and definitions vary between various administrative statistical series.
  4. If the demographic statistics currently available are deficient in some respect, do we need to consider possible means of accessing additional statistics, or recommending system changes to collect or derive better statistics in the future?
  5. Have we developed a profile of the characteristics of different sub-groups to assist with targeting?

    If there is a serious lack of population data, what qualitative information is available that throws some light on the characteristics of policy groups or service recipients?
  6. What is the ‘fit’ between what we really want to measure, and what available statistics allow us to measure? For example, only incidence or prevalence rates may be available but what we really want are statistics on severity.
  7. Do we need to analyse trend data carefully to ensure the trends are real and not statistical artefacts?

    For instance, has the definition of the statistical series or the way statistics are collected changed?

    How sensitive is the trend to the choice of base year or period, or to the definition of the cohort?
  8. Are there possible physical limits to the continuation of recent trends (eg of population growth in a region)?

    Can we identify possible constraints on the continuation of recent trends for a sub-group derived from the experience of similar groups where trends have reached a plateau?

    Do we need to allow for greater uncertainty when projecting small-area populations, or small populations with high growth rates?
  9. Have we standardised the key measures being used or the underlying base populations appropriately?
  10. When comparing statistics for different groups, are we using specified cases only?

    For instance, a common error is to compute statistics for the Māori population, and then to label the total population minus the Māori population as non-Māori, when a significant proportion of that population is actually not specified, some of whom will be of Māori ethnicity.

    What do we know about the characteristics of the non-respondents? Compare subgroups in a population with the whole population who specified the appropriate characteristic rather than using the non-subgroup as a contrast.
  1. Are appropriate broad outcome targets set for key policy and service populations in the context of sector goals?
  2. Do we need to analyse the data from different perspectives, for instance, using both cross-section and cohort analysis?
  3. Have we exploited the full range of supporting contextual information in interpreting demographic statistics?
  4. Do we need to develop alternative scenarios for different population/sub-group dynamics? Are alternative demographic scenarios logically and internally consistent?
  5. Do we need to check the output of any modelling of demographic variables against independent data?

 

Population Statistics Unit | Statistics New Zealand Statistics House,

The Boulevard, Harbour Quays, PO Box 2922, Wellington, New Zealand.

Ph: 0508 525 525 Fax:+64 4 931 4079