Interpreting nKPI data

This page contains general information to aid in interpreting nKPI data. Further information related to both collections is provided on the main Technical notes page.

Where to go for more information

This page contains general information to aid interpretation of nKPI data. This should be used in conjunction with additional information contained in the:

The national Key Performance Indicators (nKPI) collection consists of 15 process-of-care and 9 health-outcome indicators organised under three domains (Table 1).

Table 1: Indicators by domain and type

Process-of-care indicators

Health-outcome indicators

PI13: First antenatal visit

PI02: Birthweight result

PI01: Birthweight recorded

PI11: Smoking during pregnancy

PI04: Child immunisation

 

PI03: MBS health assessment—aged 0–4

 

In this report, where there are small numbers of reporting organisations in a state or territory, data are presented combined with another state or territory. This is the case for Tasmania (presented combined with Victoria) and the Australian Capital Territory (presented combined with New South Wales).

Organisational participation and data exclusions

Not all organisations in-scope to report data to the nKPI collection do so. This varies by period (Table 2).

Table 2: nKPI organisation participation rate
Reporting period

In-scope to report data

Reported data

Participation rate (%)

June 2017

228

228

100.0

December 2017

231

231

100.0

June 2018

236

233

98.7

December 2018

242

238

98.3

June 2019

240

234

97.5

December 2019

241

237

98.3

June 2020

236

220

93.2

For the organisations that do report data, particular data items may be excluded from analysis if data quality issues have not been resolved (Table 3). The major reasons for data not being provided or organisations having data quality problems include a lack of complete records of data held by the organisation, insufficient data management resources at organisations to support the data collection, organisations not providing the service for which the indicator collects information, and problems with the electronic transfer of data extracted from organisations’ CIS. Changes to the data extraction process were a major reason for organisations having data quality issues in their original submission from June 2017 to June 2018.

Table 3: nKPI organisations with unresolved validation issues
Reporting period

Number of organisations with unresolved issues

Total number of organisations that reported data

Organisations with unresolved issues (%)

June 2017

21

228

9.2

December 2017

25

231

10.8

June 2018

17

233

7.3

December 2018

2

238

0.8

June 2019(a)

0

234

December 2019

0

237

June 2020

3

220

1.4

  1. June 2019 was the first reporting period in which organisations were advised by the Department of Health that they were not required to provide data for indicators relating to a service they were not funded to provide. Organisations were also advised that if they do not have the data for an indicator (for example because of a CIS issue) to leave it blank.

In addition to unresolved internal validation issues, some indicators are excluded from analysis where the organisation’s data do not meet the regular client definition (for example because they were a new organisation or they had changed to a new CIS) or where issues were identified with a particular CIS. This varies by period and by data item. For example:

  • Data from organisations using the MMEX Clinical Information System (CIS) were excluded from data submitted in collections from June 2019 and earlier for indicators related to smoking and alcohol.
  • PI13 (antenatal visits)—data for some organisations using Communicare and Medical Director was affected by data extraction issues for June 2017, December 2017 and June 2018. This resulted in some categories being combined.
  • PI20 (risk factors to enable a CVD risk assessment)—MMEX results are excluded for June 2017.
  • PI21 (CVD risk assessment result)—data are only included from organisations with CISs which capture all data necessary to calculate a result (some CISs do not).
  • PI22 (cervical screening)—some data quality issues were identified with the initial June 2018 submission but these have been resolved for all other periods.
  • PI18 and PI19 (kidney function test recorded and result) have had ongoing data quality issues since June 2017. Affected data were excluded.

Changes to data extraction methods

Data from earlier collections are not comparable with data from June 2017 onwards. For the June 2017 collection, changes were made to the electronic data extraction method for most organisations that resulted in a break in series. For more information see AIHW 2018.

From December 2015 onwards, organisations funded by the Northern Territory Government changed the way in which data were extracted so that only tests or measurements conducted at the reporting organisation were counted.

Changes in indicators

Indicator specifications may be revised over time (for example, to reflect the latest clinical and best-practice guidelines).

  • PI22 (cervical screening)—in June 2018, PI22 was adjusted to align with revised requirements under the National Cervical Screening Program (NCSP). The key changes from June 2018 are that:
    • data include clients who had either a Papanicolaou smear (Pap test) conducted prior to 1 December 2017 or a human papillomavirus (HPV test) conducted from 1 December 2017
    • the age range was revised to 20–74 to accommodate the former reporting age range (20–69) and the new age range (25–74).

In 2020, in response to issues identified during the AIHW’s Review of the two national Indigenous specific primary health care datasets: OSR and nKPI, all indicators current as of June 2020 underwent a review by a clinical and technical working group sitting under, and convened by, the (Indigenous) Health Services Advisory Group (HS DAG). As a result, HS DAG has approved a series of changes to the indicators and these will be rolled out progressively during 2020–21.

Maternal and child health organisations

Data from a small number of organisations that received funding only for maternal and child health services (MCH organisations) are included in the nKPI data presented in this report unless otherwise noted.

While MCH organisations are generally excluded from the OSR data presented in this report (see Interpreting OSR data), they are included in the nKPI data. This is because a subset of indicators applies directly to the MCH funded programs and the aims of these programs are considered similar to the aims of antenatal/early childhood care delivered within organisations funded for primary health care.

Prior to June 2019, because MCH organisations were not limited to reporting only on the maternal and child health indicators, a small number also reported against other nKPIs (like alcohol or BMI).

References

AIHW (Australian Institute of Health and Welfare) 2018. National Key Performance Indicators for Aboriginal and Torres Strait Islander primary health care: results for 2017. National key performance indicators for Aboriginal and Torres Strait Islander primary health care series no. 5. Cat. no. IHW 200. Canberra: AIHW.