What we do | Ā mātou mahi

We check that organisations supporting and working with tamariki, rangatahi, and their whānau are meeting their needs, delivering services effectively, and improving outcomes.

We determine:

  • compliance with the Oranga Tamariki Act, National Care Standards and other regulations
  • the quality and impact of service delivery and practices
  • if outcomes have been improved for children, young people, whānau
    Whānau refers to people who are biologically linked or share whakapapa. For the Monitor’s monitoring purposes, whānau includes parents, whānau members living with tamariki at the point they have come into care View the full glossary
    and families who receive services or support.

We monitor agencies with statutory obligations under or in connection with the Oranga Tamariki Act. We also look at how the oranga tamariki system interfaces with other systems for tamariki
Children (plural) aged 0-13 yearsView the full glossary
known to Oranga Tamariki.

Our guiding documents are the foundation for our work

We monitor agencies with statutory obligations under the Oranga Tamariki Act

  • Oranga Tamariki – Ministry for Children
  • Other organisations with statutory delegations under the Oranga Tamariki Act – such as for care and custody or youth justice
  • NZ Police (Youth Justice)

We engage with organisations that provide services to tamariki and whānau under s396 and s403 of the Oranga Tamariki Act

  • Other Non-Government Organisations such as care partners, youth justice programmes, and early intervention services
  • Iwi
    TribeView the full glossary
    , hapū
    Sub-tribeView the full glossary
    , and Māori social services

We also monitor how other government agencies interface with the oranga tamariki system, including:

  • Education
  • Health
  • Kainga Ora
  • Social Development

Evidence is at the centre of our approach

Our monitoring approach is based on a rigorous methodology with evidence at the centre.

We use a mixed-methods approach.

  • We collect information from people in the communities we visit.
  • We gather data from agencies relevant to what we are reporting on.

We use these together to create a robust picture of how services are working for tamariki
Children (plural) aged 0-13 yearsView the full glossary
, rangatahi
Young person aged 14 – 21 years of ageView the full glossary
, and whānau
Whānau refers to people who are biologically linked or share whakapapa. For the Monitor’s monitoring purposes, whānau includes parents, whānau members living with tamariki at the point they have come into care View the full glossary
– what’s working well, and what needs improvement.

Our approach is designed to guard against potential bias and ensure our analysis is robust.

We combine what we hear with the data we gather

We get a robust picture of the quality of the services tamariki
Children (plural) aged 0-13 yearsView the full glossary
and whānau
Whānau refers to people who are biologically linked or share whakapapa. For the Monitor’s monitoring purposes, whānau includes parents, whānau members living with tamariki at the point they have come into care View the full glossary
receive, from their perspectives. These voices are a cross check with the data we collect.

Together this data and information help us develop evidence-driven insights into what is working well, and what isn't, for tamariki. It also enables us to validate the impact of changes.

Quotes represent what we heard

The quotes we share in our reports are selected to illustrate the themes or insights uncovered through our analysis. The quotes are representative of what we heard.

Sometimes we will share an example of good practice in an area where the experience is primarily negative. Learning from good practice can help drive improvement by showing what good looks like. In these cases, we may also include a positive quote even though it is not representative of what we heard overall.

How we gather information from communities

We listen to tamariki
Children (plural) aged 0-13 yearsView the full glossary
, rangatahi
Young person aged 14 – 21 years of ageView the full glossary
, whānau
Whānau refers to people who are biologically linked or share whakapapa. For the Monitor’s monitoring purposes, whānau includes parents, whānau members living with tamariki at the point they have come into care View the full glossary
and caregivers and to the professionals who support them


To understand what is working well and what needs to improve, we engage with tamariki, rangatahi, whānau, and caregivers to understand how well they are being supported by services.

When we visit communities, we also meet with people who provide services and support. This can include iwi
TribeView the full glossary
and Māori service providers, community organisations, Oranga Tamariki, and government agencies including NZ Police, and frontline health and education workers.

We listen to a wide range of people to get a balanced view. We usually hear from more than 1,000 people each year.


How we do this

Our monitoring kaimahi are trained to engage with and listen to  tamariki and rangatahi. They have experience working with different communities, including Māori communities.

Our kaimahi come from different backgrounds, including social work, psychology, education, and law.

We use a set of structured questions called pātai pākiki when we engage with people in a community. This helps us ask questions in a clear and consistent way. Our outcomes framework helped shape these questions.


How often we visit and how we plan

We visit each community once every 3 years. We use our monitoring phases to plan each visit and guide how we work with the community.

How we gather data

We ask for data and information from agencies. We also use a national research database, the Stats NZ Integrated Data Infrastructure (IDI). Together, this data helps us see how organisations are performing and whether outcomes are improving for tamariki
Children (plural) aged 0-13 yearsView the full glossary
, rangatahi
Young person aged 14 – 21 years of ageView the full glossary
, and whānau
Whānau refers to people who are biologically linked or share whakapapa. For the Monitor’s monitoring purposes, whānau includes parents, whānau members living with tamariki at the point they have come into care View the full glossary
.


Under the Oversight of the Oranga Tamariki System Act, we can ask agencies for data and information. Agencies that must provide this data to us are those that deliver services or support to tamariki, rangatahi, and their whānau and family through the oranga tamariki system.

These agencies include government agencies such as Oranga Tamariki, NZ Police, and the Ministries of Health and Education. They also include non-government organisations with custody of tamariki and rangatahi, such as Open Home Foundation.


Agencies must also monitor themselves

The National Care Standard regulations require agencies that have custody or care of tamariki and rangatahi to assess how well they comply with the regulations. And they must assess how well they meet their obligations under the Oranga Tamariki Act.

They must give us information about:

  • how they plan to improve their own monitoring
  • areas where they have concerns or are not complying
  • how they plan to improve compliance.

Access to the IDI research database

We use the Stats NZ IDI through our partnership with the Social Investment Agency. The IDI is a large research database. It holds de-identified data about people and households in Aotearoa
New ZealandView the full glossary
.

The IDI helps us look at outcomes for different groups of people. We are able to group people by their level of involvement with the oranga tamariki system. We can also look at ethnicity and diagnosed disability within each group.

For example, we can compare outcomes for tamariki and rangatahi Māori in the system with Māori who are not in the system. This data is included in our Outcomes for Māori reports.

How we analyse information from communities

When we kōrero
Conversation or discussionView the full glossary
with people in the community, we record the conversations. We first remove details that could identify the people we heard from. 


We work together to code what we heard

Our monitoring and analyst kaimahi wānanga (meet and discuss) to talk through what they heard during each visit. We sort the information into groups using our coding framework and specialist software. This helps us find patterns and themes.


We make sure our process is robust

We guard against bias and make sure our analysis is robust. We do this through quality checks of our coding and our analysis. 

We use specialist NVivo software to record and sort the information. This helps us see themes, how often views are shared across the conversations and how strongly people feel about them.

Our outcomes framework helped shape our coding framework, just as it helped shape our pātai pākiki.


Our analysis process has been externally reviewed

An external review found that our process is rigorous and committed to accurately capturing and honouring the voices of everyone engaged with – especially tamariki
Children (plural) aged 0-13 yearsView the full glossary
, rangatahi
Young person aged 14 – 21 years of ageView the full glossary
and whanau.

How we analyse data

Our team analyses the data from agencies to:

  • look for trends
  • see whether changes, such as new programmes or ways of working, have affected service quality for tamariki
    Children (plural) aged 0-13 yearsView the full glossary
    , rangatahi
    Young person aged 14 – 21 years of ageView the full glossary
    , and whānau
    Whānau refers to people who are biologically linked or share whakapapa. For the Monitor’s monitoring purposes, whānau includes parents, whānau members living with tamariki at the point they have come into care View the full glossary
  • check whether results are different for groups such as tamariki Māori or tamariki with disabilities
  • understand how well agencies are complying with legislation and regulations.

You can find tables of the data we collect from agencies in our reports, on our Reports page.