Are you homeless or at risk of becoming homeless? Help is available. Contact Link2Home 24/7.
This how to guide explains how to plan and undertake the external assessment. The main topics covered are:
Your organisation and the Board need to be aware of privacy, confidentiality and notifiable issues that apply to the self-assessment and external assessment.
The confidentiality provisions for ASES in the Evidence Guide state:
The information you give as part of your self-assessment and the external assessment report is the property of your organisation and the contents are confidential to you, the Australian Service Excellence Office, External Assessors and licensed providers. The content of your report will not be released to any other third party without your prior written approval, except when required by law (South Australian Department of Human Services: 2019:6).
Assessors are contractually required to abide by:
If Assessors find evidence or allegations regarding serious health, safety or abuse, risk, financial impropriety or professional misconduct, they are contractually required to:
While the ASES Team is not responsible for resolving notifiable issues, it cannot issue an ASES Certificate of Accreditation until the notifiable issues have been resolved.[3]
These events occur rarely. If they do, the Assessor will provide a written account of the issues to the Board and the ASES Team. It is up to the organisation to work to resolve the issue before the external assessment can resume or restart. The SHS should advise DCJ and, if they are part of a JWA and not the lead organisation, the lead organisation in the JWA, of any reportable issues in writing.
The External Assessment site visit involves a number of interviews with various stakeholder groups, a review of documents and systems, and inspections of the agreed sites and service outlets.
Most site visits are two days but may be more or less depending on the size, structure and complexity of the organisation, and the scope of the ASES assessment.
It is important that every aspect of the site visit is planned, coordinated and scheduled by liaising with your Assessor and all participants. It is a good idea to start early and allocate enough staff hours as this planning can take some time.
The typical components of a site visit are described below.
Opening meeting
The Assessor welcomes attendees, explains the purpose of the visit, confirms the agenda, confirms arrangements for keeping key contacts informed and clarifying any issues that arise.
Interviews
The Assessor interviews clients, the management team, staff, the Board and partner organisations and external stakeholders. Interviews can be group sessions or individual sessions and will generally be spread across sites.
Review of documents, systems and artefacts
The Assessor reviews documents (e.g., client and staff records, policies, procedures, reports Board papers), systems (e.g., databases, digital systems, social media, website) and signage, symbols, posters, artefacts.
Observations
The Assessor observes aspects of each site such as access to the site; maintenance of buildings and equipment; work, health and safety measures; staff interactions; client activities and privacy and confidentiality provisions for clients.
Closing meeting
At the end of the site visit the Assessor provides an overview highlighting any strengths and concerns, a summary of the ratings for the ASES requirements, and next steps in the quality review process.
Example: The table below lists the sequencing of the components that captured in a typical, two-day site visit for a single site organisation.
Template agenda for a typical, two-day site visit for an organisation with one service outlet
Day 1 | Day 2 |
Welcome, WHS tour and site inspection | Short debrief of day 1 with senior staff |
Opening meeting | Review of Human Resources (HR) system and interview with HR Manager |
Interviews with senior staff and Board members | Interview with middle managers |
Review of Xero and CIMS systems | Lunchtime interview with partner organisations |
Lunch | Review onsite documentation, onsite documentation, key project files, documentation related to the Board such as meeting minutes |
Interviews with clients | Report writing and preparation for the closing meeting |
Report writing | |
Review of client files and personnel files | |
End of day 1 meeting with CEO and Operations Manager | Closing meeting, feedback on key findings and next steps |
As part of the resources in this module, two examples of an actual site visit agenda, completed by SHSs with their Assessors, are provided.
External Assessment Site Visit Timetable 1
External Assessment Site Visit Timetable 2
The site visit will involve interviews with four groups of people: clients, staff (and volunteers), the Board, and partner organisations and external stakeholders.
The purpose of all the interviews is to verify, clarify and gain new information about how your organisation implements its processes and practices in relation to the ASES.
You will need to inform and engage these people before the site visit and interviews with the Assessor.
The number of people to be interviewed in each group depends on the size of the organisation and number of sites and programs. Your Assessor will provide guidance about this.
The external assessment requires:
In arranging interviews and access to client files your organisation will need to:
The purpose of interviews with clients is to learn how clients experience all of the organisation’s obligations relating to service provision requirements in the ASES. The Assessor will focus on whether service provision aligns with the organisation’s policies, processes and systems.
Typical interview questions are included in the handout, Example Interview Questions,
You will need to provide the Assessor with written consents from clients whose files will be reviewed during the site visit. Advise your clients that their rights to privacy and confidentiality will be observed in this process.
See two examples of consent forms developed by SHSs for their external assessment which you can use and adapt for this purpose:
All clients have a right and opportunity to be involved and consulted or to refuse to be involved. This includes the right to withdraw consent previously given at any time. Organisations are required to invite client representation at both the opening and closing meetings of external assessment site visits.
To exercise these rights, clients need to be informed about ASES, what it means, and the opportunities available to them to participate.
In arranging interviews with clients (and their representatives, where relevant), you need to explain:
Examples of posters used by one SHS to communicate with clients about ASES and the external assessment are provided as part of this module:
These examples may help you develop communication tools about the external assessment that are appropriate to your clients. It is good practice to engage clients to help you to develop these tools, if possible.
You may choose to send out written information to clients about ASES first, and then follow up with a visit or phone call to provide additional information about how they can participate and answer any questions.
Your Assessor may also have handouts with information about how different groups can participate in the external assessment that you can use and adapt.
Clients have a right to receive the level and type of support they need to enable them to participate in the external assessment.[5] Clients have the right to advocacy and support to assist in having their say. People from ATSI or CALD backgrounds and people with disabilities and their support persons are not to be excluded. They should be provided with timely, plain language information, in line with their communication needs about the audit process, to allow for their full and informed contribution.
You should inform clients that they have a choice about how they will be interviewed – in person, by phone, in a one-to-one session or a group session. Ask your clients what they would prefer and factor that in when preparing the agenda with your Assessor.
Provide additional supports that clients may need to attend the site visit, such as transport or child care. Let clients know that they are welcome to bring an advocate or a support person to their interview.
Provide clients with timely, plain language information about the external assessment process and make sure these communications are inclusive of all your clients. Organise translations and interpreter services for the interview, when necessary.
Brief the Assessor about any assistance to be provided to clients and any issues, communication needs and sensitivities they need to be aware.
Advise your clients that the Assessor will respect their right to confidentiality and privacy in any interaction with them and that there will be no retribution to the client for freely expressing their views about your service.
The key issues outlined in this section are outlined in Communication Tool for the External Assessment Site Visit. This document provides sample texts that you can use and adapt to develop communication tools with clients about ASES, the site visit, options for participation and client rights.
To encourage client participation, you can employ strategies such as providing lunch, morning or afternoon tea and giving clients gift vouchers or movie vouchers. However, make sure that any gifts offered to clients are not so valuable that they could be interpreted as an inducement.
The external assessment requires:
Verbal consent from staff is generally sufficient for the Assessor to review their files but check this before the site visit as some Assessors require written consents.
The focus of interviews with staff is twofold since staff are both service providers and internal clients of the organisation. Assessors explore:
Staff at each level of the organisation are interviewed separately, not with their supervisors. They are only asked questions related to their role.
Sometimes staff are worried that the interviews will be onerous or that they will say ‘something wrong’. You should advise staff that the best approach is to:
Examples of questions are included in the handout, Example Interview Questions, which is provided as part of this guide.
Ideas for organising participation in the external assessment include:
Informing staff of the outcomes of the visit and thanking them for their contribution is crucial for their ongoing engagement in the work that will follow.
The external assessment requires:
The focus of the Board interviews is to identify how the Board:
The Assessor will explore how these roles are applied in practice within the operational context and constraints of the organisation.
Examples of questions are included in the handout, Example Interview Questions, which is provided as part of this guide.
The Board will be aware of the accreditation process through their approval and monitoring of your ASES Project Plan. The main tasks for organising participation of the Board include:
The external assessment requires interviews with a sample of the organisations that have an interest in, or are affected by, the business of your organisation. These include:
These interviews are generally conducted in a group setting but a phone interview may also be possible with any organisations that are not able to make it.
The purpose of the interviews with this group is to examine the effectiveness of your communication, partnership agreements (formal and informal) and joint working agreements.
The Assessor will interview representatives of partner organisations and external stakeholders only – these interviews do not include your organisation’s staff or Board members.
Examples of questions are included in the handout, Example Interview Questions, which is provided as part of this guide.
The steps involved in planning the Assessor’s interviews with partner organisations and external stakeholders are:
At the site visit the Assessor will need to see:
A comprehensive list of evidence examples if provided in How to guide 4: Guide to Good Evidence. Not all evidence is printed evidence. It can include artefacts, digital records, audio or video recordings and web-based evidence.
Preparing the physical environment includes:
A site inspection checklist is provided as part of this module that includes the key items Assessors observe and document at each site.
In the days leading up to the site visit:
Resource
You can use the Checklist: Planning the External Assessment Site Visit provided as part of this module to keep on track.
[1] Government of South Australia, Standard Goods and Services Agreement, DHS76 Australian Service Excellence Standards Panel: Assessments, Quality, Performance, 1 July 2019, p. 13.
[2] Government of South Australia, op. cit., p. 12.
[3] Government of South Australia, op. cit., p. 13.
[4] Your Assessor will advise you of the sample size for client interviews and client file reviews. This will be based on the sampling methodology involved in auditing and the size and structure of your organisation.
[5] Government of South Australia, Standard Goods and Services Agreement, DHS76 Australian Service Excellence Standards Panel: Assessments, Quality, Performance, 1 July 2019, p. 13.
[6] Based on the South Australia. Dept. for Communities and Social Inclusion (now the Department of Human Services), Australian Service Excellence Standards: A road map to an excellent organisation, Third Edition, version 7, 2019, p. 81.