Development of School’s Sports Safety Audit Tools (3sat)

The implementation of this study is to design, develop, test, and produce school’s sports safety audit tool in order to assist schools to conduct safety audits on infrastructure, equipment and management of sports activities. The development of school’s sports safety audit tool (3SAT) method is adapted from Stufflebeam's evaluation model (1983), which involves aspects of context, input, process, and product. In the aspect of context, the researchers conducted a retrospective conceptual analysis that identified factors of accidental incidents in sports that occurred in the school environment. Subsequently, the researchers obtained inputs to develop and design the contents of 3SAT based on documents such as Malaysia Ministry of Education Circular Letter on student safety in schools, School Occupational Safety and Health Program Handbook, Guidelines for Safety and Occupational Health Act 1994 (Act 514), Safe Schools Integrated Program Module, and Safe Schools Policies. For the evaluation process, the researchers obtained the validity of the content from 11 expert panels. A pilot study was conducted at selected schools to test and determine the reliability level of 3SAT. 3SAT consists of five types of audit on school infrastructure namely, Sports Store/Sports Management Room, Field, Open Court, Covered Open Hall, and Indoor Hall. The data obtained from the audit process were analyzed descriptively to identify the Sports Safety Index at the schools being studied. The expert panels agreed that the validity of 3SAT was excellent (91.70%) and relevant to the content of the study. The reliability of 3SAT for Sports Store/Sports Management Room (α = .863), Field (α = .842), and Open Court (α = .816) were good and consistent. The reliability of 3SAT for Covered Open Hall (α = .738) and Indoor Hall (α = .647) were adequate, acceptable and consistent. In reference to the method of construction of 3SAT based on Stufflebeam's (1983) evaluation model, it was concluded that 3SAT has a very good validity and is relevant to the content of the study. The reliability level of 3SAT was also good, adequate, consistent and acceptable for this study. 3SAT is an audit report that provides inputs on indices and indicators to identify safety and risk factors for infrastructure facilities and sports activities management at schools. The audit report can be International Journal of Academic Research in Business and Social Sciences Vol. 1 0 , No. 9, 2020, E-ISSN: 2222-6990 © 2020 HRMARS 3 submitted periodically to Malaysia Ministry of Education. The report can be accessible to parents and public in order to assess their confidence in the safety of students at schools.


Introduction
Malay proverb says "unexpected misfortune" and accidents can happen everywhere and at any time. News of accidents occurring in the school area is regularly reported in mass media every year. The most common accident incidents include being hit by goalposts in football play, health complications during sports activities, being hit by lightning at the school field while playing football and being attacked by snakes at school area. Table 1 is a chronology of students' death as a result of being hit by a goalpost while playing ball in school from the mass media source. The news of accident incidents related to health complications occurred in April, 2010 in which a remove class male student died of heart attack while attending his school's annual sports event in Bukit Mertajam ("Students died while playing sports", 2010). The similar incident occurred in a primary school in Merapoh when a Year Six boy died of hypertension and heart problem while attending a sports tournament in 2015 ("The trauma of the location", 2015). In 2019, a Form Four student collapsed and unconscious while participating in running event during annual sports day, and passed away minutes after arriving at the hospital ("Form Four student die", 2019). Most recently, 16-year-old students who died after doing cross-country training at school was reported (Hamsuddin, 2020).
The news of death struck by lightning while playing football (Fareez, 2019) involved a student of Maahad Tahfiz Al-Furqan in Teluk Intan and another in Shah Alam. Later in April 2016, there was news of an accident incident involving a Year One school student who died of snake bite while playing with friends in school yard (Abdul Rahim & Subaryati, 2016) and was followed by several other incidents of snake bite in the school area., N. F., & The accident incidents have received a lot of unpleasant reactions especially from parents whose children are still in school because they are worried that such incidents can happen to their children. Therefore, the schools must take precautionary measures to prevent the same accident from happening again. Malaysia Ministry of Education (MOE) was aware of this and has directed the school administration to make audit reports on the state of school infrastructure and equipment (Iskandar, 2016).
Ideally, schools (school leaders, teachers, and supporting staff) should constantly monitor and assess the infrastructure, equipment and sports activity management which pose risk potentials for student accidents especially when conducting Physical Education, co-curricular and sports activities. Schools need to have a specific and standardized instrument for monitoring and assessment to determine the safety level so that the risk of accidents can be prevented and controlled.
Schools also need to be aware and responsible for the safety of students especially when conducting Physical Education, co-curricular and sports activities. Every teacher involved in these activities should take safety precautions in light of the guidelines and instructions in the Professional Education Circular (SPI) of MOE regarding student safety in schools.
There are three SPI circulars related, i.e. SPI No. 1/1995: Students' personal safety during the teaching and learning of Physical Education and Health Education as well as co-curricular and sports activities within and outside the school. The contents of the circular contained information reminding Physical Education and Sports teachers to be aware of possible incidents that could cause accidents to students. Teachers should also take precautions and control steps to prevent accidents (Malaysia Ministry of Education, 1995).
SPI No. 9/2000 is a circular on student personal safety guidance in teaching Physical Education and Health Education as well as co-curricular, and sports activities within and outside the school. SPI is intended to remind the principals and headmasters to be alert to any possible harm or injury to the students. Principals and headmasters also need to take proactive steps to avoid accident incidents in schools (Malaysia Ministry of Education, 2000).
MOE SPI No. 5/2016: Safety guidelines in teaching Physical Education and Health Education and cocurricular and sports activities within and outside the school area are intended to inform safety guidelines that must be adhered to during Physical Education and Health Education and co-curricular and sports activities within and outside the school area (Malaysia Ministry of Education, 2016).
It is concluded that the content in each of these SPIs describes the safety guidelines and measures to be followed by Physical Education and Health Education teachers, co-curriculum and sports teachers, and school students. The school, especially the chairman of the Physical Education and Health Education committee or the Sports Secretary, is responsible for inspecting and maintaining sports equipment located at sports stores, sports or games areas, prohibited and dangerous areas. The schools are warned to not hold any sports activities during heavy rains and thunderstorms.
The SPI statements also contain matters related to reports of accidents or injuries where accident incidents or injuries should be investigated and reported to the principals or headmasters immediately. All accident incidents must be recorded including reporting of sports activity evaluations. Accordingly, high-skilled sports activities such as gymnastics and water activities should be taught by qualified sports teachers. The MOE make it compulsory for the school management to disseminate the contents of the SPI to the school community which involved in Physical Education, co-curricular and sports activities for safety actions.
As a result of these reminders and actions, MOE also impulses schools to take initiatives and actions to establish Co-Curriculum Activity Safety Policy or School Safety Policy, establish Safe School Program or Occupational Safety and Health Program, and establish a School Safety Committee. The schools are also required to submit safety audit report on the state of the infrastructure such as school sports facilities and equipment (Johor Bahru District Education Office, 2016; Malaysia National Teachers' Service Union, 2013). The report has been submitted in a variety of formats, with no standard report formats. Most schools have submitted reports based on the National Audit format and there were also schools that use the Health and Safety Audit in general format by the Malaysia Ministry of Health.
Accordingly, the National Institute for Occupational Safety and Health (NIOSH) offers services to sports organizers in managing aspects of Occupational Safety and Health to ensure safety is a priority ("Sports organizers need to prioritize safety issues", 2017). The NIOSH Chairman also recommended that all schools should conduct a safety audit at least once every two years to identify any weaknesses that could be rectified for the purpose of preventing accidents (Zainul, 2016). The president of the National Parent Teacher Association (PTA), Associate Prof. Dr Mohd Ali Hassan also reminded schools to keep a record of school safety committees and weekly and annual reports that need to be submitted and corrective actions to be implemented from time to time ("Do not feel comfortable", 2016).
School is an entity under the management of the Malaysia Ministry of Education and it is appropriate that a form or format of a safety audit report be consistent. However, in Malaysia schools do not have standard or specific measuring tool or instruments for conducting safety audits that can provide inputs and indicators to identify safety levels and risk of accidents regarding facilities, equipment and management of sports activities in schools.
Therefore, the purpose of this study is to design, develop, test and produce school's sports safety audit tool to help schools in conducting safety audits on facilities, equipment and management of sports activities. The tool provides audit value that can provide inputs and indicators to identify safety and accident risks in terms of infrastructure and sports activity management in Malaysian schools. The audit report can be submitted periodically to Malaysia Ministry of Education. The report is also accessible to parents and the public in order to assess their children's safety in school.

Research Objectives
a) Determine the model of the school's sports safety audit tool. b) Explain the method of construction of school's sports safety audit tool. c) Assess the validity of school's sports safety audit tool. d) Assess the reliability of school's sports safety audit tool. e) Develop the school's sports safety audit tool.

Methodology
The method of construction of a school's sports safety audit tool (3SAT) is an adaptation of an evaluation model (Stufflebeam, 1983) that involves the aspects of context, input, process and product. The evaluation model provides an analytical and rational basis for decision-making based on the planning, structuring, implementing, researching and reviewing of decisions to track the progress of the implementation of a program (Stufflebeam, 1983). The evaluation model in this study gathers information systematically, especially in identifying the strengths and decision making of the effectiveness of 3SAT. The following is the description of the model as well as the description of the construction method of 3SAT.

Context Evaluation
Context evaluation refers to identifying the environment that is relevant to a program and explaining the actual state of the program. The evaluation involves conceptual and empirical analysis that can be obtained from formative and summative sources (Stufflebeam, 1983). The information of context evaluation helps in making decisions related to planning and allows researchers to identify unachieved needs (research objectives), and to improve what prevents them from being achieved. Context evaluation focuses on key variables to achieve the research objectives.
Based on the above description, the researchers initiated the context evaluation by conducting a retrospective conceptual analysis that identified factors of accidental incidents in sports occurring in the school environment. Among the accident incidents include being hit by a goalpost while playing football (Ibrahim, 2016), health complication problems during sports activities ("Form four student die", 2019), death by lightning struck in school field ("Tahfiz student killed by lightning", 2013; Azman, 2019), and snake bite while playing sports in the school area (Fazlina & Betty, 2016).
The accident incidents gave the impression that the school did not have adequate monitoring and maintenance of the school's sports equipment and environment. Likewise, it seems that the Physical Education and co-curricular teachers do not care about the risk of adverse weather and are less sensitive to the student's health and fitness levels. These conceptions need to be studied and analyzed empirically.
Likewise, the Ministry of Human Resources also showed concern on the incidents and recommended that students should be taught occupational safety and health education to reduce the rates of student accident in schools (Fong, 2000).
Empirical analysis is about the safety aspects of students especially when dealing with Physical Education, co-curricular and sports programs or activities. Every teacher involved in such activities or programs should take safety measures in accordance with the guidelines and instructions in the Professional Education Circular (SPI) of Malaysia Ministry of Education regarding student safety in schools. Teachers also need to make sure that students comply with the instructions and safety guidelines when using and managing sports equipment.
In this regard, teachers need to be mindful about things or factors that are difficult to overcome or control in accident prevention. The study of Roslena's (2012) listed factors such as individual negligence, i.e. take it easy attitude and not aware of accident risk, students' playful behaviour, i.e. like to play around with equipment without supervision, equipment that is suddenly damaged, does not know how to handle equipment, does not use appropriate clothing for sports activities, and individuals in a state of fatigue or tiredness.
There are also physical factors contributing to occurrence of accidents such as poor infrastructure, less conducive environment and weaknesses in security management systems (Bahari, 2006). Infrastructure factors include poorly maintained equipment, poor equipment structure which does not fulfil correct specifications, and lack of provision of protective gears such as face masks, safety helmets and gloves. Unsafe environmental factors include slippery floor surfaces, poor lighting, insufficient ventilation circulations, high noise levels, exposure to smoke and dust, and poorlyorganized equipment. The weaknesses in the security management system include unclear delivery and communication, less effective information on safety, and organizations that are less focused on the safety and health aspects of the school.

Input Evaluation
Input evaluation identifies the extent to which resource needs are used to select the appropriate strategies for solving problems (Fitzpatrick et al., 2011). At this stage, information on safety issues in sports is gathered to structure a design such as a measuring tool or instrument and to implement strategies towards achieving research objectives such as specifying procedures, equipment, facilities and materials (Stufflebeam, 2003).
According to the statement, the researchers obtained input to design the content of 3SAT based on several documents such as the Professional Education Circular (SPI) of Malaysia Ministry of Education regarding student safety in schools. The researchers also referred to the Handbook of Occupational Safety and Health in School issued by NIOSH (2017). Schools are encouraged to apply safety and health aspects to their students by referring to the handbook (Lee, 2008) Furthermore, the researchers also referred to the document issued by the Department of Occupational Safety and Health (DOSH), Ministry of Human Resources (2006) that provides guidelines for the Occupational Safety and Health Act (OSHA) 1994 (Act 514). The document is referred because there are teachers and supporting staffs working in the school and they are subject to the implementation of OSHA regulations. The guidelines are to keep students safe and avoid any delinquency activities that may affect their health.
In addition, the researchers referred to the Safe Schools Integrated Program Module (Malaysia Ministry of Education, 1999), the Safe Schools Policy document (Malaysia Ministry of Education, 2002) and the 3K Program (cheerfulness, cleanliness and safety). To conclude, these three documents help the school in making action management programs and policies on school safety. The management helps the school to raise awareness and understand the need for safety as a key agenda in the education sector.

Process Evaluation
The main objective of process evaluation is to provide feedback on the extent to which activities planned can be conducted and to identify weaknesses in the process of developing a program (Stufflebeam, 1983). Such feedback can be used to modify and improve the program's design and strategy (Sufflebeam, 2003). Process evaluation also examines the quality of program implementation in which program activities are monitored, documented and evaluated by the evaluators (Fitzpatrick et al., 2011;Mertens & Wilson, 2012).
The process evaluation for forming 3SAT for this study began with a meeting with the researchers to confirm the action plan for producing the audit tool. The first step is to organize 3SAT construction workshops specifically to determine the format and content of the audit that is relevant to the study concept. The researchers analyse and form the structure of 3SAT content based on references to relevant documents, literature reviews and analysis of research needs.
Subsequently, a pilot study of 3SAT was conducted to obtain preliminary views from teachers and school administrators on the scope of auditing and safety aspects in sports. Once 3SAT is refined, the next step is to obtain a validity evaluation from the panel of experts. The researchers have identified 11 panellists, three from the National Institute for Occupational Safety and Health (NIOSH), a senior lecturer in the field of Physical Education from a public university, and a Head of the Department of Teacher Research and Innovation, Teacher Education Institute with a doctorate of philosophy in Physical Education, three experienced secondary school teachers who teach Physical Education subject, and three experienced primary school teachers who teach Physical Education subject.
All expert panels were provided with an evaluation form with 3SAT. The panel were asked to evaluate 3SAT based on the scale of 1 (very low) to 10 (very high) over 15 items that refer to the quality of the tool. The brief details of the items evaluated are as follows: a) Overall contents are relevant to the safety audit measurement, b) Measures what to measure accurately, c) Content covers a broad range of factors related to sports safety audits, d) Sports safety audit statements are elaborated in detail, e) Demographic content is relevant to what to know, f) Safety audit content is appropriate with what to know, g) Management audit content is appropriate with what to know, h) Safety audit assessment statement (Part B) is clear , i) The rubric of safety audit evaluation section (Part B) is accurate, j) The safety management audit evaluation statement (Part C) is clear, k) The management audit evaluation rubric (Part C) is accurate, 1) The value of 1 (lowest) to 5 (highest) to measure the sports safety audit aspect is sufficient, m) The content of the research tools focus on sports safety audits, n) sentence structure/word order is clear, and o) sentence/word order is comprehensible.
All the contents of the instruments evaluated by the expert panel have been refined in several meetings and workshops. After obtaining good validity score from the panel of experts, the researchers conducted a pilot study at a selected school as a sample to determine the level of 3SAT reliability and suitability of the purpose of this study. The pilot study was conducted in collaboration with research assistants and teachers as enumerators in the schools involved.

Product Evaluation
The product evaluation evaluates outcomes to identify the positive and negative effects of a program being run (Mertens & Wilson, 2012). This aspect is to compare actual results with accepted standards for evaluating, continuing, terminating, modifying or refocusing on a program (Stufflebeam, 2003).
At this stage, short and long-term outcomes are evaluated to identify whether a program objective has been achieved. The achievement of a program objective is the result of well-planned and implemented methodological techniques and processes. Product evaluation is a combination of techniques and methodologies to ensure that all decisions are recorded to assist in validating the findings of the evaluation (Mertens & Wilson, 2012;Stufflebeam, 2003).
Product evaluation in this study resulted in five types of 3SAT involving auditing of school infrastructure: a) Sports Store / Sports Management Room, b) Field, c) Open Court, d) Covered Hall, and e) Indoor Hall. The infrastructure is audited because the activities and management of Physical Education, co-curriculars and sports are often conducted at these locations. The audit report is intended to provide inputs on indices and indicators to identify the safety level and risk of accidents on infrastructure and management of sports activities in schools.
The design of the audit tool contains Part A, i.e. the demographic information of the school infrastructure. This section requires information on size or measurement, location, and usage activities in sports stores/sports management rooms, fields, courts, and halls. Part B is the scope of safety audits in sports focusing on the elements of environment, control and information. Part C also covers the scope of safety management audits related to maintenance and records. Table 2 is the scope of the audit and number of items for each 3SAT. Each scope of audits and items has a rubric evaluation scale from 1 to 5 that involves observation methods. Evaluation scores obtained from each audited item were analysed descriptively and transformed to percentage values. Percentage value information is an indicator for determining the level of sports safety based on the Sports Safety Index in the schools being studied. Table 3 is the Sports Safety Index in the schools which contains the evaluation percentages and is coordinated by color and safety indicators to determine the level of sports safety at the audited location. The index is a summary of audit reports as indicators for identifying the level of safety and risk of accidents regarding infrastructure and management of sports activities in schools. Red Highest potential accidents Very Low Figure 1 is the example of safety audit evaluation calculation form at sports store/sports management room and sports safety index report of a school. The calculation method begins with summing up the evaluation score for each audit scope. The total score is divided by the number of items based on the audit scope to obtain the actual evaluation score. The evaluation scores are converted into percentage values to determine the color, indicator and level of sports safety in sports store/sports management room based on the Safety Index. Overall Total ÷ 80 X 100 = OVERALL SCORE ÷ 275 X 100 = Figure 1. Audit evaluation form in sports store/sports management room and report on sports safety index in school.

Results
This section presents the results of 3SAT analysis in terms of validity and reliability. The validity of 3SAT data from the 11 panel evaluators was analyzed descriptively and reported in terms of mean and standard deviation. The results of the data analysis showed that all the panel evaluators rated a mean of 9 out of 10 on the 15 items evaluated for the five types of 3SAT. The overall validity value for 3SAT was 9.17 and the standard deviation was .497. The mean value was transformed into percentage and was found to be 91.70%. The validity value was at an excellent level and was relevant to the content of the study (Garson, 2016). The result of the validity value implied that 3SAT is valid and can be administered for this study. Table 4 is a descriptive statistic of the validity of 3SAT from the panel of experts on the 15 items evaluated. Overall mean 9.13 .522 9.07 .621 9.20 .408 9.17 .461 9.30 .479 Subsequently, a pilot study was conducted to determine the reliability of 3SAT. A total of 10 secondary and primary, urban and rural schools were randomly selected to test the reliability of the five types of 3SAT. The researchers, research assistants and teachers as enumerators in the participating schools used observation methods to conduct audits based on items that are listed in the scope of audit. Each audit scope has an evaluation scale of 1 to 5.
Out of the 10 schools surveyed, audits were conducted on 10 sports stores/sports management rooms, and 9 audits were conducted on the field and open court as one school did not have all the listed infrastructure. It also found that only three open hall and indoor halls could be audited as seven other schools did not have the infrastructure to carry out Physical Education, co-curricular and sports activities. Table 5 is the statistics of 3SAT reliability value.  Garson (2016), the auditing reliability of 3SAT in Sports Store/Sports Management Room, Field and Open Court is good and consistent while the auditing reliability of 3SAT in Covered Open Hall is adequate and consistent, the auditing reliability of 3SAT of Indoor Hall is acceptable for the purpose of this study. Thus, 3SAT has excellent validity and relevance to the content of the study while 3SAT reliability is good, sufficient, consistent and acceptable for studies as evinced in Tables 4 and 5.

Summary and Conclusion
The development of school's sports safety audit tool (3SAT) is based on an evaluation model (Stufflebeam, 1983). The model is used to provide analytical and systematic research tools for obtaining empirical evaluation in decision making. The 3SAT design involves evaluation elements in terms of context, input, process and product. The context evaluation involves a retrospective conceptual and empirical analysis of identifying factors of accident incidents in sports that occur in the school environment. The input evaluation is to identify the extent of the need of resources based on several documents on sports safety to select the appropriate strategy for solving the research problem. The process evaluation is to provide feedback on the extent to which the planned activities are carried out and to identify the validity and reliability of the 3SAT formation process. The product evaluation is to identify the impact of the results of the study through 3SAT based on the Sports Safety Index in the schools studied.
The 3SAT method of construction based on the evaluation model (Stufflebeam, 1983) is proven as a steadfast audit tool with excellent validity and relevance to the content of the study while the reliability is good, adequate, consistent and acceptable for this study.