4. Self-reflection questionnaire on educational establishments’ innovation culture

Koen Van Lieshout
OECD
Stéphan Vincent-Lancrin
OECD

The short module of questions on innovation culture includes self-reflective and evaluation questions and follows other questionnaires on work culture, for instance Amabile’s questionnaire discussed in Chapter 2. The topic of innovation culture deserves a module because it provides the foundation for the other three innovation components discussed in the companion report: innovation management, knowledge and information, and resources and drivers. There are three separate versions of the module to capture the insights and reflections of school leaders, teaching staff, and students.

The module is designed to be added to existing questionnaires, such as the self-reflective SELFIE questionnaire of the European Commission, which delves into school infrastructure and capacity to engage with digitalisation. The module would complement SELFIE by collecting information on the enabling and supporting culture for innovation. It could also be used in international or domestic surveys. Another possible use is a separate administration within establishments. It shows how one could capture relevant information within a relatively small number of items.

The module begins with a description of its purpose and provides definitions of the main terms: innovation and innovation activities, with definitions from the Oslo Manual (OECD/Eurostat, 2018[1]); and creativity and critical thinking skills, with definitions taken from the report Fostering Students' Creativity and Critical Thinking: What it Means in School (Vincent-Lancrin et al., 2019[2]). The questionnaire is suitable for all types of educational institutions, including schools and tertiary education. It instructs school or tertiary education leaders to answer the questions for their entire institution and teachers at tertiary education institutions to answer for the part of the institution where they teach. This can either yield statistics if administered with a probability sample or lead to internal discussions within the establishments that collect the data.

The module includes eight questions, each with several sub-questions. The student survey is considerably shorter and does not directly ask about innovation. It includes a question on the student’s year of study to contextualise their answers and permit comparisons across years or schools. Some of the questions could be more applicable to students in higher grades. Students answering yes or no to such items should be evaluated differently depending on their grade level.

With one exception, the response categories for all questions in all three versions consists of an importance scale ranging from ‘strongly agree’ to ‘strongly disagree’ along with a “Don’t know” option. The exception is a question on obstacles to innovation, which uses an importance scale, and question 1.3 in the version for school leaders which uses the share of staff engaged in specific innovation activities.

Question 1.1 asks respondents for their level of agreement with statements on the school’s leadership and management strategies. The questions probe management receptiveness and support for innovation. Several questions ask about management support for including diverse voices, such as teachers, students, and parents, in innovation activities and in providing ideas for innovations. Their inclusion collects input and knowledge from different perspectives and should be particularly important for teaching and learning innovations.

Different sub-questions are included in the three module versions. The six statements for the teacher survey cover management participation in innovation, provision of a clear vision of how changes will lead to improvements, empowering staff to innovate, encouraging students to propose innovations, giving teachers a role in innovation, and taking new ideas and proposals seriously, regardless of their source. The version for school leaders also asks if the school’s innovation strategy includes the knowledge and skills of all staff and if there are dedicated teams working on innovation that include teachers, students, and parents.

The version for students uses different language to ensure understanding, different questions to obtain student perspectives, and asks the questions in different ways. For example, the first sub-question probes if school leaders encourage students to propose new ways of doing things at the school, while the second sub-question asks students to reflect on how often the school changes how it does things (in and outside the classroom).

Question 1.2 collects data on the methods used by the school to involve teachers and students in innovation and the specific ways in which teachers or students are involved. For example, the question for teachers provides statements on the respondent’s perspective on activities to support innovation (“this school has good processes in place for encouraging and developing innovative ideas”) and if the respondent has received support for involvement in innovation activities (“I am rewarded for experimenting with or improving on current practices”, “I can get the resources I need to try out new practices”, “I receive feedback for every innovative idea I suggest”). These are direct measures of the practical implications of the school’s innovation culture, including resources. Ten similar statements are included in the version for school leaders.

There is no equivalent question for students, but students are given seven statements about their involvement in activities that are related to innovation. Examples include “I have been part of groups with teachers or school leaders where we think about new ideas at my school” and “My teachers have responded to suggestions from me or other students in the class to change how they teach”.

Question 1.3 is similar to the second question, but for teaching staff it includes statements on the respondent’s personal involvement in innovation and their innovation skills, while the version for school leaders includes statements on the entire staff. There is no equivalent question for students.

The questions on involvement for teachers cover collaboration (“I am involved with collaborative projects with other schools on innovation in education”) and new practices (“I have adopted new practices into my daily work within the last year”). The questions on skills cover current levels (“I have the skills I need to develop innovative activities or materials”) and the effect of involvement in innovation on developing skills (“participating in innovation activities develops my professional skills”).

The collection of information on how many staff are involved in collaboration is useful as part of improving information flows with other schools, while responses to the adoption of new practices provide baseline data for the percentage of staff that are actively innovating. The question on skills determines if staff believe their skills are sufficient and combined with the perception of staff skills by school leadership, could identify whether additional training might be necessary.

Question 1.4 is identical for school leaders and teachers and covers the importance of six factors in constraining the ability of the respondent to innovate. The question is not included in the student version of the module.

The sub-questions cover government regulations or practices, the school’s internal regulations or practices, the social context, such as community support; the respondent’s skills, a lack of resources, and frequent staff turnover. Over the short term, there is little that respondents can do about government regulations, but information on internal regulations or practices could provide feedback for the school leadership about problems, leading to a dialogue about possible changes to remove or reduce these obstacles. Issues with the social context would suggest a need for the school to build better support for innovations among its stakeholders or work with their community to identify necessary changes.

Question 1.5 concerns resources for innovation and users or stakeholder involvement in innovation. Two questions on resources ask if a dedicated person is available to assist staff with innovations and if a dedicated person is responsible for applying for funding. Three questions on user or stakeholder involvement ask if teachers, students, or parents/guardians “are involved in the design or planning of innovations”. The questions are very similar for teachers and school leaders, but the question is not included in the module for students.

The presence of dedicated personnel to assist innovations or apply for funding will lower the personal costs for teachers to participate in innovation, create ‘institutional expertise’ around innovation, and ensure that there is someone who knows of funding opportunities and how to structure a funding request. The other questions determine if innovations are developed with user input, which should improve the quality and effectiveness of innovations for teaching and learning (Osborne, Radnor and Strokosch, 2016[3]; Osborne et al., 2021[4]).

The version of question 1.6 for teachers asks how the respondents solve problems and their attitudes to risks, while the version for school leaders asks about the school approach to risk. The question is not asked in the student version, although students are asked if they learn from their mistakes. The extent to which the school is willing to take risks affects both its likelihood to innovate and the scope of its innovations. Finding the right balance between a positive risk-taking attitude and being thorough during the innovation process is important. Pilot tests and experimentation can require acceptance of risk, but too much risk taking could result in suboptimal outcomes.

The two questions on risk for teachers address ways of managing risk: “I think it is important to take measured risks to improve teaching and learning” and “failure is acceptable, if the failure was productive (i.e. lessons were drawn)”. Learning from failures can be important for improving future innovations and creating an innovation culture that accepts appropriate risks.

The two questions on problem-solving cover the respondent’s involvement of students and solving problems in a way that is “appropriate to the task at hand”.

The eight sub-questions for teachers in question 1.7 cover creativity in teaching and learning, for instance by using “different teaching methods”, encouraging “students to explore new approaches to assignments and problems”, and “innovative teaching”. Creative problem-solving does not necessarily lead to innovation, but it is an enabling factor. Creativity implies coming up with new and ideas and solutions or connecting different concepts. The module version for students asks several questions on their creativity and use of critical thinking.

The module for school leaders does not cover creativity. Instead, it includes four sub-questions that ask about the ability of the school to absorb external innovations and develop internal innovations. These questions should be evaluated in combination with data on the teachers’ perspective on the school’s innovation culture, which is expected to influence both external and internal innovation activities.

Question 1.8 uses six sub-questions in the version for teachers to assess the current environment for innovation at the school. The sub-questions include attitudinal questions (“I prefer to do things the way I have always done them”), beliefs about the status quo at school (“current practices at this school are good enough”), and collaboration practices (“We work collaboratively across the school to develop and implement new pedagogical practices”). These sub-questions are designed to develop an innovation profile of both responding teachers and school leaders, who are asked similar questions. A willingness to change practices is particularly important for school leaders, as their attitudes are likely to affect their school’s innovation culture.

Collaboration across the school helps to diffuse knowledge about existing practices and solutions, but also ensures that different perspectives are included. The version of the module for school leaders asks for their agreement with the statement “I exchange information with managers at other schools about their practices”. External knowledge sharing among school leaders is valuable for the diffusion of quality innovations between schools and identifying problems and how to solve them.

References

[1] OECD/Eurostat (2018), Oslo Manual 2018: Guidelines for Collecting, Reporting and Using Data on Innovation, 4th Edition, The Measurement of Scientific, Technological and Innovation Activities, OECD Publishing, Paris/Eurostat, Luxembourg, https://doi.org/10.1787/9789264304604-en.

[4] Osborne, S., M. Cucciniello, G. Nasi and K. Strokocsh (2021), “New development: Strategic user orientation in public services delivery—the missing link in the strategic trinity?”, Public Money & Management, Vol. 41/2, pp. 172-175, https://doi.org/10.1080/09540962.2020.1758401.

[3] Osborne, S., Z. Radnor and K. Strokosch (2016), “Co-Production and the Co-Creation of Value in Public Services: A suitable case for treatment?”, Public Management Review, Vol. 18/5, pp. 639-653, https://doi.org/10.1080/14719037.2015.1111927.

[2] Vincent-Lancrin, S., C. González-Sancho, M. Bouckaert, F. de Luca, M. Fernández-Barrerra, G. Jacotin, J. Urgel and Q. Vidal (2019), Fostering Students’ Creativity and Critical Thinking: What it Means in School, Educational Research and Innovation, OECD Publishing, Paris, https://doi.org/10.1787/62212c37-en.

This is a module with questions around innovation culture at [schools]. Its purpose is to help promote self-reflection within a [school] around its processes and culture to support innovative activities. Its main aim is to gather information about the strengths and weaknesses of your innovation culture, and serve as a first step to internal discourse or efforts to improve your [school]’s innovation culture. This module could be implemented as part of [school] self-reflection surveys (such as the SELFIE survey developed by the European Commission).

This version is specific to “[SCHOOL LEADERS]”. Please answer specifically to the campus or part of the [school] you are responsible for. If you are responsible for multiple campuses, the entire [school], and/or multiple levels of education – please answer with all of those in mind. The data collected in this survey is treated confidentially. Data from the [school] leader, student, and teaching staff survey will be matched, but collected data will be treated anonymously.

All terms in [brackets] should be adapted to terms appropriate for the level of schooling, and country context.

MANSTR. 1.1 Do you agree with the following statements about leadership and management strategies at your [school]?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes.

EXTINP. 1.2 How would you evaluate your [school] when it comes to how it approaches the process of innovation?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

SHASTA. 1.3 What share of your staff:

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes.

Innovation activities are actions taken with the intention to develop innovations.

SCOINO. 1.4 How important are the following factors in constraining your ability to innovate?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

EMPAMO. 1.5 Please indicate whether you feel the following statements apply to your work.

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

WOVAST. 1.6 How would you evaluate the following work styles and values at your educational [school]?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

TEACUL. 1.7 To what extent are the following things true when it comes to working on innovation at your [school]?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

PERINN. 1.8 To what extent are the following things true about your personal innovation work at your [school]?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

This is a module with questions around innovation culture at [schools]. Its purpose is to help promote self-reflection within a [school] around its processes and culture to support innovative activities. Its main aim is to gather information about the strengths and weaknesses of your innovation culture, and serve as a first step to internal discourse or efforts to improve your [school]’s innovation culture. This module could be implemented as part of [school] self-reflection surveys (such as the SELFIE survey developed by the European Commission).

This version is specific to “TEACHING STAFF”. Please answer specifically to the campus or part of the [school] where you teach. If you teach at multiple campuses and/or multiple levels of education – please answer with all of those in mind. The data collected in this survey is treated confidentially. Data from the [school] leader, student, and teaching staff survey will be matched, but collected data will be treated anonymously.

All terms in [brackets] should be adapted to terms appropriate for the level of schooling, and country context.

MANSTR. 1.1 Do you agree with the following statements about leadership and management strategies at your [school]?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

EXTINP 1.2 How would you evaluate your [school] when it comes to how it approaches the process of innovation?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

INOPRA 1.3 To what extent do you agree with the following statements about your involvement in innovation?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes.

Innovation activities are actions taken with the intention to develop innovations.

SCOINO. 1.4 How important are the following factors in constraining your ability to innovate in your job?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

EMPAMO 1.5 Please indicate whether you feel the following statements apply to your [school].

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

WOVAST. 1.6 How would you evaluate the following work styles and values at your [school]?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

FLALRC. 1.7 To what extent do you agree with these statements around teaching and learning?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

TEACUL. 1.8 To what extent are the following things true when it comes to working on innovation at your [school]?

An innovation is a new or improved product or process that differs significantly from the [school]’s previous products or processes

This is a module with questions around innovation culture at [school]. Its purpose is to help promote self-reflection within a [school] around its processes and culture to support innovative activities. Its main aim is to gather information about the strengths and weaknesses of your innovation culture, and serve as a first step to internal discourse or efforts to improve your [school]’s innovation culture. This module could be implemented as part of [school] self-reflection surveys (such as of the SELFIE survey from developed by the European Commission).

This version is specific to “STUDENTS’. The data collected in this survey is treated confidentially. Data from the [school] leader, student, and teaching staff survey will be matched, but collected data will be treated anonymously.

All terms in [brackets] should be adapted to terms appropriate for the level of schooling, and country context.

Module questions

AGEGRP 1.1 What year of study are you in?

Year: _______

MANSTR. 1.2 Do you agree with the following statements about your [school]?

School leaders mean the principal, dean, or others that may be in charge at your [school].

EXTINP 1.3 How well do you think the following types of communication around new ideas work at your [school]?

NEWIDE 1.4 Do the following statements apply to you when thinking about new ideas for your [school]?

WOVAST 1.5 Do you agree or disagree with the following statements about your work for [school] (both in and out of class, including homework)?

FLALRC 1.6 Do you agree or disagree with the following statement about your [classes]?

Metadata, Legal and Rights

This document, as well as any data and map included herein, are without prejudice to the status of or sovereignty over any territory, to the delimitation of international frontiers and boundaries and to the name of any territory, city or area. Extracts from publications may be subject to additional disclaimers, which are set out in the complete version of the publication, available at the link provided.

© OECD 2023

The use of this work, whether digital or print, is governed by the Terms and Conditions to be found at https://www.oecd.org/termsandconditions.