2. How does the performance of students in Türkiye compare to international benchmarks?

This chapter examines the performance of students in Türkiye in the IEA TIMSS (Grades 41 and 8) and OECD PISA (15-year-olds) international assessments from 2003 until 2019. It focuses on average performance across the different test domains – mathematics, science and reading (PISA) and mathematics and science (TIMSS) – as well as students’ proficiency across different levels of performance and on trends in performance over time. The chapter compares the performance of students in Türkiye to the OECD average and to that of students in the selected benchmark countries – Germany, Poland and Russia (see Chapter 1 for an explanation of how benchmark countries were selected).

All students and adults require proficiency in mathematics, science and reading in order to thrive in modern societies. Proficiency in the different domains is not only needed in the labour market but also for performing basic daily tasks and for understanding the world surrounding us. By the end of compulsory education, students should have a solid mastery of mathematics, science and languages and be able to apply their knowledge to solve problems that they encounter in their daily lives. The proficiency levels used by the PISA and TIMSS assessments are fully described in Chapter 1.

In 2019, for the first time in Türkiye’s participation in TIMSS, Grade 4 students performed above the international average (i.e. average of all TIMSS-participating countries in 2019)2 in both mathematics and science (Figure 2.1). Grade 4 students in Türkiye also performed very close to the OECD average in mathematics and at the same level as the OECD average in science. Statistically, Türkiye’s performance was similar to many countries, including some countries that historically score above the OECD average, such as Germany, Poland and Sweden in mathematics, and Croatia, Hungary and Ireland in science.

In 2019, almost a third (29.6%) of students in Türkiye performed at or below the low benchmark in mathematics (Figure 2.2). Students below the low benchmark are not able to use basic mathematics concepts or solve simple problems while those at the low benchmark can add, subtract, multiply and divide but struggle with more complex questions (see Chapter 1). While the share of students performing at or below the low benchmark in Türkiye was similar to the international average, it was higher than the OECD average (25.8%) and all of the benchmark countries.

In contrast, 42.5% of students in Türkiye performed at the high and advanced benchmarks. Students at the high benchmark can apply conceptual understanding to solve problems while those at the advanced benchmark can find solutions in a variety of relatively complex situations and explain their reasoning. The share of students performing at the highest levels in Türkiye was greater than both the international and OECD averages.

In science, one-fourth of students performed below or at the low benchmark (Figure 2.3). Students below the low benchmark lack basic knowledge and understanding of physical and life sciences, while those at the low benchmark have some basic scientific knowledge. The share of students performing at the lowest two levels in Türkiye was smaller than the international average and similar to the OECD average (24.8%). It was also lower than the share of low performers (i.e. at or below the low benchmark) in mathematics.

In Türkiye, 44% of students reached the high and advanced proficiency benchmarks. At these levels, students are able to apply scientific knowledge in everyday and abstract contexts. The share of students performing at these levels was higher than both the international and OECD averages. In general, students in Türkiye often perform higher in science than in other domains, suggesting it is an area of national strength.

The trend in Türkiye’s Grade 4 mathematics scores between 2011 and 2019 shows marked improvement (Figure 2.4). Average performance rose by 14 score points between 2011 and 2015 and a further 40 points between 2015 and 2019, surpassing the international average and bringing Türkiye very close to the OECD average. The improvement in Türkiye’s performance was substantial especially in the last cycle (between 2015 and 2019).

In general, in TIMSS, countries that made substantial improvements like Türkiye started from a position below the international average, with few exceptions. This was the case of Poland which experienced the largest rise among all countries between 2011 and 2015, moving from significantly below the international average to significantly above it. In contrast, countries that showed stability or minor declines were those that started near or above the international average (e.g. Germany, whose performance remained stable).

The performance in science of Grade 4 students also improved with a rise of 20 score points between 2011 and 2015 followed by a substantial rise of 43 score points between 2015 and 2019 (Figure 2.5. Trends in students’ science performance in Grade 4). This rise brought Türkiye’s average above the international average and closed the gap with the OECD average. Only Poland had a similar improvement over time with a rise of 42 score points between 2011 and 2015. This rise was followed by a drop of 16 score points between 2015 and 2019, while Germany experienced a drop of ten score points between 2011 and 2019.

In mathematics, between the two TIMSS cycles of 2011 and 2019, the share of students performing at or below the low benchmark declined substantially (Figure 2.6). In 2011, half (49%) of the students performed at or below the low benchmark. By 2019, just less than a third of students performed at the two lowest levels (i.e. below and at the low benchmark) and the share of students performing below the low benchmark almost halved. In contrast, the share of students performing at high and advanced levels doubled over the same period. A similar pattern was observed in Poland between 2011 and 2015. Over that period, Poland’s results were marked by a substantial rise in the number of students in the high and advanced benchmarks of about 27 percentage points and an equivalent decline in the proportion of low achievers (at or below the low benchmark).

The evolution of proficiency in science over time was similar (Figure 2.7). Between 2011 and 2019, there was a clear drop in the share of students scoring below the low benchmark (decline of 14 percentage points) and the share of students in the low benchmark (decline of 13 percentage points combined with a rise in the high (18 percentage points)) and advanced proficiency benchmark (8 percentage points). Comparatively, a similar trend was observed in Poland with the share of students below the low, low and intermediate benchmarks declining and the share of students in the high and advanced benchmarks rising by 14 percentage points.

In mathematics in 2019, Grade 8 students in Türkiye had an average performance that was similar to the international average of TIMSS countries but below the average of OECD countries (Figure 2.8). Statistically, the performance of students in Türkiye in mathematics was similar to that of students in Italy, Norway and Sweden, while in science it was similar to that of students in England (United Kingdom) and Israel.

About 20% of Grade 8 students scored below the low proficiency benchmark in mathematics (Figure 2.9). This was similar to the international average of 19% but higher than the OECD average of 10%. Students at this level are unable to perform basic mathematics tasks. In contrast, a larger proportion of students – 32% in mathematics – performed at the high or advanced benchmarks.

In science, 12% of students did not reach the low benchmark against an international average of 18% (OECD average of 9%). In contrast, a larger proportion (38% of students) performed at the high or advanced benchmarks. Türkiye’s comparatively stronger performance in science compared with mathematics reflects the relative strength of the country’s performance in this domain.

The improvement trend in Grade 4 was mirrored by a similar and even stronger trend (in terms of absolute points) in Grade 8 in both mathematics and science (Figure 2.11). Achievements in mathematics improved over the period of 2007 to 2018 with a rise of 64 score points, bringing Türkiye to the international average and closer to the OECD average. The bulk of this improvement took place between 2015 and 2019 (rise of 38 score points).

A major improvement in students’ science achievements in Grade 8 was observed between 2011 and 2019 (Figure 2.12). Average performance rose by 61 score points with the bulk of improvement happening between 2007 and 2011 (29 score points), and between 2015 and 2019 (22 score points). This rise brought Türkiye’s average performance above the international average of 499 (but just below the OECD average of 526) and closed the gap with high performing countries.

In 2007 in mathematics, more than two-thirds of students (67.1%) performed at or below the low proficiency benchmark. Between 2007 and 2019, there was a major and consistent decline in the share of students performing at those levels with a fall of more than 20 percentage points (Figure 2.13). This drop was accompanied by a rise in the share of students in the intermediate, high and advanced proficiency benchmarks. The largest improvements were observed in the high and advanced benchmarks, with a doubling of the share of students in each benchmark by 2019.

In science in 2007, almost two-thirds (59.9%) of students performed at or below the low benchmark, falling to just over a third (34%) by 2019 (Figure 2.14). At the other end of the scale, there was an improvement in all other three benchmarks (i.e. intermediate, high and advanced), especially at the high and advanced benchmarks where the share of students in these top benchmarks more than doubled.

As the target Grade 4 cohort in 2011 is the same as the one in Grade 8 in 2015, and the one in Grade 4 in 2015 is the same as the one in Grade 8 in 2019, TIMSS allows for comparison of relative progress achieved by the cohort between these grades. It should, however, be noted that due to the fact that TIMSS is a quasi-longitudinal survey, it is possible to compare the performance of the same cohort at different points in time but not that of individual students. Therefore, what does TIMSS tell us about students’ progress in mathematics and science between Grades 4 and 8?

The first cohort that was assessed in Grade 4 in 2011 and then in Grade 8 in 2015 (“Cohort 1”) showed a decline in mathematics performance and an improvement in science performance between Grades 4 and 8. In mathematics, the average performance of this cohort declined by 11 score points between Grades 4 and 8, while in science, performance improved by 30 score points between the two grades (Figure 2.15).

The second cohort, which was first assessed in Grade 4 in 2015 and then in Grade 8 in 2019 (“Cohort 2”) improved in both subjects across grades. In mathematics, performance improved by 13 score points and by 32 score points in science. Another country that had major progress for Cohort 2 in science and mathematics is Bahrain.

Moreover, between Grades 4 and 8, the proportion of students not reaching the low proficiency benchmark in science declined by about five percentage points. This decline was mirrored by a rise in the proportion of students reaching the high and advanced benchmarks. In mathematics, the proportion of students not reaching the low proficiency benchmark rose by one percentage point between 2015 (Grade 4) and 2019 (Grade 8).

Performance on the PISA assessment can be reported in a variety of ways. In this section, average performance on the PISA test for Türkiye and benchmark countries is presented, in addition to proficiency in the three domains of assessment: mathematics, science and reading. When considering Türkiye’s PISA results, it is important to bear in mind that performance improved at the same time as the rapid expansion of the education system (see Chapter 1 and below).

In 2018, 15-year-old students in Türkiye scored below the OECD average in all domains of assessment: reading, mathematics and science; however, the gap between Türkiye’s performance and the OECD average was smaller in science than in mathematics (Figure 2.16). Statistically, performance in reading was similar to that of Greece, Israel, Luxembourg and Ukraine, science was similar to that of Belarus, Croatia, Israel, Italy, Slovak Republic and Ukraine, and mathematics was similar to that of Cyprus, Greece, Serbia and Ukraine.

Across the three domains assessed by PISA in 2018, mathematics was the domain where there was the greatest share (37%) of students who did not attain the baseline level of proficiency at which students are considered to have the basic skills and knowledge they will need for success in life and work (i.e. Level 2) (see Chapter 1 for further information about proficiency levels). The share of low achievers (i.e. performing below Level 2) in science was more than ten percentage points lower (25.5%) and much closer to the OECD average (22%). In reading, the share of low performers was also closer to the OECD average (Figure 2.17).

In contrast, the share of high performers (i.e. Level 5 or above) was the greatest in mathematics (4.8%) and the closest to the OECD average (10.8%). In contrast, the share of high performers in science (2.5%) and reading (3.3%) was lower and further away from the OECD average.

The PISA data show that both the participation and performance of 15-year-olds in Türkiye has improved over time. While there has been a general trend of improvement, average scores in all domains dropped unexpectedly in 2015. Box 2.2 discusses possible reasons for this decline. Since 2003, in mathematics, average performance has risen by 30 score points with a substantial increase between 2006 and 2009 and later between 2015 and 2018 (Figure 2.20). Türkiye’s improving performance was the largest among all three benchmark countries. In general, countries that did well on the PISA test in earlier cycles tended to have stable performances or more modest improvements than countries like Türkiye that started from a lower position with greater room for growth. The two other countries that experienced major improvements between 2003 and 2018 are Poland and Portugal.

Türkiye’s average performance in science improved by more than 40 score points between 2006 (the first year when science was the main domain of assessment) and 2018 with an unexpected drop in 2015 (Figure 2.21). This rise brought Türkiye’s performance closer to the OECD average and reduced the gap by more than a half (the gap shrunk from 40 score points to 20). In all three benchmark countries, performances were either stable (Poland and Russia) or declined over that period (Germany). The only country to experience a greater improvement in science between 2006 and 2018 was Qatar (increase of 70 score points).

In reading, the average performance of students in Türkiye rose by 25 score points between 2003 and 2018, reaching its highest level in 2012 (Figure 2.22). Mexico was one of the only countries to experience a substantial rise in reading performance over the same period.

In mathematics in 2018, the proportion of low achievers (students performing below Level 2) declined by about 15 percentage points in comparison with previous cycles of PISA (i.e. 2003 and 2015) while the proportion of top achievers (students performing at Level 5 or above) slightly increased. On average across OECD countries, the proportion of high and low achievers did not change. This result is particularly encouraging because it shows that the improving trends in mathematics were driven by a rise in the performance of low achievers. It is particularly notable that the performance of low performers improved at the same time as previously out-of-school students remained in school longer (see following section on improving performance and rising participation among 15-year-olds). Among the three benchmark countries, Poland had similar trends over time with a decline in the proportion of low achievers.

In science, between 2006 and 2018, the proportion of low achievers declined by 20 percentage points while the share of high achievers rose by two percentage points (across all OECD countries, the proportions were stable). Most of the improvement in performance took place among the intermediate achievers. No other country, including the three benchmarks, had a similar decline in the share of low achievers over that period with the exception of Qatar (drop of 31 percentage points).

In reading, the proportion of low and high achievers was stable over the period of 2009 to 2015. However, between 2015 and 2018, the share of low achievers (performing below Level 2) declined by 14 percentage points while the share of high achievers (performing at Level 5 or above) increased by three percentage points. No changes were observed on average across OECD countries. Only North Macedonia had a similar decline in the proportion of low achievers over the same period of time as Türkiye.

Over the period of 2003 to 2018, the average performance in reading of students in Türkiye improved by 25 score points. This improvement was accompanied by a rise in enrolment among 15-year-olds and a rise in the PISA sample coverage (see Chapter 1). School enrolment increased progressively between 2003 and 2012 with the largest rise taking place in 2012 when education became compulsory for this age group. Similarly, coverage of the PISA sample of the 15-year-old population improved over time (with the coverage index rising from 36% to 73%) as more students became eligible for sampling.3

Assessment of out-of-school 15-year-olds in five countries by the OECD shows that they perform lower than those that are in school (Ward, 2020[7]). One might therefore expect that as an education system expands and participation increases, with previously out-of-school children starting to attend school, that average performance might decline. However, Türkiye’s PISA results show that the country has been able to both increase participation and performance at the same time. Comparing the performance of the highest and lowest performing students over time shows that Türkiye has been able to improve the performance of both high and low performing students while participation has increased. The score of students at the 75th percentile of performance – who are most likely not to have been impacted by changes in enrolment – increased by 27 points in reading between 2003 and 2018. At the same time, the score of students at the 25th percentile of performance – the group of performers most likely affected by increasing enrolment – also increased by 27 score points. This suggests that Türkiye has been able to bring previously out-of-school young people into school and still improve performance for most of the student population including the newcomers (see Chapters 1 and 3).

Policies and initiatives undertaken by the Ministry of National Education and other actors over the last decade have contributed to improvements in both participation and quality at the same time. These include improvements in the school infrastructure, for example by increasing the number of classrooms, increasing teacher numbers and expanding access to a wider share of students, for example by providing transportation services for students living in remote areas may also have contributed to improvements in quality and access. In particular, the expansion of access among girls has been a major achievement in Türkiye. While girls were under-represented in PISA 2003, representing 45% of the PISA sample, more girls progressively joined the system to reach parity with boys by 2018 (in 2018, girls represented 49.6% of the PISA sample). Since girls score higher than boys on average in two out of three PISA domains (reading and science), the increase in girls’ participation, relative to boys, may have helped to increase Türkiye’s average score in PISA over time. It is also possible that in Türkiye, the rise in participation was achieved among the easier to reach population since only one-third of 15-year-olds were eligible to participate in PISA in 2003.

This chapter paints a very positive picture of student performance in Türkiye. Average performance in Grades 4 and 8 and at age 15 has improved progressively over time and the gap between Türkiye’s performance and the OECD average and that of TIMSS-participating countries has shrunk substantially. These improvements have been driven by a rise in the share of high performers and a decline in the share of low performers in all grades and across the two assessments (PISA and TIMSS). The improvements in PISA are particularly notable since they were accompanied by a rise in participation among 15-year-olds. However, it is important to note that since the 2018 PISA assessment only covered 73% of 15-year-olds, the data do not provide a full picture of the performance of all 15-year-olds in Türkiye.

References

[1] IEA (2020), TIMSS 2019 International Results in Mathematics and Science, TIMSS & PIRLS International Study Center, Lynch School of Education, Boston College, and International Association for the Evaluation of Educational Achievement, https://timssandpirls.bc.edu/timss2019/international-results/ (accessed on 21 May 2021).

[3] IEA (2016), TIMSS 2015 International Reports, TIMSS & PIRLS International Study Center, Lynch School of Education, Boston College, and International Association for the Evaluation of Educational Achievement, http://timssandpirls.bc.edu/timss2015/international-results/ (accessed on 21 May 2021).

[2] IEA (2012), About TIMSS 2011, TIMSS & PIRLS International Study Center, Boston College, International Association for the Evaluation of Educational Achievement, https://timssandpirls.bc.edu/timss2011/ (accessed on 21 May 2021).

[5] Kitchen, H. et al. (2019), OECD Reviews of Evaluation and Assessment in Education: Student Assessment in Turkey, OECD Reviews of Evaluation and Assessment in Education, OECD Publishing, Paris, https://doi.org/10.1787/5edc0abe-en.

[4] OECD (2021), “PISA: Programme for International Student Assessment”, OECD Education Statistics (database), https://doi.org/10.1787/data-00365-en (accessed on 21 May 2021).

[7] Ward, M. (2020), “PISA for Development: Out-of-school assessment: Results in Focus”, PISA in Focus, No. 110, OECD Publishing, Paris, https://doi.org/10.1787/491fb74a-en (accessed on 24 July 2021).

[6] World Bank (2017), “World Bank administers School Construction Projects under the Facility for Refugees in Turkey”, World Bank, Washington, DC, https://www.worldbank.org/en/news/press-release/2017/01/30/world-bank-administers-school-construction-projects-under-the-facility-for-refugees-in-turkey (accessed on 6 December 2021).

Notes

← 1. In this report, the terminology of “TIMSS Grade 4” is used throughout since this is the official name of the assessment. However, the data refer to Grade 5 students in lower secondary education in Türkiye.

← 2. For consistency across the PISA analysis and in line with the OECD’s standard practice for comparative analysis, an average of TIMSS-participating countries (“TIMSS international average”) and OECD countries that participate in TIMSS (“OECD average”) are used throughout this report.

← 3. See Chapter 1 for a discussion on the difference between the PISA coverage index and national enrolment rates.

Metadata, Legal and Rights

This document, as well as any data and map included herein, are without prejudice to the status of or sovereignty over any territory, to the delimitation of international frontiers and boundaries and to the name of any territory, city or area. Extracts from publications may be subject to additional disclaimers, which are set out in the complete version of the publication, available at the link provided.

© OECD 2022

The use of this work, whether digital or print, is governed by the Terms and Conditions to be found at https://www.oecd.org/termsandconditions.