Purpose

This paper investigates the future of emerging skills and their impact on occupations in the European Union by setting up a powerful paradigm of leveraging the European Skills, Competences, Qualifications and Occupations (ESCO) Delta files to predict future skills in a repeatable fashion, allowing policymakers and educational institutes to easily gain insights into emerging skill needs. This study explores the implications of automation on skill development, addressing key questions regarding the emergence of non-automatable skills across all industries and skills contained in the ESCO dataset.

Design/methodology/approach

The research design is exploratory, quantitative and cross-sectional. This study employed a big data analysis of the ESCO Delta datasets combined with the ALM-hypothesis framework to analyse the emergence of non-automatable (herein called non-routinisable) skills and what this means for future occupations. The proposed methodology provides a replicable framework for analysing future ESCO Delta file releases with regard to emerging, non-routinsable skills.

Findings

Our empirical findings reveal that (1) there is a Self-Automating Effect, i.e. non-routinisable skills are growing more in non-technical industries and technical industries may be automating themselves out of jobs. (2) The Matthew Effect in Skills, i.e. high-skill jobs are requiring more skills (compared to low-skill jobs as measured by educational requirements) and so becoming more specialised, however, counterintuitively, AI may be reducing this gap. (3) The Red Queen Effect: in spite of the effect of AI in (2), we find that in jobs requiring higher educational degrees, the new skill requirements are increasing most (with a few notable exceptions), requiring employees to run just to stay in the same place.

Originality/value

This study contributes to the existing literature in three ways: (1) it shows a practical and easy-to-replicate approach to leverage the high quality, well curated ESCO data set to carry out predictions of future skills (routinisable or not); (2) it answers questions around skill inequalities potentially arising due to technology advancements; (3) it helps governments and educational institutes understand which skills are emerging, “future-proof” skills that future graduates and current employees will likely need in order to remain competitive in the labour markets of the future.

The rapid advancement of Artificial Intelligence (AI), particularly the emergence of Large Language Models (LLMs) and generative AI, has fundamentally altered the landscape of work. The automation of cognitive tasks, previously thought to be the exclusive domain of human expertise, is reshaping the composition of skills required across a wide spectrum of occupations. Traditional economic theories on job displacement, such as the Autor–Levy–Murnane (ALM) hypothesis (Autor et al., 2003), have long distinguished between routine and non-routine tasks, predicting that routinisable work – whether cognitive or manual – is particularly susceptible to technological automation by AI. More recent scholarship (Susskind, 2019) has expanded on this framework, arguing that even non-routine analytical and interpersonal tasks are increasingly vulnerable as AI systems advance in sophistication, calling tasks that might become susceptible to automation by machines or computers routinisable.

In light of these technological disruptions, there is a clear need to examine shifts in the European labour market, particularly the emergence of new skill requirements. The European Skills, Competences, Qualifications and Occupations (ESCO) database provides a uniquely valuable resource for tracking changes in the skills required across occupations. By systematically analysing the new skills added to ESCO in each major delta update of the database, we can gain critical insights into the evolving demands of the job market. However, merely identifying new skills is insufficient – many of these additions may already be on the path to obsolescence if they remain what is known as routinisable. To address this challenge, our study applies the ALM hypothesis and subsequent refinements by Susskind to filter out skills that are likely to be automated in the near future (we use subjective expert judgement to predict what, in the next five years, could be automated and include the data on the choices with the paper). What remains is a refined set of genuinely emergent, non-routinisable skills that provide a forward-looking perspective on the competencies that will define the future of work.

As well as analysing individual skills, it is equally important to examine how these new competencies are distributed across occupations. A key research gap in labour market studies is the concentration of skill emergence – that is, identifying which occupational categories are experiencing the most significant influx of new skill requirements (Beblavỳ et al., 2016). Are these emerging skills concentrated in high-skill, high-autonomy professions, or are they diffusing across mid- and low-skill occupations as well? Are certain occupations undergoing more profound skill transformations than others? Answering these questions will provide policymakers, educators, and workforce planners with essential guidance on where reskilling efforts should be targeted.

Despite the growing literature on automation and AI-driven labour market shifts (Shellshear and Oh, 2024), there remains a lack of empirical work linking real-world skill updates from easily usable and accessible data sources – as captured in high-quality databases like ESCO – to theoretical models of automation vulnerability. This study addresses this critical research gap by integrating dynamic skill evolution data with established frameworks of task (and skill) routinisation. In doing so, we move beyond broad discussions of automation risk to offer concrete, evidence-based insights into the skills that will define the next generation of European workers.

This research is of urgent relevance. The transformative effects of generative AI are already evident across industries, with sectors such as customer service, software development, legal analysis and office administration experiencing rapid integration of AI tools (Spring et al., 2022). Yet, policymakers remain uncertain about which skills will remain robust in the face of automation. By distinguishing between truly emergent skills and those that are transient placeholders before obsolescence, we provide insights into changing skill demands in the near future.

In the sections that follow, we first present a review of the literature, then a systematic methodology for tracking skill evolution using ESCO Delta files across all skills contained in these datasets, provide a framework for identifying routinisable versus non-routinisable skills, and an empirical investigation into occupational patterns of skill emergence. We discuss these findings, and then finally, we conclude. Our findings offer a forward-looking view of the competencies that will shape the future European workforce and provide actionable insights for education and labour policy in the age of AI-driven disruption.

Much has been written about the future of skills, automation and labour markets and we summarise the main research relevant for this paper here beginning with a review of the dataset that forms the core of our analysis, the ESCO (“ESCO Website,” 2025) dataset.

According to its website, ESCO is a European Commission project, run by the Directorate General for Employment, Social Affairs and Inclusion. Its first full version (ESCO v1) was published on the 28th of July 2017. Built on the Simple Knowledge Organization System, ESCO aims to enhance communication between employers and job seekers. De Smedt et al. (2015) describe the design and development of the ESCO dataset, a multilingual classification of ESCO, as a building block for a semantic labour market ecosystem.

The ESCO dataset has been used in a variety of studies and can help as a tool for improving labour market efficiency and addressing skill mismatches in the EU. Building on ESCO’s purpose as a semantic labour market tool, le Vrang et al. (2014) used ESCO data to tackle the problem of semantic interoperability to help address the mismatch between workers' skills and companies' needs in the EU labour market. Thematically, this paper is closely related to the work presented here.

The ESCO dataset has also been used for understanding occupations and skills on a number of occasions. For example Chiarello et al. (2021) examine the ESCO skills classification via text mining to see if it can help align the European ESCO skills classification with emerging Industry 4.0 technological trends to provide more up-to-date labour market intelligence. Further on this theme, Caratozzolo et al. (2023) proposes a dynamic knowledge, skills and abilities matrix-based taxonomy for the Industry 4.0 workforce using the ESCO dataset. Although these studies show good uses of the ESCO dataset for understanding skills and occupations, they are only tangentially related to the topic at hand.

Additionally, machine learning and big data techniques have been applied to the ESCO dataset to automate resume/skill classification and improve productivity in skill-based labour market mechanics and dynamics, combining massive resume datasets with official statistical surveys (Mrsic et al., 2020). Further on this theme, Mason et al. (2023) demonstrate how skills taxonomies like ESCO can be used with machine learning to integrate online data and reveal skills gaps to inform career and training decisions. This work is of relevance to the results presented here in its complementary nature of showing how to extend the ESCO results here to a more global scale.

Although the above papers (and similar ones not cited here) are relevant to our analysis and use the ESCO dataset, they do not address the research questions that we would like to investigate in this study.

Predicting future skills is an important task for both policymakers and education institutes and so much has been written on this topic, especially with the current interest in AI and its impact on jobs and employment rates. For example, Eskarne et al. (2019) provide a thorough overview of much research on the impact of technology on employment, shifting skills needs and patterns of occupational change. It synthesises an analysis of the automation of skills and jobs and provides references to many studies that analyse these topics. Building on this theme, Ennis (2018) discusses the need to define and develop 21st-century skills for the future workforce and does so by leveraging data from the World Economic Forum in collaboration with the Boston Consulting Group, New Vision for Education: Fostering Social and Emotional Learning through Technology. It provides insights into competencies and character qualities that are essential for the future workforce, as explored in its research sources.

Of relevance to this paper is a study which developed a multilayer data analysis protocol to predict future skills by examining research publications (Telukdarie et al., 2021). This paper uses research publications to predict future skills, rather than relying on current skill demand or economic indicators. This is similar in theme to the current paper but approaches the question from a different direction. Other papers such as Kotsiou et al. (2022) synthesise various future skills frameworks into nine meta-categories to inform the conceptualization of skills needed for the future. This allows a predictive framework for discovering future skills but is not based on concrete data that will continue to be refreshed in the future (like the ESCO dataset). On a similar note, Bakhshi (2017) uses a novel method to map likely changes in employment and skills, finding growth in education, healthcare and public sector occupations, contrary to assumptions about automation’s impact. These results align with the findings of this paper. Although not using the ESCO dataset, another paper worth noting along this line is (Sousa and Wilks, 2018) which identifies critical and disruptive technological skills needed by organizations in the future, however, the paper focuses on the skills required by small and medium-sized enterprises with their findings identifying the critical skills of importance as complex problem-solving, critical thinking, creativity, people management, coordinating with others, emotional intelligence, judgement and decision-making, service orientation and negotiating and cognitive flexibility. The important disruptive technological skills were artificial intelligence, nanotechnology, robotisation, Internet of Things, augmented reality and digitalisation. Corroborating this work, Vorina et al. (2023) predict that adaptability, creativity, critical thinking and digital skills will be important for future jobs due to technological changes.

An earlier paper, Wilson (2010) discusses the need for Europe to generate higher quality and more innovative products and services, requiring new jobs and skills, to compete in the global market, looking at skills supply and demand in Europe, medium-term forecast up to 2020. The focus, however, is on industry-level demand and needs for specific occupations unlike our focus on specific skills. Another paper of a similar theme is MacCrory et al. (2014), which examines changes in occupational skill requirements from 2006 to 2014 due to rapid technological advances, finding the expected result of a reduction in skills that compete with machines and an increase in skills that complement machines.

Although extensive research has explored evolution, automation and labour market transformation, what is missing has been the usage of a repeatable and easily updated framework for predicting future skill needs based on an easily available public data source so that the relevant analysis can be repeated in a predictable and reliable fashion as more data are provided or updated. Without such a dataset, many studies that have scraped data from multiple websites (Borbásné Szabó and Ternai, 2018), show that this can lead to data collection methods that become illegal or challenging in the future as organisations protect themselves from data scrapers due to the impact of AI tools consuming data to train their models.

The other half of the skills equation is the jobs side and much has also been written on this topic. As brief examples, Jagannathan et al., (2019) provide an overview of global and regional trends impacting emerging jobs and labour markets, the overview collects a number of papers together which examine promising strategies in skills for jobs that address trends around labour markets of the future with a particular focus on Asia. Fareri et al. (2021) developed the SkillNER system, a named entity recognition tool, which was created to automatically extract soft skills from text, enabling the detection of job profile communities based on shared soft skills. Leveraging the ESCO dataset, Mirski et al. (2017) describe the OpenSKIMR approach to match individual skills with job demands, with the goal of enabling young people to plan and simulate their individual learning and career trajectories. By using ESCO, they are able to provide a consistent understanding of the skills and qualifications of relevant talents, showcasing the possibility of matching data about skills, learning and jobs. Finally, the article (Wilson, 2012) forecasts future job trends in Europe. This Cedefop research paper provides data showing a number of trends, such as most new jobs in Europe being at the higher and lower end of the skill spectrum, bringing a risk of job polarisation. The data presented shows weak employment growth, indicating a possible oversupply of people with high-level qualifications, leading to the most highly-qualified workforce in its history in Europe, relevant to some of the results presented here.

Our work complements the above papers, filling in a number of gaps as mentioned earlier and builds on the work by Wilson (2012) to predict the future job trends in Europe based on the effect of automation on skills needed by jobs.

It is worth noting that outside of the European context, much has been written about workforce adaptation and changing skill demands. For example, the paper (Lokesh et al., 2024) explores the intersection of AI and the future of work, with a focus on the imminent technological shifts and the evolution of in-demand skills. This is done via a literature review on the current state of AI in the workforce and identifying gaps in knowledge and training. The paper introduces a novel approach to addressing the identified gaps with a conceptual framework emphasising adaptive strategies for workforce development. Their early results indicated an intricate interplay between AI adoption and skill demands, providing insights for workforce adaptation. The implications are not dissimilar to those arising here.

The paper (Miah, 2024) discusses future AI’s implications, among others, on job creation and job displacement and provides recommendations on how workers and companies can prepare for AI. Some key insights presented are around the predicted job market shifts due to AI, suggesting a bifurcation of roles similar to the aforementioned paper’s identification with new opportunities emerging alongside potential job displacement. These disruptions highlight the necessity for upskilling and reskilling initiatives, empowering the workforce to adapt and thrive in an AI-driven environment, especially in skill development. The insights from this article are at a higher economic level rather than broad and specific skill focused like this paper.

The final piece of the puzzle which is important for this paper is deciding which jobs, tasks and skills will likely be automated by computers, robots and machines. This is a real effect and studies have observed a reduction in skills that compete with machines, an increase in skills complementing machines, and growth in areas where automation has not yet made significant progress (MacCrory et al., 2014). To understand this, a key part of the theory used in this paper is the ALM hypothesis (Autor et al., 2003). This hypothesis is built around two key assumptions:

(1) that computer capital substitutes for workers in carrying out a limited and well-defined set of cognitive and manual activities, those that can be accomplished by following explicit rules (what we term routine tasks); and (2) that computer capital complements workers in carrying out problem-solving and complex communication activities (nonroutine tasks).

Although the task-based approach to understanding technological change’s impact on labour markets is widely accepted (instead of just a focus on jobs as evidenced by papers citing the aforementioned publication), the classification of tasks as routine has been challenged for underestimating the capabilities of machines (Susskind, 2019). Susskind proposes a new hypothesis that encompasses ALM as a special case, addressing tasks previously thought immune to automation that he calls routinisable, a concept we use in this paper. The complexity of this topic was further explored by (Autor, 2015), who argued that while automation substitutes for labour, it also complements it, increasing productivity and labour demand, hence providing a more nuanced picture of skill and job automation that is corroborated by the analysis in this paper.

Research Questions

This article carries out an exploratory analysis of the ESCO dataset, looking to address three questions:

  1. The Self-Automating Effect: Are any industries (such as IT) reducing their own occupational skill requirements through automation-driven skill evolution?

  2. The Matthew Effect in Skills: Are high-skill jobs requiring more skills (compared to low-skill jobs, as measured by educational requirements) and so becoming more specialised and further out of reach for the less educated? What impact does AI and automation have on this?

  3. The Red Queen Effect: Put bluntly, are some jobs just running to stay in place? In what types of occupations are we seeing the most new skills being required of employees? Is this effect real or just perceived?

The ESCO dataset represents an ideal dataset for carrying out the analysis in this paper. Unlike other datasets scraped from websites or collected from private repositories, the ESCO dataset is a professionally curated, high-quality dataset of thousands of skills and occupations (at the point of writing it contained 3,039 occupations and 13,939 skills). It is well maintained and regularly updated, freely available and well documented, as well as funded by the EU, making it perfect for research projects like the one presented here.

To use the ESCO dataset, our first step was to collect the requisite data from the ESCO website. These data can be downloaded freely and as stated on the website:

Note that other than accepting the privacy statement, there are no additional requirements when downloading ESCO, (“ESCO Website,” 2025)

Hence, the data can be used for any purpose, not violating the privacy statements. Once downloaded, the data need to be filtered, joined and selected to be able to carry out the planned analysis; however, before we describe that process, we explain how skills are added and managed in the ESCO database. Our usage of the datasets analysed all occupations and skills subject to the data preparation steps below.

Skills, competencies and ESCO

The first and one of the most important principles to understand is the types of knowledge, skills and competencies included in ESCO as well as what ESCO means by these concepts. This question is answered directly on the ESCO website as follows:

The skills pillar includes knowledge, skills and competences that are defined as follows:

  1. Knowledge: The body of facts, principles, theories and practices that is related to a field of work or study. Knowledge is described as theoretical and/or factual, and is the outcome of the assimilation of information through learning.

  2. Skill: The ability to apply knowledge and use know-how to complete tasks and solve problems. Skills are described as cognitive (involving the use of logical, intuitive and creative thinking) or practical (involving manual dexterity and the use of methods, materials, tools and instruments).

  3. Competence: The proven ability to use knowledge, skills and personal, social and/or methodological abilities, in work or study situations, and in professional and personal development.

While sometimes used as synonyms, the scope of the terms “skill” and “competence” can be distinguished. “Skill” refers to the use of methods or instruments in a particular setting and in relation to defined tasks. “Competence” is broader and refers to the ability of a person, facing new situations and unforeseen challenges, to use and apply knowledge and skills in an independent and self-directed way. However, there is no distinction between skills and competences recorded in the ESCO skills pillar.

In our analysis, we only required skills and so left knowledge and competences out of our analyses.

To ensure that the database is suitable for our analysis, we need to understand how skills are added to the database. To do this, ESCO employs a methodology that blends a data-driven approach with human expertise. Input is received from a variety of sources, including stakeholders, experts, ESCO users, researchers and national classifications who propose improvements or suggest adding new concepts. These suggestions are then validated by checking whether the concepts are being actively used in the EU labour market and education and training fields. For this purpose, ESCO analyses data such as Online Job Vacancies, CVs, other national or international classifications, courses and learning outcomes and similar sources. In addition to user suggestions, ESCO collects data from all these sources in order to analyse if there are new emerging concepts. The process also involves enriching and clustering extracted information, mapping it to ESCO concepts, manually validating the results and consultations (the above description was provided in a personal communication from ESCO and is also detailed in the reference on Figure 1 below).

Figure 1
A figure depicting the steps highlighted by E S C O for database creation.The figure shows the icon “E S C O: European Skills or Competences, Qualifications and Occupations” in the top left corner and the logo of the “European Commission” on the top right corner. The figure is titled “E S C O v 1.2. Methodology: A data driven approach.” Below the title, a horizontal blue bar is labeled “Data Driven Approach,” under which five text boxes representing five stages are arranged in a horizontal series. The first stage is labeled “1. Feedback and Data Collection” and includes six text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “External expert’s input,” Text box 2: “M S Mapping tables and N O Cs,” Text box 3: “Online job skills,” Text box 4: “E U R O P A S S user profiles,” Text box 5: “Courses and Learning Outcomes,” and Text box 6: “Desk Research.” The second stage is labeled “2. Processing Data Using A I Models” and includes four text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “Enriching extracted info with metadata,” Text box 2: “Clustering extracted info,” Text box 3: “Mapping extracted info to E S C O concepts,” and Text box 4: “A I provides a score to spot potential new concepts.” The third stage is labeled “3. Manual Validation of A I” and includes three text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “Drafting validation and terminological rules,” Text box 2: “E S C O S E C manually validates the mapping,” and Text box 3: “Decisions to include new concepts or alternative labels.” The fourth stage is labeled “4. Quality Review and Drafting Concepts” and includes four text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “Peer review based on previous decisions,” Text box 2: “Input revision by experts and stakeholders,” Text box 3: “Final conclusions on new concepts,” and Text box 4: “Drafting of new concepts (descriptions, N P T s, relations...).” The fifth and final stage is labeled “5. Final Quality Review and Consultation” and includes four text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “Final quality checks,” Text box 2: “Preparing concepts for consultation,” Text box 3: “M S and Public consultation on the new version,” and Text box 4: “Validation by Member States (E N and translations).”

The ESCO methodology for the creation of its database. Used with permission of ESCO. “Source: ESCO version 1.2” (2024) 

Figure 1
A figure depicting the steps highlighted by E S C O for database creation.The figure shows the icon “E S C O: European Skills or Competences, Qualifications and Occupations” in the top left corner and the logo of the “European Commission” on the top right corner. The figure is titled “E S C O v 1.2. Methodology: A data driven approach.” Below the title, a horizontal blue bar is labeled “Data Driven Approach,” under which five text boxes representing five stages are arranged in a horizontal series. The first stage is labeled “1. Feedback and Data Collection” and includes six text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “External expert’s input,” Text box 2: “M S Mapping tables and N O Cs,” Text box 3: “Online job skills,” Text box 4: “E U R O P A S S user profiles,” Text box 5: “Courses and Learning Outcomes,” and Text box 6: “Desk Research.” The second stage is labeled “2. Processing Data Using A I Models” and includes four text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “Enriching extracted info with metadata,” Text box 2: “Clustering extracted info,” Text box 3: “Mapping extracted info to E S C O concepts,” and Text box 4: “A I provides a score to spot potential new concepts.” The third stage is labeled “3. Manual Validation of A I” and includes three text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “Drafting validation and terminological rules,” Text box 2: “E S C O S E C manually validates the mapping,” and Text box 3: “Decisions to include new concepts or alternative labels.” The fourth stage is labeled “4. Quality Review and Drafting Concepts” and includes four text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “Peer review based on previous decisions,” Text box 2: “Input revision by experts and stakeholders,” Text box 3: “Final conclusions on new concepts,” and Text box 4: “Drafting of new concepts (descriptions, N P T s, relations...).” The fifth and final stage is labeled “5. Final Quality Review and Consultation” and includes four text boxes arranged in a vertical series. They are labeled from top to bottom as follows: Text box 1: “Final quality checks,” Text box 2: “Preparing concepts for consultation,” Text box 3: “M S and Public consultation on the new version,” and Text box 4: “Validation by Member States (E N and translations).”

The ESCO methodology for the creation of its database. Used with permission of ESCO. “Source: ESCO version 1.2” (2024) 

Close Figure 1

The exact methodology was presented in a presentation on the recent launch of v1.2 (“ESCO Website,” 2025) and is presented in the following diagram:

As mentioned, our analysis focused on skills/concepts, not knowledge in the ESCO classification.

Preparing the ESCO data for analysis

In this section, we give a description of the ESCO data required for the analysis in this paper.

For the analysis, we focused on the so-called Deltas of the ESCO datasets. These are updates to the database which may add new content such as skills but may perform other functions too. Only the major version updates (i.e. an update to the second digit of the version such as 1.2 or 1.1) will contain new content, as stated on the website under FAQs (“ESCO Website,” 2025):

  1. Minor versions: contain changes that do not affect the concept level (i.e. no concepts are added, no concepts are removed and the scope of the existing concepts is not changed). Minor releases refer to typos, adding or removing relations between concepts, making minor changes to the labels and the descriptions, etc. and do not require any update of mapping tables.

  2. Major versions: contain changes that affect either the concept level (i.e. concepts are added, concepts are removed and the scope of the existing concepts is changed) and/or the data model.

Hence, our analysis utilises the major version updates to the ESCO database, of which there were two relevant ones for our analysis, v1.0.9 - > v1.1.0 and v1.1.1 - > v1.2.0 [1]. In terms of timelines:

  1. ESCO v1.2.0 was released on the 13th of May 2024

  2. ESCO v1.1.0 was released on the 28th of January 2022; however, a pre-release was made available in December 2020.

  3. ESCO v1.0.0 was released on the 28th of July 2017

The major updates to the skills and occupations occurred at the v1.0.9 → v1.1.0 update where 353 new skills/competencies were added. In the v1.1.1 → v1.2.0 update 42 new skills were added.

The size of the datasets used for the analysis are as follows:

  1. The Delta v1.1.0 dataset initially contained 191,734 records, with 23,082 of these being English records, which are the focus of our analysis (the dataset is linguistically diverse, comprising a total of 28 unique languages). Upon reviewing the dataset, out of the 191,734, a total of 64,287 records were there to indicate a removed record, while 22,659 were of existing records that were updated, and finally those of interest were the 104,784 newly added records. Additionally, there were 4 records that remained unclassified.

  2. To analyse the Delta v1.1.0 we required other files as well which were:

    • broaderRelationsSkillPillar_en which contained 20,771 total records

    • skills_en which contained 13,891 total records

    • skillGroups_en which contained 643 total records

    • occupations_en which contained 3,008 total records

    • occupationSkillRelations_en which contained 123,852 total records

  3. The updated Delta v1.2.0 dataset consists of 140,550 records, with 20,338 of these being English records, which are the primary focus of our analysis. This dataset represents a significant update, with 75,319 of the records indicating they were added, 63,899 records indicating a removal, and 1,332 existing records were updated. Notably, all records have been classified, with no unclassified records remaining. As before, the dataset continued to showcase linguistic diversity, spanning 28 unique languages.

  4. As above, to analyse the Delta v1.2.0 we required other files as well which were:

    • broaderRelationsSkillPillar_en which contained 20,822 total records

    • skills_en which contained 13,939 total records

    • skillGroups_en which contained 640 total records

    • occupations_en which contained 3,039 total records

    • occupationSkillRelations_en which contained 129,004 total records

Almost a million records in total formed the data source for our analysis. Of these records in the two Deltas, we then selected a subset of them for our analysis by selecting only those records where:

  1. Language is either EN or NONE

  2. conceptURI contains “skill” - To indicated it is skill competence/knowledge record

  3. Action is “Added” - Indicate new records added to the new dataset

Note that the ESCO data classify skills into hierarchies, for example, for the skill “comply with regulations”, it is the final level in the hierarchy: transversal skills and competences → social and communication skills and competences → following ethical code of conduct → comply with regulations.

For our analysis, we choose to work with the L1 and L2 skill levels to be able to aggregate concepts to a sufficient level and analyse larger scale trends instead of, e.g. trying to create our own groupings of terms, we used the natural hierarchies provided by ESCO (to allow easy replicability of our study). Also, going beyond the L1 or L2 skill levels and using the L3 skill level was not an option due to many entries missing and each entry being unique and so not providing aggregated trends. Our process to join the datasets is presented in Figure 2 below.

Figure 2
A database schema diagram shows seven E S C O tables with labeled fields and arrows indicating foreign key relationships.The first table on the top left has 5 rows and 2 columns. Row 1 represents the table header “broader underscore Relations underscore Skill underscore Pillar,” and rows 2 to 5 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: concepty underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES. Row 4: Column 1: broader underscore type; Column 2: string. Row 5: Column 1: broader U r i; Column 2: REFERENCE. The second table on the bottom left has 11 rows and 2 columns. Row 1 represents the table header “skill underscore groups,” and rows 2 to 11 are divided into two columns. The data presented is as follows: Row 2: Column 1: concepty underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES. Row 4: Column 1: preferred underscore label; Column 2: string. Row 5: Column 1: alt underscore labels; Column 2: string. Row 6: Column 1: hidden underscore labels; Column 2: string. Row 7: Column 1: status; Column 2: string. Row 8: Column 1: modified underscore date; Column 2: timestamp. Row 9: Column 1: in underscore scheme; Column 2: string. Row 10: Column 1: description; Column 2: string. Row 11: Column 1: code; Column 2: string. The third table at the top center has 16 rows and 2 columns. Row 1 represents the table header “skills,” and rows 2 to 16 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: concept underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: P K. Row 4: Column 1: skill underscore type; Column 2: string. Row 5: Column 1: reuse underscore level; Column 2: string. Row 6: Column 1: preferred underscore label; Column 2: string. Row 7: Column 1: alt underscore labels; Column 2: string. Row 8: Column 1: hidden underscore labels; Column 2: string. Row 9: Column 1: status; Column 2: string. Row 10: Column 1: modified underscore date; Column 2: timestamp. Row 11: Column 1: scope underscore note; Column 2: string. Row 12: Column 1: definition; Column 2: string. Row 13: Column 1: in underscore scheme; Column 2: string. Row 14: Column 1: description; Column 2: string. Row 15: Column 1: version; Column 2: string. Row 16: Column 1: is underscore deleted; Column 2: boolean. The fourth table on the bottom center has 6 rows and 2 columns. Row 1 is the table header “skill underscore skill underscore relations,” and rows 2 to 7 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: original underscore skill underscore u r i; Column 2: REFERENCES. Row 3: Column 1: original underscore skill underscore type; Column 2: string. Row 4: Column 1: relation underscore type; Column 2: string. Row 5: Column 1: related underscore skill underscore type; Column 2: string. Row 6: Column 1: related underscore skill underscore u r i; Column 2: REFERENCES. Row 7: Column 1: version; Column 2: string. The fifth table on the top right has 17 rows and 2 columns. Row 1 represents the table header “occupations,” and rows 2 to 17 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: concept underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: P K. Row 4: Column 1: i s c o underscore group; Column 2: REFERENCES. Row 5: Column 1: preferred underscore label; Column 2: string. Row 6: Column 1: alt underscore labels; Column 2: string. Row 7: Column 1: hidden underscore labels; Column 2: string. Row 8: Column 1: status; Column 2: string. Row 9: Column 1: modified underscore date; Column 2: timestamp. Row 10: Column 1: regulated underscore profession underscore note; Column 2: Type. Row 11: Column 1: scope underscore note; Column 2: string. Row 12: Column 1: definition; Column 2: string. Row 13: Column 1: in underscore scheme; Column 2: string. Row 14: Column 1: description; Column 2: string. Row 15: Column 1: code; Column 2: string. Row 16: Column 1: version; Column 2: string. Row 17: Column 1: is underscore deleted; Column 2: boolean. The sixth table on the bottom center-right has 6 rows and 2 columns. Row 1 represents the table header “occupation underscore skill underscore relations,” and rows 2 to 7 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: occupation underscore u r i; Column 2: REFERENCES. Row 3: Column 1: relation underscore type; Column 2: string. Row 4: Column 1: skill underscore type; Column 2: string. Row 5: Column 1: skill underscore u r i; Column 2: REFERENCES. Row 6: Column 1: related underscore skill underscore u r i; Column 2: string. Row 7: Column 1: version; Column 2: string. The seventh table on the top, to the right of the fifth, has 10 rows and 2 columns. Row 1 represents the table header “I S C O underscore groups,” and rows 2 to 9 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: concept underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: string. Row 4: Column 1: code; Column 2: P K. Row 5: Column 1: preferred underscore label; Column 2: string. Row 6: Column 1: status; Column 2: string. Row 7: Column 1: alt underscore labels; Column 2: string. Row 8: Column 1: in underscore scheme; Column 2: string. Row 9: Column 1: description; Column 2: string. Row 10: Column 1: version; Column 2: string. A line from “Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES” of the first table connects to “Row 3: Column 1: concept underscore u r i; Column 2: P K” of the third table. A line from “Row 5: Column 1: broader u r i; Column 2: REFERENCE” of the first table connects to “Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES” of the second table. A line from “Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES” of the first table connects to “Row 5: Column 1: broader U r i; Column 2: REFERENCE” of the first table. A line from “Row 3: Column 1: concept underscore u r i; Column 2: P K” of the third table connects to “Row 2: Column 1: original underscore skill underscore u r i; Column 2: REFERENCES” of the fourth table. Another line from “Row 3: Column 1: concept underscore u r i; Column 2: P K” of the third table connects to “Row 5: Column 1: skill underscore u r i; Column 2: REFERENCES” of the sixth table. A line from “Row 3: Column 1: concept underscore u r i; Column 2: P K” of the fifth table connects to “Row 2: Column 1: occupation underscore u r i; Column 2: REFERENCES” of the sixth table. A line from “Row 4: Column 1: i s c o underscore group; Column 2: REFERENCES” of the fifth table connects to “Row 4: Column 1: code; Column 2: P K” of the seventh table.

The connections between concepts of the different ESCO tables. The arrows link primary and foreign keys to join tables. Source: Figure by authors

Figure 2
A database schema diagram shows seven E S C O tables with labeled fields and arrows indicating foreign key relationships.The first table on the top left has 5 rows and 2 columns. Row 1 represents the table header “broader underscore Relations underscore Skill underscore Pillar,” and rows 2 to 5 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: concepty underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES. Row 4: Column 1: broader underscore type; Column 2: string. Row 5: Column 1: broader U r i; Column 2: REFERENCE. The second table on the bottom left has 11 rows and 2 columns. Row 1 represents the table header “skill underscore groups,” and rows 2 to 11 are divided into two columns. The data presented is as follows: Row 2: Column 1: concepty underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES. Row 4: Column 1: preferred underscore label; Column 2: string. Row 5: Column 1: alt underscore labels; Column 2: string. Row 6: Column 1: hidden underscore labels; Column 2: string. Row 7: Column 1: status; Column 2: string. Row 8: Column 1: modified underscore date; Column 2: timestamp. Row 9: Column 1: in underscore scheme; Column 2: string. Row 10: Column 1: description; Column 2: string. Row 11: Column 1: code; Column 2: string. The third table at the top center has 16 rows and 2 columns. Row 1 represents the table header “skills,” and rows 2 to 16 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: concept underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: P K. Row 4: Column 1: skill underscore type; Column 2: string. Row 5: Column 1: reuse underscore level; Column 2: string. Row 6: Column 1: preferred underscore label; Column 2: string. Row 7: Column 1: alt underscore labels; Column 2: string. Row 8: Column 1: hidden underscore labels; Column 2: string. Row 9: Column 1: status; Column 2: string. Row 10: Column 1: modified underscore date; Column 2: timestamp. Row 11: Column 1: scope underscore note; Column 2: string. Row 12: Column 1: definition; Column 2: string. Row 13: Column 1: in underscore scheme; Column 2: string. Row 14: Column 1: description; Column 2: string. Row 15: Column 1: version; Column 2: string. Row 16: Column 1: is underscore deleted; Column 2: boolean. The fourth table on the bottom center has 6 rows and 2 columns. Row 1 is the table header “skill underscore skill underscore relations,” and rows 2 to 7 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: original underscore skill underscore u r i; Column 2: REFERENCES. Row 3: Column 1: original underscore skill underscore type; Column 2: string. Row 4: Column 1: relation underscore type; Column 2: string. Row 5: Column 1: related underscore skill underscore type; Column 2: string. Row 6: Column 1: related underscore skill underscore u r i; Column 2: REFERENCES. Row 7: Column 1: version; Column 2: string. The fifth table on the top right has 17 rows and 2 columns. Row 1 represents the table header “occupations,” and rows 2 to 17 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: concept underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: P K. Row 4: Column 1: i s c o underscore group; Column 2: REFERENCES. Row 5: Column 1: preferred underscore label; Column 2: string. Row 6: Column 1: alt underscore labels; Column 2: string. Row 7: Column 1: hidden underscore labels; Column 2: string. Row 8: Column 1: status; Column 2: string. Row 9: Column 1: modified underscore date; Column 2: timestamp. Row 10: Column 1: regulated underscore profession underscore note; Column 2: Type. Row 11: Column 1: scope underscore note; Column 2: string. Row 12: Column 1: definition; Column 2: string. Row 13: Column 1: in underscore scheme; Column 2: string. Row 14: Column 1: description; Column 2: string. Row 15: Column 1: code; Column 2: string. Row 16: Column 1: version; Column 2: string. Row 17: Column 1: is underscore deleted; Column 2: boolean. The sixth table on the bottom center-right has 6 rows and 2 columns. Row 1 represents the table header “occupation underscore skill underscore relations,” and rows 2 to 7 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: occupation underscore u r i; Column 2: REFERENCES. Row 3: Column 1: relation underscore type; Column 2: string. Row 4: Column 1: skill underscore type; Column 2: string. Row 5: Column 1: skill underscore u r i; Column 2: REFERENCES. Row 6: Column 1: related underscore skill underscore u r i; Column 2: string. Row 7: Column 1: version; Column 2: string. The seventh table on the top, to the right of the fifth, has 10 rows and 2 columns. Row 1 represents the table header “I S C O underscore groups,” and rows 2 to 9 are divided into two columns. The data presented in the table is as follows: Row 2: Column 1: concept underscore type; Column 2: string. Row 3: Column 1: concept underscore u r i; Column 2: string. Row 4: Column 1: code; Column 2: P K. Row 5: Column 1: preferred underscore label; Column 2: string. Row 6: Column 1: status; Column 2: string. Row 7: Column 1: alt underscore labels; Column 2: string. Row 8: Column 1: in underscore scheme; Column 2: string. Row 9: Column 1: description; Column 2: string. Row 10: Column 1: version; Column 2: string. A line from “Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES” of the first table connects to “Row 3: Column 1: concept underscore u r i; Column 2: P K” of the third table. A line from “Row 5: Column 1: broader u r i; Column 2: REFERENCE” of the first table connects to “Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES” of the second table. A line from “Row 3: Column 1: concept underscore u r i; Column 2: REFERENCES” of the first table connects to “Row 5: Column 1: broader U r i; Column 2: REFERENCE” of the first table. A line from “Row 3: Column 1: concept underscore u r i; Column 2: P K” of the third table connects to “Row 2: Column 1: original underscore skill underscore u r i; Column 2: REFERENCES” of the fourth table. Another line from “Row 3: Column 1: concept underscore u r i; Column 2: P K” of the third table connects to “Row 5: Column 1: skill underscore u r i; Column 2: REFERENCES” of the sixth table. A line from “Row 3: Column 1: concept underscore u r i; Column 2: P K” of the fifth table connects to “Row 2: Column 1: occupation underscore u r i; Column 2: REFERENCES” of the sixth table. A line from “Row 4: Column 1: i s c o underscore group; Column 2: REFERENCES” of the fifth table connects to “Row 4: Column 1: code; Column 2: P K” of the seventh table.

The connections between concepts of the different ESCO tables. The arrows link primary and foreign keys to join tables. Source: Figure by authors

Close Figure 2

To validate data integrity, we systematically cross-referenced a subset of records from the Delta file with the online ESCO database using conceptURI identifiers, which served as the primary key. This helped us to understand how new skills were being added and how existing ones were modified over time. Additionally, we examined the broaderRelationsSkillPillar_en file to identify the highest-level skill group each skill belongs to, and based on this, we selected the highest and second highest skill levels for our analyses (i.e. L1 and L2). This step was essential in categorising skills correctly and recognizing overarching trends in ESCO’s evolving taxonomy. Once we established the relationships between these datasets, we developed a Python script to extract, process and analyse the relevant data (as mentioned above in the three filtering steps), the results of which we produce in the Data Analysis and Results section below.

In our analysis, we also combined the two deltas into one given that the remaining set of skills in the v1.1.1 → v1.2.0 Delta was only 42. This meant that we were unable to provide a longitudinal time-based analysis; however, it allowed for more robust analysis of the evolution of skills given the larger volume of new skills.

The second part of our processing of the data analyses the new skills added to the ESCO database via the Deltas and classifies them as routinisable or not. This part of the analysis used the extension of the ALM hypothesis presented in (Susskind, 2019). According to this article, Susskind introduces the concept of routinisable which he defines as follows:

If a task is routinisable, a routine can be composed that allows a machine to perform it – but that routine may not necessarily reflect the way in which a human being performs the task. The concept of “routinisability” nests the concept of “routineness”. The latter is focused on whether a task has features that make it more or less feasible to articulate how a human being performs it in a set of rules for a machine to follow. The concept of “routinisability” instead asks whether a task has features that make it more or less feasible to articulate a set of rules for a machine to follow.

To determine which skills are routinisable we used an expert evaluation. Both authors have been developing AI tools for a combined 30+ years and so based on our experiences (working in machine learning, generative AI and optimisation), we classified tasks into routinisable or not based on our experience and predictions. We also found this most appropriate given the recent developments in generative AI and our choice of frameworks (ALM) for deciding on routinisable or not. We see this approach as valid for this publication for two reasons:

  1. Although not perfect (Stevens et al., 2019), it has also been shown in a number of publications and different domains that human expert judgement produces lower error than state of the art machine based approaches in a number of domains (Ärje et al., 2020; EDENBRANDT et al., 1993) or use human experts to form the basis of machine judgement (Yang, 1994).

  2. In addition, we provide the data of what we have classified as routinisable so that others can reproduce our classification easily.

Before choosing this approach, we analysed other approaches such as the one used by Frey and Osborne (2017) who developed a methodology to estimate the probability of computerization for various occupations. They utilized machine learning algorithms to assess tasks based on:

  1. Perception and Manipulation: Tasks requiring manual dexterity and complex perception are less likely to be automated.

  2. Creative Intelligence: Tasks involving originality and fine arts are less susceptible.

  3. Social Intelligence: Tasks necessitating social interaction and negotiation are less prone to automation.

Using these criteria, Frey and Osborne could assign a probability that a task could become automated. This approach wasn’t suitable for our scenario due to types of skills provided in ESCO and the skill level we chose to analyse skills on. So in carrying out the classification, we oriented ourselves on the original ALM-Hypothesis paper (Autor et al., 2003) and how it explained what a routine task was and then extended that definition in accordance with Susskind’s recommendation. In their paper, Autor et al. (2003) categorised tasks into routine and non-routine, as well as cognitive and manual dimensions. According to the authors, routine tasks are characterised by repetitive and rule-based activities, hence are more prone to automation. We used this to guide our classification.

As a part of our classification into routinisable and non-routinisable, we made three additional assumptions:

  1. Our time horizon for deciding on whether a skill is routinisable or not was five years and so it was whether the authors believed that a certain skill or competence would be automatable in the next five years.

  2. Artificial General Intelligence will not become a reality in the next five years, otherwise it would render almost all skills (if not all skills) routinisable.

  3. The 30+ years of experience of the authors was a sufficient basis to classify skills as routinisable.

Once our classification of the skills was complete, we then removed any routinisable skills from the skillsets and analysed the L1 categories to understand which industries and areas we expected to be impacted most, leaving a non-routinisable set of skills for the future which allowed us to answer Research Question 1 above. The results of this are explored in the next section.

After carrying out this analysis, we moved on to Research Questions 2 and 3. For this, we took this remaining list of skills and examined the occupations that required these non-routinisable skills. To do so, we removed rows from the table of skills (a sample of which is provided in Table 1) for L2 skills that we deemed to be routinisable. Note that all the L2 skills were unique, so there were no issues with joining these two datasets to carry out this matching. This left a set of rows and occupations which we used to answer Research Questions 2 and 3.

Table 1

An example of an occupation and the new skills included in the v1.0.9 – v1.1.0 update

OccupationL1 skill categoryL2 skill category
Mountain guideAssisting and caringCounselling
Mountain guideCommunication, collaboration and creativityLiaising and networking
Mountain guideCommunication, collaboration and creativityTeaching and training
Mountain guideManagement skillsAllocating and controlling resources
Mountain guideInformation skillsMonitoring, inspecting and testing
Mountain guideWorking with computersUsing digital tools for collaboration, content creation and problem solving

Source(s): Table by authors

We begin analysing Research Question 1 beginning with both all the new routinisable and non-routinisable skills and then remove the routinisable skills as discussed in the previous section. We present this at the Level 1 (L1) level of granularity to be able to identify trends. Table 2 presents the results for all new skills in the two Deltas as well as the results for all non-routinisable skills with the number in parentheses showing the order of most to least (i.e. (2) indicates this L1 Skill Category has the second largest number of skills in the list).

Table 2

L1 skills by all and non-routinisable types, the numbers in parentheses indicate the new order from most to least

L1 skill categoryAll new L1 skillsNon-routinisable L1 skills
Communication, collaboration and creativity110 (1)50 (1)
Information skills73 (2)12 (6)
Management skills45 (3)45 (2)
Assisting and caring36 (4)36 (3)
Working with computers32 (5)14 (5)
Life skills and competences23 (6)23 (4)
Working with machinery and specialised equipment20 (7)8 (8)
Handling and moving11 (8)1 (12)
Core skills and competences9 (9)9 (7)
Social and communication skills and competences9 (9)9 (7)
Thinking skills and competences7 (10)7 (9)
Self-management skills and competences7 (10)7 (9)
Physical and manual skills and competences4 (11)4 (10)
Constructing3 (12)3 (11)
Inter-disciplinary programmes and qualifications involving engineering, manufacturing and construction1 (13)0 (13)

Source(s): Table by authors

To answer Research Questions 2 and 3, we need to look at the relationship between occupations with routinisable and non-routinisable skills and then non-routinisable skills separately as well as whether such jobs require a higher education degree. An example of occupations and new L1 skills for the routinisable vs non-routinisable cases is presented in Tables 3 and 4 respectively.

Table 3

A list of occupations and counts of all L1 skills

OccupationAll new L1 skills
Energy engineer68
Architect59
Mechanical engineer54
Civil engineer33
Environmental scientist27
Chemical engineer27
Urban planner26
Chemist26
Data scientist26
Microsystem engineer25

Source(s): Table by authors

Table 4

A list of occupations and counts of all non-routinisable L1 skills

OccupationNon-routinisable L1 skills
Energy engineer25
Architect25
Mechanical engineer21
Environmental scientist19
Chemist18
Toxicologist18
Civil engineer18
Behavioural scientist18
Chemical engineer18
Economist18

Source(s): Table by authors

The next step was to combine this data with whether the occupations were deemed to require a higher education degree or not. This analysis was carried out by analysing each role and confirming whether the job required a bachelor’s degree or higher. This analysis was guided by the Bureau of Labor Statistics (BLS) Educational and Training Assignments (“Education and training assignments by detailed occupation,” 2023). The U.S. BLS assigns typical education levels needed for entry into various occupations. These assignments are based on analyses of job duties and the education and training commonly required and were used to assess the roles (or similar roles) to decide whether a bachelor’s (or more advanced degree) was required. We also provide this classification data as part of the submission of this paper.

From the ESCO updates, there was a total of 488 roles that were deemed to require any of the new skills in at least one of the two ESCO Delta updates. Of these, there were 376 roles remaining which needed new, non-routinisable skills (so 112 roles did not require new, non-routinisable skills but just had new skills), and of those 249 required a higher education degree and 129 didn’t require higher education degrees (i.e. at least a university bachelor’s degree).

For both routinisable and non-routinisable skills, what we discover is that for all occupations requiring a higher education degree, there are 3,720 new skills across 302 occupations with a mean of 12.32 new skills per occupation and a sample standard deviation of 11.73 (the range of values was from 68 to 1). For occupations not requiring a higher education degree, there were 186 occupations and 613 new skills with a mean of 3.3 and a standard deviation of 3.51 (the range of values was from 22 to 1).

Due to the nature of the skills per occupation distributions being multimodal and non-Gaussian, we also looked at a number of skill cut-offs for the number of occupations requiring a higher degree. For occupations requiring a higher education degree, there were 140 occupations needing 10 or more new skills; for occupations not requiring higher education degrees, it was 17 occupations needing 10 or more new skills.

For just the non-routinisable skills, what we discover is that for all occupations requiring a higher education degree, there were 249 occupations with 2,422 new skills with a mean of 9.73 and a sample standard deviation of 7.7 (the range of values was from 25 to 1). For non-higher education occupations, there were 127 occupations and 380 new skills with a mean of 2.99 and a standard deviation of 2.62 (the range of values was from 11 to 1).

Similar to the above, we analysed a skill cut off of 10 or more skills with 126 such occupations requiring a higher education degree and only 3 occupations not requiring a higher education degree.

The main results of the above analysis are summarised in Table 5 below.

Table 5

Summary of skill differences across occupation and skill types

Skill typeMeanStandard deviationDiff. Statistically significant
Higher Ed. Occupation All L1 Skills12.3211.73No
Non-Higher Ed. Occupation All L1 Skills3.33.51
Higher Ed. Occup. Non-routinisable L1 Skills9.737.7No
Non-Higher Ed. Occup. Non-routinisable L1 Skills2.992.62

Source(s): Table by authors

Given there were many occupations with a single new skill, we reviewed the data to see if this single new skill was the same skill for all occupations but it was not the case that there was a common skill (i.e. occurring more than half the time) amongst all of these occupations with just one new skill.

To answer Research Question 3, we analysed the data to understand which types of occupations are seeing the most new skills added when we view them from the dimensions of higher education vs non-higher education and also from the routinisable vs non-routinisable perspective.

When looking at all L1 skills, there are 302 occupations that require a higher education degree, and there are 186 occupations that do not require a higher education degree for occupations with new skills being added. When the 488 occupations were ranked in order of the number of new skills being added, occupations 1 to 128 were occupations requiring higher education degrees, with occupation 129 not requiring a higher education degree. From a purely probabilistic perspective, if the order of the appearance of these occupations was random (i.e. the skill distributions came from similar distributions), then using the binomial distribution to model this probability (with p = 302/488), the probability of this specific order of the first 128 occupations requiring higher education degrees occurring is equal to 2.1697 × 10–25, a probability so low (well below standard statistical significance thresholds of α = 0.01) so this is highly likely not random. A similar calculation for non-routinisable skills shows a similarly low probability, showing it highly likely not random that occupations requiring higher education degrees all have so many new skills added in the latest two ESCO Delta updates.

The above data helps us to answer Research Question 1 by showing that, for skills in the IT sector such as information skills and working with computers, although there are many emerging skills (of both routinisable and non-routinisable types), the necessity of prioritising of these skills by policymakers and educational institutes requires further investigation due to such skills not even being in the top three most important recently added skills after filtering out routinisable skills.

On average, the overall new skills in the combined deltas were 390, with only 228 skills being classified as non-routinisable, an overall reduction of 162 (roughly 11 per L1 skill category, of which there were 15) or 42%. We see that in the information skills category that 61 skills or 83% are routinisable (according to our analysis) and in working with computers, 18 skills or 56% are routinisable (both above the L1 skill category average). Another category for which many skills were routinisable is communication, collaboration and creativity skills, with 55% being routinisable. Despite this reduction, there were so many new skills in the communication, collaboration and creativity skills category that it remains the category with the most new non-routinisable L1 skills, demonstrating their importance.

The clearly critical L1 skill categories (in addition to communication, collaboration and creativity skills) that should remain a focus are management skills and the related skills of assisting and caring. All are clearly human tasks that require human input and so we see the other half of the question being answered that although many new computer-focused skills are arising, many will become routinisable and so should not be focused on from an education and policy perspective. However, the people skills that have been a focus of many other studies, Josten and Lordan (2022) have shown that not only are they expanding quickly in the new skills required, but these skills are not routinisable. Assuming that the trends discovered here continue, they deserve significant attention from an education and policy perspective.

To answer Research Question 2, we analysed the occupation data and the new skills per occupation. This research question has two parts:

  1. Are occupations for people with higher education degrees becoming more specialised (i.e. requiring more skills) and further out of reach for those without higher education degrees?

  2. What impact does AI and automation have on this difference in required skills?

In analysing the above, the data indicates that the answer to the first part of Research Question 2 would be yes, although the difference presented here is not statistically significant. By looking at occupations from the routinisable and non-routinisable perspective, we see that the mean for higher education degree requiring occupations (12.24) is greater than for occupations not requiring a higher education degree (3.52) (albeit this not being statistically significant).

When analysing the second part of Research Question 2, we see that the automation of certain skills (i.e. routinisable skills) may potentially be reducing the gap between the new skills required, decreasing the mean for occupations requiring a higher education degree from 12.24 to 9.67 (a 21% decrease) more than for those not requiring a higher education degree from 3.52 to 3.21 (a 9% decrease). These initial findings suggest that AI-driven automation may be contributing to a reduction in skill inequality across occupations, although these results are also not statistically significant, however, provide an interesting trend. This is not a totally expected result as some literature seems to indicate a widening gap (Morandini et al., 2023), and so suggests an opportunity for further investigation.

The explanation for this counterintuitive result may be due to technical (e.g. IT) industries in which many new skills are created (originally ranked second and fifth in terms of routinisable and non-routinisable new skills respectively) are simultaneously the industry capable of building AI tools and so perhaps the easiest target for their AI tools are to solve their own problems, hence automating away the new skills that are arising to deal with the technology changes. The definitive answer to this question is a research project in itself.

As we saw from the binomial distribution probability calculation in the previous section, if our null hypothesis were that higher education and non-higher education degrees both required an equal number of new skills, then our final calculation in the “Data analysis and results” section leads us to reject the null hypothesis and conclude that occupations requiring higher education degree are truly requiring more new skills than occupations not requiring higher education degrees (albeit noting the above trend in IT industries).

When we combine the results from Research Question 2 and Research Question 3, then the conclusion we can draw is that yes, occupations requiring higher education degrees are adding more skills but when we take into account the question of which skills are routinisable, then this gap shrinks (especially in IT industries) suggesting that, in the limit, automation may be reducing the disparity between the traditionally more cognitive jobs than those requiring more human presence, physical labour or management. Then overlaying Research Question 1 on top of this conclusion, we see this effect on the individual skill level, noting that many of the IT-related new skills are actually ones that are routinisable, leaving the following three L1 skill categories as being the ones with the most new and emerging, non-routinisable skills:

  1. Communication, collaboration and creativity

  2. Management skills

  3. Assisting and caring

Again, this shows the importance of human skills in an AI-automated workplace.

An important point to note in the above that is missing, is the discussion clearly around the needed increase in AI literacy and skills for employees who will likely be expected to be able to use AI tools to automate parts of their work. This may come from external vendors, but nonetheless an ability to work with AI tools is clearly another important and significant conclusion from the above. With an estimated 41.5% of all new skills in the ESCO Deltas predicted to be routinisable in the next five years, it is clearly a pressing matter.

This study contributes to the existing literature on labour market automation, skill evolution and workforce adaptability by introducing a replicable methodology for tracking skill transformations using the ESCO dataset. Unlike previous studies that rely on static analyses or broad theoretical discussions, our approach integrates dynamic, real-world skill updates with established automation frameworks, providing an ability to develop a longitudinal perspective on emerging competencies. Additionally, this research refines the ALM hypothesis by incorporating Susskind’s concept of routinisability, offering a more nuanced classification of skills susceptible to automation. The findings also seem to indicate that prevailing assumptions about AI’s impact on skill inequality may require further investigation, as the results here suggest that automation may be reducing, rather than exacerbating, disparities between high- and low-skill occupations.

The findings of this study have significant implications for policymakers, educational institutions and industry leaders seeking to navigate the shifting labour market landscape. With over 40% of new skills identified in the ESCO dataset deemed routinisable within the next five years, strategic workforce planning is essential to prevent skill obsolescence. Policymakers should prioritize the integration of future-proof, non-routinisable skills – such as critical thinking, complex problem-solving and interpersonal communication – into educational curricula and lifelong learning programs. Similarly, businesses must reconsider hiring and training strategies, ensuring that employees are equipped to work alongside AI systems rather than be displaced by them. Organizations should also foster a culture of continuous skill development, leveraging AI-enhanced learning tools to upskill workers in emerging, non-automatable domains. By proactively addressing these shifts, European labour markets can better adapt to automation and technological disruption while ensuring a more resilient and inclusive workforce.

This study has provided a data-driven analysis of emerging skills in the European labour market, leveraging ESCO Delta files to identify trends in skill evolution and automation susceptibility across all skills and occupations present in the ESCO datasets. By integrating the ALM hypothesis and Susskind’s framework on routinisability, we examined the impact of automation on occupational skill requirements, addressing three key research questions.

Our findings highlight the Self-Automating Effect, demonstrating that technical industries are automating themselves out of jobs, with many newly emerging IT-related skills classified as routinisable. This suggests that while digital competencies remain relevant, they may not provide long-term job security in their current form. The Matthew Effect in Skills was also observed, indicating that high-skill occupations are accumulating new skill requirements at a faster rate than lower-skill roles, reinforcing the trend of occupational specialisation. However, contrary to expectations, AI-driven automation appears to be narrowing this gap by reducing the number of required skills in high-skill professions. Finally, the Red Queen Effect reveals that many occupations, especially high-skill ones, are experiencing an ongoing need for skill adaptation, particularly in areas requiring human-centric competencies such as communication, collaboration, management and caregiving.

The policy and educational implications of these findings are substantial. While technological skills continue to evolve, the future workforce will likely require a stronger emphasis on interpersonal, managerial and problem-solving abilities – domains that remain largely resistant to automation. Policymakers should focus on designing education and training programs that balance digital literacy with these non-routinisable competencies. Similarly, organizations should reconsider their workforce development strategies to ensure employees are equipped with adaptable, future-proof skills.

Ultimately, this study underscores the urgent need for proactive policy interventions and strategic workforce planning in the face of accelerating automation. By anticipating skill trends and adapting educational curricula accordingly, European institutions can better prepare workers for the demands of an AI-driven economy. Future research should continue to explore the intersection of automation, skill inequality, and labour market transformation to ensure that technological progress translates into inclusive and sustainable employment opportunities.

Despite its contributions, this study has limitations. The reliance on expert judgement for routinisability classification introduces a subjective element that could be refined through further validation using crowd-based ratings and/or predictive AI models; this would strengthen the external validity of the results. Although the authors have provided their classification, so they can be analysed and reused in the future. Additionally, the analysis is constrained to European skill dynamics, and future research should examine whether similar trends hold in other global labour markets.

One limitation of this work is the limited number of Deltas used in the analysis. It will be an important research project to repeat this analysis when more skill Deltas are released and to plot the changes over time. This will remain as a future task.

Another limitation was our focus on the English language. Although the English language has become the lingua franca for business interactions across Europe (“The Commission’s use of languages - European Commission,” n.d.; “Surveys - Eurobarometer,” n.d.), it is still not the primary language for all inhabitants of Europe. Research indicates that over 80% of Europeans indicate they speak English (“Top English Speaking Countries in Europe (2025),” n.d.). Investigating the other languages available in the ESCO dataset could help confirm (or refute) the results presented here.

Finally, another limitation could be in biases in the selection of new skills, capabilities and occupations by the ESCO team. It is difficult to know who this impacted the selection of new skills, capabilities and occupations but it is likely to have had an impact.

Future work should also be carried out on a regular basis, given the impressive speed with which AI tools are evolving and automating tasks. Skills and tasks once out of reach of AI could quickly come within reach and entirely change the analysis within this article. In addition, subsequent ESCO Delta updates will provide an opportunity to refine and expand this framework, enabling continuous monitoring of skill transformations over time.

The authors are deeply indebted to the two anonymous reviewers for their helpful feedback to improve this paper.

1.

After contacting the ESCO team, they indicated that earlier versions would not be appropriate for our analysis due to changes in the data.

Ärje
,
J.
,
Raitoharju
,
J.
,
Iosifidis
,
A.
,
Tirronen
,
V.
,
Meissner
,
K.
,
Gabbouj
,
M.
,
Kiranyaz
,
S.
and
Kärkkäinen
,
S.
(
2020
), “
Human experts vs. machines in taxa recognition
”,
Signal Processing: Image Communication
, Vol. 
87
, 115917, doi: .
Autor
,
D.H.
(
2015
), “
Why are there still so many jobs? The history and future of workplace automation
”,
The Journal of Economic Perspectives
, Vol. 
29
, pp. 
3
-
30
, doi: .
Autor
,
D.H.
,
Levy
,
F.
and
Murnane
,
R.J.
(
2003
), “
The skill content of recent technological change: an empirical exploration
”,
Quarterly Journal of Economics
, Vol. 
118
No. 
4
, pp. 
1279
-
1333
, doi: .
Bakhshi
,
H.
(
2017
), “
The future of skills: employment in 2030
”,
available at:
 https://futureskills.pearson.com/research/assets/pdfs/technical-report.pdf (
accessed 19 February 2025
).
Beblavỳ
,
M.
,
Akgüc
,
M.
,
Fabo
,
B.
and
Lenaerts
,
K.
(
2016
), “
Occupations observatory-methodological note
”,
CEPS Special Report
.
Borbásné Szabó
,
I.
and
Ternai
,
K.
(
2018
), “
Process-based analysis of digitally transforming skills
”, pp. 
104
-
115
, doi: .
Caratozzolo
,
P.
,
Azofeifa
,
J.D.
,
Mejía-Manzano
,
L.A.
,
Rueda-Castro
,
V.
,
Noguez
,
J.
,
Magana
,
A.J.
and
Benes
,
B.
(
2023
), “
A matrix taxonomy of knowledge, skills, and abilities (KSA) shaping 2030 labor market
”,
2023 IEEE Frontiers in Education Conference (FIE)
,
IEEE
, pp. 
1
-
8
.
Chiarello
,
F.
,
Fantoni
,
G.
,
Hogarth
,
T.
,
Giordano
,
V.
,
Baltina
,
L.
and
Spada
,
I.
(
2021
), “
Towards ESCO 4.0–Is the European classification of skills in line with Industry 4.0? A text mining approach
”,
Technological Forecasting and Social Change
, Vol. 
173
, 121177, doi: .
De Smedt
,
J.
,
le Vrang
,
M.
and
Papantoniou
,
A.
(
2015
), “
ESCO: towards a semantic web for the European labor market
”,
available at:
 https://ceur-ws.org/Vol-1409/paper-10.pdf
Edenbrandt
,
L.
,
Devine
,
B.
and
Macfarlane
,
P.W.
(
1993
), “
Classification of electrocardiographic ST-T segments — human expert vs artificial neural network
”,
European Heart Journal
, Vol. 
14
No. 
4
, pp. 
464
-
468
, doi: .
Education and training assignments by detailed occupation [WWW Document]
(
2023
), “
Bureau of labor Statistics
”,
available at:
 https://www.bls.gov/emp/tables/education-and-training-by-occupation.htm (
accessed
 13 February 2025).
Ennis
,
C.
(
2018
), “
Partnership for 21st century skills
”,
available at:
 https://westminsterresearch.westminster.ac.uk/item/q9w94/partnership-for-21st-century-skills (
accessed 19 February 2025
).
ESCO version 1.2 [WWW Document]
(
2024
),
available at:
 https://esco.ec.europa.eu/system/files/2024-05/V1.2%20Launch%20-%20ESCO%20SEC%20combined%20-%20final%20clean.pdf (
accessed
 19 February 2025).
ESCO Website [WWW Document]
(
2025
), “
European skills, competences, qualifications and occupations (ESCO)
”,
available at:
 https://esco.ec.europa.eu/en (
accessed
 13 February 2025).
Eskarne
,
A.P.
,
Margherita
,
B.
,
Federico
,
B.
,
Marcelino
,
C.G.
,
Francesca
,
C.
,
Jonatan
,
C.M
,
Clara
,
C.M.I.
,
Huw
,
E.J.
,
Enrique
,
F.M.
and
Emilia
,
G.G.
(
2019
), “
The changing nature of work and skills in the digital age
”,
available at:
 https://policycommons.net/artifacts/2162820/the-changing-nature-of-work-and-skills-in-the-digital-age/2918454/ (
accessed
 13 February 2025).
Fareri
,
S.
,
Melluso
,
N.
,
Chiarello
,
F.
and
Fantoni
,
G.
(
2021
), “
SkillNER: mining and mapping soft skills from any text
”,
Expert Systems with Applications
, Vol. 
184
, 115544, doi: .
Frey
,
C.B.
and
Osborne
,
M.A.
(
2017
), “
The future of employment: how susceptible are jobs to computerisation?
”,
Technological Forecasting and Social Change
, Vol. 
114
, pp. 
254
-
280
, doi: .
Jagannathan
,
S.
,
Ra
,
S.
and
Maclean
,
R.
(
2019
), “
Dominant recent trends impacting on jobs and labor markets – an Overview
”,
International Journal of Training Research
, Vol. 
17
No. 
sup1
, pp. 
1
-
11
, doi: .
Josten
,
C.
and
Lordan
,
G.
(
2022
), “
Automation and the changing nature of work
”,
PLoS One
, Vol. 
17
No. 
5
, e0266326, doi: .
Kotsiou
,
A.
,
Fajardo-Tovar
,
D.D.
,
Cowhitt
,
T.
,
Major
,
L.
and
Wegerif
,
R.
(
2022
), “
A scoping review of future skills frameworks
”,
Irish Educational Studies
, Vol. 
41
No. 
1
, pp. 
171
-
186
, doi: .
le Vrang
,
M.
,
Papantoniou
,
A.
,
Pauwels
,
E.
,
Fannes
,
P.
,
Vandensteen
,
D.
and
De Smedt
,
J.
(
2014
), “
Esco: boosting job matching in europe with semantic interoperability
”,
Computer
, Vol. 
47
No. 
10
, pp. 
57
-
64
, doi: .
Lokesh
,
G.R.
,
Harish
,
K.S.
,
Sangu
,
V.S.
,
Prabakar
,
S.
,
Santhosh Kumar
,
V.
and
Vallabhaneni
,
M.
(
2024
), “
AI and the future of work: preparing the workforce for technological shifts and skill evolution
”,
2024 International Conference on Knowledge Engineering and Communication Systems (ICKECS)
, pp. 
1
-
6
, doi: .
MacCrory
,
F.
,
Westerman
,
G.
,
AlHammadi
,
Y.
and
Brynjolfsson
,
E.
(
2014
), “
Racing with and against the machine: changes in occupational skill composition in an era of rapid technological advance
”,
Presented at the International Conference on Interaction Sciences
.
Mason
,
C.M.
,
Chen
,
H.
,
Evans
,
D.
and
Walker
,
G.
(
2023
), “
Illustrating the application of a skills taxonomy, machine learning and online data to inform career and training decisions
”,
The International Journal of Information and Learning Technology
, Vol. 
40
No. 
4
, pp. 
353
-
371
, doi: .
Miah
,
M.
(
2024
), “
Unveiling the evolutionary impact of artificial intelligence on the workforce
”,
Informatica Economica
, Vol. 
28
Nos
1/2024
, pp. 
39
-
58
, doi: .
Mirski
,
P.
,
Bernsteiner
,
R.
and
Radi
,
D.
(
2017
), “
Analytics in human resource management the OpenSKIMR approach
”,
Procedia computer science
, Vol. 
122
, pp. 
727
-
734
, doi: .
Morandini
,
S.
,
Fraboni
,
F.
,
De Angelis
,
M.
,
Puzzo
,
G.
,
Giusino
,
D.
and
Pietrantoni
,
L.
(
2023
), “
The impact of artificial intelligence on workers' skills: upskilling and reskilling in organisations
”,
Informing Science
, Vol. 
26
, pp. 
39
-
68
, doi: .
Mrsic
,
L.
,
Jerkovic
,
H.
and
Balkovic
,
M.
(
2020
), “Interactive skill based labor market mechanics and dynamics analysis system using machine learning and big data”, in
Sitek
,
P.
,
Pietranik
,
M.
,
Krótkiewicz
,
M.
and
Srinilta
,
C.
(Eds),
Intelligent Information and Database Systems, Communications in Computer and Information Science
,
Springer
,
Singapore
, pp. 
505
-
516
, doi: .
Shellshear
,
E.
and
Oh
,
K.W.
(
2024
), “
Technology shift impacts on the recruitment management triangle
”,
European Journal of Management Studies
, Vol. 
29
No. 
1
, pp. 
71
-
84
, doi: .
Sousa
,
M.J.
and
Wilks
,
D.
(
2018
), “
Sustainable skills for the world of work in the digital age
”,
Systems Research
, Vol. 
35
No. 
4
, pp. 
399
-
405
, doi: .
Spring
,
M.
,
Faulconbridge
,
J.
and
Sarwar
,
A.
(
2022
), “
How information technology automates and augments processes: insights from Artificial-Intelligence-based systems in professional service operations
”,
Journal of Operations Management
, Vol. 
68
Nos
6-7
, pp. 
592
-
618
, doi: .
Stevens
,
R.
,
Lord
,
P.
,
Malone
,
J.
and
Matentzoglu
,
N.
(
2019
), “
Measuring expert performance at manually classifying domain entities under upper ontology classes
”,
Journal of Web Semantics
, Vol. 
57
, 100469, doi: .
Surveys - Eurobarometer [WWW Document]
(
n.d.
),
available at:
 https://europa.eu/eurobarometer/surveys/detail/2979 (
accessed
 4 November 2025).
Susskind
,
D.
(
2019
), “
Re-thinking the capabilities of technology in economics
”,
Economics Bulletin
, Vol. 
39
, pp. 
280
-
288
.
Telukdarie
,
A.
,
Munsamy
,
M.
and
Gaula
,
M.
(
2021
), “
Big data analysis for predicting future skills
”,
2021 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM)
,
IEEE
, pp. 
411
-
415
.
The Commission’s use of languages - European Commission
(
n.d.
),
available at:
 https://commission.europa.eu/about/service-standards-and-principles/commissions-use-languages_en (
accessed
 4 November 2025).
Top English Speaking Countries in Europe (2025)
(
n.d
),
available at:
 https://www.europelanguagejobs.com/blog/English-Speaking-Countries-Europe (
accessed
 4 November 2025).
Vorina
,
A.
,
Vrcelj
,
N.
and
Bevanda
,
V.
(
2023
), “
Innovative careers ahead: adapting to new occupations and competencies in the future workforce
”, pp. 
241
-
248
, doi: .
Wilson
,
R.A.
(
2010
), “
Skills supply and demand in Europe medium-term forecast up to 2020
”,
Publications Office of the European Union
.
Wilson
,
N.R.
(
2012
), “
Future skills supply and demand in Europe
”,
available at:
 https://wrap.warwick.ac.uk/69175/ (
accessed
 13 February 2025).
Yang
,
Y.
(
1994
), “Expert network: effective and efficient learning from human decisions in text categorization and retrieval”, in
Croft
,
B.W.
and
Van Rijsbergen
,
C.J.
(Eds),
SIGIR ’94
,
Springer
,
London
, pp. 
13
-
22
, doi: .
Published in European Journal of Management Studies. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence maybe seen at Link to the terms of the CC BY 4.0 licence.

or Create an Account

Close subscription notice
Close access options