PhD Position Engineering Productivity Metrics at the Future of Software Engineering (FUSE) lab

Job description
As generative artificial intelligence is transforming the daily work of software engineers, TU Delft and the Meta Dev Infra team join forces in a research lab to investigate how we can leverage AI to advance the daily experience and productivity of software engineers at the scale of Meta's tens of thousands of software engineers.

Across several tracks, we will develop tools that rethink the future of software engineering. Our work will be informed by sound theories and supported by empirical data. In this project, we will use AI as an opportunity and address the challenges that emerge due to AI. Our goal is to conduct rigorous research, apply our results in practice at Meta and to educate the students of TU Delft about the new insights we gather. We will focus on open science, sharing our results to help developers across the world.

Engineering Productivity Metrics

This track will investigate how we can customize typical software engineering metrics to usefully reflect progress for machine learning engineers. Not all their changes get deployed as they might not measurably push the final outcomes in A/B experiments. How can we still inform the engineers whether they go in the right direction?

Next to this, we will also focus on a shift-left of experimentation: Before deploying a change, an A/B test measures whether business metrics are improved by the change. We will develop tools to provide early feedback to the developers on the correct configuration of their experiments.

We are committed to creating a diverse and inclusive research environment and encourage applications from all qualified candidates, regardless of their background or experience. We believe that diversity contributes to a more innovative and creative research community.

If you do not meet some of the optional requirements listed, we encourage you to still apply and explain how your unique experience and skills can contribute to our research.

Job requirements
Required (by the Graduate School of TU Delft):

• Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
• Proficiency in the English language (https://www.tudelft.nl/onderwijs/opleidingen/phd/admission)

Additional requirements:

• Research focus, characterized by curiosity, data fluency, and critical thinking
• Engineering mindset, including ability to create experimental prototypes and demonstrators
• Team player, good listener, and ready to help.

TU Delft (Delft University of Technology)
Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!

Faculty of Electrical Engineering, Mathematics and Computer Science
The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three scientific disciplines. Combined, they reinforce each other and are the driving force behind the technology we all use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make completely sustainable and future-proof. At the same time, we are developing the chips and sensors of the future, whilst also setting the foundations for the software technologies to run on this new generation of equipment – which of course includes AI. Meanwhile we are pushing the limits of applied mathematics, for example mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. In other words: there is plenty of room at the faculty for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1000 employees and 4,000 students work and study in this innovative environment.

Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.

PhD Position Automated Code Refactoring at the Future of Software Engineering (FUSE) lab

Job description
As generative artificial intelligence is transforming the daily work of software engineers, TU Delft and the Meta Dev Infra team join forces in a research lab to investigate how we can leverage AI to advance the daily experience and productivity of software engineers at the scale of Meta's tens of thousands of software engineers.

Across several tracks, we will develop tools that rethink the future of software engineering. Our work will be informed by sound theories and supported by empirical data. In this project, we will use AI as an opportunity and address the challenges that emerge due to AI. Our goal is to conduct rigorous research, apply our results in practice at Meta and to educate the students of TU Delft about the new insights we gather. We will focus on open science, sharing our results to help developers across the world.

Automated Code Refactoring

The focus is on exploring and evaluating the potential of LLM-based automated refactoring of codebases with the ultimate goal of reducing software complexity and improving code quality. We will investigate how LLMs can support and automate tasks such as enhancing maintainability and performance while also reducing technical debt and facilitating bug detection and bug fixing. The main modules include (1) capturing practitioners' experiences and expectations to establish a roadmap, (2) developing models and benchmarks for LLM-based refactoring, (3) designing autonomous agents, and (4) conducting studies to analyse real-world impact.

We are committed to creating a diverse and inclusive research environment and encourage applications from all qualified candidates, regardless of their background or experience. We believe that diversity contributes to a more innovative and creative research community.

If you do not meet some of the optional requirements listed, we encourage you to still apply and explain how your unique experience and skills can contribute to our research.

Job requirements
Required (by the Graduate School of TU Delft):

• Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
• Proficiency in the English language (https://www.tudelft.nl/onderwijs/opleidingen/phd/admission)

Additional requirements:

• Research focus, characterized by curiosity, data fluency, and critical thinking
• Engineering mindset, including ability to create experimental prototypes and demonstrators
• Team player, good listener, and ready to help.

TU Delft (Delft University of Technology)
Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!

Faculty of Electrical Engineering, Mathematics and Computer Science
The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three scientific disciplines. Combined, they reinforce each other and are the driving force behind the technology we all use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make completely sustainable and future-proof. At the same time, we are developing the chips and sensors of the future, whilst also setting the foundations for the software technologies to run on this new generation of equipment – which of course includes AI. Meanwhile we are pushing the limits of applied mathematics, for example mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. In other words: there is plenty of room at the faculty for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1000 employees and 4,000 students work and study in this innovative environment.

Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.

PhD Position Predictive Software Testing at the Future of Software Engineering (FUSE) lab

Job description
As generative artificial intelligence is transforming the daily work of software engineers, TU Delft and the Meta Dev Infra team join forces in a research lab to investigate how we can leverage AI to advance the daily experience and productivity of software engineers at the scale of Meta's tens of thousands of software engineers.

Across several tracks, we will develop tools that rethink the future of software engineering. Our work will be informed by sound theories and supported by empirical data. In this project, we will use AI as an opportunity and address the challenges that emerge due to AI. Our goal is to conduct rigorous research, apply our results in practice at Meta and to educate the students of TU Delft about the new insights we gather. We will focus on open science, sharing our results to help developers across the world.

Predictive Software Testing

This track focuses on creating an intelligent and adaptive testing ecosystem capable of safeguarding quality in massive, rapidly-evolving codebases. As software scales, traditional testing methods often break down due to long regression cycles and high infrastructure costs. We will explore (1) learning-based techniques (e.g., LLMs, agents) to capture the intent behind code changes, (2) defining new metrics for test "quality" that go beyond code coverage, (3) predicting the success of code changes based on test quality, providing developers quick feedback, and (4) designing autonomous agents that automatically refactor, prune, and optimize test code, preventing test decay.

We are committed to creating a diverse and inclusive research environment and encourage applications from all qualified candidates, regardless of their background or experience. We believe that diversity contributes to a more innovative and creative research community.

If you do not meet some of the optional requirements listed, we encourage you to still apply and explain how your unique experience and skills can contribute to our research.

Job requirements
Required (by the Graduate School of TU Delft):

• Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
• Proficiency in the English language (https://www.tudelft.nl/onderwijs/opleidingen/phd/admission)

Additional requirements:

• Research focus, characterized by curiosity, data fluency, and critical thinking
• Engineering mindset, including ability to create experimental prototypes and demonstrators
• Team player, good listener, and ready to help.

TU Delft (Delft University of Technology)
Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!

Faculty of Electrical Engineering, Mathematics and Computer Science
The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three scientific disciplines. Combined, they reinforce each other and are the driving force behind the technology we all use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make completely sustainable and future-proof. At the same time, we are developing the chips and sensors of the future, whilst also setting the foundations for the software technologies to run on this new generation of equipment – which of course includes AI. Meanwhile we are pushing the limits of applied mathematics, for example mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. In other words: there is plenty of room at the faculty for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1000 employees and 4,000 students work and study in this innovative environment.

Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.

PhD Position Code Review Efficiency at the Future of Software Engineering (FUSE) lab

Job description
As generative artificial intelligence is transforming the daily work of software engineers, TU Delft and the Meta Dev Infra team join forces in a research lab to investigate how we can leverage AI to advance the daily experience and productivity of software engineers at the scale of Meta's tens of thousands of software engineers.

Across several tracks, we will develop tools that rethink the future of software engineering. Our work will be informed by sound theories and supported by empirical data. In this project, we will use AI as an opportunity and address the challenges that emerge due to AI. Our goal is to conduct rigorous research, apply our results in practice at Meta and to educate the students of TU Delft about the new insights we gather. We will focus on open science, sharing our results to help developers across the world.

Code Review Efficacy

The reviewing track will explore ways to make code reviewing more effective and efficient. A major element is how LLM tools relate to reviewing, either when code is produced by them (in which case a human must review plausible-looking but possibly incorrect code), or when they can assist the reviewing of code created by humans. Other related research involves making tieing reviews more closely with the project's history and the semantics of the reviewed code.

We are committed to creating a diverse and inclusive research environment and encourage applications from all qualified candidates, regardless of their background or experience. We believe that diversity contributes to a more innovative and creative research community.

If you do not meet some of the optional requirements listed, we encourage you to still apply and explain how your unique experience and skills can contribute to our research.

Job requirements
Required (by the Graduate School of TU Delft):

• Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
• Proficiency in the English language (https://www.tudelft.nl/onderwijs/opleidingen/phd/admission)

Additional requirements:

• Research focus, characterized by curiosity, data fluency, and critical thinking
• Engineering mindset, including ability to create experimental prototypes and demonstrators
• Team player, good listener, and ready to help.

TU Delft (Delft University of Technology)
Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!

Faculty of Electrical Engineering, Mathematics and Computer Science
The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three scientific disciplines. Combined, they reinforce each other and are the driving force behind the technology we all use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make completely sustainable and future-proof. At the same time, we are developing the chips and sensors of the future, whilst also setting the foundations for the software technologies to run on this new generation of equipment – which of course includes AI. Meanwhile we are pushing the limits of applied mathematics, for example mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. In other words: there is plenty of room at the faculty for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1000 employees and 4,000 students work and study in this innovative environment.

Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.

PhD Position Engineering Productivity Metrics at the Future of Software Engineering (FUSE) lab

Job description
As generative artificial intelligence is transforming the daily work of software engineers, TU Delft and the Meta Dev Infra team join forces in a research lab to investigate how we can leverage AI to advance the daily experience and productivity of software engineers at the scale of Meta's tens of thousands of software engineers.

Across several tracks, we will develop tools that rethink the future of software engineering. Our work will be informed by sound theories and supported by empirical data. In this project, we will use AI as an opportunity and address the challenges that emerge due to AI. Our goal is to conduct rigorous research, apply our results in practice at Meta and to educate the students of TU Delft about the new insights we gather. We will focus on open science, sharing our results to help developers across the world.

Engineering Productivity Metrics

This track will investigate how we can customize typical software engineering metrics to usefully reflect progress for machine learning engineers. Not all their changes get deployed as they might not measurably push the final outcomes in A/B experiments. How can we still inform the engineers whether they go in the right direction?

Next to this, we will also focus on a shift-left of experimentation: Before deploying a change, an A/B test measures whether business metrics are improved by the change. We will develop tools to provide early feedback to the developers on the correct configuration of their experiments.

We are committed to creating a diverse and inclusive research environment and encourage applications from all qualified candidates, regardless of their background or experience. We believe that diversity contributes to a more innovative and creative research community.

If you do not meet some of the optional requirements listed, we encourage you to still apply and explain how your unique experience and skills can contribute to our research.

Job requirements
Required (by the Graduate School of TU Delft):

• Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
• Proficiency in the English language (https://www.tudelft.nl/onderwijs/opleidingen/phd/admission)

Additional requirements:

• Research focus, characterized by curiosity, data fluency, and critical thinking
• Engineering mindset, including ability to create experimental prototypes and demonstrators
• Team player, good listener, and ready to help.

TU Delft (Delft University of Technology)
Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!

Faculty of Electrical Engineering, Mathematics and Computer Science
The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three scientific disciplines. Combined, they reinforce each other and are the driving force behind the technology we all use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make completely sustainable and future-proof. At the same time, we are developing the chips and sensors of the future, whilst also setting the foundations for the software technologies to run on this new generation of equipment – which of course includes AI. Meanwhile we are pushing the limits of applied mathematics, for example mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. In other words: there is plenty of room at the faculty for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1000 employees and 4,000 students work and study in this innovative environment.

Click here to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.