Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Exploring Test Smells Across Programming Languages: A Systematic Mapping Study

View through CrossRef
Tests are essential for ensuring code quality in software development. However, poor implementation practices can compromise the maintainability and evolution of test code, leading to additional costs and effort. These practices, known as test smells, have been the focus of numerous studies that expanded the catalog of known test smells. Despite this progress, little attention has been given to examining test smells from the perspective of programming languages, particularly their relationship with specific languages or test frameworks. As a result, researchers and practitioners have proposed various approaches and tools to detect and refactor the same test smells across different languages. In this work, we address this gap by analyzing test smells in the literature from a programming language perspective. We conducted a systematic mapping study, gathering data from papers published up to August 2025, examining 117 papers. We identified the most prevalent languages and frameworks associated with test smells, the most common test smells in each language, refactorings for addressing test smells, datasets of test smells, the criticality of specific test smells, and a collection of tools to detect or refactor test smells for various languages and frameworks. Our results show that while many test smells have been addressed, research remains limited to a few languages and frameworks. We also found datasets and detection/refactoring tools for some languages and analyzed the criticality of frequently mentioned test smells. This study highlights the need to expand research to more languages and develop more universal solutions.
Title: Exploring Test Smells Across Programming Languages: A Systematic Mapping Study
Description:
Tests are essential for ensuring code quality in software development.
However, poor implementation practices can compromise the maintainability and evolution of test code, leading to additional costs and effort.
These practices, known as test smells, have been the focus of numerous studies that expanded the catalog of known test smells.
Despite this progress, little attention has been given to examining test smells from the perspective of programming languages, particularly their relationship with specific languages or test frameworks.
As a result, researchers and practitioners have proposed various approaches and tools to detect and refactor the same test smells across different languages.
In this work, we address this gap by analyzing test smells in the literature from a programming language perspective.
We conducted a systematic mapping study, gathering data from papers published up to August 2025, examining 117 papers.
We identified the most prevalent languages and frameworks associated with test smells, the most common test smells in each language, refactorings for addressing test smells, datasets of test smells, the criticality of specific test smells, and a collection of tools to detect or refactor test smells for various languages and frameworks.
Our results show that while many test smells have been addressed, research remains limited to a few languages and frameworks.
We also found datasets and detection/refactoring tools for some languages and analyzed the criticality of frequently mentioned test smells.
This study highlights the need to expand research to more languages and develop more universal solutions.

Related Results

Software Metric Based Impact Analysis of Code Smells ‐ A Large Scale Empirical Study
Software Metric Based Impact Analysis of Code Smells ‐ A Large Scale Empirical Study
ABSTRACTContextCode smells are indicators of poor design and implementation choices that negatively affect software quality and maintainability. Moreover, it is difficult and time‐...
Test smells 20 years later: detectability, validity, and reliability
Test smells 20 years later: detectability, validity, and reliability
AbstractTest smells aim to capture design issues in test code that reduces its maintainability. These have been extensively studied and generally found quite prevalent in both huma...
Fixing Dockerfile smells: an empirical study
Fixing Dockerfile smells: an empirical study
AbstractDocker is the de facto standard for software containerization. A Dockerfile contains the requirements to build a Docker image containing a target application. There are sev...
Dynamic stacking ensemble for cross-language code smell detection
Dynamic stacking ensemble for cross-language code smell detection
Code smells refer to poor design and implementation choices by software engineers that might affect the overall software quality. Code smells detection using machine learning model...
Discovering code smells in Javascript software using clustering techniques
Discovering code smells in Javascript software using clustering techniques
A presença de code smells em projetos de software têm consequências negativas no que diz respeito a coesão e manutenibilidade do código. Assim sendo, a análise de técnicas usadas p...
Identifying and Addressing Test Smells in JavaScript: A Developer-Centric Study
Identifying and Addressing Test Smells in JavaScript: A Developer-Centric Study
Test smells are poor practices in test code that can compromise maintainability, reliability, and clarity. While the concept has been widely studied in languages such as Java and P...
Quality Assessment of LLM-Generated Multi-Language Systems: Comparative Analysis Using Design Smells
Quality Assessment of LLM-Generated Multi-Language Systems: Comparative Analysis Using Design Smells
Abstract Large Language Models (LLMs) are increasingly used to generate source code, including software that integrates multiple programming lang...
Provocative Tests in Diagnosis of Thoracic Outlet Syndrome: A Narrative Review
Provocative Tests in Diagnosis of Thoracic Outlet Syndrome: A Narrative Review
Abstract Thoracic outlet syndrome (TOS) is a group of conditions caused by the compression of the neurovascular bundle within the thoracic outlet. It is classified into three main ...

Back to Top