Sample size, power and effect size revisited: simplified and practical approaches in pre-clinical, clinical and laboratory studies.

Serdar CC, Cihan M, Yücel D, Serdar MA. · 2021

Read Sample size, power and effect size revisited: simplified and practical approaches in pre-clinical, clinical and laboratory studies. by Serdar CC, Cihan M, Yücel D, Serdar MA. (2021) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc7745163.txt.

Introduction

Serdar and co-authors give a practical guide to sample size, power, and effect size. Sample size shapes a study's design and the trust its results deserve. A wrong size wastes time and money and can raise ethical issues. Many researchers, the authors note, lack firm grounding in these concepts.

The guide explains how sample size ties to effect size and to statistical meaning. It shows why both too few and too many subjects can mislead. It then points readers to software, guidelines, and references for doing the sums. Examples span lab, pre-clinical, and clinical work. The aim is sound planning before data collection starts.

Catalog record

CREATORSerdar CC, Cihan M, Yücel D, Serdar MA.
YEAR2021
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC7745163

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sample size, power and effect size revisited: simplified and practical approaches in pre-clinical, clinical and laboratory studies By Ceyhan Ceran Serdar, Murat Cihan, Doğan Yücel, Muhittin A Serdar Published in: Biochemia Medica DOI: 10.11613/BM.2021.010502 ABSTRACT Calculating the sample size in scientific studies is one of the critical issues as regards the scientific contribution of the study. The sample size critically affects the hypothesis and the study design, and there is no straightforward way of calculating the effective sample size for reaching an accurate conclusion. Use of a statistically incorrect sample size may lead to inadequate results in both clinical and laboratory studies as well as resulting in time loss, cost, and ethical problems. This review holds two main aims. The first aim is to explain the importance of sample size and its relationship to effect size (ES) and statistical significance. The second aim is to assist researchers planning to perform sample size estimations by suggesting and elucidating available alternative software, guidelines and references that will serve different scientific purposes. INTRODUCTION Statistical analysis is a crucial part of a research. A scientific study must include statistical tools in the study, beginning from the planning stage. Developed in the last 20-30 years, information technology, along with evidence-based medicine, increased the spread and applicability of statistical science. Although scientists have understood the importance of statistical analysis for researchers, a significant number of researchers admit that they lack adequate knowledge about statistical concepts and principles (1). In a study by West and Ficalora, more than two-thirds of the clinicians emphasized that “the level of biostatistics education that is provided to the medical students is not sufficient” (2). As a result, it was suggested that statistical concepts were either poorly understood or not understood at all (3, 4). Additionally, intentionally or not, researchers tend to draw conclusions that cannot be supported by the actual study data, often due to the misuse of statistics tools (5). As a result, a large number of statistical errors occur affecting the research results. Although there are a variety of potential statistical errors that might occur in any kind of scientific research, it has been observed that the sources of error have changed due to the use of dedicated software that facilitates statistics in recent years. A summary of main statistical errors frequently encountered in scientific studies is provided below (6-13): - Flawed and inadequate hypothesis; - Improper study design; - Lack of adequate control condition/group; - Spectrum bias; - Overstatement of the analysis results; - Spurious correlations; - Inadequate sample size; - Circular analysis (creating bias by selecting the properties of the data retrospectively); - Utilization of inappropriate statistical studies and fallacious bending of the analyses; - p-hacking (i.e. addition of new covariates post hoc to make P values significant); - Excessive interpretation of limited or insignificant results (subjectivism); - Confusion (intentionally or not) of correlations, relationships, and causations; - Faulty multiple regression models; - Confusion between P value and clinical significance; and - Inappropriate presentation of the results and effects (erroneous tables, graphics, and figures). RELATIONSHIP AMONG SAMPLE SIZE, POWER, P VALUE AND EFFECT SIZE In this review, we will concentrate on the problems associated with the relationships among sample size, power, P value, and effect size (ES). Practical suggestions will be provided whenever possible. In order to understand and interpret the sample size, power analysis, effect size, and P value, it is necessary to know how the hypothesis of the study was formed. It is best to evaluate a study for Type I and Type II errors (Figure 1) through consideration of the study results in the context of its hypotheses (14-16). [Figure: Illustration of Type I and Type II errors.] A statistical hypothesis is the researcher’s best guess as to what the result of the experiment will show. It states, in a testable form the proposition the researcher plans to examine in a sample to be able to find out if the proposition is correct in the relevant population. There are two commonly used types of hypotheses in statistics. These are the null hypothesis (H0) and the alternative (H1) hypothesis. Essentially, the H1 is the researcher’s prediction of what will be the situation of the experimental group after the experimental treatment is applied. The H0 expresses the notion that there will be no effect from the experimental treatment. Prior to the study, in addition to stating the hypothesis, the researcher must also select the alpha (α) level at which the hypothesis will be declared “supported”. The α represents how much risk the researcher is willing to take that the study will conclude H1 is correct when (in the full population) it is not correct (and thus, the null hypothesis is really true). In other words, alpha represents the probability of rejecting H0 when it actually is true. (Thus, the researcher has made an error by reporting that the experimental treatment makes a difference, when in fact, in the full population, that treatment has no effect.) The most common α level chosen is 0.05, meaning the researcher is willing to take a 5% chance that a result supporting the hypothesis will be untrue in the full population. However, other alpha levels may also be appropriate in some circumstances. For pilot studies, α is often set at 0.10 or 0.20. In studies where it is especially important to avoid concluding a treatment is effective when it actually is not, the alpha may be set at a much lower value; it might be set at 0.001 or even lower. Drug studies are examples for studies that often set the alpha at 0.001 or lower because the consequences of releasing an ineffective drug can be extremely dangerous for patients. Another probability value is called “the P value”. The P value is simply the obtained statistical probability of incorrectly accepting the alternate hypothesis. The P value is compared to the alpha value to determine if the result is “statistically significant”, meaning that with high probability the result found in the sample will also be true in the full population. If the P value is at or lower than alpha, H1 is accepted. If it is higher than alpha, the H1 is rejected and H0 is accepted instead. There are actually two types of errors: the error of accepting H1 when it is not true in the population; this is called a Type I error; and is a false positive. The alpha defines the probability of a Type I error. Type I errors can happen for many reasons, from poor sampling that results in an experimental sample quite different from the population, to other mistakes occurring in the design stage or implementation of the research procedures. It is also possible to make an erroneous decision in the opposite direction; by incorrectly rejecting H1 and thus wrongly accepting H0. This is called a Type II error (or a false negative). The β defines the probability of a Type II error. The most common reason for this type of error is small sample size, especially when combined with moderately low or low effect sizes. Both small sample sizes and low effect sizes reduce the power in the study. Power, which is the probability of

Read the complete text