Tag Archives: missing data

EMA Publish Guidance on Missing Data from Confirmatory Clinical Trials.

EMA Publish Guidance on Missing Data from Confirmatory Clinical Trials.

Full Text Here

It should be the aim of those conducting clinical trials to achieve complete capture of all data from all patients, including those who discontinue from treatment. Whilst it is unavoidable that some data are missing from all confirmatory clinical trials, it should be noted that just ignoring missing data is not an acceptable option when planning, conducting or interpreting the analysis of a confirmatory clinical trial. The reason for missing data and handling of missing data in the analysis represent critical factors in
the regulatory assessment of all confirmatory clinical trials. The main focus of this guideline is issues associated with the analysis of the primary efficacy endpoint where patients are followed up over time. However, by careful planning it is possible to reduce the amount of data that are missing. This is important because missing data are a potential source of bias when analysing data from clinical trials. Interpretation of the results of a trial is always problematic when the proportion of missing values is
substantial. When this occurs, the uncertainty of the likely treatment effect can become such that it is not possible to conclude that evidence of efficacy has been established.
In confirmatory trials the primary analysis is commonly performed on the full analysis set as this analysis is consistent with the intention to treat (ITT) principle. If data for some subjects are missing for the primary endpoint it is necessary to specify how all randomised patients can be included in the statistical analysis. However, there is no universally applicable method that adjusts the analysis to take into account that some values are missing, and different approaches may lead to different conclusions.
To avoid concerns over data-driven selection of methods, it is essential to pre-specify the selected methods in the statistical section of the study protocol or analysis plan. Unfortunately, when there are missing data, all approaches to analysis rely on assumptions that cannot be verified. It should be noted that the strategy employed to handle missing values might in itself be a source of bias. A critical discussion of the number, timing, pattern, reason for and possible implications of missing values in
efficacy and safety assessments should be included in the clinical report as a matter of routine. It will be useful to investigate the pattern of missing data in previous trials in the same or similar indications for related medicinal products. This could assist in identifying additional actions to minimise the amount of missing data during the conduct of the trial, the choice of the primary analysis method and in determining how missing data will be handled in this analysis.
A positive regulatory decision must be based on an analysis where the possibility of important bias in favour of the experimental agent can be excluded. The justification for selecting a particular method should not be based primarily on the properties of the method under particular assumptions but on whether it is likely that it will provide an appropriate estimate for the comparison of primary regulatory interest in the circumstances of the trial under consideration.. An appropriate analysis would provide a
point estimate that is unlikely to be biased in favour of experimental treatment to an important degree (under reasonable assumptions) and a confidence interval that does not underestimate the variability of the point estimate to an important extent. The type of bias that can critically affect interpretation depends upon the objective of the study (to show superiority, non-inferiority or equivalence). As the choice of primary analysis will be based on assumptions that cannot be verified it will almost always be
necessary to investigate the robustness of trial results through appropriate sensitivity analyses that make different assumptions.

For Assistance with Clinical Trials Management and Design Click Here

Damien Bové is THE Drug Development and Regulatory Consultant (pharmaceutical or biotechnology), I work with my clients to define a drug development target, define a drug development strategy, define a regulatory strategy or define a commercial strategy. Our clients are generally raising funds or looking to license out their technology and we help them achieve it. If you want to know more don’t hesitate to get in touch.

Avoid Expensive Mistakes, Keep On Top of New and Changing Regulations for Free!

Sign up for the most value add free newsource you can get for free. We spend a huge amount of time and effort monitoring the main drug / device regulators websites for changes in the regulatory environment, and capture between 20 and 40 new regulations, rules and initiatives each month, and summaries them in a fantastic FREE monthly Regulatory and Market Round Up. You can Un-Subscribe at any time and we don not share your details with anybody. You can’t afford to miss out on this service. Just fill in the form below.

Fill Out the Short Form Below…


  1. (required)


  2. (valid email required)

“Please note that the pages on this website are designed to provide you with general information only. We make no warranties, representations or undertakings about any of its content. This includes the completeness, accuracy and fitness for any particular purpose, or the content of any third party site referred to or accessed through it. You are personally responsible for ensuring that the information is correct and we will not be held liable or accountable for any mistakes that occur.”

EMEA re-posts Points to Consider on Missing Data

The EMEA has re-posted points to consider on missing data, this points to consider was formally adopted in 2001, however the EMEA has chosen to re post this on the website. It does not appear to have changed since its last posting.

The EMEA a considered missing data as a potential source of bias when analysing clinical trials, interpretation of the results of a trial is always problematic when the number of missing values is substantial. There are many possible sources of missing data, affecting either complete subjects or specific items, missing data violate the strict Intend To Treat principals: measurement of patient outcomes regardless of protocol adherence and analysis performed by treatment assigned, regardless of which treatment patients actually received.  If missing values are handled simply by excluding any patients with missing outcomes from analysis, the following problems may affect the interpretation of the trial results.

The sample size and variability of outcomes affects the power of the clinical trial, power is greater the larger sample size and smaller variability. The reduction in the number of cases available for analysis, completeness of data add ot the resulting reduction of the statistical power.

Bias is the most important concern resulting from the missing data may affect: Designation of the treatment effect, The comparability of the treatment groups, The representativeness of the study sample in relation to the target population. Bias occurs in the estimation of the treatment effect when the relationship between missing this treatment outcomes exists. In most cases it is difficult or impossible to elucidate whether the relationship between missing values and unobserved outcome variable is completely absent. Thus it is sensible to adopt a conservative approach, considering missing values as potential sources of bias.

A possible way of handling incomplete data is to ignore them and perform statistical analysis with complete data only. However, complete case analysis violates intention-to-treat principal. More importantly it is subject to bias, and thus cannot become recommended as the primary analysis confirmatory trial.

The statistical analysis of the clinical trial requires imputation of values to those data that have not been recorded. Many techniques have been used for the imputation of missing data, but none of them can be considered as the gold standard in every situation. The guidance goes on to discuss the many options available:

To cope with situations where response collection is interrupted at one point, the widely used method is last observation carried forward. This method is likely to be acceptable if measurements are expected to be relatively consistent over time.

Best worst case imputation, assigning the worst possible value of the outcome to dropouts are a negative reason (treatment failed) and the best possible value to positive dropouts (kills), is another approach that can be considered, provided it is applied conservatively.

Another simple approach of inputting missing data is to replace the unobserved measurements by values derived from other sources. Possible sources include information from the same subject, from other subject of similar baseline characteristics, the predictive value from an empirically developed model, historical data, etc.

Most methods faced the risk of bias in the standard error downwards by estimating central value and ignoring its uncertainty. This risk can be avoided by some techniques based upon maximum likelihood methodology and with multiple imputation methods. Maximum likelihood methodologies have been proposed that imputation of missing values, as have multiple imputation methods. Maximum likelihood method strategies fit the model by an iterative process. Multiple input methods generate multiple copies of the original dataset replacing missing values by randomly generated values, and analysing is complete sets.

Unfortunately, there is no universally accepted methodological approach and the missing values.the best process of all is the avoidance of missing data in the first place.

If you would like more detail in this area please get in touch with Damien Bové damien.bove@idaconsultants.com

Damien Bové works as a drug development consultant (pharmaceutical or biotechnology) and regulatory consultant, we work with our clients to define a drug  development target, define a drug development strategy, define a regulatory strategy or define a commercial strategy. Our clients are generally raising funds or looking to license out their technology and we help them achieve it. If you want to know more don’t hesitate to get in touch.

ida consultants freestrategyconsultation 515x64 EMEA re posts Points to Consider on Missing Data

As you know this website is a great resourse for keeping up to date with developments and regulations, why not get our FREE monthly regulatory and market round up. You can un-subscribe at any time and we do not share your details with anybody.