View source for Randomized controlled trial

[[Image:Flowchart of Phases of Parallel Randomized Trial - Modified from CONSORT 2010.jpg|thumb|300px|right|Flowchart of four phases (enrollment, intervention allocation, follow-up, and data analysis) of a parallel randomized trial of two groups, modified from the CONSORT (Consolidated Standards of Reporting Trials) 2010 Statement<ref name="Schulz-2010">{{Cite journal | author = Schulz KF, Altman DG, Moher D; for the CONSORT Group | title = CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials | journal = [[Br Med J]] | volume = 340 | pages = c332 | year = 2010 | doi = 10.1136/bmj.c332 | pmid = 20332509 | pmc = 2844940 }}</ref>]]A '''randomized controlled trial (RCT)''' is a type of scientific [[experiment]] most commonly used in testing the [[efficacy]] or [[effectiveness]] of [[healthcare]] [[Service (economics)|services]] (such as [[medicine]] or [[nursing]]) or [[health]] [[technologies]] (such as [[pharmaceuticals]], [[medical devices]] or [[surgery]]). RCTs involve the [[random]] allocation of different interventions (treatments or conditions) to [[research subject|subjects]]. The most important advantage of proper randomization is that "it eliminates [[selection bias]], balancing both known and unknown prognostic factors, in the assignment of treatments."<ref name="Moher-2010">{{Cite journal | author = Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG | title = CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials | journal = [[Br Med J]] | volume = 340 | pages = c869 | year = 2010 | doi = 10.1136/bmj.c869 | pmid = 20332511 | pmc = 2844943 }}</ref>

The terms "RCT" and '''randomized trial''' are often used synonymously, but some authors distinguish between "RCTs" which compare treatment groups with [[Scientific control|control]] groups not receiving treatment (as in a [[placebo-controlled study]]), and "randomized trials" which can compare multiple treatment groups with each other.<ref name="Ranjith-2005">{{Cite journal | author = Ranjith G | title = Interferon-α-induced depression: when a randomized trial is not a randomized controlled trial | journal = [[Psychother Psychosom]] | volume = 74 | issue = 6 | pages = 387 | year = 2005 | doi = 10.1159/000087787 | pmid = 16244516 }}</ref>   RCTs are sometimes known as '''randomized control trials'''.<ref name="Chalmers-1981">{{Cite journal | author = Chalmers TC, Smith H Jr, Blackburn B, Silverman B, Schroeder B, Reitman D, Ambroz A | title = A method for assessing the quality of a randomized control trial | journal = [[Control Clin Trials]] | volume = 2 | issue = 1 | pages = 31–49 | year = 1981 | doi = 10.1016/0197-2456(81)90056-8 | pmid = 7261638 }}</ref> RCTs are also called '''randomized [[clinical trial]]s''' or '''randomized controlled clinical trials''' when they concern [[clinical research]]<ref name="Peto-1976">{{Cite journal | author = Peto R, Pike MC, Armitage P, Breslow NE, Cox DR, Howard SV, Mantel N, McPherson K, Peto J, Smith PG | title = Design and analysis of randomized clinical trials requiring prolonged observation of each patient. I. Introduction and design | journal = [[Br J Cancer]] | volume = 34 | issue = 6 | pages = 585–612 | year = 1976 | pmc=2025229/ | pmid = 795448 }}</ref><ref name="Peto-1977">{{Cite journal | author = Peto R, Pike MC, Armitage P, Breslow NE, Cox DR, Howard SV, Mantel N, McPherson K, Peto J, Smith PG | title = Design and analysis of randomized clinical trials requiring prolonged observation of each patient. II. Analysis and examples | journal = [[Br J Cancer]] | volume = 35 | issue = 1 | pages = 1–39 | year = 1977 | pmc=2025310 | pmid = 831755 }}</ref><ref name="Wollert-2004">{{Cite journal | author = Wollert KC, Meyer GP, Lotz J, Ringes-Lichtenberg S, Lippolt P, Breidenbach C, Fichtner S, Korte T, Hornig B, Messinger D, Arseniev L, Hertenstein B, Ganser A, Drexler H | title = Intracoronary autologous bone-marrow cell transfer after myocardial infarction: the BOOST randomised controlled clinical trial | journal = [[Lancet]] | volume = 364 | issue = 9429 | pages = 141–8 | year = 2004 | doi = 10.1016/S0140-6736(04)16626-9 | pmid = 15246726 }}</ref>; however, RCTs are also employed in other research areas such as [[criminology]], [[education]], and [[international development]].

==History==
It is claimed that the first published RCT was a 1948 paper entitled "[[Streptomycin]] treatment of pulmonary [[tuberculosis]], although agriculture experiments date back to Neyman (1923) and Fisher's pioneering work in the 1920s. A [[Medical Research Council (UK)|Medical Research Council]] investigation."<ref name="MRC-1948">{{Cite journal | author = Streptomycin in Tuberculosis Trials Committee | title = Streptomycin treatment of pulmonary tuberculosis. A Medical Research Council investigation| journal = [[Br Med J]] | volume = 2 | issue = 4582 | pages = 769–82 | year = 1948 | doi = 10.1136/bmj.2.4582.769 | pmid = 18890300 | pmc = 2091872 }}</ref><ref name="Brown-1998">{{cite news |title= Landmark study made research resistant to bias |author= Brown D |newspaper= [[Washington Post]] |date=1998-11-02 }}</ref><ref name="Shikata-2006">{{Cite journal | author = Shikata S, Nakayama T, Noguchi Y, Taji Y, Yamagishi H| title = Comparison of effects in randomized controlled trials with observational studies in digestive surgery | journal = [[Ann Surg]] | volume = 244 | issue = 5 | pages = 668–76 | year = 2006 | doi = 10.1097/01.sla.0000225356.04304.bc | pmc=1856609 | pmid = 17060757 }}</ref> One of the authors of that paper was [[Austin Bradford Hill]], who is credited as having conceived the modern RCT.<ref name="Stolberg-2004">{{Cite journal | author = Stolberg HO, Norman G, Trop I | title = Randomized controlled trials | journal = [[Am J Roentgenol]] | volume = 183 | issue = 6 | pages = 1539–44 | year = 2004 | url = http://www.ajronline.org/cgi/content/full/183/6/1539 | pmid = 15547188 }}</ref> However, a recent paper which looked at early RCT use in social and educational intervention studies rather than medical studies found reports of RCT being used as early as 1928.<ref>[http://www.informaworld.com/smpp/content~db=all~content=a780179536~frm=abslink http://www.informaworld.com/smpp/content~db=all~content=a780179536~frm=abslink]</ref>
<!-- details of 1928 study hidden behind paywall -->

By the late 20th century, RCTs had become the "[[gold standard]]" for "rational therapeutics" in medicine.<ref name="Meldrum-2000">{{Cite journal | author = Meldrum ML | title = A brief history of the randomized controlled trial. From oranges and lemons to the gold standard | journal = [[Hematol Oncol Clin North Am]] | volume = 14 | issue = 4 | pages = 745–60, vii | year = 2000 | doi = 10.1016/S0889-8588(05)70309-9  | pmid = 10949771 }}</ref>  As of 2004, more than 150,000 RCTs were in the [[Cochrane Library]].<ref name="Stolberg-2004"/>  To improve the reporting of RCTs in the medical literature, an international group of scientists and editors published [[Consolidated Standards of Reporting Trials]] (CONSORT) Statements in 1996, 2001, and 2010 which have become widely accepted.<ref name="Schulz-2010"/><ref name="Moher-2010"/>

==Ethics==
Although the principle of [[clinical equipoise]] ("genuine uncertainty within the expert medical community... about the preferred treatment") common to clinical trials<ref name="Freedman-1987">{{Cite journal | doi = 10.1056/NEJM198707163170304 | author = Freedman B | title = Equipoise and the ethics of clinical research | journal = [[N Engl J Med]] | volume = 317 | issue = 3 | pages = 141–5 | year = 1987 | pmid = 3600702 }}</ref> has been applied to RCTs, the [[ethics]] of RCTs have special considerations.  For one, it has been argued that equipoise itself is insufficient to justify RCTs.<ref name="Gifford-1995">{{Cite journal | author = Gifford F | title = Community-equipoise and the ethics of randomized clinical trials | journal = [[Bioethics (journal)|Bioethics]] | volume = 9 | issue = 2 | pages = 127–48 | year = 1995 | doi = 10.1111/j.1467-8519.1995.tb00306.x | pmid = 11653056 }}</ref>  For another, "collective equipoise" can conflict with a lack of personal equipoise (e.g., a personal belief that an intervention is effective).<ref name="Edwards-1998">{{Cite journal | author = Edwards SJL, Lilford RJ, Hewison J | title = The ethics of randomised controlled trials from the perspectives of patients, the public, and healthcare professionals | journal = [[Br Med J]] | volume = 317 | issue = 7167 | pages = 1209–12 | year = 1998 | url = http://www.bmj.com/cgi/content/full/317/7167/1209 | pmid = 9794861 | pmc = 1114158 }}</ref>  Finally, [[Zelen's design]], which has been used for some RCTs, randomizes subjects ''before'' they provide informed consent, which may be ethical for RCTs of [[screening]] and selected therapies, but is likely unethical "for most therapeutic trials."<ref name="Zelen-1979">{{Cite journal | doi = 10.1056/NEJM197905313002203 | author = Zelen M | title = A new design for randomized clinical trials | journal = [[N Engl J Med]] | volume = 300 | issue = 22 | pages = 1242–5 | year = 1979 | url = http://content.nejm.org/cgi/content/abstract/300/22/1242 | pmid = 431682 }}</ref><ref name="Torgerson-1998">{{Cite journal | author = Torgerson DJ, Roland M | title = What is Zelen's design? | journal = [[Br Med J]] | volume = 316 | issue = 7131 | pages = 606 | year = 1998 | url = http://www.bmj.com/cgi/content/full/316/7131/606 | pmid = 9518917 | pmc = 1112637 }}</ref>

==Classifications of RCTs==
===By study design===
One way to classify RCTs is by [[study design]].  From most to least common in the medical literature, the major categories of RCT study designs are<ref name="Hopewell-2010">{{Cite journal | author = Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG | title = The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed | journal = BMJ | volume = 340 | pages = c723 | year = 2010 | url = http://www.bmj.com/cgi/content/full/340/mar23_1/c723 | doi = 10.1136/bmj.c723  | pmid = 20332510 | pmc = 2844941 }}</ref>:
* [[Parallel study|Parallel-group]] – each participant is randomly assigned to a group, and all the participants in the group receives (or does not receive) an intervention
* [[Crossover study|Crossover]] – over time, each participant receives (or does not receive) an intervention in a random sequence
* Split-body – separate parts of the body of each participant (e.g., the left and right sides of the face) are randomized to receive (or not receive) an intervention
* [[Cluster randomised controlled trial|Cluster]] – pre-existing groups of participants (e.g., villages, schools) are randomly selected to receive (or not receive) an intervention
* [[Factorial experiment|Factorial]] – each participant is randomly assigned to a group that receives a particular combination of interventions or non-interventions (e.g., group 1 receives vitamin X and vitamin Y, group 2 receives vitamin X and placebo Y, group 3 receives placebo X and vitamin Y, and group 4 receives placebo X and placebo Y)
An analysis of the 616 RCTs indexed in [[PubMed]] during December 2006 found that 78% were parallel-group trials, 16% were crossover, 2% were split-body, 2% were cluster, and 2% were factorial.<ref name="Hopewell-2010"/>

===By outcome of interest (efficacy vs. effectiveness)===
RCTs can be classified as "explanatory" or "pragmatic."<ref name="Zwarenstein-2008">{{Cite journal | author = Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, Oxman AD, Moher D; CONSORT group; Pragmatic Trials in Healthcare (Practihc) group | title = Improving the reporting of pragmatic trials: an extension of the CONSORT statement | journal = BMJ | volume = 337 | pages = a2390 | year = 2008 | doi = 10.1136/bmj.a2390 | url = http://www.bmj.com/cgi/content/full/337/nov11_2/a2390 | pmid = 19001484 }}</ref> Explanatory RCTs test [[Efficacy#Healthcare|efficacy]] in a research setting with highly selected participants and under highly controlled conditions.<ref name="Zwarenstein-2008"/> In contrast, pragmatic RCTs test [[effectiveness]] in everyday practice with relatively unselected participants and under flexible conditions; in this way, pragmatic RCTs can "inform decisions about practice."<ref name="Zwarenstein-2008"/>

===By hypothesis (superiority vs. noninferiority vs. equivalence)===
Another classification of RCTs categorizes them as "superiority trials," "noninferiority trials," and "equivalence trials," which differ in methodology and reporting.<ref name="Piaggio-2006">{{Cite journal | author = Piaggio G, Elbourne DR, [[Doug Altman|Altman DG]], [[Stuart Pocock|Pocock SJ]], Evans SJ; CONSORT Group | title = Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement | journal = JAMA | volume = 295 | issue = 10 | pages = 1152–60 |  year = 2006 | doi = 10.1001/jama.295.10.1152 | url = http://jama.ama-assn.org/cgi/content/full/295/10/1152 | pmid = 16522836 }}</ref> Most RCTs are superiority trials, in which one intervention is hypothesized to be superior to another in a [[Statistical significance|statistically significant]] way.<ref name="Piaggio-2006"/> Some RCTs are noninferiority trials "to determine whether a new treatment is no worse than a reference treatment."<ref name="Piaggio-2006"/> Other RCTs are equivalence trials in which the hypothesis is that two interventions are indistinguishable from each other.<ref name="Piaggio-2006"/>

== Randomization ==
The advantages of proper [[randomization]] in RCTs include<ref name="Schulz-2002">{{Cite journal | author = Schulz KF, Grimes DA | title = Generation of allocation sequences in randomised trials: chance, not choice | journal = Lancet | volume = 359 | issue = 9305 | pages = 515–9 | year = 2002 | doi = 10.1016/S0140-6736(02)07683-3 | url = http://www.who.int/entity/rhl/LANCET_515-519.pdf | pmid = 11853818 }}</ref>:
* "It eliminates bias in treatment assignment," specifically [[selection bias]] and [[confounding]].
* "It facilitates blinding (masking) of the identity of treatments from investigators, participants, and assessors."
* "It permits the use of probability theory to express the likelihood that any difference in outcome between treatment groups merely indicates chance."

There are two processes involved in randomizing patients to different interventions. First is choosing a ''randomization procedure'' to generate an unpredictable sequence of allocations; this may be a simple random assignment of patients to any of the groups at equal probabilities, may be "restricted," or may be "adaptive." A second and more practical issue is ''allocation concealment'', which refers to the stringent precautions taken to ensure that the group assignment of patients are not revealed prior to definitively allocating them to their respective groups. Non-random "systematic" methods of group assignment, such as alternating subjects between one group and the other, can cause "limitless contamination possibilities" and can cause a breach of allocation concealment.<ref name="Schulz-2002"/>

=== Randomization procedures ===
An ideal randomization procedure would achieve the following goals<ref name="Lachin-1988a">{{Cite journal | unused_data = DUPLICATE DATA: doi = 10.1016/0197-2456(88)90045-1 | author = Lachin JM | title = Statistical properties of randomization in clinical trials | journal = Control Clin Trials | volume = 9 | issue = 4 | pages = 289–311 | year = 1988 | doi = 10.1016/0197-2456(88)90045-1 | pmid = 3060315 }}</ref>:
* '''Equal group sizes''' for adequate [[statistical power]], especially in [[Subgroup analysis|subgroup analyses]].
* '''Low selection bias'''.  That is, the procedure should not allow an investigator to predict the next subject's group assignment by examining which group has been assigned the fewest subjects up to that point.
* '''Low probability of confounding''' (i.e., a low probability of "accidental bias"<ref name="Schulz-2002"/><ref name="Buyse-1989">{{Cite journal | unused_data = DUPLICATE DATA: doi = 10.1016/0197-2456(89)90057-3 | author = Buyse ME | title = Analysis of clinical trial outcomes: some comments on subgroup analyses | journal = Control Clin Trials | volume = 10 | issue = 4 Suppl | pages = 187S–194S | year = 1989 | doi = 10.1016/0197-2456(89)90057-3 | pmid = 2605967 }}</ref>), which implies a balance in [[covariate]]s across groups. If the randomization procedure causes an imbalance in covariates related to the outcome across groups, estimates of effect may be [[bias of an estimator|biased]] if not adjusted for the covariates (which may be unmeasured and therefore impossible to adjust for).
However, no single randomization procedure meets those goals in every circumstance, so researchers must select a procedure for a given study based on its advantages and disadvantages.

==== Simple randomization ====
This is a commonly used and intuitive procedure, similar to "repeated fair coin-tossing."<ref name="Schulz-2002"/> Also known as "complete" or "unrestricted" randomization, it is [[Robust statistics|robust]] against both selection and accidental biases. However, its main drawback is the possibility of imbalanced group sizes in small RCTs.  It is therefore recommended only for RCTs with over 200 subjects.<ref name="Lachin-1988b">{{Cite journal | unused_data = DUPLICATE DATA: doi = 10.1016/0197-2456(88)90049-9 | author = Lachin JM, Matts JP, Wei LJ | title = Randomization in clinical trials: conclusions and recommendations | journal = Control Clin Trials | volume = 9 | issue = 4 | pages = 365–74 | year = 1988 | doi = 10.1016/0197-2456(88)90049-9 | pmid = 3203526 }}</ref>

==== Restricted randomization ====
To balance group sizes in smaller RCTs, some form of [[restricted randomization|"restricted" randomization]] is recommended.<ref name="Lachin-1988b"/>  The major types of restricted randomization used in RCTs are:
* '''[[Randomized block design|Permuted-block randomization]]''' or '''blocked randomization''': a "block size" and "allocation ratio" (number of subjects in one group versus the other group) are specified, and subjects are allocated randomly within each block.<ref name="Schulz-2002"/> For example, a block size of 6 and an allocation ratio of 2:1 would lead to random assignment of 4 subjects to one group and 2 to the other. This type of randomization can be combined with "stratified randomization", for example by center in a [[multicenter trial]], to "ensure good balance of participant characteristics in each group."<ref name="Moher-2010"/> A special case of permuted-block randomization is ''random allocation'', in which the entire sample is treated as one block.<ref name="Schulz-2002"/> The major disadvantage of permuted-block randomization is that even if the block sizes are large and randomly varied, the procedure can lead to selection bias.<ref name="Lachin-1988a"/> Another disadvantage is that "proper" analysis of data from permuted-block-randomized RCTs requires stratification by blocks.<ref name="Lachin-1988b"/>
* '''Adaptive biased-coin randomization''' methods (of which '''urn randomization''' is the most widely-known type): In these relatively uncommon methods, the probability of being assigned to a group increases if the group is over-represented and decreases if the group is under-represented.<ref name="Schulz-2002"/> The methods are thought to be less affected by selection bias than permuted-block randomization.<ref name="Lachin-1988b"/>

==== Adaptive ====
At least two types of "adaptive" randomization procedures have been used in RCTs, but much less frequently than simple or restricted randomization:
* '''Covariate-adaptive randomization''', of which one type is '''minimization''': The probability of being assigned to a group varies in order to minimize "covariate imbalance."<ref name="Lachin-1988b"/> Minimization is reported to have "supporters and detractors"<ref name="Schulz-2002"/>; because only the first subject's group assignment is truly chosen at random, the method does not necessarily eliminate bias on unknown factors<ref name="Moher-2010"/>.
* '''Response-adaptive randomization''', also known as '''outcome-adaptive randomization''': The probability of being assigned to a group increases if the responses of the prior patients in the group were favorable.<ref name="Lachin-1988b"/> Although arguments have been made that this approach is more ethical than other types of randomization when the probability that a treatment is effective or ineffective increases during the course of an RCT, ethicists have not yet studied the approach in detail.<ref name="Rosenberger-1993">{{Cite journal | unused_data = DUPLICATE DATA: doi = 10.1016/0197-2456(93)90028-C | author = Rosenberger WF, Lachin JM | title = The use of response-adaptive designs in clinical trials | journal = Control Clin Trials | volume = 14 | issue = 6 | pages = 471–84 | year = 1993 | doi = 10.1016/0197-2456(93)90028-C | pmid = 8119063 }}</ref>

=== Allocation concealment ===
"Allocation concealment" (defined as "the procedure for protecting the randomisation process so that the treatment to be allocated is not known before the patient is entered into the study") is considered desirable in RCTs.<ref name="Forder-2005">{{Cite journal | author = Forder PM, Gebski VJ, Keech AC | title = Allocation concealment and blinding: when ignorance is bliss | journal = Med J Aust | volume = 182 | issue = 2 | pages = 87–9 | year = 2005 | url = http://www.mja.com.au/public/issues/182_02_170105/for10877_fm.html | pmid = 15651970 }}</ref> In practice, in taking care of individual patients, clinical investigators in RCTs often find it difficult to maintain impartiality. Stories abound of investigators holding up sealed envelopes to lights or ransacking offices to determine group assignments in order to dictate the assignment of their next patient.<ref name="Schulz-2002">{{Cite journal | title = Allocation concealment in randomised trials: defending against deciphering | journal = Lancet | volume = 359 | issue = 9306 | pages = 614–8 | year = 2002 | doi = 10.1016/S0140-6736(02)07750-4 | url = http://www.who.int/entity/rhl/LANCET_614-618.pdf | pmid = 11867132 | author = Schulz KF, Grimes DA }}</ref> Such practices introduce selection bias and [[Lurking variable|confounders]] (both of which should have minimized by randomization), thereby possibly distorting the results of the study.<ref name="Schulz-2002"/> 

Some standard methods of ensuring allocation concealment include sequentially-numbered, opaque, sealed envelopes (SNOSE); sequentially-numbered containers; pharmacy controlled randomization; and central randomization.<ref name="Schulz-2002"/> It is recommended that allocation concealment methods be included in an RCT's [[Clinical trial protocol|protocol]], and that the allocation concealment methods should be reported in detail in a publication of an RCT's results; however, 2005 study determined that most RCTs have unclear allocation concealment in their protocols, in their publications, or both.<ref name="Pildal-2005">{{Cite journal | author = Pildal J, Chan AW, Hróbjartsson A, Forfang E, Altman DG, Gøtzsche PC | title = Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study | journal = BMJ | volume = 330 | issue = 7499 | pages = 1049 | year = 2005 | doi = 10.1136/bmj.38414.422650.8F | url = http://www.bmj.com/cgi/content/full/330/7499/1049 | pmid = 15817527 | pmc = 557221 }}</ref> On the other hand, a 2008 study of 146 [[meta-analysis|meta-analyses]] concluded that the results of RCTs with inadequate or unclear allocation concealment tended to be biased toward beneficial effects only if the RCTs' outcomes were [[Subjectivity|subjective]] as opposed to [[Objectivity (philosophy)|objective]].<ref name="Wood-2008">{{Cite journal | author = Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, Gluud C, Martin RM, Wood AJ, Sterne JA | title = Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study | journal = BMJ | volume = 336 | issue = 7644 | pages = 601–5 | year = 2008 | doi = 10.1136/bmj.39465.451748.AD | url = http://www.bmj.com/cgi/content/full/336/7644/601 | pmid = 18316340 | pmc = 2267990 }}</ref>

== Blinding ==
An RCT may be [[Blind experiment|Blinded]], (also called "masked") by "procedures that prevent study participants, caregivers, or outcome assessors from knowing which intervention was received."<ref name="Wood-2008"/> Unlike allocation concealment, blinding is sometimes inappropriate or impossible to perform in an RCT; for example, if an RCT involves a treatment in which active participation of the patient is necessary (e.g., [[physical therapy]]), participants cannot be blinded to the intervention.

Traditionally, blinded RCTs have been classified as "single-blind," "double-blind," or "triple-blind"; however, in 2001 and 2006 two studies showed that these terms have different meanings for different people.<ref name="Devereaux-2001">{{Cite journal | author = Devereaux PJ, Manns BJ, Ghali WA, Quan H, Lacchetti C, Montori VM, Bhandari M, Guyatt GH | title = Physician interpretations and textbook definitions of blinding terminology in randomized controlled trials | journal = [[J Am Med Assoc]] | volume = 285 | issue = 15 | pages = 2000–3 | year = 2001 | doi =  10.1001/jama.285.15.2000| url = http://jama.ama-assn.org/cgi/content/full/285/15/2000 | pmid = 11308438 }}</ref><ref name="Haahr-2006">{{Cite journal | author = Haahr MT, Hróbjartsson A | title = Who is blinded in randomized clinical trials? A study of 200 trials and a survey of authors | journal = Clin Trials | volume = 3 | issue = 4 | pages = 360–5 | year = 2006 | doi = 10.1177/1740774506069153 | url = http://ctj.sagepub.com/cgi/content/abstract/3/4/360 | pmid = 17060210 }}</ref>  The 2010 CONSORT Statement specifies that authors and editors should not use the terms "single-blind," "double-blind," and "triple-blind"; instead, reports of blinded RCT should discuss "If done, who was blinded after assignment to interventions (for example, participants, care providers, those assessing outcomes) and how."<ref name="Moher-2010"/>

RCTs without blinding are referred to as "unblinded"<ref name="Marson-2007">{{Cite journal | author = Marson AG, Al-Kharusi AM, Alwaidh M, Appleton R, Baker GA, Chadwick DW, et al | title = The SANAD study of effectiveness of valproate, lamotrigine, or topiramate for generalised and unclassifiable epilepsy: an unblinded randomised controlled trial | journal = [[Lancet]] | volume = 369 | issue = 9566 | pages = 1016–26 | year = 2007 | doi = 10.1016/S0140-6736(07)60461-9 | pmid = 17382828 | pmc = 2039891 }}</ref>, "open"<ref name="Chan-1995">{{Cite journal | author = Chan R, Hemeryck L, O'Regan M, Clancy L, Feely J | title = Oral versus intravenous antibiotics for community acquired lower respiratory tract infection in a general hospital: open, randomised controlled trial | journal = [[BMJ]] | volume = 310 | issue = 6991 | pages = 1360–2 | year = 1995 | url = http://www.bmj.com/cgi/content/full/310/6991/1360 | pmid = 7787537 | pmc = 2549744 }}</ref>, or (if the intervention is a medication) "[[Open-label trial|open-label]]"<ref name="Fukase-2008">{{Cite journal | author = Fukase K, Kato M, Kikuchi S, Inoue K, Uemura N, Okamoto S, Terao S, Amagai K, Hayashi S, Asaka M; Japan Gast Study Group | title = Effect of eradication of Helicobacter pylori on incidence of metachronous gastric carcinoma after endoscopic resection of early gastric cancer: an open-label, randomised controlled trial | journal = Lancet | volume = 372 | issue = 9636 | pages = 392–7 | year = 2008 | doi = 10.1016/S0140-6736(08)61159-9 | pmid = 18675689 }}</ref>. In 2008 a study concluded that the results of unblinded RCTs tended to be biased toward beneficial effects only if the RCTs' outcomes were subjective as opposed to objective<ref name="Wood-2008"/>; for example, in an RCT of treatments for [[multiple sclerosis]], unblinded neurologists (but not blinded neurologists) felt that the treatments were beneficial<ref name="Noseworthy-1994">{{Cite journal | author = Noseworthy JH, Ebers GC, Vandervoort MK, Farquhar RE, Yetisir E, Roberts R | title = The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial | journal = Neurology | volume = 44 | issue = 1 | pages = 16–20 | year = 1994 | url = http://www.neurology.org/cgi/content/abstract/44/1/16 | pmid = 8290055 }}</ref>. In pragmatic RCTs, although the participants and providers are often unblinded, it is "still desirable and often possible to blind the assessor or obtain an objective source of data for evaluation of outcomes."<ref name="Zwarenstein-2008"/>

==Analysis of data from RCTs==
The types of statistical methods used in RCTs depend on the characteristics of the data and include:
* For [[dichotomous]] (binary) outcome data, [[logistic regression]] (e.g., to predict sustained virological response after receipt of [[peginterferon alfa-2a]] for [[hepatitis C]]<ref name="Manns-2001">{{Cite journal | author = Manns MP, McHutchison JG, Gordon SC, Rustgi VK, Shiffman M, Reindollar R, Goodman ZD, Koury K, Ling M, Albrecht JK| title = Peginterferon alfa-2b plus ribavirin compared with interferon alfa-2b plus ribavirin for initial treatment of chronic hepatitis C: a randomised trial | journal = [[Lancet]] | volume = 358 | issue = 9286 | pages = 958–65 | year = 2001 | doi = 10.1016/S0140-6736(01)06102-5 | pmid = 11583749 }}</ref>) and other methods can be used.
* For continuous outcome data, [[analysis of covariance]] (e.g., for changes in blood lipid levels after receipt of [[atorvastatin]] after [[acute coronary syndrome]]<ref name="Schwartz-2001">{{Cite journal | author = Schwartz GG, Olsson AG, Ezekowitz MD, Ganz P, Oliver MF, Waters D, Zeiher A, Chaitman BR, Leslie S, Stern T; Myocardial Ischemia Reduction with Aggressive Cholesterol Lowering (MIRACL) Study Investigators | title = Effects of atorvastatin on early recurrent ischemic events in acute coronary syndromes: the MIRACL study: a randomized controlled trial | journal = [[J Am Med Assoc]] | volume = 285 | issue = 13 | pages = 1711–8 | year = 2001 | url = http://jama.ama-assn.org/cgi/content/full/285/13/1711 | pmid = 11277825 | doi = 10.1001/jama.285.13.1711 }}</ref>) tests the effects of predictor variables.
* For time-to-event outcome data that may be [[Censoring (statistics)|censored]], [[survival analysis]] (e.g., [[Kaplan–Meier estimator]]s and [[Cox proportional hazards model]]s for time to [[coronary heart disease]] after receipt of [[Hormone replacement therapy (menopause)|hormone replacement therapy in menopause]]<ref name="Rossouw-2002">{{Cite journal | author = Rossouw JE, Anderson GL, Prentice RL, LaCroix AZ, Kooperberg C, Stefanick ML, Jackson RD, Beresford SA, Howard BV, Johnson KC, Kotchen JM, Ockene J; Writing Group for the Women's Health Initiative Investigators | title = Risks and benefits of estrogen plus progestin in healthy postmenopausal women: principal results from the Women's Health Initiative randomized controlled trial | journal = [[J Am Med Assoc]] | volume = 288 | issue = 3 | pages = 321–33 | year = 2002 | url = http://jama.ama-assn.org/cgi/content/full/288/3/321 | pmid = 12117397 | doi = 10.1001/jama.288.3.321 }}</ref>) is appropriate.

Regardless of the statistical methods used, important considerations in the analysis of RCT data include:
* Whether a RCT should be stopped early due to interim results.  For example, RCTs may be stopped early if an intervention produces "larger than expected benefit or harm," or if "investigators find evidence of no important difference between experimental and control interventions."<ref name="Moher-2010"/>
* The extent to which the groups can be analyzed exactly as they existed upon randomization (i.e., whether a so-called "[[intention-to-treat analysis]]" is used). A "pure" intention-to-treat analysis is "possible only when complete outcome data are available" for all randomized subjects<ref name="Hollis-1999">{{Cite journal | author = Hollis S, Campbell F | title = What is meant by intention to treat analysis? Survey of published randomised controlled trials | journal = [[Br Med J]] | volume = 319 | issue = 7211 | pages = 670–4 | year = 1999 | url = http://www.bmj.com/cgi/content/full/319/7211/670 | pmid = 10480822 | pmc = 28218 }}</ref>; when some outcome data are missing, options include analyzing only cases with known outcomes and using [[Imputation (statistics)|imputed]] data<ref name="Moher-2010"/>. Nevertheless, the more that analyses can include all participants in the groups to which they were randomized, the less bias that an RCT will be subject to.<ref name="Moher-2010"/>
* Whether [[subgroup analysis]] should be performed.  These are "often discouraged" because [[multiple comparisons]] may produce false positive findings that cannot be confirmed by other studies.<ref name="Moher-2010"/>

==Reporting of RCT results==
The ''CONSORT 2010 Statement'' is "an evidence-based, minimum set of recommendations for reporting RCTs."<ref name="CONSORT">{{cite web |url=http://www.consort-statement.org |title=Welcome to the CONSORT statement Website |author=CONSORT Group |accessdate=2010-03-29}}</ref> The CONSORT 2010 checklist contains 25 items (many with sub-items) focusing on "individually randomised, two group, parallel trials" which are the most common type of RCT.<ref name="Schulz-2010"/> For other RCT study designs, "CONSORT extensions" have been published.<ref name="Schulz-2010"/>

==Advantages==
RCTs are considered by most to be the most reliable form of [[scientific method|scientific evidence]] in the [[hierarchy of evidence]] that influences healthcare policy and practice because RCTs reduce spurious causality and bias. Results of RCTs may be combined in [[systematic review]]s which are increasingly being used in the conduct of [[evidence-based medicine]]. Some examples of scientific organizations' considering RCTs or systematic reviews of RCTs to be the highest-quality evidence available are:
* As of 1998, the [[National Health and Medical Research Council]] of Australia designated "Level I" evidence as that "obtained from a [[systematic review]] of all relevant randomised controlled trials" and "Level II" evidence as that "obtained from at least one properly designed randomised controlled trial."<ref>{{ cite book |url= http://www.nhmrc.gov.au/_files_nhmrc/file/publications/synopses/cp30.pdf |title= A guide to the development, implementation and evaluation of clinical practice guidelines |author= National Health and Medical Research Council |date=1998-11-16 |publisher= Commonwealth of Australia |location = Canberra | isbn = 1864960485 |page= 56|accessdate=2010-03-28}}</ref>
* Since at least 2001, in making [[clinical practice guideline]] recommendations the [[United States Preventive Services Task Force]] has considered both a study's design and its [[internal validity]] as indicators of its quality.<ref name="Harris-2001">{{Cite journal | author = Harris RP, Helfand M, Woolf SH, Lohr KN, Mulrow CD, Teutsch SM, Atkins D; Methods Work Group, Third US Preventive Services Task Force | title = Current methods of the US Preventive Services Task Force: a review of the process | journal = Am J Prev Med | volume = 20 | issue = 3 Suppl | pages = 21–35 | year = 2001 | url = http://www.ahrq.gov/clinic/ajpmsuppl/review.pdf | pmid = 11306229 | doi = 10.1016/S0749-3797(01)00261-6 }}</ref> It has recognized "evidence obtained from at least one properly randomized controlled trial" with good [[internal validity]] (i.e., a rating of "I-good") as the highest quality evidence available to it.<ref name="Harris-2001"/>
* The [[Evidence-based medicine#Grade Working Group|GRADE Working Group]] concluded in 2008 that "randomised trials without important limitations constitute high quality evidence."<ref name="Guyatt-2008">{{Cite journal | author = Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ; GRADE Working Group | title = What is "quality of evidence" and why is it important to clinicians? | journal = BMJ | volume = 336 | issue = 7651 | pages = 995–8 |year = 2008 | doi = 10.1136/bmj.39490.551019.BE | pmc = 2364804 | url = http://www.bmj.com/cgi/content/full/336/7651/995 | pmid = 18456631 }}</ref>
* For issues involving "Therapy/Prevention, Aetiology/Harm," the Oxford Centre for Evidence-based Medicine]] as of 2009 defined "Level 1a" evidence as a systematic review of RCTs that are consistent with each other, and "Level 1b" evidence as an "individual RCT (with narrow [[Confidence Interval]])."<ref>{{cite web |url= http://www.cebm.net/index.aspx?o=1025 |title= Levels of evidence |author= Oxford Centre for Evidence-based Medicine |date=2009 March  |accessdate=2010-03-28}}</ref>

Notable [[Clinical trials with surprising outcomes|RCTs with unexpected results]] that contributed to changes in clinical practice include:
* After [[Food and Drug Administration]] approval, the [[antiarrhythmic agents]] [[flecainide]] and [[encainide]] came to market in 1986 and 1987 respectively.<ref name="Anderson-1997">{{Cite journal | author = Anderson JL, Pratt CM, Waldo AL, Karagounis LA | title = Impact of the Food and Drug Administration approval of flecainide and encainide on coronary artery disease mortality: putting "Deadly Medicine" to the test | journal = Am J Cardiol | volume = 79 | issue = 1 | pages = 43–7 | year = 1997 | url = http://www.ajconline.org/article/S0002-9149%2896%2900673-X/abstract | pmid = 9024734 | doi = 10.1016/S0002-9149(96)00673-X }}</ref> The non-randomized studies concerning the drugs were characterized as "glowing"<ref name="Rubin-2006">{{cite news |title= In medicine, evidence can be confusing - deluged with studies, doctors try to sort out what works, what doesn't |author= Rubin R |url= http://www.usatoday.com/news/health/2006-10-15-medical-evidence-cover_x.htm |newspaper= USA Today |date= 2006-10-16 |accessdate=2010-03-22}}</ref>, and their sales increased to a combined total of approximately 165,000 prescriptions per month in early 1989<ref name="Anderson-1997"/>.  In that year, however, a preliminary report of a RCT concluded that the two drugs increased mortality.<ref name="CAST-1989">{{Cite journal | doi = 10.1056/NEJM198908103210629 | title = Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. The Cardiac Arrhythmia Suppression Trial (CAST) Investigators | journal = N Engl J Med | volume = 321 | issue = 6 | pages = 406–12 |year = 1989 | url = http://content.nejm.org/cgi/content/abstract/321/6/406 | pmid = 2473403 }}</ref>  Sales of the drugs then decreased.<ref name="Anderson-1997"/>
* Prior to 2002, based on observational studies, it was routine for physicians to prescribe hormone replacement therapy for post-menopausal women to prevent [[myocardial infarction]].<ref name="Rubin-2006"/> In 2002 and 2004, however, published RCTs from the [[Women's Health Initiative]] claimed that women taking hormone replacement therapy with estrogen plus progestin had a higher rate of myocardial infarctions than women on a placebo, and that estrogen-only hormone replacement therapy caused no reduction in the incidence of coronary heart disease.<ref name="Rossouw-2002"/><ref name="Anderson-2004">{{Cite journal | author = Anderson GL, Limacher M, Assaf AR, Bassford T, Beresford SA, Black H, et al | title = Effects of conjugated equine estrogen in postmenopausal women with hysterectomy: the Women's Health Initiative randomized controlled trial | journal = JAMA | volume = 291 | issue = 14 | pages = 1701–12 | year = 2004 | doi = 10.1001/jama.291.14.1701 | url = http://jama.ama-assn.org/cgi/content/full/291/14/1701 | pmid = 15082697 }}</ref>  Possible explanations for the discrepancy between the observational studies and the RCTs involved differences in methodology, in the hormone regimens used, and in the populations studied.<ref name="Grodstein-2003">{{Cite journal | author = Grodstein F, Clarkson TB, Manson JE | title = Understanding the divergent data on postmenopausal hormone therapy | journal = N Engl J Med | volume = 348 | issue = 7 | pages = 645–50 | year = 2003 | doi = 10.1056/NEJMsb022365 | url = http://content.nejm.org/cgi/content/extract/348/7/645| pmid = 12584376 }}</ref><ref name="Vandenbroucke-2009">{{Cite journal | author = Vandenbroucke JP | title = The HRT controversy: observational studies and RCTs fall in line | journal = Lancet | volume = 373 | issue = 9671 | pages = 1233–5 | year = 2009 | doi = 10.1016/S0140-6736(09)60708-X | url = http://linkinghub.elsevier.com/retrieve/pii/S0140-6736(09)60708-X | pmid = 19362661 }}</ref> The use of hormone replacement therapy decreased after publication of the RCTs.<ref name="Hsu-2009">{{Cite journal | author = Hsu A, Card A, Lin SX, Mota S, Carrasquillo O, Moran A | title = Changes in postmenopausal hormone replacement therapy use among women with high cardiovascular risk | journal = Am J Public Health | volume = 99 | issue = 12 | pages = 2184–7 | year = 2009 | doi = 10.2105/AJPH.2009.159889 | url = http://ajph.aphapublications.org/cgi/content/full/99/12/2184 | pmid = 19833984 }}</ref>

== Disadvantages ==
Many papers discuss the disadvantages of RCTs.<ref name="Black-1996">{{Cite journal | author = Black N | title = Why we need observational studies to evaluate the effectiveness of health care | journal = BMJ | volume = 312 | issue = 7040 | pages = 1215–8 | year = 1996 | url = http://www.bmj.com/cgi/content/full/bmj%3B312/7040/1215 | pmid = 8634569 | pmc = 2350940 }}</ref><ref name="Sanson-Fisher-2007">{{Cite journal | author = Sanson-Fisher RW, Bonevski B, Green LW, D'Este C | title = Limitations of the randomized controlled trial in evaluating population-based health interventions | journal = Am J Prev Med | volume = 33 | issue = 2 | pages = 155–61 | year = 2007 | doi = 10.1016/j.amepre.2007.04.007 | url = http://www.ajpm-online.net/article/S0749-3797%2807%2900225-5/abstract | pmid = 17673104 }}</ref>  Among the most frequently-cited drawbacks are:

=== Limitations of external validity ===
The extent to which RCTs' results are applicable outside the RCTs varies; that is, RCTs' [[external validity]] may be limited.<ref name="Black-1996"/><ref name="Rothwell-2005">{{Cite journal | author = Rothwell PM | title = External validity of randomised controlled trials: "to whom do the results of this trial apply?" | journal = Lancet | volume = 365 | issue = 9453 | pages = 82–93 | year = 2005 | doi = 10.1016/S0140-6736(04)17670-8 | url = http://apps.who.int/rhl/Lancet_365-9453.pdf | pmid = 15639683 }}</ref> Factors that can affect RCTs' external validity include<ref name="Rothwell-2005"/>:
* Where the RCT was performed (e.g., what works in one country may not work in another)
* Characteristics of the patients (e.g., an RCT may include patients whose prognosis is better than average, or may exclude "women, children, the elderly, and those with common medical conditions"<ref name="Van Spall-2007">{{Cite journal | author = Van Spall HG, Toren A, Kiss A, Fowler RA | title = Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review | journal = JAMA | volume = 297 | issue = 11 | pages = 1233–40 | year = 2007 | doi = 10.1001/jama.297.11.1233 | url = http://jama.ama-assn.org/cgi/content/full/297/11/1233 | pmid = 17374817 }}</ref>)
* Study procedures (e.g., in an RCT patients may receive intensive diagnostic procedures and follow-up care difficult to achieve in the "real world")
* Outcome measures (e.g., RCTs may use [[Scale (social sciences)#Composite measures|composite measures]] infrequently used in clinical practice)
* Incomplete reporting of adverse effects of interventions

=== Costs ===
RCTs can be expensive<ref name="Sanson-Fisher-2007"/>; one study found 28 [[Clinical trial#Phase III|Phase III]] RCTs funded by the [[National Institute of Neurological Disorders and Stroke]] prior to 2000 with a total cost of US$335 million<ref name="Johnston-2006">{{Cite journal | author = Johnston SC, Rootenberg JD, Katrak S, Smith WS, Elkins JS | title = Effect of a US National Institutes of Health programme of clinical trials on public health and costs | journal = [[Lancet]] | volume = 367 | issue = 9519 | pages = 1319–27 | year = 2006 | doi = 10.1016/S0140-6736(06)68578-4 | url = http://www.chrp.org/pdf/HSR20070511.pdf | pmid = 16631910 }}</ref>, for a [[mean]] cost of US$12 million per RCT.  Nevertheless, the [[return on investment]] of RCTs may be high, in that the same study projected that the 28 RCTs produced a "net benefit to society at 10-years" of 46 times the cost of the trials program, based on evaluating a [[quality-adjusted life year]] as equal to the prevailing mean [[per capita]] [[gross domestic product]].<ref name="Johnston-2006"/>

=== Relative importance of RCTs and observational studies ===
Two studies published in ''[[The New England Journal of Medicine]]'' in 2000 found that [[Observational study|observational studies]] and RCTs overall produced similar results<ref name="Benson-2000">{{Cite journal | author = Benson K, Hartz AJ | title = A comparison of observational studies and randomized, controlled trials | journal = [[N Engl J Med]] | volume = 342 | issue = 25 | pages = 1878–86 | year = 2000 | url = http://content.nejm.org/cgi/content/full/342/25/1878 | pmid = 10861324 | doi = 10.1056/NEJM200006223422506 }}</ref><ref name="Concato-2000">{{Cite journal | author = Concato J, Shah N, Horwitz RI | title = Randomized, controlled trials, observational studies, and the hierarchy of research designs | journal = [[N Engl J Med]] | volume = 342 | issue = 25 | pages = 1887–92 | year = 2000 | url = http://nejm.highwire.org/cgi/content/full/342/25/1887 | pmid = 10861325 | doi = 10.1056/NEJM200006223422507 | pmc = 1557642 }}</ref>. The authors of the 2000 findings cast doubt on the ideas that "observational studies should not be used for defining evidence-based medical care" and that RCTs' results are "evidence of the highest grade."<ref name="Benson-2000"/><ref name="Concato-2000"/> However, a 2001 study published in ''[[Journal of the American Medical Association]]'' concluded that "discrepancies beyond chance do occur and differences in estimated magnitude of treatment effect are very common" between observational studies and RCTs.<ref name="Ioannidis-2001">{{Cite journal | author = Ioannidis JP, Haidich AB, Pappa M, Pantazis N, Kokori SI, Tektonidou MG, Contopoulos-Ioannidis DG, Lau J | title = Comparison of evidence of treatment effects in randomized and nonrandomized studies | journal = [[J Am Med Assoc]] | volume = 286 | issue = 7 | pages = 821–30 | year = 2001 | url = http://jama.ama-assn.org/cgi/content/full/286/7/821 | pmid = 11497536 | doi = 10.1001/jama.286.7.821 }}</ref>

Two other lines of reasoning question RCTs' contribution to scientific knowledge beyond other types of studies:
* If study designs are ranked by their potential for new discoveries, then [[Anecdotal evidence#Scientific context|anecdotal evidence]] would be at the top of the list, followed by observational studies, followed by RCTs.<ref name="Vandenbroucke-2008">{{Cite journal | author = Vandenbroucke JP | title = Observational research, randomised trials, and two views of medical science | journal = [[PLoS Med]] | volume = 5 | issue = 3 | pages = e67 | year = 2008 | doi = 10.1371/journal.pmed.0050067 | pmid = 18336067 | pmc = 2265762 }}</ref>
* RCTs may be unnecessary for treatments that have dramatic and rapid effects relative to the expected stable or progressively worse natural course of the condition treated.<ref name="Black-1996"/><ref name="Glasziou-2007">{{Cite journal | author = Glasziou P, Chalmers I, Rawlins M, McCulloch P | title = When are randomised trials unnecessary? Picking signal from noise | journal = [[Br Med J]] | volume = 334 | issue = 7589 | pages = 349–51 | year = 2007 | doi = 10.1136/bmj.39070.527986.68 | pmc=1800999 | pmid = 17303884 }}</ref> One example is [[History of cancer chemotherapy#Combination chemotherapy|combination chemotherapy]] including [[cisplatin]] for [[Metastasis|metastatic]] [[testicular cancer]], which increased the cure rate from 5% to 60% in a 1977 non-randomized study.<ref name="Glasziou-2007"/><ref name="Einhorn-2002">{{Cite journal | author = Einhorn LH | authorlink = Lawrence Einhorn | title = Curing metastatic testicular cancer | journal = [[Proc Natl Acad Sci U S A]] | volume = 99 | issue = 7 | pages = 4592–5 | year = 2002 | doi = 10.1073/pnas.072067999 | pmid = 11904381 | pmc = 123692 }}</ref>

===Difficulty in studying rare events===
Interventions to prevent events that occur only infrequently (e.g., [[sudden infant death syndrome]]) and uncommon adverse outcomes (e.g., a rare side effect of a drug) would require RCTs with extremely large sample sizes and may therefore best be assessed by observational studies.<ref name="Black-1996"/>

===Difficulty in studying outcomes in distant future===
It is costly to maintain RCTs for the years or decades that would be ideal for evaluating some interventions.<ref name="Black-1996"/><ref name="Sanson-Fisher-2007"/>

=== Pro-industry findings in industry-funded RCTs ===
Some RCTs are fully or partly funded by the health care industry (e.g., the [[pharmaceutical industry]]) as opposed to government, nonprofit, or other sources. A systematic review published in 2003 found four 1986-2002 articles comparing industry-sponsored and nonindustry-sponsored RCTs, and in all the articles there was a correlation of industry sponsorship and positive study outcome.<ref name="Bekelman-2003">{{Cite journal | author = Bekelman JE, Li Y, Gross CP | title = Scope and impact of financial conflicts of interest in biomedical research: a systematic review | journal = [[J Am Med Assoc]] | volume = 289 | issue = 4 | pages = 454–65 | year = 2003 | url = http://jama.ama-assn.org/cgi/content/full/289/4/454 | pmid = 12533125 | doi = 10.1001/jama.289.4.454 }}</ref> A 2004 study of 1999-2001 RCTs published in leading medical and surgical journals determined that industry-funded RCTs "are more likely to be associated with statistically significant pro-industry findings."<ref name="Bhandari-2004">{{Cite journal | author = Bhandari M, Busse JW, Jackowski D, Montori VM, Schünemann H, Sprague S, Mears D, Schemitsch EH, Heels-Ansdell D, Devereaux PJ | title = Association between industry funding and statistically significant pro-industry findings in medical and surgical randomized trials | journal = [[Can Med Assoc J]] | volume = 170 | issue = 4 | pages = 477–80 | year = 2004 | url = http://ecmaj.com/cgi/content/full/170/4/477 | pmid = 14970094 | pmc = 332713 }}</ref> One possible reason for the pro-industry results in industry-funded published RCTs is [[publication bias]].<ref name="Bhandari-2004"/>

===Therapeutic misconception===
Although subjects almost always provide [[informed consent]] for their participation in an RCT, studies since 1982 have documented that many RCT subjects believe that they are certain to receive treatment that is best for them personally; that is, they do not understand the difference between research and treatment.<ref name="Appelbaum-1982">{{Cite journal | author = Appelbaum PS, Roth LH, Lidz C | title = The therapeutic misconception: informed consent in psychiatric research | journal = [[Int J Law Psychiatry]] | volume = 5 | issue = 3-4 | pages = 319–29 | year = 1982 | doi = 10.1016/0160-2527(82)90026-7 | pmid = 6135666 }}</ref><ref name="Henderson-2007">{{Cite journal | author = Henderson GE, Churchill LR, Davis AM, Easter MM, Grady C, Joffe S, Kass N, King NM, Lidz CW, Miller FG, Nelson DK, Peppercorn J, Rothschild BB, Sankar P, Wilfond BS, Zimmer CR | title = Clinical trials and medical care: defining the therapeutic misconception | journal = [[PLoS Med]] | volume = 4 | issue = 11 | pages = e324 | year = 2007 | doi = 10.1371/journal.pmed.0040324 | pmid = 18044980 | pmc = 2082641 }}</ref> Further research is necessary to determine the prevalence of and ways to address this "[[therapeutic misconception]]".<ref name="Henderson-2007"/>

=== Statistical error ===
RCTs are subject to both [[type I and type II errors|type I ("false positive") and type II ("false negative") statistical errors]].  Regarding Type I errors, a typical RCT will use 0.05 (i.e., 1 in 20) as the probability that the RCT will falsely find two equally effective treatments significantly different.<ref name="Wittes-2002">{{Cite journal | author = Wittes J | title = Sample size calculations for randomized controlled trials | journal = [[Epidemiol Rev]] | volume = 24 | issue = 1 | pages = 39–53 | year = 2002 | doi = 10.1093/epirev/24.1.39 | pmid = 12119854 }}</ref> Regarding Type II errors, despite the publication of a 1978 paper noting that the [[sample size]]s of many "negative" RCTs were too small to make definitive conclusions about the negative results<ref name="Freiman-1978">{{Cite journal | doi = 10.1056/NEJM197809282991304 | author = Freiman JA, Chalmers TC, Smith H Jr, Kuebler RR | title = The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 "negative" trials | journal = [[N Engl J Med]] | volume = 299 | issue = 13 | pages = 690–4 | year = 1978 | url = http://content.nejm.org/cgi/content/abstract/299/13/690 | pmid = 355881 }}</ref>, by 2005-2006 a sizeable proportion of RCTs still had inaccurate or incompletely-reported sample size calculations<ref name="Charles-2009">{{Cite journal | author = Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P | title = Reporting of sample size calculation in randomised controlled trials: review | journal = [[Br Med J]] | volume = 338 | issue = | pages = b1732 | date = 2009-05-12 | doi = 10.1136/bmj.b1732 | pmid = 19435763 | pmc = 2680945 }}</ref>.

=== Cultural effects ===
The RCT method creates cultural effects that have not been well understood.<ref name="Jain-2010">{{Cite journal | author = Jain SL | title = The mortality effect: counting the dead in the cancer trial | journal = [[Public Culture]] | volume = 21 | issue = 1 | pages = 89–117 | year = 2010 | doi = 10.1215/08992363-2009-017 }}</ref> For example, patients with terminal illness may attempt to join trials as a last ditch attempt at treatment, even when treatments are unlikely to be successful.

==RCTs in criminology, education, and international development==
===Criminology===
A 2005 review found 83 randomized experiments in criminology published in 1982-2004, compared with only 35 published in 1957-1981.<ref name="Farrington-2005">{{cite journal |author= Farrington DP, Welsh BC |year= 2005 |title= Randomized experiments in criminology: What have we learned in the last two decades? |journal=[[Journal of Experimental Criminology]] |volume=1 |issue=1 |pages= 9–38 |doi= 10.1007/s11292-004-6460-0 }}</ref> The authors classified the studies they found into five categories: "policing", "prevention", "corrections", "court", and "community".<ref name="Farrington-2005"/>  Focusing only on offending behavior programs, Hollin (2008) argued that RCTs may be difficult to implement (e.g., if an RCT required "passing sentences that would randomly assign offenders to programmes") and therefore that experiments with [[quasi-experimental design]] are still necessary.<ref>{{cite journal |author=Hollin CR |year= 2008 |title= Evaluating offending behaviour programmes: does only randomization glister? |journal=[[Criminology and Criminal Justice]] |volume=8 |issue=1 |pages= 89–106 |doi= 10.1177/1748895807085871 }}</ref>

===Education===
RCTs have been used in evaluating a number of educational interventions.  For example, a 2009 study randomized 260 elementary school teachers' classrooms to receive or not receive a program of behavioral screening, classroom intervention, and parent training, and then measured the behavioral and academic performance of their students.<ref>{{cite journal |author=Walker HM, Seeley JR, Small J, Severson HH, Graham BA, Feil EG, Serna L, Golly AM, Forness SR |year= 2009 |title=A randomized controlled trial of the First Step to Success early intervention. Demonstration of program efficacy outcomes in a diverse, urban school district |journal=[[Journal of Emotional and Behavioral Disorders]] |volume= 17 |issue=4 |pages=197–212 |doi= 10.1177/1063426609341645 }}</ref> Another 2009 study randomized classrooms for 678 first-grade children to receive a classroom-centered intervention, a parent-centered intervention, or no intervention, and then followed their academic outcomes through age 19.<ref>{{cite journal |author= Bradshaw CP, Zmuda JH, Kellam SG, Ialongo NS |year=2009 |title= Longitudinal impact of two universal preventive interventions in first grade on educational outcomes in high school |journal= [[Journal of Educational Psychology]] |volume=101 |issue=4 |pages=926–937 |doi= 10.1037/a0016586 }}</ref>

===International development===
RCTs are currently being used by a number of international development experts to measure the impact of development interventions worldwide.  [[Development economics|Development economists]] at research organizations including [[Abdul Latif Jameel Poverty Action Lab]]<ref name="Duflo-2006">{{Cite web |author=Duflo E, Glennerster R, Kremer M |url=http://web.archive.org/web/20070119193234/http://www.povertyactionlab.com/papers/Using+Randomization+in+Development+Economics.pdf |title=Using randomization in development economics research: a toolkit |date=2006-12-12 |publisher=[[MIT]] Department of Economics |format=PDF}} Working Paper No. 06-36</ref><ref>{{cite journal |author= Banerjee AV, Cole S, Duflo E, Linden L |year=2007 |title= Remedying education: evidence from two randomized experiments in India |journal=[[Quarterly Journal of Economics]] |volume= 122 |issue= 3 |pages= 1235–1264 |doi= 10.1162/qjec.122.3.1235 }}</ref> and [[Innovations for Poverty Action]]<ref name="Karlan-2010">{{cite journal |author=Karlan D, Zinman J |year=2010 |title=Expanding  credit  access:  using randomized supply decisions to estimate the impacts |journal=[[Review of Financial Studies]] |volume=23 |issue=1 |pages=433–464 |doi=10.1093/rfs/hhp092 }}</ref> have used RCTs to measure the effectiveness of poverty, health, and education programs in the developing world. RCTs can be highly effective in policy evaluation since they allow researchers to isolate the impacts of a specific program from other factors such as other programs offered in the region, general macroeconomic growth, short-term events (such as a favorable harvest), and differences in personal qualities that might make one individual more successful than another.

For development economists, the main benefit to using RCTs compared to other research methods is that randomization guards against selection bias, a problem present in many current studies of development policy. In one notable example of a cluster RCT in the field of development economics, Olken (2007) randomized 608 villages in Indonesia in which roads were about to be built into six groups (no audit vs. audit, and no invitations to accountability meetings vs. invitations to accountability meetings vs. invitations to accountability meetings along with anonymous comment forms).<ref name="Olken-2007">{{cite journal |author=Olken BA |year=2007 |title=Monitoring corruption: evidence from a field experiment in Indonesia |journal=[[Journal of Political Economy]] |volume=115 |issue= 2 |pages=200–249 |doi=10.1086/517935 }}</ref> After estimating "missing expenditures" (a measure of [[Political corruption|corruption]]), Olken concluded that government audits were more effective than "increasing grassroots participation in monitoring" in reducing corruption.<ref name="Olken-2007"/>

== See also ==
* [[Drug development]]
* [[Hypothesis testing]]
* [[Impact evaluation]]
* [[Jadad scale]]
* [[Statistical inference]]

== References ==
{{reflist|2}}

== Further reading ==
* Domanski MJ, McKinlay S. Successful randomized trials: a handbook for the 21st century. Philadelphia: Lippincott Williams & Wilkins, 2009. ISBN 978-0-7817-7945-6.
* Jadad AR, Enkin M. Randomized controlled trials: questions, answers, and musings. 2nd ed. Malden, Mass.: Blackwell, 2007. ISBN 978-1-4051-3266-4.
* Matthews JNS. Introduction to randomized controlled clinical trials. 2nd ed. Boca Raton, Fla.: CRC Press, 2006. ISBN 1-58488-624-2.
* Nezu AM, Nezu CM. Evidence-based outcome research: a practical guide to conducting randomized controlled trials for psychosocial interventions. Oxford: Oxford University Press, 2008. ISBN 978-0-19-530463-3.
* Solomon PL, Cavanaugh MM, Draine J.  Randomized controlled trials: design and implementation for community-based psychosocial interventions. New York: Oxford University Press, 2009. ISBN 978-0-19-533319-0.
* Torgerson DJ, Torgerson C. Designing randomised trials in health, education and the social sciences: an introduction. Basingstoke, England, and New York: Palgrave Macmillan, 2008. ISBN 978-0-230-53735-4.

== External links ==
* Bland M. [http://www-users.york.ac.uk/~mb55/guide/randsery.htm Directory of randomisation software and services.] University of York, 2008 March 19. 
* Evans I, Thornton H, Chalmers I. [http://www.jameslindlibrary.org/pdf/testing-treatments.pdf Testing treatments: better research for better health care.] London: Pinter & Martin, 2010. ISBN 978-1-905177-35-6.
* Gelband H. [http://www.fas.org/ota/reports/8310.pdf The impact of randomized clinical trials on health policy and medical practice: background paper.] Washington, DC: U.S. Congress, Office of Technology Assessment, 1983.  (Report OTA-BP-H-22.)
* [http://reflect-statement.org/ REFLECT (Reporting guidElines For randomized controLled trials for livEstoCk and food safeTy) Statement]
* Wathen JK, Cook JD. [http://www.mdanderson.org/education-and-research/departments-programs-and-labs/departments-and-divisions/division-of-quantitative-sciences/research/biostats-utmdabtr-002-06.pdf Power and bias in adaptively randomized clinical trials.] M. D. Anderson Cancer Center, University of Texas, 2006 July 12.

{{Medical research studies}}
{{Experimental design}}
{{Statistics}}

{{DEFAULTSORT:Randomized Controlled Trial}}
[[Category:Clinical research]]
[[Category:Epidemiology]]
[[Category:Evidence-based medicine]]
[[Category:Experimental design]]
[[Category:Pharmaceutical industry]]
[[Category:Pharmacology]]

[[de:Randomisierte, kontrollierte Studie]]
[[es:Prueba controlada aleatoria]]
[[id:Uji acak terkendali]]
[[lt:Eksperimentiniai tyrimai]]
[[nl:Gerandomiseerd onderzoek met controlegroep]]
[[ja:ランダム化比較試験]]
[[sv:Randomized clinical trial]]
[[th:การวิจัยเชิงทดลองแบบสุ่มและมีกลุ่มควบคุม]]
[[zh:随机对照试验]]
[[Category:2Fix]]