Millions of Americans receive high-quality health care in the United States. Our capacity to provide the most sophisticated and effective care is unrivaled, and there is no evidence that any other system achieves better quality. Yet there is abundant evidence that serious and extensive quality problems exist throughout the U.S. health care system, resulting in harm to many Americans. Opportunities for improvement exist in all areas of clinical practice, across the continuum of care.
As a result of overuse, underuse, and misuse of health care services, our society pays a substantial price. The opportunity costs of poor quality include years of life lost or spent with major or minor impairments, pain and suffering, disability costs, and lost productivity. In many areas, especially those involving overuse and misuse of health care services, that improving quality is also likely to lower health care costs.
The Quality of Health Care in America (QHCA) Project, a part of the Institute of Medicine’s Special IOM Initiative on Quality, was established in June 1998 and charged with developing a strategy to produce a significant improvement in quality over the coming decade.
The Committee on the Quality of Health Care in America, chaired by William C.Richardson, Ph.D., was responsible for this 2-year project.
Four advisory groups were established to assist the QHCA Committee in carrying out its charge. To provide a broad base of expertise, these advisory
groups consisted of both committee members and other distinguished leaders within the health care arena. Each advisory group was chaired by a member(s) of the QHCA Committee. One of these four groups, the Technical Advisory Panel on the State of Quality, chaired by Mark Chassin, M.D., was asked to review and synthesize literature on the state of quality in the health care industry. Other members of this panel included: Arnold Epstein, M.D., M.A.; Brent James, M.D.; James P.Logerfo, M.D.; Harold Luft, Ph.D.; R.Heather Palmer, M.B., B.Ch.; Kenneth B.Wells, M.D. This appendix presents the panel’s findings.
In developing its approach to this effort, the State of Quality Panel reviewed an earlier synthesis of the literature on quality that was carried out by investigators at the RAND Corporation (Schuster et al., 1998). This earlier review covered papers that, for the most part, were published between 1993 and mid-1997. To extend that earlier work, the IOM commissioned an updated synthesis from the investigators at RAND. This update covered the literature included in the earlier review with the addition of (1) papers published between July 1997 and August 1998, and (2) selected publications identified by members of the State of Quality Panel. A draft of this commissioned paper was reviewed by the State of Quality Panel at its November 1998 meeting, and subsequently revised in accordance with the panel’s suggestions. The final version, provided at the end of this appendix, was completed in January 1999.
A synthesis of findings from the literature on the quality of health care provides abundant evidence of poor quality. There are examples of exemplary care, but the quality of care is not consistent. Thus, the average American cannot assume that he or she will receive the best care modern medicine has to offer.
There are many examples of overuse, underuse, and misuse of health care services. Overuse refers to the provision of health services for which the potential risks outweigh the potential benefits. Underuse indicates that a health care service for which the potential benefits outweigh the potential risks was not provided. Misuse occurs when otherwise appropriate care is provided, but in a manner that does or could lead to avoidable complications.
Overuse of health care services is common. Examples include the following:
performance of major surgery (e.g., hysterectomy, coronary artery bypass graft) without appropriate reasons;
provision of antibiotics for the common cold and other viral upper respiratory tract infections for which they are ineffective;
insertion of tubes in children’s eardrums in the absence of clinically appropriate indications; and
performance of chiropractic spinal manipulation for certain back conditions for which there is no evidence of benefit.
Lack of insurance is a major contributing factor to underuse. Even with comprehensive insurance coverage, however, much of the population fails to receive recommended preventive services, and many patients do not receive the full range of clinically indicated services for acute and chronic conditions. Examples include the following:
Cardiac care In a study of 3,737 Medicare patients with a diagnosis of heart attack who were eligible for treatment with beta blockers, only 21 percent were found to have received beta blockers within 90 days of discharge. The adjusted mortality rate for patients with treatment was 43 percent below that of patients without treatment (Soumerai et al., 1997).
Pneumococcal vaccine In 1989, the U.S. Preventive Services Task Force recommended that people 65 years and older receive a one-time vaccination for pneumonia, and in 1996, this recommendation was modified to apply to all immunocompetent people aged 65 and older. Yet studies of the proportion of elderly who had been vaccinated produced estimates in the range of only 28 to 36 percent (CDC, 1995; Kottke et al., 1997).
Acute care for pneumonia Two studies of hospitalized patients with pneumonia found serious shortcomings in the proportion of patients receiving appropriate components of care (Kahn et al., 1990; Meehan et al., 1997).
In recent years, increased attention has been focused on misuse. Studies of misuse are particularly challenging because actual or potential adverse events often go undocumented and unreported. But studies of preventable deaths and adverse drug events point to frequent and sometimes serious errors. For example, one study of over 4,000 hospitalized patients found that there were 19 preventable or potential adverse drug events per 1,000 patient days in intensive care units and 10 preventable or potential adverse drug events per 1,000 patient days in general care units (Cullen et al., 1997).
The existing literature does not allow a comprehensive estimate of the burden of harm due to poor quality. The literature on health care quality covers only a portion of the full range of quality concerns. For the most part, published studies focus on individuals who come into contact with the health care system. From a population perspective, the opportunity cost of poor quality must also
include the health benefits lost as a result of limited access due to financial or other barriers and poor patient adherence to therapeutic advice. These opportunity costs include years of life lost or spent with major or minor impairments, pain and suffering, disability costs, and lost productivity.
The literature also does not reveal how frequently the various types of quality problems occur. For example, some kinds of overuse problems may have a greater likelihood of being documented than some types of misuse or underuse problems because the data necessary to document overuse are more likely to reside in administrative datasets or medical records.
From the available literature, it is also not possible to produce estimates of the costs of eliminating certain types of quality problems or the benefits likely to be derived. But there is no doubt that major improvements are possible in many clinical areas and health care settings, across the full continuum of care.
The panel’s work represents a modest effort to review the state of health care quality. Specifically, the literature review was commissioned for this study limited in the following ways:
It focused only on publications in leading peer-reviewed journals. Other sources of information, such as the data and analyses of Medicare Peer Review Organizations (PROs) or analyses using malpractice data, were not included. The Medicare PRO program is a particularly promising source of information on quality because the PROs have been conducting quality review projects involving physicians, hospitals, and health plans for over 10 years.
The review did not focus in depth on specific clinical areas. An intensive review by clinical area would provide a more complete picture of the full spectrum of quality problems and their frequency of occurrence.
The review did not include the many publications based on reports of patient experience or satisfaction.
The review did not include the body of studies reporting the impact of quality improvement activities. Thus it permits only anecdotal observations on the effectiveness of various of attempts to improve quality.
Although the publications included in the review appeared in peer-reviewed journals, the panel made no attempt to assess the scientific rigor of the methodologies employed.
Despite the above limitations, the panel believes that more in-depth reviews would not change its general conclusions that there are many areas in which quality of care can be improved. At the same time, additional research might be helpful for several reasons:
A fuller understanding of quality problems would be useful in identifying specific areas in which those problems are greatest, as well as the most promising opportunities for improvement.
Condition-specific analyses would provide better estimates of the potential benefits foregone as a result of poor quality and the best strategies for improvement.
Additional work focused in particular clinical areas might also be helpful in raising awareness of practitioners and others who are skeptical about the existence of quality problems in their areas of expertise. Condition-specific analyses of quality that employ rigorous and valid measures could help build stronger support for quality improvement initiatives.
Additional reviews of the literature should be conducted to identify factors that contribute to poor quality and effective strategies for improvement. For example, review of the literature on quality substantiates that for certain complex procedures, higher volume leads to better outcomes. But we do not know whether this result is attributable to the greater skill of an experienced surgeon, the greater standardization of processes in high-volume settings, or some other factor. Abundant evidence exists that quality can be improved, and there is much to be learned from the review of various improvement strategies about the roles of patients, clinicians, and systems and the use of various types of incentives.
Additional conceptual work, literature and data analysis, and development of measures are needed to improve capacities for quality-of-care assessment in certain key areas of medicine. An example is quality assessment in the areas of mental health, substance abuse, and neurologic disorders, and quality assessment for special populations, such as the frail elderly, poor children, and ethnic minorities.
Centers for Disease Control and Prevention. 1995. Influenza and Pneurnococcal Vaccination Coverage Levels among Persons Aged>65 Years—United States, January-December 1995. Morbidity and Mortality Weekly Report 46:176–82.
Cullen D.J., et al. 1997. Preventable Adverse Drug Events in Hospitalized Patients: a Comparative Study of Intensive Care and General Care Units. Critical Care Medicine 8:1289–97.
Kahn, K.L., W.H.Rogers, L.V.Rubenstein, et al. 1990. Measuring Quality of Care with Explicit Process Criteria before and after Implementation of the DRG-Based Prospective Payment System. Journal of the American Medical Association 264:1969–73.
Kottke, T.E., L.I.Solberg, ML. Brekke, et al. 1995, Aspirin in the Treatment of Acute Myocardial Infarction in Elderly Medicare Beneficiaries: Patterns of Use and Outcomes. Circulation 92:2841–7.
Meehan, T.P., M.J.Fine, H.M.Krumholz, et al. 1997. Quality of Care, Process and Outcomes in Elderly Patients with Pneumonia. Journal of the American Medical Association 278:2080–4
Schuster, Mark A., Elizabeth A.McGlynn, and Robert H.Brook. 1998. “How Good Is the Quality of Health Care in the United States?” 1998. 76 (4) Milbank Quarterly 517–563.
Soumerai, S.B., T.D.McLaughlin, E.Hertzmark, G.Thibault, and L.Goldman. 1997. Adverse Outcomes of Underuse of Beta-Blockers in Elderly Survivors of Acute Myocardial Infarction. Journal of the American Medical Association 277:115–21.
Mark A.Schuster, M.D., Ph.D.;1 Elizabeth A.McGlynn, Ph.D.;2 Cung B.Pham, B.A.;3 Myles D.Spar, M.D.;4 and Robert H. Brook, M.D., Sc.D.5
Submitted January 1999
Quality of health care is on the national agenda. In September 1996, President Clinton established the Advisory Commission on Consumer Protection and Quality in the Health Care Industry, which has released its final report on how to define, measure, and promote quality of health care (Advisory Commission on Consumer Protection and Quality in the Health Care Industry, 1998).
Much of the interest in quality of care has developed in response to the dramatic transformation of the health care system in recent years. New organizational structures and reimbursement strategies have created incentives that may affect quality of care. Although some of the systems are likely to improve quality, concerns about potentially negative consequences have prompted a movement to assure that quality will not be sacrificed to control costs.
The concern about quality arises more from fear and anecdote than from facts; there is little systematic evidence about quality of care in the United States. The nation has no mandatory national system and few local systems to track the quality of care delivered to the American people. More information is available on the quality of airlines, restaurants, cars, and VCRs than on the quality of health care.
In 1997, the National Coalition on Health Care (NCHC) commissioned us to review the academic literature for articles that provide evidence of the quality of care in the United States (Schuster et al., 1998). The Institute of Medicine’s
Technical Advisory Panel on the State of Quality commissioned an update to include studies published between January 1997 and July 1998. In this report, we summarize our findings from both the original study and the update. In the absence of a national quality tracking system, we believe such a summary is the best way to provide an overview of the quality of care delivered in the United States. We provide examples to illustrate quality in diverse settings, for diverse conditions, and for diverse demographic groups, and to offer insight into the quality that exists nationwide.
The Institute of Medicine has defined quality as “the degree to which health services for individuals and populations increase the likelihood of desired health outcomes and are consistent with current professional knowledge” (Lohr, 1990). Good quality means providing patients with appropriate services in a technically competent manner, with good communication, shared decision making, and cultural sensitivity.
Quality can be evaluated based on structure, process, and outcomes (Donabedian, 1980). Structural quality evaluates health system capacities, process quality assesses interactions between clinicians and patients, and outcomes offer evidence about changes in patients’ health status. The best process measures are those for which there is research evidence that better processes lead to better outcomes. For example, controlling blood pressure reduces mortality from stroke and heart disease; performing routine mammography identifies breast cancer at an earlier stage so that a cure is more likely; prescribing inhaled corticosteroids reduces the likelihood and severity of asthma flare-ups. Similarly, the best outcome measures are those which are tied to processes of care, in other words, those over which the health care system has influence. For example, the survival rate for pancreatic cancer would not be a good outcome measure because we do not yet have treatments that meaningfully affect survival. By contrast, pain level in patients with pancreatic cancer is a reasonable outcome measure.
All three dimensions can provide valuable information for measuring quality, but most of the quality-of-care literature focuses on measuring processes of care. Two measurement approaches dominate in the literature: (a) assessing appropriateness of care and (b) adherence to professional standards.
An intervention or service (e.g., a lab test, procedure, medication) is considered appropriate if, for individuals with particular clinical and personal characteristics, its expected health benefits (e.g., increased life expectancy, pain relief, decreased anxiety, improved functional capacity) exceed its expected health risks (e.g., mortality, morbidity, anxiety anticipating the intervention, pain caused by the intervention, inaccurate diagnoses) by a wide enough margin to make the intervention or service worth doing (Brook et al., 1986). A subset of appropriate
care is necessary or crucial care. Care is considered necessary if there is a reasonable chance of a nontrivial benefit to the patient and if it would be improper not to provide the care—in other words, if it might be considered ethically unacceptable not to provide this care (Kahan et al., 1994; Laouri et al., 1997).
Another way to measure process quality is to determine whether care meets or adheres to professional standards. This assessment can be done by creating a list of quality indicators that describe a process of care that should occur for a particular type of patient or clinical circumstance and by evaluating whether patients’ care is consistent with the indicators. Quality indicators are based on standards of care, which are either found in the research literature and in statements of professional medical organizations or determined by an expert panel. Current performance can be compared against a physician’s or a plan’s own prior performance, against the performance of other physicians and plans, or with reference to a benchmark that establishes a goal. Indicators can cover a specific condition (e.g., children with sickle cell disease should be prescribed daily penicillin prophylaxis starting by no later than six months of age, until at least five years of age), or they can cover general aspects of care regardless of condition (e.g., patients prescribed a medication should be asked about medication allergies).
This report draws on two searches of the scientific literature. The original NCHC report was based on a search for quality-of-care articles from the MEDLINE PLUS database (1993 to present) conducted in June 1997 and on relevant studies identified from the bibliographies of these articles. This database incorporates both the National Library of Medicine (NLM)’s MEDLINE database and the Health Planning and Administration’s HEALTH database. The NCHC report excluded articles published before 1987. In conducting our literature search, we did not aim to be exhaustive, but rather to find examples that encompass a broad range of conditions and settings. (The inclusion criteria are described in the next section.)
For this update, we conducted a systematic search of articles published between January 1, 1997, and July 31, 1998, using the NLM’s Medical Subject Headings (MeSH) to search for appropriate articles. This system is designed so that each MeSH term corresponds to a single concept appearing in the biomedical literature. Trained NLM indexers assign relevant MeSH terms to each database entry (usually about 10–12 per entry) (NLM, 1997a). The more than 17,000 MeSH terms are organized in a tree format, with multiple hierarchical layers of subheadings (NLM, 1997b)(Our search terms appear at the end of the report).
We conducted our search on August 24, 1998, and obtained 2,402 entries. Two authors reviewed each entry and its abstract to determine whether the study had potential for inclusion in our summary tables. Based on this initial screening,
we retrieved more than 200 articles. Each was reviewed by two authors to determine whether the article was eligible for inclusion in this report. Some articles identified in the literature search were not available from the library by the completion date of the report.
Because we did not find any studies of misuse in our update search, we conducted a supplemental search using key words such as “adverse,” “event#,” and “preventable” that produced additional relevant articles. In addition, several studies were recommended by members of the Institute of Medicine’s Technical Advisory Panel on the State of Quality.
We include only data from large or diverse U.S. populations—for example, the nation, an entire state, an entire city, or several hospitals. Studies from multiple offices of a single managed care organization are also considered eligible, but we do not include data from studies that cover only a single hospital or clinic. Although such studies are informative and the cumulative weight of their findings compelling, they are especially subject to concerns that they provide evidence of isolated problems rather than insight into the quality of care delivered more broadly.
We include baseline data from quality improvement interventions as well as data for comparison/control/nonintervention groups from such interventions. We report baseline rather than follow-up data because the former are more likely to be representative of the quality of care provided around the country. Quality measurement conducted after a specific intervention shows the potential for interventions to improve quality, but until such interventions are commonplace, these post-intervention results are unlikely to represent what is taking place in most parts of the country. In addition, even the post-intervention results from such studies virtually always show room for further improvement.
We report results only from studies for which we can identify a standard of good quality and exclude those for which there is no standard. For example, some studies show variations in practices that may reflect variations in quality. However, the studies cannot determine which hospital or clinic or group of physicians is providing better or worse quality care.
There are several ways to measure quality of care that are not represented among the studies listed in our summary tables. Although these approaches are valuable components of the quality-of-care toolbox, they have not been used in a way that provides an overview of quality in the United States.
Studies often compare outcomes across multiple institutions to show which have better and which have worse outcomes, but the studies do not always present
a standard against which to compare outcomes. As a consequence, we do not know if the institution with the best outcomes is not nearly as good as it should be, or if the institution with the worst outcomes is nonetheless doing quite well. We only know how they compare with each other. If the outcomes are not risk-adjusted, it can be even more difficult to interpret them. This does not mean that studies cannot use outcomes to shed light on variations in quality. For example, prescription of beta blockers after a heart attack is a frequently used measure of quality. One study found that only about one in five eligible patients with a heart attack received beta blockers within 90 days of hospital discharge and also that those who received the treatment were much less likely to die than those who did not (Soumerai et al., 1997). Another study showed that poorer quality of care for children with asthma was associated with more hospitalizations (Homer et al., 1996).
We found a similar limitation with using satisfaction ratings, which some consider a type of outcome. We do not report on levels of satisfaction because it is difficult to determine what is an acceptable level of satisfaction. There is generally no standard to which to compare the results, and we do not know whether the institution with the best satisfaction ratings could and should be doing much better.
Studies of access to care are not typically classified as quality-of-care studies, but a person who is unable to obtain health care could hardly be said to be receiving good quality care. Access studies are beyond the scope of this report. However, we need to keep in mind that quality-of-care studies often measure quality only for people who have interacted with the health care system and so tend to overstate quality of care received by the population as a whole (Franks et al., 1993a, 1993b; Lurie et al., 1984, 1986; Sorlie et al., 1994).
In general, structural measures have not been consistently shown to relate either to process quality or outcomes, but there are exceptions. For example, volume of care provided (in other words, the number of procedures performed or the number of patients cared for) by an institution or clinician has often been found to relate to quality (Hannan et al., 1989, 1995; Kelly and Hellinger, 1986; Kitahata et al., 1996; Luft et al., 1979; Phibbs et al., 1996; Riley and Lubitz, 1985; Stone et al., 1992).
Another type of study does not provide direct evidence of quality of health care but is useful for identifying reasons for poor quality. Studies in which physicians report what they generally do or what they would do for a particular scenario can be informative, especially when physicians report practices that indicate poor quality. Although these studies do not describe care provided to individual patients, they can indicate a need for further education or other efforts to improve clinical practices.
Finally, we note that our search mechanism almost certainly missed articles with relevant data. Many studies not intended as quality-of-care studies provide
data that shed light on quality of care. Some of these were identified through our search, but it is likely that many others were not.
We divided our review of quality in the United States into three categories: underuse (Table A-1), overuse (Table A-2), and misuse (Table A-3). Underuse indicates that a health care service for which the potential benefits outweigh the potential risks (i.e., necessary care) is not provided. Overuse indicates the reverse—a health care service is provided when the potential risks outweigh the potential benefits (i.e., inappropriate care). Misuse occurs when otherwise appropriate care is provided in a way that leads to or could lead to avoidable complications. Examples of misuse include when an antibiotic appropriate to the patient’s infection is prescribed despite the fact that the patient has a documented allergy to the antibiotic, or when two drugs, each of which is appropriate for a patient’s condition, are prescribed despite contraindications to prescribing them together. An incorrect dose or dosing schedule is also considered misuse.
In each summary table, we list (and sometimes describe) the health care service for which quality is reported, the sample on which the report is based, the data source for the sample, the findings, and the reference. The tables report data from 73 articles.
Perhaps the most striking revelation to emerge from this review is the surprisingly small amount of systematic knowledge available on the quality of health care delivered in the United States. Even though health care is a huge industry that affects the lives of most Americans, we have only snapshots of information about particular conditions, types of surgery, and locations of care.
The dominant finding of our review is that there are large gaps between the care people should receive and the care they do receive. This is true for preventive, acute, and chronic care, whether one goes for a checkup, a sore throat, or diabetic care. It is true whether one looks at overuse, underuse, or misuse. It is true in different types of health care facilities and for different types of health insurance. It is true for all age groups, from children to the elderly. And it is true whether one is looking at the whole country or a single city.
A few examples emphasize this point. An annual influenza vaccine is recommended as a preventive measure for all adults 65 years or older, a group at especially high risk for complications and death from influenza (U.S. Preventive Services Task Force, 1989, 1996). However, in 1993, only 52 percent of people in this age group in the United States received the vaccine; among people who had been to the doctor at least once that year, the percentage was slightly higher at 56 percent (Centers for Disease Control and Prevention, 1995b).
A major issue in acute care is the overuse of antibiotics, which has led to the development of strains of bacteria that are resistant to available antibiotics (Centers for Disease Control and Prevention, 1994a). Antibiotics are almost never an appropriate treatment for people with a common cold because almost all colds are caused by a virus, for which antibiotics are not effective. However, in a study of Medicaid beneficiaries diagnosed with a cold in Kentucky during a one-year period from 1993 to 1994, 60 percent filled a prescription for an antibiotic (Mainous et al., 1996). In a national study of patient visits in 1992, 51 percent of adult patients and 44 percent of patients younger than 18 years old diagnosed with a common cold were treated with antibiotics (Gonzales et al., 1997; Nyquist et al., 1998).
Other types of medications are also not always used in the most appropriate manner. Among hospitalized elderly patients with depression who were discharged on antidepressant medication, 33 percent were on a dose below the recommended level (Wells et al., 1994b). In a study of 634 patients with depression or depressive symptoms in Boston, Chicago, and Los Angeles, 19 percent were treated with minor tranquilizers and no antidepressants (Wells et al., 1994a), despite the lack of evidence that tranquilizers work for depression and the risk that they will cause side effects or addiction (Depression Guideline Panel, 1993).
Patients with chronic conditions, for which certain routine examinations and tests are crucial in order to prevent complications, do not all get the care they need. Diabetes mellitus causes several complications that are less likely to occur with good care. One of these complications is an eye condition called diabetic retinopathy, which is the leading cause of new blindness among persons aged 20 to 74 in the United States. It is recommended that patients with insulin-dependent diabetes mellitus have an annual dilated eye examination (the clinician uses drops to enlarge the pupil to see behind it more easily) starting five years after diagnosis and that patients with non-insulin-dependent diabetes mellitus have the exam annually starting at the time of diagnosis. In a national study in 1989, only 49 percent of adults with either type of diabetes had undergone a dilated eye examination in the past year (66 percent in the past two years), and 61 percent had undergone any type of eye exam in the past year (79 percent in the past two years). Twenty percent of diabetics had no eye exam in the past two years. Among diabetics who were at particularly high risk for vision loss because they already had retinopathy or because they had had diabetes for a long time, 61 percent and 57 percent, respectively, had a dilated examination in the past year (Brechner et al., 1993).
Sometimes surgery is performed on people who do not need it. A study of seven managed care organizations revealed that about 16 percent of hysterectomies performed during a one-year period from 1989 to 1990 were carried out for inappropriate reasons. An additional 25 percent were done for reasons of uncertain clinical benefit (Bernstein et al., 1993b). There are also examples of patients who need surgery but do not receive it. In a study of four hospitals, 43 percent of
patients with a positive exercise stress test demonstrating the need for coronary angiography had received it within 3 months; 56 percent had received it within 12 months (Laouri et al., 1997).
Adverse events are injuries caused by medical management of a disease rather than by the disease itself. A review in New York State in 1984 found that 1.0 percent of hospitalizations had an adverse event due to negligence (Brennan et al., 1991). A study of two Boston hospitals found an adjusted rate of preventable adverse drug events of 1.8 per 100 non-obstetric hospital admissions; 20 percent of these events were life-threatening (Bates et al., 1995).
Not all studies have found such poor quality. In a study of patients from 10 academic medical centers who had cataract surgery, 2 percent had the surgery for inappropriate reasons (Tobacman et al., 1996). In a study of patients in New York State who underwent coronary artery bypass graft surgery, 1.6 percent had surgery for inappropriate reasons (Leape et al., 1996). Nonetheless, the majority of studies described in the tables show much room for improving quality.
Many have been quick to conclude that managed care is responsible for much of the poor quality care found in the U.S. health care system. However, studies published in the research literature neither clearly confirmed nor refuted this conclusion. Some studies find that managed care organizations provide better care than fee-for-service; some find that fee-for-service provides better care; still others find that the care is about the same (Miller and Luft, 1993, 1994). Results vary depending on the setting, the type of care assessed, and the methodology.
Examining how managed care affects quality is complicated by the research approach, which has generally lumped together managed care organizations without distinguishing them by type (e.g., group- and staff-model health maintenance organizations, independent practice associations, preferred provider organizations, point-of-service plans) or by features (e.g., comprehensiveness of the benefits package, nonprofit versus for-profit status). For purposes of examining quality, it would be more useful to assess the effect of specific characteristics of managed care organizations. For example, including immunizations in a benefits package may have a larger impact on immunization rates than whether the care is offered by a managed care organization or a fee-for-service provider.
A final important constraint on examining managed care’s affect on quality is the pace of change in this industry. Indeed, managed care is changing so rapidly (Landon et al., 1998) that most currently available studies are already out of date. We do not have a quality measurement system that enables timely assessment of the rapid changes occurring in the health care marketplace. Even the most widely used systems (e.g., the Health Plan Employer Data and Information Set, described below) are far from universal and do not include both managed care and fee-for-service.
Because the Technical Advisory Panel specifically requested an update on studies published in 1997–1998, we examined these studies as a group. There are several notable findings. First, few of these later studies reported on overuse of care. By contrast, our original review produced many examples of overuse. These early studies were based principally on the UCLA/RAND appropriateness method (Brook, 1994), which was one of the key methods used for quality assessment in the late 1980s and early 1990s. We do not know why the number of appropriateness studies has declined in recent years. Perhaps the many studies published throughout the prior decade convinced researchers that a great deal of inappropriate care is being provided, and they saw no need to make the same point over and over again. Or perhaps researchers now prefer other types of research questions and methodologies.
Most of the recent studies provided examples of underuse. The findings are similar to those in the original review. For most types of care that researchers choose to study, we find that although many people do receive high quality care, many others do not. For example, a national study found that smoking status of adult patients was known by about two-thirds of primary care physicians after seeing their adult patients (Thorndike et al., 1998). Most preventive screening tests in the various studies were performed on more than half of the studied population but far from all. Blood pressure screening was particularly high (88 percent at last visit in one study [Kottke et al., 1997]), and in at least one study, cholesterol screening was high as well (84 percent) (Davis et al., 1998). Papanicolaou tests also appear to be provided to a large percentage of eligible women (Kottke et al., 1997). Quality continues to vary for acute care as well. The vast majority of hospitalized patients with pneumonia had timely oxygenation measurements (89 percent), but a lower percentage received blood cultures before antibiotics (57 percent) (Meehan et al., 1997).
Most of the studies of underuse were in chronic care. Mental health care falls below standards, with 70 percent of schizophrenics in one study receiving poor symptom management, and 79 percent of those experiencing medication side effects receiving poor management of them (Young et al., 1998). Cardiac care was the major area in which quality-of-care studies were conducted over the past decade, and the care patterns documented in the earlier studies continue among the recent ones. Excellent clinical research has shown repeatedly that certain medications should and should not be used for people with myocardial infarctions or unstable angina, yet several quality-of-care studies show that many patients are still not getting proper treatments (e.g., Berger et al., 1998; Krumholz et al., 1998; Simpson et al., 1997; Soumerai et al., 1998). As mentioned above, one study with particularly striking results found that only 21 percent of eligible patients with a heart attack received beta blockers within 90 days of hospital discharge (Soumerai et al., 1997). Although patients with cardiovascular dis-
ease—a subset of the population that unambiguously needs cholesterol testing— had very high rates of cholesterol testing (96 percent), a much lower percentage of these patients received comprehensive treatment when their tests were abnormal (McBride et al., 1998).
In this paper, we have described reports of quality that have appeared in the research literature. There are also some systems that measure quality in select sectors of the United States, most notably the National Committee for Quality Assurance’s (NCQA) Health Plan Employer Data and Information Set (HEDIS). HEDIS is a performance measurement tool designed to help purchasers and consumers evaluate managed care plans and to hold plans accountable for the quality of their services. In 1996, more than 330 plans—over half the U.S. plans representing more than three-quarters of all commercial managed care enrollees—were reporting HEDIS measures on their commercial enrollees. Average adherence rates for select indicators made publicly available by NCQA fell primarily in the 60 to 70 percent range, with the extremes at 38 percent for diabetic eye exams (past year) and 84 percent for initiation of prenatal care in the first trimester (Thompson et al., 1998). Thus, HEDIS’s findings are consistent with those of the studies we have reported. Whether assessing quality as part of a research study or as part of a marketplace tool, the evidence repeatedly shows that quality falls short of standards.
There is good reason to be proud of the U.S. health care system, and evidence from international studies does not show consistent superiority elsewhere in the world (Gray et al., 1990; Pilpel et al., 1992; McGlynn et al., 1994; Froehlich et al., 1997; Meijler et al., 1997; Tamblyn et al., 1997; Wong et al., 1997). The United States is responsible for many important advances in health care technology, and state-of-the-art care is available in both large and small communities throughout the country. However, just because outstanding care is available does not mean that it is always provided or that everyone has access to such care. Most people in the studies reported here did receive excellent care. What is notable is that many did not.
The quality of health care provided in the United States varies among hospitals, cities, and states. Whether the care is preventive, acute, or chronic, it frequently does not meet professional standards. We can do much better. The solution is not simply a matter of spending more money on health care. A large part of our quality problem is the amount of inappropriate care provided in this country. Eliminating such nonbeneficial and potentially harmful care would generate large savings in human and financial costs. However, there are also many examples of
people who receive either too little or technically poor care; fixing these problems may increase expenditures.
Some people might conclude that quality is good enough based on the evidence we have presented in this report—in other words, that the standards used in the various studies are too high. We would disagree with such a conclusion.
Clinicians and health plans that are motivated to improve the quality of care they deliver can use information on quality to focus their improvement efforts. For example, a group of all cardiothoracic surgeons practicing in Maine, New Hampshire, and Vermont, using continuous quality improvement and other techniques to improve their practices, reduced their combined mortality rates by 24 percent (O’Connor et al., 1996). Government action also has the potential to spur improvement. In New York State (NYS), risk-adjusted mortality for coronary artery bypass graft (CABG) surgery decreased 41 percent from 4.17 percent in 1989 (when the NYS Department of Health began disseminating information regarding the outcomes of CABG surgery) to 2.45 percent in 1992 (Hannan et al., 1994). Between 1987 (before the NYS reporting program began) and 1992, unadjusted 30-day mortality rates following CABG declined by 33 percent in NYS Medicare patients, compared with a 19 percent decline nationwide, giving NYS the lowest statewide risk-adjusted CABG mortality rate in the country (Peterson et al., 1998).
If quality-of-care information is made available regularly and in an interpretable form, consumers and large purchasers can use it to make informed decisions when choosing among clinicians and plans, which will, in turn, give providers an added incentive to improve quality. Policy makers can also use information about quality of care to determine the impact of public and private changes in the health care marketplace. We are currently experiencing a dramatic shift in the organization and financing of health services delivery in the United States. The private sector has been the driving force behind this transformation, but the public sector is beginning to use its market power as well. Incentives to move Medicaid and Medicare beneficiaries into managed care represent one of many examples of public sector change.
Although quality assessment organizations, accreditation organizations, and government agencies are currently doing work to measure quality of care, most of this activity has begun during the past decade. The rapid development of the field is encouraging, but it is confined to organizations that cover specific sections of the country or restrict themselves to certain segments of the health care marketplace. Their work, as well as the findings of individual studies such as those listed in Tables A-1 to A-3, provides some evidence of the situation throughout the country.
But changes in the U.S. health care delivery system are occurring more rapidly than evaluations of them can be performed. Much of the information concerning the relation between the organization of the health care system and quality of care is already outdated. At present, the United States has only a
patchwork of systems that measure quality, with little uniformity, breadth, or ability to produce rapid results. Furthermore, these systems do not yet assess most providers of health care in the United States. There is no system that provides a comprehensive assessment of quality of care for the nation—including how quality varies by population subgroups (e.g., gender, age, race/ethnicity, income, region of country, size of community) and how quality is changing over time. Efforts such as HEDIS could eventually lead to development of a comprehensive, national quality assessment system, but such a system may not develop rapidly unless there is an organized effort to ensure that it does.
The United States cannot afford to let this situation continue. A systematic strategy for routine monitoring and reporting on quality, as well as the information systems needed to support such activities, will be essential if we are to preserve the best of the American health care system while striving to improve the efficiency with which high-quality services are provided.
This strategy could be organized by the federal government, the private sector, or a public-private partnership. It could involve coordination among all three. But in any case, the strategy will need to cover the aspects of quality that patients, purchasers, and providers care about; it will need to collect data in a way that is manageable, reasonable, and affordable; and it will need to produce information in a format that is useful for making a variety of decisions.
The United States is capable of implementing a quality measurement system that can provide the multiple participants in the health care system with the information they need to ensure delivery of high-quality care. In light of the changes that the health care system has been experiencing, a strategy to measure and consequently to improve quality is needed now.
Partial funding was provided by the National Coalition on Health Care and the Institute of Medicine. We are indebted to Allison L.Diamant, M.D., M.S.P.H., Mark Chassin, M.D., M.P.P., M.P.H., Janet Corrigan, Ph.D., Molla Donaldson, D.Ph., Rachel Spilka, Ph.D., and Joseph H.Triebwasser, M.D., for comments on drafts of this paper. We are also indebted to James Tebow, Ph.D., Lauren N. Nguyen, M.P.H., Yuko Sano, A.B., Sinaroth Sor, M.D., and Myra Wong, A.B., for document and research assistance.
Advisory Commission on Consumer Protection and Quality in the Health Care Industry. 1998. Quality First: Better Health Care for All Americans. Final Report to the President of the United States. Washington, D.C.
Agency for Health Care Policy and Research. 1994. Acute Low Back Problems in Adults. Clinical Practice Guideline #14.
Agency for Health Care Policy and Research. 1996. Helping Smokers Quit, Guide for Primary Care Clinicians, Number 18, AHCPR Publication Number 96–0693.
American Academy of Pediatrics. 1988. Guidelines for Health Supervision II. Elk Grove Village, Ill.
——. 1994. 1994 Red Book. Report of the Committee on Infectious Diseases. Elk Grove Village, Ill.
American College of Obstetricians and Gynecologists Committee on Obstetric Practice. 1996. Prevention of Early-Onset Group B Streptococcal Disease in Newborns. Washington, D.C.: American College of Obstetricians and Gynecologists.
American College of Obstetricians and Gynecologists. Technical Bulletin Number 170-July 1992. 1993. International Journal of Gynecology and Obstetrics 42:55–9.
Bates, D.W., D.J.Cullen, N.Laird, et al. 1995. Incidence of Adverse Drug Events and Potential Adverse Drug Events. Journal of the American Medical Association 274:29–34.
Berger, A.K., D.W.Edris, J.A.Breall, et al. 1998. Resource Use and Quality of Care for Medicare Patients with Acute Myocardial Infarction in Maryland and the District of Columbia: Analysis of Data from the Cooperative Cardiovascular Project. American Heart Journal 135:349–56.
Bernstein, S.J., L.H.Hilborne, L.L.Leape, et al. 1993a. The Appropriateness of Use of Coronary Angiography in New York State. Journal of the American Medical Association 269:766–9.
Bernstein, S.J., E.A.McGlynn, A.L.Siu, et al. 1993b. The Appropriateness of Hysterectomy: A Comparison of Care in Seven Health Plans. Journal of the American Medical Association 269:2398–402.
Brechner, R.J., C.C.Cowie, L.J.Howie, W.H.Herman, J.C.Will, and M.I.Harris. 1993. Ophthalmic Examination among Adults with Diagnosed Diabetes Mellitus. Journal of the American Medical Association 270:1714–8.
Brennan, T.A., L.L.Leape, N.M.Laird, et al. 1991. Incidence of Adverse Events and Negligence in Hospitalized Patients. New England Journal of Medicine 324:370–6.
Bronstein, J.M., V.A.Johnson, C.A.Fargason, Jr. 1997. Impact of Care Setting on Cost and Quality under Medicaid. Journal of Health Care for the Poor and Underserved 8:202–16.
Brook, R.H., M.R.Chassin, and A.Fink. 1986. A Method for Detailed Assessment of the Appropriateness of Medical Technologies. International Journal Technology Assessment in Health Care 2:53–63.
Brook, R.H. 1994 The RAND/UCLA Appropriateness Method. In: McCormick KA, Moore SR, Siegel RA, eds. Clinical Practice Guideline Development: Methodology Perspectives, AHCPR Pub. No. 95–0009, Rockville, MD: U.S. Public Health Service 59–70.
Carey, T.S., K.Weis, and C.Homer. 1991. Prepaid versus Traditional Medicaid Plans: Lack of Effect on Pregnancy Outcomes and Prenatal Care. Health Services Research 26(2):165–81.
Centers for Disease Control and Prevention. 1993a. Mammography and Clinical Breast Examinations among Women Aged 50 Years and Older-Behavioral Risk Factor Surveillance System, 1992. Morbidity and Mortality Weekly Report 42:737–41.
——. 1993b. Physician and Other Health-Care Professional Counseling of Smokers to Quit— United States, 1991. Morbidity and Mortality Weekly Report 42:854–7.
——. 1993c. State-Specific Changes in Cholesterol Screening-Behavioural Risk Factor Surveillance System, 1988–91. Morbidity and Mortality Weekly Reports 42:663–7.
——. 1994a. Addressing Emerging Infectious Disease Threats: A Prevention Strategy for the United States. Morbidity and Mortality Weekly Report 43(RR-5):1–18.
——. 1994b. Adults Taking Action to Control Their Blood Pressure-United States, 1990. Morbidity and Mortality Weekly Report 43:509–17.
——. 1995a. Recommended Childhood Immunization Schedule-United States, 1995. Morbidity and Mortality Weekly Report 44(RR-5):1–9.
——. 1995b. Influenza and Pneumococcal Vaccination Coverage Levels among Persons Aged> 65 Years—United States, 1973–1993. Morbidity and Mortality Weekly Report 44:506–15.
——. 1996. Trends in Cancer Screening-United States, 1987 and 1992. Morbidity and Mortality Weekly Report 45:57–61.
——. 1997. National, State, and Urban Area Vaccination Coverage Levels among Children Aged 19–35 Months-United States, January-December 1995. Morbidity and Mortality Weekly Report 46:176–82.
Chassin, M.R., J.Kosecoff, R.E.Park, et al. 1987. Does Inappropriate Use Explain Geographic Variations in the Use of Health Care Services? A Study of Three Procedures. Journal of the American Medical Association 258:2533–7.
Cullen, D.J., B.J.Sweitzer, D.W.Bates, E.Burdick, A.Edmondson, L.L.Leape. 1997. Preventable Adverse Drug Events in Hospitalized Patients: A Comparative Study of Intensive Care and General Care Units. Critical Care Medicine. 25:1289–97.
Davis, K.C., M.E.Cogswell, S.Lee, R.Rothenberg, J.P.Koplan. 1998. Lipid Screening in a Managed Care Population. Public Health Services 113:346–50.
Depression Guideline Panel. 1993. Depression in Primary Care. Volume 2: Treatment of Major Depression. Clinical Practice Guideline Number 5. Pub. no. (PHS) 93–0551. Rockville, Md.: U.S. Department of Health and Human Services.
Donabedian, A. 1980. Explorations in Quality Assessment and Monitoring, Volume 1: The Definition of Quality and Approaches to Its Assessment. Ann Arbor, Mich.: Health Administration Press.
Dowell, S.F., and B.Schwartz. 1997. Resistant Pneumococci: Protecting Patients through Judicious Use of Antibiotics. American Family Physician 55:1647–54.
Draper, D., K.L.Kahn, E.J.Reinisch, et al. 1990. Studying the Effects of the DRG-Based Prospective Payment System on Quality of Care. Design, Sampling, and Fieldwork. Journal of the American Medical Association 264:1956–61.
Dubois, R.W., and R.H.Brook. 1988. Preventable Deaths: Who, How Often, and Why? Annals of Internal Medicine 109:582–9.
Ellerbeck, E.F., S.F.Jencks, M.J.Radford, et al. 1995. Quality of Care for Medicare Patients with Acute Myocardial Infarction: A Four-State Pilot Study from the Cooperative Cardiovascular Project. Journal of the American Medical Association 273:1509–14.
Franks, P., C.M.Clancy, M.R.Gold. 1993a. Health Insurance and Mortality: Evidence from a National Cohort. Journal of the American Medical Association 270:737–41.
Franks, P., C.M.Clancy, M.R.Gold, P.A.Nutting. 1993b. Health Insurance and Subjective Health Status: Data from the 1987 National Medical Expenditure Survey. American Journal of Public Health 83:1295–9.
Froehlich, F., I.Pache, B.Bumand, et al. 1997. Underutilization of Upper Gastrointestinal Endoscopy. Gastroenterology 112:690–7.
Gonzales, R., J.F.Steiner, and M.A.Sande. 1997. Antibiotic Prescribing for Adults With Colds, Upper Respiratory Tract Infections, and Bronchitis by Ambulatory Care Physicians. Journal of the American Medical Association 278:901–4.
Gray, D., J.R.Hampton, S.J.Bernstein, J.Kosecoff, and R.H.Brook. 1990. Audit of Coronary Angiography and Bypass Surgery. Lancet 335:1317–20.
Greenfield, S., D.M.Blanco, R.M.Elashoff, and P.A.Ganz. 1987. Patterns of Care Related to Age of Breast Cancer Patients. Journal of the American Medical Association 257:2766–70.
Greenspan, A.M., H.R.Kay, B.C.Berger, R.M.Greenberg, A.J.Greenspon, and M.S.Gaughan. 1988. Incidence of Unwarranted Implantation of Permanent Cardiac Pacemakers in a Large Medical Population. New England Journal of Medicine 318:158–63.
Guadagnoli, E., C.L.Shapiro, J.C.Weeks, et al. 1998. The Quality of Care for Treatment of Early Stage Breast Carcinoma: Is It Consistent with National Guidelines? Cancer 83:302–9.
Hand, R., S.Sener, J.Imperato, et al. 1991. Hospital Variables Associated With Quality of Care for Breast Cancer Patients. Journal of the American Medical Association 266:3429–32.
Hannan, E.L.H.Kilburn, M.Racz, E.Shields, and M.R.Chassin. 1994. Improving the Outcomes of Coronary Artery Bypass Surgery in New York State. Journal of the American Medical Association 271:761–6.
Hannan, E.L., J.F.O’Donnell, H.Kilburn, Jr., H.R.Bernard, A.Yazici. 1989. Investigation of the Relationship between Volume and Mortality for Surgical Procedures Performed in New York State Hospitals. Journal of the American Medical Association 262:503–10.
Hannan, E.L., A.L.Siu, D.Kumar, H.Kilburn, Jr., M.R.Chassin. 1995. The Decline in Coronary Artery Bypass Graft Surgery Mortality in New York State: The Role of Surgeon Volume. Journal of the American Medical Association 273:209–13.
Hilborne, L.H., L.L.Leape, S.J.Bernstein, et al. 1993. The Appropriateness of Use of Percutaneous Transluminal Coronary Angioplasty in New York State. Journal of the American Medical Association. 269:761–5.
Hillner, B.E., M.K.McDonald, L.Penberthy, et al. 1997. Measuring Standards of Care for Early Breast Cancer in an Insured Population. Journal of Clinical Oncology 15:1401–8.
Homer, C.J., P.Szilagyi, L.Rodewald, et al. 1996. Does Quality of Care Affect Rates of Hospitalization for Childhood Asthma? Pediatrics 98:18–23.
Joint National Committee on Detection, Evaluation, and Treatment of High Blood Pressure. 1993. The Fifth Report of the Joint National Committee on Detection, Evaluation, and Treatment of High Blood Pressure (JNC V). Archives of Internal Medicine 153:154–83.
Kahan, J.P., S.J.Bernstein, L.L.Leape, et al. 1994. Measuring the Necessity of Medical Procedures. Medical Care 32:357–65.
Kahn, K.L., W.H.Rogers, L.V.Rubenstein, et al. 1990. Measuring Quality of Care with Explicit Process Criteria before and after Implementation of the DRG-Based Prospective Payment System. Journal of the American Medical Association 264:1969–73.
Kelly, J.V., F.J.Hellinger. 1986. Physician and Hospital Factors Associated with Mortality of Surgical Patients. Medical Care 24:785–800.
Kitahata, M.M., T.D.Koepsell, R.A.Deyo, C.L.Maxwell, W.T.Dodge, and E.H.Wagner. 1996. Physicians’ Experience with the Acquired Immunodeficiency Syndrome as a Factor in Patients’ Survival. New England Journal of Medicine 334:701–6.
Kleinman, L.C., J.Kosecoff, R.W.Dubois, and R.H.Brook. 1994. The Medical Appropriateness of Tympanostomy Tubes Proposed for Children Younger than 16 Years in the United States. Journal of the American Medical Association 271:1250–5.
Klinkman, M.S., D.W.Gorenflo, and T.S.Ritsema. 1997. The Effects of Insurance Coverage on the Quality of Prenatal Care. Archives of Family Medicine 6:557–66.
Kogan, M.D., G.R.Alexander, M.Kotelchuck, D.A.Nagey, and B.W.Jack. 1994. Comparing Mothers’ Reports on the Content of Prenatal Care Received with Recommended National Guidelines for Care. Public Health Reports 109:637–46.
Kottke, T.E., L.I.Solberg, M.L.Brekke, et al. 1997. Delivery Rates for Preventive Services in 44 Midwestern Clinics. Mayo Clinic Proceedings 72:515–23.
Krumholz, H.M., M.J.Radford, E.F.Ellerbeck, et al. 1995. Aspirin in the Treatment of Acute Myocardial Infarction in Elderly Medicare Beneficiaries: Patterns of Use and Outcomes. Circulation 92:2841–7.
——. 1996. Aspirin for Secondary Prevention after Acute Myocardial Infarction in the Elderly: Prescribed Use and Outcomes. Annals of Internal Medicine 124:292–8.
Krumholz, H.M., D.M.Philbin, Y.Wang, et al. 1998. Trends in the Quality of Care with Medicare Beneficiaries Admitted to the Hospital with Unstable Angina. Journal of the American College of Cardiology 31:957–63.
Landon, B.E., I.E.Wilson, and P.D.Cleary. 1998. A Conceptual Model of the Effects of Health Care Organizations on the Quality of Medical Care. Journal of the American Medical Association 279:1377–82.
Laouri, M., R.L.Kravitz, S.J.Bernstein, et al. 1997. Underuse of Coronary Angiography: Application of a Clinical Method. International Journal for Quality in Health Care 9:5–22.
Lazovich D., E.White, D.B.Thomas, R.E.Moe. 1991. Underutilization of Breast-Conserving Surgery and Radiation Therapy Among Women With Stage I or II Breast Cancer. Journal of the American Medical Association 266:3433–8.
Leape, L.L., T.A.Brennan, N.Laird, et al., 1991. The Nature of Adverse Events in Hospitalized Patients: Results of the Harvard Medical Practice Study II. New England Journal of Medicine 324:377–84.
Leape, L.L., L.H.Hilbome, R.E.Park, et al. 1993. The Appropriateness of Use of Coronary Artery Bypass Graft Surgery in New York State. Journal of the American Medical Association 269:753–60.
Leape, L.L., L.L.Hilbome, J.S.Schwartz, et al. 1996. The Appropriateness of Coronary Artery Bypass Graft Surgery in Academic Medical Centers. Annals of Internal Medicine 125:8–18.
Legorreta. A.P., J.Christian-Herman, R.D.O’Connor, et al. 1998. Compliance with National Asthma Management Guidelines and Specialty Care: A Health Maintenance Organization Experience. Archives of Internal Medicine 158:457–64.
Lieu, T.A., J.C.Mohle-Boetani, G.T.Ray, L.M.Ackerson, D.L.Walton. 1998. Neonatal Group B Streptococcal Infection in a Managed Care Population. Obstetrics and Gynecology 92:21–7.
Liu, Z., K.L.Shilkret, L.Finelli. 1998. Initial Drug Regimens for the Treatment of Tuberculosis: Evaluation of Physician Prescribing Practices in New Jersey. Chest 113:1446–51.
Lohr, K.N. Ed. 1990. Medicare: A Strategy for Quality Assurance. Washington D.C.: National Academy Press.
Luft, H.S., J.P.Bunker, A.C.Enthoven. 1979. Should Operations Be Regionalized? The Empirical Relation between Surgical Volume and Mortality. New England Journal of Medicine 301:1364– 9.
Lurie, N., N.B.Ward, M.F.Shapiro, R.H.Brook. 1984. Termination of Medical Benefits: Does it Affect Health? New England Journal of Medicine 311:480–4.
Lurie, N., N.B.Ward, M.F.Shapiro, et al. 1986. Termination of Medical Benefits: A Follow-Up Study One Year Later. New England Journal of Medicine 314:1266–8.
Mainous, A.G., W.J.-Hueston, and J.R.Clark. 1996. Antibiotics and Upper Respiratory Infection: Do Some Folks Think There Is a Cure for the Common Cold? Journal of Family Practice 42:357–61.
McBride, P.M., H.G.Schrott, M.B.Plane, G.Underbakke, R.L.Brown. 1998. Primary Care Practice Adherence to National Cholesterol Education Program Guidelines for Patients with Coronary Heart Disease. Archives of Internal Medicine 158:1238–44.
McCaig, L.F., and J.M.Hughes. 1995. Trends in Antimicrobial Drug Prescribing among Office-Based Physicians in the United States. Journal of the American Medical Association 273:214– 9.
McGlynn, E.A., C.D.Naylor, G.M.Anderson, et al. 1994. Comparison of the Appropriateness of Coronary Angiography and Coronary Artery Bypass Surgery between Canada and New York State. Journal of the American Medical Association 272:934–40.
Meehan, T.P., J.Hennen, M.J.Radford, M.K.Petrillo, P.Elstein, and D.J.Ballard. 1995. Process and Outcome of Care for Acute Myocardial Infarction among Medicare Beneficiaries in Connecticut: A Quality Improvement Demonstration Project. Annals of Internal Medicine 122:928–36.
Meehan, T.P., M.J.Fine, H.M.Krumholz, et al. 1997. Quality of Care, Process and Outcomes in Elderly Patients with Pneumonia. Journal of the American Medical Association 278:2080–4
Meijler, A.P., H.Rigter, S.J.Bernstein, et al. 1997. The Appropriateness of Intention to Treat Decisions for Invasive Therapy in Coronary Artery Disease in the Netherlands. Heart 77:219–24.
Miller, R.H., and H.S.Luft. 1993. Managed Care: Past Evidence and Potential Trends. Frontiers of Health Services Management 9:3–37.
——. 1994. Managed Care Plan Performance since 1980: A Literature Analysis. Journal of the American Medical Association 271:1512–9.
Murata, P.J., E.A.McGlynn, A.L.Siu, et al. 1994. Quality Measures for Prenatal Care: A Comparison of Care in Six Health Care Plans. Archives of Family Medicine 3:41–9.
NIH Consensus Conference Treatment of Early-Stage Breast Cancer. 1991. Journal of the American Medical Association 265:391–5.
National Library of Medicine. 1997a. Medical subject headings, Annotated Alphabetic List, 1998. Bethesda, Md.: U.S. Dept. of Health and Human Services, Public Health Service, National Institutes of Health, National Library of Medicine; Washington, D.C.
——. 1997b. Medical Subject Headings, Tree Structures, 1998. Bethesda, Md.: U.S. Dept. of Health and Human Services, Public Health Service, National Institutes of Health, National Library of Medicine; Washington, D.C.
Nyquist, A., R.Gonzales, J.F.Steiner, and M.A.Sande. 1998. Antibiotic Prescribing for Children With Colds, Upper Respiratory Tract Infections, and Bronchitis. Journal of the American Medical Association 279:875–7.
O’Connor, G.T., S.K.Plume, E.M.Olmstead, et al. 1996. A Regional Intervention to Improve the Hospital Mortality Associated With Coronary Artery Bypass Graft Surgery. Journal of the American Medical Association 275:841–6.
Payne, S.M., C.Donahue, P.Rappo, et al. 1995. Variations in Pediatric Pneumonia and Bronchitis/ Asthma Admission Rates. Is Appropriateness a Factor? Archives of Pediatrics and Adolescent Medicine 149:162–9.
Peterson, E.D., E.R.DeLong, J.G.Jollis, L.H.Muhlbaier, and D.B.Mark. 1998. The Effects of New York’s Bypass Surgery Provider Profiling on Access to Care and Patient Outcomes in the Elderly. Journal of the American College of Cardiology 32:993–9.
Phibbs, C.S., J.M.Bronstein, E.Buxton, and R.H.Phibbs. 1996. The Effects of Patient Volume and Level of Care at the Hospital of Birth on Neonatal Mortality. Journal of the American Medical Association 276:1054–9.
Pilpel, D., G.M.Fraser, J.Kosecoff, S.Weitzman, and R.H.Brook. 1992. Regional Differences in Appropriateness of Cholecystectomy in a Prepaid Health Insurance System. Public Health Review 20:61–74.
Retchin, S.M., and J.Preston. 1991. Effects of Cost Containment on the Care of Elderly Diabetics. Archives of Internal Medicine 151:2244–8.
Regier, D.A., W.E.Narrow, D.S.Rae, R.W.Maderscheid, B.Z.Locke, and F.K.Goodwin. 1993. The de facto US Mental and Addictive Disorders Service System . Archives of General Psychiatry 50:85–94.
Riley, G., J.Lubitz. 1985. Outcomes of Surgery among the Medicare Aged: Surgical Volume and Mortality. Health Care Financing Review 7:37–47.
Schucker, B., J.T.Wittes, N.C.Santanello, et al. 1991. Change in Cholesterol Awareness and Action. Archives of Internal Medicine 151:666–73.
Schuster, M.A., E.A.McGlynn, R.H.Brook. 1998. How Good Is the Quality of Health Care in the United States? Milbank Quarterly 76:517–63.
Shekelle, P.G., I.Coulter, E.L.Hurwitz, et al. 1998. Congruence Between Decisions to Initiate Chiropractic Spinal Manipulation for Low Back Pain and Appropriateness Criteria in North America. Annals of Internal Medicine 129:9–17.
Simon, G.E., and M.VonKorff. 1995. Recognition, Management, and Outcomes of Depression in Primary Care. Archives of Family Medicine 4:99–105.
Simpson, R.J. Jr., R.R.Weiser. S.Naylor, C.A.Sueta, A.K.Metts. 1997. Improving Care for Unstable Angina Patients in a Multiple Hospital Project Sponsored by a Federally Designated Quality Improvement Organization. American Journal of Cardiology. 80(8B):80H–4H.
Sorlie, P.D., N.J.Johnson, E.Backlund, D.D.Bradham. 1994. Mortality in the Uninsured Compared with that in Persons with Public and Private Insurance. Archives of Internal Medicine 154:2409– 16.
Soumerai, S.B., T.D.McLaughlin, E.Hertzmark, G.Thibault, and L.Goldman. 1997. Adverse Outcomes of Underuse of Beta-Blockers in Elderly Survivors of Acute Myocardial Infarction. Journal of the American Medical Association 277:115–21.
Soumerai, S.B., T.J.McLauglin, J.H.Gurwitz, et al. 1998. Effect of Local Medical Opinion Leaders on Quality of Care for Acute Myocardial Infarction: A Randomized Controlled Trial. Journal of the American Medical Association 279:1358–63.
Starfield, B., N.R.Powe, J.R.Weiner, et al. 1994. Costs vs Quality in Different Types of Primary Care Settings. Journal of the American Medical Association 272:1903–8.
Stone, V., G.Seage, T.Hertz, and A.Epstein. 1992. The Relation between Hospital Experience and Mortality for Patients with AIDS . Journal of the American Medical Association 268:2655–61.
Stoner, T.J., B.Dowd, W.P.Carr, G.Maldonado, T.R.Church, J.Mandel. 1998. Do Vouchers Improve Breast Cancer Screening Rates? Results from a Randomized Trial. Health Services Research. 33:11–28.
Summary of the Second Report of the National Cholesterol Education Program Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel II). 1993. Journal of the American Medical Association 626:3015–23.
Tamblyn, R., L.Berkson, W.D.Dauphinee, et al. 1997. Unnecessary Prescribing of NSAIDs and the Management of NSAID-Related Gastropathy in Medical Practice. Annals of Internal Medicine 127:429–38.
Thamer, M., N.F.Ray, S.C.Henderson, et al. 1998. Influence of the NIH Consensus Conference on Helicobacter Pylori on Physician Prescribing Among a Medicaid Population. Medical Care 36:646–60.
Thompson, J.W., J.Bost, F.Ahmed, C.E.Ingalls and C.Sennett. 1998. The NCQA’s Quality Compass: Evaluating Managed Care in the United States. Health Affairs 17:152–8.
Thorndike, AX, N.A.Rigotti, R.S.Stafford, and D.E.Singer. 1998. National Patterns in the Treatment of Smokers by Physicians. Journal of the American Medical Association 279:604–8.
Tobacman, J.K., P.Lee, B.Zimmerman, H.Kolder, L.Hilborne, and R.H.Brook. 1996. Assessment of Appropriateness of Cataract Surgery at Ten Academic Medical Centers in 1990. Ophthalmology 103:207–15.
Udvarhelyi, I.S., K.Jennison, R.S.Phillips, and A.M.Epstein. 1991. Comparison of the Quality of Ambulatory Care for Fee-for-Service and Prepaid Patients. Annals of Internal Medicine 115:394–400.
U.S. Preventive Services Task Force. 1989. Guide to Clinical Preventive Services. Baltimore: William & Wilkins.
——. 1996. Guide to Clinical Preventive Services. Baltimore: William & Wilkins.
Weiner, J.P., S.T.Parente, D.W.Garnick, J.Fowles, A.G.Lawthers, and H.Palmer. 1995. Variation in Office-Based Quality: A Claims-Based Profile of Care Provided to Medicare Patients with Diabetes. Journal of the American Medical Association 273:1503–8.
Wells, K.B., R.D.Hays, M.A.Burnam, et al. 1989. Detection of Depressive Disorder for Patients Receiving Prepaid or Fee-for-Service Care: Results from the Medical Outcomes Study. Journal of the American Medical Association 262:3298–302.
Wells, K., W.Katon, B.Rogers, and P.Camp. 1994a. Use of Minor Tranquilizers and Antidepressant Medications by Depressed Outpatients: Results from the Medical Outcomes Study. American Journal of Psychiatry 151:694–700.
Wells, K.B., G.Norquist, B.Benjamin, W.Rogers, K.Kahn, and R.Brook. 1994b. Quality of Antidepressant Medications Prescribed at Discharge to Depressed Elderly Patients in General Medical Hospitals before and after Prospective Payment System. General Hospital Psychiatry 16:4–15.
Wells, K.B., W.H.Rogers, L.M.Davis, et al. 1993. Quality of Care for Hospitalized Depressed Elderly Patients before and after Implementation of the Medicare Prospective Payment System. American Journal of Psychiatry 150:1799–805.
Winslow, C.M., J.B.Kosecoff, M.Chassin, D.E.Kanouse, and R.H.Brook. 1988. The Appropriateness of Performing Coronary Artery Bypass Surgery. Journal of the American Medical Association 260:505–9.
Wong, J.H., J.M.Findlay, and M.E.Suarez-Almazor. 1997. Regional Performance of Carotid Endarterectomy: Appropriateness, Outcomes, and Risk Factors for Complications. Stroke 28:891–8.
Young, A.S., G.Sullivan, M.A.Bumam, R.H.Brook. 1998. Measuring the Quality of Outpatient Treatment for Schizophrenia. Archives of General Psychiatry 55:611–7.
TABLE A-1 Examples of Quality of Health Care in the United States—Underuse: Did Patients Receive the Care They Should Have Received?
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
PREVENTIVE CARE |
||||
|
Immunizations |
||||
|
Childhood Vaccines |
||||
|
Three Polio; four Diphtheria, Tetanus, Pertussis; one Measles, Mumps, Rubella; and three Haemophilus influenzae type b (Hib) by 18 months old. (Three to four doses of Hib are recommended, depending on formulation; three Hepatitis B virus vaccines [HBV] are also recommended but were not included in this particular study.) (American Academy of Pediatrics [AAP], 1994; Centers for Disease Control and Prevention [CDC], 1995a). |
Children 19–35 months old in 31,997 households from a nationally representative sample of the United States (U.S.). |
National Immunization Survey (NIS), 1995. |
74% received all the vaccines. (If three doses of Hib are not included, the percentage is 76%.) |
CDC, 1997 |
|
Influenza Vaccine |
||||
|
Annual vaccination of all people≥65 years old is recommended (U.S. Preventive Services Task Force [USPSTF], 1989). This recommendation has since been reiterated (USPSTF, 1996). |
Approximately 8,000 adults ≥65 years old from a sample of people representative of the U.S. civilian, noninstitutionalized population. |
National Health Interview Survey (NHIS), 1993. |
52% received annual influenza vaccine. |
CDC, 1995b |
|
Same as above. |
From a sample of 7,997 randomly selected patients ≥20 years old who had visited a clinic during the |
Mailed surveys with phone follow-up of patients who visited one of 44 clinics from August 1, to |
72% of people≥65 years had an influenza vaccine in the prior year. |
Kottke et al., 1997 |
|
|
study period, 6,830 (85%) completed surveys. |
September 9, 1994, in the Minneapolis-St. Paul metropolitan area with contracts with one of two managed care companies. |
|
|
|
Pneumococcal Vaccine |
||||
|
One-time vaccination for all people≥65 years old is recommended (USPSTF, 1989). In 1996, the recommendation was modified to specify one-time vaccination for all immunocompetent individuals≥65 years old (USPSTF, 1996). |
Approximately 8,000 adults ≥65 years old from a sample of people representative of the U.S. civilian, noninstitutionalized population. |
NHIS, 1993 |
28% received pneumococcal vaccine. |
CDC, 1995b |
|
Same as above. |
From a sample of 7,997 randomly selected patients ≥20 years old who had visited a clinic during the study period, 6,830 (85%) completed surveys. |
Mailed surveys with phone follow-up of patients who visited one of 44 clinics from August 1, to September 9, 1994, in the Minneapolis-St. Paul metropolitan area with contracts with one of two managed care companies. |
36% of people≥65 years old had ever had a pneumococcal vaccine. |
Kottke et al., 1997 |
|
Cancer Screening |
||||
|
Breast Cancer Screening |
||||
|
Recommendations vary. In 1989, the USPSTF recommended an annual clinical breast exam (CBE) for women≥40 years old and mammography every 1–2 years for women 50–75 years old (USPSTF, 1989). |
21,601 women≥50 years old from a sample of people representative of the U.S. population (excluding Arkansas and Wyoming, |
Behavioral Risk Factor Surveillance System, 1992. |
58% had clinical breast exam in the prior year; 46% had mammography in the prior year; 40% had both examinations in the |
CDC, 1993a |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
In 1996, it recommended mammography every 1–2 years with or without annual clinical breast exam for women 50–69 years old (USPSTF, 1996). |
and including the District of Columbia). |
|
prior year. |
|
|
Same as above. |
From a sample of 7,997 randomly selected patients ≥20 years old who had visited a clinic during the study period, 6,830 (85%) completed surveys. |
Mailed surveys with phone follow-up of patients who visited one of 44 clinics from August 1, to September 9, 1994, in the Minneapolis-St. Paul metropolitan area with contracts with one of two managed care companies. |
72% of women≥50 years old had a breast examination in the prior two years; 68% of women 50 years or older had a mammogram in the prior two years. |
Kottke et al., 1997 |
|
Same as above. |
221 women>50 years old. |
Interview survey of women in farm households randomly sampled from six southern Minnesota counties, 1992. |
38% of women had not received a mammogram in the prior 18 months. |
Stoner et al., 1998 |
|
Cervical Cancer Screening |
||||
|
Women with an intact uterus (having a cervix) should have a Papanicolaou (Pap) smear after initiation of sexual intercourse and every 1–3 years thereafter. Some organizations recommend starting Pap smears for all women who have reached 18 years old, regardless of sexual history (USPSTF, 1989). These recommendations |
Women≥18 years old with an intact uterus from a sample of 128,412 people representative of the U.S. civilian, noninstitutionalized population. |
NHIS, 1992. |
67% had a Pap smear in the prior 3 years. |
CDC, 1996 |
|
have since been reiterated (USPSTF, 1996). |
|
|||
|
Same as above. |
From a sample of 7,997 randomly selected patients ≥20 years old who had visited a clinic during the study period, 6,830 (85%) completed surveys. |
Mailed surveys with phone follow-up of patients who visited one of 44 clinics from August 1, to September 9, 1994, in the Minneapolis-St. Paul metropolitan area with contracts with one of two managed care companies. |
84% of women had a Pap smear in the prior two years. |
Kottke et al., 1997 |
|
Colon Cancer Screening |
||||
|
Recommendations vary. In 1980, the American Cancer Society recommended annual fecal occult blood testing (FOBT) starting at 50 years old. Some other organizations made similar recommendations. In 1989, the USPSTF did not make recommendations (USPSTF, 1989), but in 1996, it recommended annual FOBT, sigmoidoscopy (periodicity unspecified), or both starting at 50 years old (USPSTF, 1996). |
Adults≥40 years old from a sample of 128,412 people representative of the U.S. civilian, noninstitutionalized population. |
NHIS, 1992 |
14% of men and 15% of women had FOBT in the prior year; 44% of men and 43% of women had ever had FOBT; 11% of men and 7% of women had proctosigmoidoscopy in the prior 3 years. |
CDC, 1996 |
|
Same as above. |
250 women 40–65 years old who had no major illnesses, who received primary care at one of the group practices, and who were eligible for preventive care. |
Medical records for patients from four group practices in Massachusetts, November 1, 1985, to October 31, 1987. |
51%–59% of women had FOBT every 2 years or flexible sigmoidoscopy every 5 years. |
Udvarhelyi et al., 1991 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Cardiac Risk Factors |
||||
|
Smoking Counseling |
||||
|
The USPSTF recommends a complete history of tobacco use as well as tobacco cessation counseling on a regular basis (USPSTF, 1989, 1996). The Agency for Health Care Policy and Research (AHCPR) recommends that primary care physicians identify patients’ smoking status and counsel smokers at every visit (AHCPR, 1996). |
8,778 smokers≥18 years old from a sample of 43,732 people representative of the U.S. civilian, noninstitutionalized population. |
NHIS, 1991. |
37% of smokers who had a visit with a physician or other health care professional during the prior year had been advised to quit smoking. |
CDC, 1993b |
|
Same as above. |
From a sample of 7,997 randomly selected patients ≥20 years old who had visited a clinic during the study period, 6,830 (85%) completed surveys. |
Mailed surveys with phone follow-up of patients who visited one of 44 clinics from August 1, to September 9, 1994, in the Minneapolis-St. Paul metropolitan area with contracts with one of two managed care companies. |
53% of smokers were asked their smoking status. 47% of smokers were advised to quit. |
Kottke et al., 1997 |
|
Same as above. |
A nationally representative sample of 3,254 physicians representing 145,716 adult patient ambulatory care visits. |
National Ambulatory Medical Care Survey (NAMCS), 1991–1995. |
Physicians knew the patient’s smoking status at 66% of all patient visits. (The percentage for primary care physicians ranged from about 61% to |
Thorndike et al., 1998 |
|
|
67%, depending on the year.) Smoking counseling was provided at 22% of visits of known smokers. (The percentage for primary care physicians ranged from 20% to 38%.) |
|
||
|
Blood Cholesterol Screening |
||||
|
In 1988, the National Heart, Lung, and Blood Institute recommended routine cholesterol screening at least every 5 years starting at 20 years old. In 1989, the USPSTF recommended periodic screening for middle-aged men (USPSTF, 1989), and in 1996, it recommended periodic screening for men 35–65 years old and women 45–65 years old. Treatment includes dietary therapy, physical activity, or lipid-lowering medications depending on the patient (National Cholesterol Education Program [NCEP], 1993). |
3,700 adults≥18 years old from a representative sample of the non-African American U.S. population. |
Telephone survey by the National Heart, Lung, and Blood Institute, 1990. |
65% of adults had ever had a blood cholesterol test; 51% had the test in the prior year; and an additional 14% had it prior to that. 35% had never had a blood cholesterol test. |
Schucker et al., 1991 |
|
Same as above. |
Adults≥20 years old from a sample of people representative of the U.S. population (excluding Wyoming, Kansas, and |
CDC’s Behavioral Risk Factor Surveillance System, 1991. |
The state-specific rates of adults who had cholesterol screening in the prior 5 years ranged from 57% to 70%. |
CDC, 1993c |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
Nevada, and including the District of Columbia) (sample sizes for individual states range from 670 to 3,190 people). |
|
||
|
Same as above. |
From a sample of 7,997 randomly selected patients ≥20 years old who had visited a clinic during the study period, 6,830 (85%) completed surveys. |
Mailed surveys with phone follow-up of patients who visited one of 44 clinics from August 1, to September 9, 1994, in the Minneapolis-St. Paul metropolitan area with contracts with one of two managed care companies. |
68% had had their cholesterol measured during the prior 5 years. |
Kottke et al., 1997 |
|
Blood Cholesterol Screening and Treatment |
||||
|
Same as above. |
1,004 people 40–64 years old from a sample that had been enrolled continuously for at least 5 years and had at least one outpatient visit during the study period. |
Medical records from three sites of a managed care plan (South Florida; Jacksonville, Florida; and Atlanta, Georgia), January 1, 1988, to December 31, 1993. |
84% were screened for elevated cholesterol levels at least once during the 6-year period. 86% with a diagnosis of hypercholesterolemia were treated with diet therapy, cholesterol-lowering drugs, or both. |
Davis et al., 1998 |
|
Blood Pressure Screening |
||||
|
In 1989, the USPSTF recommended blood pressure measurements for normotensive patients≥21 years old every 2 years if their last diastolic and systolic blood pressures were below 85 mm Hg and 140 mm Hg, respectively, and annually if their last diastolic was 85–89 mm Hg (USPSTF, 1989). In 1996, these recommendations were modified to specify apparently normotensive patients (USPSTF, 1996). |
From a sample of 7,997 randomly selected patients ≥20 years old who had visited a clinic during the study period, 6,830 (85%) completed surveys. |
Mailed surveys with phone follow-up of patients who visited one of 44 clinics from August 1, to September 9, 1994, in the Minneapolis-St. Paul metropolitan area with contracts with one of two managed care companies. |
88% had blood pressure measured at the most recent visit. |
Kottke et al., 1997 |
|
General Preventive Care |
||||
|
Well-Child Care |
||||
|
The AAP recommends routine history, physical examination, screening tests, and anticipatory guidance throughout childhood (AAP, 1988). |
All children who had their second birthday during the first half of the study year, and all 2-year-olds with otitis media or asthma, from a sample of 2,024 patients of 135 providers. |
Medical records from physicians’ offices, community health centers, and hospital outpatient facilities sampled from Maryland Medicaid claims data, 1988. |
For each type of clinical setting, the study reports the average percentage of technical quality indicators for well-child care that were not met. Each average fell in the 35%–65% range. |
Starfield et al., 1994 |
|
Well-Adult Care |
||||
|
Patients should have preventive health visits every 1–3 years when 19–64 years old and every year when≥65 years old (USPSTF, 1989). |
All adults with asthma, hypertension, and diabetes from a sample of 2,024 patients of 135 providers. |
Same as above. |
For each type of clinical setting, the study reports the average percentage of technical quality indicators for well-adult care that were not met. Each average fell in the 45%–55% range. |
Starfield et al., 1994 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
ACUTE CARE |
||||
|
Pneumonia |
||||
|
Pneumonia: Hospital Care |
||||
|
Includes documentation of tobacco use/ nonuse and lower-extremity edema; blood pressure readings; oxygen therapy or intubation for hypoxic patients. |
1,408 patients hospitalized with pneumonia from a nationally representative sample of 7,156 patients hospitalized with any of five conditions (congestive heart failure, acute myocardial infarction, pneumonia, stroke, hip fracture) (Draper et al., 1990). |
Medical records for Medicare patients from 297 hospitals in five states (California, Florida, Indiana, Pennsylvania, Texas), July 1, 1985, to June 30, 1986. |
52%–90% of patients with pneumonia received appropriate components of care. |
Kahn et al., 1990 |
|
Includes various components of pneumonia care consistent with prevailing standards of care. |
1,343 patients≥65 years old hospitalized with pneumonia. |
National Medicare claims data and medical records, October 1, 1994, to September 30, 1995 |
89% had oxygenation assessment within 24 hours of hospital arrival, 76% received antibiotics within 8 hours of arrival, 69% had blood cultures within 24 hours of arrival, and 57% had blood cultures collected before initial antibiotic administration. |
Meehan et al., 1997 |
|
Otitis Media |
||||
|
Otitis Media: Treatment |
||||
|
Includes various components of otitis media care consistent with prevailing standards of care. |
464 children≥3 years old diagnosed with otitis media from a sample of 2,024 patients of 135 providers. |
Medical records from physicians’ offices, community health centers, and hospital outpatient facilities sampled from Maryland Medicaid claims data, 1988. |
For each type of clinical setting, the study reports the average percentage of technical quality indicators for otitis media that were not met. Each average fell in the 10%–40% range. |
Starfield et al., 1994 |
|
Hip Fractures |
||||
|
Hip Fracture: Hospital Care |
||||
|
Includes documentation of mental status and pedal or leg pulse, serum potassium level, electrocardiogram. |
1,404 patients hospitalized with hip fracture from a nationally representative sample of 7,156 patients hospitalized with any of five conditions (congestive heart failure, acute myocardial infarction, pneumonia, stroke, hip fracture) (Draper et al., 1990). |
Medical records for Medicare patients from 297 hospitals in five states (California, Florida, Indiana, Pennsylvania, Texas), July 1, 1985, to June 30, 1986. |
67%–94% of patients with hip fracture received appropriate components of care. |
Kahn et al., 1990 |
|
Urinary Tract Infections |
||||
|
Urinary Tract Infections: Diagnosis |
||||
|
The provision of a urine culture in diagnosing a urinary tract infection (UTI) is consistent with prevailing standards of care. |
535 episodes of UTI from 465 children who received ambulatory care for UTIs out of a sample of 147,356 children<8 years old with |
Medicaid claims from Alabama, July 1, 1989, to June 30, 1993. |
52% received a urine culture. |
Bronstein et al., 1997 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
continuous Medicaid coverage (exclusive of children with Medicaid because of Supplemental Security Income) for all 12 months of 1992. |
|
||
|
Pregnancy and Delivery |
||||
|
Prenatal Care: Medical History, Physical Examination, and Laboratory Tests |
||||
|
Includes various components of prenatal care consistent with prevailing standards of care. |
9,924 women who had live births in 1988 from a nationally representative sample of the U.S. population (excluding South Dakota and Montana, and including the District of Columbia). |
National Maternal and Infant Health Survey (NMIHS), 1988. |
80% were asked about health history during the first or second visit. 98% had their weight and height measured, 96% had blood pressure measured, and 86% received a physical or pelvic examination during the first or second visit. 79% received blood tests and 93% received urinalysis during the first or second visit. 56% received all of the evaluations listed above during the first or second visit. |
Kogan et al., 1994 |
|
Prenatal Care: Counseling About Nutrition, Weight Gain, Substance Use, and Breastfeeding |
||||
|
Includes various components of prenatal care consistent with prevailing standards of care. |
Same as above. |
Same as above. |
97% were counseled about vitamins, 93% were counseled about diet, and 72% were counseled about proper weight gain during pregnancy during at least one prenatal visit. 68% were counseled to reduce or eliminate alcohol consumption, 69% to reduce or eliminate smoking, and 65% to stop use of illegal drugs during at least one prenatal visit. 53% were counseled about breastfeeding during at least one prenatal visit. 32% received all of the counseling listed above during at least one prenatal visit. |
Kogan et al., 1994 |
|
Prenatal Care: Screening Tests |
||||
|
Includes tests to screen for anemia, asymptomatic bacteriuria, syphilis, gonorrhea, hepatitis B, rubella immunity, and Rh factor and antibody. |
Random sample of 586 women who had a live birth from 24,170 births that occurred during the study period. |
Medical records for patients from six HMOs in six states (Arizona, California, Colorado, Massachusetts, Minnesota, Oregon), August 1, 1989, to July 31, 1990. |
Among six HMOs, women received 64%–95% (average 82%) of seven recommended routine prenatal screening tests. |
Murata et al., 1994 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Prenatal Care: Other Routine Prenatal Care |
||||
|
Includes first prenatal visit during first trimester, accurate determination of gestational age, screening for inherited disorders, measurement of symphysis-fundal height, and blood pressure measurement. |
Same as above. |
Same as above. |
Among six HMOs, women received 78%–87% (average 84%) of five processes of routine prenatal care. |
Murata et al., 1994 |
|
Prenatal Care: Pregnancy Complications |
||||
|
Includes diagnostic and treatment interventions after abnormal screening test results, and care to mitigate effects of pregnancy-induced hypertension and gestational diabetes. |
Same as above. |
Same as above. |
Among six HMOs, women received 54%–77% of care for complications of pregnancy. |
Murata et al., 1994 |
|
Prenatal Care: Proteinuria |
||||
|
Urine is checked for protein to evaluate for the presence of preeclampsia, a serious complication of pregnancy. |
Inpatient records for 2,336 women from a sample of 2,878 births in 1985; prenatal care records for 823 of these women. |
Medical records for patients sampled from Medicaid claims files for women and children enrolled in Aid to Families with Dependent Children (AFDC) in two communities in California and two communities in Missouri, 1985. |
Testing was provided at 75%–83% of visits. Follow-up was performed for 41%–65% of patients with proteinuria. |
Carey et al., 1991 |
|
Prenatal Care: Recording of Gestational Age |
||||
|
Includes a component of prenatal care consistent with prevailing standards of care. |
Same as above. |
Same as above. |
Gestational age was recorded at 78%–95% of visits. |
Carey et al., 1991 |
|
Prenatal Care: Assessment of Fetal Heart Tones after 18 Weeks of Gestation |
||||
|
Includes a component of prenatal care consistent with prevailing standards of care. |
Same as above. |
Same as above. |
Fetal heart tones were assessed at 81%–93% of visits. |
Carey et al., 1991 |
|
Prenatal Care: Follow-up for Low Hematocrit |
||||
|
Low hematocrit indicates anemia. |
Same as above. |
Same as above. |
Follow-up was performed for 32%–51% of patients with low hematocrit. |
Carey et al., 1991 |
|
Prenatal Care: Follow-up for High Blood Pressure |
||||
|
Includes a component of prenatal care consistent with prevailing standards of care. |
Same as above. |
Same as above. |
Follow-up was performed for 31%–53% of patients with high blood pressure. |
Carey et al., 1991 |
|
Prenatal Care: Physical Examination |
||||
|
Includes various components of prenatal care consistent with prevailing standards of care. |
267 women receiving routine, low-risk prenatal care were randomly selected, with stratification by insurance type (Medicaid, health maintenance organization, fee-for-service). |
Medical records from seven private and hospital-based prenatal care sites in Washtenaw County, Michigan, for women receiving care between January 1, 1991, and December 31, 1992. |
99% had blood pressure assessed at each visit. 93% had fundal height assessed at each visit after 20 weeks gestation. |
Klinkman et al., 1997 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Prenatal Care: Laboratory Screening Tests |
||||
|
Includes various components of prenatal care consistent with prevailing standards of care. |
Same as above. |
Same as above. |
Patients received an average of 81%–83% (depending on insurance type) of recommended laboratory screening tests. |
Klinkman et al., 1997 |
|
Delivery: Neonatal Group B Streptococcal (GBS) Disease |
||||
|
The American College of Obstetricians and Gynecologists recommends intrapartum antibiotics for women with rupture of membranes (ROM) for 18 hours or more to prevent neonatal Group B Streptococcal (GBS) infection (ACOG, 1993, 1996). |
81 women with ROM≥18 hours from among all women with deliveries during the study period. |
Medical records from two HMO hospitals (in which protocols similar to ACOG guidelines had been adopted) in San Francisco and Oakland, California, for women who delivered from January to June 1995. |
88% received an antibiotic effective against GBS, 37% received antibiotics within 20 hours of ROM (median duration of ROM was 31 hours). |
Lieu et al., 1998 |
|
CHRONIC CARE |
||||
|
Asthma |
||||
|
Adult Asthma Care |
||||
|
Includes various components of asthma care consistent with prevailing standards of care. |
Adults≥18 years old in a group of 393 adults and children diagnosed with asthma, from a sample of 2,024 patients of 135 providers. |
Medical records from physicians’ offices, community health centers, and hospital outpatient facilities sampled from Maryland Medicaid claims data, 1988. |
For each type of clinical setting, the study reports the average percentage of technical quality indicators for adult asthma that were not met. Each of the averages was located in the 40%–45% range. Between 5% and 35% of care was inappropriate. |
Starfield et al., 1994 |
|
Childhood Asthma Care |
||||
|
Includes various components of asthma care consistent with prevailing standards of care. |
Children<18 years old in a group of 393 adults and children diagnosed with asthma, from a sample of 2,024 patients of 135 providers. |
Same as above. |
For each type of clinical setting, the study reports the average percentage of technical quality indicators for childhood asthma that were not met. Each of the averages was located in the 30%–40% range. Between 0% and 20% of care was inappropriate. |
Starfield et al., 1994 |
|
Asthma Care |
||||
|
Includes various components of asthma care consistent with prevailing standards of care. |
5,580 patients≥14 years old who were prescribed asthma medications. |
Survey of patients from multiple sites of a health maintenance organization in California, 1996. |
72% of patients with severe asthma had a steroid inhaler, 26% of patients needing daily medications had a peak flow meter at home, and 42% were advised about self-management tools. |
Legorreta et al., 1998 |
|
Diabetes Mellitus |
||||
|
Diabetes Mellitus: Dilated Eye Examination |
||||
|
Annual dilated eye examination to screen for retinopathy starting at time of diagnosis of non-insulin-dependent diabetes mellitus (NIDDM) and 5 years after diagnosis of insulin-dependent diabetes mellitus (IDDM). |
2,392 adults≥18 years old with IDDM (124 patients), NIDDM treated with insulin (922 patients), and NIDDM not treated with insulin (1,346 patients) from a sample of 84,572 people |
NHIS, 1989. |
49% had a dilated eye examination in the prior year; 66% had an examination in the prior 2 years; 61% and 57% of patients at high risk of vision loss because of a |
Brechner et al., 1993 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
representative of the U.S. civilian, noninstitutionalized population. |
|
history of retinopathy or of long duration of diabetes, respectively, had an examination in the prior year. |
|
|
Diabetes Mellitus: Any Eye Examination |
||||
|
Dilated eye examination is recommended, as described above, but any eye examination is also reported to determine whether there was any effort to assess for retinopathy. |
Same as above. |
Same as above. |
61% had an eye examination in the prior year; 79% had an examination in the prior 2 years. |
Brechner et al., 1993 |
|
Diabetes Mellitus: Eye Exam by Ophthalmologist |
||||
|
Dilated eye examination is recommended, as described above, but an examination by an ophthalmologist serves as a proxy for a dilated eye examination. |
97,388 Medicare patients ≥ 65 years old diagnosed with diabetes mellitus. |
All Medicare claims data (Parts A and B) from three states (Alabama, Iowa, Maryland), submitted from July 1, 1990, to June 30, 1991. |
54% did not have an examination by an ophthalmologist during the prior year. |
Weiner et al., 1995 |
|
Diabetes Mellitus: Physical Examination |
||||
|
Includes various components of diabetes care consistent with prevailing standards of care. |
292 patients≥65 years old with diabetes mellitus. |
National Medicare Competition Evaluation, with medical records from 8 HMOs and 113 fee-for-service providers for patients drawn from |
92%–96% had their weight recorded at least once after diagnosis. 70% (for both HMO and FFS providers) had a peripheral vascular examination. 94%–96% had |
Retchin and Preston, 1991 |
|
|
enrollment lists of patients with start-up dates between January 1983, and May 1984; records were abstracted from the start-up date to March 31, 1986. |
blood pressure recorded at least annually. 30%–48% had a funduscopic examination or referral to an ophthalmologist within 2 years of diagnosis. 58%– 63% had tonometry performed. |
|
|
|
Diabetes Mellitus: Hemoglobin A1C |
||||
|
Hemoglobin A1C (or glycosylated hemoglobin) is a blood test that reflects the metabolic control of diabetes. The test should be performed at least once a year for diabetics. |
97,388 Medicare patients ≥ 65 years old diagnosed with diabetes mellitus. |
All Medicare claims data (Parts A and B) from three states (Alabama, Iowa, Maryland), submitted from July 1, 1990, to June 30, 1991. |
84% did not receive a hemoglobin A1C test during the prior year. |
Weiner et al., 1995 |
|
Diabetes Mellitus: Cholesterol Screening |
||||
|
It is recommended that total cholesterol be measured at least once a year for diabetics. |
Same as above. |
Same as above. |
45% did not receive blood cholesterol screening during the prior year |
Weiner et al., 1995 |
|
Diabetes Mellitus: Laboratory Studies and Follow-ups |
||||
|
Includes various components of diabetes care consistent with prevailing standards of care. |
292 patients≥65 years old with diabetes mellitus. |
National Medicare Competition Evaluation, with medical records from 8 HMOs and 113 fee-for-service providers for patients drawn from enrollment lists of patients with start-up dates between January 1983, and May 1984; records were |
74%–89% had urinalysis performed. 75%–95% had creatinine or serum urea nitrogen determined at least annually after diagnosis. 82%–83% had an electrocardiogram performed within 6 months of diagnosis. 91%–95% had at least one repeated blood |
Retchin and Preston, 1991 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
abstracted from the start-up date to March 31, 1986. |
glucose within 12 months of diagnosis. 84%–90% who were not taking insulin had blood glucose recorded at least every 12 months. 74% (for both HMO and FFS providers) who were taking insulin had blood glucose recorded at least every 6 months. |
|
|
|
Diabetes Mellitus: Influenza Vaccine |
||||
|
Includes diabetes care consistent with prevailing standards of care. |
Same as above. |
Same as above. |
19%–62% received an influenza vaccination. |
Retchin and Preston, 1991 |
|
Diabetes Mellitus |
||||
|
Includes various components of diabetes care consistent with prevailing standards of care. |
368 adults≥18 years old diagnosed with diabetes, from a sample of 2,024 patients of 135 providers. |
Medical records from physician offices, community health centers, and hospital outpatient facilities sampled from Maryland Medicaid claims data, 1988. |
For each clinical setting, the study reports the average percentage of technical quality indicators for diabetes that were not met. Each average was located in the 40%–60% range. |
Starfield et al., 1994 |
|
Peptic Ulcer Disease |
||||
|
Peptic Ulcer Disease: Treatment |
||||
|
People with H. pylori peptic ulcer disease (PUD) should be prescribed antimicrobial therapy for the infection, as strongly recommended by the National Institutes of Health Consensus Development Conference in February 1994. |
About 3,571 Medicaid beneficiaries≥18 years old who received care for PUD and who were not receiving nonsteroidal antiinflammatory drugs. |
Computerized inpatient, outpatient, and pharmaceutical claims files of the Pennsylvania Medicaid Program, March 1994, to February 1996. |
11% of patients received antimicrobials within five days of a PUD encounter. |
Thamer et al., 1998 |
|
Hypertension |
||||
|
Hypertension: Treatment |
||||
|
Hypertension (high blood pressure) is a leading risk factor for coronary heart disease, congestive heart failure, stroke, ruptured aortic aneurysm, renal disease, and retinopathy, all of which contribute to high morbidity and mortality (U.S. Preventive Services Task Force, 1989). This was reiterated in 1996 (U.S. Preventive Services Task Force, 1996). |
246 patients>30 years old with chronic uncomplicated hypertension. |
Medical records for patients from four group practices in Massachusetts, November 1, 1985, to October 31, 1987. |
41%–54% of patients had their hypertension controlled (mean blood pressure<150/90). |
Udvarhelyi et al., 1991 |
|
Same as above. |
Nationally representative sample of U.S. adults with hypertension (sample size not available). |
National Health and Nutrition Examination Survey III, 1988–1991. |
55% of people with hypertension had blood pressure under control (blood pressure<160/95 on one occasion and reported currently taking antihypertensive medications); 21% when using strict criteria (blood pressure<140/90 and reported currently taking antihypertensive medications). |
Joint National Committee on Detection, 1993 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Same as above. |
8,697 adults≥18 years old diagnosed with hypertension from a sample of 36,610 people representative of the U.S. population. |
NHIS, 1990. |
89% of adults with hypertension received advice from a physician about controlling hypertension (i.e., taking antihypertensive medication, decreasing salt intake, losing weight, or exercising); 80% reported taking at least one action to control hypertension. |
CDC, 1994b |
|
Same as above. |
593 adults≥18 years old diagnosed with hypertension, from a sample of 2,024 patients of 135 providers. |
Medical records from physician offices, community health centers, and hospital outpatient facilities sampled from Maryland Medicaid claims data, 1988. |
For each type of clinical setting, the study reports the average percentage of technical quality indicators for hypertension that were not met. Each average fell in the 40%–55% range. |
Starfield et al., 1994 |
|
Mental Health |
||||
|
Depression: Detection |
||||
|
Includes diagnostic criteria consistent with prevailing standards of care. |
650 patients with current depressive disorder from a sample of 22,462 adult patients who visited one large HMO; several |
Medical Outcomes Study in three cities (Boston, Chicago, Los Angeles); questionnaires completed February to October 1986; |
44%–51% of depressed patients who visited general medical clinicians had their depression detected during the visit. 78%–94% of |
Wells et al., 1989 |
|
|
multispecialty, mixed-group practices; single-specialist small group practices; or solo practice providers in each city during the study period. |
phone interviews completed May to December 1986. |
depressed patients who visited mental health specialists had their depression detected during the visit. |
|
|
Depression: Treatment |
||||
|
Includes various components of depression care consistent with prevailing standards of care. |
Same as above. |
Same as above. |
50%–58% of depressed patients who visited general medical clinicians received appropriate care (the depression was detected, and they were counseled or referred to a mental health specialist or another clinician was noted to be providing the majority of the patient’s care). 83%– 93% of depressed patients who visited mental health specialists received appropriate care. |
Wells et al., 1989 |
|
Depression: Admission Assessment |
||||
|
Includes various components of depression care consistent with prevailing standards of care. |
1,198 patients hospitalized with depression, representative of all Medicare elderly patients hospitalized in general medical hospitals with a discharge diagnosis of |
Medical records for Medicare patients from 297 hospitals in five states (California, Florida, Indiana, Pennsylvania, Texas), July 1, 1985, to June 30, 1986. |
As part of admission assessment, 23% of patients did not have adequate psychological assessment, 26% did not have cognitive assessment, 50% did not have assessment of |
Wells et al., 1993 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
depression. |
|
psychosis, 19% did not have documentation of psychiatric history, 47% did not have documentation of whether patient had a history of suicide attempts or ideation, 24% did not have documentation of prior or current medication use, and 45% did not have documentation that heart sounds were examined. Mean number of components of neurologic examination (assessment of pupils, deep tendon reflexes, and gait) performed was 1.4. |
|
|
Mental/Addictive Disorder |
||||
|
Includes diagnostic criteria and treatment consistent with prevailing standards of care. |
People with mental or addictive disorder from a sample of 20,291 adults ≥18 years old. |
National Institute of Mental Health’s Epidemiologic Catchment Area study interviews, 1980–1985. |
29% of people with any mental or addictive disorder received some professional or voluntary mental health service during the prior 12 months, as did 32% of people with any disorder except |
Regier et al., 1993 |
|
|
substance use, 37% of people with any mental disorder with comorbid substance use, 24% of people with substance use (e.g., alcohol), 64% of people with schizophrenia, 46% of people with any affective disorder (e.g., depression), 33% of people with any anxiety disorder (e.g., obsessive-compulsive), 70% of people with somatization, 31% of people with antisocial personality disorder, and 17% of people with severe cognitive impairment. |
|
||
|
Schizophrenia: Treatment |
||||
|
Includes various components of schizophrenia care consistent with prevailing standards of care. |
224 patients from a random sample of patients 18–65 years old with schizophrenia or schizoaffective disorder who had been treated at the clinic for>3 months, had been hospitalized<21 days during the prior 3 months, and had>1 visit with a psychiatrist during the sampling period. |
Patient interviews and medical records from a Veterans Affairs Medical Center clinic and a community mental health center clinic during a 3-month period in early 1996. |
70% of patients with significant psychotic symptoms received poor management of their symptoms, and 79% of patients with significant medication side effects (akathisia, parkinsonism, tardive dyskinesia) received poor management of the side effects. 35% of patients with severe |
Young et al., 1998 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
disability were not receiving case management. 57% of patients in close contact with family members had no communication between the clinic and the family. |
|
||
|
Cancer |
||||
|
Breast Cancer: Diagnosis |
||||
|
Patients with breast cancer have better outcomes if diagnosis is made at an early stage. |
5,766 newly diagnosed patients with histologically confirmed breast cancer. |
Data submitted to American Cancer Society, Illinois Division, Chicago, by 99 hospitals out of 104 Illinois hospitals with active cancer registries, 1988. |
The average rate across hospitals of patients diagnosed with cancer at a late stage (IIb through IV) was 18%. |
Hand et al., 1991 |
|
Breast Cancer: Diagnosis |
||||
|
Patients with breast cancer have better outcomes if hormone receptor levels in tumor tissue are determined. |
2,958 newly diagnosed patients with histologically confirmed Stage II-IV breast cancer. |
Same as above. |
The average rate across hospitals of patients who did not have a hormone receptor test was 11%. |
Hand et al., 1991 |
|
Diagnosis should be made with fine needle aspiration, cytology, limited incisional biopsy, or definitive wide local excision. |
918 insured women≤64 years old with local/ regional invasive breast cancer Stage I or II. |
Data collected by Virginia Cancer Registry from 50 hospitals that represented 85% of Virginia hospital beds, and claims data from |
92% had initial biopsy prior to total mastectomy. |
Hillner et al., 1997 |
|
|
Trigon Blue Cross Blue Shield of Virginia, 1989– 1991. |
|
||
|
Breast Cancer: Treatment |
||||
|
Includes various components of breast cancer treatment consistent with prevailing standards of care. |
199 women 50–69 years old and 175 women≥70 years old with adenocarcinoma of the breast receiving primary cancer management at a participating hospital. |
Medical records from seven hospitals in southern California, for women with breast cancer diagnosed in 1980, to 1982. |
67% of women≥70 years old received appropriate treatment, compared with 83% of women 50–69 years old. After controlling for comorbidity, hospital, and cancer stage, a difference in appropriateness related to age persisted. |
Greenfield et al., 1987 |
|
Breast conservation, defined as excision of the tumor and surrounding tissue, with axillary dissection, followed by radiation therapy, was preferable to mastectomy for the majority of women with Stage I or II breast cancer, as supported by clinical trials and a 1990 NIH Consensus Conference (NIH Consensus Conference, 1991). |
8,095 women with a first primary breast cancer, Stage I or II. |
Data from the Seattle-Puget Sound cancer registry, which covers cancer cases in 13 western Washington counties and is part of the Surveillance, Epidemiology, and End Results (SEER) program of the National Cancer Institute, 1983– 1989. |
34% had breast-conserving surgery. |
Lazovich et al., 1991 |
|
Same as above. |
2,657 women with complete records out of 2,731 women with a first primary breast cancer, Stage I or II, who underwent breast-conserving surgery. |
Same as above. |
85% received radiation therapy. |
|
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Same as above. |
4,311 newly diagnosed patients with histologically confirmed Stage I-II breast cancer. |
Data submitted to American Cancer Society, Illinois Division, Chicago, by 99 hospitals out of 104 Illinois hospitals with active cancer registries, 1988. |
The average rate across hospitals of patients who did not receive radiotherapy after partial mastectomy was 48%. |
Hand et al., 1991 |
|
Same as above. |
918 insured women≤64 years old with local/regional invasive breast cancer Stage I or II. |
Data collected by Virginia Cancer Registry from 50 hospitals that represented 85% of Virginia hospital beds and claims data from Trigon Blue Cross Blue Shield of Virginia, 1989– 1991. |
86% received local breast radiation following lumpectomy. |
Hillner et al., 1997 |
|
Patients with breast cancer have better outcomes if adjuvant therapy is given to patients with Stage II neoplasms. |
2,248 newly diagnosed patients with histologically confirmed Stage II breast cancer. |
Data submitted to American Cancer Society, Illinois Division, Chicago, by 99 out of 104 Illinois hospitals with active cancer registries, 1988. |
The average rate across hospitals of patients who did not receive adjuvant therapy was 44%. |
Hand et al., 1991 |
|
Premenopausal, node-positive women with local/regional breast cancer should receive adjuvant chemotherapy. |
918 insured women≤64 years old with local/ regional invasive breast cancer Stage I or II. |
Data collected by Virginia Cancer Registry from 50 hospitals that represented 85% of Virginia hospital beds, and claims data from |
83% of premenopausal women with at least one positive axillary node received adjuvant chemotherapy. |
Hillner et al., 1997 |
|
|
Trigon Blue Cross Blue Shield of Virginia, 1989, to 1991. |
|
||
|
Patients with breast cancer have better outcomes if axillary lymph node dissection is done as part of the surgical treatment with Stage I and II neoplasms. |
4,311 newly diagnosed patients with histologically confirmed Stage I-II breast cancer |
Data submitted to American Cancer Society, Illinois Division, Chicago, by 99 hospitals out of 104 Illinois hospitals with active cancer registries, 1988 |
The average rate across hospitals of patients who did not have a lymph node dissection was 9%. |
Hand et al., 1991 |
|
Same as above. |
918 insured women≤64 years old with local/ regional invasive breast cancer Stage I or II. |
Data collected by Virginia Cancer Registry from 50 hospitals that represented 85% of Virginia hospital beds, and claims data from Trigon Blue Cross Blue Shield of Virginia, 1989– 91. |
88% underwent axillary node dissection. |
Hillner et al., 1997 |
|
Women with early stage breast carcinoma (TNM Stages I and II) who undergo breast-conserving surgery should then receive radiation therapy. |
1,292 women who underwent breast-conserving surgery from a sample of 2,575 women with early-stage breast carcinoma, excluding patients for whom national recommendations were not likely to apply. |
Medical records, patient surveys, and physician surveys for patients from 18 Massachusetts hospitals from a stratified random sample of 20, from September 1993, to September 1995, and from 30 Minnesota hospitals, from January 1993, to December 1993. |
84%–86% received radiation therapy after breast-conserving surgery. |
Guadagnoli et al., 1998 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
For early-stage breast carcinoma (TNM Stages I and II), axillary lymph node dissection should be performed. |
2,559 women who had axillary lymph node dissection from a sample of 2,575 women with early-stage breast carcinoma, excluding patients for whom national recommendations were not likely to apply. |
Same as above. |
81%–94% underwent axillary lymph node dissection. |
Guadagnoli et al., 1998 |
|
For early-stage breast carcinoma (TNM Stages I and II), premenopausal women with positive lymph nodes should receive chemotherapy. |
228 premenopausal women with positive lymph nodes from a sample of 2,575 women with early-stage breast carcinoma, excluding patients for whom national recommendations were not likely to apply. |
Same as above. |
94%–97% received chemotherapy. |
Guadagnoli et al., 1998 |
|
For early-stage breast carcinoma (TNM Stages I and II), postmenopausal women with positive lymph nodes and positive estrogen receptor status should receive hormonal therapy. |
168 postmenopausal women with positive lymph nodes and positive estrogen receptor status from a sample of 2,575 women with early-stage breast carcinoma, excluding patients for whom national recommendations were not likely to apply. |
Same as above. |
59%–63% received hormonal therapy. |
Guadagnoli et al., 1998 |
|
Breast Cancer: Follow-up |
||||
|
Annual mammography is appropriate for women who have had local/regional breast cancer. |
918 insured women≤64 years old with local/regional invasive breast cancer Stage I or II. |
Data collected by Virginia Cancer Registry from 50 hospitals that represented 85% of Virginia hospital beds, and claims data from Trigon Blue Cross Blue Shield of Virginia, 1989– 1991. |
79% of women had a mammogram within the first 18 months postoperatively. |
Hillner et al., 1997 |
|
Cardiovascular Disease |
||||
|
Cardiovascular Disease: Blood Cholesterol Testing |
||||
|
Clinical trials have shown a 30%–50% reduction in morbidity and mortality rates with management of cholesterol levels for patients with cardiovascular disease (CVD). The Adult Treatment Panel (ATP-II) of the National Cholesterol Education Program recommended management of cholesterol in patients with CVD with goals of LDL level<100 mg/dL and triglyceride level<200 mg/dL (NCEP, 1993). |
603 patients 27–70 years old with CVD. |
Physician survey, patient survey, and medical records from 159 physicians in 45 primary care practices in and around four midwestern cities: Eau Claire, Wisconsin; Iowa City, Iowa; Madison, Wisconsin; Minneapolis, Minnesota; August 1993, to February 1995. |
96% had total cholesterol levels, 67% had LDL values, 90% had triglyceride levels, and 75% had HDL levels recorded in the past 5 years. 72% with LDL >130 mg/dL had received diet counseling, and 42% had received cholesterol-lowering medication; 58% with LDL 100–130 mg/dL had received diet counseling, and 42% had received cholesterol-lowering medication. |
McBride et al., 1998 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Coronary Artery Disease: Coronary Angiography |
||||
|
Coronary angiography is a method for evaluating coronary artery anatomy to determine whether a patient is a candidate for coronary artery bypass graft surgery or percutaneous transluminal coronary angioplasty. |
352 patients who met explicitly defined criteria for necessity of coronary angiography, from among 1,350 positive exercise stress tests in a randomly selected sample of 5,850 stress tests. |
Medical records from four teaching hospitals (three public, one private) in Los Angeles, California and patient telephone interviews (with 243 of the 352 patients), January 1, 1990, to June 30, 1991. |
43% of patients received coronary angiography within 3 months of the positive exercise stress test; 56% received coronary angiography within 12 months of the positive test. |
Laouri et al., 1997 |
|
Myocardial Infarction (MI): Treatment with Aspirin |
||||
|
Aspirin is an effective, inexpensive, and safe treatment for a heart attack. Aspirin therapy reduces short-term mortality in patients with suspected heart attack by 23%. Aspirin should not be given to patients with certain conditions (e.g., hemorrhagic stroke, gastrointestinal bleeding). |
7,917 Medicare patients≥ 65 years old hospitalized with heart attack who were “ideal” candidates for treatment with aspirin, with no possible contraindications to aspirin therapy. Medical records for |
Medicare beneficiaries who were hospitalized in four states (Alabama, Connecticut, Iowa, Wisconsin), as part of the Cooperative Cardiovascular Project Pilot, June 1, 1992, to February 28, 1993. |
64% received aspirin within the first 2 days of hospitalization. |
Krumholz et al., 1995 |
|
Same as above. |
5,490 Medicare patients≥ 65 years old hospitalized with heart attack who were alive at discharge and who had no contraindications to aspirin therapy. |
Same as above. |
76% were discharged with instructions to take aspirin. Patients who were prescribed aspirin at discharge had a 6-month mortality rate of 8.4%, compared with 17% for |
Krumholz et al., 1996 |
|
|
patients not prescribed aspirin. |
|
||
|
Same as above. |
7,486 patients who were “ideal” candidates for treatment with aspirin during initial hospitalization from a sample of 16,124 Medicare patients hospitalized with a principal diagnosis of heart attack; 5,841 patients who were alive at discharge and who were “ideal” candidates for treatment with aspirin prior to or at time of discharge, from the same sample. |
Same as above. |
83% received aspirin during hospitalization; 77% received aspirin prior to or at time of discharge. |
Ellerbeck et al., 1995 |
|
Same as above. |
187 patients with confirmed heart attack who were alive at discharge and who had no contraindications to aspirin therapy from a sample of 300 Medicare patients≥65 years old hospitalized with a principal diagnosis of heart attack. |
Medicare mortality data issued by the Health Care Financing Administration (HCFA) and medical records for Medicare patients from six hospitals in Connecticut, as part of the Medicare Hospital Information Project, October 1, 1988, to September 30, 1991. |
73% received aspirin at time of discharge. |
Meehan et al., 1995 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Same as above. |
Subset of 2,938 patients with admitting diagnosis of MI. |
Medical records from 16 Minnesota hospitals for patients admitted August 1, 1995, to April 30, 1996. |
The median percentage of eligible patients≥65 years old receiving aspirin in the first 48 hours of hospitalization was 77%. |
Soumerai et al., 1998 |
|
Unstable Angina: Treatment with Aspirin |
||||
|
Same as above. |
384 patients who were “ideal” candidates for treatment with aspirin on admission and 321 who were “ideal” candidates for aspirin at discharge, from a sample of 450 patients≥65 years old hospitalized with unstable angina. |
Medical records and administrative data for patients with Medicare from three Connecticut hospitals, 1993–1995. |
72% received aspirin on admission (66% in 1993– 1994 and 82% in 1995). 65% were prescribed aspirin at discharge (66% in 1993–1994 and 79% in 1995). |
Krumholz et al., 1998 |
|
Unstable Angina: Treatment with Aspirin |
||||
|
Same as above. |
735 patients who were “ideal” candidates for treatment with aspirin during hospitalization and 531 who were “ideal” candidates for aspirin at discharge, from a sample of 882 patients≥65 years old with unstable angina. |
Medical records of Medicare beneficiaries discharged from 16 hospitals in North Carolina between October 1, 1993, and September 30, 1994. |
76% received aspirin during their hospital stay. 67% were prescribed aspirin at discharge. |
Simpson et al., 1997 |
|
Same as above. |
2,392 patients who were “ideal” candidates for aspirin during hospitalization and 1,387 who were “ideal” candidates for aspirin at discharge, from a sample of 4,300 patients with MI. |
Medical records from acute care hospitals in Maryland and the District of Columbia in Medicare’s National Claims History File sampled during January 1994, to July 1995. |
87% received aspirin during their stay. 77% received aspirin at discharge. |
Berger et al., 1998 |
|
MI: Treatment with Thrombolytics |
||||
|
Thrombolytics are medications that break down some of the acute blockage in the blood vessels that causes a heart attack, thereby reducing infarct size and limiting left ventricular dysfunction. Thrombolytics have been shown to reduce post-MI mortality by as much as 25%, though they should not be given to patients with certain conditions (e.g., recent hemorrhagic stroke). |
1,105 patients who were “ideal” candidates for treatment with thrombolytic agents from a sample of 16,124 Medicare patients hospitalized with a principal diagnosis of heart attack. |
Medical records for Medicare beneficiaries who were hospitalized in four states (Alabama, Connecticut, Iowa, Wisconsin), as part of the Cooperative Cardiovascular Project Pilot, June 1, 1992, to February 28, 1993. |
70% received thrombolytics during hospitalization. |
Ellerbeck et al., 1995 |
|
Same as above. |
68 patients with confirmed heart attack who had no contraindications to thrombolytic therapy, and who had electrocardiographic indications for thrombolytic therapy, from a sample of 300 Medicare patients≥65 years old |
Medicare mortality data issued by HCFA and medical records for Medicare patients from 6 hospitals in Connecticut, as part of the Medicare Hospital Information Project, October 1, 1988, to September 30, 1991. |
43% received thrombolytics during hospitalization |
Meehan et al., 1995 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
hospitalized with a principal diagnosis of heart attack. |
|
||
|
Same as above. |
245 patients who were “ideal” candidates for thrombolytics in the first hour of arrival from a sample of 4,300 patients with MI. |
Medical records from acute care hospitals in Maryland and the District of Columbia in Medicare’s National Claims History File sampled during January 1994, to July 1995. |
60% received thrombolytics within 1 hour after arrival. |
Berger et al., 1998 |
|
Same as above. |
Subset of 2,938 patients with admitting diagnosis of MI. |
Medical records from 16 Minnesota hospitals for patients admitted August 1, 1995, to April 30, 1996. |
The median percentage of eligible patients ≥ 65 years old receiving thrombolytics in the first 48 hours of hospitalization was 55%. |
Soumerai et al., 1998 |
|
MI: Reperfusion (Thrombolysis/Percutaneous Transluminal Coronary Angioplasty [PTCA]) |
||||
|
PTCA uses a miniature balloon catheter to decrease stenosis (blockage) in blood vessels supplying the heart. (Thrombolysis is described above.) |
398 patients who were considered “ideal” candidates for reperfusion from a sample of 4,300 patients with MI. |
Medical records from acute care hospitals in Maryland and the District of Columbia in Medicare’s National Claims History File sampled during January 1994, to June 1995. |
64% received reperfusion therapy (thrombolysis/ PTCA) within 12 hours of arrival at hospital. |
Berger et al., 1998 |
|
MI: Treatment with Heparin |
||||
|
Heparin is beneficial to patients with heart attack, though heparin should not be given to patients with certain conditions (e.g., bleeding disorders, stroke). |
9,857 patients who were “ideal” candidates for treatment with heparin from a sample of 16,124 Medicare patients hospitalized with a principal diagnosis of heart attack. |
Medical records for Medicare beneficiaries who were hospitalized in four states (Alabama, Connecticut, Iowa, Wisconsin), as part of the Cooperative Cardiovascular Project Pilot, June 1, 1992, to February 28, 1993. |
69% received heparin during hospitalization. |
Ellerbeck et al., 1995 |
|
Unstable Angina: Treatment with Heparin |
||||
|
Same as above. |
369 patients who were “ideal” candidates for treatment with heparin, from a sample of 450 patients ≥ 65 years old hospitalized with unstable angina. |
Medical records and administrative data for patients with Medicare from three Connecticut hospitals, 1993–1995. |
24% received intravenous heparin (20% in 1993 to 1994 and 32% in 1995). Of those receiving heparin, 51% had a therapeutic activated partial thromboplastin time (PTT) within 24 hours. |
Krumholz et al., 1998 |
|
Same as above. |
91 patients who were considered “ideal” candidates for heparin intravenously administered, from a sample of 882 patients ≥ 65 years old with unstable angina. |
Medical records of Medicare beneficiaries discharged from 16 hospitals in North Carolina between October 1, 1993, and September 30, 1994. |
63% received heparin administered intravenously. |
Simpson et al., 1997 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
MI: Treatment with Intravenous Nitroglycerin |
||||
|
Intravenous nitroglycerin is beneficial to patients with heart attack who have persistent chest pain, although intravenous nitroglycerin should not be given to patients with certain conditions (e.g., shock or hypotension on admission). |
1,754 patients who were “ideal” candidates for treatment with intravenous nitroglycerin from a sample of 16,124 Medicare patients hospitalized with a principal diagnosis of heart attack. |
Medical records for Medicare beneficiaries who were hospitalized in four states (Alabama, Connecticut, Iowa, Wisconsin), as part of Cooperative Cardiovascular Project Pilot, June 1, 1992, to February 28, 1993. |
74% received intravenous nitroglycerin during hospitalization. |
Ellerbeck et al., 1995 |
|
MI: Smoking Cessation Advice |
||||
|
Smokers with coronary artery disease who stop smoking have a better prognosis than those who keep smoking; at the time of heart attack, these smokers are most susceptible to advice about cessation of smoking. |
1,691 smokers who were “ideal” candidates for smoking cessation advice from a sample of 16,124 Medicare patients hospitalized with a principal diagnosis of heart attack. |
Same as above. |
28% received smoking cessation advice prior to or at time of discharge. |
Ellerbeck et al., 1995 |
|
Same as above. |
551 patients who were smokers from a sample of 4,300 patients with MI. |
Medical records from acute care hospitals in Maryland and the District of Columbia in Medicare’s National Claims History File sampled during January 1994, to July 1995. |
41% received smoking cessation advice. |
Berger et al., 1998 |
|
Unstable Angina: Smoking Cessation Advice |
||||
|
Same as above. |
133 patients who were identified as smokers, from a sample of 882 patients ≥ 65 years old with unstable angina. |
Medical records of Medicare beneficiaries discharged from 16 hospitals in North Carolina between October 1, 1993, and September 30, 1994. |
23% received smoking cessation counseling. |
Simpson et al., 1997 |
|
MI: Treatment with Angiotensin-Converting Enzyme (ACE) Inhibitors |
||||
|
ACE inhibitors can reduce post-MI mortality in patients with left ventricular dysfunction, although ACE inhibitors should not be given to patients with certain conditions (e.g., aortic stenosis). |
1,473 patients who were “ideal” candidates for treatment with ACE inhibitors from a sample of 16,124 Medicare patients hospitalized with a principal diagnosis of heart attack. |
Medical records for Medicare beneficiaries who were hospitalized in four states (Alabama, Connecticut, Iowa, Wisconsin), as part of Cooperative Cardiovascular Project Pilot, June 1, 1992, to February 28, 1993. |
59% received ACE inhibitors prior to or at time of discharge. |
Ellerbeck et al., 1995 |
|
Same as above. |
407 patients who were considered “ideal” candidates for ACE inhibitors from a sample of 4,300 patients with MI. |
Medical records from acute care hospitals in Maryland and the District of Columbia in Medicare’s National Claims History File sampled during January 1994, to July 1995. |
65% received ACE inhibitors for low ejection fraction (EF). |
Berger et al., 1998 |
|
Unstable Angina: Treatment with ACE Inhibitors |
||||
|
Same as above. |
177 patients who were considered “ideal” candidates for an ACE |
Medical records of Medicare beneficiaries discharged from 16 |
39% received an ACE inhibitor during hospitalization. 42% |
Simpson et al., 1997 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
inhibitor during hospitalization and 127 who were “ideal” candidates for an ACE inhibitor at discharge, from a sample of 882 patients ≥ 65 years old with unstable angina. |
hospitals in North Carolina between October 1, 1993, and September 30, 1994. |
received an ACE inhibitor at discharge. |
|
|
MI: Treatment with Beta Blockers |
||||
|
Beta blocker therapy can reduce post-MI mortality by as much as 25%, although beta blockers should not be given to patients with certain conditions (e.g., low left ventricular ejection fraction, pulmonary edema). |
2,976 patients who were “ideal” candidates for treatment with beta blockers from a sample of 16,124 Medicare patients hospitalized with a principal diagnosis of heart attack. |
Medical records for Medicare beneficiaries who were hospitalized in four states (Alabama, Connecticut, Iowa, Wisconsin), as part of Cooperative Cardiovascular Project Pilot, June 1, 1992, to February 28, 1993. |
45% received beta blockers prior to or at time of discharge. |
Ellerbeck et al., 1995 |
|
Same as above. |
3,737 Medicare patients ≥ 65 years old with principal diagnosis of heart attack who were eligible for treatment with beta blockers, from a statewide cohort of 5,332 people who had survived a heart attack for at least 30 days and |
New Jersey Medicare hospital admissions and enrollment data, 1986– 1992; New Jersey Medicaid drug utilization and enrollment files, 1986– 1991; New Jersey Program of Pharmacy Assistance for the Aged and Disabled drug |
21% received beta blockers within 90 days of discharge; adjusted mortality rate for patients with treatment was 43% lower than that of patients without treatment. |
Soumerai et al., 1997 |
|
|
who had prescription drug coverage. |
utilization data, 1986–1991. |
|
|
|
Same as above. |
104 patients with confirmed heart attack who were alive at discharge and who had no contraindications to beta blockers from a sample of 300 Medicare patients ≥ 65 years old hospitalized with a principal diagnosis of heart attack. |
Medicare mortality data issued by HCFA and medical records for Medicare patients from 6 hospitals in Connecticut, as part of the Medicare Hospital Information Project, October 1, 1988, to September 30, 1991. |
41% received beta blockers at time of discharge. |
Meehan et al., 1995 |
|
MI: Treatment with Beta Blockers |
||||
|
Same as above. |
Subset of 2,938 patients with admitting diagnosis of MI. |
Medical records from 16 Minnesota hospitals for patients admitted August 1, 1995, to April 30, 1996. |
The median percentage of eligible patients receiving beta blockers in the first 48 hours of hospitalization was 78%. |
Soumerai et al., 1998 |
|
Same as above. |
302 patients who were considered “ideal” candidates for beta blockers at discharge from a sample of 4,300 patients with MI. |
Medical records from acute care hospitals in Maryland and the District of Columbia in Medicare’s National Claims History File sampled during January 1994, to July 1995. |
60% received beta blockers at discharge. |
Berger et al., 1998 |
|
Unstable Angina: Treatment with Beta Blockers |
||||
|
Same as above. |
815 patients who were “ideal” candidates for beta |
Medical records of Medicare beneficiaries |
45% received beta blockers during hospitalization. |
Simpson et al., 1997 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
|
blockers during hospitalization and 589 who were “ideal” candidates for beta blockers at discharge, from a sample of 882 patients ≥ 65 years old with unstable angina. |
discharged from sixteen hospitals in North Carolina between October 1, 1993, and September 30, 1994. |
38% received beta blockers at discharge. |
|
|
MI: Hospital Care |
||||
|
Includes documentation of examination of jugular veins and alcoholism/smoking habits. |
1,437 patients hospitalized with acute myocardial infarction from a nationally representative sample of 7,156 patients hospitalized with any of five conditions (congestive heart failure, acute myocardial infarction, pneumonia, stroke, hip fracture) (Draper et al., 1990). |
Medical records for Medicare patients from 297 hospitals in five states (California, Florida, Indiana, Pennsylvania, Texas), July 1, 1985, to June 30, 1986. |
64%–68% of patients with acute myocardial infarction received appropriate components of care. |
Kahn et al., 1990 |
|
Unstable Angina: Low-Cholesterol Diet |
||||
|
Includes care for unstable angina consistent with prevailing standards of care. |
637 discharged patients who were “ideal” candidates for a low-cholesterol diet, from a sample of 882 patients ≥ 65 years old with unstable angina. |
Medical records of Medicare beneficiaries discharged from 16 hospitals in North Carolina and Septemeber 30, 1994. |
38% were prescribed a low-cholesterol diet at discharge. |
Simpson et al., 1997 |
TABLE A-2 Examples of Quality of Acute Health Care in the United States—Overuse: Did Patients Receive Inappropriate Care?
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Antibiotic Use |
||||
|
Common Cold |
||||
|
Almost all colds are caused by a virus, for which antibiotics are not an effective treatment. |
1,439 patients with 2,171 outpatient and emergency department visits for the common cold (acute nasopharyngitis) from a random sample of 50,000 patients with at least one claim for care by a physician, dentist, or optometrist. |
Kentucky Medicaid claims data, July 1, 1993, to June 30, 1994. |
In 60% of encounters for the common cold, patients filled prescriptions for antibiotics. |
Mainous et al., 1996 |
|
Same as above. |
Patients ≥ 18 years old with a diagnosis of the common cold, exclusive of adults with underlying lung disease, from a nationally representative sample of 1,529 physicians representing 28,787 adult patient ambulatory care visits. |
National Ambulatory Medical Care Survey (NAMCS), 1992. |
51% of patients diagnosed with a cold were treated with antibiotics. |
Gonzales et al., 1997 |
|
Same as above. |
Children≤18 years diagnosed with common colds from a total of 531 pediatric office visits with a primary diagnosis of cold, upper respiratory tract infection (URI), or bronchitis, exclusive of children with underlying lung disease, from a sample representative of the U.S. population. |
Same as above. |
Antibiotics were prescribed at 44% of visits of patients with common colds |
Nyquist et al., 1998 |
|
Upper Respiratory Tract Infection |
||||
|
Antimicrobial drugs do not shorten the course of viral URI, nor do they prevent secondary bacterial infections. |
Physicians who participated from a nationally representative sample of 3,000 office-based physicians. |
Same as above. |
16% of all antimicrobial drug prescriptions (an estimated 17,922,000 prescriptions nationally) were written for upper respiratory tract infections in 1992. |
McCaig and Hughes, 1995 |
|
Same as above. |
Patients ≥ 18 years old with a diagnosis of URI, exclusive of adults with underlying lung disease, from a nationally representative sample of 1,529 physicians representing 28,787 adult patient ambulatory care visits. |
Same as above. |
52% of patients diagnosed with a URI were treated with antibiotics. |
Gonzales et al., 1997 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Same as above. |
Children≤18 years diagnosed with URIs from a total of 531 pediatric office visits with a primary diagnosis of cold, URI, or bronchitis, exclusive of children with underlying lung disease, from a sample representative of the U.S. population. |
Same as above. |
Antibiotics were prescribed at 46% of visits of patients with URIs. |
Nyquist et al., 1998 |
|
Pharyngitis, Nasal Congestion, Common Cold, and Other Upper Respiratory Tract Infections |
||||
|
Since most of these conditions are viral, antibiotics have no benefit. |
Physicians who participated from a nationally representative sample of 3,000 office-based physicians. |
Same as above. |
Over 70% of patients received antibiotic prescriptions for pharyngitis (excluding streptococcal), over 50% received them for rhinitis, and over 30% received them for a nonspecific URI, cough, or cold. |
Dowell and Schwartz, 1997 |
|
Bronchitis |
||||
|
Most cases of bronchitis are caused by a virus, for which antibiotics are not an effective treatment. |
Patients≥18 years old with a diagnosis of bronchitis, exclusive of adults with underlying lung disease, from a nationally representative sample of 1,529 physicians representing 28,787 adult patient ambulatory care visits. |
Same as above. |
66% of patients diagnosed with bronchitis were treated with antibiotics. |
Gonzales et al., 1997 |
|
Same as above. |
Children ≤ 18 years diagnosed with bronchitis from a total of 531 pediatric office visits with a primary diagnosis of cold, URI, or bronchitis, exclusive of children with underlying lung disease, from a sample representative of the U.S. population. |
Same as above. |
Antibiotics were prescribed at 75% of visits of patients with bronchitis. |
Nyquist et al., 1998 |
|
Respiratory Illness |
||||
|
Pneumonia |
||||
|
Hospital admissions for pneumonia are considered appropriate when, for example, a patient fails to improve with outpatient oral medication or has a pleural effusion or an empyema. |
445 hospital admissions of children < 18 years old admitted with pneumonia. |
Medical records for patients from 12 hospitals in five communities in Boston and nearby suburbs, July 1, 1985, to June 30, 1986. |
9.4% of admissions were inappropriate. |
Payne et al., 1995 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Bronchitis/Asthma |
||||
|
Hospital admissions for bronchitis/asthma are considered appropriate when, for example, a patient has failed to improve with outpatient therapy or has a pneumothorax. |
1,038 hospital admissions of children < 18 years old admitted with bronchitis/ asthma. |
Same as above. |
4.4% of admissions were inappropriate. |
Payne et al., 1995 |
|
Otitis Media |
||||
|
Use of Tympanostomy Tubes |
||||
|
Indications for tympanostomy tube placement include refractory middle ear infection and chronic mastoiditis. |
6,429 children < 16 years old with recurrent acute otitis media and/or persistent otitis media with effusion who were insured in health plans requiring precertification by a utilization review firm. |
Interviews with physicians’ office staff at otolaryngology practices from 49 states and the District of Columbia, January 1, 1990, to July 30, 1991; additional interviews were conducted with otolaryngologists to determine the existence of extenuating clinical circumstances. |
41% of tube insertions were appropriate, 32% equivocal, and 27% inappropriate. If extenuating clinical circumstances were taken into account, 42% of tube insertions were appropriate, 35% equivocal, and 23% inappropriate. |
Kleinman et al., 1994 |
|
Depression |
||||
|
Depression: Treatment |
||||
|
There is no evidence that minor tranquilizers are effective for depression, but there is evidence that antidepressant medications are effective for depression. |
634 patients with current depressive disorder or depressive symptoms from a sample of 22,399 adult patients who visited one large HMO or several multispecialty, mixed-group practices in each city during the study period. |
Medical Outcomes Study (MOS) in three cities (Boston, Chicago, Los Angeles); questionnaires completed February to October 1986; phone interviews completed May to December 1986. |
19% of patients were treated with minor tranquilizers; 12% were treated with antidepressant medications; 11% were treated with a combination of minor tranquilizers and antidepressant medications; 59% received neither. |
Wells et al., 1994a |
|
Depression: Admission |
||||
|
Appropriate reasons for admission include depression, medical condition meriting acute care, comorbid major psychiatric disorder, or medical reasons precluding outpatient care for depression. |
1,198 patients hospitalized with depression, representative of all Medicare elderly patients hospitalized in general medical hospitals with a discharge diagnosis of depression. |
Medical records for Medicare patients from 297 hospitals in five states (California, Florida, Indiana, Pennsylvania, Texas), July 1, 1985, to June 30, 1986. |
93% were admitted for clearly or possibly appropriate reasons, and 7% were admitted for inappropriate reasons. |
Wells et al., 1993 |
|
Hysterectomy |
||||
|
Hysterectomy |
||||
|
Hysterectomy is the surgical removal of the uterus. |
642 women ≥ 20 years old who underwent nonemergency, nononcologic hysterectomies. |
Medical records for patients from seven managed care organizations, August 1, 1989, to July 31, 1990. |
16% of hysterectomies were inappropriate, 25% were equivocal, and 58% were appropriate. |
Bernstein et al., 1993b |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Cardiovascular Disease |
||||
|
Coronary Artery Disease: Coronary Angiography |
||||
|
Coronary angiography is a method for evaluating coronary artery anatomy to determine whether a patient is a candidate for coronary artery bypass graft surgery or percutaneous transluminal coronary angioplasty. |
Random sample of 1,335 patients who had coronary angiography. |
Medical records from 15 nonfederal hospitals providing coronary angiography in New York State, selected through a stratified random sample (for location, volume of coronary angiography, and authorization to perform coronary artery bypass graft surgery), 1990. |
4% of coronary angiographies were inappropriate, 20% were equivocal, and 76% were appropriate. |
Bernstein et al., 1993a |
|
Same as above. |
Random sample of 1,677 cases of coronary angiography. |
Medicare physician claims from three sites selected from 13 sites in eight states (Arizona, California, Colorado, Iowa, Massachusetts, Montana, Pennsylvania, South Carolina), 1981. |
17% of coronary inappropriate, 9% were equivocal, and 74% were appropriate. |
Chassin et al., 1987 |
|
Coronary Artery Disease: Coronary Artery Bypass Graft (CABG) |
||||
|
In CABG surgery, damaged blood vessels supplying the heart are replaced with vessels from elsewhere in the body. |
Stratified random sample of 386 patients who underwent CABG surgery in the three hospitals. |
Medical records from three hospitals (excluding Veterans Administration, other governmental, and specialty hospitals) selected through a stratified random sample (for size and teaching status) in a western state as part of the National Institutes of Health Consensus Development Program, 1979, 1980, and 1982 |
14% of CABG surgeries were inappropriate, 30% were equivocal, and 56% were appropriate. |
Winslow et al., 1988 |
|
Same as above. |
Random sample of 1,156 patients who had isolated CABG surgery. |
Medical records for patients from 12 Academic Medical Center Consortium hospitals in 10 states (California, Iowa, Louisiana, Maryland, Massachusetts, Minnesota, New Hampshire, New York, North Carolina, Pennsylvania), 1990. |
1.6% of CABG surgeries were inappropriate, 7% were equivocal, and 92% were appropriate. |
Leape et al., 1996 |
|
Same as above. |
Random sample of 1,338 patients who had isolated CABG surgery. |
Medical records from 15 nonfederal hospitals providing CABG procedure in New York State, selected through a stratified random sample (for location and volume of CABG operations), 1990. |
2.4% of CABG surgeries were inappropriate, 7% were equivocal, and 91% were appropriate. |
Leape et al., 1993 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Coronary Artery Disease: Percutaneous Transluminal Coronary Angioplasty (PTCA) |
||||
|
PTCA uses a miniature balloon catheter to decrease stenosis (blockage) in blood vessels supplying the heart. |
Random sample of 1,306 patients who had PTCA. |
Medical records from 15 nonfederal hospitals providing PTCA in New York State, selected through a stratified random sample (for location and volume of PTCA), 1990. |
4% of PTCAs were inappropriate, 38% were equivocal, and 58% were appropriate. |
Hilborne et al., 1993 |
|
Myocardial Infarction (MI): Permanent Cardiac Pacemaker |
||||
|
Pacemakers help regularize abnormal heart rates and rhythms. |
Medicare patients who underwent a total of 382 pacemaker implantations. |
Medical records from six university teaching hospitals, 11 university-affiliated hospitals, and 13 community hospitals in Philadelphia County, January 1, to June 30, 1983. |
20% of pacemaker implantations were inappropriate, 36% were equivocal, and 44% were appropriate. |
Greenspan et al., 1988 |
|
MI: Treatment with Lidocaine |
||||
|
Lidocaine prophylaxis used to prevent ventricular fibrillation in patients treated for probable MI has been shown to increase mortality. |
Subset of 2,938 patients with admitting diagnosis of MI. |
Medical records from sixteen Minnesota hospitals for patients admitted August 1, 1995, to April 30, 1996. |
The median percentage of patients ineligible for lidocaine who received it in the first 48 hours of hospitalization was 12%. |
Soumerai et al., 1998 |
|
MI: Avoidance of Calcium Channel Blockers for Patients with a Contraindication |
||||
|
Calcium channel blockers should not be given to patients with certain conditions (e.g., low left ventricular ejection fraction, evidence of shock, or pulmonary edema during hospitalization). |
785 patients with clear contraindication to calcium channel blockers from a sample of 16,124 Medicare patients hospitalized with a principal diagnosis of heart attack. |
Medical records for Medicare beneficiaries who were hospitalized in four states (Alabama, Connecticut, Iowa, Wisconsin), as part of the Cooperative Cardiovascular Project Pilot, June 1, 1992, to February 28, 1993. |
21% of those for whom calcium channel blockers were contraindicated received them. |
Ellerbeck et al., 1995 |
|
Same as above. |
220 patients with a contraindication for calcium channel blockers (i.e., a left ventricular ejection fraction < 40%) from a sample of 4,300 patients with MI. |
Medical records from acute care hospitals in Maryland and the District of Columbia in Medicare’s National Claims History File sampled during January 1994, to July 1995. |
18% of those for whom calcium blockers were contraindicated received them. |
Berger et al., 1998 |
|
Unstable Angina: Avoidance of Calcium Channel Blockers for Patients with a Contraindication |
||||
|
Same as above. |
218 patients with contraindications for calcium channel blocking drugs, from a sample of 882 patients ≥ 65 years old with unstable angina. |
Medical records of Medicare beneficiaries discharged from 16 hospitals in North Carolina between October 1, 1993, and September 30, 1994. |
62% of those for whom calcium blockers were contraindicated received them. |
Simpson et al., 1997 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Carotid Arteries |
||||
|
Carotid Endarterectomy |
||||
|
Carotid endarterectomy is a procedure that opens up stenotic (blocked) carotid arteries (which supply blood to the brain). |
Random sample of 1,302 cases of carotid endarterectomy. |
Medicare physician claims data and medical records from three sites selected from thirteen sites in eight states (Arizona, California, Colorado, Iowa, Massachusetts, Montana, Pennsylvania, South Carolina), 1981. |
32% of carotid endarterectomies were inappropriate, 32% were equivocal, and 35% were appropriate. |
Chassin et al., 1987 |
|
Gastrointestinal Disease |
||||
|
Upper Gastrointestinal Tract Endoscopy |
||||
|
Endoscopy enables visualization of the gastrointestinal tract, and permits biopsy and brush cytologic examination. |
Random sample of 1,585 cases of upper gastrointestinal tract endoscopy. |
Same as above. |
17% of upper gastrointestinal tract endoscopies were inappropriate, 11% were equivocal, and 72% were appropriate. |
Chassin et al., 1987 |
|
Cataracts |
||||
|
Cataract Surgery |
||||
|
Cataract surgery is a commonly performed surgery in adults ≥ 65 years old. Cataract surgery should not be performed on people with certain conditions (e.g., macular degeneration or diabetic retinopathy). |
1,020 patients who underwent a total of 1,139 cataract surgeries. |
Medical records for patients from 10 academic medical centers, 1990. |
2% of cataract surgeries were inappropriate, 7% were equivocal, and 91% were appropriate. |
Tobacman et al. 1996 |
TABLE A-3 Examples of Quality of Health Care in the United States Misuse: Did Patients Receive Appropriate Care in a Manner That Could Have Caused Harm?
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Preventable Deaths |
||||
|
Evaluation of preventable deaths |
||||
|
A death is considered preventable when the patient received poor care, and the poor care probably resulted in the patient’s death. |
182 patients who died in hospitals from stroke, pneumonia, or heart attack. |
Medical records for patients from 12 hospitals, 1985. |
14% of deaths resulted from inadequate diagnosis or treatment and could have been prevented. |
Dubois and Brook, 1988 |
|
Adverse Events |
||||
|
Adverse Events |
||||
|
An adverse event is an injury that is caused by medical management rather than the underlying disease and that prolongs hospitalization, produces a disability at |
|
|||
|
discharge, or both. |
30,121 medical records from a weighted sample of 31,429 records of hospitalized patients from a population of 2,671,863 nonpsychiatric discharged patients. |
51 randomly selected acute care, nonpsychiatric hospitals in New York State, 1984. |
There were 1,133 adverse events and 280 negligent events during 1984 admissions, representing a 3.7% statewide incidence rate of adverse events, and a 1.0% statewide incidence rate of adverse events due to negligence. |
Brennan et al., 1991 |
|
Same as above. |
30,121 medical records from a weighted sample of 31,429 records of hospitalized patients from a population of 2,671,863 nonpsychiatric discharged patients. |
51 randomly selected acute care, nonpsychiatric hospitals in New York State, 1984. |
17% of adverse events resulting from operations and 37% of other adverse events were due to negligence; 47% of physician errors leading to adverse events were due to negligence. |
Leape et al., 1991 |
|
Adverse Drug Events |
||||
|
Same as above. |
4,031 adult nonobstetric admissions to a stratified random sample of 11 medical and surgical units in two hospitals. |
Medical records and reports of hospital staff for 2 tertiary care hospitals in Boston, February to July 1993. |
There were 1.8 preventable adverse drugs events (ADEs) per 100 admissions (adjusted rate), of which 20% were life threatening, 43% were serious, and 37% were significant. There were an additional 5.5 potential ADEs per 100 admissions (adjusted rate). |
Bates et al., 1995 |
|
Same as above. |
4,031 patients admitted to 5 intensive care units (3 medical, 2 surgical) and 6 general care units (4 medical, 2 surgical) selected from a stratified random sample of units in 2 tertiary care hospitals in Boston. |
Case-investigation reports (including staff interviews, medical record review, etc.) for patients admitted between February and July 1993. |
There were 19 preventable or potential ADEs per 1000 patient days in the ICUs. There were 10 preventable or potential ADEs per 1000 patient days in general care units. Rates adjusted for number of medications per patient showed no significant differences for the two settings. |
Cullen et al., 1997 |
|
Health Care Servicea |
Sample Description |
Data Source |
Quality of Care |
Referenceb |
|
Mental Health |
||||
|
Depression: Treatment |
||||
|
Includes treatment consistent with prevailing standards of care. |
1,198 patients hospitalized with depression, representative of all Medicare elderly patients hospitalized in general medical hospitals with a discharge diagnosis of depression. |
Medical records for Medicare patients from 297 hospitals in five states (California, Florida, Indiana, Pennsylvania, Texas), July 1, 1985, to June 30, 1986. |
33% of patients discharged with antidepressants had doses below recommended level. |
Wells et al., 1994b |
|
Includes treatment consistent with prevailing standards of care. |
64 patients with major depression from a sample of 2,592 consecutive primary care patients 18–65 years old who attended one of the study clinics. |
Patient surveys and interviews, physician surveys, and computerized pharmacy records from 3 primary care clinics of Group Health Cooperative of Puget Sound in Washington. |
Among patients with major depression who received antidepressant medications, 78% received dosages within the recommended ranges. |
Simon and VonKorff, 1995 |
APPENDIX: Search Strategy for January 1997-July 1998 MEDLINE PLUS Search
|
Search Type |
Medical Subject Heading (MeSH) Search Term |
Tree Numbera |
Boolean Operator |
|
Subject |
Quality of health care |
N4.761 |
or |
|
Subject |
Guideline adherence |
N4.761.337 |
or |
|
Explode exact subjectb |
Outcome and process assessment, health care |
N4.761.761.559 |
|
|
Subject |
Professional review organization |
N4.761.673 |
or |
|
Subject |
Quality indicators, health care |
N4.761.789 |
and |
|
Language |
English |
|
and |
|
Date |
1997, 1998 |
|
|
|
NOTE: As Boolean operators, “or” means that articles with one search term and/or another search term are included, and “and” means that articles must have both search terms (or strings of search terms) to be included. For this search, articles with any of the Medical Subject Headings (MeSH) were included, and only articles in English and from 1997 or 1998 were included. aTree Number is a National Library of Medicine alphanumerical code for indexing MeSH terms. bThe “Explode” search function includes the MeSH category as well as all the subcategorical branches connected to it. It is equivalent to typing out the MeSH term and each of its subcategorical branches separately. The subcategories included when exploding “Outcome and Process Assessment, Health Care” are: Outcome Assessment, Treatment Outcome, Medical Futility, Treatment Failure, and Process Assessment. |
|||