Mad CAP Antics: Antibiotics Within 4 Hours
Jack tackled a controversial topic at this month’s Journal Club — what’s the evidence for giving antibiotics within four hours for CAP patients? It’s a good question, because how well we perform at this task is a big part of how our hospitals are measured. Ineed, pneumonia antibiotic timing is one of JCAHO’s Core Measures and there are only more such metrics down the road — so we’d like to think that our funding depends on rock-solid science and proven benefits.
Well…
As Jack noted, the 4-hr policy is based primarily on four papers,
1) Kahn et al, JAMA 1990 Oct 17 264(15) 1969-73 with comments 1995-6
2) McGarvey et al, Quality Review Bulletin April 13(4) 124-30
3) Meehan, Houck et al. JAMA 1997 Dec 17 278(23) 2080-4
4) Houck et al, Arch Intern Med. 2004; 164(6):637-644.
It’s this last paper we’re going to discuss — a retrospective study derived from a national sample of medicare patients with pneumonia.
Full disclosure — the lead author, Peter Houck, works for the Oklahmona Foundation for Medical Quality. Sure, they’re not-for-profit, but there’s an inherent conflict-of-interest. It’s kind of like how JCAHO reviews hospital performance, but also has a consulting arm that avises hospitals on how to pass their review, for a fee. The line between “the patient’s best interest” and “the regulatory agency’s best interest” becomes blurry, when someone from a quality-assurance agency is researching measurable hospital policies.
Since the ‘therapy’ being tested here is timing to administration of antibiotics, this study can’t ethically be done prospectively. Their retrospective sample is worth noting, however: They took their numbers from a database of Medicare (over 65) with a primary or secondary ICD-9 code of pneumonia sampled from July 1- Dec 31, 1998, or Sept 1, 1998-March 31, 1999 (this database had 346,105 patients, though it seems possible they sampled the same patients twice). The authors randomly selected up to 850 cases from each state (more like the Senate than the House of Representatives — Wyoming’s handling of pneumonia could be weighed equally with California’s), giving a study set of 39,242 patients .
Exclusion criteria included death or discharge on day of admission, age under 65, lack of radiographic evidence of pneumonia, history of immunocompromised status, recent hospitalization, or lack of ABx timing documentation. This eliminated over half their set, leaving 18,209 patients from 3732 hospitals (avg = 3/hospital, but one hospital accounted for 122 patients in the sample).
Their outcomes were in-house mortality, mortality within 30 days of admission, LOS in house, and readmission within 30 days of discharge. Jack recommends we start assessing the data with Table 4, which reports 30-day mortality, divided up by who got ABx when. So patients that got antibiotics within one hour, compared to those that got ABx after one hour, showed no significant difference in mortality. Ditto with two hours. But those patients that got ABx within 3 hours had a mortality of 11.7% (95%CI 11.0-12.6) compared with 12.3% (95%CI 11.5-13.0) for patients getting antibiotics after 3 hours, giving an adjusted odds ratio of 0.88, which was significantly different. Three hours! So why isn’t that the rule? Because, ah, four hour cutoffs are “commonly used in quality improvement activities.” OK…
The benefit of ABx before X hours, compared to after X hours, persists for values of X from 3 to 9 (if you don’t get antibiotics before 10 hours, it makes no significant difference in mortality if you get them after 10 hours.
Since the authors decided to focus on the 4 hour cutoff, they generated a lot of data around that timepoint. Their patient characteristics (Table 1) shows sufficient randomization in many categories, though it looks like women, minorities, and those over 85 were more likely to get ABx after 4 hours, rather than before. In Table 2, we see that city hospitals were less likely to get ABx administered before four hours, compared to nonmetropolitan hospitals. The same slowness was seen true in for-profit hospitals, as well as teaching hospitals. Make of that what you will.
Table 5 shows the breakdown of all outcomes, depending on whether ABx were given before or after 4 hrs. Length of stay, in-house mortality, and 30 day mortality are all significantly lower in the “within 4 hr” group (30-day readmission is unaffected). Looking closer at 30-day mortality, we see that 12.7% of patients die with antibiotics after 4hr, compared with 11.6% who die with antibiotics before (confidence intervals do not intersect). That 1.1% difference means the NNT is 91 (if we give 91 patients ABx before 4 hrs, we’ll save one more life). Of the 600,000 medicare patients admitted for pneumonia each year, that translates to 6600 lives saved.
Also striking about Table 5– there’s a huge mortality difference between PSI (pneumonia severity index) class IV and V, compared to class II and III… but all patients who got ABx within 4 hours fared better than those who did not, in terms of in-hospital mortality, 30-day mortality, and shorter LOS.
So, early administration is obviously a good thing, right? Well, no – it turns out that patients who got antibiotics before two hours actually did worse (see Table 3) in terms of higher in-hospital mortality (7.4%, CI 6.6-8.3) compared to the 2-4hr group (6.3%, CI 5.6-7.0), and 30 day mortality (12.5% for the under 2 hr group, compared to 10.9% for the 2-4 hr group). The authors are perplexed by this — it doesn’t fit with their model that pneumonia’s progressive injury to the lung can be interrupted by antibiotics. They recommend further study (because recommending to withhold antibiotics until two hours had elapsed might be controversial).
A few more points about all the ‘benefits’ of early antibiotics – JCAHO’s elevation of the 4 hr rule as a proxy for quality has encouraged hospitals to agressively, but superficially, treat coughing patients that walks into the ED. It’s hard to study whether this rule is contributing to antibiotic resistance, or whether rushing to give PO biaxin is really helping anyone, or whether the community benefits when we let pneumonia patients jump the triage queue at the expense of possibly sicker patients.
For further reading, emcrit.org has good resources on CAP, the blood culture controversy, and citations for optimal coverage for all of pneumonia’s different flavors.
Also, Jack previewed the new guidelines from the Infections Disease Society of America / American Thoracic Society, reprinted from Clinical Infectious Disease 2007: 44:S27-72: (I love how the first author is, in fact, based in Canada.)
29. For patients admitted through the ED, the first antibiotic dose should be administered while still in the ED. (Moderate recommendation; level III evidence.)
Surprisingly mild!! The authors elaborate:
Time to first antibiotic dose for CAP has recently received significant attention from a quality-of-care perspective. This emphasis is based on 2 retrospective studies of Medicare beneficiaries that demonstrated statistically significantly lower mortality among patients who received early antibiotic therapy [109,264]. The initial study suggested a breakpoint of 8 h [264], whereas the subsequent analysis found that 4 h was associated with lower mortality [109]. Studies that document the time to first antibiotic dose do not consistently demonstrate this difference, although none had as large a patient population. Most importantly, prospective trials of care by protocol have not demonstrated a survival benefit to increasing the percentage of patients with CAP who receive antibiotics within the first 4–8h [22, 65]. Early antibiotic administration does not appear to shorten the time to clinical stability, either [265], although time of first dose does appear to correlate with LOS [266, 267]. Aproblem of internal consistency is also present, because, in both studies [109, 264], patients who received antibiotics in the first 2 h after presentation actually did worse than those who received antibiotics 2–4 h after presentation. For these and other reasons, the committee did not feel that a specific time window for delivery of the first antibiotic dose should be recommended.
Blockbuster stuff! Let’s see if JCAHO modifies their recommendations in light of this authoritative, evidence-based recommendation.
Posted
on Sunday, March 18th, 2007 at 5:25 am by Nick. Filed under
Pneumonia, Regulations, Infectious Disease, Journal Club.
You may post a comment.
Annals of EM this month (May 2007, Vol 49, No. 5) has some more on the 4-hr rule:
Identification of 90% of patients Ultimately Diagnosed with CAP within 4 Hours of ED Arrival May Not Be Feasible:
“In our center, we found that at least 20% of all community-acquired pneumonia patients admitted through our ED did not have a final ED diagnosis of community-acquired pneumonia. Thus, even if the effects of crowding, atypical patient presentations, and delays in nursing care could be overcome, it would be unrealistic to believe that one could
deliver antibiotics within 4 hours to 90% of ED patients eligible for core measure PN-5b. Furthermore, we found that 56.7% of outlier patients without a diagnosis of community-acquired pneumonia had normal or unchanged chest radiography result. In an era of increasing antibiotic resistance, emergency physicians will be reluctant to give antibiotics for community-acquired pneumonia in such a situation, and it would seem appropriate to exclude such patients from the JCAHO benchmarks.”
And some commentary by Dr. Pines:
“However, as in all retrospective studies, the potential for unmeasured confounding exists and is a significant limitation. For example, other unmeasured factors associated with antibiotic timing that were not included in their analysis may also contribute to the observed mortality difference, such as better nursing care, less ED crowding, or just being a better-run hospital. There were also problems with internal consistency about the effect of antibiotic timing on mortality…
…Most patients with pneumonia have been clinically ill for days and sometimes weeks before arriving at the ED. It seems a leap to suggest that time to antibiotics within hours of ED presentation alone is responsible for the mortality difference. Despite these arguments, this is the evidence base for the JCAHO/CMS guideline. Additionally, both studies excluded patients without radiographic evidence of pneumonia. It is not clear why the JCAHO/CMS definition of PN-5b includes these patients without radiographic evidence in their denominator. Should we be giving antibiotics to all patients with pneumonia in their differential diagnosis at any stage of their evaluation, as is suggested by PN-5b? That does not sound like good medicine to me.”
Comment by NG on May 7th, 2007 at 2:13 pm
I have had intractable hiccups for 13 yrs, can anyone help me?
Comment by clinton stanford on July 5th, 2007 at 11:19 pm
As caregivers we have a voice. We need to have the opportunity to manage the (limited) risk/benefit ratio to our patients advantage. There is no question it is easier to measure process than quality, but quality is what we seek. Speaking up of course places a burden on ourselves to be constructive. I have been told that one concept behind this particular issue, and some of the other current goals, is to catch ‘the low hanging fruit’, to improve quality by making simple changes that are easy to reach. Medicine is too human to make that a reasonable concept.
Comment by Gordon Bleil on July 18th, 2007 at 5:23 pm