Role of Ultrasound Lung Comets in the Diagnosis of Acute Heart Failure in Emergency Department: A Systematic Review and Meta-analysis

Dyspnea is one of the commonest complaints of patients presenting to the emergency department (ED)^[1-3]. Acute heart failure (AHF) accounts for many of these presentations^[4] and has relation with high morbidity and mortality^[5]. Early discrimination between cardiac and non-cardiac causes of dyspnea is often challenging. A prompt and accurate diagnosis may guide and optimize acute management, avoid delays in care, and improve the outcome. Conventional diagnosis tools, such as history, physical examination, electrocardiogram (ECG), chest X-ray plain film, and serum amino-terminal pro-brain-type natriuretic peptide (NT-proBNP), either lack specificity or sensitivity^[6-7]. Due to high requirement of personnel knowledge as well as a special training of cardiac, thoracic and veins ultrasound, it is difficult to popularize the 'gold' standard echocardiography with Doppler examination for a fast-paced and busy ED. However, emergency physicians (EP) often need to make quick and decisive management plans within such limited settings.

In the recent years, a new technique of transthoracic lung ultrasonography (TLS) has emerged and demonstrated promising results in AHF diagnosis at an early stage. Lichtenstein et al. first reported diffuse B-lines as an ultrasound sign of interstitial edema in 1997^[8-9]. Increased extravascular lung water could cause thickened subpleural interlobular septa which can be detected by the ultrasound beams. These reflected ultrasound beams create comet-tail reverberation artifact known as B-lines or ultrasound lung comets (ULCs). Subsequently, more studies confirmed that B-lines are ULCs artifacts related to fluid-filled alveoli edema^[10-12]. Excessive ULCs have been found to correlate with AHF diagnosis^[13]. These artifacts are easily identified with bedside ultrasonography. As mentioned above, TLS through ULCs evaluation is an easy technique for rapid diagnosis of AHF. Moreover, TLS is inexpensive, widely available, and can be repeated without additional radiation to patient. However, the diagnostic value of ULCs for evaluating AHF patients presenting urgently with dyspnea in EDs is uncertain. The objective was to assess the overall performance of the ULCs in the diagnosis of AHF in ED.

A literature review and a meta-analysis were conducted. Original articles published in English and Chinese up to the end of July 2017 were searched in PubMed, ProQuest, Cochrane Library, Web of science, OvidSP (EMBASE), EBSCO, Clinicaltrial.gov, CNKI, and WanFang Data. We searched some free text words or medical topic headings separately or in combination: 'ultrasound', 'sonography', 'ultrasonography', 'B-lines', 'comet', 'ultrasound lung comets', 'ULCs', 'dyspnea', 'heart failure', 'heart dysfunction', 'acute cardiogenic pulmonary edema (ACPE)', 'AHF', 'ACPE', 'sensitivity', and 'specificity'. Furthermore, the lists of reference for all eligible articles and reviews were also retrieved for additional studies. No attempt has been made to include unpublished data.

We selected articles for analysis that included the following criteria: (1) Population: patients with complaints of acute dyspnea or clinical suspected AHF; (2) Type of studies: prospective diagnostic studies that evaluated the diagnostic efficiency of lung ultrasonography (US) for the detection of AHF in the emergency department or pre-hospital emergency settings (case reports, retrospective investigations, and other types of case-control studies were excluded); (3) Index test: no restriction was made on the protocol of TLS used to detect AHF, as long as the authors addressed that they used the ULCs to make AHF diagnostic decision. In most studies, ULCs was defined as the presence of at least two zones showing the presence of three or more B-lines on both sides of the chest. There is no limit to the type of TLS operating physician or the type of machine and probe which was applied; (4) Comparison: comparison of imaging results with a final diagnosis from clinical follow-up accepted as the reference standard; (5) Outcomes: true positives, false negatives, false positives, and true negatives. If there is no clear report, these data must be calculated to retrieve. Two investigators (GCZ and STY) selected and examined eligible studies independently. Disagreements were resolved through discussion. Repeated citations were deleted and final references were formatted to be compatible with EndNote citation software.

We used the Quality Assessment of Studies of Diagnostic Accuracy included in Systematic Reviews-2 (QUADAS-2) tool^[14] to assess the methodological quality of all included articles. QUADAS-2 consists of two sections: the risks of bias and concerns regarding applicability. The former part is comprised of four domains: patient selection, index test, reference standard, and flow and timing. The latter is comprised of three domains: patient selection, index test, and reference standard.

Two investigators (LCS and SQZ) independently extract the following data items by using a specific data extraction sheet: types of ultrasound machine and probe, characteristics of patients, patient body position, the time between the patient admission to US examination, the TLS criteria for AHF, reference standards, study quality evaluation of included studies, and outcomes. When there are discrepancies, reaching consensus with a third author of this review (STY) was adopted.

The forest plots and summary receiver operating characteristic (SROC) curves were analyzed by using Meta-DiSc (version 1.4) software (http://www.hrc.es/investigacion/metadisc_en.htm). The threshold/cutoff effect was presented by calculating the Spearman correlation coefficient between the logit of sensitivity and the logit of specificity. The heterogeneity in each study was evaluated through performing χ² tests. If there was significant heterogeneity existing among studies, the random-effects model was applied. On the contrary, the fixed effect model was adopted. We also conducted Meta-DiSc to calculate the inconsistency index (I²) to quantify the amount of heterogeneity. P < 0.1 or I² > 50% suggested a prominent heterogeneity. Publication bias was checked using a Deeks' funnel plot asymmetry test. Fagan plot analysis was also applied. We assumed the pretest probabilities of 20%, 45%, and 70%. The corresponding post-test probabilities were calculated following a 'positive' or 'negative' TLS outcome based on the summary sensitivity and specificity which showed the relationship among the prior probability specified, the likelihood ratio, and posterior test probability^[15]. The level of low (20%), moderate (45%), and high pre-test probability (70%) were defined according to the PRIDE AHF scores^[16].

Most studies included in our meta-analysis have reported the time between the patients' admission and bedside TLS examination. As it is widely known, this time interval is crucial for the EPs to make prompt evaluation and could immensely influence the volume of extravascular lung water and thus, affect US pathologic findings because of initial treatment effect. Accordingly, the following subgroup analysis was established: comparisons between studies performed within 90 min of patient admission and beyond this time interval.

Fifteen studies were finally identified for this meta-analysis^{[10, 16-30]}. The flow diagram of search results is summarized in Figure 1. The number of cases ranged from 42 to 1, 005, involving a total of 3, 309 patients. The detailed characteristics of selected studies are showed in Table 1 and Table 2.

Figure 1.  Flow chart of study selection for inclusion in the systematic review.

Figure 2 and Figure 3 show the quality assessment of individual studies.

Figure 2.  Quality assessment of diagnostic accuracy studies 2 (QUADAS-2). Each domain is represented in a bar with the proportion of studies considered high-risk, low-risk, or unclear. The same applies to applicability concerns.

Figure 3.  Quality assessment according to quality assessment of diagnostic accuracy studies 2 (QUADAS-2). For each study, risk of bias and applicability concerns are classified as high risk, low risk, or unclear.

The summary sensitivity and specificity values were 0.85 [95% confidence interval (CI), 0.84-0.87], and 0.91 (95% CI, 0.89-0.92) (Figure 4). The summary PLR, NLR, and diagnostic odds ratio (DOR) were 8.94 (95% CI, 5.64-14.18), 0.14 (95% CI, 0.08-0.26) and 67.24 (95% CI, 31.78-142.28). The HSROC was 0.9587 (SE, 0.0130) (Figure 5). The Deeks' funnel plot asymmetry test showed no evidence of significant publication bias (P = 0.783) (Figure 6).

Figure 4.  Forest plots for sensitivity and specificity.

Figure 5.  Summary receiver operating characteristic (SROC) curves for the detection of AHF using ULCs.

Figure 6.  Deeks' funnel plot for the assessment of potential publication bias.

We detected significant heterogeneity among included studies, and therefore, all these results were analyzed under the random-effect model. Spearman rank correlation was -0.214 (P = 0.443), which indicated no significant threshold effect among individual studies. We also explored possible sources of heterogeneity among the studies by using meta-regression analysis with the following covariates as predictor variables: patient number (e.g., > 100 vs. < 100), study quality, operator (experienced vs. inexperienced), scanning protocol and the time interval between the patient's admission to bedside TLS examination (< 90 min vs. > 90 min). Results suggest that the time interval was closely related to accuracy (relative DOR, 3.56; 95% CI, 1.01-12.51; P = 0.0480).

According to the definition of PRIDE AHF scores^[16], the pretest probabilities of 20%, 45%, and 70% were evaluated in contrast with post-test probabilities based on a 'positive' or 'negative' ultrasound result. The Fagan plot analysis demonstrated that when the pre-test probabilities were 20%, 45%, or 70%, the positive post-test probabilities of AHF were 74%, 90%, or 96%, respectively (Figure 7). Furthermore, ULCs was helpful to reduce the negative post-probability of AHF to as low as 3% and 8% when the pre-probabilities of 'negative' measurement were 20% and 45%. Although the probability of correctly diagnosing AHF based on a 'positive' ULCs results is as high as 96% when the pretest probability was 70%, the diagnosis would be incorrect in 21% of patients whose ULCs results were 'negative' (Figure 8).

Figure 7.  Fagan plot analysis to evaluate the clinical utility of transthoracic lung ultrasonography for the detection of acute heart failure.

Figure 8.  Fagan plot analysis to evaluate the clinical utility of transthoracic lung ultrasonography for the detection of acute heart failure from studies that reported a time interval < 90 min.

Five studies reported a time interval between the patient's admission to bedside TLS examination > 90 min^{[10, 25-26, 28, 30]}, and the pooled sensitivity, specificity, PLR, NLR, and DOR were 0.67 (95% CI, 0.61-0.72), 0.90 (95% CI, 0.87-0.92), 6.42 (95% CI, 4.14-9.95), 0.35 (95% CI, 0.25-0.50), and 20.14 (95% CI, 9.17-44.24), respectively. The HSROC was 0.8924 (SE, 0.0631). Conversely, eight studies reported a time interval between the patient's admission to bedside TLS examination < 90 min^{[17-19, 21, 23-24, 27, 29]}, and the pooled sensitivity, specificity, PLR, NLR, and DOR were 0.91 (95% CI, 0.89-0.92), 0.90 (95% CI, 0.89-0.92), 10.13 (95% CI, 4.87-21.08), 0.07 (95% CI, 0.02-0.24), and 127.8 (95% CI, 46.10-354.30), respectively. The HSROC was 0.9712 (SE, 0.0258). The studies with the evaluation time < 90 min have an overall better sensitivity than the others. According to the summary likelihood ratio calculated from included studies reported the time interval < 90 min (Figure 7), we evaluated the pretest probabilities of 20%, 45%, and 70% against the corresponding post-test probabilities based on 'positive' or 'negative' ULCs results. When the pretest probability was only 20%, the accurate diagnosis probability of AHF was up to 76% based on the positive ULCs result, while the probability was only 1% based on the negative ULCs result; when pretest probability was 45%, the accurate diagnosis probability of AHF was up to 91% based on the positive ULCs result, while the probability was 4% based on the negative ULCs result; when pretest probability was 70%, the accurate diagnosis probability of AHF was up to 97% based on the positive ULCs result, while the probability was 10% based on the negative ULCs result.

The results demonstrated that the ULCs is reliable in the diagnosis of AHF. The overall sensitivity, specificity, and DOR were 85%, 91%, and 67.24, respectively as well as the AUC was 0.91. Positive ULCs results could increase the probability of AHF in low and moderate risk groups by approximately 50%. If TLS was performed without delay, negative ULCs results could decrease the probability of AHF in low and moderate risk groups to approximately 1%-4%; As a result, the diagnostic process may change in some patients. In our analysis, even in low-risk AHF patients, ULCs has been shown to have appropriate accuracy. Further subgroup analyses showed a significantly better diagnostic accuracy for the diagnosis of AHF for the studies that reported a time interval between the patient's admission to bedside TLS examination < 90 min than for those > 90 min.

Early diagnosis of AHF is critical to successfully identify underlying diseases or causes and to prevent further myocardial dysfunction and clinical deterioration in some patients. However, initial diagnosis may be difficult because of the nonspecific, highly variable, and probably observer dependent signs and symptoms^[31-32]. NT-proBNP and BNP could not accurately differentiate AHF from other etiologies of dyspnea. Moreover, other factors, such as the presence of a 'gray zone' of uncertainty in its reference range, comorbid illnesses, age, renal dysfunction, and expensive assay kit may affect the use of NT-proBNP^[33]. Chest radiography (CR) can be used in most acute dyspneic patients in ED, but it has been proved to be an insensitive and inaccurate test. Other imaging examinations are not always available in most EDs and transferring a critically ill and unstable patient for scanning is impractical^[34]. Moreover, large amount radiation also cannot be ignored. It is considered that echocardiography with doppler examination maybe the gold standard for the diagnosis of a patient with AHF. However, an immediate extensive echo testing and a consultant cardiologist is not always available in the emergency department. Additionally, echo may not be indicated for all of the patients presenting to the emergency department with acute undifferentiated dyspnea^[35]. In summary, none of these tests considered singularly seems sufficiently accurate to identify AHF because each method exhibits an imbalance between sensitivity and specificity characteristics^[36-38]. Therefore, it was estimated that heart failure is correctly diagnosed initially in only 50% of affected patients^[39]. Thus, it is imperative to find a simple, secure, and portable diagnostic tool in ED. TLS performed by EPs emerged as the times require.

TLS could identify ULCs easily even by novice sonographers or nurses. In our study, the average quality of all included literature is at a high level. According to the included literature description, AHF could be easily diagnosed by the presence of at least three B-lines in an intercostal space in two or more regions for each side of the thorax regardless of numbers of the chest wall are divided. In our predefined subgroup analyses, study quality and scanning protocol did not significantly alter the point estimates for sensitivity and specificity. The above results indicated that TLS is repeatable and easily interpretable. More importantly, TLS could effectively rule out ACPE when no multiple ULCs are detected. However, early studies were mostly conducted in intense care unit (ICU) or cardiopulmonary ward where patients have already been treated with diuretics and nitrates. Thus, the diagnostic efficiency may be altered. Moreover, most patients transferred to the ward may have not been in the critical stage because of the emergency management and plenty of time was available for intensivist or cardiologist to perform TLS. As a result, the true TLS test utility and practicability for a fast-paced and busy ED might be affected.

Al Deeb et al. also conducted a meta-analysis to evaluate the diagnostic performance of point-of-care US for ACPE in 2014^[40]. The majority of their included studies were conducted in ICU or inpatient ward. Only two studies in this article were completed in the ED. They reported that a sensitivity of US using B-lines to diagnosis ACPE of 94.1% and a specificity of 92.4%. There are several strengths in our study compared to the study by Al Deeb et al. First, we included more studies in the present study. Second, Al Deeb et al. admitted that further studies with more undifferentiated dyspneic patients from ED were necessary to gain more valid and reliable estimates of test accuracy in ED patients. Thus, in the present meta-analysis we reported the diagnostic value of ULCs mostly performed by frontline physicians other than radiologists in detecting AHF in EDs or even prehospital emergency settings. The results showed that for the early diagnosis of AHF, the overall accuracy of TLS performed by EPs who was not specialized in cardiac US is also good. The final noteworthy strength of our study was that the time interval between ED admission and bedside TLS performance (< 90 min vs. > 90 min) was found to be strongly associated with accuracy of TLS, because ULCs rapidly resolve with decongestion. It is widely known this time window is vital for EPs quick evaluation and is of great clinical utility. The Fagan plot analysis indicated that when the TLS was performed at the time of a patient's initial presentation to the ED, the presence of AHF among low to moderate risk populations would be accurately excluded due to a negative TLS result. We chose the time interval 90 min prior to TLS as we thought this was more applicable to daily practice, as patients may be treated by emergency medical services or other pre-hospital emergency personnel prior to initial evaluation by EPs. Delayed TLS after an initial diuretic therapy could affect final US pathologic findings, but it is considered that almost two hours are necessary to appreciate B-lines resolution after medical or mechanical ventilation therapy^[41-42]. Therefore, in clinical routine TLS may represent a valuable addition to the current diagnostic work-up of patients with suspected AHF. This non-invasive test is likely to help patients triage and draw a preliminary diagnosis. In spite of its simplicity, safety, and mobility, US has limitations in the diagnosis of AHF. TLS results were generated from the quantification of lung B-lines. Other causes of interstitial and alveolar thickening which may accompany or cause AHF, such as pulmonary fibrosis, can provide false positive results. Therefore, ULCs findings may not be representative of general spectrum of disease.

Some limitations of this study should be taken into consideration. First, we did not identify unpublished studies, and no attempt was made to include articles published in other languages. Second, the accuracy of ULCs in the diagnosis of AHF usually depends on the skill of the operators. The differences between the operators (their skill, experience, knowledge of chest US, etc.) were not interpreted in detail in this study and might result in such significant heterogeneity in our study. However, no sufficient details were available in the studies focus to make a stratification of the operators' skills. Therefore, in future studies we encourage the researchers to give a more detailed description. Thirdly, the diagnostic accuracy of ULCs was compared with that of the 'gold standard', namely comprehensive examination results, whereas the standard was not the unique one. This might explain the high heterogeneity found in this meta-analysis. Chart review is fairly common for determining final diagnosis in AHF studies, so while imperfect, it may be the best method that we currently have. Therefore, it is necessary to continue this meta-analysis with more unified criterion articles, and the results of our study should be interpreted with caution.

To our knowledge, this is the first meta-analysis of ULCs detected in ED for the diagnostic evaluation of AHF. Despite above-mentioned limitations, this study strongly supports the routine detection of AHF using TLS performed at the bedside and early test performance during the evaluation of patients presenting to the ED with acute dyspnea together with routine examinations. Eps or other medical professionals performed portable ultrasonography is a reliable method in the diagnosis of AHF, but the accuracy of ULCs in the diagnosis of AHF depends on the time interval between patient's admission to bedside TLS examination.

We are grateful to Beijing Municipal Science and Technology Commission and National Natural Science Foundation of China which funded this study. We appreciate the assistance of GAO Wen MD in the preparation of this article.

RL MD and ZGQ MD contributed to the conception and design of the study. RL MD, ZGQ MD, and YST MD contributed to the retrieval of articles, the extraction of data, the calculation of data, and the design of the figures and tables. RL MD and ZGC MD wrote the original manuscript. SLC PhD and ZSQ MD revised the manuscript. All authors approved the final manuscript.

No conflict of interest to declare.