Prospective multicentre study of host response signatures in ... - Nature.com
Abstract
Few biomarkers for sepsis diagnosis are commonly used in neonatal sepsis. While the role of host response is increasingly recognized in sepsis pathogenesis and prognosis, there is a need for evaluating new biomarkers targeting host response in regions where sepsis burden is high and medico-economic resources are scarce. The objective of the study is to evaluate diagnostic and prognostic accuracy of biomarkers of neonatal sepsis in Sub Saharan Africa. This prospective multicentre study included newborn infants delivered in the Abomey-Calavi region in South Benin and their follow-up from birth to 3 months of age. Accuracy of transcriptional (CD74, CX3CR1), proteic (PCT, IL-6, IL-10, IP-10) biomarkers and clinical characteristics to diagnose and prognose neonatal sepsis were measured. At delivery, cord blood from all consecutive newborns were sampled and analysed, and infants were followed for a 12 weeks' period. Five hundred and eighty-one newborns were enrolled. One hundred and seventy-two newborns developed neonatal sepsis (29.6%) and death occurred in forty-nine infants (8.4%). Although PCT, IL-6 and IP-10 levels were independently associated with sepsis diagnosis, diagnostic accuracy of clinical variables combinations was similar to combinations with biomarkers and superior to biomarkers alone. Nonetheless, CD74, being the only biomarkers independently associated with mortality, showed elevated prognosis accuracy (AUC > 0.9) either alone or in combination with other biomarkers (eg. CD74/IP-10) or clinical criterion (eg. Apgar 1, birth weight). These results suggest that cord blood PCT had a low accuracy for diagnosing early onset neonatal sepsis in Sub Saharan African neonates, while association of clinical criterion showed to be more accurate than any biomarkers taken independently. At birth, CD74, either associated with IP-10 or clinical criterion, had the best accuracy in prognosing sepsis mortality.
Trial registration Clinicaltrial.gov registration number: NCT03780712. Registered 19 December 2018. Retrospectively registered.
Introduction
Neonatal sepsis remains a major societal and economic burden in low- and middle-income countries (LMIC). The Institute for Health Metrics and Evaluation estimates that in 2017, 200,000 newborns deaths occurred for every 2 million cases of sepsis in sub-Saharan Africa1. Early diagnosis of newborns with sepsis can reduce mortality and morbidity rates2. Unfortunately, the limited specificity of clinical signs, the lack of appropriate biological testing and the outrageous cost of sepsis treatment compared to national medium income in LMIC hamper most initiatives to reduce neonatal and pediatric mortality3. Difficulty in diagnosing sepsis in neonates is related to the conjunction of multiple variables, such as maternal health, pregnancy conditions, gestational age at delivery, newborn immune function, timing of infection and pathogens detection, as well as socio-economic environments and access to healthcare as seen in resources limited settings (RLS)4.
At birth, the immune defences go through rapid development and strengthen during the first years of life5. Studies have shown that the increased risk of early and late neonatal infections observed in both term and preterm infants are related to impaired innate immune function6,7,8. This innate immaturity is characterized by altered cytokines production and decreased function of antigen-presenting cells9,10. Blood culture remains the gold standard for the diagnosis of neonatal sepsis, but beside delayed results and low sensitivity, cost and access to those techniques in RLS limit its use11,12. Other tests routinely used for the diagnosis of neonatal sepsis, such as C-reactive protein (CRP) and blood count (total and differential white blood cell counts, absolute and immature neutrophil counts, and the ratio of immature to total neutrophils), are not unanimously recognized as good biomarkers of neonatal sepsis, respectively having a low specificity and lack of sensitiveness13,14,15,16. Additionally, repeated measurements are necessary to reach sufficient sensitivity limiting its use outside clinical bundles15. Procalcitonin (PCT) has been suggested to be a good marker for severe bacterial infection in newborn17,18,19. Several studies have shown that some pro-inflammatory (IL-6, IP-10) and anti-inflammatory (IL-10) cytokines can be used for the diagnosis of bacterial neonatal infection20,21,22,23,24. However, those cytokines profiles may be influeneced by gestational age, and time of onset of infection in newborn21,25. Based on a microarray study, a panel of genes has been identified in critically ill septic patients whose expression on peripheral blood could effectively help stratifying patients at increased risk of secondary infection and/or death26,27. Among these genes, CD74 and CX3CR1 were shown to be associated with mortality and/or the occurrence of secondary infections28,29,30. Low expression of CX3CR1 is associated with mortality and immunosuppression in adult patients with septic shock28,29,30. Similarly, low expression of CD74 is associated with mortality in adult patients with septic shock while increasing expression of CD74 in the first days of intensive care is associated with the occurrence of secondary infections29,31. There are no data on value of CD74 and CX3CR1 for the prognosis or diagnosis of neonatal sepsis, which hamper current use of these biomarkers in neonates and children15,16,32,33.
In this study, we evaluated the diagnostic and prognostic accuracy of transcriptional (CX3CR1, CD74) and proteic (IL6, IL10, IP-10, PCT) biomarkers and their association with clinics and maternal risk factors for neonatal sepsis. In addition, we measured the reference range of those biomarkers during the first 3 months of life.
Results
Cohort description
Between April 17, 2016 and March 12, 2018, a total of 581 newborns were enrolled, 420 (72.3%) in the hospital arm and 161 (27.7%) in the sub-urban arm. Patients' characteristics are displayed in Table 1. Median gestational age (GA) was 38.4 weeks (95% confidence interval [CI] 35.5–40 weeks), with a median birth weight of 2816 g (95% CI 2400–3150 g). One hundred and eighty-four (31.6%) infants were born prematurely with thirty-four (5.8%) being less than 32 weeks of GA. More preterm infants were delivered in the hospital arm than in the sub-urban arm (41.2% vs. 6.2%, p < 0.0001) and had a lower birth weight (2700 g vs. 3006 g, p < 0.001). Forty-five multiple gestations (40 twins, 5 triplicate) happened. Gestational malaria occurred in forty-three mothers (8.1%), affecting 49 infants (8.4%). Intermittent preventive treatment of malaria was performed in 470/531 (88.5%) of all mothers. Although methodologically considered as an exposure, the low gestational malaria occurrence did not justified a subgroup analysis. According to the study design, main differences between hospital and suburban arms were related to the perinatal risks with more premature infants and maternal risk factors of infection in the hospital arm. In total, 432/581 (74.3%) babies were born from mothers with maternal risk factors of infection (386/531, 72.7%). One hundred and seventy-two infants (29.6%) developed a clinical sepsis according to the definition. All occurred in the hospital arm. Among these, adjudication confirmed 168 cases (97.7%) (Fig. 1). All but five clinical sepsis were EONS. In the hospital arm, 307/420 infants were hospitalized following birth, the remaining with uneventful delivery and normal perinatal adaptation were discharged. Only one infant from the sub-urban arm was hospitalized for prenatally undiagnosed omphalocele. The median hospital stay was 4 days (95% CI 2–7 days). The global mortality was 49/581 (8.4%) with a significant difference between hospital and sub-urban arms, respectively 11.4% (48/420) versus 0.62% (1/161) (p < 0.001). Most death occurred in the first week of life (median 2 days) and were related to neonatal sepsis (n = 44) or prematurity complications (n = 5).
Identification of microorganisms in neonatal sepsis was performed using conventional bacterial culture followed by Biofire® FilmArray® multiplexing panel testing. Results are described in Table 2. A total of 155 hemocultures were sampled, of which positive cultures was obtained in 59/155 (38.1%) samples. Standard microbial cultures identified 59 pathogens and 14 hemocultures showed multiple germs and were considered as contaminated. Fifty-six of the 155 hemocultures were positive using Biofire® FilmArray® (56/155, 36.1%), in which 91 pathogens were identified. Gram-negative bacteria represented the majority of pathogens (52.5% to 49.4% pending the microbiologic technique) with Enterobacter cloacae complex, Klebsiella pneumonia, Serratia marcescens and Staphylococcus spp. being the most frequent germs identified (Table 2). Additional Biofire® FilmArray® panels identified viral infections (including Norovirus GI/GII, Rotavirus A, Coronavirus OC43, human rhinovirus and Respiratory Syncytial Virus) in 23 samples with negative standard cultures. Out of the 29 cerebrospinal fluid samples, one was positive for Hemophilus influenzae.
Primary outcosme: sepsis diagnosis
Cord blood levels of studied biomarkers are displayed in Table 3. Procalcitonin level was significantly higher in infants developing neonatal sepsis compared to both sub-urban arm and hospital healthy infants (Fig. 2A). A significant difference in cord blood from non-septic neonates between both arms was observed. Diagnosis accuracy of different clinical variables and biomarkers alone and in association were tested in three models (Table 4). Model 1 encompassed patients from the hospital arm representing high-risk pregnancies. The model 2 compared hospital septic patients to all non-septic patients (hospital and suburban arm). The model 3 compared clinical sepsis with positive blood culture to all non-septic patients. Globally, none of tested biomarkers showed accurate diagnosis capacity. Combination of biomarkers with or without clinical criterion had similar diagnostic accuracy than combination of clinical criterion, irrespective of the model. Multivariate analysis including non-redundant clinical criterion and all biomarkers (Table 5), identified PCT (aOR 1.21, 95% CI 1.02–1.43, p = 0.027), IL-6 (aOR 1.13, 95% CI 1.00–1.27, p = 0.043), IP-10 (aOR 0.82, 95% CI 0.72–0.93, p = 0.002) as well as Apgar score at 1 min > 7 (aOR 0.18, 95% CI 0.08–0.40, p < 0.001), and maternal fever (aOR 2.8, 95% CI 1.58–5.03, p < 0.001) as independently associated with sepsis diagnosis (model 2), with clinical criterion being the most strongly associated items with sepsis diagnosis. PCT cut-off value for a 96% diagnostic sensitivity (6% specificity) was 0.4 µg/mL similar to what has been published previously (Supplemental Table 1). Nevertheless, in the high-risk patients model 1, CD74 to IP-10 ratio had the best diagnostic AUC (0.77, 95%CI 0.72–0.81). CD74/IP-10 ratio value of 0.44 (Youden index 0.21) had a sensitivity of 73% and specificity of 25% for clinical sepsis diagnosis. Correlation between biomarkers and clinical variables showed that CX3CR1, IP-10, IL-6 and IL-10 are poorly correlated with clinical variables (Fig. 3). However, CD74 and PCT were strongly correlated (correlation cut-off < − 0.5 or > 0.5) with premature rupture of membrane (PROM), maternal fever, Apgar score, heart and respiratory rate (Fig. 3).
Secondary outcome: mortality
At delivery, PCT, CD74, IL-6 and CX3CR1 levels were significantly different between survivors and non survivors (Fig. 2B). Level of expression of CD74 showed good prognosis accuracy in model 2 and 3, as well as being systematically retrieved in most combinational models (Table 6). Interestingly, best prognosis accuracy occurred with the combination of biomarkers and clinical items, with CD74, Apgar score at 1 min and birth weight having an AUC of 0.97 (95% CI 0.94–0.99). On multivariate analysis (Table 7), CD74 was the only biomarkers independently associated with mortality (aOR 0.69, 95% CI 0.57–0.83, p < 0.001) along with intrauterine growth retardation (aOR 4.32, 95% CI 1.07–17.34, p = 0.039), and skin motteling (aOR 55.5, 95% CI 3.67838.97, p = 0.003).
Biomarkers reference range in the first 12 weeks of life
In healthy newborns, all biomarkers but PCT had a significant lower value on cord blood than in the first week following birth (Fig. 4). Whereas most biomarkers range did not vary between weeks 1 and 12, CD74 progressively increased during the first 8 weeks of life. Following neonatal sepsis, at week 4, CD74 was significantly lower in septic than in healthy newborns. We did not observe any significant differences in biomarker profiles between newborns exposed or not to gestational malaria.
Discussion
This multicentre study performed in sub Saharan Africa showed that clinical criteria either related to the infant or the mother are superior to individual cord blood biomarkers34. Nonetheless, CD74/IP-10 ratio may prove some interest in a subgroup of high-risk patients (prematurity, multiple gestation, maternal infection). Although cord blood PCT value was shown to be independently associated with early-onset sepsis diagnosis, it has a poor accuracy (cutoff similar to previous studies 0.4 ng/mL). In contrast, cord-blood biomarkers especially when associated with clinical criterion was shown to be highly predictive of outcome. CD74 was shown to be the only prognosis biomarkers independently associated with outcome and its association with Apgar at 1 min, intrauterine growth retardation having the highest prognosis accuracy.
The evaluation of clinical and biomarkers for neonatal sepsis diagnosis and prognosis in setting with high prevalence of sepsis and limited resources is bringing for the first-time detailed assessment of potential biomarkers utility and establishment of reference values in neglected pediatric populations. As such, this study is a radical breach in biomarkers development paradigms by re-focusing their evaluation in settings with high prevalence of neonatal sepsis and low ressources. Several large studies, occurring in setting with high resources and low sepsis prevalence, have suggested that cord blood PCT may be a robust biomarker for neonatal sepsis diagnosis, reporting elevated sensitivity and specificity for cut-off values ranging between 0.6 and 0.7 ng/mL35,36,37. These encouraging data were not confirmed by all. Few series in extreme premature infants and in setting where EONS prevalence was higher showed lower sensitivity and specificity ranging between 48.7 to 69% and 68.6 to 70%, respectively38,39. Our study confirms the inaccuracy of cord blood PCT in diagnosing neonatal sepsis. The lack of specificity that we observed may be related to the effect of maternal and neonatal medical or environmental conditions on PCT levels. In a large series involving 2′151 infants (26 with EONS), Joram et al. identified gestational age (28–32 weeks) and pH < 7.10 to be the only factors associated with increased PCT levels36. In our series, PCT was correlated with PROM, maternal fever, Apgar score, gestational age, infant heart and respiratory rate, suggesting that prenatal condition and newborn adaptation impact PCT level as displayed by a significant PCT level difference in healthy infants born from either the hospital (with maternal risk factors) or the sub-urban arm (no maternal risk factors).
Interestingly, in the sub-group of high-risk patients CD74/IP-10 ratio was shown for the first time to have a better accuracy for sepsis diagnosis than any studied biomarkers and clinical combinations. CD74, the invariant chain involved in MHC class II molecules transport, is identified as a prognosis marker in adult critically ill patients developing healthcare associated infections31. In our study, CD74 expression alone has a low accuracy for neonatal sepsis diagnosis, but its association with IP-10, the interferon-γ inducible protein-10, emerges as a good combination of biomarker. IP-10 is associated with various inflammatory conditions such as autoimmune diseases, hemophagocytic syndromes and viral infections where its combination with phospholipase A2, or IL-10 were suggested for sepsis diagnosis23,40,41,42. Combination of CD74 and IP-10, illustrating both antigen presentation ability and response to type II interferon stimulation, may be representative of both faces of neonatal immunological competency to infection. Ontogeny of antigen presentation in early life is thought to be a key factor in determining age-specific responses to microbes and other antigens. IP-10 production in infants reflects a consequent Th1 response and as such, it may represent in conjunction with a reduced CD74 expression, despite IFNγ stimulation, a signature for severely dysregulated response associated with neonatal sepsis.
Although well recognized in cancer, few publications relate CD74 utility in sepsis, none in children and neonates43,44. In contrast, in a study of critically ill septic adults, low expression of CD74 was frequently shown to be independently associated with mortality29. whereas secondary infection occurrence was associated with increased CD74 expression in the first day following admission for septic shock41. Our study further extend CD74 prognosis utility in neonatal sepsis. CD74 expression on cord blood of < 6.36–12.37 cutoff value was predictive of death in neonates with a sensitivity of 95–100% and a specificity of 10–36%, pending the model (Supplemental Table 1). Indirectly those results confirm those related to histocompatibility leukocytes antigen-DR expression on monocytes (mHLA-DR) that is known to be highly correlated (r = 0.87) with CD74 expression[38]. Low mHLA-DR was shown to be associated with EONS in premature infants and mortality following LONS45,46. The underlying pathophysiologic rational behind the association of low CD74/low mHLA-DR in infants and sepsis mortality may be resumed by an altered antigen presentation, either acquired or secondary to a perinatal event. Primary defect or decreased expression of mHLA-DR was shown to be associated with prematurity and altered myeloid cells functionality in extremely immature infants8,47. Secondary decrease of mHLA-DR in response to diverse aggression is well recognized. Decrease in mHLA-DR expression was demonstrated following sepsis, and is recognized as one of the main immunological caracterization of post-infective immune failure48,49,50. As such, the prolonged alteration of mHLA-DR was shown to be associated with mortality in adults with sepsis48,51,52,53. Serial mHLA-DR kinetics in septic newborns is largely unknown although a rise in HLA-DR negative monocytes following severe sepsis is reported54. Interestingly, in our study, infants surviving sepsis showed a prolonged alteration of CD74 expression up to 1 month following EONS (Fig. 4). Nevertheless, such prolonged post-sepsis reduction in CD74 transcription, as well as reduced mHLA-DR has never been described in both infants and adults. Newborns are known to have a rapidly evolving immunity during the first months of life. Olin et al. demonstrated in a longitudinal analysis of infant's immunity that a phenotypic convergence is occurring between term and preterm infants at 3 months of age, but in between environmental factors shape immune variation55. Interestingly they showed that drastic changes in cell composition and phenotypes, plasma protein concentrations occurred during the first few days of life bringing additional insights to the understanding of biomarkers kinetics and potential utility for diagnosing EONS. Accordingly, our study establishes the reference values of IL-6, IL-10, IP-10 and CD74, CX3CR1 during the first 4 and 12 weeks of life, respectively. These are the first published set of reference values from newborn and infants living in Sub Saharan Africa. Extrapolation of these reference values to infants outside Africa may be acceptable. We showed that gestational malaria did not impact any biomarkers values making these reference values applicable in region with no endemic malaria. In addition, a recent study showed that age-related immune patterns was not different between Africa, North America, South America and Europe despite environmental variations56.
In addition to the forehead mentioned biomarkers limitations, additional should be acknowledged. Although intensive workup has been set to obtain systematic microbiologic documentation, it is plausible that model 3 (based on culture positive sepsis) may under-evaluate the number of positive cases considering residual technical and organizational issues. However, the consistency of the analysis along the three models suggest that the impact is minimal. The most challenging methodologic issue was the follow-up of the children up to 3 months of age. Local individuals serving as official community advisor, organized local health care centers, midwifes and dedicated physicians and nurses organized the systematic follow-up of all children. Community advisor allowed to have close and honest collaboration with local authorities (village chief) permitting to reassure and pursue the follow-up.
Those results may directly affect management of infants with EONS in LRS. First, our data emphasize the importance of clinical criteria for EONS diagnosis and therefore the importance of implementing clinical curriculum to train midwifes, nurses and physicians taking care of neonates. Second, structured perinatal track at a regional level may help identifying high-risk populations and optimizing resources allocation. Altogether, this study illustrate how a structured and sequential management may help to reduce neonatal sepsis mortality4. Benefit of biomarkers for EONS in LRS is questionable especially in regards to cost-effectiveness and decision-making. In settings with high burden of sepsis and LRS, the low specificity of biomarkers may significantly increase unnecessary treatment and therefore having low cost-effectiveness and risk of aggravating the development of multiresistant pathogens hospital ecology.
In this study we showed that cord blood PCT, and all tested biomarkers, are inferior to clinical criterion for neonatal sepsis diagnosis in Sub-Saharan African population with maternal fever at delivery being a key risk factor for EONS Expression of CD74 was shown to be predictive of mortality in infants with neonatal sepsis. Kinetics of CD74 expression following neonatal sepsis showed a prolonged impairment in survivors. In high-risk patients, CD74/IP-10 ratio was found to have a good accuracy for neonatal sepsis diagnosis, depicting a novel signature for defective Th1 response and altered antigen presentation seen in sepsis and sepsis-associated immune depression.
Methods
Study design and participants
Participants were delivered in two sub-urban health centres (sub-urban arm) and three urban University hospitals (hospital arm) in the Abomey-Calavi, Sô-Ava and Cotonou districts in the South Benin region where malaria is hyper-endemic34. In both arms, only infants born from mother living in the Abomey-Calavi district were recruited to facilitate the follow-up and minimize effect of geographical origins. In the sub-urban arm, that includes only normal geatation with low-risk delivery (no maternal risk factors for infection), all consecutive births were included, whereas in the hospital arm only newborns born from mothers with maternal-foetal risk factors for infection (prematurity, prolonged rupture of the membrane, maternal fever) were included. In both arms, the exclusion criteria included maternal HIV positive status, major congenital malformation and refusal of consent. All children from both arms were followed clinically on a bi-monthly base during the first 3 months of life. The follow-up consisted of scheduled home visits and unscheduled emergency visits if the infant was ill. The study protocol was approved by the Comité d'Ethique de la Recherche – Institut des Sciences Biomédicales Appliquées (CER-ISBA 85-5). Written informed consent was obtained from parents. All methods were performed in accordance with the relevant guidelines and regulations.
Exposures and neonatal sepsis definition
The exposure were occurrence of gestational malaria (GM). GM was defined as a malaria infection during pregnancy or at delivery. For women in the suburban arm, malaria screening was performed at each scheduled prenatal visit using a thick blood smear. Mothers from the Hospital arm were screened only at the time of delivery. In this group, antenatal malaria was established on the basis of mother's anamnesis. For both study arms, placental blood smear and mother's peripheral blood smear were performed. The Lambaréné technique was used to quantify parasitaemia with a detection threshold of five parasites per microliter34. Neonatal sepsis was suspected in neonates with more than two of the following criteria being present: neutrophil count < 7500/mm3 or > 14 500/mm3, band form > 1500/mm3, immature/total neutrophils ratio > 0.16, platelets count < 150 000/mm3 and CRP > 10 mg/L. Suspected neonatal sepsis was considered as clinical sepsis when the following clinical signs were associated: temperature irregularity; respiratory distress or apnoea; seizures, altered tonus, irritability or lethargy; vomiting, altered feeding pattern, ileus; skin perfusion alteration, haemodynamic signs (tachycardia, hypotension); hypoglycaemic/hyperglycaemic, hyperlactatemia or identification of focal infection such as soft tissue infection or conjunctivitis19,57,58. All newborns with a clinical sepsis were subsequently adjudicated by one independent pediatrician (PT) and sorted into 'presumed sepsis' and 'definite clinical sepsis' grouped as "adjudicated sepsis". In discordant cases, a second independent pediatrician (ULT) performed the final adjudication with access, in addition to the full medical file review, to microbiological cultures results. Parallel to microbiological culture (BACT/ALERT® system), specific BioFire® FilmArray® panels (bioMerieux, Marcy-l'Etoile, France) were run for all positive blood cultures (Blood Culture Identification (BCID) panel), cerebrospinal fluids (meningitis/encephalitis panel), respiratory and gastrointestinal samples (Pneumonia and Gastro-Intestinal panels). All studied biomarkers were kept blinded for the adjudication.
Biomarkers sampling
At birth and at follow-up visits, the clinical examination data of the children were collected. Blood samples were obtained at birth, then at week (W)1, W4, W8 and W12. The study protocol has been described in detail elsewhere34. In brief, 18 mL cord blood at birth and 2 mL peripheral blood were collected in PAXgene™ Blood RNA tubes (PreAnalytix, Hilden, Germany) for transcriptomic biomarkers study. For protein biomarkers study 9 mL cord blood at birth and 500 µL to 1 mL peripheral blood were collected in heparin tubes. PAXgene™ Blood samples were stabilized at least 2 h at room temperature after collection and frozen at − 80 °C following the manufacturer's guidelines. Heparin blood samples were centrifuged at 1500 to 2000 rpm for 5 min. The plasma obtained was stored at − 80 °C.
RNA extraction, reverse transcription and quantitative PCR
Total RNA was extracted from cord blood by QIAsymphony SP/AS (QIAGEN Hilden, Germany) using PAXgeneTM Blood RNA Kit (PreAnalytix, Hilden, Germany) according manufacturer guidelines. The RNA integrity was measured prior to RNA amplification using a Bioanalyser 2100 (Agilent Technologies, Palo Alto, CA) in accordance with the manufacturer's instructions (RNA integrity number ≤ 6 were excluded [min 6.5–max 9.4]). The expression level of CX3CR1 and CD74 was measured by RT-qPCR using ABI7500 thermocycler (Applied BioSystems®, California,USA) from 10 ng of RNA samples using prototype Argene® kit (bioMerieux, France) following the manufacturer's instructions. The determination of the copy concentration of each gene is performed using a calibration curve. The results are expressed as the ratio of the concentrations of CX3CR1 or CD74 to those of HPRT1 (Hypoxanthine Phosphoribosyltransferase 1) used to normalize the gene expression results.
Protein quantification
PCT, IL-6, IL-10 and IP-10 proteins in plasma were analyzed in a batch by Simplex AssaysTM according to the manufacturer's instructions as previously described59. The Ella microfluidic analyzer (Protein Simple, San Jose, CA, USA) was used to assess cytokine concentrations60.
Outcomes
The primary outcome was the diagnosis of clinical neonatal sepsis, and secondary outcome was mortality within the first 3 months of life. Neonatal sepsis diagnosis was established by the local paediatrician based on the clinical examination of the child and initial laboratory workup including haemogram, C-reactive protein (CRP) and microbiological cultures (blood, cerebral fluids and urine). Neonatal sepsis that occurred within the first 72 h following birth was considered as an early onset neonatal sepsis (EONS), and late onset (LONS) thereafter (for detailed algorithm for sepsis diagnosis, see published study protocol34).
Statistical analysis
An independent statistician (FB) (Soladis Inc. Lyon, France; https://www.soladis.com) and IRD biostatistician (GA) supported the statistical methodology and performed all analysis. Statistical analyses were performed using R software version 3.6.1. The variables were assessed for normality using Kolmogorov Smirnov test. Numbers and frequency were used for qualitative data and medians and IQR (inter-quartile range: [Q1–Q3]) for quantitative data. Qualitative variables were compared using the Chi-squared test (or Fisher's exact test for small expected numbers). The distribution of quantitative data was compared using Student's t-test (or the Mann–Whitney t-test when distribution was not normal or Welch test when homoscedasticity was rejected) if 2 groups were compared. If more than 2 groups, the distribution of quantitative data was compared using Anova test (or the Kruskal–Wallis test when distribution was not normal or when homoscedasticity was rejected).
To evaluate their diagnostic accuracy, data-driven analysis was performed. Three models were used:
Model 1 encompassed only Hospital patients either with or without clinical sepsis; Model 2 enriched the non-sepsis group with unseptic patient from the suburban arm. Model 3 refined the sepsis group with only the culture positive sepsis considered. Selection of cut-off values or discrimination values defining the positive and negative test results were performed. Several methods for selecting optimal cut-off values in diagnostic tests are proposed in the literature depending on the underlying reason for this choice. Here, we selected a cut-off to have a sensitivity of 0.95 and maximize specificity. This choice of cut-off was the same in the rest of the publication61. CD74/IP-10 was the score corresponding to the division of CD74 gene expression level by IP-10 serum concentration. We used three datasets to test more complex models, either genes (noted CX3CR1 & CD74), proteins (noted Protein biomarkers) or sets of biomarkers (noted All biomarkers). To avoid overfitting and to compare our models, we used random sampling which takes place within each class and must preserve the overall distribution of data by class. To do this, we created a distribution, repeated 200 times, of 75/25% of the data. This distribution was used to optimize hyperparameters with package caret. Then we compared the average AUC and select the best average AUC for each dataset between all models. AUC accuracies were compared using Bootstrap approach. A p value < 0.05 was considered as significant.
For comparison between clinical variables (VC) and biomarkers, we selected the clinical variables of interest following an expert opinion (PT) and corresponding to neonatal risk factors (eg. Gestational age, weight, maternal risk factors, multiple gestation, APGAR score) (Supplementary Table 1). In order to compare clinical and biomarker data, we transformed the data into the same referential to be able to compare them. We transformed the categorical clinical variables into a complete set of dummy variables62. Different transformations were then applied to the data set. A Yeo-Johnson transform is a non-linear transformation that reduces skewness and approximates a normal law. We centered (subtracts the mean of the variable's data) and scaled data (divides the standard deviation).
For the establishment of heatmap, Partial Last Squares (PLS) Regression was used to compare the two datasets. This algorithm comes from the mixOmics package. Biomarkers were deflated with respect to the information extracted/modelled from the local regression on Clinical Variables. Consequently, the latent variables computed to predict Biomarkers from Clinical Variables are different from those computed to predict Clinical Variables from Biomarkers. One matrix Clustered Image Map (CIM) is a 2-dimensional visualization with rows and/or columns reordered according to some hierarchical clustering method to identify interesting patterns. The CIM allows to visualize correlations between variables. Generated dendrograms from clustering were added to the left side and to the top of the image. The used clustering method for rows and columns is the complete linkage method and the used distance measure is the distance Euclidean. We showed only variables with co-variances greater than max(covariance)/262.
To study clinical items and biomarkers factors associated with clinical sepsis, and death, we used univariate and multivariate logistic regress...
Comments
Post a Comment