Abstract
COVID-19 survival data presents a special situation where not only the time-to-event period is short, but also the two events or outcome types, death and release from hospital, are mutually exclusive, leading to two cause-specific hazard ratios (csHR d and csHR r ). The eventual mortality/release outcome is also analyzed by logistic regression to obtain odds-ratio (OR). We have the following three empirical observations: (1) The magnitude of OR is an upper limit of the csHR d : |log(OR)| ≥ |log(csHR d )|. This relationship between OR and HR might be understood from the definition of the two quantities; (2) csHR d and csHR r point in opposite directions: log(csHR d ) ⋅ log(csHR r ) < 0; This relation is a direct consequence of the nature of the two events; and (3) there is a tendency for a reciprocal relation between csHR d and csHR r : csHR d ∼ 1/csHR r . Though an approximate reciprocal trend between the two hazard ratios is in indication that the same factor causing faster death also lead to slow recovery by a similar mechanism, and vice versa, a quantitative relation between csHR d and csHR r in this context is not obvious. These results may help future analyses of data from COVID-19 or other similar diseases, in particular if the deceased patients are lacking, whereas surviving patients are abundant.
1 Introduction
Survival analysis studies the longitudinal event data. Regression in survival analysis investigates whether a factor contributes to the hazard (rate of risks) of the event under study. The hazard ratio (HR) is the ratio of two hazards, one with the factor taking the at-risk value (e.g. smoking) and another without (e.g. not-smoking). Since hazard and HR describes the instantaneous risk, or rate of event occurrence (e.g. death from a specific disease), it is a very different concept from the life-long risk of having that event [1]. As a result, regression in survival analysis (e.g. Cox regression) is different from the static case-versus-control regression analysis (e.g. logistic regression). Take the following two statements as example: “smoking makes lung cancer patients die faster” and “smoking makes a person more likely to die from lung caner than a non-smoker”; the first would be a conclusion from a survival analysis, whereas the second from a case-control type of analysis.
The COVID-19 pandemic since 2020 [2–4] provides a unique longitudinal event data. First of all, a COVID-19 patient admitted to a hospital sees his/her outcome relatively quickly: either the patient survived or does not in a matter of days. As a result, there are very few right-censored data where the outcome is still unknown at the time of data collection. Of course, there exist chronic or long COVID-19 survivors who are not completely cured [5–9], but they are unlikely to die from COVID-19 in the future.
The second feature of COVID-19 longitudinal event data is that the two events, death and release from the hospital, are not the traditional “competing risk” events [10, 11]. Although not strictly defined as such, competing risks events are often two unfavorable events with one occurring before the occurrence of another. In COVID-19 data, the event of being released from hospital is a favorite event, and a description of them in principle should not be connected to words like “risk” or “hazard”. A higher HR for the event of releasing from hospital implies a faster recover, thus a factor that contributes to this higher HR actually provide protection. A better name to describe death and release event pairs could just be “competing events” without using the word “risk”.
Also, in the COVID-19 data, the event of death and the event of released from hospital are mutually exclusive. Although organ transplant and death can be mutually exclusive when the organ involved is (e.g.) heart, transplant of many other types of organ is an event that preceed, and may have an impact on, death. Even in the case of heart transplant, survival after the operation is not completely guaranteed. Regardless of these detail, factors affecting transplant timing are basically external, whereas those affecting mortality without a transplant are mostly internal. Our COVID-19 death/release mutually exclusive event pair does not have a correspondence in death/organ-transplant pairs.
As first proposed in Kalbfleisch and Prentice [12] (see also, e.g. [10, 13]), given the event time (T, K) where T is the time to event (or to censoring), K = 1, 2 for two event types (we may understand that k = 0 means right-censored), the cause-specific hazard function can be defined as:
where K for event type (1 or 2), and conditioning T ≥ t means the function is defined before the occurring of either event, and x is a covariate. Equation (1) is the per unit time probability that only event-K occurs. When K = 1 events are considered (e.g. death), K = 2 events (e.g. release) are converted to right-censored (which is essentially equivalent to K = 0), and
When studying the impact of the effect of a covariate x, we assume an exponential contribution from x on the baseline hazard in Eq. (1) (Cox proportional hazard model), i.e.
We study the two cause-specific hazard ratios (HRs), one for time-to-death (treating release event as right-censored) and another for time-to-release (then treating death event as right-censored):
where x is the independent binary factor (for continuous factor, the definition is similar, with two hazards evaluated at x-levels differing by 1 unit), and the time dependency is supposedly canceled. The question we ask: what is the relationship between the two cause-specific hazard ratios, csHR k=death and csHR k=rel? Intuitively, if a factor value leads to faster death, the same factor may lead to slow recovery, and vice versa. In other words, a larger csHR k=death may imply a smaller csHR k=rel. Our working hypothesis is that csHR k=death ≈ 1/csHR k=rel, which is also hypothesized to be approximately equal to the odds-ratio from a logistic regression analysis.
If the event time is not long, as is the case for COVID-19 patients, at certain fixed time all samples will have one of the two events (death and release) occurred. Odds ratio (OR) for binary variable x is defined as:
where N death(x = 1) is the number of deceased patients with x = 1, N rel(x = 1) is the number of released patients with x = 1, etc. The subscript “death” can be dropped because it is understood that we are interested in how the presence of a x value contributes to the death. For continuous variable x, x = 0 and x = 1 is replaced by a unit change of the variable value x = x 0 and x = x 0 + 1, averaged over all x 0. OR is not defined in the survival analysis, but is intrinsically related to the HR. A possible relationship between OR and HR is another hypothesis.
We will use a survival data of n = 450 COVID-19 test our working hypotheses. Previously we asked the question on whether the two survival analyses and one logistic regression can all identify a risk factor [15]. Here we are asking more quantitative questions concerning these analyses.
2 Data
The COVID-19 patients dataset (n = 450) used in this study was collected from the Tokat State Hospital. Electronic medical records, including patient demographics, clinical manifestation, comorbidities, laboratory tests results were collected. According to the severity and outcomes of the patients, they were divided into two groups: deceased/nonsurviving, released/survived severe groups. Clinical and laboratory data were comparable among the two groups. Ministry of Health permission and the ethics committee of Tokat GaziOsmanPasa University Ethics committee permission was obtained with the number 83116987/360 on March 4, 2021.
Besides age and gender, we selected these 18 laboratory testing measurements at the time of hospital admission in the survival analysis n value is the number of samples with measurement value): (from the complete blood count panel) white blood cell (WBC) count (n = 432), neutrophil (NEU) count (n = 383), lymphocyte (LYM) count (n = 382), hemoglobin (HGB) (n = 432), platelet (PLT) (n = 432), mean corpuscle volume (MCV) (n = 432), mean platelet volume (MPV) (n = 430); (from metabolic panel) glucose (n = 449), alanine adinotransferase (ALT) (n = 435), aspartate aminotrasferase (AST) (n = 429), blood urea nitrogen (urea or BUN) (n = 436), creatine (n = 436), calcium (n = 393), potassium (n = 433), sodium (n = 435); (others) ferritin-1 (FER1) (n = 407), d-dimer (n = 390), and lactate dehydrogenase (LDH) (n = 316). The NLR (neutrophil/lymphocyte ratio) and PLR (platelet/lymphocyte ratio) are derived quantities. There are other test measurements, either only available for fewer number of patients, or due to other reasons, that are not included in the analysis.
3 Methods
The single-variable Cox regression in Eq. (2) can be extended to multivariate context, and the cause-specific log hazard ratio is defined as:
The left-hand side of Eq. (5) contains time t whereas the right-hand side does not, which is the proportional hazard assumption, that the time-dependent part is canceled. i is the index for factors (the index i on the left hand size of Eq. (5) is implied). From Eq. (5), it can be seen that csH
The R (https://www.r-project.org/) statistical package survive [16] is used in the analysis. The coxph is used for Cox regression, cox.zph is used for testing proportional hazard assumption, based on Schoenfeld residual method [17].
4 Results
Summary statistics: Of the n = 450 samples, 353 (78%) are released from the hospital, 97 (22%) were deceased, with a deceased/released ratio of 27.5%. There is no right-censored patients in this collection. A 57.6% of patients are male, and this proportion is slightly lower for the released group (56.1%), as compared to the deceased group (62.9%). The mean/median age of all patients is 59.7/66, and the mean/median age for the released group is much younger (55.8/60) than that for the deceased group (74.1/75).
Table 1 provides a summary statistics of all 18 factors, for all patients, released group, and deceased group. Both mean and median value are listed. The following variables do not seem to follow a normal distribution ferritin-1, d-dimer, glucose, ALT, AST, urea, creatine, LDH, NEU, and perhaps LYM and PLT. These can either be due to a long-tail in the distribution (there are few samples with extreme large values compared to the mean/median) or perhaps due to a potentially log-normal distribution (then the variable is better logarithm transformed), such as ferritin-1.
Summary statistics of the used factors: mean/median value for all samples, released samples, and deceased samples; t and Wilcoxon test p-values for comparing between released and deceased samples; and whether the factor is better modeled by a log-normal distribution. P-values smaller than 0.005 are shown in boldface.
Factor | Mean/median | t/Wilcoxon p-value | Long-tail | ||
---|---|---|---|---|---|
All | Released | Deceased | |||
FER1 | 497.2/206 | 1096.3/930 | 314.8/123.6 | 2.6E-17/1.6E-24 | Yes |
d-dimer | 1.12/0.51 | 2.32/2.54 | 0.73/0.38 | 5.7E-18/4.9E-23 | Yes |
Glucose | 139.8/113.2 | 196.6/174.5 | 124.4/106 | 5.7E-10/1.3E-18 | Yes |
ALT | 63.8/26.7 | 150/29 | 39/26 | 0.0045/0.088 | Yes |
AST | 112.4/31.1 | 376/51.9 | 35.4/29 | 0.0016/5.5E-10 | Yes |
Urea | 57.9/34.4 | 132.5/106.5 | 36.5/30.4 | 2.4E-19/1.9E-37 | Yes |
Calcium | 8.6/8.7 | 7/7/7.7 | 8.9/8.9 | 1.7E-30/5.8E-30 | |
Creatine | 1.3/0.8 | 2.5/2.1 | 0.91/0.74 | 2.2E-14/4.8E-25 | Yes |
LDH | 472.6/297.1 | 912.4/512.5 | 291.9/257.6 | 0.0004/7.8E-25 | Yes |
Potassium | 4.4/4.3 | 4.8/4.7 | 4.3/4.3 | 3.8E-5/7.8E-5 | |
Sodium | 140.6/140 | 143.7/143.1 | 139.7/139.8 | 4.4E-7/1.8E-8 | |
WBC | 9/7 | 15.7/14.3 | 7.1/6.4 | 2.4E-17/3E-28 | |
NEU | 7.2/4.9 | 14.3/13 | 5/4.1 | 5.8E-19/1.4E-31 | Yes |
LYM | 1.4/1.2 | 0.79/0.58 | 1.6/1.4 | 2.1E-14/1E-22 | |
HGB | 12/12.1 | 10.4/10.2 | 12.5/12.6 | 2.2E-14/1.6E-15 | |
PLT | 87.4/87.9 | 89.9/90.6 | 86.7/87.2 | 0.00015/1E-5 | |
MCV | 238.5/221 | 192.8/184 | 251.7/237 | 2.8E-e/2.4E-7 | |
MPV | 10.3/10.1 | 11.3/11.1 | 10/9.9 | 7.2E-14/1.6E-16 |
As a consequence of potential violation of normal distribution, for the test result between the levels for the released and deceased groups, we present both t-test p-values and Wilcoxon test p-values in Table 1. A striking observation of the result in Table 1 is that all factors are significantly different between the released and the deceased group. The deceased patients exhibit distinct level of many factors and form a cluster by itself. We have noticed this already in Cetin et al. and Ulgen et al. [15, 18, 19].
The mean/median time to either dead or release events is 10.3/8, the mean/median of time to release is 9.5/8, and that of time to death is 13.2/11. In other words, the time-to-death tends to be 2–3 days longer than the time-to-release. For both time-to-release and time-to-death, the logarithm-transformed time follows a normal distribution better than the non-log-transformed time. Though not included in this data, we also observed that ICU surviving patients have a hospitalization stay time longer than those of non-ICU surviving patients, and shorter than those of ICU-deceased patients [20].
Overview of the survival analysis and logistic regression analysis results: Large number of analysis run results are included in Tables 2 –4. Table 3 contains factors in a metabolic panel, Table 4 are factors in a complete blood count panel, and Table 2 lists the rest. The first column is the result from single-factor Cox regression survival analysis using death as event of interest and release as right-censored event. The second column is the Cox regression results by switching the two events. The listed results include the cause-specific hazard ratio (csHR) and its 95% confident interval (CI), and the p-value for testing csHR equal to 1. The third column is the logistic regression result comparing the dead and release samples, where the results include odds-ratio (OR) and its 95% CI, and p-value for testing OR = 1.
Results from two cause-specific survival analyses and logistic regression analysis with a single factor: gender, age, FER1, d-dimer, and LDH. The csHR d (95% CI) is the cause-specific hazard-ratio for time-to-death event and its 95% confidence interval; pv d is the corresponding p-value; csHR r and pv r are hazard ratio and p-value for time-to-release event; OR (95% CI) and pv (LR) are odds-ratio (and its 95% confidence interval) and p-value from logistic regression. p-values smaller than 0.005 are shown in boldface. All similar results for log-transformed factor value and discretized (binarized) factors are also shown, where the threshold used to discretization are given in the first column.
Factor | csHR d (95% CI) | pv d | csHR r (95% CI) | pv r | OR (95% CI) | pv (LR) |
---|---|---|---|---|---|---|
Age | 1.052 (1.033, 1.072) | 9e-8 | 0.973 (0.968, 0.978) | 3.5e-26 | 1.076 (1.054, 1.099) | 9.4e-12 |
≥70 | 3.705 (2.259, 6.078) | 2.1e-7 | 0.461 (0.368, 0.577) | 1.4e-11 | 7.69 (4.51, 13.09) | 6e-14 |
Gender | 1.048 (0.689, 1.594) | 0.83 | 1.381 (1.118, 1.706) | 0.0028 | 0.754 (0.475, 1.197) | 0.23 |
FER1 | 1.0007 (1.0004, 1.001) | 3.1e-7 | 0.9987 (0.9984, 0.999) | 3.1e-18 | 1.002 (1.001, 1.002) | 4.3e-19 |
log(FER1) | 1.703 (1.395, 2.077) | 1.6e-7 | 0.645 (0.6, 0.693) | 2.6e-33 | 3.108 (2.402, 4.022) | 6.5e-18 |
|
2.66 (1.751, 4.039) | 4.5e-6 | 0.26 (0.182, 0.371) | 1.1e-13 | 10.88 (6.35, 18.64) | 3.5e-18 |
d-dimer | 1.558 (1.356, 1.789) | 3.6e-10 | 0.561 (0.486, 0.647) | 2.1e-15 | 2.501 (2.051, 3.049) | 1.3e-19 |
log(dd) | 1.938 (1.552, 2.419) | 5.2e-9 | 0.571 (0.517, 0.632) | 1e-27 | 3.347 (2.545, 4.402) | 5.4e-18 |
|
3.259 (2.11, 5.034) | 1e-7 | 0.319 (0.232, 0.439) | 2.2e-12 | 10.17 (6.007, 17.220) | 6e-18 |
LDH | 1.0001 (1, 1.0002) | 0.03 | 0.997 (0.996, 0.998) | 8.6e-10 | 1.008 (1.006, 1.01) | 4.4e-13 |
log(LDH) | 1.884 (1.574, 2.254) | 4.7e-12 | 0.298 (0.214, 0.415) | 7.1e-13 | 35.22 (14.89, 83.30) | 5.1e-16 |
|
4.975 (3.152, 7.852) | 5.5e-12 | 0.235 (0.154, 0.36) | 2.3e-11 | 21.15 (11.37, 39.35) | 5.6e-22 |
Similar to Table 2 but for factors measured by a metabolic panel blood test.
Factor | HR d (95% CI) | pv d | HR r (95% CI) | pv r | OR (95% CI) | pv (LR) |
---|---|---|---|---|---|---|
Glucose | 1.004 (1.002, 1.005) | 1.3e-06 | 0.994 (0.992, 0.996) | 2.5e-08 | 1.013 (1.009, 1.016) | 1.8e-12 |
(log)glucose | 2.976 (2.027, 4.371) | 2.7e-08 | 0.44 (0.335, 0.577) | 3.1e-09 | 11.34 (6.13, 20.98) | 1e-14 |
|
3.49 (2.327, 5.237) | 1.5e-09 | 0.385 (0.277, 0.535) | 1.3e-08 | 9.25 (5.5, 15.54) | 4.5e-17 |
ALT | 1.0004 (1, 1.0008) | 0.044 | 0.997 (0.995, 0.999) | 0.0018 | 1.007 (1.003, 1.01) | 3.8e-05 |
log(ALT) | 1.27 (1.09, 1.479) | 0.0021 | 0.895 (0.809, 0.989) | 0.03 | 1.444 (1.161, 1.797) | 0.00099 |
|
3.7 (2.23, 6.15) | 4.4e-07 | 0.222 (0.092, 0.537) | 0.00084 | 16.22 (5.88, 44.79) | 7.5e-08 |
AST | 1.0002 (1, 1.0004) | 0.016 | 0.994 (0.99, 0.998) | 0.0024 | 1.02 (1.011, 1.028) | 2.5e-06 |
log(AST) | 1.418 (1.265, 1.589) | 1.8e-09 | 0.705 (0.604, 0.823) | 1e-05 | 3.26 (2.29, 4.65) | 6.9e-11 |
|
3.63 (2.3, 5.728) | 3.1e-08 | 0.371 (0.213, 0.646) | 0.00046 | 8.99 (4.4, 18.35) | 1.6e-09 |
Urea | 1.008 (1.006, 1.01) | 6.6e-21 | 0.985 (0.981, 0.989) | 6.9e-14 | 1.043 (1.034, 1.053) | 1.5e-20 |
log(urea) | 3.398 (2.671, 4.323) | 2.3e-23 | 0.505 (0.431, 0.591) | 2.6e-17 | 22.35 (12.3, 40.6) | 2.1e-24 |
|
9.82 (5.93, 16.26) | 7.2e-19 | 0.205 (0.138, 0.304) | 3.5e-15 | 47.44 (25.08, 89.72) | 1.7e-32 |
Calcium | 0.501 (0.412, 0.608) | 3.1e-12 | 1.875 (1.637, 2.147) | 1.1e-19 | 0.107 (0.066, 0.173) | 6.3e-20 |
|
0.231 (0.151, 0.352) | 9.6e-12 | 4.816 (3.143, 7.38) | 5.2e-13 | 0.049 (0.027, 0.089) | 2.8e-23 |
Creatine | 1.34 (1.242, 1.446) | 5.3e-14 | 0.675 (0.585, 0.779) | 6.7e-08 | 2.663 (2.078, 3.414) | 1.1e-14 |
log(CRE) | 2.679 (2.143, 3.349) | 5e-18 | 0.622 (0.527, 0.735) | 2e-08 | 8.65 (5.51, 13.61) | 8.9e-21 |
|
6.051 (3.987, 9.184) | 2.7e-17 | 0.236 (0.153, 0.364) | 6.3e-11 | 25.53 (14.03, 46.45) | 2.8e-26 |
Potassium | 1.457 (1.204, 1.763) | 0.00011 | 0.73 (0.631, 0.843) | 1.9e-05 | 2.499 (1.808, 3.455) | 3e-08 |
|
2.756 (1.813, 4.191) | 2.1e-06 | 0.326 (0.215, 0.495) | 1.4e-07 | 8.02 (4.47, 14.37) | 2.7e-12 |
Sodium | 1.111 (1.075, 1.149) | 5.8e-10 | 0.957 (0.936, 0.978) | 8.7e-05 | 1.2 (1.14, 1.27) | 1.3e-10 |
|
3.327 (2.194, 5.045) | 1.5e-08 | 0.266 (0.161, 0.44) | 2.4e-07 | 12.41 (6.49, 23.73) | 2.6e-14 |
Similar to Table 2 but for factors measured by a complete blood count panel test.
Factor | csHR d (95% CI) | pv d | csHR r (95% CI) | pv r | OR (95% CI) | pv (LR) |
---|---|---|---|---|---|---|
WBC | 1.08 (1.06, 1.1) | 3.2e-15 | 0.869 (0.841, 0.897) | 4.7e-18 | 1.368 (1.279, 1.464) | 6.7e-20 |
log(WBC) | 3.996 (2.827, 5.648) | 4.3e-15 | 0.352 (0.284, 0.437) | 3.4e-21 | 28.2 (14.24, 55.84) | 9.6e-22 |
|
5.056 (3.306, 7.732) | 7.7e-14 | 0.217 (0.145, 0.324) | 8.8e-14 | 22.02 (12.35, 39.25) | 1e-25 |
NEU | 1.085 (1.064, 1.105) | 5.2e-17 | 0.85 (0.819, 0.882) | 1.3e-17 | 1.421 (1.316, 1.533) | 1.9e-19 |
log(NEU) | 3.77 (2.775, 5.131) | 2.5e-17 | 0.402 (0.337, 0.48) | 5.9e-24 | 21.52 (11.31, 40.92) | 8.2e-21 |
|
6.35 (3.975, 10.15) | 1.1e-14 | 0.238 (0.162, 0.35) | 2.7e-13 | 24.21 (13.31, 44.05) | 1.7e-25 |
LYM | 0.243 (0.157, 0.375) | 1.8e-10 | 1.18 (1.082, 1.286) | 0.00017 | 0.124 (0.0709, 0.2167) | 2.3e-13 |
log(LYM) | 0.35 (0.276, 0.442) | 2.1e-18 | 1.73 (1.461, 2.05) | 2.1e-10 | 0.095 (0.0555, 0.1626) | 9.3e-18 |
|
0.232 (0.152, 0.354) | 1.2e-11 | 4.669 (2.895, 7.529) | 2.6e-10 | 0.052 (0.0275, 0.0972) | 3.8e-20 |
HGB | 0.856 (0.781, 0.938) | 0.00085 | 1.253 (1.192, 1.318) | 1.5e-18 | 0.615 (0.542, 0.697) | 3.6e-14 |
|
0.605 (0.397, 0.923) | 0.02 | 3.698 (2.544, 5.374) | 7.1e-12 | 0.145 (0.084, 0.251) | 5.1e-12 |
PLT | 0.9968 (0.995, 0.9986) | 0.00064 | 1.0004 (0.9996, 1.0012) | 0.33 | 0.994 (0.991, 0.996) | 1.9e-6 |
log(PLT) | 0.74 (0.5908, 0.927) | 0.0088 | 1.336 (1.109, 1.609) | 0.0023 | 0.27 (0.168, 0.434) | 6.1e-8 |
|
0.695 (0.411, 1.175) | 0.17 | 3.341 (1.915, 5.831) | 2.2e-5 | 0.166 (0.0785, 0.35) | 2.5e-6 |
MCV | 1.048 (1.012, 1.085) | 0.0093 | 0.96 (0.943, 0.976) | 2e-6 | 1.085 (1.044, 1.128) | 3.8e-5 |
|
2.179 (1.433, 3.313) | 0.00027 | 0.582 (0.426, 0.795) | 0.00066 | 3.547 (2.112, 5.955) | 1.7e-6 |
MPV | 1.322 (1.181, 1.48) | 1.2e-6 | 0.764 (0.701, 0.832) | 8.8e-10 | 2.326 (1.876, 2.884) | 1.5e-14 |
|
2.45 (1.629, 3.685) | 1.7e-5 | 0.381 (0.272, 0.533) | 1.8e-8 | 6.959 (4.131, 11.722) | 3e-13 |
NEU/LYM | 1.023 (1.0179, 1.028) | 5.7e-20 | 0.908 (0.886, 0.931) | 3.4e-14 | 1.219 (1.166, 1.274) | 1.6e-18 |
log(NLR) | 2.721 (2.234, 3.315) | 2.5e-23 | 0.556 (0.496, 0.624) | 1.4e-23 | 10.471 (6.406, 17.115) | 7.4e-21 |
|
10.54 (5.95, 18.69) | 7.3e-16 | 0.182 (0.121, 0.272) | 1.3e-16 | 51.64 (26.04, 102.42) | 1.5e-29 |
PLT/LYM | 1.0003 (1.0002, 1.0004) | 1.8e-5 | 0.998 (0.997, 0.999) | 3.6e-6 | 1.004 (1.0026, 1.0054) | 1.5e-8 |
log(PLR) | 1.871 (1.472, 2.377) | 3.1e-7 | 0.82 (0.721, 0.934) | 0.0027 | 2.41 (1.70, 3.42) | 7.9e-7 |
|
3.698 (2.417, 5.656) | 1.6e-9 | 0.43 (0.3, 0.616) | 4.1e-6 | 6.77 (3.93, 11.68) | 6.2e-12 |
We also run the same group of analysis on log-transformed factor values, if that factor better follows a normal distribution after log transformation. Then, we run the same set of analysis, when the factor value is continuous, for binarized factors with optimally chosen threshold values. Both these runs will be discussed in detail later. The reason for running large number of analyses is not for “fishing expedition” in order to have a better chance to find statistically significant results, but to test the robustness of the results. Therefore, we do not do a multiple testing correction.
The proportional hazard ratio assumption is tested by the Schoenfeld residual method in implemented in the R function “cox.zph” in the “survival” package [17]. The test result sometimes depends on if the independent variable is log-transformed or not. We found that the proportional hazard ratio assumption is not rejected for time-to-death events, and mostly not rejected (at 0.01 level) for time-to-release events, except for age (pv = 0.0014), (log)d-dimer (pv = 3E-6), and (log)ALT (pv = 5E-5).
We mark those p-values that are smaller the 0.005 in Tables 2 –4. The reason to use 0.005 instead of 0.01 or 0.05 is explained in Ioannidis and Colquhoun [21, 22], and the practice of always adding a level when using the word “significant” is proposed in Wasserstein et al. [23]; see also Li et al. [24]. Strikingly, almost all factors significantly (at 0.005 level) influence the rate of event of COVID-19 patients, and are significantly different between the deceased and survived group.
Relationship between HR d and HR r for continuous factors: Another striking observation is the relationship between the two cause-specific hazard ratios. Denote csHR d for csHR of the event of death from COVID-19 and csHR r for csHR of the event of COVID-19 patient releasing from hospital. it can be easily seen from Tables 2 –4 that if csHR d > 1, the corresponding csHR r < 1, and vice versa. A simple mathematical expression of this fact is:
The only exception is the factor of gender. But the 95% CI is so large to have both
Tables 2 –4 seem to also show that the larger csHR d , and smaller csHR r , and vice versa. In order to check if there is a numerical relationship between csHR d and csHR r , we plot 1/HR r as function of csHR d in Figure 1. The line csHR d × csHR r = 1 is marked by the slope = 1 line in Figure 1. There are many factors clustered near the csHR d = csHR r = 1 point and a close-up plot is shown separately. A factor is labeled in red if p-values for both csHR is significantly (at level 0.001) different from 1, and in blue if one or both csHR is not significant. Our working hypothesis can be written as a reciprocal relation between csHR d and csHR r :

The x-axis is the cause-specific hazard ratio csHR d for death event, and y-axis is reciprocal of the hazard ratio for the release event (1/HR r ), for the 18 blood test measurements as well as age and gender. The diagonal line indicates the exact relationship csHR d = 1/csHR r . A factor is in red if its p-values (for testing csHR d and csHR r = 1) are both smaller than 0.001; in blue if both p-values are larger than 0.001; and light-blue if one of the two p-values is smaller than 0.001. Because there are many factors having HR close to 1, the right subplot presents a close-up near csHR d = csHR r = 1.
Extension of the relationship between HR d and HR r in a multivariate context: One may wonder whether the approximate reciprocal relationship between HR d and HR r for a variable when other variables are also used in a multiple cause-specific Cox regression. Because adding more variables in a multiple regression often leads to unpredictable outcome due to collinearity between variables, and due to overfitting when the variable-per-sample ratio is too high, we investigate a simple situation: we run a three-variable Cox regression with the variable of interest, plus gender and age co-variates.
Table 5 shows the cause-specific hazard ratio of 18 continuous factors (log-transformed if necessary) conditional on gender and age, for either time-to-death or time-to-release. Without exception, if one of the csHR d or csHR r is larger than 1, the other is smaller than 1. The product of the two hazard ratios are close to 1 except for log(urea), log(creatine), and log(LYM). The urea and creatine factors are highly correlated, and both are significantly correlated with lymphocyte.
Cause-specific hazard ratio with dead as the event (csHR d ) and that with release as the event (csHR r ), conditional on gender and age covariates. The last column shows the product of the two hazard ratios.
Factor | csHR d | csHR r | csHR d ⋅ csHR r |
---|---|---|---|
log(FER1) | 1.62 | 0.68 | 1.10 |
log(d-dimer) | 1.60 | 0.78 | 1.25 |
log(glucose) | 2.82 | 0.65 | 1.84 |
log(ALT) | 1.29 | 0.90 | 1.16 |
log(AST) | 1.38 | 0.73 | 1.01 |
log(urea) | 3.11 | 0.66 | 2.04 |
Calcium | 0.51 | 1.60 | 0.82 |
log(creatine) | 2.52 | 0.80 | 2.03 |
log(LDH) | 1.77 | 0.40 | 0.71 |
Potassium | 1.39 | 0.77 | 1.07 |
Sodium | 1.10 | 0.95 | 1.04 |
log(WBC) | 3.39 | 0.40 | 1.35 |
log(NEU) | 3.33 | 0.47 | 1.55 |
log(LYM) | 0.39 | 1.28 | 0.50 |
HGB | 0.91 | 1.26 | 1.15 |
MCV | 1.03 | 0.97 | 1.00 |
log(PLT) | 0.79 | 1.21 | 0.95 |
MPV | 1.30 | 0.82 | 1.07 |
Relationship between hazard (rate) ratio and odds (risk) ratio: As emphasized in Sutradhar and Austin [1], survival analysis estimates the relative rates (of risk) whereas case-control type of analysis such as logistic regression estimates the relative (static or cumulative) risks. Tables 2
–4 show that OR seems to have a larger magnitude than csHR
d
. Figure 2 shows y = OR as a function of x = csHR
d
. Unlike Figure 1 where dots are scattered near the slope = 1 line, in Figure 2, dots systematically deviates from the diagonal line. In fact, if a factor is a risk (OR

The x-axis is the cause-specific hazard ratio csHR d for death event, and the y-axis the odds-ratio (OR) from logistic regression, for 20 factors. The right subplot presents a close-up near csHR d = OR = 1.
Equation (8) might be proved in a simple approximation as follows: the risk function F(t) is known to be related to hazard rate function h(t):
Therefore, the odds-ratio is (the subscript 1, 2 refers to two states in a binary variable or a two numerical level of a continuous factor with one unit difference, and not refers to the two competing-risks):
In the proportional hazard assumption, h
1(t) = α
1
h
0(t), h
2(t) = α
2
h
0(t), where h
0(t) is a baseline hazard function, and denote
One approach in getting the approximation in Eq. (11) is the Taylor expansion assuming small H 0(t) [25].
Relationship between csHR d and csHR r for binarized continuous factors: The HR for continuous factors measures the ratio of two hazard rates when the unit of the factor increases by one. Therefore, when one unit change is negligible compared to the possible range, HR can be very close to 1. In order to see the true impact of a continuous variable, we discretize continuous factors into levels. Although one can choose three levels for below-normal, normal, and above-normal, the normal range of a factor may not be universally accepted.
We use binary levels (higher and lower than a threshold) where the threshold value is a compromise between two selections: the first threshold is chosen to maximize the Youden index [26], which is simply the sum of sensitivity and specificity (minus 1). The second threshold is chosen by providing the population prevalence of cases (which is set at 10%), which in turn gives weight to samples in the dataset (see, https://www.medcalc.org/manual/roc-curves.php and [27]). Both thresholds are obtained from the medcalc.org program. The final threshold is a geometric mean of the Youden-based threshold and that after considering the 10% population case prevalence. The resulting threshold values for all factor (except for age, neutrophil/lymphocyte ratio, platelet/lymphocyte ratio, where the thresholds are more intuitively selected) are given in Tables 2 –4. The resulting csHR d and csHR r have larger magnitude than the corresponding continuous value, because the “unit change” is much larger.
In order to study the numerical relationship between csHR d and csHR r for binarized factors, we examine other possible threshold values beyond that determined by the medcalc program and plot csHR d (red) and 1/csHR d (blue) as a function of threshold value, for 19 test measurements, in Figure 3. The 95% confidence interval (CI) of csHR d or 1/csHR r is marked with dash vertical lines. If the discretized factor is not significant at a corresponding threshold, red dots turn pink and blue dots turn light-blue. We also mark normal ranges of blood tests from two different sources (as grey horizontal lines) and the threshold used in Table 1 (as downward arrow in grey). We consistently found the 95% CI of csHR d and 1/csHR r overlap with each other at the chosen (optimal) threshold value. In other words, when a reasonable threshold value is used to convert a continuous factor to a binary factor, and running two survival analyses results in a roughly reciprocal relationship between the two cause-specific hazard ratios.

The csHR d (red) and 1/csHR r (blue) for binarized 18 blood test measurements as a function of the threshold used to discretize these factors. The 95% CI of csHR d or 1/csHR r are shown in dashed vertical lines. If the discretized factor’s csHR is not significant (at 0.01 level) by the survival analysis, its color turns from red (blue) to pink (light-blue). The threshold used in Table 1 is shown as a downward arrow. The two horizontal lines represent the normal range of these blood test results (from two different sources), and horizontal dash line is csHR = 1.
Relationship between csHR d and OR for binarized continuous factors: Similar to Figure 2 where we show the scatter plot for cause-specific hazard ratio for time-to-death (x-axis) and logistic regression odds-ratio (y-axis), Figure 4 shows the similar scatter plot for the discretized factors. The 95% CI for both are shown by horizontal and vertical segments. All points in the first quadrant are above the diagonal line, and those in the third quadrant below the diagonal line. Therefore, | log(OR)| ≥ | log(csHR d )| is true for all binarized factors.

Similar to Figure 2, but for discretized/binarized factors: the x-axis is the cause-specific hazard ratio csHR d for death event, and the y-axis the odds-ratio (OR) from logistic regression.
Effect of log-transformation of factor values: Remember the meaning of HR for continuous variable is the ratio of two hazards evaluated at two factor values differing by one unit: x 1 = c, x 2 = c + 1. The dependence on c is supposed to be averaged out. If the factor is log-transformed, the two evaluation points are log(x 1) = c′, log(x 2) = c′ + 1, or x 2 is x 1 multiplied by a constant 2.718. Not only this one-unit change is much larger, but also, the change in the original scale x 2 − x 1 = e c ′+1 − e c ′ = 1.718 ⋅ e c ′ depends on c′. Tables 2 –4 show that csHR d or csHR r are dramatically larger (in magnitude) than the un-logged factors. The effect of log-transformation on p-value is unclear, though in our examples, the test becomes more significant after the factor being log-transformed.
The concept of hazard ratio has been cautioned in Hernán [28]. In particular, the instantaneous incident rate for an event to occur may depend on the time, and HR is only an average over the potential time dependence. Our attempt to binarize a continuous factor or log-transform a factor illustrates a similar problem. If HR not only depends on the one-unit-change step, but also depends on which level this step is made, and depends on whether the step is in additive scale or multiplicative scale, then the average may not capture the whole spectrum of the behavior of hazard in its full range.
5 Discussion
The COVID-19 time-to-event data is unique not only the two events, mortality and discharge, are mutually exclusive, but also a susceptible factor might be behind faster death and slower release at the same time. Even though csHR and OR, i.e. instantaneous risk and cumulative risk, are not theoretically proven to always point to the same direction, in our data, they do. If we consider heart transplant and other open-heart operations as events that may have saved a patient’s life, thus are mutually exclusive with mortality, we can not say that the factors causing a longer waiting time until operation are the same ones causing a faster death without these operation. For this reason, we have the basis for the reciprocal cause-specific hazard (csHR) ratios hypothesis which can only be examined in data similar to COVID-19, but not in other survival data just because two events are mutually exclusive.
Besides cause-specific competing risk survival analysis proposed in Kalbfleisch and Prentice [12], there is another subdistribution hazard proposed in Fine and Gray [29]:
where ∪ (logical OR) means two groups of samples are considered in the calculation of hazard (h sd ): one is those who has not yet experienced the type-1 event at time t (e.g. still alive), and another is those who has already experienced the type-2 event (e.g. released) before time t. Why already released samples are still considered in the calculation for hazard (rate of risk) for death is not explained, and h sd does not have a good interpretation [11]. The reason that subdistribution hazard (Fine-Gray model) is still used is due to the fact that its hazard ratio (sdHR) always preserves the direction (larger or smaller than 1) in odds-ratio. The csHR does not have such a general proof for direction preserving. However, as seen in this paper, sdHR and OR are in the same direction without exception in our data. On the other hand, sdHR has its own problems [10, 30–33].
The possible links between the two csHR’s have at least two consequences. The first is on hospitalization stay time. If a patient has certain condition (e.g. high glucose or hyperglycemia), the larger-than-1 csHR d implies that the patient has a higher death-rate than those with normal glucose level (remember again that although csHR and OR can not be proven to be in the same direction in theory, in practice such as our data, the two are pointing in the same direction); on the other hand, the larger-than-1 csHR r value indicates the patients have a higher chance to be released. Therefore, whether hyperglycemia increases the hospital stay time or not depends on whether the patient survives or not. The hospital stay time is of interest because of the number of hospital beds is limited, and there is a need for bed management [34].
If a factor/condition causes the severity of a COVID-19 patient, intuitively we would conclude that patients with the condition will stay in hospital longer. In reality, if the disease is too severe, the patient will stay in hospital shorter, because the patient succumbed to death faster. Among the deceased patients, we would expect the co-existence of short and long stays, while less diverging in stay time for discharged patients. Indeed, though mean of log(stay time) between the deceased and released groups is not significantly different (t-test p-value = 0.15, though Wilcoxon test p-value is 0.00034), the variances are very different (F-test p-value = 1.1E-8).
The second consequence that two csHRs might be related is that if we focus on time-to-release events, we could collect much more samples simply because more patients being recovered/released than deceased. In a sense, this strategy examines which factor delays the recovering time in surviving patients. Larger sample sizes would help to detect more subtle causing factors. This strategy will become more relevant if life-saving drugs for COVID-19 are developed and nobody or almost nobody die from the disease. Even in that future event, we still have in possession surviving patients.
The fact that OR
As discussed thoroughly in the literature that we can not always assume csHR (unlike subdistribution HR) is in the same direction as OR [10, 14]. In other words, csHR
In conclusion, we draw attention to the connection between the two types of mutually exclusive events, mortality and discharge, in COVID-19 survival data. We also made three observations from COVID-19 data: the opposite direction between the two csHRs log(HR d ) ⋅ log(HR r ) < 0, approximately reciprocal link between them HR d ⋅ HR r ≈ 1, and odds-ratio as an upper limit of HR d : |log(csHR d )| ≤ |log(OR)|.
Acknowledgment
WL acknowledges the support from Robert S Boas Center for Genomics and Human Genetics.
-
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
-
Research funding: The data analysis work was not funded.
-
Conflict of interest statement: Authors declare no conflicts of interests.
-
Ethical approval: All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
-
Informed consent: As the study was a retrospective analysis of medical records, informed consent was waived.
References
1. Sutradhar, R, Austin, P. Relative rates not relative risks: addressing a widespread misinterpretation of hazard ratios. Ann Epidemiol 2018;28:54–7. https://doi.org/10.1016/j.annepidem.2017.10.014.Search in Google Scholar PubMed
2. Zhou, P, Yang, XL, Wang, XG, Hu, B, Zhang, L, Zhang, W, et al.. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature 2020;579:270–3. https://doi.org/10.1038/s41586-020-2012-7.Search in Google Scholar PubMed PubMed Central
3. Huang, C, Wang, Y, Li, X, Ren, L, Zhao, J, Hu, Y, et al.. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020;395:497–506. https://doi.org/10.1016/s0140-6736(20)30183-5.Search in Google Scholar
4. Xu, Z, Shi, L, Wang, Y, Zhang, J, Huang, L, Zhang, C, et al.. Pathological findings of COVID-19 associated with acute respiratory distress syndrome. Lancet Respir Med 2020;8:420–2. https://doi.org/10.1016/s2213-2600(20)30076-x.Search in Google Scholar
5. Carfi, A, Bernabei, R, Landi, F, Gemelli Against COVID-19 Post-Acute Care Study Group. Persistent symptoms in patients after acute COVID-19. JAMA 2020;324:603–5. https://doi.org/10.1001/jama.2020.12603.Search in Google Scholar PubMed PubMed Central
6. Rubin, R. As their numbers grow, COVID-19 “long haulers” stump experts (news & analysis). JAMA 2020;324:1381–3. https://doi.org/10.1001/jama.2020.17709.Search in Google Scholar PubMed
7. Crook, H, Raza, S, Nowell, J, Young, M, Edison, P. Long covid – mechanisms, risk factors, and management. BMJ 2021;274:n1648. https://doi.org/10.1136/bmj.n1648.Search in Google Scholar PubMed
8. Mehandru, S, Merad, M. Pathological sequelae of long-haul COVID. Nat Immunol 2022;23:194–202. https://doi.org/10.1038/s41590-021-01104-y.Search in Google Scholar PubMed PubMed Central
9. Davis, HE, McCorkell, L, Vogel, JM, Topol, EK. Long COVID: major findings, mechanisms and recommendations. Nat Rev Microbiol 2023;21:133–46.10.1038/s41579-022-00846-2Search in Google Scholar PubMed PubMed Central
10. Austin, PC, Lee, DS, Fine, JP. Introduction to the analysis of survival data in the presence of competing risks. Circulation 2016;133:601–9. https://doi.org/10.1161/circulationaha.115.017719.Search in Google Scholar PubMed PubMed Central
11. Austin, PC, Fine, JP. Practical recommendations for reporting Fine-Gray model analyses for competing risk data. Stat Med 2017;36:4391–400. https://doi.org/10.1002/sim.7501.Search in Google Scholar PubMed PubMed Central
12. Kalbfleisch, JD, Prentice, RL. The statistical analysis of failure time data. Hoboken NJ.: Wiley-Interscience; 1980.Search in Google Scholar
13. Pintilie, M. Analysing and interpreting competing risk data. Stat Med 2007;26:1360–7. https://doi.org/10.1002/sim.2655.Search in Google Scholar PubMed
14. Lau, B, Cole, SR, Gange, SJ. Competing risk regression models for epidemiologic data. Am J Epidemiol 2009;170:244–56. https://doi.org/10.1093/aje/kwp107.Search in Google Scholar PubMed PubMed Central
15. Cetin, S, Ulgen, A, Balci, PO, Sivgin, H, Cetin, M, Sivgin, S, et al.. Survival analyses of COVID-19 patients in a Turkish cohort: comparison between using time to death and time to release. Sci Med J 2021;3:1–9. https://doi.org/10.28991/scimedj-2021-03-si-1.Search in Google Scholar
16. Therneau, TM, Grambsch, PM. Modeling survival data: extending the Cox model. Berlin: Springer; 2010.Search in Google Scholar
17. Grambsch, P, Therneau, T. Proportional hazards tests and diagnostics based on weighted residuals. Biometrika 1994;81:515–26. https://doi.org/10.1093/biomet/81.3.515.Search in Google Scholar
18. Ulgen, A, Cetin, S, Balci, PO, Sivgin, H, Sivgin, S, Cetin, M, et al.. COVID-19 outpatients and surviving inpatients exhibit comparable blood test results that are distinct from non-surviving inpatients. Health Sci Med 2021;4:306–13. https://doi.org/10.32322/jhsm.900462.Search in Google Scholar
19. Ulgen, A, Cetin, S, Cetin, M, Sivgin, H, Li, W. A composite ranking of risk factors for COVID-19 time-to-event data from a Turkish cohort. Comput Biol Chem 2022;98:107681. https://doi.org/10.1016/j.compbiolchem.2022.107681.Search in Google Scholar PubMed PubMed Central
20. Cetin, S, Ulgen, A, Sivgin, H, Li, W. A study on factors impacting length of hospital stay of COVID-19 inpatient. J Contemp Med 2021;11:396–404. https://doi.org/10.16899/jcm.911185.Search in Google Scholar
21. Ioannidis, JPA. The proposal to lower p value thresholds to 0.005. JAMA 2018;319:1429–30. https://doi.org/10.1001/jama.2018.1536.Search in Google Scholar PubMed
22. Colquhoun, D. The reproducibility of research and the misinterpretation of p-values. R Soc Open Sci 2017;4:171085. https://doi.org/10.1098/rsos.171085.Search in Google Scholar PubMed PubMed Central
23. Wasserstein, RL, Schirm, AL, Lazar, NA. Moving to a world beyond p < 0.01. Am Statistician 2019;73:1–19. https://doi.org/10.1080/00031305.2019.1583913.Search in Google Scholar
24. Li, W, Shih, A, Freudenberg-Hua, Y, Fury, W, Yang, Y. Beyond standard pipeline and p < 0.05 in pathway enrichment analyses. Comput Biol Chem 2021;92:107455. https://doi.org/10.1016/j.compbiolchem.2021.107455.Search in Google Scholar PubMed PubMed Central
25. Stare, J. Odds ratio, hazard ratio and relative risk. Metodoloski Zvezki 2016;13:59–67. https://doi.org/10.51936/uwah2960.Search in Google Scholar
26. Youden, WJ. Index for rating diagnostic tests. Cancer 1950;3:32–5. https://doi.org/10.1002/1097-0142(1950)3:1<32::aid-cncr2820030106>3.0.co;2-3.10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3Search in Google Scholar
27. Zweig, MH, Campbell, G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993;39:561–77. https://doi.org/10.1093/clinchem/39.4.561.Search in Google Scholar
28. Hernán, MA. The hazards of hazard ratios. Epidemiology 2010;21:13–5. https://doi.org/10.1097/ede.0b013e3181c1ea43.Search in Google Scholar
29. Fine, JP, Gray, RJ. A proportional hazards model for the subdistribution of a competing risk. J Am Stat Assoc 1999;94:496–509. https://doi.org/10.1080/01621459.1999.10474144.Search in Google Scholar
30. Lesko, CR, Lau, B. Bias due to confounders for the exposure-competing risk relationship. Epidemiology 2017;28:20–7. https://doi.org/10.1097/ede.0000000000000565.Search in Google Scholar
31. Allison, P. For causal analysis of competing risks, don’t use Fine & Gray’s subdistribution method. Statistical Horizons; 2018. Available from: https://statisticalhorizons.com/for-causal-analysis-of-competing-risks/.Search in Google Scholar
32. Putter, H, Schumacher, M, van Houweligen, HC. On the relation between the cause-specific hazard and the subdistribution rate for competing risks data: the Fine-Gray model revisited. Biom J 2020;62:790–807. https://doi.org/10.1002/bimj.201800274.Search in Google Scholar
33. Austin, PC, Steyerberg, EW, Putter, H. Fine-Gray subdistribution hazard models to simultaneously estimate the absolute risk of different event types: cumulative total failure probability may exceed 1. Stat Med 2021;40:4200–12.10.1002/sim.9023Search in Google Scholar
34. Roimi, M, Gutman, R, Somer, J, Arie, AB, Calman, I, Bar-Lavie, Y, et al.. Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: a nationwide study. J Am Med Inf Assoc 2021;28:1188–96. https://doi.org/10.1093/jamia/ocab005.Search in Google Scholar PubMed PubMed Central
35. Latouche, A, Allignol, A, Beyersmann, J, Labopin, M, Fine, JP. A competing risks analysis should report results on all cause-specific hazards and cumulative incidence functions. J Clin Epidemiol 2013;66:648–53. https://doi.org/10.1016/j.jclinepi.2012.09.017.Search in Google Scholar PubMed
© 2023 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Research Articles
- Survival analysis using deep learning with medical imaging
- Using a population-based Kalman estimator to model the COVID-19 epidemic in France: estimating associations between disease transmission and non-pharmaceutical interventions
- Approximate reciprocal relationship between two cause-specific hazard ratios in COVID-19 data with mutually exclusive events
- Sensitivity of estimands in clinical trials with imperfect compliance
- Highly robust causal semiparametric U-statistic with applications in biomedical studies
- Hierarchical Bayesian bootstrap for heterogeneous treatment effect estimation
- Penalized logistic regression with prior information for microarray gene expression classification
- Bayesian learners in gradient boosting for linear mixed models
- Unequal allocation of sample/event sizes with considerations of sampling cost for testing equality, non-inferiority/superiority, and equivalence of two Poisson rates
- HiPerMAb: a tool for judging the potential of small sample size biomarker pilot studies
- Heterogeneity in meta-analysis: a comprehensive overview
- On stochastic dynamic modeling of incidence data
- Power of testing for exposure effects under incomplete mediation
- Exact correction factor for estimating the OR in the presence of sparse data with a zero cell in 2 × 2 tables
- Right-censored partially linear regression model with error in variables: application with carotid endarterectomy dataset
- Assessing HIV-infected patient retention in a program of differentiated care in sub-Saharan Africa: a G-estimation approach
- Prediction-based variable selection for component-wise gradient boosting
Articles in the same Issue
- Frontmatter
- Research Articles
- Survival analysis using deep learning with medical imaging
- Using a population-based Kalman estimator to model the COVID-19 epidemic in France: estimating associations between disease transmission and non-pharmaceutical interventions
- Approximate reciprocal relationship between two cause-specific hazard ratios in COVID-19 data with mutually exclusive events
- Sensitivity of estimands in clinical trials with imperfect compliance
- Highly robust causal semiparametric U-statistic with applications in biomedical studies
- Hierarchical Bayesian bootstrap for heterogeneous treatment effect estimation
- Penalized logistic regression with prior information for microarray gene expression classification
- Bayesian learners in gradient boosting for linear mixed models
- Unequal allocation of sample/event sizes with considerations of sampling cost for testing equality, non-inferiority/superiority, and equivalence of two Poisson rates
- HiPerMAb: a tool for judging the potential of small sample size biomarker pilot studies
- Heterogeneity in meta-analysis: a comprehensive overview
- On stochastic dynamic modeling of incidence data
- Power of testing for exposure effects under incomplete mediation
- Exact correction factor for estimating the OR in the presence of sparse data with a zero cell in 2 × 2 tables
- Right-censored partially linear regression model with error in variables: application with carotid endarterectomy dataset
- Assessing HIV-infected patient retention in a program of differentiated care in sub-Saharan Africa: a G-estimation approach
- Prediction-based variable selection for component-wise gradient boosting