Home Comparative effectiveness is the common denominator in health services research: experimental effects are promising, real-world effects are compelling
Article
Licensed
Unlicensed Requires Authentication

Comparative effectiveness is the common denominator in health services research: experimental effects are promising, real-world effects are compelling

  • Franz Porzsolt ORCID logo EMAIL logo
Published/Copyright: October 5, 2023

Abstract

Background

Sir Archibald Cochrane and Sir Austin Bradford Hill requested 80 years ago answers to three questions (Can it work? Does it work? Is it worth it?) before a new intervention is implemented in day-to-day healthcare. A critical analysis of currently accepted answers identified a terminology conflict that inherits the risk of misleading interpretations and inappropriate decisions.

Content

For detection of the terminology problem and the development of the solutions was possible through three recommendations (the “Ulm heritage”): (1) Albert Einstein (*1879 in Ulm/Germany) predicted, “A problem cannot be solved with the way of thinking that caused it”; (2) The “hochschule für gestaltung ulm (Academy of Design, 1953–1968)” disseminated the rules of American designers and architects e.g., “Form Follows Function”; and (3) requested to “design not only individual but universally valid solutions with socio-political relevance”.

Summary

Our data confirms the power of the FFF rule, the pros and cons of value judgments, the complexity of healthcare decisions, the difference between scientific statements and political decisions, and the effects of interprofessional collaboration.

Outlook

“Efficacy” offers promising “Proofs of Principle (PoP)” while “effectiveness” describes “Real-World Effectiveness (RWE)”. That is why the results obtained are always more important than hypotheses.


Corresponding author: Franz Porzsolt, MD, PhD, Institute of Clinical Economics ICE e.V., Schwarzenberg Str. 135 89081 Ulm, Germany, Mobile: +49 173 329 9774, E-mail:

Acknowledgments

I am indebted to Gabriele Mecklenbrauck PhD (Naturopathic Practice) for editorial support in the effort to maintain neutral terminology.

  1. Research ethics: Not applicable.

  2. Informed consent: Not applicable.

  3. Author contributions: The author has accepted responsibility for the entire content of this manuscript and approved its submission.

  4. Competing interests: The author states no conflict of interest.

  5. Research funding: None declared.

  6. Data availability: Not applicable.

References

1. https://www.wikiwand.com/de/Neue_Deutsche_Heilkunde. [Accessed 23 Sep 2022].Search in Google Scholar

2. Willich, SN, Girke, M, Hoppe, J-D, Kiene, H, Klitzsch, W, Matthiessen, PF, et al.. Schulmedizin und Komplementärmedizin. Verständnis und Zusammenarbeit müssen vertieft werden. Dtsch Aerztebl 2004;101:A1314–19.Search in Google Scholar

3. Gray, JAM. Evidence based policy making. BMJ 2004;329:988–9. https://doi.org/10.1136/bmj.329.7473.988.Search in Google Scholar PubMed PubMed Central

4. Porzsolt, F, Wiedemann, F, Phlippen, M, Weiss, C, Weiss, M, Schmaling, K, et al.. The terminology conflict on efficacy and effectiveness in healthcare. J Comp Eff Res 2020;9:1171–8. https://doi.org/10.2217/cer-2020-0149.Search in Google Scholar PubMed

5. Watzlawick, P. Wie wirklich ist die Wirklichkeit? Wahn, Täuschung, Verstehen, 2. Auflage. München: Piper Verlag; 2022:S.1–252 p.Search in Google Scholar

6. Porzsolt, F. Evidence-based risk management: safety means “perception of risk”. In: 4th World Congress on Clinical Safety. Vienna/Austria; Sept 28–30, 2015. Available from: https://jglobal.jst.go.jp/en/detail?JGLOBAL_ID=201702272709711634.Search in Google Scholar

7. Porzsolt, F, Correia, LCL. Clinical economics is based on real world conditions not only on ideal study conditions (editorial). Rio de Janeiro: Arquivos Brasileiros de Cardiologia [Brazilian Archives of Cardiology]; 2017.Search in Google Scholar

8. Porzsolt, F, Pfuhl, G, Kaplan, RM, Eisemann, M. Covid-19 pandemic lessons: uncritical communication of test results can induce more harm than benefit and raises questions on standardized quality criteria for communication and liability. Health Psychol Behav Med 2021;9:818–29. https://doi.org/10.1080/21642850.2021.1979407.Search in Google Scholar PubMed PubMed Central

9. Barlow, DH. Anxiety and its disorders: the nature and treatment of anxiety and panic. New York, NY: Guilford press; 2004.Search in Google Scholar

10. Hanna, E. Book review. Horwitz, AV. Anxiety: a short history, Baltimore: Johns Hopkins university press. 2013. Soc Health Illness 2015;37:164–5. https://onlinelibrary.wiley.com/doi/full/10.1111/1467-9566.12251 [Accessed 26 Nov 2022].10.1111/1467-9566.12251Search in Google Scholar

11. Porzsolt, F, Weiss, M, Lautenschlager, F, Legrum, P, Weiss, C. Combination of the Minimum Clinically Important Difference (MCID) with the Minimum Detectable Change (MDC): implementation of the unfulfilled requirement of clinical epidemiology “subjective assumptions are to be confirmed by objective statements”. Submitted for publication.Search in Google Scholar

12. Kuss, O, Blettner, M, Börgermann, J. Propensity Score – eine alternative Methode zur Analyse von Therapieeffekten (Propensity score: an alternative method of analyzing treatment effects). Dtsch Arztebl Int 2016;113:597–603. https://doi.org/10.3238/arztebl.2016.0597.Search in Google Scholar PubMed PubMed Central

13. Porzsolt, F, Wiedemann, F, Legrum, P, Weiss, C, Weiss, M. The pragmatic controlled trial as keystone between the structured experimental study conditions and the unstructured real-world conditions. Submitted for publication.Search in Google Scholar

14. Porzsolt, F, Rocha, NG, Toledo-Arruda, AC, Thomaz, TG, Moraes, C, Bessa-Guerra, TR, et al.. Efficacy and effectiveness trials have different goals, use different tools, and generate different messages. Pragmatic Obs Res 2015;6:47–54. https://doi.org/10.2147/POR.S89946.Search in Google Scholar PubMed PubMed Central

15. Porzsolt, F, Weiss, C, Weiss, M. Covid-19: Twin Methode zum Nachweis der Real-World Effectiveness unter Alltagsbedingungen [Covid-19: twin method for demonstration of real-world effectiveness (RWE) under the conditions of day-to-day care]. Gesundheitswesen 2022;84:1–4. https://doi.org/10.1055/a-1819-6237.Search in Google Scholar PubMed

16. Rudnicka, J. Ausgaben im Bundeshaushalt nach Ressorts 2017–2021 vom 19.08.2022. https://de.statista.com/statistik/daten/studie/75833/umfrage/ausgabenstruktur-im-bundeshaushalt/#:∼:text=Die%20Ausgaben%20im%20Bundesministerium%20f%C3%BCr%20Arbeit%20und%20Soziales,Ausgaben%20im%20Bundeshaushalt%202019%20ca.%20357%2C12%20Milliarden%20Euro [Accessed 25 Sep 2022].Search in Google Scholar

17. Haynes, B. Can it work? Does it work? Is it worth it? The testing of healthcare interventions is evolving. BMJ 1999;319:652–3. https://doi.org/10.1136/bmj.319.7211.652.Search in Google Scholar PubMed PubMed Central

18. Porzsolt, F, Weiss, C, Weiss, M, Müller, AG, Becker, SI, Eisemann, M, et al.. Versorgungsforschung braucht dreidímensionale Standards zur Beschreibung von Gesundheitsleistungen [Health services research needs three-dimensional standards for description of health services]. Monit Versorgungsforschung 2019;04:53–60. https://doi.org/10.24945/MVF.04.19.1866-0533.2163.Search in Google Scholar

19. Sullivan, LH. The tall office building artistically considered. Lippincott’s Mag 1896;57:403–9. Reprinted in Inland Architect and News Record 27 (May 1896), pp. 32–34; Western Architect 31 (January 1922), pp. 3–11; published as “Form and Function Artistically Considered” The Craftsman 8 (July 1905), pp. 453–58.Search in Google Scholar

20. Wiedemann, F, Porzsolt, F. Measuring health-related quality of life in randomised controlled trials: expected and reported results do not match. Pragmat Obs Res 2022;13:9–16. https://doi.org/10.2147/POR.S350165.Search in Google Scholar PubMed PubMed Central

21. Schmaling, K, Kaplan, RM, Porzsolt, F. Efficacy and effectiveness studies of depression are not well-differentiated in the literature: a systematic review. BMJ Evid Based Med 2020;1:28–30. https://doi.org/10.1136/bmjebm-2020-111337.Search in Google Scholar PubMed

Received: 2023-06-23
Accepted: 2023-08-24
Published Online: 2023-10-05

© 2023 Walter de Gruyter GmbH, Berlin/Boston

Articles in the same Issue

  1. Frontmatter
  2. Reviews
  3. Markhamia lutea leaves aqueous and ethanolic extract with curative anti-inflammatory activity attenuates paclitaxel toxicity in rat’s intestine
  4. Does hydrotherapy influence plasma glucose levels in type 2 diabetes? – A scoping review
  5. Comparative effectiveness is the common denominator in health services research: experimental effects are promising, real-world effects are compelling
  6. Research Articles
  7. Hydroethanolic extract of Piliostigma thonningii leaves extenuates the severity of diarrhoea in female Wistar rats
  8. Pharmacokinetic assessment of rifampicin and des-acetyl rifampicin in carbon tetrachloride induced liver injury model in Wistar rats
  9. Antipyretic activity of the hydro-alcoholic extract of Artemisia absinthium L. as a standalone and as an adjuvant with barley water against yeast-induced pyrexia in albino Wistar rats
  10. Selenium prevented renal tissue damage in lipopolysaccharide-treated rats
  11. Preliminary data on cytotoxicity and functional group assessment of a herb–mineral combination against colorectal carcinoma cell line
  12. Oral intake of collagen hydrolysate from mackerel scad (Decapterus macarellus) attenuates skin photoaging by suppressing the UVB-induced expression of MMP-1 and IL-6
  13. Pentaclethra macrophylla leaves reduce blood glucose level, improve sexual behavior and modulate critical enzymes associated with diabetes-erectile dysfunction morbidity in rats
  14. Anti-melanoma and antioxidant properties of the methanol extract from the leaves of Phragmenthera capitata (Spreng.) Balle and Globimetula braunii (Engl.) Van Tiegh
  15. The assessment of the mechanism of action of lauric acid in the context of oral cancer through integrative approach combining network pharmacology and molecular docking technology
  16. Therapeutic potential of flavonoids in ovalbumin induced asthma in mice model
  17. The effects of pioglitazone and rosiglitazone on liver function in hypothyroid rats
  18. Effect of ozone gas on viral kinetics and liver histopathology in hepatitis C patients
Downloaded on 11.9.2025 from https://www.degruyterbrill.com/document/doi/10.1515/jcim-2023-0179/html
Scroll to top button