Can medical research be justified?

Abstract

I investigate the cost-effectiveness of medical research, using methods based on Lichtenburg, Murphy and Topel, and compare this to other charities. I find that the returns on investment in medical research are significantly lower than comparable investments in existing charities.

Introduction

People who study technology are somewhat spoiled when it comes to returns on research investments. The number of transistors we can fit on a chip has roughly doubled every year for the last 50 years - if life expectancy had kept up, people born today would expect to live for about $6*10^{15}$ years (that's a six followed by 15 zeros). To put it mildly, medical research hasn't quite kept up that pace. What's worse is that we're spending tons of money to keep up this less-than-awesome advancement.

Red line is NIH funding and black is the percentage change in life expectancy. All prices in 2010 dollar equivalents. We're spending more and more on medical research without seeing increasing returns.

So it's reasonable for us to ask if there isn't some way of investing our money more wisely when it comes to medicine. Sendhil Mullainathan has an excellent talk arguing that the type of research we need is not: "What drug will cure this disease?" but "How can we get people to use existing drugs to cure their diseases?" There are some interesting results like Giving Everyone the Health of the Educated and The health impact of resolving racial disparities which suggest that changes in social structure may be more effective than medical research itself.

Now, how do the benefits of research into new drugs stack up? I found a paper by Lichtenberg which discusses the role of pharmaceutical innovation in mortality reduction. A more general paper by Murphy and Topel provide a framework that I'll reuse here.

Essentially, we assume that all increases in health are due to medical research, and that medical research takes 10 years from when it's done to when it affects the world. For example, the health increases from 1990-2000 were the result of research done during the 80s.

A discount rate of 3% per year is used for both costs and benefits. A critical point is that they only considers fixed costs of research, ignoring the costs of treatment itself. (e.g. a treatment which costs a dollar is considered equivalent to a treatment which costs $1,000,000.) I include both costs here.

A few points: The benefits of medical research are measured in QALYs, and the cost is dollars, which gives us something called an ICER. You may remember ICERs as "the thing which Sarah Palin called 'Death Panels'." If you dislike putting a price tag on people's lives, you won't like the rest of this article.

Costs

The formula I use is as follows: let $r_t$ be the cost of researching treatment $t$, and $v_t$ be the increased marginal cost of creating the treatment and $p_t$ the number of people who use the treatment. So any treatment $t$ costs $r_t + v_t p_t$ - note that it's entirely possible for the research cost to be negative, assuming the decreased variable cost offsets the increased fixed cost.

To find the sum $\sum_t r_t + v_t p_t$ we can break it into the research cost, which is just the amount spent on research, and the change in variable cost, which is the change in medical expenditures per person multiplied by the total number of people. To prevent a "change in cost" occurring due to population change, the total number of people is defined as the population of the US at the end of the time period.

Benefits

The benefit is similarly defined by the product of the change in QALYs $q$ with the population $p$. We need to project it forward, so the total benefit is $\sum_{t=0}^{\infty}(.97^t)qp_t$, using our 3% discount rate. To avoid double-counting people, I actually use the formula $qp_0+\sum_{t=1}^{\infty}(.97^t)qb_t$ where $b_t$ is the number of people born in year $t$.

Something to keep in mind is that the benefits of medical research apply not just to everyone who is currently alive, but to everyone who will ever live. So even small advances in life expectancy result in huge benefits (as measured here).

Data

From 1985 to 1994 the US spent about two trillion dollars on medical research (both public and private) and from 1995 to 2005 QALE increased by .7 years, for total ratio of $7,317 per added QALY.

So is that good?

The World Bank and WHO collectively publish a report entitled Disease Control Priorities. Based on this data, and studies performed by charities themselves, an organization called Give Well evaluates which charities and methods are effective. Unfortunately, they use a measure related to QALY but not identical: disability-adjusted life years. Nonetheless, we can get a rough measure of how effective medical research is from their criteria:

We feel that a program can be considered extremely cost-effective if estimates put it in the range of $100 per disability-adjusted life-year (DALY) averted, $50 per life-year significantly changed, or $1000 per life significantly changed. - Give Well on Cost Effectiveness

To put it mildly, $7,317 is slightly larger than $100, giving us a fairly firm answer that no, medical research isn't a good way to spend our money.

Discussion

Murphy and Topel do a pretty good job of discussing the limitations of this method, so I'll just add that my calculated ICER for medical research is more than two orders of magnitude worse than the best charity, so it's unlikely that minor changes will affect the conclusion.

I hope this article helps inform your decision when a local university requests government money to expand its research program, or you're torn between donating to Race for the Cure and Village Reach.

References / Data

Probably the simplest way to see what I did is to check out the github repo - if you can read R, readYear.r should be able to explain pretty much everything. The function estimates will return the value I gave here.

I wrote down the sources of all the data I used in that R file, but here's another list:

  • ftp://ftp.bls.gov/pub/special.requests/cpi/cpiai.txt
  • http://www.nih.gov/about/almanac/appropriations/index.htm
  • http://www.cms.gov/NationalHealthExpendData/downloads/nhegdp09.zip
  • http://www.cdc.gov/nchs/products/life_tables.htm

Please don't hesitate to contact me with questions or concerns.

1 comment:

  1. #Best#Clinicalresearch#institute#inPune#India
    Prorelix Lifesciences is a Best Clinical research institute in Pune, India near Mumbai provides Clinical research Courses, Pharmacovigilance courses, Post graduate diploma, Distance or online clinical research courses, Best distance courses, Best short term courses Best part time courses.

    ReplyDelete