I’m an FDA – Food and Drug Administration – scientist. I am not alone in being very upset about many things that have occurred at the FDA in recent years. An article that describes a
poll of FDA scientists conducted by The Union of Concerned Scientists (UCS) and Public Employees for Environmental Responsibility (PEER) last year sums up the way I feel about things at the FDA:
The results paint a picture of a troubled agency: hundreds of scientists reported significant interference with the FDA's scientific work, compromising the agency's ability to fulfill its mission of protecting public health and safety.
I have previously written and posted articles critical of the FDA on DU. Those articles have dealt with: The FDA’s
preference for industry representatives over the public with respect to meeting invitations; George Bush’s
war against science and our
Civil Service system; and, the time that a scientific article of mine
was pulled by the FDA Commissioner just before it was due to be published in a medical journal and just
after the Commissioner had met with representatives of the corporation that manufactured the medical device that was the subject of my article.
Recent frustrations have caused in me the desire to share some things with my friends at DU, as I am very interested to see if other people see this similarly to the way that I see it. I’ll try to be as objective as I can about this.
A little backgroundI work for the part of FDA that evaluates and approves medical devices for use in humans. It’s called the Center for Devices and Radiological Health (CDRH). Two main components of that Center are the part that approves the medical devices and the part that evaluates their performance in humans
after they’ve been approved and marketed, in order to see how they perform in “the real world”, as we say.
I work for the latter part of CDRH – the part that evaluates the devices after approval and marketing (call us “post-market”). The other part (call them “pre-market”) until recently was about ten times larger than we are – they had about a thousand employees, to our 100.
One very big difference between us and them is that almost all of
our scientists have training and degrees in public health, whereas almost none of
their scientists have that. It makes a big difference in one’s outlook. Public health professionals are trained to have an attitude that says that they work to serve the public. I believe that it is fair to say that, in contrast to us, most of the pre-market scientists in our center feel like they are supposed to serve the corporations that make the medical devices more than they are supposed to serve the public.
A transition to more post-market emphasisIn the last couple of years there has been a move to give us public health scientists on the post-market side of the Center more authority over post-market issues. Until very recently, the pre-market people not only had all the authority over approving medical devices, but they had authority over the
post-market evaluation of the devices as well. We post-market people merely served as their consultants. We would evaluate the scientific data and make recommendations based on our public health expertise. And all too frequently our advice would be met with comments like “But that’s not fair to the manufacturer”. Why not? Because neither manufacturer A nor manufacturer B ever had do those things, so why should we require manufacturer C, for example, to conduct a study to better evaluate the safety of their product?
We always felt that having the pre-market approvers of the medical devices also be responsible for the post-market evaluation of the devices was a very bad idea. First of all, lacking public health degrees, hardly any of them had proper training for developing and overseeing post-market scientific studies. Secondly, there was a serious conflict of interest involved. Having approved a medical device, they would be very reluctant to find fault with it after it was marketed because that could be seen as admitting a serious mistake. It’s a little bit like giving the President of the United States the authority to give pardons to his own staff for crimes they may have committed. Indeed, the pre-market folks routinely exhibited much less enthusiasm for the post-market evaluation of devices than they did for the approval of the devices that they oversaw. And on many occasions when we would try to discuss with them problems with the post-market performance of a device that they had approved, they would react very defensively.
So we pushed to get more authority over the post-market evaluation of medical devices, and finally a major transition began to take place, giving us that authority. I want to believe that this transition is largely attributable to our efforts towards it, but I am unable to say for sure exactly how it happened. However, the transition is by no means yet complete, and we are still struggling for it.
An example of how the FDA makes decisions regarding post-market evaluation of medical devicesNow I come to the part that I really wanted to talk about – how decisions have been and continue to be made regarding various aspects of post-market studies to evaluate medical devices.
Recognizing that only a small minority of persons who read this post are statisticians or have significant statistical training, I’ll leave statistics out of this and try to explain it in simple English:
In considering how to design a post-market study, one of the main considerations is to decide on where to set the bar for the post-market performance of the medical device with respect to its safety and its effectiveness. More specifically, where do we want to set that bar in comparison to alternative means of treating the disease or condition that the medical device is supposed to treat? Do we want to say that it’s ok to be 10%
less safe and effective than currently available treatments? 20% less safe and effective? 50%? This is a complex clinical/scientific issue, and I don’t intend here to discuss all of the many considerations that should go into such a determination. What I will do here is tell you how the pre-market folks routinely make that determination.
Here’s how they do it: First they decide, perhaps after talking with the manufacturer, how many study subjects
the manufacturer would consider acceptable for including in the study. If the number is too high, the manufacturer will say that the study would be too costly or too “burdensome” for them. So, in that manner, the pre-market folks determine the number of subjects who will participate in the study.
The second step is to create scientific justification for the sample size that they determined. They do this by asking us – the post-market folks – to tell them what margin of safety or effectiveness will statistically justify their pre-selected sample size. The lower the bar, the fewer subjects they need in their study. So, their plan is simply to pick a low enough bar that they will be able to justify their pre-selected sample size.
Get it? It’s kind of like deciding that global warming doesn’t exist, and then picking the scientists who will support your conclusion – if you can find them. Or, like deciding that weapons of mass destruction
do exist, and then finding the evidence to support that. It’s very simple, really.
The struggle for controlRecall I said that in the past the role of us post-market folks was merely to advise the pre-market folks on how to set up their post-market studies. I would never play along with their games. I would simply tell them that it was not appropriate to pre-select the sample size or determine the performance bar based on the need for a small sample size. They would say “Thank you very much”, and that was often be the last I would hear from them.
But now, as I said, we are attempting to gain control over the process. And just a couple days ago we began a confrontation over this issue, while it is still unclear which side is going to get to decide the matter. Next week we have a meeting to try to settle this, so wish me luck.
Viewing this in perspectiveThey’re not all like that. Many of them appreciate our input. And many of them appreciate our input even though they can’t even begin to understand our point of view. Most of them are good people, in my opinion. But they have worked in a specific culture for so long that they have imbibed the values of that culture, and they view almost everything through the eyes of that culture. In short, many of them don’t have the slightest clue that the FDA is supposed to be a public health agency; that the public deserves at least as much consideration as do the corporations who make the products they deal with; or that there is anything wrong with making scientific decisions based on the needs of corporations.
I’m sorry that I can’t tell you when or how this all started. I came to the FDA in 1999, and it was bad then, although I would say it got quite a bit worse during the Bush pResidency. True, in 1999 we had a Democratic President, but we had also had a Republican Congress for quite a few years by then. And this was followed, starting in 2001, with almost six uninterrupted years of a lethal combination of Republican Congress and pResident at the same time.
It’s not just the FDA, of course. All federal government agencies have been badly corrupted during the years of the Bush pResidency. In a democracy, money is not supposed to drive the most important decisions that a nation makes – but that’s the
current status of our nation; in a democracy, people are supposed to have some confidence that their votes will be counted – but that’s
not the current status of our nation; in a democracy, the news that people get is
not supposed to be dominated by a handful of wealthy and powerful corporations – but that
is the current status of our nation; and last but not least, in a democracy that also has a strong mechanism built into its Constitution for getting rid of incompetent and corrupt public officials, a pResident with a 27% approval rating would be out on his ear before too long – but that’s
not the current status of our nation.