The Volokh Conspiracy
Mostly law professors | Sometimes contrarian | Often libertarian | Always independent
Is Judge Newman Entitled to Her Day in Court to Challenge Her "Stealth Impeachment"?
Other former judges and I have just filed an amicus brief in the D.C. Circuit, making the case that the federal courts should consider Judge Newman's challenge to being effectively removed from her position on the Federal Circuit in violation of her constitutional rights.
My co-blogger, Josh Blackman, has previously written an excellent post about what might be viewed as the "stealth impeachment" of Judge Newman in the Federal Circuit. Judge Newman has been suspended due to her alleged failure to "cooperate" with a Special Committee appointed by the Chief Judge of the Federal Circuit, which was investigating Judge Newman's capacity to perform her work. Judge Newman has sought federal judicial review of whether this lengthy suspension violates her constitutional rights. But, thus far, she has been denied any judicial review.
Yesterday, I joined former judges Susan Braden, Janice Rogers Brown, Randall Rader, and Thomas Vanaskie in an amicus brief (written by experienced appellate lawyer Richard Samp) urging the D.C. Circuit to direct that Judge Newman's claims be reviewed on their merits. Here's the opening of our brief explaining why Judge Newman is entitled to her day in court:
Judge Pauline Newman has served with distinction on the United States Court of Appeals for the Federal Circuit since its creation in 1984. Her many dissents may on occasion irritate some of her judicial colleagues, but those opinions have routinely been vindicated by the U.S. Supreme Court—including as recently as this year. Doctors who have examined her recently have all concluded that she remains cognitively sharp, an opinion shared by many who have witnessed her recent public appearances. There has been no finding that Judge Newman is disabled or otherwise incapable of performing her judicial duties.
Judge Newman has nonetheless been effectively removed from office by Appellees [e.g., the Chief Judge of the Federal Circuit et al.]. In response to her decision to decline a medical examination by doctors of their choice, Appellees suspended her from all judicial activities—including hearing cases, writing opinions, and voting on petitions to hear cases en banc. The original order imposed a one-year suspension, but Appellees later renewed the suspension for another year and made clear that the suspension would continue indefinitely until Judge Newman acquiesced to their examination demand. She responded by filing suit in district court, alleging that she has been removed from office in violation of her constitutional rights. But rather than addressing the merits of those constitutional issues, the district court largely dismissed Judge Newman's claims on the ground that judicial review was precluded.
That holding cuts against the strong presumption that litigants are entitled to have their federal constitutional claims heard in a federal court. The presumption can be overcome only by clear and convincing evidence that Congress meant to foreclose review, and there is no such evidence in this case. Judge Newman is entitled to her day in court.
Moreover, the facts alleged by Judge Newman state a valid claim. The Constitution assigns to the U.S. Senate alone the power to remove Article III judges from office. By suspending Judge Newman for an indefinite period and thereby effectively removing her from office, Appellees are usurping that power. That usurpation represents a serious challenge to the independence of federal judges that the Framers sought to preserve.
For Judge Newman to be removed from judicial service for an indefinite period of time violates clearly established separation-of-powers principles. As we explain in our brief:
Judge Newman alleges that Appellees are seeking to remove her from office. The uncontested facts demonstrate that: (1) on September 20, 2023, the Judicial Council suspended her for one year from hearing any cases at the panel or en banc level, based on her refusal to cooperate with the Special Committee's investigation (e.g., her refusal to submit to medical examination by doctors chosen by the Judicial Council); (2) on September 6, 2024, the Judicial Counsel renewed its suspension for a second year; (3) in recommending the September 2024 extension of Judge Newman's suspension, the Special Committee stated that the suspension is "subject to renewal if the refusal to cooperate here continues after" completion of the second year of suspension.
Those facts demonstrate Appellees' intent to deprive Judge Newman of her judicial authority for an indefinite period of time—at least until such time as she abandons her contention that it is they and not she who are engaging in misconduct. Appellees' long-term deprivation of Judge Newman's judicial authority is impossible to distinguish from an outright removal from office given her advanced age. At age 97, Judge Newman has a short life expectancy, and a multi-year suspension can plausibly be interpreted as an effort to run out the clock on her life.
Based on the above, Judge Newman has stated a valid claim that Appellees have violated her rights under separation-of-powers provisions of the U.S. Constitution. Article III, Section 1 states that federal judges "shall hold their offices during good behavior," and they can be removed from office only through a vote of impeachment by the U.S. House of Representatives and a trial and conviction by the Senate. See Art. I, § 3, cl. 6 (stating that "The Senate shall have the sole power to try all Impeachments") (emphasis added). In other words, a Judicial Council effort to remove a judge from office violates the Constitution by impinging on powers delegated solely to the Senate.
At the very least, Judge Newman is entitled to reversal of the district court's dismissal of Counts II and III. Those counts plausibly allege that Appellees' actions have effected her de facto removal from the bench, and that the Constitution expressly prohibit anyone other than the U.S. Senate from taking those actions. And unless Appellees can supply the Court with substantial evidence that Judge Newman is not actually subject to an indefinite suspension, it should grant her motion for injunctive relief and enter judgment in her favor on Counts II and III.
The Special Committee asserts that Judge Newman's refusal to acquiesce to its medical demands constitutes "a serious form of continuing misconduct." But that assertion cannot justify Appellees' decision to suspend Judge Newman indefinitely—a suspension which currently stands at two years and which Appellees threaten to lengthen unless Judge Newman acquiesces to their demands.
If Appellees consider the alleged misconduct sufficiently serious to warrant removal from office, their proper course is to refer the matter to Congress for possible impeachment and trial. What they may not do is take it upon themselves to effectively remove Judge Newman from office by suspending her indefinitely.
Perhaps the key point in our brief is the threat to judicial independent posed by the effective impeachment of Judge Newman by colleagues with whom she has sometimes disagreed with in numerous dissenting opinions:
Amici are particularly concerned by the threat to judicial independence posed by Appellees' alleged actions. Throughout her career, Judge Newman has demonstrated a willingness to express her views without regard to how those views will be perceived by her judicial colleagues. Her hundreds of dissenting opinions have no doubt exasperated some of those colleagues at times, but the law has benefitted from her willingness to express those dissenting views unabashedly. If the Federal Circuit Judicial Council succeeds in shutting down Judge Newman without going through the constitutionally prescribed process for removing Article III judges from office, other judges may conclude that they should hesitate to act boldly in defense of justice for gear of the adverse consequences of doing so.
I hope that the D.C. Circuit agrees with our position that only adhering to the constitutionally prescribed impeachment process for allegations of judicial misconduct will ensure that Article III judges can feel confident that their rulings will not endanger their job security.
Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Comments may only be edited within 5 minutes of posting. Report abuses.
Please
to post comments
My first thought was that it's not unreasonable to ask a judge approaching 100 to get checked out. But the demand that the doctor be of their choice, rather than mutually agreed on, kind of gives the game away. It was a stealth impeachment, and you could see this procedure scaled up really warping the judiciary.
Mutual seems reasonable. She has submitted doctor reports, but none of them are the type of complete workup you would get from an independent physician and most of them have had some sort of relationship to her or her counsel. It makes me wonder if the doctor selection is the issue, why she doesn't go do a full workup with an independent neurologist.
Well, why should she suddenly switch doctors? She's not having any problems with her current doctor, or issues he can't handle.
It would be reasonable for the special committee to have asked for a mutually agreeable doctor, if they had some reason to believe her doctor wasn't impartial, beyond them being HER doctor. IF.
A more comprehensive exam would normally only be done if the regular exam had turned something up. Since the regular exam didn't, again, turn anything up, the request seems groundless.
In the end, choice of doctor is only tangential to the central issue, which is whether they have the authority to de facto strip her of her judicial position this way. The only reason I brought it up is that it's evidence that the special committee is being unreasonable.
If they can establish that they can de facto impeach fellow judges this way, you could see the technique being deployed more widely, and being used to influence the partisan composition of the bench. So this claim of power is worth contesting even if attempting to exercise it in this case was facially reasonable.
No Brett, you are missing the most important point:
*Their& doctors have already concluded that she is incompetent, that's why they have been selected. And Voodoo Scientists are the only professionals whose "professional judgement" courts will blindly defer to. If an engineer testifies that a bridge was unsafe, he/she/it has to justify it, while a psychiatrist can not be cross examined on his/her/its "professional judgement."
The "Goldwater Rule" prevents them from concluding incompetence without examining her, so her only defense is to not let them do so.
The fair resolution is her doctors and their doctors pick a third doctor whom they all agree on and that person examines her.
She's still all there if she is refusing to fall into their trap.
You are missing the point, there is no authority of the Chief Judge of the Federal Circuit to effectively remove a judge.
This is one of those cases where someone considers the constitution too bothersome to follow. Its inconvenient that the chief of the Federal Circuit can't remove the judge on her authority or the authority of a committee.
Does she as an individual have a constitutional right to an office or only a paycheck?
"The Judges, both of the supreme and inferior Courts, shall hold their Offices during good Behaviour, and shall, at stated Times, receive for their Services, a Compensation, which shall not be diminished during their Continuance in Office."
The Constitution treats holding office and getting compensation as two separate things, so I'd say the have a right to BOTH.
How much control does she have as to her duties once she has the job? Could she be assigned to a different district (probably not, but IANAL)? Can she be assigned to a different court room? Do judges like her specialize in specific kinds of cases (criminal, civil, bankruptcy, immigration, ...) and could she be shifted without her consent as backlogs change?
In other words, as long as she's getting paid and has the same job title that she was appointed to, how much choice does she have in what her bosses assign her to do?
She was nominated to a specific court, and confirmed by the Senate to a specific court. So, no, she can't be reassigned to another court.
Seems like the Chief Judge of the Federal Circuit is the one whose behavior justifies removal.
My question would be whether the district court and DC Circuit have authority to review actions by a different and sister federal court. I think the answer is probably, no. That seems like something that can only be done by SCOTUS as part of its supervisory authority.
I agree with mse326 with respect to where the power lies to uphold the rights of Judge Newman, and also agree with Brett Baltimore with respect to where the real threat lies -- the ability of a cabal of judges to sideline one of their own for disfavored views (aka politics.)
The action of suspending the judge is not a court case, so they are not reviewing the actions of a "court".
A judge getting treated like an ordinary citizen under suspicion?
How awful!
That was my first reaction too. An insider getting mistreated by the other insiders for not treating her like an inner circle insider.
My second reaction was to a comparison with the infamous rubber rooms for teachers who the unions won't let be fired for malfeasance.
Is she still being paid?
If so, then she has suffered no injury.
Failure to state a claim.
The only "right" a judge has under the Constitution is to be paid.
Have you read the Fifth Amendment lately?
That part about "nor be deprived of life, liberty, or property, without due process of law"?
She has a "liberty" interest in being a judge, she probably finds the work rewarding and wishes to continue doing it. And "due process of law" is clearly defined as Impeachment by the House and Conviction by the Senate.
"She has a 'liberty' interest in being a judge, she probably finds the work rewarding and wishes to continue doing it. And 'due process of law' is clearly defined as Impeachment by the House and Conviction by the Senate."
I'm not so sure about that. She has a property interest in her job with its salary and benefits, but do you have any authority that there is a liberty interest in being a federal judge?
I doubt that this is the absolute dumbest thing you’ve ever said. But it certainly belongs on the hall of fame plaque.
No. The Constitution requires not only that federal judges get paid but also that "hold their Offices" until and unless impeached.
But who determines the duties of that office? Surely it can't be the judge herself. How far can they change those duties before it crosses that gray line?
CONGRESS determined the duties of the office when it established the court. There is some flexibility as to who does what but for her to do NONE was not what Congress intended.
While there is obviously some discretion to determine duties, that determination is a) bounded by the constitution and b) largely set by congress. Regardless, I don't think there's any legitimate way to say that 'sit at home and while we have someone else do the work' counts as 'holding the office'.
Would you, for example, consider the President of [insert banana republic of your choice] to still be 'holding the office' if the VP usurped all power and decision-making authority but kept the President as a figurehead? Most of us would consider that a coup.
You basically described the last several years of the Reagan administration. Yes, I was there.
Under your theory, a Supreme Court Justice would have a justiciable case if they weren't able to author 1/9th of the opinions.
Snopes: Did Ronald Reagan Have Alzheimer's Disease While in Office?
"However, the physicians who directly attended Ronald Reagan while he was president agreed unanimously that he never displayed signs or symptoms of dementia the whole time he was in office, the New York Times reported in 1997:"
Judge Newman continues to hold her office.
There is another aspect of that that the lawyers involved are missing -- that of medical ethics and the rules governing the MEDICAL profession, and her rights as a human being.
Her rights as an American and not as a judge.
At its most basic, her right to be examined by the medical professionals of her choice -- they have to be duly licensed and accredited but (if she's paying for them) she gets to pick them.
For example, eye tests are required for driver's licenses, but you have the right to submit a signed statement by your eye doctor instead, and this goes all the way back to the basic concept of the doctor patient relationship being a voluntary one.
The Voodoo Scientists are trying to make end runs around this, and pressuring one to "voluntarily" be examined by someone else is common, but the someone else is violating the medical equivalent of bar rules and I'd suggest her advocates consult a medical ethics professor in a med school as medical ethics is as defined a field as bar ethics is.
Using a legal analogy, what they are doing here is similar to a judge telling a defendant that the defendant can *only* be represented by the attorney the judge picks and not some other attorney. My guess is that a conviction under those circumstances would be reversed upon appeal -- but she has no appeal from bias in the evaluation.
And this is disquietly close to the Soviet abuses of mental health and their practice of maliciously labeling those with whom they disagreed as "mentally ill."
All the time, judges order medical tests for defendants and also dictate which medical professional gives those tests. Often the judge orders that the defendant pay for the tests themselves.
I don't see **this** aspect being any different.
I don't like it, but I don't think it is a good legal argument.
What I do have issues with is:
1. I don't see that DC Circuit has jurisdiction over anything the Fed circuit did. This is a SCOTUS issue.
2. There is no method for handling when a judge (not saying her, but in general) is no longer medically fit to serve. I think, Constitutionally, it can only be handled via impeachment, which isn't a logistically satisfactory answer, but there it is.
3. I agree with other commenters that if these actions are allowed to stand, they will be used to purge the judiciary on political grounds. Much the same is already being used in academia, as the judiciary allows removal of tenure and jobs based on "comity". Dislike that old conservative fellow professor? Just claim they don't have "comity" for opposing your political ideas, and your university can strip them of tenure and fire them. Get a nice new Leftist professor. This will soon be used to get ride of those conservative judges.
The federal circuit has jurisdiction over specific subjects, patent claims, claims against the federal government for things like takings and torts, stuff like that. The claims involved in this lawsuit don’t involve these sorts of subjects. So the federal circuit doesn’t have jurisdiction over them.
"All the time, judges order medical tests for defendants and also dictate which medical professional gives those tests. Often the judge orders that the defendant pay for the tests themselves."
Has that ever been challenged? Not just a legal appeal but a formal complaint against said medical professional to the state agency that licenses them? My guess is that it hasn't because these are criminal defendants and most likely the judge has good reason to order the tests.
But I would like to see what a Board of Registration did with a credible complainant raising this issue. Such concerns have toned down some of the Behavioral Intervention Teams -- the people with psych licenses worried about losing them if Daddy's Lawyer challenges Junior's medical expulsion.
"I don't see **this** aspect being any different."
She has not been charged with any crime.
There is no credible indication that she is a threat to herself or others.
"2. There is no method for handling when a judge (not saying her, but in general) is no longer medically fit to serve. I think, Constitutionally, it can only be handled via impeachment, which isn't a logistically satisfactory answer, but there it is."
The House establishes a committee (or subcommittee) on judicial competence and misconduct. It is authorized to hold hearings on judges on the basis of (something) and to recommend Impeachment when appropriate. As we saw with Trump's second Impeachment, it can go quite quickly in largely pro-forma fashion if everyone is in agreement, and this is all House rules that the House can set up.
My guess is that most would decide to retire rather than be Impeached (as Nixon did), and you put something in the rules giving them 48 hours to do so before the House acts on the recommendation.
"3. I agree with other commenters that if these actions are allowed to stand, they will be used to purge the judiciary on political grounds. Much the same is already being used in academia, as the judiciary allows removal of tenure and jobs based on "comity". "
The students are being removed on the basis of fabricated mental health allegations. One undergrad bluntly told me that "they think that all conservatives are crazy." I felt that the undergrad was a tad paranoid -- until six weeks later when I was hiding said student.
"Has that ever been challenged? Not just a legal appeal but a formal complaint against said medical professional to the state agency that licenses them? My guess is that it hasn't because these are criminal defendants and most likely the judge has good reason to order the tests."
Where do you get the idea that a judge's authority to order physical examinations is limited to criminal defendants? Rule 35(a)(1) of the Federal Rules of Civil Procedure states:
I suspect that this rule is most often applied to civil plaintiffs, who are claiming to have been injured, on motion of the defendant.
A "formal complaint" for what, you lunatic?
re: "her right to be examined by the medical professionals of her choice"
That is not an actual right - at least not an absolute one. Sure, you have the right to pick any doctor you like as long as you're paying for it but you don't have an absolute right to pick the doctor that someone else is paying for.
For an easy example, look at any bog-standard workers comp fraud claim. You say you're injured and have a doctor's note to prove it. Your employer says you're fine and your doctor is in on the fraud. Your employer is entitled to an independent evaluation of your medical condition. There's nothing even remotely controversial about that position.
The problem here is she is being accused of misconduct, a forensic rather than a purely privately therapeutic context. This makes the situation a little different.
As noted below, I think if parties were even semi-reasonable they would attempt to mediate a compromise respecting both concerns.
No such "right" exists. And even more importantly, "You must be examined by Doctor X" would not infringe on this imaginary right to be examined by Doctor Y.
You do not. Now, it's true that some states allow this, but that doesn't make it a "right."
There is no such basic concept, not to mention that a DMV employee giving you an eye exam is not a doctor-patient relationship anyway.
Defendants are routinely assigned lawyers about whom they have no choice.
Setting aside the sordid details of the skirmish, I'll just say I can only hope to have half the level of energy needed to engage in this scale of a battle in my late 90s. Girlfriend's tough as nails.
I do think in general it's unfortunate when people's careers morph into their identities such that they just can't let go and enjoy the rest of their lives and insist on dying in the saddle, but the only real difference I see between her and countless others is that she's beat the reaper for a good number of years longer than is typical, particularly in this business.
I think a reasonable approach here would be that she picks a doctor, they pick a doctor, the two doctors mutually agree on a third doctor, and all 3 doctors are present at and can participate in the examination.
And if she wants to impose privacy-related conditions, e.g. only female doctors get to examine her physically, I think they should be accepted as long as they don’t defeat the reliability of the report. She is a judge involved in what might be characterized as a difference of opinion. The panel should show her some respect. She shouldn’t be treated like a criminal defendant.
Sure that sounds reasonable.
But I only see a good behavior requirement in the constitution, and its Congress that decides whether she has behaved well, not her fellow judges or a doctor.
Congress probably has the power to authorize a panel of judges to provide some judicial discipline but the Constitution mandates an impeachment to remove a judge from office, which is what is happening here in fact if not nominally.
For the record:
1) Judge Newman did have a full workup by Dr. Aaron Filler. The CT scan is able to rule out dementia and Judge Newman's CT scan was perfectly normal.
2) Judge Newman is not seeking review of Federal Circuit's judgment. She is seeking a review of an administrative order entered by the Judicial Council of the Federal Circuit (and also the Judicial Conduct & Disability Committee of the Judicial Conference). These are administrative bodies located in DC and so review is proper in DC federal courts. Even the DoJ admitted as much at least with respect to facial challenges to the act.
The CT scan is able to rule out dementia seems unsupported. Do you have any citations/evidence that CT scans can not just diagnose but *rule out*a dementia diagnosis?
I'm curious about this as well. I'm not a medical professional, but I have heard/read many times that there are types of dementia (most notably, Alzheimer's) that cannot be confirmed without post-mortem analysis of brain tissue.
The report by Dr. Filler has citations to studies that state as much. CT scan can't diagnose every particular cause of dementia (if one is present), but it can rule out the presence of a dementia.
Here are some additional studies:
https://pubmed.ncbi.nlm.nih.gov/37227982/
http://nmpangea.com/2017/10/20/brain-perfusion-spect-a-highly-useful-test-for-the-diagnosis-of-the-dementias/
Not to worry, they'd love to do that as well...
That was the case 20 years ago, things have advanced quite a bit since.
CT scans aren't that good for detail of soft tissue, they can pick up gross brain shrinkage, but that's about it. MRIs are better at distinguishing detail in soft tissue, but ideally you'd go with a PET scan, which can actually pick up things like amyloid.
I've been through CT, MRI, and PET, and I can assure you that if there's no good reason to get such a scan, you probably want to avoid it. At best they're uncomfortable.
Spinal taps can be a pretty good diagnostic, but can be even more unpleasant. There are some research level blood tests available.
But, to underscore the fundamental issue: If there's no evidence of dementia from ordinary cognitive tests, none of the invasive stuff is in any way justified!
But she already DID do such a scan. (And not regular CT, but perfusion CT which looks at blood flow and functional capacities). Plus, yes, you are correct, none of the screening tests suggested that she needs anything else.
Similar to my comment above, Filler is an inventor and lawyer who has appeared before the Fed. Cir., and rather than do the full cognitive tests that are typically done, he instead does CT scans (which are useful but not conclusive) and a discussion about patent law that doesn't test recall, etc. Even his own report notes that he only spent some time with her and symptoms can appear at other times. He dismisses the testimony of others, but anyone reading the emails she sent (which he doesn't mention) would have to have some serious questions. I don't know how a normal full cognitive test with a fully independent doctor would go, but I continue to be perplexed as to why she hasn't presented evidence from one.
I’ve never met Judge Newman, much less examined or evaluated her (not that I’d be qualified to do so anyway). But I have read her emails to the court IT staff from last year. Have you? And if so, are you really saying they don’t give you any concerns about her fitness to wield the judicial power of the United States?
Are there links? Can we see the emails?
There is an allegation in the record recited by Cassell that refusal by Newman to submit to a third-party medical workup constitutes bad behavior. If the emails contain evidence to suggest that may be a valid concern, how could that not be relevant to the case?
Tangentially related, the issue whether impeachment actually is the only grounds for removal. Contrary to assertions in the brief, and comments here, that is not what the Constitution actually says. If precedent insists on that interpretation, maybe that ought to get full weight, but I think this could be a case (depending on facts I have not yet seen presented) to suggest that such a precedent is unwise, and ought to be reconsidered.
They’re included in the exhibits to this report, as are some other primary materials that would, I’d suggest, lend some force to Judge Moore’s concerns.
https://cafc.uscourts.gov/wp-content/uploads/JudicialMisconductOrders/September%2020,%202023%20Judicial%20Council%20Order.pdf
Indeed. It never got that bad in my own experience, but reading that, I saw one of my previous lives flash before my eyes...
Perhaps those working so hard to defend Judge Newman in this case should be required to work for Judge Newman?
In civil rights cases against states, there is a concept of suing someone in their official vs. individual capacities. Wonder if that concept is applicable here. Judge Newman should have standing in her official capacity as an Article III judge to complain about violations of Constitutional protections for Article III judges.
If I remember correctly, Judge Moore's beef with Judge Newman is that the latter often takes a very long time to come up with her opinion.
I don't understand why Judge Moore feels she needs to go down this stealth impeachment route to solve this problem. She and her fellow judges can simply impose a time limit - why not just state a new rule for the Circuit saying "you get three months / six months / whatev to cough up your dissent and if you don't, it's noogie time. We're publishing the majority opinion anyway."
Such a rule seems to me to be a far more defensible use of the Chief Judge's power to manage her court than trying to push the old dame out.
Maybe this would help: https://cafc.uscourts.gov/wp-content/uploads/JudicialMisconductOrders/September%2020,%202023%20Judicial%20Council%20Order.pdf
You don't have to have served as a federal law clerk to a senior judge to understand it (but it would probably help)...
Since the Constitution specifies only one way of disciplining judges - impeachment - that should be the method to follow. Unlike some state constitutions, the federal constitution has no special commission to handle allegedly unfit judges.
The Pickering case arguably shows that misconduct by a judge is impeachable even if its the result of a mental condition they can't control. This seems fair if, as we're constantly assured, the impeachment process is only *quasi* judicial and does not follow all the rules of judicial proceeding.
Let her fellow judges, if they're concerned, refer the case to the House for possible impeachment, to be followed by a Senate trial if impeachment goes through.
She's not being "punished". She will be a paid federal judge until the day she dies--she will just have a lot more free time than her fellow judges.
Senior judges are always "eased out" of their roles--always. But, yes, there's always impeachment... In the same way you can always use a sledgehammer to crack a nut.
Yours is a fairly cynical view of what constitutes punishment against an official. Allowing them to collect a paycheck isn't sufficient. They need to have actual duties - this is not only for the official's benefit but for the public's.
Judges aren't protected as a favor to the judges themselves - God forbid! They're protected because this gets the public closer to the ideal of doing justice without fear or favor.
If a judge can have her authority taken away by her colleagues, this opens the door for shenanigans against judges whose decisions benefit the public while provoking the ire of more corrupt colleagues. I'm speaking hypothetically, but not implausibly.
So, yes, taking away a judge's duties is just as much a punishment as taking away her income. And the public interest, as defined by the Constitution, points to a two-thirds Senate vote as the way to remove judges, not a majority vote of fellow-judges.
If you have a better idea how to manage cognitive decline in federal judges than that which has been developed by the federal courts for decades, please share. Impeachment is clearly unworkable.
Allowing addled judges to continue until they drop dead is no way to protect the public interest.