While Blackburn called Trump's comments "indefensible," she said she still supports his policy positions.

"While I do not agree with everything that he says, I share the same concerns on major issues facing our nation. The issues of national security, economic security and religious liberty deserve our attention and best efforts," Blackburn said in a statement.

Black agreed, saying she couldn't "bear the thought of Hillary Clinton controlling the Supreme Court or our foreign policy. America has too much at stake to risk her radical and dangerous policies."

The comments come a day after Tennessee Republican Gov. Bill Haslam called on Trump to withdraw his candidacy and let vice presidential nominee Mike Pence take the top spot on the ticket. He's among dozens of prominent national Republicans renouncing their support for Trump, but the only well-known Tennessee Republican to do so.