“Congress could not have meant for the guarantees it was affording to be so cavalierly swept aside,” wrote one judge.