Born in Waco, Texas, Williams was the lead singer of The Charioteers between 1930 and 1950, when he formed his own Billy Williams Quartet with Eugene Dixon, Claude Riddick and John Ball. Many television appearances followed, including an appearance on Your Show of Shows with Sid Caesar.
By the early 1960s he lost his voice due to complications of diabetes. He subsequently moved to Chicago and worked as a social worker until his death there in 1972.