Acting IRS Commissioner Gary Shapley was removed from his position on Friday after being appointed to the post on Tuesday, The New York Times reported.