Tax Refund Scams: 3 Schemes to Look for and How to Avoid Them For one thing, the IRS would not insult you over the phone. It’s tax season and scams are afoot. Because filing tax returns can be such an arduous, confusing process, it’s the perfect opportunity for criminals to take advantage of unsuspecting taxpayers. Here are three tactics scammers use to steal personal information and money, according to the IRS. The more you know, the less likely you’ll get scammed.