House Democrats pushed back Thursday against the notion President Barack Obama should wait to act on immigration, given the results of the 2014 midterms, while also suggesting the criticism of his expected executive action on immigration is overblown.

Minority Leader Nancy Pelosi said Obama acted with Congress when the Senate passed an immigration overhaul bill in 2013 and Rep. Louise M. Slaughter, D-N.Y., later slammed criticism of Obama’s expected action.

“It’s perfectly legitimate, and I don’t know why in the world you all are so obsessed with that notion, because I bet you that you know yourselves that it’s perfectly legitimate for him to do it, and you made no outcry of any sort when anybody else did it,” Slaughter said. “It’s because it’s Obama.”