Leeds, 53 places higher on the league ladder than Newport, led 1-0 for most of a pulsating third-round tie at Rodney Parade.
But a Conor Shaughnessy own goal and substitute Shawn McCoulsky’s towering header put County in the fourth round for the first time since the 1978-79 season.