The Terps built a 2-0 lead in the first 13 minutes but couldn't hold on.
Neumann notched five saves in a clean sheet against Ohio State.
The Terps rose five spots after beating Ohio State, 2-0, last week.
After a 3-3 start, the Terps are flying high.
The sophomore has scored both of his goals this season on headers.
Justin Gielen and Malcolm Johnston found the back of the net for the Terps.
Seven different players have notched game-winning goals in the Terps' eight wins this season.
“This was not a thing of beauty [against Yale]. But sometimes on these midweek games, you just have to grind it out.”
The Terps topped two ranked opponents — Indiana and Yale — last week.
Bergmann is the first player to earn Big Ten honors on offense and defense since at least 2010.