Milwaukee Brewers closer Francisco Rodriguez had been picking up his teammates all season with one dominating performance after another.

This was the day they returned the favor.

After Rodriguez surrendered a game-tying, two-strike, two-out home run to Mark Teixeira in the top of the ninth, the Brewers came back to beat the New York Yankees, 6-5, on Mark Reynolds' two-out single in the bottom of the inning Sunday before a sellout crowd of 43,544 at Miller Park.

In converting his first 15 save opportunities, including eight with one-run leads, Rodriguez had not allowed a single run. And while every closer is going to blow a save eventually, it was still somewhat shocking when Teixeira went down and golfed a 3-2 changeup — Rodriguez's signature pitch — out to right field to tie the game.

"Two strikes, two outs, it's a lot tougher," said manager Ron Roenicke, whose club avoided dropping a third consecutive series. "Teixeira is a good hitter, smart hitter. He understands how to hit; he's dangerous. He went down and got a good changeup."

Rodriguez, who finally got an earned-run average (0.45), took it all in stride, tipping his cap to Teixeira.

"Actually, it was a good pitch," he said. "In the beginning, I had my doubts about whether it was up or middle in. The ball was going down and away to him. He just hooked it. That's part of the game."

Rodriguez's teammates didn't let him sit on that disappointment for long. With one down in the bottom of the ninth, resurgent Rickie Weeks (3 for 5) slashed a broken-bat, opposite-field double over the first-base bag and moved to third on a wild pitch by reliever Adam Warren.

Warren gave himself a chance to escape by striking out Lyle Overbay but wasn't as fortunate with Reynolds, who tried to catch the Yankees off-guard with a bunt attempt on a 0-1 count but whiffed on it. On the next pitch, Reynolds — who finished the 2013 season with the Yankees — punched a slider through the left side for his game-winning single and the Brewers' first walk-off victory of the year.

"The third baseman was way back," Reynolds said of his bunt attempt. "I kind of made eye contact with Rickie. It was a good play if I did it. It was right down the middle. I wish I would have swung at it. I took my chances."

Reynolds' hit capped a nice team victory in which many players had supporting roles. The game began on a sour note when starter Matt Garza was all over the place during a three-run, 40-pitch top of the first inning.

Garza settled down and put together four scoreless innings before his pitch count (106) forced an early exit. Five relievers covered the rest of the game, allowing five hits and two runs, including the Teixeira stunner.

The Brewers erased a 3-2 deficit with a three-run rally in the sixth inning as Roenicke took a gamble with his bench depth. With two on and no outs, Roenicke sent left-handed hitting Scooter Gennett to bat for Garza, prompting Yankees manager Joe Girardi to counter with lefty Matt Thornton replacing starter David Phelps.