The 25-year-old Kramer (1-1) struck out eight and walked none, giving up only Julio Franco's fourth-inning home run. It was his first major league victory.
Kramer faced 28 batters, one over the minimum, and teammate Paul Sorrento backed him with two home runs, his 10th and 11th of the season.
"It just set in. I came one pitch from a perfect game," Kramer said. "All I can say is: Wow!"
Before Monday, the right-hander had never pitched longer than four innings in the major leagues. But he shut down a Texas team that entered the game ranked third in the American League in runs scored.
Toronto 4, Milwaukee 1--Dave Stewart gave up two hits over seven innings at Toronto, leading the Blue Jays to their fifth consecutive victory.
The victory for Stewart (1-1) was his first since coming to the Blue Jays. He gave up one run, struck out three and walked two.
Devon White homered twice for Toronto. White homered on the game's first pitch from Mike Boddicker (3-3). It was the 18th time White has homered to start a game.
The game also marked Paul Molitor's first appearance against his former teammates. A Brewer for 15 seasons before signing with the Blue Jays, Molitor went two for four with a run scored and a stolen base.
Boston 6, Detroit 5--Scott Cooper hit a two-out triple during the 10th inning and scored on Bob Zupcic's double at Detroit.
Cooper was credited with a triple after the ball scooted past center fielder Milt Cuyler's attempt at a shoestring catch. He scored when Zupcic doubled against Bob MacDonald (3-2).
Baltimore 8, New York 6--Cal Ripken, in a slump much of the season, led off the seventh inning with a tie-breaking home run to lift the Orioles at Baltimore.
Ripken's homer overcame a Yankee comeback that included two home runs by Kevin Maas, erasing the Orioles' 6-1 lead.
Maas' home runs included a three-run shot against Rick Sutcliffe (5-2) that capped a four-run sixth to make the score 6-6.
Ripken, batting .209 with three homers entering the game, opened the seventh by hitting a pitch from Andy Cook (0-1) over the left-center field wall to make the score 7-6.