A Taft High School graduate who possessed just enough athletic ability to be a backup catcher at Bradley University, Krause relentlessly picked the brains of his superiors to learn more about sports, his life's passion.
In this city of big shoulders and hard work, Krause filled the bill.
But for a man who served as the architect for six world championships in a city starved for sports success, Krause still polarized public opinion.
That's why the shocking news of his resignation Monday was met by a gamut of emotions, from players shedding tears to talk-radio callers emitting cheers.
In a statement, Krause, 64, cited health concerns as the official reason for his departure after 18 seasons. But several of those close to him expressed skepticism that he voluntarily would leave a rebuilding effort that appeared to be turning the corner.
Team sources said Krause suffers from no known or disclosed serious illness.
He did battle pneumonia a few years ago, and he complained of back and neck pain from the constant travel through which the former scout still pushed himself. Often, Krause received treatment on the trainer's table, and the arrival of two grandchildren had softened him.
Still, the timing of the move raised eyebrows, especially given Krause's undying passion for his job and his constant claim that youngsters Tyson Chandler, Eddy Curry and Jamal Crawford had reinvigorated him. As recently as a preseason interview, he scoffed at the suggestion of retirement.
"The rigors and stress of the job have caused me some minor physical problems," Krause said Monday in a statement. "Those problems can be eliminated if I lessen my load and concentrate on overcoming them. My first obligation is to accomplish that for my wife, children and grandchildren.
"Upon leaving, I'm very confident that we have assembled the key pieces so that the franchise can return to the NBA's elite teams in the very near future. I am not retiring. I'm going to take some time off and spend it with my family before making any decision on my future. I will leave my options open."
One team source said Krause told him he expected to be back in the league within a year. Another said Reinsdorf offered Krause a consultant's job, but that he declined.
Reinsdorf, so closely aligned with Krause during the turbulent breakup of the 1990s dynasty, attended an emotional team meeting Monday in an upstairs office at the Berto Center.
"Jerry Krause is one of a kind," Reinsdorf said in his own statement. "He brought with him a vision of how to build a champion, and he proceeded to create one of the most dominant champions of all time. No basketball fan in America can begin to imagine the world-champion Chicago Bulls without his imprint."
Possible successors to Krause include broadcaster John Paxson, special assistant B.J. Armstrong and former special assistant and current Pacers assistant coach Jim Stack. One possibility has Paxson assuming the role, with Armstrong taking on greater responsibility in personnel decisions.
Another long shot is Memphis coach Hubie Brown, who coached Bill Cartwright in New York. Cartwright's job as Bulls head coach is safe for the immediate future.
Krause walked an unprecedented path by building six championship teams around a shooting guard. Of course, that shooting guard was Michael Jordan, and many likened buidling those teams to putting a frame around the Mona Lisa.
In truth, many of Krause's personnel moves struck gold.