From what I recall from Behind the Bastards, a major part of Hitler’s bloc was the upper middle-class. Shopkeepers, factory managers, so on. It basically came down to the opportunity to eliminate wealthy Jews, and taking their stuff - fancy furniture, buildings, their businesses, ect. The destruction of the Jews was a matter of greed that happened to fit hand-in-glove with racist ideology.