Lower impedances generally cause amplifiers to distort more. Its usually the jump between the nominal 8-to-4 Ohms that the rise in distortion generally occurs. Low impedances that get close to being a dead short can be dangerous to amps.
One of the guys I know from the pro industry, like most of the other guys I know, worked for Maryland Sound in the 80's. One of the things this guy did was put together touring rigs for shows. Sales people from many different audio companies would bring their new products in to get MSI to purchase their products. Well, he would take their new amps, put them on the test bench and check distortion and what not, then he would put a load on the amp, run it at full swing, then short the outputs with a spoon while the sales person watched in horror as the amp would meltdown or catch on fire. Nowadays companies have nifty short circuit protection. I know its sort of a tangent, but it is an interesting story.