Margaret Dumont, in my opinion anyway, was not a homely woman. She was just a little older by the time she got into films. I can totally see her being attractive in her twenties and thirties.
The other day I watched THE COCOANUTS and for the first time thought she was fairly attractive in her own way. Then I did the math and figured out that version of Margaret Dumont is only five years older than me!