Thanks for the feedback. This can be an issue with a particular card, or the SiI3132 compatibility in MorphOS in generally broken.
The first two(!) SiI3132 cards I tried even crashed my system immediately so that I wasn't even able to boot AmigaOS. So I ordered the exact card that was confirmed to work on my system (with AmigaOS at least).