I have a 2008-era QNap NAS that has never had any problem with umlauts or indeed any non-Latin characters, including Korean and Cyrillic. Peering into smb.conf all I can see of relevance is

dos charset = ASCII
display charset = UTF8

But it is an old Samba. Very, very old. Easily 2.x.