This is handled in List.mui, so this should be fixed/changed there so all applications using List.mui would have the same behaviour.

Maybe a fix could be to detect if the mouse was moved "more horizontally than vertically" after left clicking and then disable multiselection!?
This way a selection of one entry to drag it to another lister would be recognized.