From the main menu, go to "Audio/Video options". Then go into "Video Card & Resolution" and toggle the "Fullscreen" option to No.

Alternatively, you can start the game with -w from the shell.