It should be possible to just press and hold the option key on reboot to open the graphical boot menu and select the usb stick from there.