You were half right. The USB I created was bootable, because the PC booted off of it, but missed parts of the installer. I forgot about that Microsoft provides an ISO image (why would they?) that cannot be written to a USB drive with dd or any ordinary imaging tool. So I had to find another Windows machine and create a boot stick from there using the stupid Microsoft tool to write the ISO to the USB drive.
Thank you for the heads up.