If you can't boot into Windows after deleting the Linux partition, and see errors like "GRUB rescue>" or "no boot device ...

Booting from a USB stick is very helpful for many purposes. However, many factors have to be right for the boot to work ...