There are live images where you can test and run Linux out of an USB, but most of those are not persistent (start from scratch once you reboot), the other option is called dual boot where you have Windows and Linux installed in parallel and you select which one to use during boot.