No, you don't have to install Windows; you can play Xbox Cloud games right from your Steam launcher; here's how. When you purchase through links on our site, we may earn an affiliate commission.