In this talk, I discuss the state of support of GPU computing with "alternative" software array libraries in SciPy via Array API. In addition to user-visible support, I will describe some internal infrastructure of SciPy which might be useful for other libraries, and discuss ongoing work and challenges ahead.