For now it would be suggested to use the CPU with the TorchLayer from PennyLane. Although some examples might work, complete GPU support for the TorchLayer is something we’d have to further explore.
Recommend keeping an eye on the following relevant thread too: