Hey @imakash! It might be worth updating to the most-recent versions of everything — some of your package versions are out-of-sync (you’re pretty up-to-speed with lightning-gpu but not pl-lightning or pennylane)
You can try building pl-lightning from source via pip install pybind11 pennylane-lightning --no-binary :all:.