# Mr Mustard trainer issue with backend **URL:** \ **Category:** Mr Mustard\ **Created:** [December 19, 2024, 12:41am UTC](https://discuss.pennylane.ai/t/mr-mustard-trainer-issue-with-backend/7747 "2024-12-19T00:41:18Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Rahps97](https://yyz2.discourse-cdn.com/flex012/user_avatar/discuss.pennylane.ai/rahps97/32/3381_2.png) [@Rahps97](https://discuss.pennylane.ai/u/Rahps97)\ **Post date:** [December 19, 2024, 12:41am UTC](https://discuss.pennylane.ai/t/mr-mustard-trainer-issue-with-backend/7747/1 "2024-12-19T00:41:18Z")
Hi I am trying to run the map\_trainer example, got following error: --------------------------------------------------------------------------- RayTaskError(TypeError) Traceback (most recent call last) Cell In[1], line 18 15 return -fidelity(s, target) 17 # Use case 0: Calculate the cost of a randomly initialized circuit 5 times without optimizing it. —\> 18 results\_0 = map\_trainer( 19 cost\_fn=cost\_fn, 20 tasks=5, 21 ) 23 # Use case 1: Run circuit optimization 5 times on randomly initialized circuits. 24 results\_1 = map\_trainer( 25 cost\_fn=cost\_fn, 26 device\_factory=make\_circ, (…) 29 symplectic\_lr=0.05, 30 ) File ~/Photonic Neural Network/MrMustard/mrmustard/training/trainer.py:379, in map\_trainer(trainer, tasks, pbar, unblock, num\_cpus, \*\*kwargs) [376](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:376) if not unblock: [377](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:377) # blocks and wait till all tasks complete to return the end results. [378](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:378) if pbar: → [379](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:379) results = list( [380](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:380) track( [381](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:381) \_iter\_futures(promises), [382](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:382) description=f"{len(promises)} tasks running…", [383](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:383) total=len(promises), [384](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:384) ) [385](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:385) ) [386](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:386) else: [387](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:387) results = ray.get(promises) File ~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:175, in track(sequence, description, total, completed, auto\_refresh, console, transient, get\_time, refresh\_per\_second, style, complete\_style, finished\_style, pulse\_style, update\_period, disable, show\_speed) [164](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:164) progress = Progress( [165](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:165) \*columns, [166](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:166) auto\_refresh=auto\_refresh, (…) [171](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:171) disable=disable, [172](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:172) ) [174](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:174) with progress: → [175](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:175) yield from progress.track( [176](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:176) sequence, [177](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:177) total=total, [178](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:178) completed=completed, [179](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:179) description=description, [180](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:180) update\_period=update\_period, [181](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:181) ) File ~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:1225, in Progress.track(self, sequence, total, completed, task\_id, description, update\_period) [1223](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:1223) if self.live.auto\_refresh: [1224](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:1224) with \_TrackThread(self, task\_id, update\_period) as track\_thread: → [1225](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:1225) for value in sequence: [1226](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:1226) yield value [1227](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/rich/progress.py:1227) track\_thread.completed += 1 File ~/Photonic Neural Network/MrMustard/mrmustard/training/trainer.py:215, in \_iter\_futures(futures) [213](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:213) while futures: [214](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:214) done, futures = ray.wait(futures) → [215](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/Photonic%20Neural%20Network/MrMustard/mrmustard/training/trainer.py:215) yield ray.get(done[0]) File ~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/\_private/auto\_init\_hook.py:21, in wrap\_auto\_init..auto\_init\_wrapper(\*args, \*\*kwargs) [18](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/auto_init_hook.py:18) @wraps(fn) [19](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/auto_init_hook.py:19) def auto\_init\_wrapper(\*args, \*\*kwargs): [20](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/auto_init_hook.py:20) auto\_init\_ray() —\> [21](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/auto_init_hook.py:21) return fn(\*args, \*\*kwargs) File ~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/\_private/client\_mode\_hook.py:103, in client\_mode\_hook..wrapper(\*args, \*\*kwargs) [101](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/client_mode_hook.py:101) if func. **name**!= “init” or is\_client\_mode\_enabled\_by\_default: [102](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/client_mode_hook.py:102) return getattr(ray, func. **name** )(\*args, \*\*kwargs) → [103](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/client_mode_hook.py:103) return func(\*args, \*\*kwargs) File ~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/\_private/worker.py:2755, in get(object\_refs, timeout) [2749](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:2749) raise ValueError( [2750](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:2750) f"Invalid type of object refs, {type(object\_refs)}, is given. " [2751](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:2751) "‘object\_refs’ must either be an ObjectRef or a list of ObjectRefs. " [2752](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:2752) ) [2754](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:2754) # TODO(ujvl): Consider how to allow user to retrieve the ready objects. → [2755](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:2755) values, debugger\_breakpoint = worker.get\_objects(object\_refs, timeout=timeout) [2756](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:2756) for i, value in enumerate(values): [2757](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:2757) if isinstance(value, RayError): File ~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/\_private/worker.py:906, in Worker.get\_objects(self, object\_refs, timeout, return\_exceptions) [904](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:904) global\_worker.core\_worker.dump\_object\_store\_memory\_usage() [905](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:905) if isinstance(value, RayTaskError): → [906](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:906) raise value.as\_instanceof\_cause() [907](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:907) else: [908](https://vscode-remote+ssh-002dremote-002b128-002e111-002e58-002e29.vscode-resource.vscode-cdn.net/home/rahul/Photonic%20Neural%20Network/~/anaconda3/envs/Xanadu/lib/python3.11/site-packages/ray/_private/worker.py:908) raise value RayTaskError(TypeError): ray::train\_device() (pid=3643480, ip=128.111.58.29) File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/training/trainer.py”, line 181, in train\_device final\_cost = cost\_fn() ^^^^^^^^^ File “/tmp/ipykernel\_3641918/1782703836.py”, line 14, in cost\_fn File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/lab/abstract/state.py”, line 616, in **rshift** return other.primal(self) ^^^^^^^^^^^^^^^^^^ File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/lab/circuit.py”, line 63, in primal state = op.primal(state) ^^^^^^^^^^^^^^^^ File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/lab/abstract/transformation.py”, line 85, in primal new\_state = self.\_transform\_gaussian(state, dual=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/lab/abstract/transformation.py”, line 115, in \_transform\_gaussian X, Y, d = self.XYd(allow\_none=False) if not dual else self.XYd\_dual(allow\_none=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/lab/abstract/transformation.py”, line 235, in XYd Y = math.zeros\_like(X) if self.Y\_matrix is None else self.Y\_matrix ^^^^^^^^^^^^^^^^^^ File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/math/backend\_manager.py”, line 1224, in zeros\_like return self.\_apply(“zeros\_like”, (array,)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/math/backend\_manager.py”, line 111, in \_apply return attr(\*args) ^^^^^^^^^^^ File “/home/rahul/Photonic Neural Network/MrMustard/mrmustard/math/backend\_numpy.py”, line 382, in zeros\_like return np.zeros(np.array(array).shape, dtype=array.dtype) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: Cannot interpret ‘tf.float64’ as a data type ---
**Author:** ![CatalinaAlbornoz](https://yyz2.discourse-cdn.com/flex012/user_avatar/discuss.pennylane.ai/catalinaalbornoz/32/1196_2.png) [@CatalinaAlbornoz](https://discuss.pennylane.ai/u/CatalinaAlbornoz)\ **Post date:** [December 19, 2024, 8:27pm UTC](https://discuss.pennylane.ai/t/mr-mustard-trainer-issue-with-backend/7747/2 "2024-12-19T20:27:56Z")
Hi @Rahps97 ! I actually cannot replicate your error. I get a different error instead 🫠 . I’ve forwarded your question to the MrMustard developers. Note that they may take a few days to get back to you because of the holidays next week. ---
**Author:** ![Rahps97](https://yyz2.discourse-cdn.com/flex012/user_avatar/discuss.pennylane.ai/rahps97/32/3381_2.png) [@Rahps97](https://discuss.pennylane.ai/u/Rahps97)\ **Post date:** [December 19, 2024, 10:24pm UTC](https://discuss.pennylane.ai/t/mr-mustard-trainer-issue-with-backend/7747/3 "2024-12-19T22:24:30Z")
Isit some numpy related error? I got that in a new environment as well. Thanks, and Happy Holidays to you and developers. ---
**Author:** ![CatalinaAlbornoz](https://yyz2.discourse-cdn.com/flex012/user_avatar/discuss.pennylane.ai/catalinaalbornoz/32/1196_2.png) [@CatalinaAlbornoz](https://discuss.pennylane.ai/u/CatalinaAlbornoz)\ **Post date:** [December 21, 2024, 12:31am UTC](https://discuss.pennylane.ai/t/mr-mustard-trainer-issue-with-backend/7747/4 "2024-12-21T00:31:14Z")
Hi @Rahps97 , Yes, the error I got was related to Numpy but I think one of my colleagues was able to replicate your issue. We’re still not sure what’s the cause so we’ll get back to you in the new year. Happy holidays to you too!