runtime error

Exit code: 1. Reason: gin cuDNN when one has already been registered 2024-10-12 08:04:29.322282: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered 2024-10-12 08:04:29.337377: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: AVX2 AVX512F AVX512_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags. 2024-10-12 08:04:30.857893: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 51, in starmapstar return list(itertools.starmap(args[0], args[1])) File "/home/user/app/app.py", line 122, in train_model translator.train(input_texts, target_texts, epochs) File "/home/user/app/app.py", line 103, in train predicted_translation = self.translate(input_seq) File "/home/user/app/app.py", line 74, in translate encoder_output = self.model.layers[1].predict(input_seq) AttributeError: 'Dense' object has no attribute 'predict' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/user/app/app.py", line 133, in <module> results = pool.starmap(train_model, [(model, input_texts, target_texts, 100, i, rewards) for i, model in enumerate(models)]) File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 375, in starmap return self._map_async(func, iterable, starmapstar, chunksize).get() File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 774, in get raise self._value AttributeError: 'Dense' object has no attribute 'predict'

Container logs: