Open
Description
created this layer to monitor what's happening:
class ReportingConv1D(Conv1D):
def call(self, inputs):
print(f"{inputs.dtype} {inputs.shape} {self.kernel.dtype} {self.kernel.shape} {self.kernel.path}")
return super().call(inputs)
forward pass:
<dtype: 'float16'> (2, 147456, 16) float16 (5, 16, 16) reporting_conv1d_25/kernel
backward pass:
<dtype: 'float16'> (2, 147456, 16) float32 (5, 16, 16) reporting_conv1d_25/kernel