Conversion of sequential model

[drasmuss]

@zerone

If TF-Keras models have activation="relu" , then while conversion to a spiking network (i.e. subsequent swapping of ReLU neurons with nengo.SpikingRectifiedLinear() neurons), they don’t get swapped to spiking neurons. You need to define your TF-Keras models with activation=tf.nn.relu for the conversion to take place

If you specify activation="relu", under the hood that is mapped to tf.keras.activations.relu. So you would need to set up your activation swap like swap_activations={tf.keras.activations.relu: nengo.SpikingRectifiedLinear()} (rather than {tf.nn.relu: nengo.SpikingRectifiedLinear()}).