I’m running my imagination wild today. Got a lot of ideas. One such is to see if some weight values can be replaced random objects. They don’t need to be very random. Just enough so that it makes some difference and still converges.
The reason is to see if some amount generalization could be achieved.