After using my imagination. I think I discovered a new class of activation functions.

def func_i(x,i): #order unknown sin tayler expansion

if i%2==0:

return x

else:

return x**2

Just iterate between x or x**2. Like some polynom expansion.

After using my imagination. I think I discovered a new class of activation functions.

def func_i(x,i): #order unknown sin tayler expansion

if i%2==0:

return x

else:

return x**2

Just iterate between x or x**2. Like some polynom expansion.