Tree-LSTM Unit Activation Function

From GM-RKB
(Redirected from Tree LSTM)
Jump to navigation Jump to search

A Tree-LSTM Unit Activation Function is a Long Short-Term Memory Unit-based Activation Function applied to Tree Structured Neural Networks.



References

2018

  • [math]\displaystyle{ a }[/math] : sources of cell input
  • [math]\displaystyle{ i }[/math] : sources of input gate
  • [math]\displaystyle{ o }[/math]: sources of output gate
  • [math]\displaystyle{ f_n }[/math] : sources of forget gate for n-th ary
Second, it computes outputs as:

[math]\displaystyle{ c=tanh(a)\;sigmoid(i)+c_1\;sigmoid(f1),+c_2\;sigmoid(f_2),+\cdots,+c_N\;sigmoid(f_N) }[/math],

[math]\displaystyle{ h=tanh(c)sigmoid(o) }[/math].

These are returned as a tuple of (N + 1) variables(...)

2016

2015