FeUdal Network (FuN)

From GM-RKB
(Redirected from FeUdal Network (FUN))
Jump to navigation Jump to search

A FeUdal Network (FuN) is a Modular Neural Network that is composed by a manager and a worker modules.



References

2017

$z_{t}=f^{\text {percept }}\left(x_{t}\right) ; s_{t}=f^{\text {Mspace}}\left(z_{t}\right)$ (1)
$h_{t}^{M}, \hat{g}_{t}=f^{M r n n}\left(s_{t}, h_{t-1}^{M}\right) ; g_{t}=\dfrac{\hat{g}_{t}}{\parallel\hat{g}_{t}\parallel}$ (2)
$w_{t}=\phi\left(\sum_{i=t-c}^{t} g_{i}\right) $ (3)
$h^{W}, U_{t}=f^{W r n n}\left(z_{t}, h_{t-1}^{W}\right) ; \pi_{t}=\operatorname{SoftMax}\left(U_{t} w_{t}\right)$ (4)

2017 FeUdalNetworksforHierarchicalRe Fig1.png
Figure 1. The schematic illustration of FuN.