File:2017 RecurrentHighwayNetworks Fig2.png

[[File:2017_RecurrentHighwayNetworks_Fig2.png|700px|thumb|center|Figure 2: Illustration of the Gersgorin circle theorem. Two Gersgorin circles are centered around their diagonal entries [math]\displaystyle{ a_{ii} }[/math]. The corresponding eigenvalues lie within the radius of the sum of absolute values of non-diagonal entries [math]\displaystyle{ a_{ij} }[/math]. Circle (1) represents an exemplar Gersgorin circle for an RNN initialized with small random values. Circle (2) represents the same for an RNN with identity initialization of the diagonal entries of the recurrent matrix and small random values otherwise. The dashed circle denotes the unit circle of radius 1. In: Zilly et al. (2017)