eldorado.tu-dortmund.de/server/api/core/bitstreams/ee8dedde-9b7a-47c0-9049-73cf8c30f532/content
X + ) 3
ln
1 1 p
Where:
• X is the input vector size (i.e. the width of the input dataset or the number of feature columns);
• p is the sought-after coverage probability (e.g. p = 0:999 for a sought [...] Unit (GELU) :
f (x) = x ( x)
15
2 Theoretical Background
Where ( x) is dened as:
( x) = P(Z < x ) = 1 2
1 + erf
x
p 2
GELU combines properties of both linear units and probabilistic models by apply- ing [...] 3633
DN _FT3 1,65 2088
DN _VOIP 4 0,92 1172
DN _VS5 0,85 1077
DN _EM 6 0,37 466
DN _BR7 0,17 210
DN _P2P8 0,14 176
Total 100% 126892
Darknet Test Set
Label % Count
Normal 84,67 26862
DN _AS1 8,37 2657
DN …