WOGONG blog wiki read

Local Response Normalization (LRN) in different frameworks.

Local Response Normalization (LRN) has different implementations in different Frameworks.

Caffe

Document

  • Parameters (LRNParameter lrn_param) Optional

    • local_size [default 5]: the number of channels to sum over (for cross channel LRN) or the side length of the square region to sum over (for within channel LRN)
    • alpha [default 1]: the scaling parameter (see below)
    • beta [default 5]: the exponent (see below)
    • norm_region [default ACROSS_CHANNELS]: whether to sum over adjacent channels (ACROSS_CHANNELS) or nearby spatial locations (WITHIN_CHANNEL)
  • 计算公式

TensorFlow

different from Caffe version. refer to this post.

  • 计算公式

PyTorch

Document

same as Caffe version, the parameters can be used directly.

  • 计算公式