Recent work has shown that convolutional networks can be substantially deeper, more
accurate, and efficient to train if they contain shorter connections between layers close to the …

Recent work has shown that convolutional networks can be substantially deeper, more
accurate, and efficient to train if they contain shorter connections between layers close to the …

Extreme learning machine (ELM) has gained increasing interest from various research fields
recently. In this review, we aim to report the current state of the theoretical research and …

Ensembles of neural networks are known to be much more robust and accurate than
individual networks. However, training multiple deep networks for model averaging is …

The accuracy of deep convolutional neural networks (CNNs) generally improves when fueled
with high resolution images. However, this often comes at a high computational cost and …

The deployment of deep convolutional neural networks (CNNs) in many real world applications
is largely hindered by their high computational cost. In this paper, we propose a novel …

Very deep convolutional networks with hundreds of layers have led to significant reductions
in error on competitive benchmarks. Although the unmatched expressiveness of the many …

Network pruning is widely used for reducing the heavy inference cost of deep models in low-resource
settings. A typical pruning algorithm is a three-stage pipeline, ie, training (a large …

Transformers have recently shown superior performances on various vision tasks. The large,
sometimes even global, receptive field endows Transformer models with higher …

… Gao Huang is with the Department of Automation, Tsinghua … Yizeng Han and Gao Huang
are equal contribution to this … Huang, “Improved techniques for training adaptive deep networks,…