Gradient Boosting Decision Tree (GBDT) is a popular machine learning algorithm, and has
quite a few effective implementations such as XGBoost and pGBRT. Although many …

… Tie-Yan Liu … Tie-Yan Liu … Liu, “Are algorithms directly optimizing IR measures really
direct?,” Technical Report, Microsoft Research, MSR-TR-2008-154, 2008. [62] R. Herbrich, T. …

The paper is concerned with learning to rank, which is to construct a model or a function for
ranking objects. Learning to rank is useful for document retrieval, collaborative filtering, and …

The Transformer architecture has become a dominant choice in many domains, such as
natural language processing and computer vision. Yet, it has not achieved competitive …

Non-autoregressive text to speech (TTS) models such as FastSpeech can synthesize speech
significantly faster than previous autoregressive models with comparable quality. The …

Pre-trained language models have attracted increasing attention in the biomedical domain,
inspired by their great success in the general natural language domain. Among the two main …

BERT adopts masked language modeling (MLM) for pre-training and is one of the most
successful pre-training models. Since BERT neglects dependency among predicted tokens, …

Artificial intelligence (AI) is being increasingly integrated into scientific discovery to augment
and accelerate research, helping scientists to generate hypotheses, design experiments, …

Pre-training and fine-tuning, eg, BERT, have achieved great success in language
understanding by transferring knowledge from rich-resource pre-training task to the low/zero-resource …

Neural network based end-to-end text to speech (TTS) has significantly improved the quality
of synthesized speech. Prominent methods (eg, Tacotron 2) usually first generate mel-…