This is an introductory document of using the xgboost package in R. xgboost is short for
eXtreme Gradient Boosting package. It is an efficient and scalable implementation of gradient …

Low-rank and sparse structures have been profoundly studied in matrix completion and
compressed sensing. In this paper, we develop "Go Decomposition" (GoDec) to efficiently and …

Recurrent neural nets (RNN) and convolutional neural nets (CNN) are widely used on NLP
tasks to capture the long-term and local dependencies, respectively. Attention mechanisms …

Heterogeneity across clients in federated learning (FL) usually hinders the optimization
convergence and generalization performance when the aggregation of clients' knowledge …

Large language models (LLMs) with hundreds of billions of parameters have sparked a new
wave of exciting AI applications. However, they are computationally expensive at inference …

Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to
learn collaboratively without sharing their private data. However, excessive computation …

… [100] Jan van den Brand, Zhao Song, and Tianyi Zhou. Algorithm and hardness for dynamic
attention maintenance in large language models. arXiv preprint arXiv:2304.02207, 2023. …

Human-curated knowledge graphs provide critical supportive information to various natural
language processing tasks, but these graphs are usually incomplete, urging auto-completion …

It is difficult to find the optimal sparse solution of a manifold learning based dimensionality
reduction algorithm. The lasso or the elastic net penalized manifold learning based …

Recurrent neural networks (RNN), convolutional neural networks (CNN) and self-attention
networks (SAN) are commonly used to produce context-aware representations. RNN can …