User profiles for Adam Roberts

Adam Roberts

Google DeepMind
Verified email at google.com
Cited by 51958

[BOOK][B] Science fiction

A Roberts - 2002 - taylorfrancis.com
This outstanding volume offers a clear and critically engaged account of the phenomenon of
science fiction. Adam Roberts provides a concise history of science fiction also explaining …

Scaling instruction-finetuned language models

…, S Petrov, EH Chi, J Dean, J Devlin, A Roberts… - Journal of Machine …, 2024 - jmlr.org
Finetuning language models on a collection of datasets phrased as instructions has been
shown to improve model performance and generalization to unseen tasks. In this paper we …

Identification of novel transcripts in annotated genomes using RNA-Seq

A Roberts, H Pimentel, C Trapnell, L Pachter - Bioinformatics, 2011 - academic.oup.com
We describe a new ‘reference annotation based transcript assembly’ problem for RNA-Seq
data that involves assembling novel transcripts in the context of an existing annotation. This …

Differential gene and transcript expression analysis of RNA-seq experiments with TopHat and Cufflinks

C Trapnell, A Roberts, L Goff, G Pertea, D Kim… - Nature protocols, 2012 - nature.com
Recent advances in high-throughput cDNA sequencing (RNA-seq) can reveal new genes
and splice variants and quantify expression genome-wide in a single assay. The volume and …

Prolonged military occupation: the Israeli-occupied territories since 1967

A Roberts - American Journal of International Law, 1990 - cambridge.org
To what extent are international legal rules formally applicable, and practically relevant, to a
prolonged military occupation? The question has assumed prominence because of the …

Palm: Scaling language modeling with pathways

…, J Devlin, M Bosma, G Mishra, A Roberts… - Journal of Machine …, 2023 - jmlr.org
Large language models have been shown to achieve remarkable performance across a variety
of natural language tasks using few-shot learning, which drastically reduces the number …

Nato's 'humanitarian war'over kosovo

A Roberts - Survival, 1999 - Taylor & Francis
The 11-week bombing campaign conducted by NATO in spring 1999 against the Federal
Republic of Yugoslavia (FRY) has many claims to uniqueness. It was the first sustained use of …

Exploring the limits of transfer learning with a unified text-to-text transformer

C Raffel, N Shazeer, A Roberts, K Lee, S Narang… - Journal of machine …, 2020 - jmlr.org
Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned
on a downstream task, has emerged as a powerful technique in natural language …

Lamda: Language models for dialog applications

…, J Qin, D Chen, Y Xu, Z Chen, A Roberts… - arXiv preprint arXiv …, 2022 - arxiv.org
We present LaMDA: Language Models for Dialog Applications. LaMDA is a family of
Transformer-based neural language models specialized for dialog, which have up to 137B …

mT5: A massively multilingual pre-trained text-to-text transformer

L Xue, N Constant, A Roberts, M Kale… - arXiv preprint arXiv …, 2020 - arxiv.org
The recent "Text-to-Text Transfer Transformer" (T5) leveraged a unified text-to-text format
and scale to attain state-of-the-art results on a wide variety of English-language NLP tasks. In …