Lyric-to-melody generation is an important task in automatic songwriting. Previous lyric-to-melody
generation systems usually adopt end-to-end models that directly generate melodies …

Scaling text-to-speech (TTS) to large-scale, multi-speaker, and in-the-wild datasets is
important to capture the diversity in human speech such as speaker identities, prosodies, and …

Audio editing is applicable for various purposes, such as adding background sound effects,
replacing a musical instrument, and repairing damaged audio. Recently, some diffusion-…

Medical dialogue systems are promising in assisting in telemedicine to increase access to
healthcare services, improve the quality of patient care, and reduce medical costs. To facilitate …

Symbolic music understanding, which refers to the understanding of music from the symbolic
data (eg, MIDI format, but not audio), covers many music applications such as genre …

While recent large-scale text-to-speech (TTS) models have achieved significant progress,
they still fall short in speech quality, similarity, and prosody. Considering speech intricately …

Speech conveys more information than just text, as the same word can be uttered in various
voices to convey diverse information. Compared to traditional text-to-speech (TTS) methods …

Under the pandemic of COVID-19, people experiencing COVID19-related symptoms or
exposed to risk factors have a pressing need to consult doctors. Due to hospital closure, a lot of …

Under the pandemic of COVID-19, people experiencing COVID19-related symptoms have a
pressing need to consult doctors. Because of the shortage of medical professionals, many …

We present RALL-E, a robust language modeling method for text-to-speech (TTS) synthesis.
While previous work based on large language models (LLMs) shows impressive …