Audio samples for paper: Code-Switched Speech Synthesis using Bilingual Phonetic Posteriorgram with Only Monolingual Corpora.
Authors: Yuewen Cao, Songxiang Liu, Xixin Wu, Shiyin Kang, Peng Liu, Zhiyong Wu, Xunying Liu, Dan Su, Dong Yu, Helen Meng
Corpora: American English speech corpus from Blizzard challenge 2011 and Mandarin speech corpus from Data-baker's open-source website.
Notes: All utterances below are unseen by the systems during training.
System Comparison
"Base-SE": Baseline system with English speaker's speaker embedding. |
"Base-SC": Baseline system with Mandarin speaker's speaker embedding. |
"Prop-SE": Proposed system with English speaker's speaker embedding. |
"Prop-SC": Proposed system with Mandarin speaker's speaker embedding. |
Code-switched Text
1. "That's why 很多人都用地铁."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|
2. "今天真的是很high."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|
3. "看你要的holiday是怎样的."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|
4. "我看过他们的paper效果很好."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|
5. "海南 today greets us with green mountains, blue ocean, gentle breeze and warm sunshine."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|
Chinese Text
1. "一旁的姐姐迪菲说,最初以为是传销者撒谎想骗他们去."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|
2. "该爆料者言之凿凿十分肯定此事."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|
English Text
1. "Vikings are continuing to surprise us."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|
2. "Hobby farmers work on solving sheep shearing problem."
Base-SE |
Base-SC |
Prop-SE |
Prop-SC |
|
|
|
|