Rchr

J-GLOBAL ID：200901076864623187 Update date: Apr. 08, 2024

Yamagishi Junichi

ヤマギシジュンイチ | Yamagishi Junichi

Affiliation and department：
Job title： Professor
Other affiliations (1)：

The Graduate University for Advanced Studies

Homepage URL (2)： http://www.nii.ac.jp/faculty/dgital_content/yamagishi_junichi/ , http://www.nii.ac.jp/en/faculty/digital_content/yamagishi_junichi/

Research field (2)： Perceptual information processing , Perceptual information processing

Research keywords (11)： media forensics , biometrics , speaker verification , 生体検知 , speaker recognition , Machine learning , Assistive Technology , Speech Synthesis , Speech Information Processing , Pattern recognition , Speech processing

Research theme for competitive and other funds (37)：

2021 - 2025 Explainable next-generation media forensics technologies based on fake media detection and automatic fact verification
2021 - 2024 Research on master biometric information protection and utilization platform
2021 - 2023 AI噺家は人を楽しませる事ができるのか?-落語音声合成の表現力向上と噺の自動生成
2018 - 2023 VoicePersonae:声のアイデンティティクローニングと保護
2018 - 2022 PRISM: 選択的情報マスキングを可能とする次世代音声プライバシー保護技術

Show all

Papers (396)：

Chang Zeng, Xiaoxiao Miao, Xin Wang, Erica Cooper, Junichi Yamagishi. Joint Speaker Encoder and Neural Back-end Model for Fully End-to-End Automatic Speaker Verification with Multiple Enrollment Utterances. Computer Speech & Language. 2024. 86
Cheng Gong, Xin Wang, Erica Cooper, Dan Wells, Longbiao Wang, Jianwu Dang, Korin Richmond, Junichi Yamagishi. ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations. Submitted to TASLP. 2024
Shirin Dabbaghi, Canasai Kruengkrai, Ramin Yahyapour, Junichi Yamagishi. Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model. 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024). 2024
Erica Cooper, Wen-Chin Huang, Yu Tsao, Hsin-Min Wang, Tomoki Toda, Junichi Yamagishi. A review on subjective and objective evaluation of synthetic speech. Acoustical Science and Technology. 2024
Aditya Ravuri, Erica Cooper, Junichi Yamagishi. Uncertainty as a Predictor: Leveraging Self-Supervised Learning for Zero-Shot MOS Prediction. `the Self-supervision in Audio, Speech and Beyond (SASB) workshop 2024. 2024

ｍore...

MISC (39)：

Canasai Kruengkrai, 山岸順一. 自動事実検証: FEVER Challenge参加から得た教訓. 映像情報メディア学会誌インフォデミック時代のAIとサイバーセキュリティ. 2022
Trung-Nghia Le, Huy H. Nguyen, 山岸順一, 越前功. Deepfake 生成と検出の現状. 映像情報メディア学会誌インフォデミック時代のAIとサイバーセキュリティ. 2022
Hieu-Thi Luong, Junichi Yamagishi. LaughNet: synthesizing laughter utterances from waveform silhouettes and a single laughter example. ArXiv. 2021
Erica Cooper, Xin Wang, Yi Zhao, Yusuke Yasuda, Junichi Yamagishi. PRETRAINING STRATEGIES, WAVEFORM MODEL CHOICE, AND ACOUSTIC CONFIGURATIONS FOR MULTI-SPEAKER END-TO-END SPEECH SYNTHESIS. ArXiv. 2020
Antoine Perquin, Erica Cooper, Junichi Yamagishi. An Investigation of the Relation Between Grapheme Embeddings and Pronunciation for Tacotron-based Systems. ArXiv. 2020

ｍore...

Patents (10)：

音声合成装置
情報処理装置、情報処理システム、プログラムおよび情報処理方法
学習装置、学習方法、音声合成装置、音声合成方法及びプログラム
符号化装置、符号化方法およびプログラム
DNN音声合成の教師無し話者適応を実現するコンピュータシステム、そのコンピュータシステムにおいて実行される方法およびプログラム

ｍore...

Books (9)：

A Practical Guide to Logical Access Voice Presentation Attack Detection
Frontiers in Fake Media Generation and Detection, Springer, 2022
Robust Deepfake On Unrestricted Media:Generation And Detection
Frontiers in Fake Media Generation and Detection, Springer 2022
Future Trends in Digital Face Manipulation and Detection
Springer 2022
Capsule-Forensics Networks for Deepfake Detection
Springer 2022
Introduction to Voice Presentation Attack Detection and Recent Advances
Springer 2019 ISBN:9783319926261

ｍore...

Lectures and oral presentations (183)：

音声のディープフェイク検知はどこまで可能か?
(第45回けいはんな「エジソンの会」ディープフェイクの衝撃 ~現実と仮想の狭間で~ 2024)
シンセティックメディア生成とファクトチェック
(国立情報学研究所オープンハウス産官学連携セミナー「フェイクメディア研究の最前線」 2023)
声質変換チャレンジとASVspoofチャレンジ -話者モデリングの相互発展-
(日本音響学会第149回(2023年春季)研究発表会 2023)
Speech Synthesis Research 2.0
(THE 34TH CONFERENCE ON COMPUTATIONAL LINGUISTICS AND SPEECH PROCESSING (Rocling 2022), Taiwan 2022)
シンセティックメディアとフェイクメディア
(アバター共生社会倫理コンソーシアム第3回シンポジウム 2022)

ｍore...

Works (34)：

Listening test data for "Investigating Range-Equalizing Bias in Mean Opinion Score Ratings of Synthesized Speech"
Erica Cooper, Junichi Yamagishi 2023 - 現在
DR-VCTK
Yamagishi, Junichi, Sarfjoo, Seyyed Saeed 2022 - 現在
Data for the VoiceMOS Challenge 2022
Erica Cooper, Wen-Chin Huang, Tomoki Toda, Junichi Yamagishi 2022 - 現在
NII Face Mask Dataset
Trung-Nghia Le, Khanh-Duy Nguyen, Huy H. Nguyen, Junichi Yamagishi, Isao Echizen 2022 - 現在
OpenForensics: Multi-Face Forgery Detection And Segmentation In-The-Wild Dataset
Le, Trung-Nghia, Nguyen, Huy H, Yamagishi, Junichi, Echizen, Isao 2021 - 現在

ｍore...

Education (3)：

2003 - 2006 Tokyo Institute of Technology The Interdisciplinary Graduate School of Science and Engineering Ph.D., The Department of Information Processing
2002 - 2003 Tokyo Institute of Technology MEng
1998 - 2002 Tokyo Institute of Technology BEng

Professional career (1)：

PhD (Dr. Eng) (Tokyo Institute of Technology)

Work history (11)：

2021/04 - 現在 National Institute of Informatics
2019/04 - 現在 The Graduate University for Advanced Studies
2019/04 - 現在 National Institute of Informatics Digital Content and Media Science Research Division Professor
2010/04 - 現在 Nagoya Institute of Technology Speech Processing Laboratory Visiting Associate Professor
2020/08 - 2023/07 University of Edinburgh School of Informatics

Show all

Committee career (74)：

2023/11 - 現在産総研内閣府BRIDGE事業「AI×ロボット・サービス分野の実践的グローバル研究」外部評価委員
2023/10 - 現在 JST 創発的研究支援事業後藤パネル創発アドバイザー
2023/06 - 現在東北大学人工知能エレクトロニクス卓越大学院プログラム外部評価委員会
2022/04 - 2024/09 Interspeech 2024 Plenary Sessions Committee
2022/09 - 2023/12 IEEE ASRU 2023 Technical Program Chair

2021/01 - 2023/12 IEEE Signal Processing Society Education Board, Member-at-Large

2018/01 - 2023/12 Asia-Pacific Signal and Information Processing Association (APSIPA) Multimedia Security and Forensics Technical Committee

2019/05 - 2023/05 IEEE, Senior Area Editor, IEEE/ACM Transaction on Audio, Speech, and Language Processing

2019/04 - 2023/03 情報処理学会音声言語情報処理研究会 SIG-SLP 運営委員会

2022/06 - 2022/12 2022 International Symposium on Chinese Spoken Language Processing Plenary Chairs

2022/09 - 2022/09 Interspeech 2022 Session chair for "Speech Synthesis: Toward end-to-end synthesis"

2022/01 - 2022/09 VoiceMOS challenge 2022 Organizers

2022/01 - 2022/09 VoicePrivacy Challenge 2022 Organizers

2020/05 - 2021/10 Computer Speech and Language Guest editor for Special issue on Voice Privacy

2021/01 - 2021/09 ASVspoof 2021 workshop ASVspoof workshop organizer

2020/08 - 2021/09 SSW11 - The 11th ISCA Speech Synthesis Workshop Organizer

2021/04 - 2021/08 Aalborg University 博士論文外部審査委員 (Amir Hossein Poorjam)

2017/07 - 2021/04 ISCA Special Interest Group: Speech Synthesis (SynSig) Chairperson

2020/10 - 2021/03 Nagoya University PhD examiners (YiChiao Wu)

2020/08 - 2021/01 2021 IEEE Spoken Language Technology Workshop (SLT 2021) Area Chair and Session Chair for "Neural Vocoder and Others"

2019/06 - 2020/11 ISCA The Speaker and Language Recognition Workshop Odyssey 2020, Local Organizing Committee and session chair for "VoicePrivacy Mini Workshop"

2020/10 - 2020/10 ISCA Interspeech 2020 Session Chair for "Speech Synthesis: Prosody and Emotion"

2019/10 - 2020/10 Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020 Organizer

2019/09 - 2020/10 Voice Privacy Challenge and Interspeech special session Organizer

2020/05 - 2020/05 ICASSP 2020 Session chair for "Speech Synthesis And Voice Conversion I"

2019/07 - 2020/04 Computer Speech and Language, Advisory Committee for Special issue on Advances in Automatic Speaker Verification Anti-spoofing

2018/10 - 2019/12 IEEE ASRU 2019, Technical Program Chair

2018/05 - 2019/12 ASVspoof challenge 2019 Organizer and session chair for a special session at Interspeech 2019

2018/02 - 2019/09 ISCA The 10th ISCA Speech Synthesis Workshop (SSW10) Organising committee

2018/09 - 2019/06 Computer Speech and Language, Guest editor for Special issue on Speaker and language characterization and recognition: voice modeling, conversion, synthesis and ethical aspects

2019/05 - 2019/05 Session chair for “Speech synthesis 1” ICASSP 2019

2017/04 - 2019/03 情報処理学会音声言語情報処理研究会 SIG-SLP 幹事

2013/01 - 2019/03 IEEE Signal Processing Society Speech and Language Technical Committee

2018/06 - 2018/12 IEEE SLT workshop 2018 Organizer and chair of special session on Deep Learning for Speech Synthesis

2013/01 - 2018/12 IEEE Signal Processing Society Speech and Language Technical Committee

2017/09 - 2018/09 2nd voice conversion challenge 運営委員

2018/02 - 2018/07 Odyssey 2018 (Speaker Odyssey 2018) program committee and session chair

2018/02 - 2018/07 SLSP 2018 (6th International Conference on Statistical Language and Speech Processing) program committee

2018/04 - 2018/04 ICASSP 2018 Session chair for "Neural Network based Speech Synthesis"

2014/01 - 2017/12 IEEE Associate Editor of IEEE/ACM Transaction on Audio, Speech, and Language Processing

2017/09 - 2017/09 Interspeech 2017, Session chair for "The 2017 Automatic Speaker Verification Spoofing and Countermeasures Challenge (ASVspoof)"

2016/12 - 2017/09 ASV spoof challenge 2017 運営実行委員

2016/04 - 2017/06 IEEE Journal of Selected Topics in Signal Processing, Special Issue on Spoofing and Countermeasures for Automatic Speaker Verification, IEEE Journal of Selected Topics in Signal Processing, Special Issue on Spoofing and Countermeasures for Automatic Speaker Verification, Lead Guest Editor 特集号編集長

2016/12 - 2016/12 博士論文外部審査委員 Ecole polytechnique fédérale de Lausanne, Switzerland, Dr Pierre-Edouard Honnet

2015/01 - 2016/12 2016 Japanese-American Frontiers of Science Symposium Planning Group Member

2016/09 - 2016/09 Interspeech 2016, session chairs for "Prosody and expressive speech" and "Voice conversion challenge 2016"

2015/11 - 2016/09 Voice conversion challenge 2016 運営委員

2016/04 - 2016/04 Technische Universität Wien (Markus Toman) 博士外部審査員

2016/03 - 2016/03 ICASSP 2016, Session chair for "Speech Synthesis III"

2015/06 - 2015/12 電子情報通信学会英文論文誌D 特集号音声言語処理における機械学習の進展とその応用特集号編集委員

2015/06 - 2015/11 3rd International Conference on Statistical Language and Speech Processing, SLSP 2015 Programme Committee

2015/04 - 2015/09 Interspeech 2015 Session chair for “Statistical Parametric Speech Synthesis"

2015/04 - 2015/09 The First International Workshop on Machine Learning in Spoken Language Processing (MLSLP2015) Session chair for session 2

2015/04 - 2015/09 Interspeech 2015 Session chair for “Statistical Parametric Speech Synthesis"

2014/10 - 2015/09 ASV spoof challenge 2015 運営実行委員

2014/10 - 2015/09 日本音声学会誌音声研究特集号アジアにおけるコーパスを利用したデータ駆動型音声研究特集号ゲストエディタ

2014/12 - 2015/05 NONLINEAR SPEECH PROCESSING, NOLISP 2015 SCIENTIFIC COMMITTEE

2014/11 - 2015/04 40th International Conference on Acoustics, Speech and Signal Processing, ICASSP 2015 Session chair for "Speech Synthesis II”

2014/11 - 2014/11 博士論文外部審査委員 Graz University of Technology, Austria, Dr Dietmar Schabus

2014/10 - 2014/10 博士論文外部審査委員 University of Mons, Belgium, Dr Maria Astrinaki

2014/04 - 2014/09 The 9th International Symposium on Chinese Spoken Language Processing, ISCSLP 2014 TECHNICAL PROGRAM COMMITTEE

2014/04 - 2014/09 The 2014 European Signal Processing Conference, EUSIPCO 2014 Technical Program Committee

2014/04 - 2014/09 Interspeech 2014 Session chair for "Voice Conversion”

2013/04 - 2013/09 8th ISCA Speech synthesis workshop, SSW8 2013 Program Committee

2013/03 - 2013/08 Machine Learning for Interactive Systems, MLIS 2013 Programme Committee

2013/03 - 2013/08 Session chair for "Spoofing and Countermeasures for Automatic Speaker Verification” Interspeech 2013

2013/01 - 2013/06 NONLINEAR SPEECH PROCESSING, NOLISP 2013 SCIENTIFIC COMMITTEE

2011/09 - 2012/09 Interspeech 2012 Area coordinator of speech synthesis sessions

2012/03 - 2012/08 Machine Learning for Interactive Systems, MLIS 2012 Programme Committee

2011/12 - 2011/12 博士論文外部審査委員 Universidad Politecnica de Madrid, Spain, Dr Roberto Barra-Chicote

2011/03 - 2011/08 Interspeech 2011 Session chair for "Voice conversion" and "Unit selection and hybrid approaches"

2010/05 - 2010/09 Interspeech 2010 Session chair for "Voice Conversion and Speech Synthesis”

2010/04 - 2010/09 7th ISCA Speech synthesis workshop, SSW7 2010 Program Committee

2007/03 - 2007/08 6th ISCA Speech synthesis workshop, SSW6 2007 Scientific and Program Committee

Show all

Awards (23)：

2023/09 - IEEE International Joint Conference on Biometrics (IJCB 2023) BTAS/IJCB 5-Year Highest Impact Award (IEEE Biometrics Council awards) Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos, IEEE International Conference on Biometrics: Theory, Applications, and Systems (BTAS) 2019
2023/06 - 電子情報通信学会 2022年度電子情報通信学会論文賞 Effects of Image Processing Operations on Adversarial Noise and Their Use in Detecting and Correcting Adversarial Images
2023/06 - 電子情報通信学会情報・システムソサイエティ 2022年度電子情報通信学会ISS論文賞 Preventing Fake Information Generation Against Media Clone Attacks / Generation and Detection of Media Clones
2023/03 - 公益財団法人電気通信普及財団第 38 回電気通信普及財団賞テレコム学際研究賞特例表彰映像情報メディア学会,映像情報メディア学会誌,2022 年 7 月特集「インフォデミック時代の AI とサイバーセキュリティ」
2022/11 - AACL-IJCNLP 2022 Student Research Workshop (SRW) Best Presentation Award Outlier-Aware Training for Improving Group Accuracy Disparities

2021/04 - 知財図鑑卒論 OPEN AWARD 2021 優秀賞落語音声合成〜人を楽しませる音声合成に向けて〜

2019/12 - 日本音響学会第20回(2019年秋季研究発表会)学生優秀発表賞ソフトアテンションを使用しないエンドツーエンド音声合成(共著)

2019/09 - The 10th ISCA Speech Synthesis Workshop Best paper award (SSW6 2007, test-of-time award) The HMM-based Speech Synthesis System (HTS) Version 2.0

2019/09 - The 10th ISCA Speech Synthesis Workshop Best paper award (SSW9 2016, test-of-time award) Investigating Very Deep Highway Networks for Parametric Speech Synthesis

2019/03 - 日本音響学会粟屋潔学術奨励賞スペクトル系列誤差に基づくDNN音声波形モデルの学習 (共著)

2018/08 - Mobile Communication Fund, Japan 17th DOCOMO Mobile Science Award

2018/08 - 電子情報通信学会音声研究会 2017年度音声研究会研究奨励賞 Autoregressive quantized F0 modeling using a recurrent neural network with feedback links (共著)

2017/12 - 9th IEEE International Workshop on Information Forensics and Security (WIFS) 2017, Best Paper Award, An Approach for Gait Anonymization Using Deep Learning,

2017/11 - Research Data Service, University of Edinburgh, Edinburgh Datashare Award, Most popular data 2016-17,

2017/11 - IEEE Signal Processing Society Tokyo Joint Chapter IEEE Signal Processing Society (SPS) Japan Student Best Paper Award "An autoregressive recurrent mixture density network for parametric speech synthesis" (共著)

2017/03 - 一般社団法人情報処理学会 2016年度山下記念研究賞統計的パラメトリック音声合成のための FFTスペクトルからのDeep Auto-encoderに基づく低次元音響特徴量抽出 (共著)

2016/12 - JSPS JSPS prize

2016/10 - Austrian Ministry of Social Affairs The WINTEC 2016 awards, 3rd place The SALB project

2014/04 - The Minister of Education, Culture, Sports, Science and Technology The Commendation for Science and Technology by the Minister of Education, Culture, Sports, Science and Technolog, The Young Scientists’ Prize

2013/06 - The Information Processing Society of Japan The 2012 Kiyasu Special Industrial Achievement Award

2011/04 - IEEE Signal Processing Society Young Author Best Paper Award 2010 (Co-author)

2010/09 - The Acoustical Society of Japan The Itakura Prize for Innovative Young Researchers

2006/10 - Tejima PhD Thesis Award

Show all

Association Membership(s) (7)：

Information Processing Society of Japan , ISCA , IEEE , 電子情報通信学会 , 日本音響学会 , IEICE , Acoustical Society of Japan

※ Researcher’s information displayed in J-GLOBAL is based on the information registered in researchmap. For details, see here.

Return to Previous Page