Dr. Jekaterina Novikova, Ph.D.
Generative AI, LLM, Natural Language Processing, ML in Health, AI Safety
Research Expertise
About
Publications
Why We Need New Evaluation Metrics for NLG
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing / Jan 01, 2017
Novikova, J., Dušek, O., Cercas Curry, A., & Rieser, V. (2017). Why We Need New Evaluation Metrics for NLG. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. https://doi.org/10.18653/v1/d17-1238
The E2E Dataset: New Challenges For End-to-End Generation
Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue / Jan 01, 2017
Novikova, J., Dušek, O., & Rieser, V. (2017). The E2E Dataset: New Challenges For End-to-End Generation. Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue. https://doi.org/10.18653/v1/w17-5525
Evaluating the state-of-the-art of End-to-End Natural Language Generation: The E2E NLG challenge
Computer Speech & Language / Jan 01, 2020
Dušek, O., Novikova, J., & Rieser, V. (2020). Evaluating the state-of-the-art of End-to-End Natural Language Generation: The E2E NLG challenge. Computer Speech & Language, 59, 123–156. https://doi.org/10.1016/j.csl.2019.06.009
To BERT or not to BERT: Comparing Speech and Language-Based Approaches for Alzheimer’s Disease Detection
Interspeech 2020 / Oct 25, 2020
Balagopalan, A., Eyre, B., Rudzicz, F., & Novikova, J. (2020, October 25). To BERT or not to BERT: Comparing Speech and Language-Based Approaches for Alzheimer’s Disease Detection. Interspeech 2020. https://doi.org/10.21437/interspeech.2020-2557
Findings of the E2E NLG Challenge
Proceedings of the 11th International Conference on Natural Language Generation / Jan 01, 2018
Dušek, O., Novikova, J., & Rieser, V. (2018). Findings of the E2E NLG Challenge. Proceedings of the 11th International Conference on Natural Language Generation. https://doi.org/10.18653/v1/w18-6539
RankME: Reliable Human Ratings for Natural Language Generation
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) / Jan 01, 2018
Novikova, J., Dušek, O., & Rieser, V. (2018). RankME: Reliable Human Ratings for Natural Language Generation. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers). https://doi.org/10.18653/v1/n18-2012
Crowd-sourcing NLG Data: Pictures Elicit Better Data.
Proceedings of the 9th International Natural Language Generation conference / Jan 01, 2016
Novikova, J., Lemon, O., & Rieser, V. (2016). Crowd-sourcing NLG Data: Pictures Elicit Better Data. Proceedings of the 9th International Natural Language Generation Conference. https://doi.org/10.18653/v1/w16-6644
Correlating natural language processing and automated speech analysis with clinician assessment to quantify speech-language changes in mild cognitive impairment and Alzheimer’s dementia
Alzheimer's Research & Therapy / Jun 04, 2021
Yeung, A., Iaboni, A., Rochon, E., Lavoie, M., Santiago, C., Yancheva, M., Novikova, J., Xu, M., Robin, J., Kaufman, L. D., & Mostafa, F. (2021). Correlating natural language processing and automated speech analysis with clinician assessment to quantify speech-language changes in mild cognitive impairment and Alzheimer’s dementia. Alzheimer’s Research & Therapy, 13(1). https://doi.org/10.1186/s13195-021-00848-x
Comparing Pre-trained and Feature-Based Models for Prediction of Alzheimer's Disease Based on Speech
Frontiers in Aging Neuroscience / Apr 27, 2021
Balagopalan, A., Eyre, B., Robin, J., Rudzicz, F., & Novikova, J. (2021). Comparing Pre-trained and Feature-Based Models for Prediction of Alzheimer’s Disease Based on Speech. Frontiers in Aging Neuroscience, 13. https://doi.org/10.3389/fnagi.2021.635945
A design model of emotional body expressions in non-humanoid robots
Proceedings of the second international conference on Human-agent interaction / Oct 29, 2014
Novikova, J., & Watts, L. (2014, October 29). A design model of emotional body expressions in non-humanoid robots. Proceedings of the Second International Conference on Human-Agent Interaction. https://doi.org/10.1145/2658861.2658892
Comparing Acoustic-Based Approaches for Alzheimer’s Disease Detection
Interspeech 2021 / Aug 30, 2021
Balagopalan, A., & Novikova, J. (2021, August 30). Comparing Acoustic-Based Approaches for Alzheimer’s Disease Detection. Interspeech 2021. https://doi.org/10.21437/interspeech.2021-759
Hybrid chat and task dialogue for more engaging HRI using reinforcement learning
2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) / Aug 01, 2017
Papaioannou, I., Dondrup, C., Novikova, J., & Lemon, O. (2017, August). Hybrid chat and task dialogue for more engaging HRI using reinforcement learning. 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). https://doi.org/10.1109/roman.2017.8172363
Towards Artificial Emotions to Assist Social Coordination in HRI
International Journal of Social Robotics / Oct 07, 2014
Novikova, J., & Watts, L. (2014). Towards Artificial Emotions to Assist Social Coordination in HRI. International Journal of Social Robotics, 7(1), 77–88. https://doi.org/10.1007/s12369-014-0254-y
Detecting cognitive impairments by agreeing on interpretations of linguistic features
Proceedings of the 2019 Conference of the North / Jan 01, 2019
Zhu, Z., Novikova, J., & Rudzicz, F. (2019). Detecting cognitive impairments by agreeing on interpretations of linguistic features. Proceedings of the 2019 Conference of the North. https://doi.org/10.18653/v1/n19-1146
It’s Not the Way You Look, It’s How You Move: Validating a General Scheme for Robot Affective Behaviour
Human-Computer Interaction – INTERACT 2015 / Jan 01, 2015
Novikova, J., Ren, G., & Watts, L. (2015). It’s Not the Way You Look, It’s How You Move: Validating a General Scheme for Robot Affective Behaviour. In Lecture Notes in Computer Science (pp. 239–258). Springer International Publishing. https://doi.org/10.1007/978-3-319-22698-9_16
Emotionally expressive robot behavior improves human-robot collaboration
2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) / Aug 01, 2015
Novikova, J., Watts, L., & Inamura, T. (2015, August). Emotionally expressive robot behavior improves human-robot collaboration. 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). https://doi.org/10.1109/roman.2015.7333645
DEPAC: a Corpus for Depression and Anxiety Detection from Speech
Proceedings of the Eighth Workshop on Computational Linguistics and Clinical Psychology / Jan 01, 2022
Tasnim, M., Ehghaghi, M., Diep, B., & Novikova, J. (2022). DEPAC: a Corpus for Depression and Anxiety Detection from Speech. Proceedings of the Eighth Workshop on Computational Linguistics and Clinical Psychology. https://doi.org/10.18653/v1/2022.clpsych-1.1
Lexical Features Are More Vulnerable, Syntactic Features Have More Predictive Power
Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019) / Jan 01, 2019
Novikova, J., Balagopalan, A., Shkaruta, K., & Rudzicz, F. (2019). Lexical Features Are More Vulnerable, Syntactic Features Have More Predictive Power. Proceedings of the 5th Workshop on Noisy User-Generated Text (W-NUT 2019). https://doi.org/10.18653/v1/d19-5556
Impact of ASR on Alzheimer’s Disease Detection: All Errors are Equal, but Deletions are More Equal than Others
Proceedings of the Sixth Workshop on Noisy User-generated Text (W-NUT 2020) / Jan 01, 2020
Balagopalan, A., Shkaruta, K., & Novikova, J. (2020). Impact of ASR on Alzheimer’s Disease Detection: All Errors are Equal, but Deletions are More Equal than Others. Proceedings of the Sixth Workshop on Noisy User-Generated Text (W-NUT 2020). https://doi.org/10.18653/v1/2020.wnut-1.21
The aNALoGuE Challenge: Non Aligned Language GEneration
Proceedings of the 9th International Natural Language Generation conference / Jan 01, 2016
Novikova, J., & Rieser, V. (2016). The aNALoGuE Challenge: Non Aligned Language GEneration. Proceedings of the 9th International Natural Language Generation Conference. https://doi.org/10.18653/v1/w16-6627
Emotionally Driven Robot Control Architecture for Human-Robot Interaction
Towards Autonomous Robotic Systems / Jan 01, 2014
Novikova, J., Gaudl, S., & Bryson, J. (2014). Emotionally Driven Robot Control Architecture for Human-Robot Interaction. In Lecture Notes in Computer Science (pp. 261–263). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-662-43645-5_27
Fantastic Features and Where to Find Them: Detecting Cognitive Impairment with a Subsequence Classification Guided Approach
Proceedings of the Sixth Workshop on Noisy User-generated Text (W-NUT 2020) / Jan 01, 2020
Eyre, B., Balagopalan, A., & Novikova, J. (2020). Fantastic Features and Where to Find Them: Detecting Cognitive Impairment with a Subsequence Classification Guided Approach. Proceedings of the Sixth Workshop on Noisy User-Generated Text (W-NUT 2020). https://doi.org/10.18653/v1/2020.wnut-1.25
Sympathy Begins with a Smile, Intelligence Begins with a Word: Use of Multimodal Features in Spoken Human-Robot Interaction
Proceedings of the First Workshop on Language Grounding for Robotics / Jan 01, 2017
Novikova, J., Dondrup, C., Papaioannou, I., & Lemon, O. (2017). Sympathy Begins with a Smile, Intelligence Begins with a Word: Use of Multimodal Features in Spoken Human-Robot Interaction. Proceedings of the First Workshop on Language Grounding for Robotics. https://doi.org/10.18653/v1/w17-2811
Tutoring Robots
Innovative and Creative Developments in Multimodal Interaction Systems / Jan 01, 2014
Al Moubayed, S., Beskow, J., Bollepalli, B., Hussen-Abdelaziz, A., Johansson, M., Koutsombogera, M., Lopes, J. D., Novikova, J., Oertel, C., Skantze, G., Stefanov, K., & Varol, G. (2014). Tutoring Robots. In IFIP Advances in Information and Communication Technology (pp. 80–113). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-55143-7_4
Robustness and Sensitivity of BERT Models Predicting Alzheimer’s Disease from Text
Proceedings of the Seventh Workshop on Noisy User-generated Text (W-NUT 2021) / Jan 01, 2021
Novikova, J. (2021). Robustness and Sensitivity of BERT Models Predicting Alzheimer’s Disease from Text. Proceedings of the Seventh Workshop on Noisy User-Generated Text (W-NUT 2021). https://doi.org/10.18653/v1/2021.wnut-1.37
Automated detection of progressive speech changes in early Alzheimer's disease
Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring / Apr 01, 2023
Robin, J., Xu, M., Balagopalan, A., Novikova, J., Kahn, L., Oday, A., Hejrati, M., Hashemifar, S., Negahdar, M., Simpson, W., & Teng, E. (2023). Automated detection of progressive speech changes in early Alzheimer’s disease. Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring, 15(2). Portico. https://doi.org/10.1002/dad2.12445
Modeling Human-Robot Collaboration in a Simulated Environment
Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts / Mar 02, 2015
Novikova, J., Watts, L., & Inamura, T. (2015, March 2). Modeling Human-Robot Collaboration in a Simulated Environment. Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts. https://doi.org/10.1145/2701973.2702035
Cost-effective Models for Detecting Depression from Speech
2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA) / Dec 01, 2022
Tasnim, M., & Novikova, J. (2022, December). Cost-effective Models for Detecting Depression from Speech. 2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA). https://doi.org/10.1109/icmla55696.2022.00259
Introducing a ROS based planning and execution framework for human-robot interaction
Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents / Nov 13, 2017
Dondrup, C., Papaioannou, I., Novikova, J., & Lemon, O. (2017, November 13). Introducing a ROS based planning and execution framework for human-robot interaction. Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents. https://doi.org/10.1145/3139491.3139500
Human-robot collaborative tutoring using multiparty multimodal spoken dialogue
Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction / Mar 03, 2014
Al Moubayed, S., Beskow, J., Bollepalli, B., Gustafson, J., Hussen-Abdelaziz, A., Johansson, M., Koutsombogera, M., Lopes, J. D., Novikova, J., Oertel, C., Skantze, G., Stefanov, K., & Varol, G. (2014, March 3). Human-robot collaborative tutoring using multiparty multimodal spoken dialogue. Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. https://doi.org/10.1145/2559636.2563681
The role of emotions in inter-action selection
Interaction Studies / Aug 20, 2014
Novikova, J., Watts, L., & Bryson, J. J. (2014). The role of emotions in inter-action selection. Interaction Studies / Social Behaviour and Communication in Biological and Artificial Systems, 15(2), 216–223. Portico. https://doi.org/10.1075/is.15.2.10nov
Quality comparison of remote vs. in‐person digital speech assessment for dementia
Alzheimer's & Dementia / Dec 01, 2020
Robin, J., Novikova, J., Sirotkin, S., Yancheva, M., Kaufman, L. D., & Simpson, W. (2020). Quality comparison of remote vs. in‐person digital speech assessment for dementia: Developing topics. Alzheimer’s & Dementia, 16(S5). Portico. https://doi.org/10.1002/alz.046971
S44. Using Acoustic and Linguistic Markers From Spontaneous Speech to Predict Scores on the Montreal Cognitive Assessment (MoCA)
Biological Psychiatry / May 01, 2019
Balagopalan, A., Yancheva, M., Novikova, J., & Simpson, W. (2019). S44. Using Acoustic and Linguistic Markers From Spontaneous Speech to Predict Scores on the Montreal Cognitive Assessment (MoCA). Biological Psychiatry, 85(10), S313. https://doi.org/10.1016/j.biopsych.2019.03.795
Characterizing progressive speech changes in prodromal‐to‐mild Alzheimer’s disease using natural language processing
Alzheimer's & Dementia / Dec 01, 2022
Robin, J., Xu, M., Balagopalan, A., Novikova, J., Kahn, L., Oday, A., Hejrati, M., Hashemifar, S., Negahdar, M., Simpson, B., & Teng, E. (2022). Characterizing progressive speech changes in prodromal‐to‐mild Alzheimer’s disease using natural language processing. Alzheimer’s & Dementia, 18(S5). Portico. https://doi.org/10.1002/alz.063244
Factors Affecting the Performance of Automated Speaker Verification in Alzheimer’s Disease Clinical Trials
Proceedings of the 5th Clinical Natural Language Processing Workshop / Jan 01, 2023
Ehghaghi, M., Stanojevic, M., Akram, A., & Novikova, J. (2023). Factors Affecting the Performance of Automated Speaker Verification in Alzheimer’s Disease Clinical Trials. Proceedings of the 5th Clinical Natural Language Processing Workshop. https://doi.org/10.18653/v1/2023.clinicalnlp-1.27
Proceedings of the 2nd Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
Jan 01, 2022
Proceedings of the 2nd Workshop on Natural Language Generation, Evaluation, and Metrics (GEM). (2022). https://doi.org/10.18653/v1/2022.gem-1
A comparison of clinician assessment of speech versus automated speech analysis in mild cognitive impairment and Alzheimer’s dementia
Alzheimer's & Dementia / Dec 01, 2020
Yeung, A., Iaboni, A., Rochon, E., Lavoie, M., Santiago, C., Yancheva, M., Novikova, J., Kaufman, L. D., & Mostafa, F. (2020). A comparison of clinician assessment of speech versus automated speech analysis in mild cognitive impairment and Alzheimer’s dementia: Neuropsychiatry and behavioral neurology/Assessment/Measurement of neuropsychiatric/Behavioral and psychological symptoms. Alzheimer’s & Dementia, 16(S6). Portico. https://doi.org/10.1002/alz.044181
P4‐541: COMPARISON OF A SPEECH‐BASED DIGITAL BIOMARKER WITH THE MOCA IN A NATURALISTIC COHORT OF SENIORS
Alzheimer's & Dementia / Jul 01, 2019
Simpson, W., Kaufman, L., Balagopalna, A., & Novikova, J. (2019). P4‐541: COMPARISON OF A SPEECH‐BASED DIGITAL BIOMARKER WITH THE MOCA IN A NATURALISTIC COHORT OF SENIORS. Alzheimer’s & Dementia, 15(7S_Part_29). Portico. https://doi.org/10.1016/j.jalz.2019.08.088
2d. Beitragsmodell (arXiv)
Praxishandbuch Open Access / May 22, 2017
Tobschall, E. (2017). 2d. Beitragsmodell (arXiv). In Praxishandbuch Open Access (pp. 102–111). De Gruyter. https://doi.org/10.1515/9783110494068-012
The first historical account of Vietnam mathematics on arXiv
Jun 01, 2022
Ants, S. (2022). The first historical account of Vietnam mathematics on arXiv. https://doi.org/10.31219/osf.io/k7pwf
Consensus rate-based label propagation for semi-supervised classification
Information Sciences / Oct 01, 2018
Yu, J., & Kim, S. B. (2018). Consensus rate-based label propagation for semi-supervised classification. Information Sciences, 465, 265–284. https://doi.org/10.1016/j.ins.2018.06.074
Preprint repository arXiv achieves milestone million uploads
Physics Today / Jan 01, 2014
Preprint repository arXiv achieves milestone million uploads. (2014). Physics Today. https://doi.org/10.1063/pt.5.028530
About the social role of child and adolescent psychiatrists in times of epidemic
IACAPAP ArXiv / Jan 01, 2020
Falissard, B. (2020). About the social role of child and adolescent psychiatrists in times of epidemic. IACAPAP ArXiv. https://doi.org/10.14744/iacapaparxiv.2020.20004
Frontotemporal lobar degeneration
Radiopaedia.org / Jan 20, 2019
Abdelmonem, H. (2019). Frontotemporal lobar degeneration. In Radiopaedia.org. Radiopaedia.org; Internet Archive. https://doi.org/10.53347/rid-65717
A Generic Architecture for Dynamic Outdoor Environment
2011 IEEE 23rd International Conference on Tools with Artificial Intelligence / Nov 01, 2011
Aycard, O., Vu, T.-D., Baig, Q., & Fraichard, T. (2011, November). A Generic Architecture for Dynamic Outdoor Environment. 2011 IEEE 23rd International Conference on Tools with Artificial Intelligence. https://doi.org/10.1109/ictai.2011.93
ArXiv in the Open Access Era: its usage and impact on physics researchers
Bulletin of the AAS / Apr 27, 2022
Narayana, N. M., & Bhandi, M. K. (2022). ArXiv in the Open Access Era: its usage and impact on physics researchers. Bulletin of the AAS. https://doi.org/10.3847/25c2cfeb.52d67090
Using Digital Speech Assessments to Detect Early Signs of Cognitive Impairment
Frontiers in Digital Health / Oct 27, 2021
Robin, J., Xu, M., Kaufman, L. D., & Simpson, W. (2021). Using Digital Speech Assessments to Detect Early Signs of Cognitive Impairment. Frontiers in Digital Health, 3. https://doi.org/10.3389/fdgth.2021.749758
arXiv
100 Years of Math Milestones / Jun 12, 2019
arXiv. (2019). In 100 Years of Math Milestones (pp. 433–437). American Mathematical Society. https://doi.org/10.1090/mbk/121/79
Optimization for Real-Time Embedded Systems
Real-Time Embedded Systems / Jun 01, 2011
Optimization for Real-Time Embedded Systems. (2011). In Real-Time Embedded Systems (pp. 25–42). CRC Press. https://doi.org/10.1201/b10935-3
Education
University of Bath
Ph.D., Artificial Intelligence
Join Dr. Novikova on NotedSource!
Join Now
At NotedSource, we believe that professors, post-docs, scientists and other researchers have deep, untapped knowledge and expertise that can be leveraged to drive innovation within companies. NotedSource is committed to bridging the gap between academia and industry by providing a platform for collaboration with industry and networking with other researchers.
For industry, NotedSource identifies the right academic experts in 24 hours to help organizations build and grow. With a platform of thousands of knowledgeable PhDs, scientists, and industry experts, NotedSource makes connecting and collaborating easy.
For academic researchers such as professors, post-docs, and Ph.D.s, NotedSource provides tools to discover and connect to your colleagues with messaging and news feeds, in addition to the opportunity to be paid for your collaboration with vetted partners.
Expert Institutions
Proudly trusted by
