Projects funded by the NCN

Information on the principal investigator and host institution

Information of the project and the call

Keywords

Equipment

Delete all

ALOFON - Methodology and technology for the polymodal allophonic speech transcription

2015/17/B/ST6/01874

Keywords:

multimodal interface eye gaze tracking polysensory stimulation EEG neurology

Descriptors:

  • ST6_9: Human computer interaction, speech recognition and synthesis, natural language processing
  • HS2_6: General linguistics, theory and methodology of linguistic research
  • ST7_9: Man-machine interfaces

Panel:

ST6 - Computer science and informatics: informatics and information systems, computer science, scientific computing, intelligent systems

Host institution :

Politechnika Gdańska, Wydział Elektroniki, Telekomunikacji i Informatyki

woj. pomorskie

Other projects carried out by the institution 

Principal investigator (from the host institution):

prof. Andrzej Czyżewski 

Number of co-investigators in the project: 5

Call: OPUS 9 - announced on 2015-03-16

Amount awarded: 990 318 PLN

Project start date (Y-m-d): 2016-02-19

Project end date (Y-m-d): 2019-06-18

Project duration:: 40 months (the same as in the proposal)

Project status: Project settled

Project description

Download the project description in a pdf file

Note - project descriptions were prepared by the authors of the applications themselves and placed in the system in an unchanged form.

Equipment purchased [PL]

  1. Artykulograf (243 960 PLN)
  2. Sieciowy magazyn danych.
  3. Zestaw parowanych mikrofonów.
  4. Urządzenie do wizyjnego przechwytywania ruchów mięśni i twarzy.

Information in the final report

  • Publication in academic press/journals (11)
  • Articles in post-conference publications (15)
  • Book publications / chapters in book publications (1)
  1. Rejestracja, parametryzacja i klasyfikacja alofonów z wykorzystaniem bimodalności
    Authors:
    Sz Zaporowski, S. Cygert, G. Szwoch, G. Korvel, A. Czyżewski
    Academic press:
    Zeszyty Naukowe Wydziału Elektrotechniki i Automatyki Politechniki Gdańskiej (rok: 2018, tom: 1, strony: 135-138), Wydawca: Politechnika Gdańska
    Status:
    Published
    DOI:
    brak - link to the publication
  2. Visual perception of vowels from static and dynamic cues
    Authors:
    A. Rojczyk, T. Ciszewski, G. Szwoch, A. Czyżewski
    Academic press:
    The Journal of the Acoustical Society of America (rok: 2018, tom: 143, strony: 328-332), Wydawca: Acoustical Society of America
    Status:
    Published
    DOI:
    10.1121/1.5036958 - link to the publication
  3. A comparative study of English viseme recognition methods and algorithms
    Authors:
    Jachimski D., Czyżewski A., Ciszewski T.
    Academic press:
    Multimedia Tools and Applications (rok: 2017, tom: 77, strony: 16495-16532), Wydawca: Springer
    Status:
    Published
    DOI:
    10.1007/s11042-017-5217-5. - link to the publication
  4. Bimodal classification of English allophones employing acoustic speech signal and facial motion capture
    Authors:
    A. Czyżewski, S. Zaporowski, B. Kostek
    Academic press:
    The Journal of the Acoustical Society of America (rok: 2018, tom: 144, strony: 1801-1802), Wydawca: Acoustical Society of America
    Status:
    Published
    DOI:
    10.1121/1.5067951 - link to the publication
  5. The role of individual/personal differences in efl pronunciation learning
    Authors:
    Magdalena Pospieszyńska-Wojtkowiak
    Academic press:
    Journal of linguistic and intercultural education (rok: 2016, tom: Vol. 9 Issue 2, strony: 121-138), Wydawca: Alba luila 2016 Editura AETERNITAS
    Status:
    Published
    DOI:
    brak - link to the publication
  6. Analysis of 2D Feature Spaces for Deep Learning-based Speech Recognition
    Authors:
    G. Korvel, P. TREIGYS, G. TAMULEVIÈIUS, J. BERNATAVIÈIENĖ, B. Kostek
    Academic press:
    Journal of the Audio Engineering Society (rok: 2018, tom: 66, strony: 1072-1081), Wydawca: Journal of the Audio Engineering Society
    Status:
    Published
    DOI:
    10.17743/jaes.2018.0066 - link to the publication
  7. Voiceless Stop Consonant Modelling and Synthesis Framework Based on MISO Dynamic System
    Authors:
    Korvel G., Kostek B.
    Academic press:
    Archives of Acoustics (rok: 2017, tom: No. 3, vol. 42, strony: pp. 375 - 383, 2017), Wydawca: Institut of Fundamental Technological Research, Polish Academy of Sciences
    Status:
    Published
    DOI:
    10.1515/aoa-2017-0039 - link to the publication
  8. An audio-visual corpus for multimodal automatic speech recognition, Journal of Intelligent Information Systems
    Authors:
    Czyżewski, A., Kostek, B., Bratoszewski, P.
    Academic press:
    Journal of Intelligent Information Systems (rok: 2017, tom: 49, strony: 167-192), Wydawca: Springer US
    Status:
    Published
    DOI:
    10.1007/s10844-016-0438-z - link to the publication
  9. Database of speech and facial expressions recorded with optimized face motion capture settings
    Authors:
    M. Kawaler, A. Czyżewski
    Academic press:
    Journal of Intelligent Information Systems (rok: 2019, tom: 1, strony: 1), Wydawca: Springer US
    Status:
    Published
    DOI:
    10.1007/s10844-019-00547-y - link to the publication
  10. Korpus mowy angielskiej do celów multimodalnego automatycznego rozpoznawania mowy
    Authors:
    Szykulski M., Bratoszewski P., Kotus J., Czyżewski A., Kostek B.,
    Academic press:
    Przegląd Telekomunikacyjny (rok: 2016, tom: 45513, strony: 1129-1132), Wydawca: Wydawnictwo SIGMA-NOT
    Status:
    Published
    DOI:
    10.15199/59.2016.8-9.74 - link to the publication
  11. Poprawa obiektywnych wskaźników jakości mowy w warunkach hałasu
    Authors:
    K. Kąkol, B. Kostek
    Academic press:
    Zeszyty Naukowe Wydziału Elektrotechniki i Automatyki Politechniki Gdańskiej (rok: 2018, tom: 60, strony: 45-50), Wydawca: Politechnika Gdańska
    Status:
    Published
    DOI:
    10.32016/1.60.09 - link to the publication
  1. Analysis of allophones based on audio signal recordings and parameterization
    Authors:
    Czyżewski A., Piotrowska M., Kostek B.
    Conference:
    173rd Meeting of the Acoustical Society of America (rok: 2017, ), Wydawca: Acoustical Society of America
    Data:
    konferencja 25-29.06.2017
    Status:
    Published
  2. Comparative Study of Self-Organizing Maps vs. Subjective Evaluation of Quality of Allophone Pronunciation for Nonnative English Speakers
    Authors:
    Kostek B., Piotrowska M., Czyżewski A.
    Conference:
    143rd Audio Engineering Society Convention (rok: 2017, ), Wydawca: Audio Engineering Society
    Data:
    konferencja 18-21.10.2017
    Status:
    Published
  3. Material for Automatic Phonetic Transcription of Speech Recorded in Various Conditions
    Authors:
    Kostek B., Plewa M., Czyżewski A.
    Conference:
    141 Audio Eng. Soc. Convention (rok: 2016, ), Wydawca: Audio Engineering Society
    Data:
    konferencja 29.9.2016 - 2.10.2016
    Status:
    Published
  4. Objectivization of phonological evaluation of speech elements by means of audio parametrization
    Authors:
    M. Piotrowska, G. Korvel, B. Kostek, A. Rojczyk, A. Czyżewski
    Conference:
    2018 11th International Conference on Human System Interaction (HSI) (rok: 2018, ), Wydawca: IEEE
    Data:
    konferencja 04.07.2018-06.07.2018
    Status:
    Published
  5. Selection of Features for Multimodal Vocalic Segments Classification
    Authors:
    Sz Zaporowski, A. Czyżewski
    Conference:
    11th International Conference on Multimedia & Network Information Systems (rok: 2018, ), Wydawca: Springer
    Data:
    konferencja 12.9.2018- 14.9.2018
    Status:
    Published
  6. Determining Pronunciation Differences in English Allophones Utilizing Audio Signal Parameterization
    Authors:
    Kostek B., Piotrowska M., Ciszewski T., Czyżewski A.
    Conference:
    142nd Audio Engineering Society Convention (rok: 2017, ), Wydawca: Audio Engineering Society
    Data:
    konferencja 20.05-23.05.2017
    Status:
    Published
  7. Methodology and technology for the polymodal allophonic speech transcription
    Authors:
    Ciszewski T., Czyżewski A., Kostek B.
    Conference:
    The Journal of the Acoustical Society of America (rok: 2016, ), Wydawca: Acoustical Society of America
    Data:
    konferencja 23-27 maj 2016
    Status:
    Published
  8. Adjusting automatically marked voiced English allophone borders
    Authors:
    J. Rafałko. A. Czyżewski
    Conference:
    Signal Processing Algorithms, Architectures, Arrangements and Applications (SPA) 2019 (rok: 2019, ), Wydawca: IEEE
    Data:
    konferencja 18-20.09.2019
    Status:
    Published
  9. Audio-visual aspect of Lombard effect and comparison with recordings depicting emotional states.
    Authors:
    Sz Zaporowski, B. Kostek, J. Gołębiewska, J. Piltz
    Conference:
    SPA 2018 Signal Processing Algorithms, Architectures, Arrangements and Applications (rok: 2018, ), Wydawca: IEEE
    Data:
    konferencja 19.9.2018- 21.9.2018
    Status:
    Published
  10. Marking the Allophones Boundaries Based on the DTW Algorithm
    Authors:
    J. Rafałko
    Conference:
    SPA 2018 Signal Processing Algorithms, Architectures, Arrangements and Applications (rok: 2018, ), Wydawca: IEEE
    Data:
    konferencja 19.9.2018- 21.9.2018
    Status:
    Published
  11. Vocalic Segments Classification Assisted by Mouth Motion Capture
    Authors:
    S. Cygert, G. Szwoch, S. Zaporowski, A. Czyżewski
    Conference:
    2018 11th International Conference on Human System Interaction (HSI) (rok: 2018, ), Wydawca: IEEE
    Data:
    konferencja 04.07.2018
    Status:
    Published
  12. Building Knowledge for the Purpose of Lip Speech Identification
    Authors:
    Czyżewski A., Kostek B., Szykulski M., Ciszewski T.E.
    Conference:
    10th International Conference on Multimedia & Network Information Systems (rok: 2016, ), Wydawca: Springer US
    Data:
    konferencja 17.08.2016
    Status:
    Published
  13. Examining Feature Vector for Phoneme Recognition
    Authors:
    Korvel G., Kostek B.
    Conference:
    ISSPIT 2017, 17th IEEE International Symposium on Signal Processing and Information Technology (rok: 2017, ), Wydawca: IEEE
    Data:
    konferencja 18.12.2017 - 20.12.2017
    Status:
    Published
  14. Machine Learning Applied to Aspirated and Non-Aspirated Allophone Classification—An Approach Based on Audio "Fingerprinting"
    Authors:
    M. Piotrowska, G. Korvel, A. Kurowski, B. Kostek, A. Czyżewski
    Conference:
    145 Audio Engineering Society Convention (rok: 2018, ), Wydawca: Audio Engineering Society
    Data:
    konferencja 17.10.2018- 20.10.2018
    Status:
    Published
  15. Automatic Marking of Allophone Boundaries in Isolated English Spoken Words
    Authors:
    Janusz Rafałko, Andrzej Czyżewski
    Conference:
    International Conference on Computer Information Systems and Industrial Management (rok: 2020, ), Wydawca: Springer, Cham
    Data:
    konferencja 16-18.10.2020
    Status:
    Published
  1. Speech analytics based on machine learning
    Authors:
    G. Korvel, A. Kurowski, B. Kostek, A. Czyżewski
    Book:
    Intelligent Systems Reference Library (rok: 2018, tom: 149, strony: 129-157), Wydawca: Springer International Publishing AG
    Status:
    Published

O Narodowym Centrum Nauki

Finansowanie nauki

Współpraca zagraniczna

Centrum prasowe

Deklaracja dostępności
Przetwarzanie danych osobowych
Polityka cookies

Partnerzy