Development of deep neural network learning methods

2017/27/B/ST6/02852

Keywords

Descriptors

  • ST6_7: Sztuczna inteligencja, systemy inteligentne i wieloagentowe
  • ST6_11: Uczenie maszynowe, statystyczne przetwarzanie danych i zastosowanie w przetwarzaniu sygnałów

Panel

ST6 – Computer science and informatics: informatics and information systems, computer science, scientific computing, intelligent systems

Host institution

Politechnika Częstochowska, Wydział Inżynierii Mechanicznej i Informatyki

Voivodeship: śląskie

Other projects carried out by the institution »

Principal investigator (from the host institution)

prof. Leszek Rutkowski

Number of co-investigators in the project: 9

Call

OPUS 14 – announced on 2017-09-15

Amount awarded
1 368 800 PLN
Project start date
2018-10-03
Project end date
2022-05-02
Project duration
43 months (the same as in the proposal)
Project status
Project settled

Project description

Download the project description in a pdf file

Note — project descriptions were prepared by the authors of the applications themselves and placed in the system in an unchanged form.

Equipment purchased [PL]

  1. Wydajny komputer obliczeniowy do symulacji głębokich sieci neuronowych. Cost: 40 000 PLN
  2. komputery przenośne. Cost: 40 000 PLN

Information in the final report

Publication in academic press/journals (10)

  1. A Novel Fast Feedforward Neural Networks Training Algorithm

    Authors:
    Jarosław Bilski, Bartosz Kowalczyk, Andrzej Marjański, Michał Gandor, Jacek Zurada
    Academic press:
    Journal of Artificial Intelligence and Soft Computing Research (year: 2021, volume: 11 (4), pages: 287-306), Publisher: Sciendo
    Status:
    Published
    DOI:
    10.2478/jaiscr-2021-0017 – link to the publication
  2. A novel method for speed training acceleration of recurrent neural networks

    Authors:
    Jarosław Bilskia, Leszek Rutkowski, Jacek Smoląga, Dacheng Tao
    Academic press:
    Information Sciences (year: 2021, volume: 553, pages: 266-279), Publisher: Elsevier
    Status:
    Published
    DOI:
    10.1016/j.ins.2020.10.025 – link to the publication
  3. Synchronization of Switched Discrete-Time Neural Networks via Quantized Output Control With Actuator Fault

    Authors:
    Xinsong Yang, Xiaoxiao Wan, Cheng Zunshui, Jinde Cao, Yang Liu, Leszek Rutkowski
    Academic press:
    IEEE Transactions on Neural Networks and Learning Systems (year: 2021, volume: 32 (9), pages: 4191-4201), Publisher: IEEE
    Status:
    Published
    DOI:
    10.1109/TNNLS.2020.3017171 – link to the publication
  4. Dynamical and static multisynchronization analysis for coupled multistable memristive neural networks with hybrid control

    Authors:
    Xiaoxiao Lv, Jinde Cao, Leszek Rutkowski
    Academic press:
    Neural Networks (year: 2021, volume: 143, pages: 515-524), Publisher: Elsevier
    Status:
    Published
    DOI:
    10.1016/j.neunet.2021.07.004 – link to the publication
  5. Local Levenberg-Marquardt Algorithm for Learning Feedforward Neural Networks

    Authors:
    Jarosław Bilski, Bartosz Kowalczyk, Alina Marchlewska, Jacek M. Żurada
    Academic press:
    Journal of Artificial Intelligence and Soft Computing Research (year: 2020, volume: 10 (4), pages: 299-316), Publisher: Sciendo
    Status:
    Published
    DOI:
    10.2478/jaiscr-2020-0020 – link to the publication
  6. On Training Deep Neural Networks Using a Streaming Approach

    Authors:
    Piotr Duda, Maciej Jaworski, Andrzej Cader, Lipo Wang
    Academic press:
    Journal of Artificial Intelligence and Soft Computing Research (year: 2019, volume: 10 (1), pages: 15-26), Publisher: Sciendo
    Status:
    Published
    DOI:
    10.2478/jaiscr-2020-0002 – link to the publication
  7. Exponential Stabilization for Hybrid Recurrent Neural Networks by Delayed Noises Rooted in Discrete Observations of State and Mode

    Authors:
    Lichao Feng, Jinde Cao, Jun Hu, Zhihui Wu, Leszek Rutkowski
    Academic press:
    Neural Processing Letters (year: 2019, volume: 50, pages: 2797-2819), Publisher: Springer
    Status:
    Published
    DOI:
    10.1007/s11063-019-10059-z – link to the publication
  8. Event-triggered impulsive synchronization of discrete-time coupled neural networks with stochastic perturbations and multiple delays

    Authors:
    Huiyuan Li, Jian-an Fang, Xiaofan Li, Leszek Rutkowski, Tingwen Huang
    Academic press:
    Neural Networks (year: 2020, volume: 132, pages: 447-460), Publisher: Elsevier
    Status:
    Published
    DOI:
    10.1016/j.neunet.2020.09.012 – link to the publication
  9. Synchronization of Coupled Time-Delay Neural Networks With Mode-Dependent Average Dwell Time Switching

    Authors:
    Xinsong Yang, Yang Liu, Jinde Cao, Leszek Rutkowski
    Academic press:
    IEEE Transactions on Neural Networks and Learning Systems (year: 2020, volume: 31 (12), pages: 5483-5496), Publisher: IEEE
    Status:
    Published
    DOI:
    10.1109/TNNLS.2020.2968342 – link to the publication
  10. A New Approach to Descriptors Generation for Image Retrieval by Analyzing Activations of Deep Neural Network Layers

    Authors:
    Paweł Staszewski, Maciej Jaworski, Jinde Cao, Leszek Rutkowski
    Academic press:
    IEEE Transactions on Neural Networks and Learning Systems (year: 2021, volume: (Early Access), pages: 46030), Publisher: IEEE
    Status:
    Published
    DOI:
    10.1109/TNNLS.2021.3084633 – link to the publication

Articles in post-conference publications (16)

  1. Fast Conjugate Gradient Algorithm for Feedforward Neural Networks

    Authors:
    Jarosław Bilski, Jacek Smoląg
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2020, pages: 27-38), Publisher: Springer, Cham
    Date:
    conference 12.10.2020-14.10.2020
    Status:
    Published
  2. Fully Convolutional Network for Removing DCT Artefacts From Images

    Authors:
    Patryk Najgebauer, Rafał Scherer, Leszek Rutkowski
    Conference:
    International Joint Conference on Neural Networks (year: 2020, pages: 46030), Publisher: IEEE
    Date:
    conference 19.07.2020-24.07.2020
    Status:
    Published
  3. Explainable Cluster-Based Rules Generation for Image Retrieval and Classification

    Authors:
    Paweł Staszewski, Maciej Jaworski, Leszek Rutkowski, Dacheng Tao
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2020, pages: 85-94), Publisher: Springer, Cham
    Date:
    conference 12.10.2020-14.10.2020
    Status:
    Published
  4. A New Algorithm with a Line Search for Feedforward Neural Networks Training

    Authors:
    Jarosław Bilski, Bartosz Kowalczyk, Jacek M. Żurada
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2020, pages: 15-26), Publisher: Springer, Cham
    Date:
    conference 12.10.2020-14.10.2020
    Status:
    Published
  5. Modification of Learning Feedforward Neural Networks with the BP Method

    Authors:
    Jarosław Bilski, Jacek Smoląg, Patryk Najgebauer
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2021, pages: 54-65), Publisher: Springer, Cham
    Date:
    conference 20.06.2021-24.06.2021
    Status:
    Published
  6. Monitoring of Changes in Data Stream Distribution Using Convolutional Restricted Boltzmann Machines

    Authors:
    Maciej Jaworski, Leszek Rutkowski, Paweł Staszewski, Patryk Najgebauer
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2021, pages: 338–346), Publisher: Springer, Cham
    Date:
    conference 20.06.2021-24.06.2021
    Status:
    Published
  7. The Streaming Approach to Training Restricted Boltzmann Machines

    Authors:
    Piotr Duda, Leszek Rutkowski, Piotr Woldan, Patryk Najgebauer
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2021, pages: 308-317), Publisher: Springer, Cham
    Date:
    conference 20.06.2021-24.06.2021
    Status:
    Published
  8. A New Variant of the GQR Algorithm for Feedforward Neural Networks Training

    Authors:
    Jarosław Bilski, Bartosz Kowalczyk
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2021, pages: 41–53), Publisher: Springer, Cham
    Date:
    conference 20.06.2021-24.06.2021
    Status:
    Published
  9. Concept Drift Detection Using Autoencoders in Data Streams Processing

    Authors:
    Maciej Jaworski, Leszek Rutkowski, Plamen Angelov
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2020, pages: 124-133), Publisher: Springer, Cham
    Date:
    conference 12.10.2020-14.10.2020
    Status:
    Published
  10. Microscopic Sample Segmentation by Fully Convolutional Network for Parasite Detection

    Authors:
    Patryk Najgebauer, Rafał Grycuk, Leszek Rutkowski, Rafał Scherer, Agnieszka Siwocha
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2019, pages: 164-171), Publisher: Springer, Cham
    Date:
    conference 16.06.2019-20.06.2019
    Status:
    Published
  11. On Proper Designing of Deep Structures for Image Classification

    Authors:
    Piotr Woldan, Paweł Staszewski, Leszek Rutkowski, Konrad Grzanek
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2019, pages: 223-235), Publisher: Springer
    Date:
    conference 16.06.2019-20.06.2019
    Status:
    Published
  12. Visual Hybrid Recommendation Systems Based on the Content-Based Filtering

    Authors:
    Piotr Woldan, Piotr Duda, Yoichi Hayashi
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2020, pages: 455-465), Publisher: Springer, Cham
    Date:
    conference 12.10.2020-14.10.2020
    Status:
    Published
  13. On a Streaming Approach for Training Denoising Auto-encoders

    Authors:
    Piotr Duda, Lipo Wang
    Conference:
    International Conference of Artificial Intelligence and Soft Computing (year: 2020, pages: 315-324), Publisher: Springer, Cham
    Date:
    conference 12.10.2020-14.10.2020
    Status:
    Published
  14. On Handling Missing Values in Data Stream Mining Algorithms Based on the Restricted Boltzmann Machine

    Authors:
    Maciej Jaworski, Piotr Duda, Danuta Rutkowska, Leszek Rutkowski
    Conference:
    International Conference on Neural Information Processing (year: 2019, pages: 347-354), Publisher: Springer, Cham
    Date:
    conference 12.12.2019-15.12.2019
    Status:
    Published
  15. Modifications of the Givens Training Algorithm for Artificial Neural Networks

    Authors:
    Jarosław Bilski, Bartosz Kowalczyk, Andrzej Cader
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2019, pages: 14-28), Publisher: Springer, Cham
    Date:
    conference 16.06.2019-20.06.2019
    Status:
    Published
  16. Resource-Aware Data Stream Mining Using the Restricted Boltzmann Machine

    Authors:
    Maciej Jaworski, Leszek Rutkowski, Piotr Duda, Andrzej Cader
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2019, pages: 384-396), Publisher: Springer, Cham
    Date:
    conference 16.06.2019-20.06.2019
    Status:
    Published

« New search

Graphic design and implementation: Jakub Piotrowski