Effective methods for real-time scene perception based on multimodal data analysis and semi-supervised learning

2017/27/B/ST6/01743

Keywords

Descriptors

  • ST6_8: Grafika komputerowa, przetwarzanie obrazów, wizualizacja komputerowa, multimedia, gry komputerowe
  • ST6_7: Sztuczna inteligencja, systemy inteligentne i wieloagentowe

Panel

ST6 – Computer science and informatics: informatics and information systems, computer science, scientific computing, intelligent systems

Host institution

Akademia Górniczo-Hutnicza im. Stanisława Staszica w Krakowie, Wydział Informatyki, Elektroniki i Telekomunikacji

Voivodeship: małopolskie

Other projects carried out by the institution »

Principal investigator (from the host institution)

prof. Bogdan Kwolek

Number of co-investigators in the project: 4

Call

OPUS 14 – announced on 2017-09-15

Amount awarded
898 780 PLN
Project start date
2018-07-31
Project end date
2023-07-30
Project duration
60 months (the same as in the proposal)
Project status
Project settled

Project description

Download the project description in a pdf file

Note — project descriptions were prepared by the authors of the applications themselves and placed in the system in an unchanged form.

Information in the final report

Publication in academic press/journals (5)

  1. CNN-based and DTW Features for Human Activity Recognition on Depth Maps

    Authors:
    Trelinski Jacek, Bogdan Kwolek
    Academic press:
    Neu. Comp. Appl. (year: 2021, volume: 33(21), pages: 46035), Publisher: Springer
    Status:
    Published
    DOI:
    10.1007/s00521-021-06097-1 – link to the publication
  2. Reconstruction of 3D human motion in real‑time using particle swarm optimization with GPU‑accelerated fitness function

    Authors:
    Boguslaw Rumut, Bogdan Kwolek
    Academic press:
    Journal of Real-Time Image Processing (year: 2020, volume: 17, pages: 821–838), Publisher: Springer
    Status:
    Published
    DOI:
    10.1007/s11554-018-0825-5 – link to the publication
  3. Calibrated and synchronized multi-view video and motion capture dataset for evaluation of gait recognition

    Authors:
    Bogdan Kwolek, Agnieszka Michalczuk, Tomasz Krzeszowski, Adam Switonski, Henryk Josinski, Konrad Wojciechowski
    Academic press:
    Multimedia Tools and Applicatrions (year: 2019, volume: 78, pages: 32437–32465), Publisher: Springer
    Status:
    Published
    DOI:
    10.1007/s11042-019-07945-y – link to the publication
  4. Recognition of JSL Fingerspelling Using Deep Convolutional Neural Networks

    Authors:
    Bogdan Kwolek, Wojciech Baczynski, Shinji Sako
    Academic press:
    Neurocomputing (year: 2021, volume: 456, pages: 586-598), Publisher: Elsevier
    Status:
    Published
    DOI:
    10.1016/j.neucom.2021.03.133 – link to the publication
  5. Multi-modal Pose Representations for 6-DOF Object Tracking

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Status:
    Accepted for publication

Articles in post-conference publications (26)

  1. GAN-based data augmentation for visual finger spelling recognition

    Authors:
    Bogdan Kwolek
    Conference:
    The 11th International Conference on Machine Vision (year: 2018, pages: 493 -- 500), Publisher: SPIE
    Date:
    conference 43405
    Status:
    Published
  2. Multi-channels CNN temporal features for depth-based action recognition

    Authors:
    Jacek Trelinski, Bogdan Kwolek
    Conference:
    Twelfth International Conference on Machine Vision (ICMV 2019) (year: 2019, pages: 219 -- 226), Publisher: spie
    Date:
    conference 43785
    Status:
    Published
  3. 3D Model-Based 6D Object Pose Tracking on RGB Images

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    12th Asian Conference on Intelligent Information and Database Systems (year: 2020, pages: 271-282), Publisher: Springer
    Date:
    conference 43916
    Status:
    Published
  4. 6D Pose Estimation of Texture-less Objects on RGB Images Using CNNs

    Authors:
    Vladyslav Lopatin, Bogdan Kwolek
    Conference:
    International Conference on Artificial Intelligence and Soft Computing (year: 2020, pages: 12), Publisher: Springer
    Date:
    conference 44003
    Status:
    Published
  5. Ensemble of Classifiers Using CNN and Hand-Crafted Features for Depth-Based Action Recognition

    Authors:
    Jacek Trelinski, Bogdan Kwolek
    Conference:
    Int. Conf. on Artificial Intelligence and Soft Computing (year: 2019, pages: 91--103), Publisher: Springer
    Date:
    conference 43632
    Status:
    Published
  6. Ensemble of Multi-channel CNNs for Multi-class Time-Series Classification. Depth-Based Human Activity Recognition

    Authors:
    Jacek Trelinski, Bogdan Kwolek
    Conference:
    12th Asian Conference on Intelligent Information and Database Systems (year: 2019, pages: 455-466), Publisher: Springer
    Date:
    conference 43913
    Status:
    Published
  7. Deep CNN-Based Recognition of JSL Finger Spelling

    Authors:
    Nam Tu Nguen, Shinji Sako, Bogdan Kwolek
    Conference:
    Int. Conf. on Hybrid Artificial Systems (year: 2019, pages: 602-613), Publisher: Springer
    Date:
    conference 43712
    Status:
    Published
  8. Plane-Based Humanoid Robot Navigation and Object Model Construction for Grasping

    Authors:
    Pavel Gritsenko, Igor Gritsenko, Askar Seidakhmet, Bogdan Kwolek
    Conference:
    European Conference on Computer Vision Workshops (year: 2018, pages: 649--664), Publisher: Springer
    Date:
    conference 43352
    Status:
    Published
  9. 3D Model-based 6D Object Pose Tracking on RGB Images using Particle Filtering and Heuristic Optimization

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    15th International Conference on Computer Vision Theory and Applications (year: 2020, pages: 46030), Publisher: insticc
    Date:
    conference 43888
    Status:
    Published
  10. Decision Combination in Classifier Committee Built on Deep Embedding Features

    Authors:
    Jacek Trelinski, Bogdan Kwolek
    Conference:
    nternational Conference on Computational Collective Intelligence (year: 2021, pages: 480-493), Publisher: Springer
    Date:
    conference 29.09-1.10.2021
    Status:
    Published
  11. Shape Enhanced Keypoints Learning with Geometric Prior for 6D Object Pose Tracking

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    CVPR Workshops (year: 2022, pages: 2985-2991), Publisher: IEEE
    Date:
    conference 2022-06-22 - 2022-06-24
    Status:
    Published
  12. Pose Guided Feature Learning for 3D Object Tracking on RGB Videos

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    Proc. of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (year: 2021, pages: 574-581), Publisher: ScitePress
    Date:
    conference 2022-02.06-08
    Status:
    Published
  13. Human Action Recognition on Raw Depth Maps

    Authors:
    Jacek Trelinski, Bogdan Kwolek
    Conference:
    International Conference on Visual Communications and Image Processing (VCIP), 2021, pp. 1-4, doi: (year: 2021, pages: 46026), Publisher: IEEE
    Date:
    conference 5-8-12-2021
    Status:
    Published
  14. Transformer-based Convolution-free Visual Place Recognition

    Authors:
    Urban Anna, Bogdan Kwolek
    Conference:
    The IEEE 17th Int. Conf. on Control, Automation, Robotics and Vision (ICARCV) (year: 2022, pages: 161-166), Publisher: IEEE
    Date:
    conference 11.12 - 13.12
    Status:
    Published
  15. Multiple-criteria-Based Object Pose Tracking in RGB Videos

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    14th International Conference on Computational Collective Intelligence (year: 2022, pages: 477–490), Publisher: Springer
    Date:
    conference 2022-09-28 - 2022-09-30
    Status:
    Published
  16. Pose Guided Feature Learning for 3D Object Tracking on RGB Videos

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (year: 2022, pages: 574-581), Publisher: scitepress.org
    Date:
    conference 2022-02-06 - 2022-02-08
    Status:
    Published
  17. Enhancing Decision Combination in Classifier Committee via Positional Voting

    Authors:
    Jacek Trelinski, Bogdan Kwolek
    Conference:
    International Conference on Computational Science (ICCS) (year: 2022, pages: 598–609), Publisher: Springer
    Date:
    conference 2022-06-21 - 2022-06-23
    Status:
    Published
  18. Quaternion-driven CNN for Object Pose Tracking

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    International Conference on Visual Communications and Image Processing (VCIP) (year: 2021, pages: 46026), Publisher: IEEE
    Date:
    conference 5-8-12-2021
    Status:
    Published
  19. Deep Embedding Features for Action Recognition on Raw Depth Maps

    Authors:
    Jacek Trelinski, Bogdan Kwolek
    Conference:
    The 21st International Conference on Computational Science (ICCS) (year: 2021, pages: pp. 95–108 (LNCS 12744)), Publisher: Springer
    Date:
    conference 44363
    Status:
    Published
  20. Embedded Features for 1D CNN-based Action Recognition on Depth Maps

    Authors:
    Jacek Trelinski, Bogdan Kwolek
    Conference:
    16th International Conference on Computer Vision Theory and Applications (year: 2021, pages: 536-543), Publisher: Scitepress
    Date:
    conference 44235
    Status:
    Published
  21. Fiducial Points-supported Object Pose Tracking on RGB Images via Particle Filtering with Heuristic Optimization

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (year: 2021, pages: 919-926), Publisher: Scitepress
    Date:
    conference 44235
    Status:
    Published
  22. Place Inference via Graph-based One-class Decisions on Deep Embeddings and Blur Detections

    Authors:
    Piotr Wozniak, Bogdan Kwolek
    Conference:
    The 21st International Conference on Computational Science (ICCS) (year: 2021, pages: pp. 178–192 (LNCS 12746)), Publisher: Springer
    Date:
    conference 44363
    Status:
    Published
  23. Deep Embeddings-based Place Recognition Robust to Motion Blur

    Authors:
    Bogdan Kwolek, Piotr Wozniak
    Conference:
    IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) (year: 2021, pages: 1771-1779), Publisher: IEEE
    Date:
    conference 11-17.20.2021
    Status:
    Published
  24. Deep Quaternion Pose Proposals for 6D Object Pose Tracking

    Authors:
    Mateusz Majcher, Bogdan Kwolek
    Conference:
    Int. Conf. on Computer Vision Workshops (year: 2021, pages: 243-251), Publisher: IEEE
    Date:
    conference 11-17.10.2021
    Status:
    Published
  25. Enhancing Visual Place Inference via Image Ranking Using Fuzzy Similarity and Agreeability

    Authors:
    Piotr Wozniak, Bogdan Kwolek
    Conference:
    International Conference on Hybrid Artificial Intelligence Systems (year: 2021, pages: 403-414), Publisher: Springer
    Date:
    conference 22-24.09.2021
    Status:
    Published
  26. Dynamic Hand Gesture Recognition for Human-Robot Collaborative Assembly

    Authors:
    Bogdan Kwolek, Shinji Sako
    Conference:
    The 22 International Conference on Artificial Intelligence and Soft Computing (year: 2023, pages: 1–10), Publisher: Springer
    Date:
    conference 18-22 czerwca 2023
    Status:
    Published

« New search

Graphic design and implementation: Jakub Piotrowski