Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System

Godwin Enemali; Abhijeet Bishnu; Tharmalingam Ratnarajah; Tughrul Arslan

doi:10.1109/ICASSPW59220.2023.10192936

Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System

Godwin Enemali^*, Abhijeet Bishnu, Tharmalingam Ratnarajah, Tughrul Arslan

^*Corresponding author for this work

School of Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.

Original language	English
Title of host publication	2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)
Publisher	Institute of Electrical and Electronics Engineers
ISBN (Electronic)	9798350302615
DOIs	https://doi.org/10.1109/ICASSPW59220.2023.10192936
Publication status	Published - 2 Aug 2023
Event	2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, ICASSPW 2023 - Rhodes Island, Greece Duration: 4 Jun 2023 → 10 Jun 2023

Publication series

Name	ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings

Conference

Conference	2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, ICASSPW 2023
Country/Territory	Greece
City	Rhodes Island
Period	4/06/23 → 10/06/23

Keywords / Materials (for Non-textual outputs)

Audio-visual speech enhancement
embedded platform
multi-modal hearing aid

Access to Document

10.1109/ICASSPW59220.2023.10192936

Cite this

Enemali, G., Bishnu, A., Ratnarajah, T., & Arslan, T. (2023). Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System. In 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) (ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICASSPW59220.2023.10192936

Enemali, Godwin ; Bishnu, Abhijeet ; Ratnarajah, Tharmalingam et al. / Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System. 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW). Institute of Electrical and Electronics Engineers, 2023. (ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings).

@inproceedings{314eda77670b45308b0ffd3acb35144b,

title = "Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System",

abstract = "This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.",

keywords = "Audio-visual speech enhancement, embedded platform, multi-modal hearing aid",

author = "Godwin Enemali and Abhijeet Bishnu and Tharmalingam Ratnarajah and Tughrul Arslan",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, ICASSPW 2023 ; Conference date: 04-06-2023 Through 10-06-2023",

year = "2023",

month = aug,

day = "2",

doi = "10.1109/ICASSPW59220.2023.10192936",

language = "English",

series = "ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings",

publisher = "Institute of Electrical and Electronics Engineers",

booktitle = "2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)",

address = "United States",

}

Enemali, G, Bishnu, A, Ratnarajah, T & Arslan, T 2023, Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System. in 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW). ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings, Institute of Electrical and Electronics Engineers, 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, ICASSPW 2023, Rhodes Island, Greece, 4/06/23. https://doi.org/10.1109/ICASSPW59220.2023.10192936

Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System. / Enemali, Godwin; Bishnu, Abhijeet; Ratnarajah, Tharmalingam et al.
2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW). Institute of Electrical and Electronics Engineers, 2023. (ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System

AU - Enemali, Godwin

AU - Bishnu, Abhijeet

AU - Ratnarajah, Tharmalingam

AU - Arslan, Tughrul

PY - 2023/8/2

Y1 - 2023/8/2

N2 - This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.

AB - This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.

KW - Audio-visual speech enhancement

KW - embedded platform

KW - multi-modal hearing aid

UR - https://www.scopus.com/pages/publications/85168239239

U2 - 10.1109/ICASSPW59220.2023.10192936

DO - 10.1109/ICASSPW59220.2023.10192936

M3 - Conference contribution

AN - SCOPUS:85168239239

T3 - ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings

BT - 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)

PB - Institute of Electrical and Electronics Engineers

T2 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, ICASSPW 2023

Y2 - 4 June 2023 through 10 June 2023

ER -

Enemali G, Bishnu A, Ratnarajah T, Arslan T. Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System. In 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW). Institute of Electrical and Electronics Engineers. 2023. (ICASSPW 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, Proceedings). doi: 10.1109/ICASSPW59220.2023.10192936

Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System

Abstract

Publication series

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Other files and links

Fingerprint

COG-MHEAR: Towards cognitively-inspired 5G-IoT enabled, multi-modal Hearing Aids

Cite this

Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System

Abstract

Publication series

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Other files and links

Fingerprint

Projects

COG-MHEAR: Towards cognitively-inspired 5G-IoT enabled, multi-modal Hearing Aids

Cite this