Efficient self-attention with smart pruning for sustainable large language models by Samir Brahim Belhaouari (9427347)

“…Second, the Weight Matrix Folding method is introduced to efficiently prune the self-attention layer matrices in a simple and efficient mathematical model. …”

An End-to-End Concatenated CNN Attention Model for the Classification of Lung Cancer With XAI Techniques by Fariha Haque (21485518)

“…To address these challenges, an end-to-end concatenated Convolutional Neural Network (CNN) attention model has been proposed for automatic lung cancer classification. …”

Agent Productivity Modeling in a Call Center Domain Using Attentive Convolutional Neural Networks by Ahmed , Abdelrahman

“…In this paper, we propose an objective framework for modeling agent productivity for real estate call centers based on speech signal processing. …”
Get full text
Get full text

PredictPTB: an interpretable preterm birth prediction model using attention-based recurrent neural networks by Rawan AlSaad (14159019)

“…<h3>Background</h3><p dir="ltr">Early identification of pregnant women at risk for preterm birth (PTB), a major cause of infant mortality and morbidity, has a significant potential to improve prenatal care. However, we lack effective predictive models which can accurately forecast PTB and complement these predictions with appropriate interpretations for clinicians. …”

Micro-Expression Recognition using Convolutional Variational Attention Transformer (ConVAT) with Multihead Attention Mechanism by Hafiz Khizer bin Talib (20571467)

“…To address these limitations, we propose the Convolutional Variational Attention Transformer (ConVAT), a novel model that leverages a multi-head attention mechanism integrated with convolutional networks, optimized specifically for detailed micro-expression analysis. …”

A hybrid 3D CNN-LSTM model with soft spatial attention mechanism for accurate hyperspectral image classification by Mohamed Sultan Mohamed Ali (17317003)

“…This study introduces a hybrid deep learning model that combines 3D Convolutional Neural Networks (CNNs) with Long Short-Term Memory (LSTM) networks, incorporating residual connections and a soft spatial attention mechanism to overcome these limitations. …”

Temporal self-attention for risk prediction from electronic health records using non-stationary kernel approximation by Rawan AlSaad (14159019)

“…Yet, modeling the non-stationarity in EHR data has received less attention. …”

Dual-attention Network for View-invariant Action Recognition by Gedamu Alemu Kumie (19273711)

“…The DANet is composed of relation-aware spatiotemporal self-attention and spatiotemporal cross-attention modules. …”

Robust and novel attention guided MultiResUnet model for 3D ground reaction force and moment prediction from foot kinematics by Md. Ahasan Atick Faisal (15302410)

“…The proposed deep learning model is tested on two publicly available datasets containing data from 66 healthy subjects to validate the approach. …”

Hierarchical multi-head attention LSTM for polyphonic symbolic melody generation by Ahmet Kasif (17787560)

“…As such, in this study, a hierarchical multi-head attention LSTM model is proposed for creating polyphonic symbolic melodies. …”

Social attention as a cross‐cultural transdiagnostic neurodevelopmental risk marker by Thomas W. Frazier (4229593)

“…The best-fitting model included a general social attention factor and six specific factors. …”

MACGAN: An All-in-One Image Restoration Under Adverse Conditions Using Multidomain Attention-Based Conditional GAN by Maria Siddiqua (17949149)

“…Furthermore, an ablation study is conducted to analyze the contributions of the discriminator and attention blocks within the MACGAN architecture. The results confirm that both components play significant roles in the effectiveness of MACGAN, with the discriminator ensuring adversarial training and the attention blocks effectively capturing and enhancing important image features.…”

Mixed precision iterative refinement with adaptive precision sparse approximate inverse preconditioning by Noaman Khan (19810050)

“…<p dir="ltr">Hardware trends have motivated the development of mixed precision algorithms in numerical linear algebra, which aim to decrease runtime while maintaining acceptable accuracy. …”

Serum 25-hydroxyvitamin D concentrations are inversely associated with body adiposity measurements but the association with bone mass is non-linear in postmenopausal women by Vijay, Ganji

“…In a continuous variable analysis, the association between 25(OH)D and bone mass was significant, non-linear, inverse ‘U’. In conclusion, serum 25-hydroxyvitamin D was inversely associated with adiposity measures and non-linearly associated to bone mass in postmenopausal Qatari women.…”
Get full text
Get full text
Get full text

Serum 25-hydroxyvitamin D concentrations are inversely associated with body adiposity measurements but the association with bone mass is non-linear in postmenopausal women by Vijay Ganji (8710491)

“…In a continuous variable analysis, the association between 25(OH)D and bone mass was significant, non-linear, inverse ‘U’. In conclusion, serum 25-hydroxyvitamin D was inversely associated with adiposity measures and non-linearly associated to bone mass in postmenopausal Qatari women.…”

Physical Asset Management for Critical Utilities— A Systematic Literature Review by Alquraidi, Alya

“…Despite the importance of all four stages of assets lifecycle, researchers focused more on asset maintenance with less attention paid to the other stages. The review also highlights the need to develop a holistic asset management maturity model to identify gaps and advocate performance improvement actions. …”
Get full text

Analyzing the Influence of Climate and Anthropogenic Development on Vegetation Cover in the Coastal Ecosystems of GCC by Abhilash Dutta Roy (22466830)

“…Our results revealed significant changes in land cover, as seen by an increase in artificial built-up areas by 15.5% in two decades and a corresponding decrease in bareland and dense vegetation. …”

Trade Flow and Nation Brand Distance: A Structural Gravity Model Approach by AL BESHER, HUDA ISMAIL

“…A progeny of this global milieu, the ‘nation brand’ concept has captured the growing attention of policy makers, practitioners, and scholars. …”
Get full text

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction by Mansoor G. Al-Thani (19237204)

“…This significant shift enhances the model's ability to capture long-range dependencies within time series data. …”

Characterization and Modeling of Damage in Steel at Different Strain Rates by Al-Himairee, Reem

Get full text