Efficient self-attention with smart pruning for sustainable large language models by Samir Brahim Belhaouari (9427347)

“…Second, the Weight Matrix Folding method is introduced to efficiently prune the self-attention layer matrices in a simple and efficient mathematical model. …”

An End-to-End Concatenated CNN Attention Model for the Classification of Lung Cancer With XAI Techniques by Fariha Haque (21485518)

“…To address these challenges, an end-to-end concatenated Convolutional Neural Network (CNN) attention model has been proposed for automatic lung cancer classification. …”

Agent Productivity Modeling in a Call Center Domain Using Attentive Convolutional Neural Networks by Ahmed , Abdelrahman

“…In this paper, we propose an objective framework for modeling agent productivity for real estate call centers based on speech signal processing. …”
Get full text
Get full text

PredictPTB: an interpretable preterm birth prediction model using attention-based recurrent neural networks by Rawan AlSaad (14159019)

“…<h3>Background</h3><p dir="ltr">Early identification of pregnant women at risk for preterm birth (PTB), a major cause of infant mortality and morbidity, has a significant potential to improve prenatal care. However, we lack effective predictive models which can accurately forecast PTB and complement these predictions with appropriate interpretations for clinicians. …”

Micro-Expression Recognition using Convolutional Variational Attention Transformer (ConVAT) with Multihead Attention Mechanism by Hafiz Khizer bin Talib (20571467)

“…To address these limitations, we propose the Convolutional Variational Attention Transformer (ConVAT), a novel model that leverages a multi-head attention mechanism integrated with convolutional networks, optimized specifically for detailed micro-expression analysis. …”

A hybrid 3D CNN-LSTM model with soft spatial attention mechanism for accurate hyperspectral image classification by Mohamed Sultan Mohamed Ali (17317003)

“…This study introduces a hybrid deep learning model that combines 3D Convolutional Neural Networks (CNNs) with Long Short-Term Memory (LSTM) networks, incorporating residual connections and a soft spatial attention mechanism to overcome these limitations. …”

Temporal self-attention for risk prediction from electronic health records using non-stationary kernel approximation by Rawan AlSaad (14159019)

“…Yet, modeling the non-stationarity in EHR data has received less attention. …”

Dual-attention Network for View-invariant Action Recognition by Gedamu Alemu Kumie (19273711)

“…The DANet is composed of relation-aware spatiotemporal self-attention and spatiotemporal cross-attention modules. …”

Addition of sphingosine-1-phosphate to human oocyte culture medium decreases embryo fragmentation by Zreik, Tony

Get full text
Get full text
Get full text

Robust and novel attention guided MultiResUnet model for 3D ground reaction force and moment prediction from foot kinematics by Md. Ahasan Atick Faisal (15302410)

“…The proposed deep learning model is tested on two publicly available datasets containing data from 66 healthy subjects to validate the approach. …”

Hierarchical multi-head attention LSTM for polyphonic symbolic melody generation by Ahmet Kasif (17787560)

“…As such, in this study, a hierarchical multi-head attention LSTM model is proposed for creating polyphonic symbolic melodies. …”

Social attention as a cross‐cultural transdiagnostic neurodevelopmental risk marker by Thomas W. Frazier (4229593)

“…The best-fitting model included a general social attention factor and six specific factors. …”

A slow but steady nanoLuc: R162A mutation results in a decreased, but stable, nanoLuc activity by Wesam S. Ahmed (10170053)

“…Here, we combined molecular dynamics (MD) simulation and mutational analysis to show that the R162A mutation results in a decreased but stable <u>bioluminescence </u>activity of NLuc in living cells and in vitro. …”

Does standalone phacoemulsification lower intraocular pressure in glaucomatous eyes? A systematic review and meta-analysis by Osama Hussein (21301202)

“…In conclusion, standalone phacoemulsification significantly lowers IOP and reduces the need for glaucoma medications in patients with glaucoma.…”

MACGAN: An All-in-One Image Restoration Under Adverse Conditions Using Multidomain Attention-Based Conditional GAN by Maria Siddiqua (17949149)

“…Furthermore, an ablation study is conducted to analyze the contributions of the discriminator and attention blocks within the MACGAN architecture. The results confirm that both components play significant roles in the effectiveness of MACGAN, with the discriminator ensuring adversarial training and the attention blocks effectively capturing and enhancing important image features.…”

Serum Vitamin D Concentration ≥75 nmol/L Is Related to Decreased Cardiometabolic and Inflammatory Biomarkers, Metabolic Syndrome, and Diabetes; and Increased Cardiorespiratory Fitn... by Vijay Ganji (8710491)

Exendin-4 alleviates steatosis in an in vitro cell model by lowering FABP1 and FOXA1 expression via the Wnt/-catenin signaling pathway by Olfa Khalifa (10914452)

Physical Asset Management for Critical Utilities— A Systematic Literature Review by Alquraidi, Alya

“…Despite the importance of all four stages of assets lifecycle, researchers focused more on asset maintenance with less attention paid to the other stages. The review also highlights the need to develop a holistic asset management maturity model to identify gaps and advocate performance improvement actions. …”
Get full text

Trade Flow and Nation Brand Distance: A Structural Gravity Model Approach by AL BESHER, HUDA ISMAIL

“…A progeny of this global milieu, the ‘nation brand’ concept has captured the growing attention of policy makers, practitioners, and scholars. …”
Get full text

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction by Mansoor G. Al-Thani (19237204)

“…This significant shift enhances the model's ability to capture long-range dependencies within time series data. …”