Efficient self-attention with smart pruning for sustainable large language models by Samir Brahim Belhaouari (9427347)

“…Second, the Weight Matrix Folding method is introduced to efficiently prune the self-attention layer matrices in a simple and efficient mathematical model. …”

An End-to-End Concatenated CNN Attention Model for the Classification of Lung Cancer With XAI Techniques by Fariha Haque (21485518)

“…To address these challenges, an end-to-end concatenated Convolutional Neural Network (CNN) attention model has been proposed for automatic lung cancer classification. …”

Agent Productivity Modeling in a Call Center Domain Using Attentive Convolutional Neural Networks by Ahmed , Abdelrahman

“…In this paper, we propose an objective framework for modeling agent productivity for real estate call centers based on speech signal processing. …”
Get full text
Get full text

PredictPTB: an interpretable preterm birth prediction model using attention-based recurrent neural networks by Rawan AlSaad (14159019)

“…<h3>Background</h3><p dir="ltr">Early identification of pregnant women at risk for preterm birth (PTB), a major cause of infant mortality and morbidity, has a significant potential to improve prenatal care. However, we lack effective predictive models which can accurately forecast PTB and complement these predictions with appropriate interpretations for clinicians. …”

Micro-Expression Recognition using Convolutional Variational Attention Transformer (ConVAT) with Multihead Attention Mechanism by Hafiz Khizer bin Talib (20571467)

“…To address these limitations, we propose the Convolutional Variational Attention Transformer (ConVAT), a novel model that leverages a multi-head attention mechanism integrated with convolutional networks, optimized specifically for detailed micro-expression analysis. …”

A hybrid 3D CNN-LSTM model with soft spatial attention mechanism for accurate hyperspectral image classification by Mohamed Sultan Mohamed Ali (17317003)

“…This study introduces a hybrid deep learning model that combines 3D Convolutional Neural Networks (CNNs) with Long Short-Term Memory (LSTM) networks, incorporating residual connections and a soft spatial attention mechanism to overcome these limitations. …”

Temporal self-attention for risk prediction from electronic health records using non-stationary kernel approximation by Rawan AlSaad (14159019)

“…Yet, modeling the non-stationarity in EHR data has received less attention. …”

Dual-attention Network for View-invariant Action Recognition by Gedamu Alemu Kumie (19273711)

“…The DANet is composed of relation-aware spatiotemporal self-attention and spatiotemporal cross-attention modules. …”

Robust and novel attention guided MultiResUnet model for 3D ground reaction force and moment prediction from foot kinematics by Md. Ahasan Atick Faisal (15302410)

“…The proposed deep learning model is tested on two publicly available datasets containing data from 66 healthy subjects to validate the approach. …”

Hierarchical multi-head attention LSTM for polyphonic symbolic melody generation by Ahmet Kasif (17787560)

“…As such, in this study, a hierarchical multi-head attention LSTM model is proposed for creating polyphonic symbolic melodies. …”

Social attention as a cross‐cultural transdiagnostic neurodevelopmental risk marker by Thomas W. Frazier (4229593)

“…The best-fitting model included a general social attention factor and six specific factors. …”

Decreased Analgesic Requirements in Super Morbidly Versus Morbidly Obese Patients Undergoing Laparoscopic Sleeve Gastrectomy by Hamed Elgendy (14148846)

A slow but steady nanoLuc: R162A mutation results in a decreased, but stable, nanoLuc activity by Wesam S. Ahmed (10170053)

“…However, questions related to its mechanism of interaction with the substrate, furimazine, as well as bioluminescence activity remain elusive. Here, we combined molecular dynamics (MD) simulation and mutational analysis to show that the R162A mutation results in a decreased but stable <u>bioluminescence </u>activity of NLuc in living cells and in vitro. …”

Decreased Interfacial Dynamics Caused by the N501Y Mutation in the SARS-CoV-2 S1 Spike:ACE2 Complex by Wesam S. Ahmed (10170053)

“…Additionally, we find that the N501Y mutant S1-RBD displays altered dynamics that likely aids in its enhanced interaction with ACE2. …”

MACGAN: An All-in-One Image Restoration Under Adverse Conditions Using Multidomain Attention-Based Conditional GAN by Maria Siddiqua (17949149)

“…Furthermore, an ablation study is conducted to analyze the contributions of the discriminator and attention blocks within the MACGAN architecture. The results confirm that both components play significant roles in the effectiveness of MACGAN, with the discriminator ensuring adversarial training and the attention blocks effectively capturing and enhancing important image features.…”

L1-CAM knock-down radiosensitizes neuroblastoma IMR-32 cells by simultaneously decreasing MycN, but increasing PTEN protein expression by Rached, Johnny

Get full text
Get full text
Get full text
Get full text

Both decreasing interstructural space size and increasing total cover increase shrimp abundance on artificial structures deployed in a UAE seagrass bed by Bartholomew, Aaron

Get full text

Performance evaluation of 3D-printed PLA composites doped with WE43 magnesium alloy for bone tissue engineering applications by Sumama Nuthana Kalva (17302906)

“…While a low Mg content (5 %) only slightly impacted the print quality and dimensions, higher Mg concentrations (10 % and 15 %) led to increased weight, rougher surfaces, dimensional shrinkage in height, and overall poorer formation quality. Adding WE43 alloy to PLA decreased the average pore sizes of the composites. …”

Notch Signaling Inhibition by LY411575 Attenuates Osteoblast Differentiation and Decreased Ectopic Bone Formation Capacity of Human Skeletal (Mesenchymal) Stem Cells by Nihal AlMuraikhi (6002234)

“…Among the tested molecules, LY411575, a potent γ-secretase and Notch signaling inhibitor, exhibited significant inhibitory effects on osteoblastic differentiation of hBMSCs manifested by reduced ALP activity, mineralized matrix formation, and decreased osteoblast-specific gene expression as well as in vivo ectopic bone formation. …”

Serum Vitamin D Concentration ≥75 nmol/L Is Related to Decreased Cardiometabolic and Inflammatory Biomarkers, Metabolic Syndrome, and Diabetes; and Increased Cardiorespiratory Fitn... by Vijay Ganji (8710491)