Evolution Of Activation Functions for Neural Architecture Search
The introduction of the ReLU function in neural network architectures yielded substantial improvements over sigmoidal activation functions and allowed for the training of deep networks. Ever since, the search for new activation functions in neural networks has been an active research topic. However,...
Saved in:
| Main Author: | |
|---|---|
| Format: | masterThesis |
| Published: |
2020
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/10725/13847 https://doi.org/10.26756/th.2022.373 http://libraries.lau.edu.lb/research/laur/terms-of-use/thesis.php |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|