Sökning: "self-attention"

Hittade 5 avhandlingar innehållade ordet self-attention.

1. 1. Applications of Diversity and the Self-Attention Mechanism in Neural Networks

   Författare :Axel Berg; Matematik LTH; []
   Nyckelord :NATURVETENSKAP; NATURAL SCIENCES; NATURVETENSKAP; NATURAL SCIENCES; point cloud; self-attention; keyword spotting; deep learning; computer vision; machine learning; label diversity;

   Sammanfattning : This thesis covers three contributions in applications of neural networks. The first is related to diversity and ensemble learning, while the other two cover novel applications of the self-attention mechanism. An important aspect of training a neural network is the choice of objective function. LÄS MER

3. 2. Supervised and Unsupervised Deep Learning Models for Flood Detection

   Författare :Ritu Yadav; Yifang Ban; Andrea Nascetti; Nicolas Audebert; KTH; []
   Nyckelord :TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; NATURVETENSKAP; NATURAL SCIENCES; Floods; Remote Sensing; Sentinel-1 SAR; Segmentation; Change Detection; DEM; Data Fusion; Time Series; Deep Learning; Unsupervised Learning; Contrastive Learning; Self-Attention; Convolutional LSTM; Variational AutoEncoder VAE ; Geoinformatik; Geoinformatics;

   Sammanfattning : Human civilization has an increasingly powerful influence on the earthsystem. Affected by climate change and land-use change, floods are occurringacross the globe and are expected to increase in the coming years. Currentsituations urge more focus on efficient monitoring of floods and detecting impactedareas. LÄS MER

4. 3. Machine Learning methods in shotgun proteomics

   Författare :Patrick Truong; Lukas Käll; Peter Nilsson; KTH; []
   Nyckelord :NATURVETENSKAP; NATURAL SCIENCES; mass spectrometry protein summarization Bayesian hierarchical modelling label-free quantification data-independent acquisition mass spectrometry; benchmark mathematical methods; transformers; computational proteomics; proteomics; bioinformatics; bert; ms2 intensity; probabilistic modelling; Biotechnology; Bioteknologi;

   Sammanfattning : As high-throughput biology experiments generate increasing amounts of data, the field is naturally turning to data-driven methods for the analysis and extraction of novel insights. These insights into biological systems are crucial for understanding disease progression, drug targets, treatment development, and diagnostics methods, ultimately leading to improving human health and well-being, as well as, deeper insight into cellular biology. LÄS MER

5. 4. The Search for Syntax : Investigating the Syntactic Knowledge of Neural Language Models Through the Lens of Dependency Parsing

   Författare :Artur Kulmizev; Joakim Nivre; Roger Levy; Uppsala universitet; []
   Nyckelord :NATURVETENSKAP; NATURAL SCIENCES; syntax; language models; dependency parsing; universal dependencies; Datorlingvistik; Computational Linguistics;

   Sammanfattning : Syntax — the study of the hierarchical structure of language — has long featured as a prominent research topic in the field of natural language processing (NLP). Traditionally, its role in NLP was confined towards developing parsers: supervised algorithms tasked with predicting the structure of utterances (often for use in downstream applications). LÄS MER

7. 5. Vision-based Perception For Autonomous Robotic Manipulation

   Författare :Dinh-Cuong Hoang; Todor Stoyanov; Achim Lilienthal; Per-Erik Forssén; Örebro universitet; []
   Nyckelord :NATURVETENSKAP; NATURAL SCIENCES;

   Sammanfattning : In order to safely and effectively operate in real-world unstructured environments where a priori knowledge of the surroundings is not available, robots must have adequate perceptual capabilities. This thesis is concerned with several important aspects of vision-based perception for autonomous robotic manipulation. LÄS MER