Thesis Repository

Abstract

The extraction and segmentation of references from scientific articles is a core task of modern digital libraries. Once references are extracted and segmented, the bibliographic information can be made publicly available and linked, enabling efficient literature study. However, references often vary in their structure and content. This makes the extraction and segmentation of references a challenging but valuable task. The purpose of this thesis is to investigate whether Bidirectional Encoder Representations from Transformers (BERT) is suitable for the extraction and segmentation of bibliographic references. Therefore, we follow a deep learning approach for the extraction and segmentation of references from PDF documents. We use a neural network architecture based on BERT, a deep language representation model that has significantly increased performance on many natural language processing tasks. Over the BERT output, we put a linear-chain Conditional Random Field. We experiment with different BERT models and input formats and also examine two approaches for reference extraction and segmentation. The experiments are evaluated on a challenging dataset that contains both English and German social science publications with highly varying references. Our results show that the best performing BERT models were pre-trained on similar data to the data that we used for the fine-tuning of the BERT models on the task of reference extraction and reference segmentation. Moreover, our findings show that long, context-based input sequences yield the best results. The extraction model identifies and extracts references with an average F1-score of 81.9%. References are segmented with an average F1-score of 93.6%. We show that our models compare well to one other previously published work. Our conclusion is that BERT is a suitable choice for reference extraction and reference segmentation.

Abstract

Argumentation Frameworks are an approach of formalizing arguments and their interrelations in a graph structure. They can be used to draw conclusions from this modelling of knowledge. Since argumentation is an important part of human reasoning, these graph structures can be considered easily interpretable, what makes this technology an interesting explainable artificial intelligence method. Although this is not their main purpose, Quantitative Argumentation Frameworks can be used to solve classification problems by following a new approach. This approach is based on constructing them out of multilayer perceptrons (MLP), based on the work of Potyka. In this thesis we were motivated to construct Quantitative Argumentation Frameworks out of sparse MLPs. A swarm intelligence algorithm, namely Particle Swarm Optimization (PSO), was developed to search for sparse MLP models with specific characteristics that relate to performance and topology of the graphical structures. Models were implemented, tested, and evaluated on three different datasets. The implementation includes preprocessing of the datasets, parameter learning of MLPs based on backpropagation, and structure learning of the MLP graphical structures. The evaluation involves constructing fully connected MLPs and decision trees for comparison purposes. The resulting models achieved high performance and low complexity in their structure. The PSO algorithm also proved its efficiency in solving the structure learning.

Abstract

Multistep prediction is the prediction of states based on initial states and a series of control inputs. This paper focuses on developing transformer models for multistep prediction of vehicle states and testing different modifications of the transformer architecture using the example of the prediction of a ship simulation. Research in NLP promises advantages with regard to training time and prediction accuracy for the transformer architecture compared to a state-of-the-art LSTM model. The author also investigates whether positional encodings are useful in this scenario and if a transformer model can learn the order of the inputs without positional encodings.

Abstract

Kleinsatelliten sind heute eine zunehmend wichtige Möglichkeit für die Forschung, Experimente und Nutzlasten in Erdumlaufbahnen zu bringen. Bei diesen Satellitensystemen besteht einerseits ein wachsender Bedarf an Datenübertragung zu einer Bodenstation, andererseits gelten in der Raumfahrt verschiedene Einschränkungen bei Aufbau und Betrieb von Funkkommunikationssystemen. Heutige Funksysteme haben meist statische Transceiver-Konfigurationen und die genutzten Übertragungsraten entsprechen der Worst-case-Betrachtung für den jeweiligen Fall. Neuerdings werden adaptive Ansätze für den Betrieb von Funkverbindungen zwischen Satellit und Bodenstation beschrieben, bei denen die Transceiver-Konfiguration, gesteuert durch einen lernenden Algorithmus, im Betrieb verändert und den jeweiligen äusseren Einflüssen angepasst wird. Die Grundlage für die verwendeten Algorithmen ist das Reinforcement Learning Model. Ziel dieser Arbeit war die Weiterentwicklung eines für die Raumfahrtfunkkommunikation entwickelten Algorithmus und der Test dieses Algorithmus' innerhalb einer Simulationsumgebung, um die Auswirkungen der Veränderungen zu bewerten. Der modifizierte Algorithmus wurde in einer Software-Simulationsumgebung betrieben, welche die digitale Signalverarbeitung von Sender und Empfänger sowie die sich verändernden Übertragungsbedingungen während eines Satellitenüberfluges abbildete. Die Modifikation wurde mit dem Originalalgorithmus hinsichtlich der erreichbaren Datenübertragung verglichen. Unter anderem wurde die Anzahl der für das Lernen verwendeten Neuronalen Netze variiert. Weiterhin wurden verschiedene Hyperparameter variiert und die Auswirkungen auf die Datenübertragung untersucht. Eine Anpassung der Hyperparameter führte dabei zu einer Übertragung von 57,8% mehr Daten als bei der Baseline-Implementierung. Sowohl die Veränderung in der Architektur als auch die Reduzierung der parallel ausgeführten Neuronalen Netze führte zu leichten Performanzeinbußen von 4,0% und 3,3%. Die Ergebnisse der hier durchgeführten Software-Simulationen lassen sich jedoch nicht auf Hardware-Simulationsumgebungen oder tatsächliche Funkverbindungen übertragen. Die Implementierung der verschiedenen Algorithmusvarianten erlaubt es, diese Varianten zukünftig auch mit Hardware-Übertragungsstrecken zu testen und später ein solches System auf einem Kleinsatelliten zu erproben.

Abstract

Playing computer games is one of the most common and enjoyable activities in the modern lifestyle. However, people with motor impairments who cannot use mouse and keyboard are not able to interact with computing devices as required by the game design. In this regard, novel interaction techniques can enable hands-free control using gaze and voice as input modalities to assist people with motor and speech impairments. This is the first evaluation of a video game control method consisting of a combination of eye tracking and non-verbal voice commands (e.g. humming) applied in a 2D jump-and-run game environment involving essential spatio-temporal interactions. To assess interaction feasibility, the evaluation study consisted of both qualitative and quantitative measures. In addition, the feasibility was validated with a target user group of people with motor impairments. Overall, the results indicate a lower but competitive performance while increasing the fun factor.

Abstract

The modern world is highly influenced by user-contributed content such as user comments, which is one of the most popular forms of communication on social media. They help build a connection between content creators and content consumers, as well as a connection between users of a social platform, which makes them highly relevant for community interaction. However, researchers have not treated users' comment reading strategies in much detail. The existing accounts are limited to address solely an explicit comment reading approach, which is only able to track an active interaction, e.g. analyze attention by counting a number of clicks. This technique can not fully estimate the drawn attention, as 73% of people do not actively interact with comments. Eye-tracking plays a vital role in solving the task of analysing implicit attention, as it allows to estimate such crucial characteristics, as comment features, which drew the most attention, the amount of attention given or the order of seeing specific comments. The current research uses eye-tracking based attention analysis for investigating the phenomena of users' reading behaviour on the real YouTube interface. The present master thesis concentrates on analysing users' attention mechanisms and reading behaviour and finding a correlation between the comment features such as length, language, sparseness, comment position, number of likes, presence of replies, presence of video creator's like and authorised user label, which cannot be exhibited from a pure textual point of view. This work shows that number of likes and presence of answers contribute the most to the attention drawn by comments. The analysis revealed that the category of a video deeply influences the emotion and length of the popular comments: if people are looking for useful information, which applies to educational videos, they tend to pay attention to neutral and long comments, whereas while looking for entertainment, people most probably will notice short and positive comments. The two important findings from the gender analysis are that women tend to read longer comments, but skip a higher percentage of comments than men. It is hoped that this research will contribute to a deeper understanding of the features that draw the most attention, which can be exploited in content generation strategies and developing new ranking algorithms.