Theses

Binarized Neural Networks (BNNs) are feed-forward neural networks with fully connected layers that purely use binary weights. The evaluation is highly efficient, which makes it attractive to use them in low-power settings since their performance is close to the performance of linear neural networks. However, robust networks are important, especially in settings that are safety-critical. So-called attacks on neural networks are small perturbation vectors that are added to the input that lead to different (pre-defined) results. Existing methods to generate attacks mostly use gradient-based methods, but the binary, non-differentiable nature of the BNNs renders gradient-based methods impossible. One more recent approach already makes use of mixed integer linear programming (MILP) models. In this body of work, we reproduce the results of existing approaches that make use of MILP models. We come up with new formulations and we show that they are stronger performance- and results-wise. Furthermore, we show that a reformulation of these models into a column generation approach does not seem to be practical and demonstrate an MILP model to alter the network to be robust against the previously generated attacks.

This work explores if scheduled service network design programs can effectively support the Deutsche Post DHL Group (DP-DHL) in the tactical planning of their service networks. The DP-DHL operates service networks using trucks to transport packages between regional terminals. For cost-efficient transportation, packages are consolidated at hubs, which requires close coordination of the operated services. The underlying combinatorial optimization problem is known as the scheduled service network design (SSND) problem. SSND programs can decide which services to operate and how to transport commodities based on these services to minimize the total operational costs. In the case of DP-DHL, a variety of real-world constraints and operational options need to be considered during the program development. The proposed SSND program is solved by a price-and-branch heuristic, where services and paths for commodity flows are generated based on time-space graphs in column generation schemes. The program simplifies the DP-DHL problem to apply SSND programs known from literature to the DP-DHL case. Within the simplified framework, the currently operated service network under consideration could be optimized in terms of costs. The linear programming relaxation solution values show significant optimization potential, which could be partially translated into mixed-integer solutions. It can be challenging to fully model the real-world complexity and to design large and robust service networks with SSND programs. However, the improvements achieved indicate that SSND programs could be used as part of advanced solution procedures that can overcome modeling and runtime challenges.

Die Vorteile der Danzig-Wolfe-Reformulierung (DWR) beim Lösen von gemischt-ganzzahligen Programmen (MIPs) sind gut dokumentiert. Damit DWR gute Ergebnisse erzielt, muss jedoch eine bestimmte Struktur in der Nebenbedingungsmatrix des MIPs vorhanden sein. In den meisten heutigen Solvern muss der Benutzer solche Strukturen für den Solver bereitstellen. Es gibt in der Literatur einige Vorschläge zur Automatisierung der Strukturerkennung, von denen jedoch einer eine sehr wünschenswerte Prämisse hat, da er keine Benutzereingaben erfordert, d.h. keine Kenntnisse über die Problemstruktur voraussetzt. Der in der Arbeit "Structure detection in mixed-integer programs" von Khaniyev et al. vorgeschlagene Algorithmus erkennt eine bordered block diagonal (BBD) Struktur. Er schlägt eine Metrik für die Güte solcher BBD-Strukturen vor und implementiert einen greedy, auf community detection basierenden Ansatz. Diesen Algorithmus haben wir im GCG Solver implementiert, so dass wir die wichtigsten Designentscheidungen nachvollziehen sowie die Performance testen konnten.

Extracting special structures from coefficient matrices is a known practice to solve linear programs more efficiently. One of these extraction problems is the detection of maximum embedded reflected network matrices (DMERN). That is finding a maximal sub matrix in our coefficient matrix such that by multiplying a number of its rows with −1 this sub matrix contains in each column at most one -1 entry and at most one +1 entry, while all other entries are zero. The goal of this bachelors thesis is to give an introduction into the DMERN problem and provide a collection and explanation of solution approaches that can be found in the literature.

This thesis implements, documents and analyzes two different image-based approaches to detect structural similarity among mixed integer programs. The first approach detects structural similarity among mixed integer programs using the constraint coefficient matrix. Therefore, the constraint coefficient matrix is permuted using decomposition techniques of the Generic Column Generation solver (short GCG) and is visualized as an image. Several instances of strIPlib are used to create these images and then passed on to train a convolutional autoencoder. The trained convolutional autoencoder can compute feature vectors that represent latent structural features of the mixed integer program. Thereafter, the feature vectors are used to measure similarity among mixed integer programs. The aforementioned approach is extended by adding the left-hand and right-hand side vectors and the objective coefficient vector to the constraint coefficient matrix and thus creating more insightful images. These images are easily created using the developed visualization tool for decompositions in PyGCGOpt. This procedure generates our second approach to detect structural similarity among mixed integer programs. Finally, the analysis of both approaches shows that both approaches are equally well suited to detect structural similarity among mixed integer programs.

State estimation is responsible for the stable and efficient operation of electric power system and plays a vital role in power system monitoring and control. The increasing shift towards use of renewable energy sources (RES) in electric power system has introduced bi-directional flow of power in the electric power system, one from the transmission system and other from the renewable energy resources which can violate the network operating constraints which can further lead to the network failure. Therefore, state estimation in distribution networks have become very critical. Distribution System State Estimation (DSSE) algorithms compute the state variables of an electrical network complex voltages (magnitude and phase angle) using input measurements of electric bus active and reactive power injections, branch power flows and bus voltages magnitudes taken from the system. The main challenge for implementation of state estimation in distribution network is the limited number of measurements. System is generally unobservable (partially observable), therefore an attempt to solve this problem of lacking real time measurements is the employment of so-called pseudo-measurements to ensure the observability of the system and a reliable estimation. Therefore, the validity of state estimation depends on the accuracy of generated pseudo-measurements. The focal point of this thesis is to device an alternative approach to generate and model pseudo-measurement in reference to distribution system state estimation. In the proposed approach, Artificial neural networks (ANNs) are used to generate pseudo-measurements where few real measurements are used in conjunction with typical load and generation profiles. The error between the load and generation profiles (target output of ANN) and ANN output is modeled through Gaussian Mixture Model (GMM). The state estimation of three different networks are computed using the pseudo-measurements generated using the proposed methodology and compared with the actual state estimation values to validate the quality of state estimation results using the predicted pseudo-measurements. We have also demonstrated our proposed approach of pseudo-measurement modeling for state estimation on network with topological changes.

Energy grids are the backbone of every developed country. Currently, the grid topology is considered to be fixed. Topological changes are mostly executed in case of overloads or violations of safety margins. Thus, primary measures to control the power grid are market-based ones, like actively steering power plants. Recent research also identified the potential of optimizing the power flow including topological measures, like transmission element switching. The mathematical complexity of this formulation prohibits its practical usage. Currently, results are either obtained too slowly or violate critical security requirements using heavily simplified models. This work presents implementations of the traditional problem formulation and their restrictions. Alternative solution methods like nearest neighbor and reinforcement learning are implemented and compared against traditional optimization methods.

In this work, we explore combinatorial attacks on (binarized) neural networks. The "attacks" are small changes to the input data, such that the network misclassifies the input. To construct such combinatorial attacks, mixed-integer programs are used, instead of the gradient of the network, which is usually used. In the first part of the thesis, we reproduce the Iprop attack proposed by Gupta et al. in "Combinatorial Attacks on Binarized Neural Networks". Binarized neural networks are hereby aritficial neural networks with weights restricted to 0 and 1. We compare our results with those reported in the paper and analyze challenges in the implementation of the proposed method. In the second part, we extend the attacks to continuous neural networks and compare LP-based attacks with gradient-based attacks. We answer the question in which scenarios the LP-based approaches offer better performance and evaluate the strength of our formulation. Furthermore, we analyze whether successful "attacks" can be transferred to other network architectures and if LP-based attacks generalize better than gradient-based attacks.

In the course of planning railway transportation systems multiple problems have to be solved. Typically, those problems are solved sequentially in different stages, but since the planning stages are highly dependent on each other, it is beneficial to follow a more integrated approach. Inspired by the problem statement of the informatiCup 2022 "Abfahrt!", the integrated problem of creating a feasible train timetable with an associated scheduled passenger routing that minimizes the overall delay of all passengers will be investigated. This means, we direct trains and passengers individually through a public transportation network (PTN), while respecting all capacity constraints at all times. This problem turns out to be strongly NP-hard.  We propose different solution approaches based on integer linear programming and implement them to analyze their performance on examples. As a result, the approach based on a space-time graph representing actions on the original PTN outperforms the other presented concepts.

This thesis investigates the behavior of Dantzig-Wolfe decompositions with regard to constraint classification. Instead of considering all possible constraint subsets as potential decompositions, classification allows considering significantly fewer decompositions. Thus, analyses on larger instances are possible. This thesis examines, whether one can derive a rule for the strength of the dual bounds based on constraint classification.

Collection and Dispute Management, a part of the broader Order to Cash process, is responsible for collecting the credit back from the customer and improving the cash flow. Bayer's collections process suffers a severe overdue problem, owing to delayed payment by the customers. The current reactive nature of the collection process poses a significant challenge for reducing the average delinquent days. Hence a proactive collection strategy with a specific collection action for each customer is the need of the hour. This thesis focuses on understanding the business problem and providing an analytical solution for the collection team of one of the country. The solution employs Machine Learning via two modules: Invoice prediction and Days to Pay prediction. Finally, the Predictive Worklist module is the decision model that ensembles the results from the other two modules and the behavioral characteristics of the customer to create a recommended action for each customer. A detailed analysis of the problem and performance of those modules are evaluated. The proposed model serves as base for further extension of the project for other countries.

The accurate determination of the measurement uncertainty is important in the production environment to avoid economic losses due to erroneous decisions caused by measurement errors. Prerequisite for determining the measurement uncertainty is the description of the measurement process with the help of a model. Artificial neural networks (ANN) have the potential to create a model that validly describes the measurement process. However, there are no guidelines for the selection of the hyperparameters and topology of the ANN that are used in this context. In this master’s thesis, a method for optimized hyperparameter and topology selection for model building in measurement uncertainty determination using ANN was developed. The optimization of the hyperparameters and topology of ANN was first formally described as a mathematical optimization problem. To solve the problem, different algorithms (including classical algorithms, genetic algorithms) were identified and adapted for the problem of modeling in the determination of measurement uncertainty. Finally, the methods were evaluated using several measurement data sets.

In this Master Thesis, we investigate Mixed Integer Programs (MIPs) for optimally solving the problem of covering rectilinear polygons with a minimum number of axis parallel rectangles. Since larger instances involve millions of possible rectangles inducing long solving times, it might be necessary to choose a MIP formulation that can be solved with column generation. This allows us to start with a basic feasible solution and dynamically add new rectangles improving the current solution. In general, solutions to this NP-hard problem find applications in the fabrication of DNA chip arrays, in VLSI design, and image compression. In particular, aiming at image compression, other shapes like ellipses will be tested to improve the compression rate. Additionally, we investigate an approach that allows the model to select the shapes on its own to achieve even higher compression rates. Furthermore, the MIPs can be extended to allow for a lossy image compression. This thesis will elaborate and implement the introduced approaches to test them for their computational feasibility.

The nesting problem belongs to the class of cutting and packing problems. A two-dimensional cutting problem is called a nesting problem when the two-dimensional objects that need to be cut are non-rectangular. The objective is usually to minimize waste by utilizing the available material in the most efficient manner. Nesting problems are often encountered in manufacturing industries such as wood, steel, and textile industry. The geometric properties of irregularly shaped objects make solving nesting problems in practice very challenging. In this thesis, we cover the existing approaches to solving nesting problems as well as the geometric tools utilized by these approaches. Additionally, we explore a methodology combining two different strategies, namely, a heuristic algorithm and a mixed-integer programming model.

Reduced cost variable fixing is a classic technique for reducing the problem size when solving mixed-integer program. It allows fixing variables whose reduced costs are higher than the absolute gap. Reformulating problems with Dantzig-Wolfe decomposition and solving them with branch-price-and-cut algorithms often leads to tight dual bounds and smaller absolute gaps, but application of RCVF is not straightforward in these algorithms. Fixing the variables in the reformulation is not very promising but fixing variables of the original problem is not immediately possible, as no reduced costs are known for them. This thesis explores various ways to compute reduced costs of original variables and therefore apply RCVF in BP&C both from a theoretical and computational perspective.

In dieser Arbeit untersuchen wir verschiedene Relaxationen für ganzzahlige lineare Programme und betrachten dabei insbesondere deren Anwendung auf das Stable Set Problem. Wir analysieren Dantzig-Wolfe- Reformulierungen, die Corner-Relaxation und deren Variationen, die Sherali-Adams-Relaxation und die Lovasz-Schrijver-Relaxation anhand folgender Gesichtspunkte: Wie genau ist die Relaxation? Kann man die konvexe Hülle bestimmen? Wie hoch ist der Zeitaufwand? Wie hängen diese Faktoren möglicherweise von der Struktur des Graphen ab? Kann man das Problem auf ein Teilproblem reduzieren? Kann man verschiedene Verfahren kombinieren? Kann man die Verfahren auch auf andere Probleme anwenden?

Texts written in natural language are an unstructured data source that is hard for machines to understand. The amount of text in the world wide web is growing every minute. To deal with this huge number of unstructured data automated text analysis is crucial. Natural Language Processing (NLP) is part of artificial intelligence that makes natural language texts comprehensible for machines. Natural language processing (NLP) techniques can contribute to this problem by offering automated means to do preprocessing, text classification, feature extraction, and topic modelling. Social networks, like Facebook or Twitter, Application like Amazon or eBay are a phenomenon that has recently transformed numerous aspects of our lives. The impact of these platforms is no longer limited to entertainment or personal presentation of individuals. Indeed, they have formed a new sheer of business, with some emerging companies focusing primarily on this platform and others, more traditional ones, expanding their marketing efforts there. My intense research is being performed in order to efficiently categorize, filter, detect text and reviews on the customer-generated content on social networks and application reviews. One of the key segments of this effort is sentiment analysis and goal is to create different models on sentiment of the posts, comments, reviews or other forms of reactions users generate in relation to a company or a product. On the basis of that checking computational performance and results.

Um die Frage zu beantworteten, ob sich die Investition in ein bestehendes Produktionssystem lohnt, muss man beide Konfigurationen anhand von Kenngrößen miteinander vergleichen. Dazu wird die Produktionsstruktur als Maschinen, welche über Puffer miteinander verkettetet sind, abstrahiert. Dabei fangen die Puffer Maschinenausfälle ab, damit nicht weitere Arbeitsschritte auf Grund von Materialmangel oder mangelnder Kapazität im Output stillstehen. Ein Puffer kann zum Beispiel ein Förderband sein, auf dem sich Zwischenprodukte aufstauen können. Desweitern soll das Modell auch konvergente und divergente Produktionsströme abbilden, das heißt Maschinen können mit mehr als zwei Maschinen verbunden sein und somit zum Beispiel eine Endmontage beschreiben. Zur Bewertung verschiedener Konfigurationen kann man die Ausbringung als Kenngröße verwenden, welche die Produktionsmenge bezüglich einer Zeiteinheit beschreibt. Zudem ist der Wirkungsgrad, also die Ausbringung im Vergleich zur kleinsten Produktionsrate einer Maschine, interessant. Zur Messung dieser Werte in der Realität, müsste allerdings die Produktionsstruktur umgebaut werden, was mit erheblichen Kosten verbunden. Somit muss auf eine Simulation oder ein numerisches Verfahren zurückgriffen werden. In dieser Arbeit werden Algorithmen, zur Bewertung von konvergenten und divergenten Produktionsstrukturen aus der Literatur erläutert. Der Input ist ein Netzwerk aus Maschinen, wobei diese durch Kennzahlen zur Produktionsrate, Ausfallzeiten und Reparaturdauer beschrieben werden und die Puffer über ihre Kapazität definiert sind. Des Weiteren wird der Fokus auf der Anwendung dieser Algorithmen in der Praxis liegen, insbesondere im Vergleich zur Simulation. Dazu wird ein Algorithmus prototypisch umgesetzt. Zu Beginn der Arbeit werden die Ansätze der verschiedenen Algorithmen aus der Literatur erläutert. Im Anschluss wird die Vorgehensweise der Algorithmen erklärt, dabei wird der mathematische Hintergrund beleuchtet. Der letzte Abschnitt beschäftigt sich mit der Güte der Bewertung des implementierten Algorithmus und mit seiner Laufzeit.

Recent times have seen the rise of a research current which aims to solve classical Combinatorial Optimization (CO) problems through the help of Machine Learning (ML), and specifically in this work Deep Reinforcement Learning (RL) methods. One of the problems where these two exciting fields meet one another tackles the question of how to guide the branching process within a Branch and Bound algorithm, where sequential decisions must be done in order to reach an optimal solution. To this extent, the goal  of the current work is to gain insight of the state of the art methodologies dealing with such a problem, and through an implementation and an experimental study, to provide an comprehensive view of the impact of employing RL to aid the solving of CO problems.

Aktuell sind Klimaschutzmaßnahmen in vielen Sektoren von großem gesellschaftlichem und politischem Interesse, um den anthropogenen Treibhauseffekt einzudämmen. Der Verkehrssektor nimmt dabei eine entscheidende Rolle ein, da dieser zu den weltweit größten Verursachern von Treibhausgasen zählt. Im Rahmen der Mobilitätswende wird angestrebt, in den kommenden Jahren die bisher überwiegend verbreiteten Verbrennungsmotoren durch Fahrzeuge mit hybridem oder vollelektrischem Antrieb weitestgehend zu ersetzen. Damit einher geht der Ausbau der nötigen Ladeinfrastruktur und Entscheidungen bezüglich der Standortwahl und Größe von Ladestationen. In dieser Masterarbeit wird das Problem basierend auf dem Temporal Facility Location Problem mit Methoden der diskreten Optimierung mathematisch modelliert. Dieses stellt eine zeitliche Erweiterung des klassischen Standortproblems dar, in der Kunden jeweils nur für ein gegebenes Zeitintervall an einen Standort angebunden werden. Die neue Restriktion lautet, dass zu keinem Zeitpunkt mögliche Kapazitäten der Standorte überschritten werden dürfen. In einer detaillierten theoretischen Analyse werden zunächst verschiedene Varianten des grundlegenden deterministischen Temporal Facility Location Problems untersucht. Neben einer jeweiligen Komplexitätsanalyse werden beispielsweise Untersuchungen bezüglich der Approximierbarkeit durchgeführt sowie verschiedene mathematische Formulierungen hergeleitet und verglichen. Daraufhin werden die Probleme in ihren Online-Varianten untersucht und Resultate bezüglich der Kompetitivität vorgestellt. Anschließend werden realitätsnahe Charakteristika des Anwendungsbereichs in die Problemdefinition integriert, indem verschiedene Modifizierungen vorgenommen werden, und erneut eine detaillierte theoretische Analyse durchgeführt.

The use of machine learning methods such as artificial neural networks or clustering algorithms is becoming more and more popular in the optimization community. Connecting to this trend, we propose a method that, instead of tuning mixed-integer programming solvers' behavior, facilitates testing (modified) solver behavior. Utilizing dynamic clusterings and solving mixed-integer programs, we select and visualize different diverse subsets of the test data available in the structured integer programming library strIPlib that are just as representative but exhibit a much smaller size. The generated subsets do not only comprise a strIPlib collection and a 'general-purpose' benchmark test set, but also a method to generate completely customized, diverse experiment test sets, tailored to the experiment that is to be executed with them.

Mixed-integer programming (MIP) is a common technique to model optimization problems. They can be solved with the decomposition approach of Dantzig-Wolfe reformulation (DWR) and the branch-cut-and-price (BC&P) algorithm. Many state-of-the-art software packages for solving MIPs provide scripting interfaces to interactively model and optimize these problems. We introduce PyGCGOpt, a Python interface for the generic BC&P solver GCG. The interface allows to model MIPs, to construct and visualize decompositions, and to implement solvers for pricing problems which occur from DWR. We provide example applications of our interface and show that it interacts with the solver without a significant decline in performance.

Das klassische Job-Shop-Scheduling-Problem besteht darin, eine optimale Zuordnung anfallender Aufgaben zu bestehenden Maschinen zu finden. Die Optimalität der Lösung kann unterschiedlich definiert sein, zielt in den meisten Fällen aber auf eine möglichst schnelle und/oder kostengünstige Abwicklung ab. Die vorliegende Arbeit erweitert dieses klassische Modell gemäß einer der Praxis entlehnten Problemstellung um eine dynamische Komponente. In eine schon bestehende Lösung sollen nun neu hinzukommende Aufgaben integriert werden. Die neu entstandene Situation wird separat modelliert und hinsichtlich eines eigenen Optimalitätskriteriums betrachtet.

Dantzig-Wolfe Zerlegung ist eine bekannte Methode, mit der lineare gemischt-ganzzahlige Progamme (engl. mixed integer programs), die eine gewisse Struktur haben, umformuliert und so bessere Grenzen für den optimalen Zielfunktionswert erhalten werden können. Die Dantzig-Wolfe Zerlegung wird daher in Branch-and-Bound eingesetzt, wo die Laufzeit von der Qualität der ermittelten Grenzwerte abhängt. JuMP ist eine Modellierungsprache für mathematische Optimierungsprobleme, die in der Programmiersprache Julia eingebettet ist; Coluna ist ein Framework, das JuMP erweitert und die Anwendung einer Dantzig-Wolfe Zerlegung ermöglicht. In Coluna muss jedoch der Benutzer die Problemstruktur beschreiben, welche die Anwendung einer Dantzig-Wolfe Zerlegung ermöglicht. Wir beschreiben, wie dem Benutzer diese Aufgabe abgenommen werden kann und präsentieren unsere Implementierung einer automatischen Dantzig-Wolfe Zerlegung für Coluna. Die Automatisierung der Dantzig-Wolfe Zerlegung erfolt in zwei Schritten. Zunächst erklären wir, wie eine Menge von potentiellen Strukturen für ein gegebenes lineares gemischt-ganzzahliges Programm mithilfe der Indexmengen der Bedingungen identifiziert werden kann. Im zweiten Schritt präsentieren wir verschiedene Scores aus der Literatur, welche zum Ziel haben, die für eine Dantzig-Wolfe Zerlegung potentiell beste Struktur in einer Menge von Kandidaten zu identifizieren.

The selection of the optimal decomposition for Danzig-Wolfe reformulations presents a difficult task for a generic MIP solver. The determination of the structure of the program can contain valuable information for this process. Therefore detection algorithms are used to extract the characteristics of the MIP. In this thesis a new approach is introduced to classify the MIP as a whole, in contrast to commonly used constrain and variable classification. A graph is used to summarize and analyse the extracted features of the MIP. This graph is generalised, by estimating the sets of indices, that were used for the creation of the MIP. Afterwards can the compression with other graphs, which represent different types of MIPs, result in a categorization of the examined MIP. The implementation of this approach showed promising success, when tested with multiple different types of MIPs. For well structured MIPs, the algorithm was able to reliable detect the type of the MIPs and recommend decompositions accordingly. Problems exist in the handling of small irregularities in the MIPs or structure changed by the presolving process. Therefore, further improvements of the robustness of the algorithm could enhance the classification quality.

Visual Speech Recognition, also called lipreading, is the task of interpreting speech and predicting text by only analyzing the movements of a speaker’s mouth. Lipreading is a difficult task for both humans and computers. The field of Machine Learn and its promising sub-field Deep Learn, have proven to be successful in tackling complex problems. Recent advancements have enabled lipreading systems to use deep learn models which are trained end-to-end. This thesis describes the development of such a deep learn based lipreading system which as an end goal will aid temporarily speech impaired patients in the intensive care units of hospitals in communicating more efficiently. It approaches the problem by breaking it down into two stages which are trained separately. The first stage predicts audio features from video frames and the second stage takes the predicted audio features and predicts the spoken text. The audio data that is available can be utilized for training the system. The lipreading system that was developed using this approach was able to achieve results close to the popular baseline model LipNet. Further, the collective behavior of the two stages of the model was evaluated. The presented insights serve as valuable input for future research in the broader project to which this thesis belongs.

Aufgrund der Energiewende ist es unabdingbar, dass sich der europäische Strommarkt in den nächsten Jahren deutlich verändern wird. Um diese Veränderungen vorherzusagen und darauf zu reagieren, wird das europäische Stromnetz mittels linearer Programmierung simuliert. Diese Arbeit ist in Kooperation mit der Firma Consentec GmbH entstanden, wo entsprechende Simulationen durchgeführt werden. Der Anspruch an die Genauigkeit der Simulation ist dabei in den letzten Jahren gewachsen. Konkret sollen Stromflüsse nicht mehr alleine auf der Ebene einzelner Länder oder Zonen (NTC), sondern auf Leitungsebene (flow-based) abgebildet werden. Dabei entstehen sehr viele Nebenbedingungen, von denen jedoch die allermeisten den Lösungsraum nicht verändern. Es werden verschiedene Ideen diskutiert, wie mit diesen Nebenbedingungen umgegangen werden kann. Vor allem wird ein Ansatz präsentiert, der das Herausfiltern der relevanten Nebenbedingungen deutlich beschleunigt.

In the field of mixed-integer programming, selecting the right variables to branch on can have a huge impact on the size of the branch-and-bound (B&B) tree, and thus on the performance of the whole algorithm. Full strong branching, i.e. selecting variables by fully evaluating the child nodes that would be created for each variable, is good at building smaller trees, but is usually not used on its own in B&B, as the computational effort often outweighs the reduced tree size. Instead, it can be combined with other heuristics, resulting in some of the most successful heuristics for general problems, like hybrid pseudocost/strong branching or reliability branching. As evaluating individual nodes in branch-and-price (B&P) generally takes longer than in B&B due to column generation, both the cost of using strong branching and the benefits of having a small tree are emphasized. This potentially changes the relative performance of existing selection heuristics, and gives opportunity for new ones. One such heuristic is hierarchical strong branching, which combines other heuristics with strong branching with and without column generation in a hierarchical fashion. We extend hierarchical strong branching, and among other things combine it with hybrid pseudocost/strong branching and reliability branching. Then, we evaluate and compare the performance of various strong branching-based and several other candidate selection heuristics, both for original variable branching and Ryan-Foster branching.

Modeling production as mixed integer linear programs (MILP) allows exploiting periods of low electricity price to save variable cost. Complicating aspects such as perishable materials significantly increase solving time of such optimization problems. This in turn often leads to untapped potential in solution quality, which is why more efficient solution processes are needed. For recurring production planning, the same MILP is solved repeatedly, with only the input data changing. Yet, experience about patterns in the solution process is usually not used. In this thesis, a production planning problem with perishable intermediates is considered. It is modeled using lazy constraints, i.e. complicating inequalities are separated and added on-the-fly during the solution process. It is then shown that a deep neural network can predict violated lazy constraints with high precision leveraging experience from previously solved instances. The new model outperforms the fastest conventional model as well as the lazy method by up to 34% less solution time.

Laser Powder Bed Fusion (LPBF) is an additive manufacturing method that can create 3D objects by melting metal powder layer by layer with lasers. During this process, several aspects can be subject to optimization. First of all, it is of interest to find the optimal number and configuration of lasers for a given component. Additionally, an optimal path of the process head over the substrate area is to be determined and, lastly, the workload must be distributed to the scanners inside the process head. These problems are modelled as Mixed-Integer Programs and optimized using the Gurobi solver.

The master thesis deals with a classical optimization problem from the financial world, the interesting question of portfolio optimization for banks. It considers the tension between the fact that banks aim to maximize their interest income, but are also obliged to comply with certain regulatory requirements. On the one hand, the focus of this work was on setting up a functional conception of the optimization model as well as on the technical realization of the additional pre-processing that was developed for the optimization. On the other hand, the work includes the setting up as well as the corresponding implementation of a mathematical model based on selected regulatory metrics. A linear optimization model was set up, which includes the metrics NII (Net Interest Income), EVE (Economic Value of Equity) and NSFR (Net Stable Funding Ratio) as well as the capital ratios and the balance sheet. The work was technically supported by a provider of software products in the financial sector and the optimization was based on the result data from their standard software solution for the reporting of banks.

This thesis deals with the theoretical and practical analysis of mixed integer programs for orthogonal packing problems. The goal of the work is to study the packing problem, which is known in the literature as the Multiple Bin Size Bin Packing Problem, and to give solution algorithms. In particular, the condition that items must be placed in the packing without overlapping has caused problems in several dimensions, making it difficult or impossible to extend techniques from the one-dimensional case. For this reason, different modelling techniques for satisfying this condition are first presented on the Orthogonal Packing - and Orthogonal Knapsack subproblems and compared both theoretically and practically. It is shown that compact models based on relations provide the best practical results, although other modelling techniques such as discretisation have better theoretical properties. The techniques that are successful in practice are then extended in various ways for the multiple bin size bin packing problem and the possibilities in this respect are compared again in practice. The resulting comparison shows that the most compact models have the best practical results.

Der Nord-Ostsee-Kanal oder auch Kiel Kanal genannt ist die am meisten befahrene Wasserstraße der Welt. Der Kanal ist in beide Richtungen befahrbar, an vielen Stellen aber einspurig, was die Routenplanung zu einer komplexen, bislang von Hand ausgeführten Aufgabe macht. Ich stelle in meiner Arbeit einen funktionierenden globalen Ansatz vor, der unter den bestehenden Lösungen im Schnitt mehrere Prozentpunkte an Gesamtwartezeit für die Reedereien einsparen kann. Es werden die Auswirkungen verschiedener Formulierungen diskutiert und zudem eine problemspezifische Vorverarbeitung und Stärkungen der Formulierung präsentiert. Ein neuer Ansatz versucht, gute Praxislösungen zu generieren und kann bei zusätzlicher Wartezeit von fünf Minuten pro Schiff eine Halbierung der Routenkomplexität bewirken. Schließlich stelle ich einen erweiterten Branch-&-Price Algorithmus für die Dantzig-Wolfe Reformulierung vor, der in Tests erfolgreich die MIP-Lösung einiger Instanzen übertrifft.

The ability to predict future demand accurately is of essential importance in supply chain management. This includes the prediction of sales in retail during promotion periods, where the number of sales differs greatly compared to non-promotion periods. The goal of this master thesis is to increase the accuracy of stock keeping unit (SKU) sales prediction models during promotion periods in a retail setting. Different promotional factors, together with interaction effects between different articles on promotion and consequences of the COVID-19 pandemic are analysed to achieve this goal. This introduces challenges in the form of high dimensionality and sparsity, which are met with a multiple linear regression model. Besides an accurate prediction, which is achieved by the incorporation of these features, this model allows to draw conclusions about causal relations between the influencing factors and the number of sales. The model is applied to data provide by a Dutch supermarket to evaluate its performance.

Location planning over a time horizon is a common task and therefore needs efficient solving methods. Experiments with temporal extensions to related problems indicate that branch-and-price algorithms might also be suitable for solving the temporal facility location problem (TFLP). This is supported by the reproduction of the results of two papers with related temporal problems, namely the temporal bin packing problem and the temporal knapsack problem. The knowledge obtained from these results is then used to create several TFLP instances with different parameter scenarios. The reproduction as well as the solving of the TFLP instances is performed with GCG and SCIP as branch-and-price and general-purpose solver respectively. In the experiments conducted in this thesis the instance parameter that has the biggest influence on the solving times is the opening cost, but having uncapacitated or capacitated facilities is another important factor. Comparing the results of GCG and SCIP on these scenarios leads to the conclusion that in most cases the general-purpose solver SCIP is the faster alternative. The branch-and-price solver GCG is useful for large instances with expensive opening cost and useful for some instances when the facilities are uncapacitated.

Machine learning methods and deep learning in particular have seen many use-cases for almost every domain in the last couple of years now. Among those is the domain of discrete optimization. In discrete optimization machine learning has been applied to heuristically improve some algorithms. Since similar models in discrete optimization can also be handled or processed similarly, we will utilize Graph Convolutional Network (GCN) to predict which problem class a Mixed Integer Programm (MIP) belongs to, such that suitable algorithm can be applied to a model. To be exact, the natural variable-constraint bipartite graph representation of MIPs is utilized to train a GCN in the task of classification. The trained GCN will additionally be able to represent any MIP by a fixed size feature vector, which can be used to calculate how similar different MIPs are to each other. The process of training the GCN will be documented and our final model will be evaluated by comparing its performance to its competition. In addition to this, some experiments will be conducted to get a better understanding of which features and which parts of the networks are important for good classification results.

In this bachelor thesis the optimasation of the airplane boarding process is investigated. Given is a set of cabin layouts and a set of passengers with different movement speeds and amounts of carry-on luggage. To improve the overall boarding time each seat has to be assigned to a passanger and each carry-on luggage space to a luggage. The passanger satisfaction sets further requirements to the boarding process. The assignment problem is formulated as a mixed integer problem (MIP) and differentiates itself from previous works by the direct optimisation of the overall boarding time, in combination with different numbers of carry-on luggage per passanger such as limitaions of the carry-on luggage space. To investigate the assignment problem, the formulated mathematical model such as developed heuristics are implemented. The experiments with different calculations show a strong correlation between the overall boarding time and the amount of carry-on luggage to stow in the carry-on luggage space in the airplane cabin. The best solution is achieved using the heuristic \(H_{wtw}^{v2}), giving excellent boarding times in addition to a high amount of stowed carry-on luggage reaching close to maximum values.

Emissionsfreie Mobilität gewinnt immer mehr an Wichtigkeit. Für diese sind Elektrofahrzeuge unabdingbar, dadurch entstehen neue Fragen und Herausforderungen. Das iMove Projekt beschäftigt sich unter anderem mit dem „balancierten Ladeproblem (BCP)“. Hierbei wird eine Plattform entwickelt, die die Ladevorgänge von Elektrofahrzeugen optimal den Ladesäulen des Elektrische Netzes zuweisen soll. Optimalität ist bei diesem Problem zweigeteilt. Auf der einen Seite sollen die Wünsche der Elektrofahrzeugfahrer erfüllt werden. Auf der anderen Seite soll die Last auf das Elektrische Netz möglichst ausgeglichen bleiben. Hierfür wurde ein MIP entwickelt. Diese Masterarbeit beschäftigt sich mit dem Problem, dass die Elektrofahrzeugfahrer möglicherweise die Zuweisung zu einer Ladesäule der Plattform ignorieren und dieser nicht folgen. Während robuste Ansätze für diese Art der Unsicherheit nicht optimal geeignet scheinen, stellt es sich heraus das Online Ansätze eine gute Alternative bieten mit abweichenden Fahrern umzugehen. Die beste Güte erzielen Online Ansätze mit Unterstützung der Offline-Lösungen. Das Online-BCP ermöglicht es trotz abweichender Fahrer eine zulässige Lösung zu finden, allerdings zeigt sich, dass die Güte des Online-BCP noch ausbaufähig ist.

The currently ongoing energy transition increases the share of renewable energies in the electricity mix. In Germany, this is covered in particular by wind and solar energy, which are considered volatile. Since a stable power grid must guarantee a balance between the electricity produced and the electricity demanded at all times, this development presents new challenges for electricity suppliers and grid operators. One approach to counteract the fluctuation in the energy supply network is demand-side management (DSM). DSM refers to the management of demand for network-based services by customers in industry, trade and private households. Electricity suppliers benefit from DSM by increasing the reliability of supply, while electricity consumers can reduce their energy costs benefiting from financial incentives. This Master's thesis investigates, with regard to demand-side management, how optimized production planning can reduce the energy costs of a general energy-intensive production process. For this purpose, a mixed-integer linear model is developed and set up. In particular, two new possibilities for cost reduction will be modeled: on the one hand, the exploitation of volatile electricity prices by load redistribution, on the other hand, the provision of balancing power. In production planning, the various framework conditions of the production process and uncertainties in some model parameters, such as the demand for balancing power, must be taken into account. Therefore, methods from the field of robust optimization are applied as a solution for the optimization problem.

With an increasing number of man-made objects in space, the area around earth is getting increasingly polluted. Due to the chance of collisions, orbiting debris puts future missions at risk. The Kessler syndrome projects a cascading amount of debris collisions that result in an exponential increase of debris pieces. In order to avoid a catastrophic scenario, space agencies such as the European Space Agency propose missions for an active removal of space debris. Depending on the removal method, one mission aims to remove multiple debris objects. Thus, during the mission design, a combinatorial problem needs to be solved deciding the selection of debris objects and the order of space rendezvous. The problem setup shares similarities with a variant of the traveling salesman problem with city selection. The goal is to maximize the profit of the visited cities with a limited traveling budget. Since the debris orbits are exposed to perturbations, it is assumed that the costs of traveling between the objects are likely to change over time. This thesis will explore various mixed integer problem formulations for both constant costs and dynamic costs over time. For the static case, we are able to find optimal routes even for bigger debris clouds of more than 2000 objects. The proposed formulations for the dynamic case are able to solve large instances, when carefully selecting the time parameters. Moreover, we have implemented a genetic algorithm to further explore the solution space.

In this thesis, we investigate possible optimisations of the aeroplane boarding process. To accomplish this, we define and mathematically model the process, formulate it as a minimisation problem, and propose a solution procedure. We show that the problem is computationally hard in a theoretical sense and investigate the quality of heuristic approaches as well as some of its online properties.

The boarding process is of particular interest for airlines to improve profitability as well as customer satisfaction. Since boarding policy changes pose a lower implementation barrier than buying new planes or making changes to existing infrastructure, advances in aeroplane boarding research have the potential to positively impact customers and airlines relatively immediately.

This thesis aims to evaluate the boundaries of neural network training using
mixed-integer optimization. Neural networks are a powerful machine learn-
ing technique that is able to classify data non-linearly. This technique is
applied to a lot of different tasks. However, traditional approaches to neural
network training can get stuck in local minima, while algorithms exist that
solve a mixed-integer optimization problem optimally. The goal of this thesis
in the context of mixed-integer programming. We start by showing which
kind of activation functions can be expressed by a mixed-integer program
(MIP). After that variants of neural network training using mixed-integer
programming are presented and it is shown which activation functions can
be incorporated into these variants. Finally, we use a blackbox-solver to ap-
ply the resulting models to the parity function and evaluate the performance
of our approaches.

We introduce an optimization problem on graphs called Connected Vertex Clustering Problem (CVCP). The input consists of a finite graph, arbitrary linear constraints to restrict the set of feasible clusters and a linear objective function. The expected solution is a vertex clustering that optimizes the objective under the condition that each cluster induces a connected subgraph and satisfies the custom constraints. Besides partitional clustering, i.e., node partitioning, the solution may also be restricted to packings or coverings of nodes. We show that this highly configurable problem is NP-hard and propose a branch-and-price method as a solution approach. The suggested method is implemented as a framework which is capable of solving arbitrary CVCP instances. The framework can easily be extended with new features due to its plug-in architecture. This allows to exploit the characteristics of specific variants of the CVCP in order to enhance the efficiency of the solution process. We evaluate the developed framework on a districting problem for the German federal elections and on the Odd Cycle Packing Problem.

This thesis’ target is to develop an algorithm which clusters the vertices of a graph into different clusters. Said graph is going to be derived from a logistical problem dealing with vehicle transportation. The goal is based on the idea of partitioning the database of a Multi Commodity Flow problem into several smaller problems that can be solved individually. Those smaller problem units are formed by the generated clusters and by the edges connecting two vertices that have been associated with different clusters. By applying this process to the Multi Commodity Flow problem one is hopefully able to reduce the overall runtime of the problem-solving process. Hence, this thesis is first reviewing existing clustering methods which are currently being discussed. Those methods are then being assessed in terms of their applicability to this thesis’ problem. Afterwards, suitable methods are being chosen to develop a fitting algorithm based on the chosen approaches. This algorithm is going to be tested on different instances of the mentioned problem and the resulting outputs are going to be evaluated.

The Energy Minimizing Vehicle Routing Problem (EMVRP) introduced by Kara and Yetis in 2007 is an extended version of the traditional Vehicle Routing Problem of transportation logistics. In this thesis we consider different algorithms, which heuristically solve the EMVRP in reasonable computation time. This thesis also includes a comparison between the proposed heuristics, which lays out the advantages and disadvantages of each one using different sets of test instances.

Dantzig-Wolfe (DW) reformulation is a well-known approach to produce strong dual bounds for Mixed-Integer Programs (MIPs). If a MIP has a special structure which can be exploited well by a DW reformulation the solver could be much faster on the reformulated model than on the original. Otherwise the solver may fail completely. Providing a strong DW reformulation typically requires enhanced knowledge about the underlying model structure of the MIP which makes an automatic reformulation without such knowledge difficult. Despite this problem there have been several approaches proposed which implement such an automatic DW reformulation process into a state-of the-art MIP solver, especially the Generic Column Generation (GCG) framework [1]. In such frameworks the detection of a decomposition that exploits the underlying model structure is one of the most important aspects. GCG for example uses different detectors that use heuristics and clustering algorithms to generate a set of possible decompositions. Recently supervised learning algorithms have been applied by Kruber et al. [2] to decide if a reformulation of the model should be solved (and also which if several have been detected) or if the original model should better be solved by a standard solver. These first promising results showed that machine learning could be a useful support in this decision process. Besides this single question there might be other decisions in the entire process that could also potentially benefit by the use of supervised machine learning.

The bachelor thesis deals with solving multi-commodity flow problems. These kinds of problems occur in different everyday situations. For example, the transport of goods in distribution networks or the movement of messages in communication networks. In addition to the considerable size of these flow problems, which often occurs, there can be further complicating constraints on nodes, edges, or goods. In the context of the work, an alternative solution approach for minimal-cost multi-commodity flow problems, which is based for the most part on the computation of k-shortest paths, is developed. Based on optimally solved single-sink single-source single-commodity flow sub-problems, whose accumulated solutions are usually an inadmissible solution of the multi-commodity flow, the developed solution approach tries to obtain a feasible solution by rerouting the flow of edges that are infeasible in the original problem. The developed approach will be evaluated in a feasibility study based on a real use case, which is a time-expanded distribution network of an automobile manufacturer with limitations on edges and goods.

In automotive industry long delivery periods and the Just-In-Time production yield to an inflexible production plan for several weeks. At the same time the exact prediction of incoming customer orders is nearly impossible due to mass customization. However, mass customization is a core concept of automotive industry. In combination with time consumption requirements these conditions generate a challenging problem in practice. This thesis is about presenting an algorithm, where mixed integer programming is used to reduce the average waiting period for an ordered car. Based on an existing production schedule the algorithm is able to determine an optimal rescheduling with respect to restrictions in warehousing and customer preferences to guarantee the earliest possible delivery date.

This thesis is about implementing an algorithm that develops an assignement of rooms to students/teachers of the Humboldt Gymnasium Solingen. The goal is among others to rent as few rooms as possible. Additional constraints are: - Each student is assigned to one hotel and one room. - Both girls and boys as well as students and teachers are in separate rooms. - As in most years five classes are assigned to four hotels, at least one class is divided among hotels. In this case, the class shall not be divided among more than two hotels. In addition, the class which gets divided is sometimes identified beforehand. - Most rooms can be furnished with additional beds. Although the overall number of rooms is minimized, the rooms shall not be too crowded. In the end, the user shall be able to read in data, express preference (e.g. about which class to divide) and obtain the room assignment in a clear format. Programming skills in C/C++ are required.

The consecutive dinner problem describes the problem of finding routes and differing groupes for each participating team. A team's route must contain exactly three stops: one at the appetizer, one at the main course and one at the dessert. Furthermore, the team itself must prepare one of the three courses of its own route. Each group that is formed at a course must consist of three teams that have not already / will not again meet at another course. Each team has the possibility to name a course they would like to prepare. The objective function minimizes the distance all teams have to travel between their courses as well as maximizes the number of teams that get their favorite course.
Further extensions to this model can include a differentiation by age and/or gender to obtain a more diverse/equal group set-up. Also the number of previously participated dinners might be taken into consideration.

The student will develop an integer program that solves the consecutive dinner problem as well as implement the program. Real life instances will be provided to test the IP. Therefore, the student must know how to develop a mathematical program as well as how to implement IPs in C/C++ or Java.

In this Master Thesis we consider the problem of covering rectilinear polygons by the
minimum number of axis-parallel rectangles. This problem finds applications in the
fabrication of DNA chip arrays [Hannenhalli et al. 2002], in VLSI design, where the
rectilinear polygon is a chip that has to be covered by a huge number of rectangular
transistors.
Other applications are data compression and in particular image compression, where
large rectangular areas with the same color can be compressed into one pixel.

This work evaluates whether optimization problems resulting from modelling the optimal synthesis, design and operation of a decentralized energy supply system have an embedded structure which can be exploited by decomposition methods in solution algorithms. The objective is to determine if the the accuracy and/or the problem size in terms of number of periods of time and number of units considered may be increased, as these are limited if the branch-and-bound method combined with the simplex method is used to solve the problems. A model of the problem is formulated as a mixed-integer linear program as proposed by Yokoyama et al. (2002) and Voll (2013). The model is analyzed and two embedded structures suitable for decomposition are identified.

The first structure emphasizes the independent operation and design of every component. The second structure emphasizes the design and operation of all components and focuses on the independence of every period of time considered. The model is reformulated using the Dantzig-Wolfe decomposition principle for both proposed embedded structures. A numerical study is conducted where the synthesis, design and operation of a fictional energy supply system is optimized by both the branch-and-bound method combined with the simplex method and by the branch-and-price method. A set of instances is created for different degrees of complexity in terms of the number of units and the number of periods of time considered.

The results show that the dual bounds obtained by solving the rootnode LP relaxation can be improved in comparison to the conventional solution approach, if the reformulation emphasizing independent components is utilized. The results provide no evidence on improvements on the considered test set for the reformulation emphasizing design and operation. For the case of an optimal solution computing times required to solve the considered instances of a test set are found to be reduced by utilizing the branch-and-price method and the reformulation emphasizing components, if identical components are considered in the energy supply system in comparison to the non-commercial solver SCIP.

The Steiner tree packing problem is a long studied problem in combinato-
rial optimization. In contrast to many other problems, where an enormous
progress has been made in the practical problem solving, the Steiner tree
packing problem remains very difficult. Most heuristics schemes are ineffec-
tive and even finding feasible solutions is already NP -hard. What makes this
problem special, is that in order to reach an overall optimal solution non-
optimal solutions to the underlying NP -hard Steiner tree problems must be
used. Any non-global approach to the Steiner tree packing problem is likely
to fail. Integer programming is currently the best approach for computing
optimal solutions.
The goal of this master thesis is to give a survey of models relating to the
Steiner tree packing problem from the literature. In addition, a closer look
at a model for the switchbox routing problem in VLSI-Design will be given.

When reformulating a given mixed integer program by the use of classical Dantzig-Wolfe decomposition, a subset of the constraints is partially convexified, which corresponds to implicitly adding all valid inequalities for the associated integer hull. Since these inequalities are not known, a solution of the original linear programming (LP) relaxation which is obtained by transferring an optimal basic solution of the reformulated LP relaxation is in general not basic. Hence, cutting planes which are separated using a basis like Gomory mixed integer cuts are usually not directly applicable when separating such a solution.

Nevertheless, we can use some crossover method in order to obtain a basic solution which is nearby the considered non-basic solution and generate cutting planes for the basic solution using its basis information. These cutting planes might also the solution we originally wanted to separate. So far, this problem was only considered extensively by Range, who proposed the previously described approach including a particular crossover method. We present a modified crossover method and extend this procedure by considering additional valid inequalities strengthening the original LP relaxation. Furthermore, we provide the first full implementation of a separator like this and tested it on instances of several problem classes.