Sökning: "First-Order Optimization"

Visar resultat 1 - 5 av 47 avhandlingar innehållade orden First-Order Optimization.

1. 1. Efficient and Flexible First-Order Optimization Algorithms

   Författare :Hamed Sadeghi; Institutionen för reglerteknik; []
   Nyckelord :TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; NATURVETENSKAP; NATURAL SCIENCES; NATURVETENSKAP; NATURAL SCIENCES; Monotone Inclusion; Convex Optimization; First-Order Methods; Fixed-Point Iterations; Forward–Backward Splitting; Primal–Dual Algorithm;

   Sammanfattning : Optimization problems occur in many areas in science and engineering. When the optimization problem at hand is of large-scale, the computational cost of the optimization algorithm is a main concern. LÄS MER

3. 2. First-Order Algorithms for Communication Efficient Distributed Learning

   Författare :Sarit Khirirat; Mikael Johansson; Martin Jaggi; KTH; []
   Nyckelord :TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; Communication efficient learning; Optimization algorithms; Quantization; Error compensation; First-order algorithms; Stochastic gradient descent; Tillämpad matematik och beräkningsmatematik; Applied and Computational Mathematics; Optimeringslära och systemteori; Optimization and Systems Theory; Electrical Engineering; Elektro- och systemteknik;

   Sammanfattning : Technological developments in devices and storages have made large volumes of data collections more accessible than ever. This transformation leads to optimization problems with massive data in both volume and dimension. LÄS MER

4. 3. First-Order Algorithms for Communication Efficient Distributed Learning

   Författare :Sarit Khirirat; Mikael Johansson; Tong Zhang; KTH; []
   Nyckelord :TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; Communication efficient learning; Optimization algorithms; Quantization; Error compensation; First-order algorithms; Stochastic gradient descent; Electrical Engineering; Elektro- och systemteknik;

   Sammanfattning : Innovations in numerical optimization, statistics and high performance computing have enabled tremendous advances in machine learning algorithms, fuelling applications from natural language processing to autonomous driving.To deal with increasing data volumes, and to keep the training times of increasingly complex machine learning models reasonable, modern optimization algorithms distribute both data and computations over a large number of machines. LÄS MER

5. 4. Asynchronous First-Order Algorithms for Large-Scale Optimization : Analysis and Implementation

   Författare :Arda Aytekin; Mikael Johansson; Lin Xiao; KTH; []
   Nyckelord :TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; convex; optimization; asynchronous; algorithms; parallel; distributed; large-scale; big data; software; serverless; Electrical Engineering; Elektro- och systemteknik;

   Sammanfattning : Developments in communication and data storage technologies have made large-scale data collection more accessible than ever. The transformation of this data into insight or decisions typically involves solving numerical optimization problems. LÄS MER

7. 5. Accelerating Convergence of Large-scale Optimization Algorithms

   Författare :Euhanna Ghadimi; Mikael Johansson; Angelia Nedich; KTH; []
   Nyckelord :TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; TEKNIK OCH TEKNOLOGIER; ENGINEERING AND TECHNOLOGY; Convex optimization; Large-scale systems; First-order methods; Convergence analysis; ADMM; Optimization algorithms; Electrical Engineering; Elektro- och systemteknik; Matematik; Mathematics;

   Sammanfattning : Several recent engineering applications in multi-agent systems, communication networks, and machine learning deal with decision problems that can be formulated as optimization problems. For many of these problems, new constraints limit the usefulness of traditional optimization algorithms. LÄS MER