| [B2] |
S. Adly. Accelerated First-Order Optimization in Discrete and Continuous Time, Book in preparation, 680 pages (2026). Abstract
Abstract: This book develops a unified study of accelerated first-order optimization methods and their continuous-time counterparts in real Hilbert spaces. Its central idea rests on a bidirectional dialogue between discrete algorithms and continuous-time dynamics. The discrete algorithms studied in the book are associated with continuous dynamical systems. The latter models reveal Lyapunov energies, geometric mechanisms, mechanical interpretations, stability regimes, and parameter choices that refine the analysis of the algorithms.
In twelve chapters, the book covers Cauchy's method of descent, gradient flow and gradient descent, then Polyak's momentum and the heavy-ball with friction, Nesterov accelerated gradient, and the asymptotic vanishing damping dynamics (of Su-Boyd-Candès), high- and super-resolution models, and exact continuous-discrete correspondences. It then examines composite optimization, proximal algorithms, and nonsmooth dynamics with dry friction and finite-time stabilization. A recurring question concerns the true origin of acceleration, as opposed to a simple change in time scale.
Historical perspective, geometric and mechanical intuitions, examples, illustrations, and bibliographic references are integrated into the mathematical development. Each technical chapter includes ten progressive exercises, accompanied by final answers, structured hints, or complete solutions. This book is intended for Master's and doctoral students, as well as researchers in optimization, applied mathematics, dynamical systems, control, and the mathematical foundations of machine learning.
|
| [P4] |
S. Adly. A Discrete Newton-like Forward-Backward Inertial Method for Structured Monotone Inclusions. Submitted in March 2026. Abstract
Abstract: In a Hilbert space setting, we study a class of first-order algorithms which aim to solve structured monotone inclusions involving the sum of two operators. Precisely, we are looking for the zeros of two operators $A +B $, where $A$ is a maximally monotone operator (possibly set-valued), and $B$ is a cocoercive operator. Our study is based on the inertial autonomous continuous dynamic (DINAM) previously studied, which involves a Newton-type correction term attached to the associated forward-backward residual operator. This correction coincides with the hessian-driven damping in the case of a potential operator and is useful to attenuate the oscillations which occur in the inertial methods with viscous damping. We consider first a general framework based on cocoercive operators. In this context, we introduce the discrete inertial algorithm (D-DINAM) and we establish its appropriate adapted discrete Lyapounov's analysis. This approach permits us to obtain the decreasing of the appropriate associated discrete energy, summability properties, asymptotic regularity of the iterates, the weak convergence of the sequence towards a solution of the problem. We also obtained an ergodic and best-iterate residual bounds as well as strong convergence under the strong monotonicity assumption. In addition, we prove a finite-horizon consistency result between (D-DINAM) and (DINAM), with first-order accuracy as the time step vanishes. This analysis is then applied to the residual forward-backward operator associated with $A$ and $B$ to treat the additively structured monotone inclusion mentioned above. We illustrate the behavior of the inertial algorithm (D-DINAM) on four examples. The first model is a simple two dimensional saddle-type example, where we show that the continuous and the discrete models are consistent. The second model is an oscillatory two-dimensional example, where the practical role of the parameter $\beta$ and its effect on the attenuation of the oscillations phenomena known in inertial algorithms is highlighted. The third model is a finite-dimensional least-squares problem with an operator perturbation, where we show that for suitable choices of the involved parameters, (D-DINAM) can outperform the standard forward-backward algorithm. The fourth model is an unilateral contact problem in mechanics with a transport perturbation. We show that (D-DINAM) reproduces the expected behavior, and for certain choice of the involved parameters, it outperforms the standard forward-backward algorithm on the considered example.
|
| [P7] |
S. Adly. Support profiles of full-capacity Pareto spectra of order three. Submitted in July 2026. Abstract
Abstract: For a given real matrix $A\in\mathbb{R}^{n\times n}$ of order $n\geq 1$, a Pareto eigenvalue is a scalar $\lambda\in\mathbb{R}$ for which there exists a nonzero vector $x\in\mathbb{R}^n_+$ such that $Ax-\lambda x\in\mathbb{R}^n_+$ and $\langle x,Ax-\lambda x\rangle=0$. It is known that a real matrix of order $n=3$ can have at most $9$ distinct Pareto eigenvalues. We study the matrices for which this maximal number is attained and classify the way in which the $9$ Pareto eigenvalues are produced by their supports. A Pareto eigenvalue may be produced by more than one support. We therefore choose one producing support for each distinct value. The main contribution of this paper is to prove that, for every such choice, the numbers of values assigned to supports of sizes $1$, $2$, and $3$ are necessarily $$ (1,5,3),\qquad (2,4,3),\qquad\text{or}\qquad (2,5,2). $$ The proof uses bounds from the order $n=2$ problem and several restrictions on singleton, pair, and full supports. In particular, the graph formed by the pair supports producing $2$ values contains no triangle. These arguments also give another proof that the maximum Pareto capacity in order $3$ is equal to $9$. For each of the $3$ profiles, we give an explicit full-capacity matrix with $9$ regular Pareto eigenvalues. We also prove that each profile occurs on a nonempty Euclidean-open set where every Pareto eigenvalue has a unique producing support.
|
| [J116] |
S. Adly, Nguyen Nang Thieu and Nguyen Dong Yen. Noncoercive Convex Sweeping Processes with Velocity Constraints. Optimization 75 (2026), no. 4, 793–812. Online here. Abstract
Abstract: In this paper, we investigate noncoercive monotone convex sweeping processes with velocity constraints, a topic not previously investigated. Using some fundamental results on Bochner integration, the Tikhonov regularization method, a solution existence result for coercive convex sweeping processes with velocity constraints and a useful fact on measurable single-valued mappings, we prove the solution existence and properties of the solution set of noncoercive convex sweeping processes with velocity constraints under suitable conditions. These results represent a significant contribution, addressing a specific aspect of an open question posed in our recent work [S.~Adly, N.~N.~Thieu, N.~D.~Yen, Convex and nonconvex sweeping processes with velocity constraints: well-posedness and insights, Appl. Math. Optim., 88 (2023), Paper No. 45]. Additionally, we resolve two other open questions from the same paper concerning the behavior of the regularized trajectories, relying on the Dominated Convergence Theorem for Bochner integration.
|
| [J119] |
S. Adly, H. Attouch and J. M. Fadili. Comparative Analysis of Accelerated Gradient Algorithms for Convex Optimization: High and Super Resolution ODE Approach. Optimization (2024), published online. Online here. Abstract
Abstract: We investigate convex differentiable optimization and explore the temporal discretization of damped inertial dynamics driven by the gradient of the objective function. This leads to three accelerated gradient algorithms: Nesterov Accelerated Gradient (NAG), Ravine Accelerated Gradient (RAG), and (IGAHD). Attouch, Chbani, Fadili, and Riahi introduced (IGAHD) by discretizing inertial dynamics with Hessian-driven damping to attenuate inherent oscillations in inertial methods. By analyzing the high-resolution ODEs of order $p=0,1,2$ for these algorithms, we gain insights into their similarities and differences. All three algorithms share the same low-resolution ODE of order $0$, which is the dynamic proposed by Su, Boyd, and Cand\`es as a continuous surrogate for (NAG). To differentiate Nesterov from Ravine, we refine the comparison and demonstrate distinct high-resolution ODEs of order $2$ in $h$ (termed super-resolution). The corresponding Taylor expansions in $h$ reveal matching terms of order $1$ but differing terms of order $2$. To the best of our knowledge, this result is completely new and emphasizes the need to avoid confusion between the Ravine and Nesterov methods in the literature. We present numerical experiments to illustrate our theoretical results. Performance profiles, measuring the number of iterations, indicate that (IGAHD) outperforms both (NAG) and (RAG) methods. (RAG) exhibits a slight advantage over (NAG) in terms of the average number of iterations. When considering CPU-time, both (RAG) and (NAG) outperform (IGAHD). All three algorithms exhibit similar behavior when evaluating based on gradient norms.
|
| [J115] |
S. Adly and H. Attouch. Complexity analysis based on tuning the viscosity parameter of the Su-Boyd-Candès inertial gradient dynamics, Set-valued and Variational Analysis 32 (2024), no. 2, Paper No. 17, 27 pp. Abstract
Abstract: In a Hilbert setting, our study focuses on the dynamical system introduced by Su-Boyd-Cand\`es as a low-resolution ODE of Nesterov's accelerated gradient method (NAG). This inertial system, denoted by ${\rm (AVD)}_{\alpha}$, is driven by the gradient of the function $f$ to be minimized, and is damped with an asymptotically vanishing coefficient of the form $\alpha/t$, with $\alpha\geq 3$. Taking $\alpha$ large enough plays a crucial role in the asymptotic convergence properties of the trajectories. For a general convex function $f$, taking $\alpha >3$ guarantees the asymptotic convergence rate of the values $o \left( 1/t^2 \right)$, as well as the convergence of the trajectories towards optimal solutions. For strongly convex $f$, the asymptotic rate of convergence is of order $ 1/t^{\frac{2\alpha}{3}} $, which increases with $\alpha$. To analyze the effect of the parameter $\alpha$ on the convergence properties of ${\rm (AVD)}_{\alpha}$, we show that a judicious time scaling of ${\rm (AVD)}_{\alpha}$ produces trajectories close to those of the continuous steepest descent method associated with $f$ when $\alpha$ is sufficiently large. This limiting process involves a singular perturbation property, as we move from a second-order evolution equation to a first-order one. This transition enables us to understand the change in the rate of convergence from $1/t$ to $1/t^2$ between the steepest descent method and (NAG). Based on a complexity analysis over a finite time interval, new results are obtained regarding the optimal tuning of the parameter $\alpha$ and the involved constants $C_\alpha$ in the estimations. Numerical experiments have been conducted to illustrate and confirm the theoretical results.
|
| [J114] |
S. Adly, H. Attouch and Manh Hung Le. A doubly nonlinear evolution system with threshold effects associated with dry friction, Journal of Optimization Theory and Applications (JOTA) 203 (2024), no. 2, 1188–1218. Abstract
Abstract: In this paper, we investigate the asymptotic behavior of inertial dynamics with dry friction within the context of a Hilbert framework for convex differentiable optimization. Our study focuses on a doubly nonlinear first-order evolution inclusion that encompasses two potentials. {In our analysis, we specifically focus on two main components: the differentiable function $f$ that needs to be minimized, which influences the system's state through its gradient, and the nonsmooth dry friction potential denoted as$\varphi = r\|\cdot\|$. It's important to note that the dry friction term acts on a linear combination of the velocity vector and the gradient of $f$. Consequently, any stationary point in our system corresponds to a critical point of $f$, unlike the case where only the velocity vector is involved in the dry friction term, resulting in an approximate critical point of $f$}. To emphasize the crucial role of $\nabla f(x)$, we also explore the dual formulation of this dynamic, which possesses a Riemannian gradient structure. To address these dynamics, we employ the recently developed generic acceleration approach by Attouch, Bot, and Nguyen. {This approach involves the time scaling of a continuous first-order differential equation, followed by the application of the method of averaging}. By applying this methodology, we derive fast convergence results for second-order time-evolution systems with dry friction, asymptotically vanishing viscous damping, and implicit Hessian-driven damping.
|
| [J110] |
S. Adly and H. Attouch. Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations, Nonlinear Analysis: Hybrid Systems 50 (2023), 101402. Abstract
Abstract: In a Hilbert framework, for convex differentiable optimization, we analyze the long-time behavior of inertial dynamics with dry friction. In classical approaches based on asymptotically vanishing viscous damping (in accordance with Nesterov's method), the results are expressed in terms of rapid convergence of the values of the function to its minimum value. On the other hand, dry friction induces convergence towards an approximate minimizer, typically the system stops at $x$ when a given threshold $\| \nabla f (x)\| \leq r$ is satisfied. We will obtain rapid convergence results in this direction. In our approach, we start from a doubly nonlinear first-order evolution equation involving two potentials: one is the differentiable function $f$ to be minimized, which acts on the state of the system via its gradient, and the other is the nonsmooth potential dry friction $\varphi (x) =r \|x\|$ which acts on the velocity vector via its sub-differential. To highlight the central role played by $ \nabla f (x)$, we will also argue with the dual formulation of this dynamics, which has a Riemannian gradient structure. We then rely on the general acceleration method recently developed by Attouch, Bot and Nguyen, which consists in applying the method of time scaling and then averaging to a continuous differential equation of the first order in time. We thus obtain fast convergence results for second-order time-evolution systems involving dry friction, asymptotically vanishing viscous damping, and Hessian-driven damping in the implicit form.
|
| [J106] |
S. Adly, H. Attouch and R.T. Rockafellar. Preservation or not of the maximally monotone property by graph-convergence, Journal of Convex Analysis, Vol. 30, No. 2, pp 413-440 (2023). Abstract
Abstract: In a general real Hilbert space $H$, given a sequence $(A_n)_{n\in\mathbb{N}}$ of maximally monotone operators $A_n: H \rightrightarrows H$, which graphically converges to an operator $A$ whose domain is nonempty, we analyze if the limit operator $A$ is still maximally monotone. This question is justified by the fact that, as we show on an example in infinite dimension, the graph limit in the sense of Painlev\'e-Kuratowski of a sequence of maximally monotone operators may not be maximally monotone. Indeed, the answer depends on the type of graph convergence which is considered. In the case of the Painlev\'e-Kuratowski convergence, we give a positive answer under a local compactness assumption on the graphs of the operators $A_n$. Under this assumption, the sequence $(A_n)_{n\in\mathbb{N}}$ turns out to be convergent for the bounded Hausdorff topology. Inspired by this result, we show that, more generally, when the sequence $(A_n)_{n\in\mathbb{N}}$ of maximally monotone operators converges for the bounded Hausdorff topology to an operator whose domain is nonempty, then the limit is still maximally monotone. The answer to these questions plays a crucial role in the analysis of the sensitivity of monotone variational inclusions, and makes it possible to understand these questions in a unified way thanks to the concept of protodifferentiability. It also leads to revisit several notions which are based on the convergence of sequences of maximally monotone operators, in particular the notion of variational sum of maximally monotone operators.
|
| [J100] |
S. Adly, Huynh Van Ngai and Van Vu Nguyen. Dennis-Moré condition for set-valued vector fields and the superlinear convergence of Broyden updates in Riemannian manifolds, Journal of Convex Analysis 29, No. 3, (2022). Abstract
Abstract: This paper deals with the quasi-Newton type scheme for solving generalized equations involving point-to-set vector fields on Riemannian manifolds. We establish some conditions ensuring the superlinear convergence for the iterative sequence which approximates a solution of the generalized equations. Such conditions can be viewed as an extension of the classical Dennis-Moré theorem in [1] as well as the Riemannian Dennis-Moré condition established in the work [2]. Furthermore, we also apply these results to consider the convergence of a Broyden-type update for the problem of solving generalized equations in Riemannian context. Our results are new even for classical equations defined by single-valued vector fields.
[1] J. E. Dennis and J.J. Moré, A characterization of superlinear convergence and its application to quasi-Newton methods, Mathematics of Computation, 28 (1974), pp. 549--560.
[2] K.A. Gallivan, C.Qi, and P.-A. Absil}, High-Performance Scientific Computing: Algorithms and Applications, Springer London, 2012, ch. A Riemannian Dennis-Moré Condition, pp.281--293.
|
| [J99] |
S. Adly and H. Attouch. First-order inertial algorithms involving dry friction damping, Mathematical Programming Series A, 193 (2022), no. 1, Ser. A, 405–445. Online here. Abstract
Abstract: In a Hilbert space $H$, based on inertial dynamics with dry friction damping, we introduce a new class of proximal-gradient algorithms with finite convergence properties. The function $f:H \to \mathbb{R}$ to minimize is supposed to be differentiable (not necessarily convex), and enters the algorithm via its gradient. The dry friction damping function $\phi: H \to \mathbb{R}_+$ is convex with a sharp minimum at the origin, (typically $\phi(x) = r \|x\|$ with $r>0$). It enters the algorithm via its proximal mapping, which acts as a soft threshold operator on the velocities. This algorithm naturally occurs as a discrete temporal version of an inertial differential inclusion involving viscous and dry friction together. The convergence results tolerate the presence of errors, under the sole assumption of their asymptotic convergence to zero. Then, replacing the potential function $f$ by its Moreau envelope, we extend the results to the case of a nonsmooth convex function $f$. In this case, the algorithm involves the proximal operators of $f$ and $\phi$ separately. Several variants of this algorithm are considered, including the case of the Nesterov accelerated gradient method. We then consider the extension in the case of additive composite optimization, thus leading to new splitting methods. Numerical experiments are given for Lasso-type problems. The performance profiles, as a comparison tool, highlight the effectiveness of two variants of the Nesterov accelerated method with dry friction.
|
| [J94] |
S. Adly and H. Attouch. Finite time stabilization of continuous inertial dynamics combining dry friction with Hessian-driven damping, Journal of Convex Analysis, Vol. 28, no. 2, 281-310, (2021). Abstract
Abstract: In a Hilbert space $\mathcal{H}$, we study the stabilization in finite time of the trajectories generated by a continuous (in time $t$) damped inertial dynamic system. The potential function $f:\mathcal{H} \to \mathbb{R}$ to be minimized is supposed to be differentiable, not necessarily convex. It enters the dynamic via its gradient. The damping results from the joint action of dry friction, viscous friction, and a geometric damping driven by the Hessian of $f$. The dry friction damping function $\phi:\mathcal{H} \to \mathbb{R}_+$, which is convex with a sharp minimum at the origin (typically $\phi(x) = r \|x\|$ with $r>0$), enters the dynamic via its subdifferential. It acts as a soft threshold operator on the velocities and is at the origin of the stabilization property in finite time. The Hessian-driven damping, which enters the dynamics in the form $\nabla^2 f(x(t)) \dot{x}(t)$, permits to control and attenuate the oscillations which occur naturally with the inertial effect. We give two different proofs, in a finite-dimensional setting, of the existence of strong solutions of this second-order differential inclusion. One is based on a fixed-point argument and the use of Leray-Schauder theorem; the other one is based on the Yosida approximation technique and the Mosco convergence. We also give an existence and uniqueness result in a general Hilbert framework by assuming that the Hessian of the function $f$ is Lipschitz continuous on the bounded sets of $\mathcal{H}$. Then, we study the convergence properties of the trajectories as $t \to +\infty$ and show their stabilization property in finite time. The convergence results tolerate the presence of perturbations, errors, under the sole assumption of their asymptotic convergence to zero. Then, we extend the study to the case of a nonsmooth convex function $f$.
|
| [J92] |
S. Adly and H. Attouch Finite convergence of proximal-gradient inertial algorithms combining dry friction with Hessian-driven damping, SIAM Journal on Optimization (SIOPT), Vol. 30, No. 3, pp. 2134-2162 (2020). Abstract
Abstract: In a Hilbert space $H$, we introduce a new class of proximal-gradient algorithms with finite convergence properties. These algorithms naturally occur as discrete temporal versions of an inertial differential inclusion which is damped under the joint action of three dampings: a viscous damping, a geometric damping driven by the Hessian, and a dry friction damping. The function $f:H \to R$ to be minimized is supposed to be differentiable (not necessarily convex) and enters the algorithm via its gradient. The dry friction damping function $\phi:H \to \mathbb{R}_+$ is convex with a sharp minimum at the origin (typically $\phi(x) = r \|x\|$ with $r>0$). It enters the algorithm via its proximal mapping, which acts as a soft threshold operator on the velocities. The geometric damping driven by the Hessian intervenes in the dynamics in the form $\nabla^2 f(x(t)) \dot{x}(t)$. By treating this term as the time derivative of $\nabla f(x(t))$, this gives, in discretized form, first-order algorithms. The Hessian-driven damping allows controlling and attenuating the oscillations. The convergence results tolerate the presence of errors, under the sole assumption of their asymptotic convergence to zero. Replacing the potential function $f$ by its Moreau envelope, we extend the results to the case of a nonsmooth convex function $f$. In this case, the algorithm involves the proximal operators of $f$ and $\phi$ separately. Several variants of this algorithm are considered, including the case of the Nesterov accelerated gradient method. We then consider the extension in the case of additive composite optimization, thus leading to splitting methods. Numerical experiments are given for Lasso-type problems. The performance profiles, as a comparison tool, highlight the effectiveness of a variant of the Nesterov accelerated method with dry friction and Hessian-driven damping.
|
| [J85] |
S. Adly and L. Bourdin. On a decomposition formula for the resolvent operator of the sum of two set-valued maps with monotonicity assumptions, Applied Mathematics and Optimization, 80, no. 3, 715–732, (2019). Abstract
Abstract: The aim of the present work is to provide an explicit decomposition formula for the resolvent operator $\mathcal{J}_{A+B}$ of the sum of two set-valued maps $A$ and $B$ in a Hilbert space. For this purpose, we introduce a new operator called the $A$-resolvent operator of $B$, denoted by $\mathcal{J}_{A,B}$, which generalizes the usual notion. Then, our main result lies in the decomposition formula $\mathcal{J}_{A+B} = \mathcal{J}_A \circ \mathcal{J}_{A,B}$ holding true when $A$ is monotone. Several properties of $\mathcal{J}_{A,B}$ are deeply investigated in this paper. In particular, the relationship between $\mathcal{J}_{A,B}$ and an extension of the classical Douglas-Rachford operator is established, which allows us to propose a weakly convergent algorithm that computes numerically $\mathcal{J}_{A,B}$ (and thus $\mathcal{J}_{A+B}$ from the decomposition formula) when $A$ and $B$ are maximal monotone. In order to illustrate our theoretical results, we give an application in elliptic PDEs, specifically the decomposition formula is used to point out the relationship between the classical obstacle problem and a new nonlinear PDE involving a partially blinded elliptic operator. Some numerical experiments using the finite element method are carried out in order to support our approach.
|
| [J84] |
A. Aboussoror, S. Adly and F.E. Saissi . Optimality Conditions for Strong Semivectorial Bilevel Programming Problems via a Conjugate Duality, Journal of Pure and Applied Functional Analysis, 4, no. 2, 151–176, (2019). Abstract
Abstract: We are concerned with a strong semivectorial nonlinear bilevel programming problem where the upper and lower levels are vectorial and scalar, respectively. For such a problem, we give a duality approach via scalarization, regularization, and a conjugate duality. Then, via this duality approach, we provide necessary and sufficient optimality conditions for the initial semivectorial bilevel programming problem. This duality approach extends the one given in [1] from the scalar case to the semivectorial one.
[1] A. Aboussoror, S. Adly, and F. E. Saissi, An extended Fenchel-Lagrange duality approach and optimality conditions for strong bilevel programming problems, SIAM J. Optim., Vol. 27, No. 2, pp. 1230-1255, 2017.
|
| [J57] |
S. Adly, B. Brogliato, and B.K. Le. Implicit Euler Time-Discretization of a Class of Lagrangian Systems with Set-Valued Robust Controller, Journal of Convex Analysis 23 (2016), No. 1, pp 23-52. Abstract
Abstract: A class of Lagrangian continuous dynamical systems with set-valued controller and subjected to a perturbation force has been thoroughly studied in [S. Adly, B. Brogliato, B. K. Le, Well-posedness, robustness and stability analysis of a set-valued controller for Lagrangian systems, SIAM J. Control Optim., 51(2), 1592--1614, 2013]. In this paper, we study the time discretization of these set-valued systems with an implicit Euler scheme. Under some mild conditions, the well-posedness (existence and uniqueness of solutions) of the discrete-time scheme, as well as the convergence of the sequences of discrete positions and velocities in finite steps are assured. Furthermore, the approximate piecewise linear function generated by these discrete sequences is shown to converge to the solution of the continuous time differential inclusion with order $\frac{1}{2}$. Some numerical simulations on a two-degree of freedom example illustrate the theoretical developments.
|
| [J56] |
S. Adly and Ba Khiet Le. Unbounded Second Order State Dependent Moreau's Sweeping Processes in Hilbert Spaces, Journal of Optimization Theory and Applications, (2016) 169 pp 407–423. Abstract
Abstract: In this paper, an existence and uniqueness result of a second order sweeping process with velocity in the moving set under perturbation in infinite-dimensional Hilbert spaces is studied by using an implicit discretization scheme. It is assumed that the moving set depends on the time, the state, and is allowed to be unbounded. The compactness assumption on the moving set is improved compared to previous works. Our methodology is based on convex and variational analysis.
|
| [J55] |
S. Adly, H. V. Ngai, and N. Van Vu. Newton's method for solving generalized equations: Kantorovich's and Smale's approaches, Journal of Mathematical Analysis and Applications, 439 (2016), no. 1, 396–418 Abstract
Abstract: In this paper, we study the Newton-type method for solving generalized equations involving set-valued maps in Banach spaces. Kantorovich-type theorems (both local and global versions) are proved, as well as the quadratic convergence of the Newton sequence. We also extend both Smale's classical $(\alpha, \gamma)$-theory to generalized equations. These results are new and can be considered as an extension of many known ones in the literature for the classical nonlinear case. Our approach is based on tools from variational analysis, where the metric regularity concept plays an important role in our analysis.
|
| [J54] |
S. Adly, A. Hantoute, and M. Théra. Nonsmooth Lyapunov pairs for differential inclusions governed by operators with nonempty interior domain, Mathematical Programming Ser. B. 157, No 2, pp 349–374 (2016) Abstract
Abstract: The general theory of Lyapunov's stability of first-order differential inclusions in Hilbert spaces has been studied by the authors in a previous work. This new contribution focuses on the natural case when the maximally monotone operator governing the given inclusion has a domain with nonempty interior. This setting permits having nonincreasing Lyapunov functions on the whole trajectory of the solution to the given differential inclusion. It also allows some more explicit criteria for Lyapunov's pairs. Some consequences to the viability of closed sets are given, as well as some useful cases relying on the continuity or/and convexity of the involved functions. Our analysis makes use of standard tools from convex and variational analysis.
|
| [J53] |
S. Adly, Ta T.H. Trang, and Vu N. Phat. Finite-time stabilization and $H_\infty$ Control of nonlinear time-varying delay systems via output feedback, Journal of Industrial and Management Optimization, Vol. 12, Issue 1, 2016, pp 303-315. Abstract
Abstract: This paper studies the robust finite-time H∞ control for a class of nonlinear systems with time-varying delay and disturbances via output feedback. Based on the Lyapunov functional method and a generalized Jensen integral inequality, novel delay-dependent conditions for the existence of output feedback controllers are established in terms of linear matrix inequalities (LMIs). The proposed conditions allow us to design the output feedback controllers which robustly stabilize the closed-loop system in the finite-time sense. An application to H∞ control of uncertain linear systems with interval time-varying delay is also given. A numerical example is given to illustrate the efficiency of the proposed method.
|
| [J52] |
S. Adly, T.T. Trang, and V.N. Phat. Optimal Guaranteed Cost Control of Nonlinear Time-Varying Delay Systems via Static Output Feedback, Pacific Journal of Optimization (2016), Vol. 12, N° 3, pp. 649-667 Abstract
Abstract: The optimal guaranteed cost control problem via static output feedback controller is addressed in this paper for a class of dynamical systems with interval time-varying delays and nonlinear perturbations. By introducing a set of improved Lyapunov-Krasovskii functionals, a novel delay-dependent condition for output feedback guaranteed cost control with guaranteed exponential stability is derived in terms of linear matrix inequalities (LMIs). Then, a design method of robust guaranteed cost control via output feedback controller is applied for uncertain linear systems. The design of output feedback controllers can be carried out in a systematic and computationally efficient manner via the use of LMI-based algorithms. Numerical examples are included to illustrate the effectiveness of the obtained result.
|
| [J51] |
S. Adly, A. Hantoute, and B.K. Le. Nonsmooth Lur'e Dynamical Systems in Hilbert Spaces, Set-Valued and Variational Analysis,Vol. 24, Issue 1, pp 13-35. Abstract
Abstract: In this paper, we study the well-posedness and stability analysis of set-valued Lur'e dynamical systems in infinite-dimensional Hilbert spaces. The existence and uniqueness results are established under the so-called passivity condition. Our approach uses a regularization procedure for the term involving the maximal monotone operator. The Lyapunov stability as well as the invariance properties are considered in detail. In addition, we give some sufficient conditions ensuring the robust stability of the system in finite-dimensional spaces. The theoretical developments are illustrated by means of some examples dealing with nonregular electrical circuits. This work extends and improves some of the recent results given in [bg2, bg1, cs]. Our methodology is based on tools from set-valued and variational analysis.
|
| [J50] |
S. Adly, R. Cibulka, and H.V. Ngai. Newton's method for solving inclusions using set-valued approximations, SIAM Journal on Optimization, 25 (2015), no. 1, 159–184 Abstract
Abstract: Results on stability of both local and global metric regularity under set-valued perturbations are presented. As an application, we study (super-)linear convergence of the Newton-type iterative process for solving generalized equations. The possibility to choose set-valued approximations allows us to describe several iterative schemes in a unified way (such as inexact Newton method, non-smooth Newton method for semi-smooth functions, inexact proximal point algorithm, etc.). Moreover, it also covers a forward-backward splitting algorithm for finding a common zero of the sum of two multivalued (not necessarily monotone) operators. Finally, a globalization of the Newton's method is discussed.
|
| [J49] |
S. Adly and H. Rammal. A new method for solving Second-Order Cone Eigenvalue Complementarity Problem, Journal of Optimization Theory and Applications, 165 (2015), no. 2, 563–585 Abstract
Abstract: Eigenvalue complementarity problem EiCP with nonnegativity constraints has become a fruitful discipline within mathematical programming. In this paper, we extend EiCP to problem where the nonnegative orthant, i.e., the Pareto cone is replaced by the product of second order cones SOC. We reformulate such problem to find the roots of a semismooth function. Furthermore, we generalize the Lattice Projection Method LPM proposed first in [AR] to solve the second order cone eigenvalue complementarity problem SOCEiCP. The originality of this work, in comparison with [AR], is that we use a globalization of the semismooth Newton method SNM to approximate the Lorentz eigenvalues. Surprisingly, this kind of subject has never been studied before due to the difficulty of this problem in the sense that the Lorentz spectrum is not always finite. Finally, LPM is then compared to the semismooth Newton methods with line search: SNMmin and SNMFB, by using the performance profiles [Cops, perf] as a comparison tool. The numerical experiments highlight that the LPM solver is efficient and robust for solving SOCEiCP.
|
| [J48] |
S. Adly, A.L. Dontchev, and M. Théra. On one-sided Lipschitz stability of set-valued contractions, Numerical Functional Analysis and Optimization, 35 (2014), no. 7-9, 837–850 Abstract
Abstract: We show that a result by T. -C. Lim [On fixed-point stability for set-valued contractive mappings with applications to generalized differential equations, J. Math. Anal. Appl. 110 (1985) 436--441] can be sharpened significantly by using a generalization of a theorem by Arutyunov regarding fixed points of composition of mappings. A global version of the Lyusternik-Graves theorem is a corollary of this estimate as well. We apply the generalization of Lim's result to derive one-sided Lipschitz properties of the solution mapping of a differential inclusion with a parameter.
|
| [J47] |
S. Adly and R. Cibulka. Quantitative stability of a generalized equation. Application to non-regular electrical circuits, Journal of Optimization Theory and Applications JOTA, 160 (2014), no. 1, 90–110 Abstract
Abstract: The paper is devoted to the study of several stability properties (such as Aubin property, calmness, and isolated calmness) of a special non-monotone generalized equation. The theoretical results are applied in the theory of non-regular electrical circuits involving electronic devices like ideal diode, practical diode, and DIACs (DIode Alternating Current).
|
| [J46] |
S. Adly, T. Haddad, and L. Thibault. Convex Sweeping Process in the framework of Measure Differential Inclusions and Evolution Variational Inequalities, Mathematical Programming, 148 (2014), no. 1-2, Ser. B, pages: 5–47 Abstract
Abstract: In this paper, we analyze and discuss the well-posedness of two new variants of the so-called sweeping process, introduced by J.J. Moreau in the early 70's [More71] with motivation in plasticity theory. The first new variant is concerned with the perturbation of the normal cone to the moving convex subset C(t), supposed to have a bounded retraction, by a Lipschitz mapping. Under some assumptions on the data, we show that the perturbed differential measure inclusion has one and only one right continuous solution with bounded variation. The second variant, for which a large analysis is made, concerns a first-order sweeping process with velocity in the moving set C(t). This class of problems subsumes as a particular case, the evolution variational inequalities (widely used in applied mathematics and unilateral mechanics [DL]). Assuming that the moving subset C(t) has continuous variation for every t in [0,T] with C(0) bounded, we show that the problem has at least a Lipschitz continuous solution. The well-posedness of this class of sweeping process is obtained under the coercivity assumption of the involved operator. We also discuss some applications of the sweeping process for the study of vector hysteresis operators in the elastoplastic model [Krej91], the planning procedure in mathematical economy [Henr], and to nonregular electrical circuits containing nonsmooth electronic devices like diodes [abb]. The theoretical results are supported by some numerical simulations to prove the efficiency of the algorithm used in the existence proof. Our methodology is based only on tools from convex analysis. Like the other papers in this collection, we show in this presentation how elegant modern convex analysis was influenced by Moreau's seminal work.
|
| [J45] |
S. Adly and B. K. Le. Stability and invariance results for a class of non-monotone set-valued Lur’e dynamical systems, Applicable Analysis, 93 (2014), no. 5, 1087–1105. Abstract
Abstract: In this paper, we analyze the well-posedness, stability, and invariance results for a class of non-monotone set-valued Lur'e dynamical system, which has been widely studied in control and applied mathematics [l]. Many recent researches deal with the case when the set-valued part is the subdifferential of some proper, convex, lower semicontinuous function to use the nice properties of maximally monotone operators. But in practice, particularly in electronics, there are some devices such as diac, silicon controller rectifier (SCR)... of which the voltage-current characteristics are not monotone but only locally hypo-monotone. This fact motivates us to write the paper, which is organized as follows: firstly, the existence and uniqueness of solutions are proved by using Filippov's method and local hypo-monotonicity; then, the stability analysis and generalized LaSalle's invariance principle are presented. The theoretical results are supported by numerical simulations for some examples in electronics. Our methodology is based on nonsmooth and variational analysis.
|
| [J44] |
A. Aboussoror and S. Adly Generalized Semi-Infinite Programming: Optimality Conditions Involving Reverse Convex Problems, Numerical Functional Analysis and Optimization, 35 (2014), no. 7-9, 816–836 Abstract
Abstract: The paper deals with a generalized semi-infinite programming problem (S). Under appropriate assumptions, for such a problem, we give necessary and sufficient optimality conditions via reverse convex problems. In particular, a necessary and sufficient optimality condition reduces the problem (S) to a min-max problem constrained with compact convex linked constraints.
|
| [J43] |
S. Adly, B. Brogliato, and B. K. Le. Well-posedness, Robustness and Stability Analysis of a Set-Valued Controller for Lagrangian Systems, SIAM Journal on Control and Optimization 51 (2013), no. 2, 1592–1614 Abstract
Abstract: This paper deals with the analysis of a class of nonsmooth robust controllers for Lagrangian systems with non-trivial mass matrix. First, the existence and uniqueness of solutions are analyzed, then the Lyapunov stability, the Krasovskii-LaSalle invariance principle, and finite-time convergence properties are studied.
|
| [J42] |
S. Adly and H. Rammal. A New Method for Solving Pareto Eigenvalue Complementarity Problems, Computational Optimization and Applications 55, No 3, pp 703-731 (2013). Abstract
Abstract: In this paper, we introduce a new method called the Lattice Projection Method (LPM) for solving eigenvalue complementarity problems. The original problem is reformulated to find the roots of a nonsmooth function. A semismooth Newton type method is then applied to approximate the eigenvalues and eigenvectors of the complementarity problems. The LPM is compared to SNM$_{\rm min}$ and SNM$_{\rm FB}$, two methods widely discussed in the literature for solving nonlinear complementarity problems, by using performance profiles as a comparison tool. The numerical experiments highlight the efficiency of the LPM and show that it is a promising method for solving eigenvalue complementarity problems. Finally, Pareto bi-eigenvalue complementarity problems were solved numerically as an application to confirm the efficiency of our method.
|
| [J41] |
S. Adly, R. Cibulka, and H. Massias. Variational Analysis and Generalized Equations in Electronics. Stability and Simulation Issues, Set-Valued and Variational Analysis 21 (2013), no. 2, 333–358. Abstract
Abstract: The paper is devoted to the study of the Aubin/Lipschitz-like property and the isolated calmness of a particular non-monotone generalized equation arising in electronics. The variational and non-smooth analysis is applied in the theory of non-regular electrical circuits involving electronic devices like ideal diodes, practical diodes, DIACs, silicon controlled rectifiers (SCR), and transistors. We also discuss the relationship of our results to the ones using classical techniques from (smooth) analysis and provide a simulation for several simple electrical circuits which are chosen to cover the most common non-smooth elements in electronics. The simulations of the electrical circuits discussed in this paper are performed by using Xcos (a component of Scilab).
|
| [J40] |
S. Adly and O. Chau. On some dynamic thermal non-clamped contact problems, Mathematical Programming serie B, No 1-2, pp 5-26 (2013) Abstract
Abstract: We study a class of dynamic thermal sub-differential contact problems with friction, for long memory visco-elastic materials, without the clamped condition, which can be put into a general model of system defined by a second-order evolution inequality, coupled with a first-order evolution equation. We present and establish an existence and uniqueness result, by using general results on first-order evolution inequality, with monotone operators and fixed-point methods. Finally, a fully discrete scheme for numerical approximations is provided, and corresponding various numerical computations in dimension two will be given.
|
| [J38] |
S. Adly, D. Goeleven, and B. K. Le. Stability Analysis and Attractivity Results of a DC-DC Buck Converter, Set-Valued and Variational Analysis (2012) 20:331-353 Abstract
Abstract: Using tools from set-valued and variational analysis, we propose a mathematical formulation for a power DC-DC Buck converter. We prove the existence of trajectories for the model. Stability and asymptotic stability results are established. The theoretical results are supported by some numerical simulations with a discussion about explicit and implicit schemes.
|
| [J37] |
S. Adly, A. Hantoute, and M. Thera. Nonsmooth Lyapunov pairs for infinite-dimensional first-order differential inclusions, Nonlinear Analysis: Theory, Methods and Applications 75, 3 (2012) 985-1008 Abstract
Abstract: The main objective of this paper is to provide new explicit criteria to characterize weak lower semicontinuous Lyapunov pairs or functions associated with first-order differential inclusions in Hilbert spaces. These inclusions are governed by a Lipschitzian perturbation of a maximally monotone operator. The dual criteria we give are expressed by means of the proximal and basic subdifferentials of the nominal functions while primal conditions are described in terms of the contingent directional derivative. We also propose a unifying review of many other criteria given in the literature. Our approach is based on advanced tools of variational analysis and generalized differentiation.
|
| [J36] |
S. Adly, O. Chau, and M. Rochdi. Solvability of a class of thermal dynamical contact problems with subdifferential conditions, Numerical Algebra, Control and Optimization 2, 1, pp 91-104 (2012). Abstract
Abstract: We study a class of dynamic thermal sub-differential contact problems with friction, for long memory visco-elastic materials, which can be put into a general model defined by a second-order evolution inequality, coupled with a first-order evolution equation. We present and establish an existence and uniqueness result, using general results on first-order evolution inequality with monotone operators and fixed-point methods.
|
| [J35] |
A. Aboussoror and S. Adly. A Fenchel-Lagrange Duality Approach for a Bilevel Programming Problem with Extremal-Value Function, Journal of Optimization Theory and Applications 149, 2 (2011) 254-268 Abstract
Abstract: In this paper, for a bilevel programming problem (S) with an extremal-value function, we first give its Fenchel-Lagrange dual problem. Under appropriate assumptions, we show that a strong duality holds between them. Then, we provide optimality conditions for (S) and its dual. Finally, we show that the resolution of the dual problem is equivalent to the resolution of a one-level convex minimization problem.
|
| [J34] |
K. Addi, S. Adly, and H. Saoud. Finite-time Lyapunov stability analysis of evolution variational inequalities, Discrete and Continuous Dynamical Systems - Series A 31, 4 (2011) 1023-1038 Abstract
Abstract: Using Lyapunov's stability and LaSalle's invariance principle for nonsmooth dynamical systems, we establish conditions for finite-time stability of evolution variational inequalities. The theoretical results are illustrated by examples drawn from electrical circuits involving nonsmooth elements like diodes.
|
| [J33] |
S. Adly and A. Seeger. A nonsmooth algorithm for cone-constrained eigenvalue problems, Computational Optimization and Applications 49, 2 (2011) 299-318 Abstract
Abstract: We study several variants of a nonsmooth Newton-type algorithm for solving an eigenvalue problem of the form Kx(Ax−Bx)K+. Such an eigenvalue problem arises in mechanics and in other areas of applied mathematics. The symbol K refers to a closed convex cone in the Euclidean space R^n and (A,B) is a pair of possibly asymmetric matrices of order n. Special attention is paid to the case in which K is the nonnegative orthant of R^n. The more general case of a possibly unpointed polyhedral convex cone is also discussed in detail.
|
| [J32] |
A. Aboussoror, S. Adly, and V. Jalby. Weak Nonlinear Bilevel Problems: Existence of Solutions via Reverse Convex and Convex Maximization Problems, Journal of Industrial and Management Optimization 7, 3 (2011) 559-571 Abstract
Abstract: In this paper, for a class of weak bilevel programming problems, we provide sufficient conditions guaranteeing the existence of global solutions. These conditions are based on the use of reverse convex and convex maximization problems.
|
| [J28] |
S. Adly, K. Addi, B. Brogliato, and D. Goeleven. A method using the approach of Moreau and Panagiotopoulos for the mathematical formulation of non-regular circuits in electronics, Nonlinear Analysis: Hybrid Systems and Applications, N° 1, pp. 315-324 (2007). |
| [J27] |
S. Adly, D. Goeleven, and M. Théra. A continuation method for a class of periodic evolution variational inequalities, Some Topics in Industrial and Applied Mathematics. Series in Contemporary Applied Mathematics CAM 8, pp. 1-28 (2007). |
| [CP] |
A. Ahmad, S. Adly, D. Ghazanfarpour, and O. Terraz. Stability analysis of filtered mass-spring systems, Proceedings of theory and practice of computer graphics, 2007, pp. 45-52 (Bangor, England). |
| [J26] |
S. Adly, D. Goeleven, and M. Théra. Existence Results for a Class of Periodic Evolution Variational Inequalities, Chinese Annals of Mathematics - Series B, Volume 28, Number 6, pp. 629-650 (2007) |
| [BC] |
S. Adly, H. Attouch, and A. Cabot. Finite time stabilization of nonlinear oscillators subject to dry friction, Progresses in Nonsmooth Mechanics and Analysis (edited by P. Alart, O. Maisonneuve and R.T. Rockafellar), Advances in Mathematics and Mechanics, Kluwer, pp. 289-304, (2006). |
| [J25] |
S. Adly. Attractivity Theory for Second Order Nonsmooth Dynamical Systems with application to dry friction, Journal of Mathematical Analysis and Applications, 322, pp. 1055-1070 (2006). |
| [J24] |
S. Adly, M. Ait-Mansour, and L. Scrimali. Sensitivity analysis of solutions to a class of quasi-variational inequalities, Bulletino Della Unione Mathematica Italiana (BUMI), pp. 767-772 (2006). |
| [CP] |
S. Adly, E. Ernst, and M. Théra. Stability in frictional unilateral elasticity revisited: an application of the theory of semi-coercive variational inequalities, Proceeding of American Institute of Physics, Vol. 835, pp. 1-11 (2006). |
| [CP] |
K. Addi, S. Adly, B. Brogliato, and D. Goeleven. The approach of Moreau and Panagiotopoulos: use it in electronics, accepté dans Proceeding of the International Conference on Nonsmooth/Nonconvex Mechanics with Applications in Engineering, pp. 471-478 (2006). |
| [J23] |
S. Adly. Stability of linear semi-coercive variational inequalities in Hilbert spaces: application to the Signorini-Fichera Problem, Journal of Nonlinear and Convex Analysis, N° 3, pp. 325-334 (2006). |
| [J22] |
S. Adly, K. Addi, D. Goeleven, and M. Théra. A nonsymmetric linear complementarity problem to solve a quasistatic rolling frictional contact problem, Journal of Nonlinear and Convex Analysis, N°3, pp. 315-324 (2006). |
| [CP] |
A. Ahmad, S. Adly, D. Ghazanfarpour, and O. Terraz. Stabilisation par filtrage de méthodes d'intégration explicite, Journées AFIG (Association Française d'Informatique Graphique), pp. 73-80 (2006). |
| [J21] |
S. Adly, E. Ernst, and M. Théra. Norm Closure of the Barrier cone in normed linear spaces, Proceeding of the American Mathematical Society, 132, no. 10, pp. 2911-2915 (2004) |
| [J20] |
S. Adly, E. Ernst, and M. Théra. Well-positioned closed convex sets and well-positioned closed convex functions, Journal of Global Optimization, 29 (4), pp. 337-351 (2004). |
| [J19] |
S. Adly and D. Goeleven. A stability Theory for second-order nonsmooth dynamical systems with application to friction problems, Journal de Mathématiques Pures et Appliquées, Vol. 83, pp. 17-51 (2004). |