- ▪Y. Chitour, W. Liu, E.D. Sontag, "On the continuity and incremental-gain properties of certain saturated linear feedback loops", Internat. J. Robust Nonlinear Control, vol. 5, no. 5, pp. 413–440, 1995. pdf
Abstract
This paper discusses various continuity and incremental-gain properties for neutrally stable linear systems under linear feedback subject to actuator saturation. The results complement our previous ones, which applied to the same class of problems and provided finite-gain stability.
- ▪M. A. Dahleh, E.D. Sontag, D. N. C. Tse, J. N. Tsitsiklis, "Worst-case identification of nonlinear fading memory systems", Automatica, vol. 31, no. 3, pp. 503–508, 1995. doipdfinformation-based complexity · fading-memory systems · stability · system identification · structured uncertainty
Abstract
We consider the problem of characterizing possible supply functions for a given dissipative nonlinear system, and provide a result that allows some freedom in the modification of such functions.
- ▪B. DasGupta, H.T. Siegelmann, E.D. Sontag, "On the complexity of training neural networks with continuous activation functions", IEEE Trans.\ Neural Networks, vol. 6, pp. 1490–1504, 1995. pdfanalog computing · theory of computing · neural networks · computational complexity · machine learning
Abstract
Blum and Rivest showed that any possible neural net learning algorithm based on fixed architectures faces severe computational barriers. This paper extends their NP-completeness result, which applied only to nets based on hard threshold activations, to nets that employ a particular continuous activation. In view of neural network practice, this is a more relevant result to understanding the limitations of backpropagation and related techniques.
- ▪Y. Lin, E.D. Sontag, "Control-Lyapunov universal formulas for restricted inputs", Control Theory and Advanced Technology, vol. 10, no. 4, part 5, pp. 1981–2004, 1995. pdf
Abstract
We deal with the question of obtaining explicit feedback control laws that stabilize a nonlinear system, under the assumption that a "control Lyapunov function" is known. In previous work, the case of unbounded controls was considered. Here we obtain results for bounded and/or positive controls. We also provide some simple preliminary remarks regarding a set stability version of the problem and a version for systems subject to disturbances.
- ▪Y. Lin, E.D. Sontag, Y. Wang, "Input to state stabilizability for parametrized families of systems", Internat. J. Robust Nonlinear Control, vol. 5, no. 3, pp. 187–205, 1995. pdf
Abstract
This paper studies various stability issues for parameterized families of systems, including problems of stabilization with respect to sets. The study of such families is motivated by robust control applications. A Lyapunov-theoretic necessary and sufficient characterization is obtained for a natural notion of robust uniform set stability; this characterization allows replacing ad hoc conditions found in the literature by more conceptual stability notions. We then use these techniques to establish a result linking state space stability to ``input to state'' (bounded-input bounded-state) stability. In addition, the preservation of stabilizability under certain types of cascade interconnections is analyzed.
- ▪H. T. Siegelmann, E.D. Sontag, "On the computational power of neural nets", J. Computer System Sciences, vol. 50, no. 1, pp. 132–150, 1995. doipdfmachine learning · analog computing · theory of computing · neural networks · computational complexity · super-Turing computation
Abstract
This paper deals with finite size networks which consist of interconnections of synchronously evolving processors. Each processor updates its state by applying a "sigmoidal" function to a rational-coefficient linear combination of the previous states of all units. We prove that one may simulate all Turing Machines by such nets. In particular, one can simulate any multi-stack Turing Machine in real time, and there is a net made up of 886 processors which computes a universal partial-recursive function. Products (high order nets) are not required, contrary to what had been stated in the literature. Non-deterministic Turing Machines can be simulated by non-deterministic rational nets, also in real time. The simulation result has many consequences regarding the decidability, or more generally the complexity, of questions about recursive nets.
- ▪E.D. Sontag, "State-space and i/o stability for nonlinear systems", In Feedback control, nonlinear systems, and complexity (Montreal, PQ, 1994), pp. 215–235, 1995. pdf(Expository paper, placed online per request. The paper ``Input to state stability: Basic concepts and results'' is far more up to date and should be downloaded instead of this one!)
- ▪E.D. Sontag, "Control of systems without drift via generic loops", IEEE Trans. Automat. Control, vol. 40, no. 7, pp. 1210–1219, 1995. pdfstabilization · non-holonomic systems · path-planning · systems without drift · nonlinear control · controllability · real-analytic functions
Abstract
This paper proposes a simple numerical technique for the steering of arbitrary analytic systems with no drift. It is based on the generation of "nonsingular loops" which allow linearized controllability along suitable trajetories. Once such loops are available, it is possible to employ standard Newton or steepest descent methods, as classically done in numerical control. The theoretical justification of the approach relies on recent results establishing the genericity of nonsingular controls, as well as a simple convergence lemma.
- ▪E.D. Sontag, Y. Wang, "On characterizations of the input-to-state stability property", Systems Control Lett., vol. 24, no. 5, pp. 351–359, 1995. doipdf
Abstract
We show that the well-known Lyapunov sufficient condition for input-to-state stability is also necessary, settling positively an open question raised by several authors during the past few years. Additional characterizations of the ISS property, including one in terms of nonlinear stability margins, are also provided.
- ▪E.D. Sontag, "On the input-to-state stability property", European J.\ Control, vol. 1, pp. 24–36, 1995. pdf
Abstract
The "input to state stability" (ISS) property provides a natural framework in which to formulate notions of stability with respect to input perturbations. In this expository paper, we review various equivalent definitions expressed in stability, Lyapunov-theoretic, and dissipation terms. We sketch some applications to the stabilization of cascades of systems and of linear systems subject to control saturation.
- ▪E.D. Sontag, "Spaces of observables in nonlinear control", In Proceedings of the International Congress of Mathematicians, Vol.\ 1, 2 (Zürich, 1994), pp. 1532–1545, 1995. pdf
Abstract
Invited talk at the 1994 ICM. Paper deals with the notion of observables for nonlinear systems, and their role in realization theory, minimality, and several control and path planning questions.
- ▪E.D. Sontag, A.R. Teel, "Changing supply functions in input/state stable systems", IEEE Trans. Automat. Control, vol. 40, no. 8, pp. 1476–1478, 1995. pdf
Abstract
We consider the problem of characterizing possible supply functions for a given dissipative nonlinear system, and provide a result that allows some freedom in the modification of such functions.
- ▪E.D. Sontag, Y. Wang, "On characterizations of input-to-state stability with respect to compact sets", In Proceedings of IFAC Non-Linear Control Systems Design Symposium, (NOLCOS '95)\/, Tahoe City, CA, June 1995, pp. 226–231, 1995. pdf
Abstract
Previous characterizations of ISS-stability are shown to generalize without change to the case of stability with respect to sets. Some results on ISS-stabilizability are mentioned as well.
- ▪E.D. Sontag, "Critical points for neural net least-squares problems", In Proc.\ 1995 IEEE Internat.\ Conf.\ Neural Networks\/, IEEE Publications, 1995, pp. 2949–2954, 1995.
- ▪E.D. Sontag, Y. Wang, "Various results concerning set input-to-state stability", In Proc.\ IEEE Conf.\ Decision and Control, New Orleans, Dec.\ 1995, IEEE Publications, 1995, pp. 1330–1335, 1995.
- ▪E.D. Sontag, H.J. Sussmann, "Nonsmooth control-Lyapunov functions", In Proc.\ IEEE Conf.\ Decision and Control, New Orleans, Dec.\ 1995, IEEE Publications, 1995, pp. 2799–2805, 1995. pdf
Abstract
It is shown that the existence of a continuous control-Lyapunov function (CLF) is necessary and sufficient for null asymptotic controllability of nonlinear finite-dimensional control systems. The CLF condition is expressed in terms of a concept of generalized derivative (upper contingent derivative). This result generalizes to the non-smooth case the theorem of Artstein relating closed-loop feedback stabilization to smooth CLF's. It relies on viability theory as well as optimal control techniques. A "non-strict" version of the results, analogous to the LaSalle Invariance Principle, is also provided.
- ▪E.D. Sontag, "An abstract approach to dissipation", In Proc.\ IEEE Conf.\ Decision and Control, New Orleans, Dec.\ 1995, IEEE Publications, 1995, pp. 2702–2703, 1995. pdfFull version, never submitted, is here: http://sontaglab.org/FTPDIR/dissipation.pdf
Abstract
We suggest that a very natural mathematical framework for the study of dissipation -in the sense of Willems, Moylan and Hill, and others- is that of indefinite quasimetric spaces. Several basic facts about dissipative systems are seen to be simple consequences of the properties of such spaces. Quasimetric spaces provide also one natural context for optimal control problems, and even for "gap" formulations of robustness.
- ▪E.D. Sontag, "From linear to nonlinear: some complexity comparisons", In Proc.\ IEEE Conf.\ Decision and Control, New Orleans, Dec.\ 1995, IEEE Publications, 1995, pp. 2916–2920, 1995. pdf
Abstract
This paper deals with the computational complexity, and in some cases undecidability, of several problems in nonlinear control. The objective is to compare the theoretical difficulty of solving such problems to the corresponding problems for linear systems. In particular, the problem of null-controllability for systems with saturations (of a "neural network" type) is mentioned, as well as problems regarding piecewise linear (hybrid) systems. A comparison of accessibility, which can be checked fairly simply by Lie-algebraic methods, and controllability, which is at least NP-hard for bilinear systems, is carried out. Finally, some remarks are given on analog computation in this context.
- ▪A.R. Teel, T.T. Georgiou, L. Praly, E.D. Sontag, "Input-Output Stability", In The Control Handbook, pp. 895–908, 1995. pdf
Abstract
An encyclopedia-type article on foundations of input/output stability.
- ▪Y. Wang, E.D. Sontag, "Orders of input/output differential equations and state-space dimensions", SIAM J. Control Optim., vol. 33, no. 4, pp. 1102–1126, 1995. doipdf
Abstract
This paper deals with the orders of input/output equations satisfied by nonlinear systems. Such equations represent differential (or difference, in the discrete-time case) relations between high-order derivatives (or shifts, respectively) of input and output signals. It is shown that, under analyticity assumptions, there cannot exist equations of order less than the minimal dimension of any observable realization; this generalizes the known situation in the classical linear case. The results depend on new facts, themselves of considerable interest in control theory, regarding universal inputs for observability in the discrete case, and observation spaces in both the discrete and continuous cases. Included in the paper is also a new and simple self-contained proof of Sussmann's universal input theorem for continuous-time analytic systems.