A. Agrachev, Y. Baryshnikov, and A. Sarychev, Ensemble controllability by lie algebraic methods. ESAIM: Control, Optimisation and Calculus of Variations, Publication ahead of print, 2016.
DOI : 10.1051/cocv/2016029

URL : http://arxiv.org/abs/1603.07133

L. Andrieu, G. Cohen, and F. J. Vásquez-abad, Stochastic programming with probability constraints, 2007.
URL : https://hal.archives-ouvertes.fr/hal-00166149

M. Bardi and I. C. Dolcetta, Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations, Birkhäuser Mathematics. Birkhauser, 1997.
DOI : 10.1007/978-0-8176-4755-1

G. Barles, S. Dharmatti, and M. Ramaswamy, Unbounded viscosity solutions of hybrid control systems. ESAIM: Control, Optimisation and Calculus of Variations, pp.176-193, 2010.
URL : https://hal.archives-ouvertes.fr/hal-00255763

G. Barles and E. R. Jakobsen, On the convergence rate of approximation schemes for Hamilton-Jacobi-Bellman Equations, ESAIM: Mathematical Modelling and Numerical Analysis, vol.36, issue.1, pp.33-54, 2002.
DOI : 10.1051/m2an:2002002

G. Barles and P. E. Souganidis, Convergence of approximation schemes for fully nonlinear second order equations, 29th IEEE Conference on Decision and Control, pp.271-283, 1991.
DOI : 10.1109/CDC.1990.204046

V. Baudoi, Optimisation robuste multiobjectifs par modèles de substitution, 2012.

R. E. Bellman, Dynamic Programming, 1957.

A. Bensoussan and J. L. Menaldi, Hybrid control and dynamic programming . Dynamics of Continuous, Discrete and Impulsive Systems -Series B: Application and Algorithm, pp.395-442, 1997.

D. Berstimas, The price of robustness, Operations Research, vol.52, issue.1, pp.35-53, 2004.

]. O. Bokanowski, S. Maroso, and H. Zidani, Some Convergence Results for Howard's Algorithm, SIAM Journal on Numerical Analysis, vol.47, issue.4, pp.3001-3026, 2009.
DOI : 10.1137/08073041X

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.232.7016

J. F. Bonnans, S. Maroso, and H. Zidani, Error Estimates for a Stochastic Impulse Control Problem, Applied Mathematics and Optimization, vol.55, issue.3, pp.327-357, 2007.
DOI : 10.1007/s00245-006-0865-2

URL : https://hal.archives-ouvertes.fr/hal-00849555

J. F. Bonnans, P. Martinon, and E. Trélat, Singular Arcs in the Generalized Goddard???s Problem, Journal of Optimization Theory and Applications, vol.106, issue.2, pp.439-461, 2008.
DOI : 10.1007/978-3-642-05221-7

J. F. Bonnans and A. Shapiro, Optimization Problems with Perturbations: A Guided Tour, SIAM Review, vol.40, issue.2, pp.228-264, 1998.
DOI : 10.1137/S0036144596302644

URL : https://hal.archives-ouvertes.fr/inria-00073819

M. S. Branicky, V. S. Borkar, and S. K. Mitter, A unified framework for hybrid control: model and optimal control theory, IEEE Transactions on Automatic Control, vol.43, issue.1, pp.31-45, 1998.
DOI : 10.1109/9.654885

URL : http://black.csl.uiuc.edu/~dcl/nl-grad-sem/sem_papers/Branicky-TAC.pdf

F. Camilli and M. Falcone, An approximation scheme for the optimal control of diffusion processes, ESAIM: Mathematical Modelling and Numerical Analysis, vol.29, issue.1, pp.97-122, 1995.
DOI : 10.1051/m2an/1995290100971

I. , C. Dolcetta, and H. Ishii, Approximate solutions of the bellman equation of deterministic control theory, Applied Mathematics and Optimization, vol.11, issue.1, pp.161-181, 1984.

P. Carpentier, J. Chancelier, and G. Cohen, Optimal control under probability constraint. SADCO Kick off, 2011.
URL : https://hal.archives-ouvertes.fr/inria-00585861

A. Chacon and A. Vladimirsky, Fast Two-scale Methods for Eikonal Equations, SIAM Journal on Scientific Computing, vol.34, issue.2, pp.547-578, 2012.
DOI : 10.1137/10080909X

URL : http://arxiv.org/abs/1110.6220

J. Chai and R. G. Sanfelice, Hybrid feedback control methods for robust and global power conversion. IFAC-PapersOnLine, pp.298-303, 2015.

A. Charnes, W. W. Cooper, and G. H. Symonds, Cost Horizons and Certainty Equivalents: An Approach to Stochastic Programming of Heating Oil, Management Science, vol.4, issue.3, pp.235-263, 1958.
DOI : 10.1287/mnsc.4.3.235

J. Culioli and G. Cohen, Optimisation stochastique sous contraintes en espérance. Comptes Rendus de l'Académie des Sciences -Série 1, pp.753-758, 1995.

J. M. Danskin, The Theory of Max-Min and its Application to Weapons Allocation Problems, Economics and Operations Research, vol.5, 1967.
DOI : 10.1007/978-3-642-46092-0

V. F. Dem-'yanov and V. N. Malozemov, Introduction to Minimax, 1974.

D. Dentcheva, Optimization models with probabilistic constraints, Probabilistic and Randomized Methods for Design under Uncertainty, 2003.
DOI : 10.1007/1-84628-095-8_2

S. Dharmatti and M. Ramaswamy, Hybrid Control Systems and Viscosity Solutions, SIAM Journal on Control and Optimization, vol.44, issue.4, pp.1259-1288, 2005.
DOI : 10.1137/040618072

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.607.93

M. Falcone and R. Ferretti, Semi-Lagrangian approximation schemes for linear and Hamilton-Jacobi equations, Other Titles in Applied Mathematics. SIAM, vol.133, 2014.
DOI : 10.1137/1.9781611973051

URL : https://hal.archives-ouvertes.fr/hal-00916055

R. Ferretti and H. Zidani, Monotone Numerical Schemes and Feedback Construction for Hybrid Control Systems, Journal of Optimization Theory and Applications, vol.78, issue.2, pp.507-531, 2014.
DOI : 10.1090/S0002-9939-1980-0553381-X

URL : https://hal.archives-ouvertes.fr/hal-00989492

A. Geletu, M. Klöppel, H. Zhang, and P. Li, Advances and applications of chance-constrained approaches to systems optimisation under uncertainty, International Journal of Systems Science, vol.81, issue.7, pp.1209-1232, 2012.
DOI : 10.1109/TPWRS.2010.2051168

G. P. Gerdan and R. E. Deakin, Transforming cartesian coordinates x, y, z to geographical coordinates ?, ?, h. The Australian Surveyor, pp.55-63, 1999.
DOI : 10.1080/00050351.1999.10558773

R. H. Goddard, A method of reaching extreme altitudes, Smithsonian Miscellaneous Collections, vol.71, issue.2, pp.2-69, 1921.

E. Hairer, S. P. Nørsett, and G. Wanner, Solving Ordinary Differential Equations I: Nonstiff Problems, 1993.
DOI : 10.1007/978-3-662-12607-3

R. Henrion and W. Römisch, Hölder and lipschitz stability of solution sets in programs with probabilistic constraints, Mathematical Programming, pp.589-611, 2004.

R. Henrion and C. Strugarek, Convexity of chance constraints with independent random variables, Computational Optimization and Applications, vol.9, issue.2, pp.263-276, 2008.
DOI : 10.1007/978-94-017-3087-7

R. A. Howard, Dynamic Programming and Markov Processes, 1960.

K. Ishii, Viscosity solutions of nonlinearsecond order elliptic pdes associated with impulse control problems ii, Funkcialaj Ekvacioj, vol.38, issue.2, pp.297-328, 1995.

E. R. Jakobsen and K. H. Karlsen, Continuous dependence estimates for viscosity solutions of fully nonlinear degenerate elliptic equations, Electronic Journal of Differential Equations, issue.39, pp.1-10, 2002.

N. V. Krylov, On the rate of convergence of fnite difference approximation for bellman's equation, St. Petersburg Mathematical Journal, vol.9, issue.3, pp.639-650, 1998.

N. V. Krylov, On the rate of convergence of fnite difference approximation for bellman's equation with variable coefficients. Probability Theory and Related Fields, pp.1-16, 2000.

H. Kushner and P. G. Dupuis, Numerical methods for stochastic control problems in continuous time, of Stochastic Modelling and Applied Probability, 2001.

P. L. Ecuyer and G. Yin, Budget-Dependent Convergence Rate of Stochastic Approximation, SIAM Journal on Optimization, vol.8, issue.1, pp.217-247, 1998.
DOI : 10.1137/S1052623495270723

U. Ledzewicz and H. Schättler, Optimal Bang-Bang Controls for a Two-Compartment Model in Cancer Chemotherapy, Journal of Optimization Theory and Applications, vol.37, issue.3, pp.609-637, 2002.
DOI : 10.1137/S0363012997319139

E. S. Levitin, On differential properties of the optimal value of parametric problems of mathematical programming, Doklady Akademii Nauk SSSR, vol.224, pp.1354-1358, 1975.

E. S. Levitin, Differentiability with respect to a parameter of the optimal value in parametric problems of mathematical programming, Kibernetika, vol.1, pp.44-59, 1976.

C. Louembet, D. Arzelier, and G. Deaconu, Robust Rendezvous Planning Under Maneuver Execution Errors, Journal of Guidance, Control, and Dynamics, vol.125, issue.1, pp.76-93, 2015.
DOI : 10.1515/9781400831050

URL : https://hal.archives-ouvertes.fr/hal-01078508

Y. Mansour and S. Singh, On the complexity of policy iteration, Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pp.401-408, 1999.

K. Marti, Differentiation formulas for probability functions: The transformation method, Mathematical Programming, pp.201-220, 1996.
DOI : 10.1007/978-3-642-68697-9

N. Metropolis, The beginning of the monte carlo method, Los Alamos Science, Special, vol.Issue, pp.125-130, 1987.

´. E. Nadaraya, On non-parametric estimates of density functions and regression curves. Theory of Probability & Its Applications, pp.186-190, 1965.

A. Nemirovski and A. Shapiro, Convex Approximations of Chance Constrained Programs, SIAM Journal on Optimization, vol.17, issue.4, pp.969-996, 2006.
DOI : 10.1137/050622328

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.392.4476

A. Prékopa, ON PROBABILISTIC CONSTRAINED PROGRAMMING, Proceedings of the Princeton Symposium on Mathematical Programming, pp.113-138, 1970.
DOI : 10.1515/9781400869930-009

A. Prékopa, Contributions to the theory of stochastic programming, Mathematical Programming, pp.202-221, 1973.
DOI : 10.1007/BF01584661

A. Prékopa, Stochastic programming, 1995.
DOI : 10.1007/978-94-017-3087-7

A. Prékopa, Probabilistic Programming, Stochastic programming, 2003.
DOI : 10.1016/S0927-0507(03)10005-9

M. L. Puterman and S. L. Brumelle, On the Convergence of Policy Iteration in Stationary Dynamic Programming, Mathematics of Operations Research, vol.4, issue.1, pp.60-69, 1979.
DOI : 10.1287/moor.4.1.60

M. L. Puterman and M. C. Shin, Modified Policy Iteration Algorithms for Discounted Markov Decision Problems, Management Science, vol.24, issue.11, pp.1127-1137, 1978.
DOI : 10.1287/mnsc.24.11.1127

E. Raik, Qualitative research into the stochastic nonlinear programming problems, pp.8-14, 1971.

S. Ross, A First Course in Probability. Pearson, 9-th edition, 2014.

M. S. Santos and J. Rust, Convergence Properties of Policy Iteration, SIAM Journal on Control and Optimization, vol.42, issue.6, pp.2094-2115, 2004.
DOI : 10.1137/S0363012902399824

A. Sassi, Tecniche di programmazione dinamica nell'ottimizzazione di sistemi di controllo ibridi, 2013.

R. Serra, Opérations de proximité en orbite : ´ evaluation du risque de collision et calcul de manoeuvres optimales pour l'´ evitement et le rendez-vous, 2015.

R. Serra, D. Arzelier, M. Joldes, and A. Rondepierre, Probabilistic Collision Avoidance for Long-term Space Encounters via Risk Selection, Advances in Aerospace Guidance, Navigation and Control, 2015.
DOI : 10.1007/978-3-319-17518-8_39

J. A. Sethian and A. Vladimirsky, Fast methods for the Eikonal and related Hamilton- Jacobi equations on unstructured meshes, Proceedings of the National Academy of Sciences, vol.95, issue.18, pp.5699-5703, 2000.
DOI : 10.1109/9.412624

J. A. Sethian and A. Vladimirsky, Ordered Upwind Methods for Hybrid Control, Hybrid Systems: Computation and Control, 2002.
DOI : 10.1007/3-540-45873-5_31

S. J. Sheather, Density Estimation, Statistical Science, vol.19, issue.4, pp.588-597, 2004.
DOI : 10.1214/088342304000000297

B. W. Silverman, Density Estimation for Statistics and Data Analysis, 1986.
DOI : 10.1007/978-1-4899-3324-9

S. Uryasev, Derivatives of probability functions and some applications, Annals of Operations Research, vol.10, issue.1, pp.287-311, 1995.
DOI : 10.1080/17442508308833246

W. Van-ackooij and R. Henrion, Gradient Formulae for Nonlinear Probabilistic Constraints with Gaussian and Gaussian-Like Distributions, SIAM Journal on Optimization, vol.24, issue.4, pp.1864-1889, 2014.
DOI : 10.1137/130922689

A. Wächter and L. T. Biegler, On the implementation of an interiorpoint filter line-search algorithm for large-scale nonlinear programming, Mathematical Programming, pp.25-57, 2006.

A. Wald, Contributions to the Theory of Statistical Estimation and Testing Hypotheses, The Annals of Mathematical Statistics, vol.10, issue.4, pp.299-326, 1939.
DOI : 10.1214/aoms/1177732144

D. M. Young and R. T. Gregory, A survey of numerical mathematics, 1972.

H. Zhang and M. R. James, Optimal Control of Hybrid Systems and a System of Quasi-Variational Inequalities, SIAM Journal on Control and Optimization, vol.45, issue.2, pp.722-761, 2006.
DOI : 10.1137/050630131