Blog posts

2024

Presenting at JuMP-dev 2024 and Publishing in JuliaCon 2023 Proceedings

3 minute read

Published:

I’m thrilled to share two major milestones in my recent work within the Julia ecosystem. First, I presented the latest developments in optimization solvers at JuMP-dev 2024, and second, my paper on JSOSuite.jl was accepted in The Proceedings of the JuliaCon Conferences.

These two achievements highlight both the ongoing evolution of JuliaSmoothOptimizers (JSO) and its growing impact on large-scale nonlinear optimization problems.

JuMP-dev 2024: Advancing Nonlinear Optimization with JuliaSmoothOptimizers

This year’s JuMP-dev workshop, held independently from JuliaCon for the first time in Montreal, offered a focused platform for deep dives into JuMP and its surrounding tools. In my presentation, I discussed the latest progress within the JuliaSmoothOptimizers (JSO) ecosystem, my slides and the replay.

At the core of my talk was an introduction to new solvers and packages like AdaptiveRegularization.jl, which address the unique challenges of large-scale optimization problems with Adaptive Regularization with Cubics. I emphasized the following key innovations:

  • Automatic Differentiation (AD) support and integration with JuMP for easier problem modeling.
  • Memory pre-allocation for in-place solvers, reducing runtime overhead.
  • Support for multi-precision solvers and GPU-based computations, essential for modern large-scale applications.
  • The value of factorization-free solvers, which excel in tackling large, complex problems, such as those in discretized PDE-constrained optimization.

For newcomers to JSO, JSOSuite.jl serves as a critical entry point, simplifying solver selection and benchmarking through automatic algorithm matching. This tool eliminates the complexity of choosing from multiple solvers by providing a user-friendly interface that adapts to the problem at hand. My talk also touched on the broader adoption and longevity of JSO, which now spans over 50 registered packages, making it one of the most comprehensive platforms for numerical optimization.

JuliaCon 2023: JSOSuite.jl – Simplifying Continuous Optimization

While JuMP-dev 2024 focused on recent developments, my publication in The Proceedings of the JuliaCon Conferences looks at the core philosophy and implementation behind JSOSuite.jl. Titled JSOSuite.jl: Solving Continuous Optimization Problems with JuliaSmoothOptimizers, the paper introduces JSOSuite.jl as a package designed to bring ease-of-use to complex optimization challenges.

JSOSuite.jl covers a range of problem types—from unconstrained to generally-constrained and least-squares problems—and eliminates the need for users to understand the intricate details of individual solvers. Instead, the package conducts a preliminary analysis of the problem and automatically selects the most appropriate solver, offering significant advantages to both experienced practitioners and newcomers alike.

This paper builds on the innovations within JSO, reinforcing its versatility and ease of use across various fields and applications. The package is a natural fit for researchers who need efficient, reliable solvers without the overhead of manually configuring them for different problem types.

Looking Forward

Both my presentation at JuMP-dev 2024 and the publication of the JSOSuite.jl paper reflect the significant strides made by the JuliaSmoothOptimizers organization over the past year. The JSO ecosystem is positioned to continue driving innovation in the field of numerical optimization.

I’m excited to see how these advancements will be applied across diverse optimization problems in the coming years and look forward to continuing this journey with the JSO community.

New Preprint on HAL: Exploring Projected Dynamical Systems in Geochemical Reactions

1 minute read

Published:

This project holds a special place in my heart as it touches on the very applications in geochemistry that first drew me into research. Equilibrium reactions, particularly in slow processes like the water cycle in aquifers, have always fascinated me. Moreover, this paper represents an important milestone for one of the authors, Bastien, as it was part of his Ph.D. thesis. The use of projected dynamical systems, a model I am particularly fond of, adds an additional layer of personal significance to this work.

2023

ARCqK published in Mathematical Programming

3 minute read

Published:

I am thrilled to share that the article Scalable adaptive cubic regularization methods has been published in the journal Mathematical Programming, Series A. This has been a really exciting journey with my co-authors Jean-Pierre Dussault and Dominique Orban on this really exciting work that I hope will help explore the numerical possibilities of ARC methods. The proposed implementation is a perfect fit for large-scale application as it solves the subproblem inexactly and only required Hessian-vector products, so no need to evaluate and store the Hessian matrix. As usual, the code has been done in Julia and is available in the folder paper in the Github repository AdaptiveRegularization.jl. Full text published version available from here, enjoy!

Looking Back at the Winter Session

4 minute read

Published:

In the world of numerical optimization, the quest for efficiency, accuracy, and innovation never ceases. At Polytechnique Montréal, students embarking on their educational journey have a unique opportunity to explore this dynamic field through the course MTH8408 Méthodes d’optimisation et contrôle optimal. This course, which I had the privilege of teaching during the winter session of 2023, delves into the depths of numerical methods for optimization, variational calculus, and optimal control.

Unveiling JuliaSmoothOptimizers at JuMP-dev Workshop, JuliaCon 2023

2 minute read

Published:

I am thrilled to share my experiences from the recent JuMP-dev workshop that took place at the JuliaCon 2023, held at MIT in Boston, USA. As a passionate researcher in the field of numerical optimization, this year’s conference was particularly special for me, as it marked my first in-person attendance after the previous year’s online edition (read about it here). You can check the replay of my talk on youtube.

2022

PDENLPModels.jl published in JOSS

4 minute read

Published:

I am very happy to announce the publication in the Journal of Open Source Software of the paper PDENLPModels.jl: A NLPModel API for optimization problems with PDE-constraints.

A new package: FletcherPenaltySolver.jl

2 minute read

Published:

The package FletcherPenaltySolver.jl is now a Julia package !! Very happy about this one because it has been a long project and the solver with great for large problems. Besides, we always teach penalty methods at the University, but efficient implementations are scarce.

Looking Back at the Winter Session

less than 1 minute read

Published:

I taught in french the class MTH8408 Méthodes d’optimisation et contrôle optimal during the winter session at Polytechnique Montréal on numerical methods for optimization, variational calculus, and optimal control.

Partially differentiable projects

1 minute read

Published:

I am starting a new year in Montreal and one of the main projects for this year is to move forward in finalizing an ecosystem for optimization problems with partial differential equations in the constraints. The ecosystem is hosted under the JuliaSmoothOptimizers umbrella and contains:

2021

A new package: RandomLinearAlgebraSolvers.jl

1 minute read

Published:

The package RandomLinearAlgebraSolvers.jl is now a Julia package. It contains randomized iterative methods for linear algebra and random projectors used to solve linear systems in the sense of the Johnson–Lindenstrauss lemma. The package is still at an early stage and new contributions are very welcome. You will find below an example extracted from the package’s documentation. The package uses Stopping.jl as a framework for iterative methods.

IVADO, Digital October

less than 1 minute read

Published:

As part of my postdoc at IVADO, I presented my work on solving PDE-constrained optimization problems in Julia during IVADO’s annual conference, IVADO Digital October. It was a 3min presentation, and a great challenge for such challenging problem! The video is now available on Youtube, and, as usual, more on the various packages on GitHub @tmigot.

2020

New Position in Montréal

less than 1 minute read

Published:

I am starting a new postdoc position in Polytechnique Montréal with Dominique Orban on solvers for optimization problems involving PDE constraints in Julia and data science applications. This new position is funded by a competitive grant of IVADO, the institute for data valorization in Montreal.

Summer 2020 Publications

less than 1 minute read

Published:

Two publications have been accepted this summer: On approximate stationary points of the regularized mathematical program with complementarity constraints in JOTA and The new butterfly relaxation method for mathematical programs with complementarity constraints in the proceedings of the Indo-French seminar. These works are the theoretical basis toward the computation of M-stationary points of the MPCC. I also continue to update the Julia:

  • MPCC.jl Set of tools to model the mathematical program with complementarity/switching/vanishing constraints following the NLPModels structure and with basic tools to use the Stopping framework.
  • MPCCSolver.jl A set of algorithms to solve the models from MPCC.jl.

I also had the pleasure to present A differential inclusion approach to mineral precipitation-dissolution reactions in geochemistry in collaboration with Jocelyne Erhel and Bastien Hamlat in the online Workshop Variational Methods in Nonlinear Phenomena. This work is part of Bastien’s Ph.D. thesis that he successfully defended this month, Congrats!!!

Conference in Toronto [Update]

less than 1 minute read

Published:

The workshop has now evolved as an online workshop to maintain active researches despite the current pandemic, see the schedule here!

Winter 2020 Seminars and a publication

less than 1 minute read

Published:

To celebrate the new year, I gave in January a seminar talk at the Departmental Colloquium Series in Guelph where I motivated the GNEP and presented some of our findings with Monica Cojocaru. In particular, it was based on this new paper we got accepted A dynamical system approach to the generalized Nash equilibrium problem in the open access Journal of Nonlinear and Variational Analysis. The paper reviews the use of nonsmooth dynamical system to find generalized Nash equilibria.

Stopping v.0.2

5 minute read

Published:

The new version of Stopping.jl is now official on Julia. It is the first stable version of it, and I will now soon release more codes using it for MPCC and GNEP. Currently, the main page of the project is here: Stopping.jl

2019

Fall 2019 Publications

less than 1 minute read

Published:

I taught a new course in Guelph this Fall, and in the meantime, 3 papers have been accepted.

Summer 19 Talks

less than 1 minute read

Published:

I gave a couple of talks over the summer at the EURO conference 2019 EURO conference, Dublin, Ireland (and co-organize a stream on games with 18 talks!), the 2019 World Congress on Global Optimization, Metz, France, the 2019 ICCOPT, Berlin, Germany, the MOPTA 2019, Lehigh, USA and finally the AMMCS-2019, Waterloo, Ontario (co-organize of a special session on optimization). Now, back in Guelph for a second year and teach a new class this Fall.

Winter 19 Publications and a New Preprint

less than 1 minute read

Published:

This winter, I’m teaching a fun course in Guelph. In the meantime, several papers have been accepted for publication.

2018

New Position in Guelph

less than 1 minute read

Published:

I started a 2 years post-doc position in Guelph under the supervision of Monica Cojocaru. I will work on bringing optimization methods for Generalized Nash Equilibrium Problems.

New Position in Sherbrooke

less than 1 minute read

Published:

I am back in Sherbrooke for three months after winning a grant in the interdisciplinary program “Programme de bourses d’excellence pour étudiants étrangers” of FRQNT. I will continue working on a solver for degenerate non-linear programs in Julia in collaboration with Jean-Pierre Dussault.

New Position in INRIA

less than 1 minute read

Published:

I join the team FLUMINANCE at INRIA Rennes for a few months to work on dynamical complementarity problems with Jocelyne Erhel.

2017

PhD Defense

less than 1 minute read

Published:

I have successfully defended my PhD thesis in Rennes. You can find the slides here and the manuscript here.

Conference

less than 1 minute read

Published:

I gave a talk on regularization methods for MPCC and its extension to MPVC in ParaoptXI (19-22 september) in Prague. UPDATE: you can now find a preprint on this subject here. UPDATE 2: The paper is published in Optimization (doi:10.1080/02331934.2018.1542531)

Preprint

less than 1 minute read

Published:

I posted on HAL a work in collaboration with Jean-Pierre Dussault, Mounir Haddou, and Abdeslam Kadrani on relaxation methods for mathematical programs with complementarity constraints and the approximate resolution of their sub-problems entitled : How to Compute a Local Minimum of the MPCC. I will present part of this work during the conference EUROPT 2017 in Montréal.

2016

Talk INFORMS Annual Meeting

less than 1 minute read

Published:

I gave a talk about the butterfly relaxation method for mathematical programs with complementarity constraints at the INFORMS 2016 Annual Meeting, which were organized in the city of music Nashville (Tennessee, US) from 14 to 16 of November 2016, see the slides.

Talks and publications

less than 1 minute read

Published:

I gave a talk about interior point methods for monotone linear complementarity problems at the Journées SMAI-MODE 2016, which were organized in Toulouse from 23 to 25 of March 2016, see the slides. You can find a preprint of this work on HAL. UPDATE Jan. 2018: the paper has been accepted in Optimization Letters (doi: 10.1007/s11590-018-1241-2).