home.social

#optimizationtheory — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #optimizationtheory, aggregated by home.social.

fetched live
  1. `in this work we demonstrate, both theoretically and empirically, how to regularize a variational deep network implicitly via the optimization procedure, just as for standard deep learning. We fully characterize the inductive bias of (stochastic) gradient descent in the case of an overparametrized linear model as generalized variational inference and demonstrate the importance of the choice of parametrization.`

    arxiv.org/abs/2505.20235

    #ML #MachineLearning #OptimizationTheory #theory #math

  2. `in this work we demonstrate, both theoretically and empirically, how to regularize a variational deep network implicitly via the optimization procedure, just as for standard deep learning. We fully characterize the inductive bias of (stochastic) gradient descent in the case of an overparametrized linear model as generalized variational inference and demonstrate the importance of the choice of parametrization.`

    arxiv.org/abs/2505.20235

    #ML #MachineLearning #OptimizationTheory #theory #math

  3. `in this work we demonstrate, both theoretically and empirically, how to regularize a variational deep network implicitly via the optimization procedure, just as for standard deep learning. We fully characterize the inductive bias of (stochastic) gradient descent in the case of an overparametrized linear model as generalized variational inference and demonstrate the importance of the choice of parametrization.`

    arxiv.org/abs/2505.20235

    #ML #MachineLearning #OptimizationTheory #theory #math

  4. `in this work we demonstrate, both theoretically and empirically, how to regularize a variational deep network implicitly via the optimization procedure, just as for standard deep learning. We fully characterize the inductive bias of (stochastic) gradient descent in the case of an overparametrized linear model as generalized variational inference and demonstrate the importance of the choice of parametrization.`

    arxiv.org/abs/2505.20235

    #ML #MachineLearning #OptimizationTheory #theory #math

  5. `in this work we demonstrate, both theoretically and empirically, how to regularize a variational deep network implicitly via the optimization procedure, just as for standard deep learning. We fully characterize the inductive bias of (stochastic) gradient descent in the case of an overparametrized linear model as generalized variational inference and demonstrate the importance of the choice of parametrization.`

    arxiv.org/abs/2505.20235

    #ML #MachineLearning #OptimizationTheory #theory #math

  6. `We show that the Weierstrass method, like the well known #Newton method, is not generally convergent: there are open sets of #polynomials p of every degree d≥3 such that the dynamics of the Weierstrass method applied to p exhibits attracting periodic orbits.`

    arxiv.org/abs/2004.04777

    #rootFinding #optimizationTheory #optimization #computation #computing

  7. `We show that the Weierstrass method, like the well known #Newton method, is not generally convergent: there are open sets of #polynomials p of every degree d≥3 such that the dynamics of the Weierstrass method applied to p exhibits attracting periodic orbits.`

    arxiv.org/abs/2004.04777

    #rootFinding #optimizationTheory #optimization #computation #computing

  8. `We show that the Weierstrass method, like the well known #Newton method, is not generally convergent: there are open sets of #polynomials p of every degree d≥3 such that the dynamics of the Weierstrass method applied to p exhibits attracting periodic orbits.`

    arxiv.org/abs/2004.04777

    #rootFinding #optimizationTheory #optimization #computation #computing

  9. `We show that the Weierstrass method, like the well known #Newton method, is not generally convergent: there are open sets of #polynomials p of every degree d≥3 such that the dynamics of the Weierstrass method applied to p exhibits attracting periodic orbits.`

    arxiv.org/abs/2004.04777

    #rootFinding #optimizationTheory #optimization #computation #computing

  10. `As in #biological #bee colonies, a small number of scouts keeps exploring the solution space looking for new regions of high fitness (global search). The global #search procedure re-initialises the last ns-nb #flower patches with randomly generated solutions.`

    en.wikipedia.org/wiki/Bees_alg

    #optimization #optimizationTheory #globalOptimization #algorithm #algorithms #searchAlgorithm #algorithmicSearch

  11. `As in #biological #bee colonies, a small number of scouts keeps exploring the solution space looking for new regions of high fitness (global search). The global #search procedure re-initialises the last ns-nb #flower patches with randomly generated solutions.`

    en.wikipedia.org/wiki/Bees_alg

    #optimization #optimizationTheory #globalOptimization #algorithm #algorithms #searchAlgorithm #algorithmicSearch

  12. `As in #biological #bee colonies, a small number of scouts keeps exploring the solution space looking for new regions of high fitness (global search). The global #search procedure re-initialises the last ns-nb #flower patches with randomly generated solutions.`

    en.wikipedia.org/wiki/Bees_alg

    #optimization #optimizationTheory #globalOptimization #algorithm #algorithms #searchAlgorithm #algorithmicSearch

  13. `As in #biological #bee colonies, a small number of scouts keeps exploring the solution space looking for new regions of high fitness (global search). The global #search procedure re-initialises the last ns-nb #flower patches with randomly generated solutions.`

    en.wikipedia.org/wiki/Bees_alg

    #optimization #optimizationTheory #globalOptimization #algorithm #algorithms #searchAlgorithm #algorithmicSearch

  14. `According to George Dantzig, the duality theorem for linear optimization was conjectured by John von Neumann immediately after Dantzig presented the linear programming problem. Von Neumann noted that he was using information from his game theory, and conjectured that two person zero sum matrix game was equivalent to linear programming. Rigorous proofs were first published in 1948 by Albert W. Tucker and his group`

    en.wikipedia.org/wiki/Duality_

    #duality #optimization #optimizationTheory #ML #stats

  15. `According to George Dantzig, the duality theorem for linear optimization was conjectured by John von Neumann immediately after Dantzig presented the linear programming problem. Von Neumann noted that he was using information from his game theory, and conjectured that two person zero sum matrix game was equivalent to linear programming. Rigorous proofs were first published in 1948 by Albert W. Tucker and his group`

    en.wikipedia.org/wiki/Duality_

    #duality #optimization #optimizationTheory #ML #stats

  16. `According to George Dantzig, the duality theorem for linear optimization was conjectured by John von Neumann immediately after Dantzig presented the linear programming problem. Von Neumann noted that he was using information from his game theory, and conjectured that two person zero sum matrix game was equivalent to linear programming. Rigorous proofs were first published in 1948 by Albert W. Tucker and his group`

    en.wikipedia.org/wiki/Duality_

    #duality #optimization #optimizationTheory #ML #stats

  17. `According to George Dantzig, the duality theorem for linear optimization was conjectured by John von Neumann immediately after Dantzig presented the linear programming problem. Von Neumann noted that he was using information from his game theory, and conjectured that two person zero sum matrix game was equivalent to linear programming. Rigorous proofs were first published in 1948 by Albert W. Tucker and his group`

    en.wikipedia.org/wiki/Duality_

    #duality #optimization #optimizationTheory #ML #stats