This paper proposes an intuitive,modular teaching framework for dynamic programming(DP).Beginning with the fundamental concept of recursion,the framework leverages dependency graphs to visually illustrate structural r...This paper proposes an intuitive,modular teaching framework for dynamic programming(DP).Beginning with the fundamental concept of recursion,the framework leverages dependency graphs to visually illustrate structural relationships among subproblems.This visual approach helps students intuitively grasp the underlying logic of tabulation,enabling them to independently determine correct tabulation orders.The plug-and-play design significantly reduces the barrier to learning,while strengthening students'analytical thinking and problem-solving skills.The effectiveness of this method is demonstrated through classroom application using classic examples such as the longest common subsequence(LCS),matrix chain multiplication(MCM),and rod cutting problems.展开更多
The investment decision making of Project Gang, the projects that are associated with one another on economy and technique, is studied. In order to find out the best Scheme that can make the maximum profit, a dynamic ...The investment decision making of Project Gang, the projects that are associated with one another on economy and technique, is studied. In order to find out the best Scheme that can make the maximum profit, a dynamic programming algorithm on the investment decision making of Project Gang is brought forward, and this algorithm can find out the best Scheme of distributing the m resources to the n Items in the time of O(m 2 n).展开更多
The hydro unit economic load dispatch (ELD) is of great importance in energy conservation and emission reduction. Dynamic programming (DP) and genetic algorithm (GA) are two representative algorithms for solving...The hydro unit economic load dispatch (ELD) is of great importance in energy conservation and emission reduction. Dynamic programming (DP) and genetic algorithm (GA) are two representative algorithms for solving ELD problems. The goal of this study was to examine the performance of DP and GA while they were applied to ELD. We established numerical experiments to conduct performance comparisons between DP and GA with two given schemes. The schemes included comparing the CPU time of the algorithms when they had the same solution quality, and comparing the solution quality when they had the same CPU time. The numerical experiments were applied to the Three Gorges Reservoir in China, which is equipped with 26 hydro generation units. We found the relation between the performance of algorithms and the number of units through experiments. Results show that GA is adept at searching for optimal solutions in low-dimensional cases. In some cases, such as with a number of units of less than 10, GA's performance is superior to that of a coarse-grid DP. However, GA loses its superiority in high-dimensional cases. DP is powerful in obtaining stable and high-quality solutions. Its performance can be maintained even while searching over a large solution space. Nevertheless, due to its exhaustive enumerating nature, it costs excess time in low-dimensional cases.展开更多
A good hybrid vehicle control strategy cannot only meet the power requirements of the vehicle,but also effectively save fuel and reduce emissions.In this paper,the construction of model predictive control in hybrid el...A good hybrid vehicle control strategy cannot only meet the power requirements of the vehicle,but also effectively save fuel and reduce emissions.In this paper,the construction of model predictive control in hybrid electric vehicle is proposed.The solving process and the use of reference trajectory are discussed for the application of MPC based on dynamic programming algorithm.The simulation of hybrid electric vehicle is carried out under a specific working condition.The simulation results show that the control strategy can effectively reduce fuel consumption when the torque of engine and motor is reasonably distributed,and the effectiveness of the control strategy is verified.展开更多
We deal with the problem of sharing vehicles by individuals with similar itineraries which is to find the minimum number of drivers, each of which has a vehicle capacity and a detour to realize all trips. Recently, Gu...We deal with the problem of sharing vehicles by individuals with similar itineraries which is to find the minimum number of drivers, each of which has a vehicle capacity and a detour to realize all trips. Recently, Gu et al. showed that the problem is NP-hard even for star graphs restricted with unique destination, and gave a polynomial-time algorithm to solve the problem for paths restricted with unique destination and zero detour. In this paper we will give a dynamic programming algorithm to solve the problem in polynomial time for trees restricted with unique destination and zero detour. In our best knowledge it is a first polynomial-time algorithm for trees.展开更多
This paper addresses a dynamic vehicle routing problem with stochastic requests in a dual-channel distribution center that utilizes shared vehicle resources to serve two types of customers:offline corporate clients(CC...This paper addresses a dynamic vehicle routing problem with stochastic requests in a dual-channel distribution center that utilizes shared vehicle resources to serve two types of customers:offline corporate clients(CCs)with fixed and stochastic batch demands,and online individual customers(ICs)with single-unit demands.To manage stochastic batch demands from CCs,this paper proposes three recourse policies under a differentiated resource-sharing scheme:the waiting-tour-based(WTB)policy,the advance-tour-based(ATB)policy,and the advance-customer-based(ACB)policy.These policies differ in their response priorities to random requests and the scope of route reoptimization.The problem is formulated as a two-stage stochastic recourse programming model,where the first stage establishes routes for fixed demands.In the second stage,we construct three stochastic recourse programming models corresponding to the proposed recourse policies.To solve these models,this paper develop rolling horizon algorithms integrated with mathematical programming models or metaheuristic algorithms.Extensive numerical experiments validate the effectiveness of the proposed algorithms and policies.The results indicate that both the ATB and ACB policies lead to cost savings compared to the WTB policy,especially when stochastic demands are urgent and delivery resources are quite limited.Specifically,when the number of ICs is small,the expected total cost savings can exceed 12%,and in some scenarios,savings of over 20%can be achieved.When the number of ICs is large,some scenarios can achieve cost savings exceeding 7%.Furthermore,the ACB policy yields lower costs,fewer worsened ICs,fewer trips,and less vehicle time than the ATB policy.展开更多
The optimization of the control strategy of a plug-in hybrid electric bus(PHEB) for the repeatedly driven bus route is a key technique to improve the fuel economy. The widely used rule-based(RB) control strategy is la...The optimization of the control strategy of a plug-in hybrid electric bus(PHEB) for the repeatedly driven bus route is a key technique to improve the fuel economy. The widely used rule-based(RB) control strategy is lacking in the global optimization property, while the global optimization algorithms have an unacceptable computation complexity for real-time application. Therefore, a novel hybrid dynamic programming-rule based(DPRB) algorithm is brought forward to solve the global energy optimization problem in a real-time controller of PHEB. Firstly, a control grid is built up for a given typical city bus route, according to the station locations and discrete levels of battery state of charge(SOC). Moreover, the decision variables for the energy optimization at each point of the control grid might be deduced from an off-line dynamic programming(DP) with the historical running information of the driving cycle. Meanwhile, the genetic algorithm(GA) is adopted to replace the quantization process of DP permissible control set to reduce the computation burden. Secondly, with the optimized decision variables as control parameters according to the position and battery SOC of a PHEB, a RB control is used as an implementable controller for the energy management. Simulation results demonstrate that the proposed DPRB might distribute electric energy more reasonably throughout the bus route, compared with the optimized RB. The proposed hybrid algorithm might give a practicable solution, which is a tradeoff between the applicability of RB and the global optimization property of DP.展开更多
A properly designed public transport system is expected to improve traffic efficiency.A high-frequency bus service would decrease the waiting time for passengers,but the interaction between buses and cars might result...A properly designed public transport system is expected to improve traffic efficiency.A high-frequency bus service would decrease the waiting time for passengers,but the interaction between buses and cars might result in more serious congestion.On the other hand,a low-frequency bus service would increase the waiting time for passengers and would not reduce the use of private cars.It is important to strike a balance between high and low frequencies in order to minimize the total delays for all road users.It is critical to formulate the impacts of bus frequency on congestion dynamics and mode choices.However,as far as the authors know,most proposed bus frequency optimization formulations are based on static demand and the Bureau of Public Roads function,and do not properly consider the congestion dynamics and their impacts on mode choices.To fill this gap,this paper proposes a bi-level optimization model.A three-dimensional Macroscopic Fundamental Diagram based modeling approach is developed to capture the bi-modal congestion dynamics.A variational inequality model for the user equilibrium in mode choices is presented and solved using a double projection algorithm.A surrogate model-based algorithm is used to solve the bi-level programming problem.展开更多
The mathematical and statistical modeling of the problem of poverty is a major challenge given Burundi’s economic development. Innovative economic optimization systems are widely needed to face the problem of the dyn...The mathematical and statistical modeling of the problem of poverty is a major challenge given Burundi’s economic development. Innovative economic optimization systems are widely needed to face the problem of the dynamic of the poverty in Burundi. The Burundian economy shows an inflation rate of -1.5% in 2018 for the Gross Domestic Product growth real rate of 2.8% in 2016. In this research, the aim is to find a model that contributes to solving the problem of poverty in Burundi. The results of this research fill the knowledge gap in the modeling and optimization of the Burundian economic system. The aim of this model is to solve an optimization problem combining the variables of production, consumption, budget, human resources and available raw materials. Scientific modeling and optimal solving of the poverty problem show the tools for measuring poverty rate and determining various countries’ poverty levels when considering advanced knowledge. In addition, investigating the aspects of poverty will properly orient development aid to developing countries and thus, achieve their objectives of growth and the fight against poverty. This paper provides a new and innovative framework for global scientific research regarding the multiple facets of this problem. An estimate of the poverty rate allows good progress with the theory and optimization methods in measuring the poverty rate and achieving sustainable development goals. By comparing the annual food production and the required annual consumption, there is an imbalance between different types of food. Proteins, minerals and vitamins produced in Burundi are sufficient when considering their consumption as required by the entire Burundian population. This positive contribution for the latter comes from the fact that some cows, goats, fishes, ···, slaughtered in Burundi come from neighboring countries. Real production remains in deficit. The lipids, acids, calcium, fibers and carbohydrates produced in Burundi are insufficient for consumption. This negative contribution proves a Burundian food deficit. It is a decision-making indicator for the design and updating of agricultural policy and implementation programs as well as projects. Investment and economic growth are only possible when food security is mastered. The capital allocated to food investment must be revised upwards. Demographic control is also a relevant indicator to push forward Burundi among the emerging countries in 2040. Meanwhile, better understanding of the determinants of poverty by taking cultural and organizational aspects into account guides managers for poverty reduction projects and programs.展开更多
This paper proposes a model-free online value iteration(VI)algorithm for solving stochastic linear quadratic control problems with ergodic cost functions,where the diffusion term in the dynamics equation is influenced...This paper proposes a model-free online value iteration(VI)algorithm for solving stochastic linear quadratic control problems with ergodic cost functions,where the diffusion term in the dynamics equation is influenced by both the state and control variables.First,we propose an offline VI algorithm based on the idea of stochastic approximation.However,this algorithm requires prior knowledge of the system parameters,which are not always readily available.To overcome this limitation,we then develop a(partially)model-free online learning algorithm based on VI.This algorithm only requires a single system trajectory and does not need the initial control to be stabilizing.By exploiting the growth rate of Itô’s integrals to handle the stochastic term generated by multiplicative noise,we provide a rigorous proof of the algorithm’s convergence.Finally,a simulation example is presented to validate the convergence of the proposed algorithms.展开更多
摘要This paper proposes an intuitive,modular teaching framework for dynamic programming(DP).Beginning with the fundamental concept of recursion,the framework leverages dependency graphs to visually illustrate structural relationships among subproblems.This visual approach helps students intuitively grasp the underlying logic of tabulation,enabling them to independently determine correct tabulation orders.The plug-and-play design significantly reduces the barrier to learning,while strengthening students'analytical thinking and problem-solving skills.The effectiveness of this method is demonstrated through classroom application using classic examples such as the longest common subsequence(LCS),matrix chain multiplication(MCM),and rod cutting problems.
摘要The investment decision making of Project Gang, the projects that are associated with one another on economy and technique, is studied. In order to find out the best Scheme that can make the maximum profit, a dynamic programming algorithm on the investment decision making of Project Gang is brought forward, and this algorithm can find out the best Scheme of distributing the m resources to the n Items in the time of O(m 2 n).
基金supported by the National Basic Research Program of China(973 Program,Grant No.2013CB036406)the National Natural Science Foundation of China(Grant No.51179044)the Research Innovation Program for College Graduates in Jiangsu Province of China(Grant No.CXZZ12-0242)
摘要The hydro unit economic load dispatch (ELD) is of great importance in energy conservation and emission reduction. Dynamic programming (DP) and genetic algorithm (GA) are two representative algorithms for solving ELD problems. The goal of this study was to examine the performance of DP and GA while they were applied to ELD. We established numerical experiments to conduct performance comparisons between DP and GA with two given schemes. The schemes included comparing the CPU time of the algorithms when they had the same solution quality, and comparing the solution quality when they had the same CPU time. The numerical experiments were applied to the Three Gorges Reservoir in China, which is equipped with 26 hydro generation units. We found the relation between the performance of algorithms and the number of units through experiments. Results show that GA is adept at searching for optimal solutions in low-dimensional cases. In some cases, such as with a number of units of less than 10, GA's performance is superior to that of a coarse-grid DP. However, GA loses its superiority in high-dimensional cases. DP is powerful in obtaining stable and high-quality solutions. Its performance can be maintained even while searching over a large solution space. Nevertheless, due to its exhaustive enumerating nature, it costs excess time in low-dimensional cases.
基金This work was supported by the youth backbone teachers training program of Henan colleges and universities under Grant No.2016ggjs-287the project of science and technology of Henan province under Grant Nos.172102210124,202102210269the Key Scientific Research projects in Colleges and Universities in Henan(Grant No.18B460003).
摘要A good hybrid vehicle control strategy cannot only meet the power requirements of the vehicle,but also effectively save fuel and reduce emissions.In this paper,the construction of model predictive control in hybrid electric vehicle is proposed.The solving process and the use of reference trajectory are discussed for the application of MPC based on dynamic programming algorithm.The simulation of hybrid electric vehicle is carried out under a specific working condition.The simulation results show that the control strategy can effectively reduce fuel consumption when the torque of engine and motor is reasonably distributed,and the effectiveness of the control strategy is verified.
摘要We deal with the problem of sharing vehicles by individuals with similar itineraries which is to find the minimum number of drivers, each of which has a vehicle capacity and a detour to realize all trips. Recently, Gu et al. showed that the problem is NP-hard even for star graphs restricted with unique destination, and gave a polynomial-time algorithm to solve the problem for paths restricted with unique destination and zero detour. In this paper we will give a dynamic programming algorithm to solve the problem in polynomial time for trees restricted with unique destination and zero detour. In our best knowledge it is a first polynomial-time algorithm for trees.
基金supported by the National Natural Science Foundation of China(71991464/71991460,72301261,72001066)2024 Anhui Province High-end Talent Introduction and Cultivation Project.
摘要This paper addresses a dynamic vehicle routing problem with stochastic requests in a dual-channel distribution center that utilizes shared vehicle resources to serve two types of customers:offline corporate clients(CCs)with fixed and stochastic batch demands,and online individual customers(ICs)with single-unit demands.To manage stochastic batch demands from CCs,this paper proposes three recourse policies under a differentiated resource-sharing scheme:the waiting-tour-based(WTB)policy,the advance-tour-based(ATB)policy,and the advance-customer-based(ACB)policy.These policies differ in their response priorities to random requests and the scope of route reoptimization.The problem is formulated as a two-stage stochastic recourse programming model,where the first stage establishes routes for fixed demands.In the second stage,we construct three stochastic recourse programming models corresponding to the proposed recourse policies.To solve these models,this paper develop rolling horizon algorithms integrated with mathematical programming models or metaheuristic algorithms.Extensive numerical experiments validate the effectiveness of the proposed algorithms and policies.The results indicate that both the ATB and ACB policies lead to cost savings compared to the WTB policy,especially when stochastic demands are urgent and delivery resources are quite limited.Specifically,when the number of ICs is small,the expected total cost savings can exceed 12%,and in some scenarios,savings of over 20%can be achieved.When the number of ICs is large,some scenarios can achieve cost savings exceeding 7%.Furthermore,the ACB policy yields lower costs,fewer worsened ICs,fewer trips,and less vehicle time than the ATB policy.
基金supported by the National Natural Science Foundation of China(Grant No.51275557,5142505)the National Science-Technology Support Plan Projects of China(Grant No.2013BAG14B01)
摘要The optimization of the control strategy of a plug-in hybrid electric bus(PHEB) for the repeatedly driven bus route is a key technique to improve the fuel economy. The widely used rule-based(RB) control strategy is lacking in the global optimization property, while the global optimization algorithms have an unacceptable computation complexity for real-time application. Therefore, a novel hybrid dynamic programming-rule based(DPRB) algorithm is brought forward to solve the global energy optimization problem in a real-time controller of PHEB. Firstly, a control grid is built up for a given typical city bus route, according to the station locations and discrete levels of battery state of charge(SOC). Moreover, the decision variables for the energy optimization at each point of the control grid might be deduced from an off-line dynamic programming(DP) with the historical running information of the driving cycle. Meanwhile, the genetic algorithm(GA) is adopted to replace the quantization process of DP permissible control set to reduce the computation burden. Secondly, with the optimized decision variables as control parameters according to the position and battery SOC of a PHEB, a RB control is used as an implementable controller for the energy management. Simulation results demonstrate that the proposed DPRB might distribute electric energy more reasonably throughout the bus route, compared with the optimized RB. The proposed hybrid algorithm might give a practicable solution, which is a tradeoff between the applicability of RB and the global optimization property of DP.
基金supported by the National Natural Science Foundation of China(Grant No.72201088,71871077,71925001)the Fundamental Research Funds for the Central Universities of China(Grant No.PA2022GDSK0040,JZ2023YQTD0073),which are gratefully acknowledged.
摘要A properly designed public transport system is expected to improve traffic efficiency.A high-frequency bus service would decrease the waiting time for passengers,but the interaction between buses and cars might result in more serious congestion.On the other hand,a low-frequency bus service would increase the waiting time for passengers and would not reduce the use of private cars.It is important to strike a balance between high and low frequencies in order to minimize the total delays for all road users.It is critical to formulate the impacts of bus frequency on congestion dynamics and mode choices.However,as far as the authors know,most proposed bus frequency optimization formulations are based on static demand and the Bureau of Public Roads function,and do not properly consider the congestion dynamics and their impacts on mode choices.To fill this gap,this paper proposes a bi-level optimization model.A three-dimensional Macroscopic Fundamental Diagram based modeling approach is developed to capture the bi-modal congestion dynamics.A variational inequality model for the user equilibrium in mode choices is presented and solved using a double projection algorithm.A surrogate model-based algorithm is used to solve the bi-level programming problem.
摘要The mathematical and statistical modeling of the problem of poverty is a major challenge given Burundi’s economic development. Innovative economic optimization systems are widely needed to face the problem of the dynamic of the poverty in Burundi. The Burundian economy shows an inflation rate of -1.5% in 2018 for the Gross Domestic Product growth real rate of 2.8% in 2016. In this research, the aim is to find a model that contributes to solving the problem of poverty in Burundi. The results of this research fill the knowledge gap in the modeling and optimization of the Burundian economic system. The aim of this model is to solve an optimization problem combining the variables of production, consumption, budget, human resources and available raw materials. Scientific modeling and optimal solving of the poverty problem show the tools for measuring poverty rate and determining various countries’ poverty levels when considering advanced knowledge. In addition, investigating the aspects of poverty will properly orient development aid to developing countries and thus, achieve their objectives of growth and the fight against poverty. This paper provides a new and innovative framework for global scientific research regarding the multiple facets of this problem. An estimate of the poverty rate allows good progress with the theory and optimization methods in measuring the poverty rate and achieving sustainable development goals. By comparing the annual food production and the required annual consumption, there is an imbalance between different types of food. Proteins, minerals and vitamins produced in Burundi are sufficient when considering their consumption as required by the entire Burundian population. This positive contribution for the latter comes from the fact that some cows, goats, fishes, ···, slaughtered in Burundi come from neighboring countries. Real production remains in deficit. The lipids, acids, calcium, fibers and carbohydrates produced in Burundi are insufficient for consumption. This negative contribution proves a Burundian food deficit. It is a decision-making indicator for the design and updating of agricultural policy and implementation programs as well as projects. Investment and economic growth are only possible when food security is mastered. The capital allocated to food investment must be revised upwards. Demographic control is also a relevant indicator to push forward Burundi among the emerging countries in 2040. Meanwhile, better understanding of the determinants of poverty by taking cultural and organizational aspects into account guides managers for poverty reduction projects and programs.
基金supported by the National Natural Science Foundation of China(Grants No.62573266 and 62192753)the Natural Science Foundation of Shandong Province for Distinguished Young Scholars(Grant No.ZR2022JQ31).
摘要This paper proposes a model-free online value iteration(VI)algorithm for solving stochastic linear quadratic control problems with ergodic cost functions,where the diffusion term in the dynamics equation is influenced by both the state and control variables.First,we propose an offline VI algorithm based on the idea of stochastic approximation.However,this algorithm requires prior knowledge of the system parameters,which are not always readily available.To overcome this limitation,we then develop a(partially)model-free online learning algorithm based on VI.This algorithm only requires a single system trajectory and does not need the initial control to be stabilizing.By exploiting the growth rate of Itô’s integrals to handle the stochastic term generated by multiplicative noise,we provide a rigorous proof of the algorithm’s convergence.Finally,a simulation example is presented to validate the convergence of the proposed algorithms.