The Near Space Hypersonic Vehicle(NSHV)features a unique design and propulsion system,achieving exceptional speed,range,and maneuverability,which challenge ground-based radars.Space-Based Radar(SBR)offers a breakthrou...The Near Space Hypersonic Vehicle(NSHV)features a unique design and propulsion system,achieving exceptional speed,range,and maneuverability,which challenge ground-based radars.Space-Based Radar(SBR)offers a breakthrough for tracking NSHV targets,with allweather operation and freedom from Earth's curvature,but faces complex coordinate transformations.Traditional models often overlook the NSHV's dynamic gliding trajectory,especially the impact of hidden control variables on maneuvering,causing mismatches during rapid motion changes.This paper proposes a refined tracking model unified in the ECEF coordinate frame,incorporating model parameters that implicitly encode control laws,and presents an ExpectationMaximization Multi-swarm Cooperative Particle Swarm Optimization(EM-MCPSO)framework for both NSHV tracking and model parameter estimation to address this problem.To minimize conversion errors,a transformation matrix directly represented by the state in the EarthCentered Earth-Fixed(ECEF)coordinate is derived.Then the hybrid aerodynamic acceleration coefficients are introduced to precisely describe the dynamic behaviors,formulating target tracking as a joint estimation problem of state and parameters within EM framework.Finally,a self-learning algorithm based on a master–slave structured PSO is proposed to solve the optimization of the conditional expectations of EM under strong nonlinearity,with a Proportional-Derivative(PD)controller accelerating convergence,and updating the population structure with historical data.Simulations of vertical gliding and horizontal maneuvers validate the algorithm's effectiveness.展开更多
This study presents a kinematic calibration method for exoskeletal inertial motion capture (EI-MoCap) system with considering the random colored noise such as gyroscopic drift.In this method, the geometric parameters ...This study presents a kinematic calibration method for exoskeletal inertial motion capture (EI-MoCap) system with considering the random colored noise such as gyroscopic drift.In this method, the geometric parameters are calibrated by the traditional calibration method at first. Then, in order to calibrate the parameters affected by the random colored noise, the expectation maximization (EM) algorithm is introduced. Through the use of geometric parameters calibrated by the traditional calibration method, the iterations under the EM framework are decreased and the efficiency of the proposed method on embedded system is improved. The performance of the proposed kinematic calibration method is compared to the traditional calibration method. Furthermore, the feasibility of the proposed method is verified on the EI-MoCap system. The simulation and experiment demonstrate that the motion capture precision is significantly improved by 16.79%and 7.16%respectively in comparison to the traditional calibration method.展开更多
A new parallel expectation-maximization (EM) algorithm is proposed for large databases. The purpose of the algorithm is to accelerate the operation of the EM algorithm. As a well-known algorithm for estimation in ge...A new parallel expectation-maximization (EM) algorithm is proposed for large databases. The purpose of the algorithm is to accelerate the operation of the EM algorithm. As a well-known algorithm for estimation in generic statistical problems, the EM algorithm has been widely used in many domains. But it often requires significant computational resources. So it is needed to develop more elaborate methods to adapt the databases to a large number of records or large dimensionality. The parallel EM algorithm is based on partial Esteps which has the standard convergence guarantee of EM. The algorithm utilizes fully the advantage of parallel computation. It was confirmed that the algorithm obtains about 2.6 speedups in contrast with the standard EM algorithm through its application to large databases. The running time will decrease near linearly when the number of processors increasing.展开更多
Intrusion detection is the investigation process of information about the system activities or its data to detect any malicious behavior or unauthorized activity.Most of the IDS implement K-means clustering technique ...Intrusion detection is the investigation process of information about the system activities or its data to detect any malicious behavior or unauthorized activity.Most of the IDS implement K-means clustering technique due to its linear complexity and fast computing ability.Nonetheless,it is Naïve use of the mean data value for the cluster core that presents a major drawback.The chances of two circular clusters having different radius and centering at the same mean will occur.This condition cannot be addressed by the K-means algorithm because the mean value of the various clusters is very similar together.However,if the clusters are not spherical,it fails.To overcome this issue,a new integrated hybrid model by integrating expectation maximizing(EM)clustering using a Gaussian mixture model(GMM)and naïve Bays classifier have been proposed.In this model,GMM give more flexibility than K-Means in terms of cluster covariance.Also,they use probabilities function and soft clustering,that’s why they can have multiple cluster for a single data.In GMM,we can define the cluster form in GMM by two parameters:the mean and the standard deviation.This means that by using these two parameters,the cluster can take any kind of elliptical shape.EM-GMM will be used to cluster data based on data activity into the corresponding category.展开更多
The quality of synthetic aperture radar(SAR)image degrades in the case of multiple imaging projection planes(IPPs)and multiple overlapping ship targets,and then the performance of target classification and recognition...The quality of synthetic aperture radar(SAR)image degrades in the case of multiple imaging projection planes(IPPs)and multiple overlapping ship targets,and then the performance of target classification and recognition can be influenced.For addressing this issue,a method for extracting ship targets with overlaps via the expectation maximization(EM)algorithm is pro-posed.First,the scatterers of ship targets are obtained via the target detection technique.Then,the EM algorithm is applied to extract the scatterers of a single ship target with a single IPP.Afterwards,a novel image amplitude estimation approach is pro-posed,with which the radar image of a single target with a sin-gle IPP can be generated.The proposed method can accom-plish IPP selection and targets separation in the image domain,which can improve the image quality and reserve the target information most possibly.Results of simulated and real mea-sured data demonstrate the effectiveness of the proposed method.展开更多
RBF-AR (radial basis function network-based autoregressive) model is reconstructed as a new type of general radial basis function (RBF) neural network, which has additional linear output weight layer in comparison...RBF-AR (radial basis function network-based autoregressive) model is reconstructed as a new type of general radial basis function (RBF) neural network, which has additional linear output weight layer in comparison with the traditional three-layer RBF network. The extended Kalman filter (EKF) algorithm for RBF training has low filtering accuracy and divergence because of unknown prior knowledge, such as noise covariance and initial states. To overcome the drawback, the expectation maximization (EM) algorithm is used to estimate the covariance matrices of noises and the initial states. The proposed method, called the EM-EKF (expectation-maximization extended Kalman filter) algorithm, which combines the expectation maximization, extended Kalman filtering and smoothing process, is developed to estimate the parameters of the RBF-AR model, the initial conditions and the noise variances simultaneously. It is shown by the simulation tests that the EM-EKF method for the reconstructed RBF-AR network provides better results than structured nonlinear parameter optimization method (SNPOM) and the EKF, especially in low SNR (signal noise ratio). Moreover, the EM-EKF method can accurately estimate the noise variance. F test indicates there is significant difference between results obtained by the SNPOM and the EM-EKF.展开更多
In this paper, a novel algorithm is presented for direction of arrival(DOA) estimation and array self-calibration in the presence of unknown mutual coupling. In order to highlight the relationship between the array ...In this paper, a novel algorithm is presented for direction of arrival(DOA) estimation and array self-calibration in the presence of unknown mutual coupling. In order to highlight the relationship between the array output and mutual coupling coefficients, we present a novel model of the array output with the unknown mutual coupling coefficients. Based on this model, we use the space alternating generalized expectation-maximization(SAGE) algorithm to jointly estimate the DOA parameters and the mutual coupling coefficients. Unlike many existing counterparts, our method requires neither calibration sources nor initial calibration information. At the same time,our proposed method inherits the characteristics of good convergence and high estimation precision of the SAGE algorithm. By numerical experiments we demonstrate that our proposed method outperforms the existing method for DOA estimation and mutual coupling calibration.展开更多
Aiming at the problems of low measurement accuracy,uncertainty and nonlinearity of random noise of the micro electro mechanical system(MEMS)gyroscope,a gyroscope noise estimation and filtering method is proposed,which...Aiming at the problems of low measurement accuracy,uncertainty and nonlinearity of random noise of the micro electro mechanical system(MEMS)gyroscope,a gyroscope noise estimation and filtering method is proposed,which combines expectation maximum(EM)with maximum a posterior(MAP)to form an adpative unscented Kalman filter(UKF),called EMMAP-UKF.According to the MAP estimation principle,a suboptimal unbiased MAP noise statistical estimation model is constructed.Then,EM algorithm is introduced to transform the noise estimation problem into the mathematical expectation maximization problem,which can dynamically adjust the variance of the observed noise.Finally,the estimation and filtering of gyroscope random drift error can be realized.The performance of the gyro noise filtering method is evaluated by Allan variance,and the effectiveness of the method is verified by hardware-in-the-loop simulation.展开更多
Classical survival analysis assumes all subjects will experience the event of interest, but in some cases, a portion of the population may never encounter the event. These survival methods further assume independent s...Classical survival analysis assumes all subjects will experience the event of interest, but in some cases, a portion of the population may never encounter the event. These survival methods further assume independent survival times, which is not valid for honey bees, which live in nests. The study introduces a semi-parametric marginal proportional hazards mixture cure (PHMC) model with exchangeable correlation structure, using generalized estimating equations for survival data analysis. The model was tested on clustered right-censored bees survival data with a cured fraction, where two bee species were subjected to different entomopathogens to test the effect of the entomopathogens on the survival of the bee species. The Expectation-Solution algorithm is used to estimate the parameters. The study notes a weak positive association between cure statuses (ρ1=0.0007) and survival times for uncured bees (ρ2=0.0890), emphasizing their importance. The odds of being uncured for A. mellifera is higher than the odds for species M. ferruginea. The bee species, A. mellifera are more susceptible to entomopathogens icipe 7, icipe 20, and icipe 69. The Cox-Snell residuals show that the proposed semiparametric PH model generally fits the data well as compared to model that assume independent correlation structure. Thus, the semi parametric marginal proportional hazards mixture cure is parsimonious model for correlated bees survival data.展开更多
In this paper, we propose to generalize the coding schemes first proposed by Kozic &al to high spectral efficient modulation schemes. We study at first Chaos Coded Modulation based on the use of small ...In this paper, we propose to generalize the coding schemes first proposed by Kozic &al to high spectral efficient modulation schemes. We study at first Chaos Coded Modulation based on the use of small dimensional modulo-MAP encoding process and we give a solution to study the distance spectrum of such coding schemes to accurately predict their performances. However, the obtained performances are quite poor. To improve them, we use then a high dimensional modulo-MAP mapping process similar to the low-density generator-matrix codes (LDGM) introduced by Kozic &al. The main difference with their work is that we use an encoding and decoding process on GF (2m) which enables to obtain better performances while preserving a quite simple decoding algorithm when we use the Extended Min-Sum (EMS) algorithm of Declercq &Fossorier.展开更多
Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear mode...Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.展开更多
A method was proposed to evaluate the real-time reliability for a single product based on damaged measurement degradation data.Most researches on degradation analysis often assumed that the measurement process did not...A method was proposed to evaluate the real-time reliability for a single product based on damaged measurement degradation data.Most researches on degradation analysis often assumed that the measurement process did not have any impact on the product's performance.However,in some cases,the measurement process may exert extra stress on products being measured.To obtain trustful results in such a situation,a new degradation model was derived.Then,by fusing the prior information of product and its own on-line degradation data,the real-time reliability was evaluated on the basis of Bayesian formula.To make the proposed method more practical,a procedure based on expectation maximization (EM) algorithm was presented to estimate the unknown parameters.Finally,the performance of the proposed method was illustrated by a simulation study.The results show that ignoring the influence of the damaged measurement process can lead to biased evaluation results,if the damaged measurement process is involved.展开更多
基金supported by the National Natural Science Foundation of China(No.62233014)。
摘要The Near Space Hypersonic Vehicle(NSHV)features a unique design and propulsion system,achieving exceptional speed,range,and maneuverability,which challenge ground-based radars.Space-Based Radar(SBR)offers a breakthrough for tracking NSHV targets,with allweather operation and freedom from Earth's curvature,but faces complex coordinate transformations.Traditional models often overlook the NSHV's dynamic gliding trajectory,especially the impact of hidden control variables on maneuvering,causing mismatches during rapid motion changes.This paper proposes a refined tracking model unified in the ECEF coordinate frame,incorporating model parameters that implicitly encode control laws,and presents an ExpectationMaximization Multi-swarm Cooperative Particle Swarm Optimization(EM-MCPSO)framework for both NSHV tracking and model parameter estimation to address this problem.To minimize conversion errors,a transformation matrix directly represented by the state in the EarthCentered Earth-Fixed(ECEF)coordinate is derived.Then the hybrid aerodynamic acceleration coefficients are introduced to precisely describe the dynamic behaviors,formulating target tracking as a joint estimation problem of state and parameters within EM framework.Finally,a self-learning algorithm based on a master–slave structured PSO is proposed to solve the optimization of the conditional expectations of EM under strong nonlinearity,with a Proportional-Derivative(PD)controller accelerating convergence,and updating the population structure with historical data.Simulations of vertical gliding and horizontal maneuvers validate the algorithm's effectiveness.
基金supported by the National Natural Science Foundation of China (61503392)。
摘要This study presents a kinematic calibration method for exoskeletal inertial motion capture (EI-MoCap) system with considering the random colored noise such as gyroscopic drift.In this method, the geometric parameters are calibrated by the traditional calibration method at first. Then, in order to calibrate the parameters affected by the random colored noise, the expectation maximization (EM) algorithm is introduced. Through the use of geometric parameters calibrated by the traditional calibration method, the iterations under the EM framework are decreased and the efficiency of the proposed method on embedded system is improved. The performance of the proposed kinematic calibration method is compared to the traditional calibration method. Furthermore, the feasibility of the proposed method is verified on the EI-MoCap system. The simulation and experiment demonstrate that the motion capture precision is significantly improved by 16.79%and 7.16%respectively in comparison to the traditional calibration method.
基金the National Natural Science Foundation of China(79990584)
摘要A new parallel expectation-maximization (EM) algorithm is proposed for large databases. The purpose of the algorithm is to accelerate the operation of the EM algorithm. As a well-known algorithm for estimation in generic statistical problems, the EM algorithm has been widely used in many domains. But it often requires significant computational resources. So it is needed to develop more elaborate methods to adapt the databases to a large number of records or large dimensionality. The parallel EM algorithm is based on partial Esteps which has the standard convergence guarantee of EM. The algorithm utilizes fully the advantage of parallel computation. It was confirmed that the algorithm obtains about 2.6 speedups in contrast with the standard EM algorithm through its application to large databases. The running time will decrease near linearly when the number of processors increasing.
摘要Intrusion detection is the investigation process of information about the system activities or its data to detect any malicious behavior or unauthorized activity.Most of the IDS implement K-means clustering technique due to its linear complexity and fast computing ability.Nonetheless,it is Naïve use of the mean data value for the cluster core that presents a major drawback.The chances of two circular clusters having different radius and centering at the same mean will occur.This condition cannot be addressed by the K-means algorithm because the mean value of the various clusters is very similar together.However,if the clusters are not spherical,it fails.To overcome this issue,a new integrated hybrid model by integrating expectation maximizing(EM)clustering using a Gaussian mixture model(GMM)and naïve Bays classifier have been proposed.In this model,GMM give more flexibility than K-Means in terms of cluster covariance.Also,they use probabilities function and soft clustering,that’s why they can have multiple cluster for a single data.In GMM,we can define the cluster form in GMM by two parameters:the mean and the standard deviation.This means that by using these two parameters,the cluster can take any kind of elliptical shape.EM-GMM will be used to cluster data based on data activity into the corresponding category.
基金This work was supported by the National Science Fund for Distinguished Young Scholars(62325104).
摘要The quality of synthetic aperture radar(SAR)image degrades in the case of multiple imaging projection planes(IPPs)and multiple overlapping ship targets,and then the performance of target classification and recognition can be influenced.For addressing this issue,a method for extracting ship targets with overlaps via the expectation maximization(EM)algorithm is pro-posed.First,the scatterers of ship targets are obtained via the target detection technique.Then,the EM algorithm is applied to extract the scatterers of a single ship target with a single IPP.Afterwards,a novel image amplitude estimation approach is pro-posed,with which the radar image of a single target with a sin-gle IPP can be generated.The proposed method can accom-plish IPP selection and targets separation in the image domain,which can improve the image quality and reserve the target information most possibly.Results of simulated and real mea-sured data demonstrate the effectiveness of the proposed method.
基金This work was supported by the National Natural Science Foundation of China (51507015, 61773402, 61540037, 71271215, 61233008, 51425701, 70921001, 51577014), the Natural Science Foundation of Hunan Province (2015JJ3008), the Key Laboratory of Renewable Energy Electric-Technology of Hunan Province (2014ZNDL002), and Hunan Province Science and Technology Program(2015NK3035).
摘要RBF-AR (radial basis function network-based autoregressive) model is reconstructed as a new type of general radial basis function (RBF) neural network, which has additional linear output weight layer in comparison with the traditional three-layer RBF network. The extended Kalman filter (EKF) algorithm for RBF training has low filtering accuracy and divergence because of unknown prior knowledge, such as noise covariance and initial states. To overcome the drawback, the expectation maximization (EM) algorithm is used to estimate the covariance matrices of noises and the initial states. The proposed method, called the EM-EKF (expectation-maximization extended Kalman filter) algorithm, which combines the expectation maximization, extended Kalman filtering and smoothing process, is developed to estimate the parameters of the RBF-AR model, the initial conditions and the noise variances simultaneously. It is shown by the simulation tests that the EM-EKF method for the reconstructed RBF-AR network provides better results than structured nonlinear parameter optimization method (SNPOM) and the EKF, especially in low SNR (signal noise ratio). Moreover, the EM-EKF method can accurately estimate the noise variance. F test indicates there is significant difference between results obtained by the SNPOM and the EM-EKF.
基金supported by the National Natural Science Foundation of China (No. 61302141)
摘要In this paper, a novel algorithm is presented for direction of arrival(DOA) estimation and array self-calibration in the presence of unknown mutual coupling. In order to highlight the relationship between the array output and mutual coupling coefficients, we present a novel model of the array output with the unknown mutual coupling coefficients. Based on this model, we use the space alternating generalized expectation-maximization(SAGE) algorithm to jointly estimate the DOA parameters and the mutual coupling coefficients. Unlike many existing counterparts, our method requires neither calibration sources nor initial calibration information. At the same time,our proposed method inherits the characteristics of good convergence and high estimation precision of the SAGE algorithm. By numerical experiments we demonstrate that our proposed method outperforms the existing method for DOA estimation and mutual coupling calibration.
基金National Natural Science Foundation of China(No.61863024)Scientific Research Projects of Higher Institutions of Gansu Province(No.2018C-11)+1 种基金Natural Science Foundation of Gansu Province(No.18JR3RA107)Science and Technology Program of Gansu Province(No.18CX3ZA004)。
摘要Aiming at the problems of low measurement accuracy,uncertainty and nonlinearity of random noise of the micro electro mechanical system(MEMS)gyroscope,a gyroscope noise estimation and filtering method is proposed,which combines expectation maximum(EM)with maximum a posterior(MAP)to form an adpative unscented Kalman filter(UKF),called EMMAP-UKF.According to the MAP estimation principle,a suboptimal unbiased MAP noise statistical estimation model is constructed.Then,EM algorithm is introduced to transform the noise estimation problem into the mathematical expectation maximization problem,which can dynamically adjust the variance of the observed noise.Finally,the estimation and filtering of gyroscope random drift error can be realized.The performance of the gyro noise filtering method is evaluated by Allan variance,and the effectiveness of the method is verified by hardware-in-the-loop simulation.
摘要Classical survival analysis assumes all subjects will experience the event of interest, but in some cases, a portion of the population may never encounter the event. These survival methods further assume independent survival times, which is not valid for honey bees, which live in nests. The study introduces a semi-parametric marginal proportional hazards mixture cure (PHMC) model with exchangeable correlation structure, using generalized estimating equations for survival data analysis. The model was tested on clustered right-censored bees survival data with a cured fraction, where two bee species were subjected to different entomopathogens to test the effect of the entomopathogens on the survival of the bee species. The Expectation-Solution algorithm is used to estimate the parameters. The study notes a weak positive association between cure statuses (ρ1=0.0007) and survival times for uncured bees (ρ2=0.0890), emphasizing their importance. The odds of being uncured for A. mellifera is higher than the odds for species M. ferruginea. The bee species, A. mellifera are more susceptible to entomopathogens icipe 7, icipe 20, and icipe 69. The Cox-Snell residuals show that the proposed semiparametric PH model generally fits the data well as compared to model that assume independent correlation structure. Thus, the semi parametric marginal proportional hazards mixture cure is parsimonious model for correlated bees survival data.
摘要In this paper, we propose to generalize the coding schemes first proposed by Kozic &al to high spectral efficient modulation schemes. We study at first Chaos Coded Modulation based on the use of small dimensional modulo-MAP encoding process and we give a solution to study the distance spectrum of such coding schemes to accurately predict their performances. However, the obtained performances are quite poor. To improve them, we use then a high dimensional modulo-MAP mapping process similar to the low-density generator-matrix codes (LDGM) introduced by Kozic &al. The main difference with their work is that we use an encoding and decoding process on GF (2m) which enables to obtain better performances while preserving a quite simple decoding algorithm when we use the Extended Min-Sum (EMS) algorithm of Declercq &Fossorier.
摘要Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.
基金Project(60904002)supported by the National Natural Science Foundation of China
摘要A method was proposed to evaluate the real-time reliability for a single product based on damaged measurement degradation data.Most researches on degradation analysis often assumed that the measurement process did not have any impact on the product's performance.However,in some cases,the measurement process may exert extra stress on products being measured.To obtain trustful results in such a situation,a new degradation model was derived.Then,by fusing the prior information of product and its own on-line degradation data,the real-time reliability was evaluated on the basis of Bayesian formula.To make the proposed method more practical,a procedure based on expectation maximization (EM) algorithm was presented to estimate the unknown parameters.Finally,the performance of the proposed method was illustrated by a simulation study.The results show that ignoring the influence of the damaged measurement process can lead to biased evaluation results,if the damaged measurement process is involved.