The extended Kalman filter(EKF)is extensively applied in integrated navigation systems that combine the global navigation satellite system(GNSS)and strap-down inertial navigation system(SINS).However,the performance o...The extended Kalman filter(EKF)is extensively applied in integrated navigation systems that combine the global navigation satellite system(GNSS)and strap-down inertial navigation system(SINS).However,the performance of the EKF can be severely impacted by non-Gaussian noise and measurement noise uncertainties,making it difficult to achieve optimal GNSS/INS integration.Dealing with non-Gaussian noise remains a significant challenge in filter development today.Therefore,the maximum correntropy criterion(MCC)is utilized in EKFs to manage heavytailed measurement noise.However,its capability to handle non-Gaussian process noise and unknown disturbances remains largely unexplored.In this paper,we extend correntropy from using a single kernel to a multi-kernel approach.This leads to the development of a multi-kernel maximum correntropy extended Kalman filter(MKMC-EKF),which is designed to effectively manage multivariate non-Gaussian noise and disturbances.Further,theoretical analysis,including advanced stability proofs,can enhance understanding,while hybrid approaches integrating MKMC-EKF with particle filters may improve performance in nonlinear systems.The MKMC-EKF enhances estimation accuracy using a multi-kernel bandwidth approach.As bandwidth increases,the filter’s sensitivity to non-Gaussian features decreases,and its behavior progressively approximates that of the iterated EKF.The proposed approach for enhancing positioning in navigation is validated through performance evaluations,which demonstrate its practical applications in real-world systems like GPS navigation and measuring radar targets.展开更多
Lithofacies identification is a crucial work in reservoir characterization and modeling.The vast inter-well area can be supplemented by facies identification of seismic data.However,the relationship between lithofacie...Lithofacies identification is a crucial work in reservoir characterization and modeling.The vast inter-well area can be supplemented by facies identification of seismic data.However,the relationship between lithofacies and seismic information that is affected by many factors is complicated.Machine learning has received extensive attention in recent years,among which support vector machine(SVM) is a potential method for lithofacies classification.Lithofacies classification involves identifying various types of lithofacies and is generally a nonlinear problem,which needs to be solved by means of the kernel function.Multi-kernel learning SVM is one of the main tools for solving the nonlinear problem about multi-classification.However,it is very difficult to determine the kernel function and the parameters,which is restricted by human factors.Besides,its computational efficiency is low.A lithofacies classification method based on local deep multi-kernel learning support vector machine(LDMKL-SVM) that can consider low-dimensional global features and high-dimensional local features is developed.The method can automatically learn parameters of kernel function and SVM to build a relationship between lithofacies and seismic elastic information.The calculation speed will be expedited at no cost with respect to discriminant accuracy for multi-class lithofacies identification.Both the model data test results and the field data application results certify advantages of the method.This contribution offers an effective method for lithofacies recognition and reservoir prediction by using SVM.展开更多
Multi-kernel-based support vector machine (SVM) model structure of nonlinear systems and its specific identification method is proposed, which is composed of a SVM with linear kernel function followed in series by a...Multi-kernel-based support vector machine (SVM) model structure of nonlinear systems and its specific identification method is proposed, which is composed of a SVM with linear kernel function followed in series by a SVM with spline kernel function. With the help of this model, nonlinear model predictive control can be transformed to linear model predictive control, and consequently a unified analytical solution of optimal input of multi-step-ahead predictive control is possible to derive. This algorithm does not require online iterative optimization in order to be suitable for real-time control with less calculation. The simulation results of pH neutralization process and CSTR reactor show the effectiveness and advantages of the presented algorithm.展开更多
Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of n...Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of no available reference noise signal is still the bottleneck to be overcome. According to the characteristics of sonar arrays, a multi-channel differencing method is presented to provide the prerequisite reference noise. However, the ingre- dient of obtained reference noise is too complicated to be used to effectively reduce the interference noise only using the clas- sical linear cancellation methods. Hence, a novel adaptive noise cancellation method based on the multi-kernel normalized least- mean-square algorithm consisting of weighted linear and Gaussian kernel functions is proposed, which allows to simultaneously con- sider the cancellation of linear and nonlinear components in the reference noise. The simulation results demonstrate that the out- put signal-to-noise ratio (SNR) of the novel multi-kernel adaptive filtering method outperforms the conventional linear normalized least-mean-square method and the mono-kernel normalized least- mean-square method using the realistic noise data measured in the lake experiment.展开更多
Operational reliability assessment (ORA),which evaluates the risk level of power systems,is hindered by accumulated computational burdens and thus cannot meet the demands of real-time assessment.Recently,data-driven m...Operational reliability assessment (ORA),which evaluates the risk level of power systems,is hindered by accumulated computational burdens and thus cannot meet the demands of real-time assessment.Recently,data-driven methods with fast calculation speeds have emerged as a research focus for online ORA.However,the diverse contingencies of transformers,power lines,and other components introduce numerous topologies,posing significant challenges to the learning capabilities of neural networks.To this end,this paper proposes a multi-kernel collaborative graph convolution neural network (GCNN) for ORA considering varying topologies.Specifically,a physics law-informed graph convolution kernel derived from the Gaussian-Seidel iteration is introduced.It effectively aggregates node features across different topologies.By integrating additional advanced graph convolution kernels with a novel self-attention mechanism,the multi-kernel collaborative GCNN is constructed,which enables the extraction of diverse features and the construction of representative node feature vectors,thereby facilitating high-precision reliability assessments.Furthermore,to enhance the robustness of multi-kernel collaborative GCNN,the inherent pattern of the load-shedding model is analyzed and utilized to design a specialized supervised loss function,which allows the neural network to explore a broader feature space.Compared with the existing data-driven methods,the multi-kernel collaborative GCNN,combined with supervised exploration,can accommodate a wider range of contingencies and achieve superior assessment accuracy.展开更多
Machine learning algorithms have demonstrated outstanding performance for disease diagnosis.Kernel function selection plays a crucial role in effectively transforming the nonlinear nature of input data.To enhance brea...Machine learning algorithms have demonstrated outstanding performance for disease diagnosis.Kernel function selection plays a crucial role in effectively transforming the nonlinear nature of input data.To enhance breast cancer diagnosis,we propose a novel ensemble algorithm,namely,AUC-Ada-L1 MKL-WSVM,which integrates Weighted Support Vector Machines(WSVM),AdaBoost,and Multi-Kernel Learning(MKL).This ensemble algorithm introduces two main innovations.First,it simultaneously updates the weights of training samples and the combined kernel function during classification.Second,it incorporates an AUC-based approach to adjust training sample weights,effectively controlling the growth rate of misclassified sample weights in AdaBoost.Experimental results are provided to demonstrate the effectiveness of our method,which achieves an AUC score of 97.21%and an accuracy of 97.64%on the WDBC dataset,and an AUC of 97.53%and an accuracy of 97.46%on the WBC dataset.Comparative analysis further confirms that our ensemble algorithm outperforms four benchmark models in classification accuracy.展开更多
In this paper, we present a new challenging task for emotion analysis, namely emotion cause extraction.In this task, we focus on the detection of emotion cause a.k.a the reason or the stimulant of an emotion, rather t...In this paper, we present a new challenging task for emotion analysis, namely emotion cause extraction.In this task, we focus on the detection of emotion cause a.k.a the reason or the stimulant of an emotion, rather than the regular emotion classification or emotion component extraction. Since there is no open dataset for this task available, we first designed and annotated an emotion cause dataset which follows the scheme of W3 C Emotion Markup Language. We then present an emotion cause detection method by using event extraction framework,where a tree structure-based representation method is used to represent the events. Since the distribution of events is imbalanced in the training data, we propose an under-sampling-based bagging algorithm to solve this problem. Even with a limited training set, the proposed approach may still extract sufficient features for analysis by a bagging of multi-kernel based SVMs method. Evaluations show that our approach achieves an F-measure 7.04%higher than the state-of-the-art methods.展开更多
The automatic classification and identification of maize varieties is one of the important research contents in agriculture.A multi-kernel maize varieties classification approach was proposed in this paper in order to...The automatic classification and identification of maize varieties is one of the important research contents in agriculture.A multi-kernel maize varieties classification approach was proposed in this paper in order to improve the recognition rate of maize varieties.In this approach,four kinds of maize varieties were selected,in each variety 200 grains were selected randomly as the samples,and in each sample 160 grains were taken as the training samples randomly;the characteristics of maize grain were extracted as the typical characteristics to distinguish maize varieties,by which the dictionary required by K-SVD was constructed;for the test samples,the feature-matrixes were extracted by dimension reduction method which were mapped to the high-dimension space by muti-kernel function mapping.The high-dimension characteristic matrixes were trained by K-SVD method and the corresponding feature dictionary was obtained respectively.Finally,the test samples representing were trained and classified by l2,1 minimization sparse coefficient.The experiment results showed that recognition rate was improved obviously through this approach,and the poor-effect to maize variety identification from partial occlusion can be eliminated effectively.展开更多
基金the support from National Science and Technology Council,Taiwan under grant numbers NSTC 113-2811-E-019-001 and NSTC 113-2221-E-019-059.
摘要The extended Kalman filter(EKF)is extensively applied in integrated navigation systems that combine the global navigation satellite system(GNSS)and strap-down inertial navigation system(SINS).However,the performance of the EKF can be severely impacted by non-Gaussian noise and measurement noise uncertainties,making it difficult to achieve optimal GNSS/INS integration.Dealing with non-Gaussian noise remains a significant challenge in filter development today.Therefore,the maximum correntropy criterion(MCC)is utilized in EKFs to manage heavytailed measurement noise.However,its capability to handle non-Gaussian process noise and unknown disturbances remains largely unexplored.In this paper,we extend correntropy from using a single kernel to a multi-kernel approach.This leads to the development of a multi-kernel maximum correntropy extended Kalman filter(MKMC-EKF),which is designed to effectively manage multivariate non-Gaussian noise and disturbances.Further,theoretical analysis,including advanced stability proofs,can enhance understanding,while hybrid approaches integrating MKMC-EKF with particle filters may improve performance in nonlinear systems.The MKMC-EKF enhances estimation accuracy using a multi-kernel bandwidth approach.As bandwidth increases,the filter’s sensitivity to non-Gaussian features decreases,and its behavior progressively approximates that of the iterated EKF.The proposed approach for enhancing positioning in navigation is validated through performance evaluations,which demonstrate its practical applications in real-world systems like GPS navigation and measuring radar targets.
基金financially supported by the National Natural Science Foundation of China (41774129, 41904116)the Foundation Research Project of Shaanxi Provincial Key Laboratory of Geological Support for Coal Green Exploitation (MTy2019-20)。
摘要Lithofacies identification is a crucial work in reservoir characterization and modeling.The vast inter-well area can be supplemented by facies identification of seismic data.However,the relationship between lithofacies and seismic information that is affected by many factors is complicated.Machine learning has received extensive attention in recent years,among which support vector machine(SVM) is a potential method for lithofacies classification.Lithofacies classification involves identifying various types of lithofacies and is generally a nonlinear problem,which needs to be solved by means of the kernel function.Multi-kernel learning SVM is one of the main tools for solving the nonlinear problem about multi-classification.However,it is very difficult to determine the kernel function and the parameters,which is restricted by human factors.Besides,its computational efficiency is low.A lithofacies classification method based on local deep multi-kernel learning support vector machine(LDMKL-SVM) that can consider low-dimensional global features and high-dimensional local features is developed.The method can automatically learn parameters of kernel function and SVM to build a relationship between lithofacies and seismic elastic information.The calculation speed will be expedited at no cost with respect to discriminant accuracy for multi-class lithofacies identification.Both the model data test results and the field data application results certify advantages of the method.This contribution offers an effective method for lithofacies recognition and reservoir prediction by using SVM.
基金Supported by the State Key Development Program for Basic Research of China (No.2002CB312200) and the National Natural Science Foundation of China (No.60574019).
摘要Multi-kernel-based support vector machine (SVM) model structure of nonlinear systems and its specific identification method is proposed, which is composed of a SVM with linear kernel function followed in series by a SVM with spline kernel function. With the help of this model, nonlinear model predictive control can be transformed to linear model predictive control, and consequently a unified analytical solution of optimal input of multi-step-ahead predictive control is possible to derive. This algorithm does not require online iterative optimization in order to be suitable for real-time control with less calculation. The simulation results of pH neutralization process and CSTR reactor show the effectiveness and advantages of the presented algorithm.
基金supported by the National Natural Science Foundation of China(6100115361271415)+2 种基金the Opening Research Foundation of State Key Laboratory of Underwater Information Processing and Control(9140C231002130C23085)the Fundamental Research Funds for the Central Universities(3102014JCQ010103102014ZD0041)
摘要Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of no available reference noise signal is still the bottleneck to be overcome. According to the characteristics of sonar arrays, a multi-channel differencing method is presented to provide the prerequisite reference noise. However, the ingre- dient of obtained reference noise is too complicated to be used to effectively reduce the interference noise only using the clas- sical linear cancellation methods. Hence, a novel adaptive noise cancellation method based on the multi-kernel normalized least- mean-square algorithm consisting of weighted linear and Gaussian kernel functions is proposed, which allows to simultaneously con- sider the cancellation of linear and nonlinear components in the reference noise. The simulation results demonstrate that the out- put signal-to-noise ratio (SNR) of the novel multi-kernel adaptive filtering method outperforms the conventional linear normalized least-mean-square method and the mono-kernel normalized least- mean-square method using the realistic noise data measured in the lake experiment.
基金supported by the National Natural Science Foundation of China(No.52377076).
摘要Operational reliability assessment (ORA),which evaluates the risk level of power systems,is hindered by accumulated computational burdens and thus cannot meet the demands of real-time assessment.Recently,data-driven methods with fast calculation speeds have emerged as a research focus for online ORA.However,the diverse contingencies of transformers,power lines,and other components introduce numerous topologies,posing significant challenges to the learning capabilities of neural networks.To this end,this paper proposes a multi-kernel collaborative graph convolution neural network (GCNN) for ORA considering varying topologies.Specifically,a physics law-informed graph convolution kernel derived from the Gaussian-Seidel iteration is introduced.It effectively aggregates node features across different topologies.By integrating additional advanced graph convolution kernels with a novel self-attention mechanism,the multi-kernel collaborative GCNN is constructed,which enables the extraction of diverse features and the construction of representative node feature vectors,thereby facilitating high-precision reliability assessments.Furthermore,to enhance the robustness of multi-kernel collaborative GCNN,the inherent pattern of the load-shedding model is analyzed and utilized to design a specialized supervised loss function,which allows the neural network to explore a broader feature space.Compared with the existing data-driven methods,the multi-kernel collaborative GCNN,combined with supervised exploration,can accommodate a wider range of contingencies and achieve superior assessment accuracy.
基金funded by the National Natural Science Foundation of China[grant numbers 11971302 and 12171307].
摘要Machine learning algorithms have demonstrated outstanding performance for disease diagnosis.Kernel function selection plays a crucial role in effectively transforming the nonlinear nature of input data.To enhance breast cancer diagnosis,we propose a novel ensemble algorithm,namely,AUC-Ada-L1 MKL-WSVM,which integrates Weighted Support Vector Machines(WSVM),AdaBoost,and Multi-Kernel Learning(MKL).This ensemble algorithm introduces two main innovations.First,it simultaneously updates the weights of training samples and the combined kernel function during classification.Second,it incorporates an AUC-based approach to adjust training sample weights,effectively controlling the growth rate of misclassified sample weights in AdaBoost.Experimental results are provided to demonstrate the effectiveness of our method,which achieves an AUC score of 97.21%and an accuracy of 97.64%on the WDBC dataset,and an AUC of 97.53%and an accuracy of 97.46%on the WBC dataset.Comparative analysis further confirms that our ensemble algorithm outperforms four benchmark models in classification accuracy.
基金supported by the National Natural Science Foundation of China(Nos.61370165,U1636103,and 61632011)Shenzhen Foundational Research Funding(Nos.JCYJ20150625142543470 and JCYJ20170307150024907)Guangdong Provincial Engineering Technology Research Center for Data Science(No.2016KF09)
摘要In this paper, we present a new challenging task for emotion analysis, namely emotion cause extraction.In this task, we focus on the detection of emotion cause a.k.a the reason or the stimulant of an emotion, rather than the regular emotion classification or emotion component extraction. Since there is no open dataset for this task available, we first designed and annotated an emotion cause dataset which follows the scheme of W3 C Emotion Markup Language. We then present an emotion cause detection method by using event extraction framework,where a tree structure-based representation method is used to represent the events. Since the distribution of events is imbalanced in the training data, we propose an under-sampling-based bagging algorithm to solve this problem. Even with a limited training set, the proposed approach may still extract sufficient features for analysis by a bagging of multi-kernel based SVMs method. Evaluations show that our approach achieves an F-measure 7.04%higher than the state-of-the-art methods.
基金We acknowledge that this work was financially supported by the National Natural Science Foundation of China(Grant No.61472172,61673200 and 61471185)by the Natural Science Foundation of Shandong Province of China(Grant No.ZR2016FM15).
摘要The automatic classification and identification of maize varieties is one of the important research contents in agriculture.A multi-kernel maize varieties classification approach was proposed in this paper in order to improve the recognition rate of maize varieties.In this approach,four kinds of maize varieties were selected,in each variety 200 grains were selected randomly as the samples,and in each sample 160 grains were taken as the training samples randomly;the characteristics of maize grain were extracted as the typical characteristics to distinguish maize varieties,by which the dictionary required by K-SVD was constructed;for the test samples,the feature-matrixes were extracted by dimension reduction method which were mapped to the high-dimension space by muti-kernel function mapping.The high-dimension characteristic matrixes were trained by K-SVD method and the corresponding feature dictionary was obtained respectively.Finally,the test samples representing were trained and classified by l2,1 minimization sparse coefficient.The experiment results showed that recognition rate was improved obviously through this approach,and the poor-effect to maize variety identification from partial occlusion can be eliminated effectively.