Crossflow vortices induced transition is one of the most important instability types in supersonic aircraft boundary layers.While the traditional linear stability theory(LST)-based eN method demonstrates satisfactory ...Crossflow vortices induced transition is one of the most important instability types in supersonic aircraft boundary layers.While the traditional linear stability theory(LST)-based eN method demonstrates satisfactory predictive capabilities for this kind of transition,its practical implementation faces inherent limitations:the requirement of first-and second-order wallnormal derivatives of boundary layer velocityemperature profiles,the need for initial eigenvalue guesses,and the computational burden of solving eigenvalue problems.To address these challenges,this study develops a multi-layer perceptron(MLP)model tailored for linear stability analysis of three-dimensional compressible boundary layers based on the artificially defined quasi-three-dimensional non-similar boundary layer solutions.The boundary layer edge flow parameters and perturbation characteristics are mapped to eigenvalues or local growth rates of the envelop curves through fully connected layers.This architecture eliminates the need for computing wall-normal derivatives of velocityemperature profiles,initial eigenvalue estimation,and direct eigenvalue problem solving.Extensive validation across varying operational conditions and geometries(airfoils and swept wings)demonstrates exceptional agreement between the MLP’s predictions(eigenvalues and disturbance amplification factors)and traditional LST results.Furthermore,the model’s transition prediction capability is rigorously verified using National Aeronautics and Space Administration’s supersonic swept-wing crossflow-dominated transition benchmark,incorporating both stability analysis and flight test data.Results confirm the model is an efficient and reliable computational framework for transition prediction in three-dimensional finite-span wings.展开更多
Intraocular pressure(IOP)is a key parameter to diagnose glaucoma disease and assess the treatment effect of cornea after refractive surgery.Current refractive surgeries inevitably change the configuration of the corne...Intraocular pressure(IOP)is a key parameter to diagnose glaucoma disease and assess the treatment effect of cornea after refractive surgery.Current refractive surgeries inevitably change the configuration of the cornea,making it difficult to measure IOP accurately using conventional methods.The prediction method proposed in this article can accurately measure the IOP after refractive surgery.In this study,firstly,the finite element models of cornea free of IOP depicted by various vertex height,thickness,and radius are established,and the deformation of the cornea under different IOP is predicted.Based on the dataset obtained from the numerical simulations and the multi-layer perceptron neural network algorithm,two prediction models for the vertex height and thickness of the cornea free of IOP and for the configuration under IOP are developed,and a prediction method for IOP is then proposed by combining the two models.Following the similar way,two prediction models respectively for the parameters of the presumptive initial configuration of the cornea to undergo refractive surgery and for those of the cornea after surgery are constructed,and a prediction method for IOP of cornea after the surgery is presented.The validity of the prediction methods for regular IOP and that after refractive surgery is demonstrated using the clinical data from some volunteers.The proposed methods provide an efficient prediction method for regular IOP and that after refractive surgery.展开更多
The Multilayer Perceptron(MLP)is a fundamental neural network model widely applied in various domains,particularly for lightweight image classification,speech recognition,and natural language processing tasks.Despite ...The Multilayer Perceptron(MLP)is a fundamental neural network model widely applied in various domains,particularly for lightweight image classification,speech recognition,and natural language processing tasks.Despite its widespread success,training MLPs often encounter significant challenges,including susceptibility to local optima,slow convergence rates,and high sensitivity to initial weight configurations.To address these issues,this paper proposes a Latin Hypercube Opposition-based Elite Variation Artificial Protozoa Optimizer(LOEV-APO),which enhances both global exploration and local exploitation simultaneously.LOEV-APO introduces a hybrid initialization strategy that combines Latin Hypercube Sampling(LHS)with Opposition-Based Learning(OBL),thus improving the diversity and coverage of the initial population.Moreover,an Elite Protozoa Variation Strategy(EPVS)is incorporated,which applies differential mutation operations to elite candidates,accelerating convergence and strengthening local search capabilities around high-quality solutions.Extensive experiments are conducted on six classification tasks and four function approximation tasks,covering a wide range of problem complexities and demonstrating superior generalization performance.The results demonstrate that LOEV-APO consistently outperforms nine state-of-the-art metaheuristic algorithms and two gradient-based methods in terms of convergence speed,solution accuracy,and robustness.These findings suggest that LOEV-APO serves as a promising optimization tool for MLP training and provides a viable alternative to traditional gradient-based methods.展开更多
Objective:Prostate cancer(PCa)exhibits significant genomic differences between Western and Asian populations.This study aimed to design a predictive model applicable across diverse populations while selecting a limite...Objective:Prostate cancer(PCa)exhibits significant genomic differences between Western and Asian populations.This study aimed to design a predictive model applicable across diverse populations while selecting a limited set of genes suitable for clinical implementation.Methods:We utilized an integrated dataset of 1360 whole-exome and whole-genome sequences from Chinese and Western PCa cohorts to develop and evaluate the model.External validation was conducted using an independent cohort of patients.A graph neural network architecture,termed the pathway-aware multi-layered hierarchical network-Western and Asian(P-NETwa),was developed and trained on combined genomic profiles from Chinese and Western cohorts.The model employed a multilayer perceptron(MLP)to identify key signature genes from multiomics data,enabling precise prediction of PCa metastasis.Results:The model achieved an accuracy of 0.87 and an F1-score of 0.85 on Western population datasets.The application of integrated Chinese and Western population data improved the accuracy to 0.88,achieving an F1-score of 0.75.The analysis identified 18 signature genes implicated in PCa progression,including established markers(AR and TP53)and novel candidates(MUC16,MUC4,and ASB12).For clinical adoption,the model was optimized for commercially available gene panels while maintaining high classification accuracy.Additionally,a user-friendly web interface was developed to facilitate real-time prediction of primary versus metastatic status using the pre-trained P-NETwa-MLP model.Conclusion:The P-NETwa-MLP model integrates a query system that allows for efficient retrieval of prediction outcomes and associated genomic signatures via sample ID,enhancing its potential for seamless integration into clinical workflows.展开更多
Wind power forecasting plays a crucial role in optimizing the integration of wind energy into the grid by predicting wind patterns and energy output.This enhances the efficiency and reliability of renewable energy sys...Wind power forecasting plays a crucial role in optimizing the integration of wind energy into the grid by predicting wind patterns and energy output.This enhances the efficiency and reliability of renewable energy systems.Forecasting approaches inform energy management strategies,reduce reliance on fossil fuels,and support the broader transition to sustainable energy solutions.The primary goal of this study is to introduce an effective methodology for estimating wind power through temporal data analysis.This research advances an optimized Multilayer Perceptron(MLP)model using recently proposedmetaheuristic optimization algorithms,namely the FireHawk Optimizer(FHO)and the Non-Monopolize Search(NO).A modified version of FHO,termed FHONO,is developed by integrating NO as a local search mechanism to enhance the exploration capability and address the shortcomings of the original FHO.The developed FHONO is then employed to optimize the MLP for enhanced wind power prediction.The effectiveness of the proposed FHONO-MLP model is validated using renowned datasets from wind turbines in France.The results of the comparative analysis between FHONO-MLP,conventionalMLP,and other optimized versions of MLP show that FHONO-MLP outperforms the others,achieving an average RootMean Square Error(RMSE)of 0.105,Mean Absolute Error(MAE)of 0.082,and Coefficient of Determination(R2)of 0.967 across all datasets.These findings underscore the significant enhancement in predictive accuracy provided by FHONO and demonstrate its effectiveness in improving wind power forecasting.展开更多
With the increasing popularity of mobile internet devices,speech emotion recognition has become a convenient and valuable means of human-computer interaction.The performance of speech emotion recognition depends on th...With the increasing popularity of mobile internet devices,speech emotion recognition has become a convenient and valuable means of human-computer interaction.The performance of speech emotion recognition depends on the discriminating and emotion-related utterance-level representations extracted from speech.Moreover,sufficient data are required to model the relationship between emotional states and speech.Mainstream emotion recognition methods cannot avoid the influence of the silence period in speech,and environmental noise significantly affects the recognition performance.This study intends to supplement the silence periods with removed speech information and applies segmentwise multilayer perceptrons to enhance the utterance-level representation aggregation.In addition,improved semisupervised learning is employed to overcome the prob-lem of data scarcity.Particular experiments are conducted to evaluate the proposed method on the IEMOCAP corpus,which reveals that it achieves 68.0%weighted accuracy and 68.8%unweighted accuracy in four emotion classifications.The experimental results demonstrate that the proposed method aggregates utterance-level more effectively and that semisupervised learning enhances the performance of our method.展开更多
In mining or construction projects,for exploitation of hard rock with high strength properties,blasting is frequently applied to breaking or moving them using high explosive energy.However,use of explosives may lead t...In mining or construction projects,for exploitation of hard rock with high strength properties,blasting is frequently applied to breaking or moving them using high explosive energy.However,use of explosives may lead to the flyrock phenomenon.Flyrock can damage structures or nearby equipment in the surrounding areas and inflict harm to humans,especially workers in the working sites.Thus,prediction of flyrock is of high importance.In this investigation,examination and estimation/forecast of flyrock distance induced by blasting through the application of five artificial intelligent algorithms were carried out.One hundred and fifty-two blasting events in three open-pit granite mines in Johor,Malaysia,were monitored to collect field data.The collected data include blasting parameters and rock mass properties.Site-specific weathering index(WI),geological strength index(GSI) and rock quality designation(RQD)are rock mass properties.Multi-layer perceptron(MLP),random forest(RF),support vector machine(SVM),and hybrid models including Harris Hawks optimization-based MLP(known as HHO-MLP) and whale optimization algorithm-based MLP(known as WOA-MLP) were developed.The performance of various models was assessed through various performance indices,including a10-index,coefficient of determination(R2),root mean squared error(RMSE),mean absolute percentage error(MAPE),variance accounted for(VAF),and root squared error(RSE).The a10-index values for MLP,RF,SVM,HHO-MLP and WOA-MLP are 0.953,0.933,0.937,0.991 and 0.972,respectively.R2 of HHO-MLP is 0.998,which achieved the best performance among all five machine learning(ML) models.展开更多
To improve the performance of multilayer perceptron(MLP)neural networks activated by conventional activation functions,this paper presents a new MLP activated by univariate Gaussian radial basis functions(RBFs)with ad...To improve the performance of multilayer perceptron(MLP)neural networks activated by conventional activation functions,this paper presents a new MLP activated by univariate Gaussian radial basis functions(RBFs)with adaptive centers and widths,which is composed of more than one hidden layer.In the hidden layer of the RBF-activated MLP network(MLPRBF),the outputs of the preceding layer are first linearly transformed and then fed into the univariate Gaussian RBF,which exploits the highly nonlinear property of RBF.Adaptive RBFs might address the issues of saturated outputs,low sensitivity,and vanishing gradients in MLPs activated by other prevailing nonlinear functions.Finally,we apply four MLP networks with the rectified linear unit(ReLU),sigmoid function(sigmoid),hyperbolic tangent function(tanh),and Gaussian RBF as the activation functions to approximate the one-dimensional(1D)sinusoidal function,the analytical solution of viscous Burgers’equation,and the two-dimensional(2D)steady lid-driven cavity flows.Using the same network structure,MLP-RBF generally predicts more accurately and converges faster than the other threeMLPs.MLP-RBF using less hidden layers and/or neurons per layer can yield comparable or even higher approximation accuracy than other MLPs equipped with more layers or neurons.展开更多
In the early exploration of many oilfields,low-resistivity-low-contrast(LRLC)pay zones are easily overlooked due to the resistivity similarity to the water zones.Existing identification methods are model-driven and ca...In the early exploration of many oilfields,low-resistivity-low-contrast(LRLC)pay zones are easily overlooked due to the resistivity similarity to the water zones.Existing identification methods are model-driven and cannot yield satisfactory results when the causes of LRLC pay zones are complicated.In this study,after analyzing a large number of core samples,main causes of LRLC pay zones in the study area are discerned,which include complex distribution of formation water salinity,high irreducible water saturation due to micropores,and high shale volume.Moreover,different oil testing layers may have different causes of LRLC pay zones.As a result,in addition to the well log data of oil testing layers,well log data of adjacent shale layers are also added to the original dataset as reference data.The densitybased spatial clustering algorithm with noise(DBSCAN)is used to cluster the original dataset into 49 clusters.A new dataset is ultimately projected into a feature space with 49 dimensions.The new dataset and oil testing results are respectively treated as input and output to train the multi-layer perceptron(MLP).A total of 3192 samples are used for stratified 8-fold cross-validation,and the accuracy of the MLP is found to be 85.53%.展开更多
To solve the excessive huge scale problem of the traditional multi-bit digital artificial neural network(ANN) hardware implementation methods,a bit-stream ANN hardware implementation method based on sigma delta(Σ...To solve the excessive huge scale problem of the traditional multi-bit digital artificial neural network(ANN) hardware implementation methods,a bit-stream ANN hardware implementation method based on sigma delta(ΣΔ) modulation is presented.The bit-stream adder,multiplier,threshold function unit and fully digital ΣΔ modulator are implemented in a field programmable gate array(FPGA),and these bit-stream arithmetical units are employed to build the bit-stream artificial neuron.The function of the bit-stream artificial neuron is verified through the realization of the logic function and a linear classifier.The bit-stream perceptron based on the bit-stream artificial neuron with the pre-processed structure is proved to have the ability of nonlinear classification.The FPGA resource utilization of the bit-stream artificial neuron shows that the bit-stream ANN hardware implementation method can significantly reduce the demand of the ANN hardware resources.展开更多
One objective of developing machine learning(ML)-based material models is to integrate them with well-established numerical methods to solve boundary value problems(BVPs).In the family of ML models,recurrent neural ne...One objective of developing machine learning(ML)-based material models is to integrate them with well-established numerical methods to solve boundary value problems(BVPs).In the family of ML models,recurrent neural networks(RNNs)have been extensively applied to capture history-dependent constitutive responses of granular materials,but these multiple-step-based neural networks are neither sufficiently efficient nor aligned with the standard finite element method(FEM).Single-step-based neural networks like the multi-layer perceptron(MLP)are an alternative to bypass the above issues but have to introduce some internal variables to encode complex loading histories.In this work,one novel Frobenius norm-based internal variable,together with the Fourier layer and residual architectureenhanced MLP model,is crafted to replicate the history-dependent constitutive features of representative volume element(RVE)for granular materials.The obtained ML models are then seamlessly embedded into the FEM to solve the BVP of a biaxial compression case and a rigid strip footing case.The obtained solutions are comparable to results from the FEM-DEM multiscale modelling but achieve significantly improved efficiency.The results demonstrate the applicability of the proposed internal variable in enabling MLP to capture highly nonlinear constitutive responses of granular materials.展开更多
Owing to continuous production lines with large amount of consecutive controls, various control signals and huge logistic relations, this paper introduced the methods and principles of the development of knowledge bas...Owing to continuous production lines with large amount of consecutive controls, various control signals and huge logistic relations, this paper introduced the methods and principles of the development of knowledge base in a fault diagnosis expert system that was based on machine learning by the four-layer perceptron neural network. An example was presented. By combining differential function with not differential function and back propagation of error with back propagation of expectation, the four-layer perceptron neural network was established. And it was good for solving such a bottleneck problem in knowledge acquisition in expert system and enhancing real-time on-line diagnosis. A method of synthetic back propagation was designed, which broke the limit to non-differentiable function in BP neural network.展开更多
The dynamics of frontal and transverse shocks in gaseous detonation waves is a complex phenomenon bringing many difficulties to both numerical and experimental research.Advanced laser-optical visualization of detonati...The dynamics of frontal and transverse shocks in gaseous detonation waves is a complex phenomenon bringing many difficulties to both numerical and experimental research.Advanced laser-optical visualization of detonation structure may provide certain information of its reactive front,but the corresponding lead shock needs to be reconstructed building the complete flow field.Using the multi-layer perceptron(MLP)approach,we propose a shock front reconstruction method which can predict evolution of the lead shock wavefront from the state of the reactive front.The method is verified through the numerical results of one-and two-dimensional unstable detonations based on the reactive Euler equations with a one-step irreversible chemical reaction model.Results show that the accuracy of the proposed method depends on the activation energy of the reactive mixture,which influences prominently the cellular detonation instability and hence,the distortion of the lead shock surface.To select the input variables for training and evaluate their influence on the effectiveness of the proposed method,five groups,one with six variables,and the other with four variables,are tested and analyzed in the MLP model.The trained MLP is tested in the cases with different activation energies,demonstrates the inspiring generalization capability.This paper offers a universal framework for predicting detonation frontal evolution and provides a novel way to interpret numerical and experimental results of detonation waves.展开更多
Fetal health care is vital in ensuring the health of pregnant women and the fetus.Regular check-ups need to be taken by the mother to determine the status of the fetus’growth and identify any potential problems.To kn...Fetal health care is vital in ensuring the health of pregnant women and the fetus.Regular check-ups need to be taken by the mother to determine the status of the fetus’growth and identify any potential problems.To know the status of the fetus,doctors monitor blood reports,Ultrasounds,cardiotocography(CTG)data,etc.Still,in this research,we have considered CTG data,which provides information on heart rate and uterine contractions during pregnancy.Several researchers have proposed various methods for classifying the status of fetus growth.Manual processing of CTG data is time-consuming and unreliable.So,automated tools should be used to classify fetal health.This study proposes a novel neural network-based architecture,the Dynamic Multi-Layer Perceptron model,evaluated from a single layer to several layers to classify fetal health.Various strategies were applied,including pre-processing data using techniques like Balancing,Scaling,Normalization hyperparameter tuning,batch normalization,early stopping,etc.,to enhance the model’s performance.A comparative analysis of the proposed method is done against the traditional machine learning models to showcase its accuracy(97%).An ablation study without any pre-processing techniques is also illustrated.This study easily provides valuable interpretations for healthcare professionals in the decision-making process.展开更多
The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combinatio...The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combination of these algorithms may not be sufficient to extract the complex structure of user interaction data.This paper presents a new approach to address such issues,utilizing the graph convolution network to extract association relations.The proposed approach mainly includes three modules:Embedding layer,forward propagation layer,and score prediction layer.The embedding layer models users and items according to their interaction information and generates initial feature vectors as input for the forward propagation layer.The forward propagation layer designs two parallel graph convolution networks with self-connections,which extract higher-order association relevance from users and items separately by multi-layer graph convolution.Furthermore,the forward propagation layer integrates the attention factor to assign different weights among the hop neighbors of the graph convolution network fusion,capturing more comprehensive association relevance between users and items as input for the score prediction layer.The score prediction layer introduces MLP(multi-layer perceptron)to conduct non-linear feature interaction between users and items,respectively.Finally,the prediction score of users to items is obtained.The recall rate and normalized discounted cumulative gain were used as evaluation indexes.The proposed approach effectively integrates higher-order information in user entries,and experimental analysis demonstrates its superiority over the existing algorithms.展开更多
The healthcare data requires accurate disease detection analysis,real-timemonitoring,and advancements to ensure proper treatment for patients.Consequently,Machine Learning methods are widely utilized in Smart Healthca...The healthcare data requires accurate disease detection analysis,real-timemonitoring,and advancements to ensure proper treatment for patients.Consequently,Machine Learning methods are widely utilized in Smart Healthcare Systems(SHS)to extract valuable features fromheterogeneous and high-dimensional healthcare data for predicting various diseases and monitoring patient activities.These methods are employed across different domains that are susceptible to adversarial attacks,necessitating careful consideration.Hence,this paper proposes a crossover-based Multilayer Perceptron(CMLP)model.The collected samples are pre-processed and fed into the crossover-based multilayer perceptron neural network to detect adversarial attacks on themedical records of patients.Once an attack is detected,healthcare professionals are promptly alerted to prevent data leakage.The paper utilizes two datasets,namely the synthetic dataset and the University of Queensland Vital Signs(UQVS)dataset,from which numerous samples are collected.Experimental results are conducted to evaluate the performance of the proposed CMLP model,utilizing various performancemeasures such as Recall,Precision,Accuracy,and F1-score to predict patient activities.Comparing the proposed method with existing approaches,it achieves the highest accuracy,precision,recall,and F1-score.Specifically,the proposedmethod achieves a precision of 93%,an accuracy of 97%,an F1-score of 92%,and a recall of 92%.展开更多
Considering that real communication signals corrupted by noise are generally nonstationary, and timefrequency distributions are especially suitable for the analysis of nonstationary signals, time-frequency distributio...Considering that real communication signals corrupted by noise are generally nonstationary, and timefrequency distributions are especially suitable for the analysis of nonstationary signals, time-frequency distributions are introduced for the modulation classification of communication signals: The extracted time-frequency features have good classification information, and they are insensitive to signal to noise ratio (SNR) variation. According to good classification by the correct rate of a neural network classifier, a multilayer perceptron (MLP) classifier with better generalization, as well as, addition of time-frequency features set for classifying six different modulation types has been proposed. Computer simulations show that the MLP classifier outperforms the decision-theoretic classifier at low SNRs, and the classification experiments for real MPSK signals verify engineering significance of the MLP classifier.展开更多
The binary perceptron is the simplest artificial neural network formed by N input units and one output unit, with the neural states and the synaptic weights all restricted to ±1 values. The task in the teacher-st...The binary perceptron is the simplest artificial neural network formed by N input units and one output unit, with the neural states and the synaptic weights all restricted to ±1 values. The task in the teacher-student scenario is to infer the hidden weight vector by training on a set of labeled patterns. Previous efforts on the passive learning mode have shown that learning from independent random patterns is quite inefficient. Here we consider the active online learning mode in which the student designs every new Ising training pattern. We demonstrate that it is mathematically possible to achieve perfect(error-free) inference using only N designed training patterns, but this is computationally unfeasible for large systems. We then investigate two Bayesian statistical designing protocols, which require 2.3N and 1.9N training patterns, respectively, to achieve error-free inference. If the training patterns are instead designed through deductive reasoning, perfect inference is achieved using N + log_2N samples. The performance gap between Bayesian and deductive designing strategies may be shortened in future work by taking into account the possibility of ergodicity breaking in the version space of the binary perceptron.展开更多
Environmental perception is a key technology for autonomous driving.Owing to the limitations of a single sensor,multiple sensors are often used in practical applications.However,multi-sensor fusion faces some problems...Environmental perception is a key technology for autonomous driving.Owing to the limitations of a single sensor,multiple sensors are often used in practical applications.However,multi-sensor fusion faces some problems,such as the choice of sensors and fusion methods.To solve these issues,we proposed a machine learning-based fusion sensing system that uses a camera and radar,and that can be used in intelligent vehicles.First,the object detection algorithm is used to detect the image obtained by the camera;in sequence,the radar data is preprocessed,coordinate transformation is performed,and a multi-layer perceptron model for correlating the camera detection results with the radar data is proposed.The proposed fusion sensing system was verified by comparative experiments in a real-world environment.The experimental results show that the system can effectively integrate camera and radar data results,and obtain accurate and comprehensive object information in front of intelligent vehicles.展开更多
基金supported by the National Natural Science Foundation of China(Grant Nos.52372362 and 12102361)the Natural Science Basic Research Program of Shaanxi(Grant No.2025JCJCQN-071)+1 种基金the Zhejiang Provincial Natural Science Foundation of China(Grant No.LR25A020001)the Fundamental Research Funds for the Central Universities(Grant No.G2024KY0615).
摘要Crossflow vortices induced transition is one of the most important instability types in supersonic aircraft boundary layers.While the traditional linear stability theory(LST)-based eN method demonstrates satisfactory predictive capabilities for this kind of transition,its practical implementation faces inherent limitations:the requirement of first-and second-order wallnormal derivatives of boundary layer velocityemperature profiles,the need for initial eigenvalue guesses,and the computational burden of solving eigenvalue problems.To address these challenges,this study develops a multi-layer perceptron(MLP)model tailored for linear stability analysis of three-dimensional compressible boundary layers based on the artificially defined quasi-three-dimensional non-similar boundary layer solutions.The boundary layer edge flow parameters and perturbation characteristics are mapped to eigenvalues or local growth rates of the envelop curves through fully connected layers.This architecture eliminates the need for computing wall-normal derivatives of velocityemperature profiles,initial eigenvalue estimation,and direct eigenvalue problem solving.Extensive validation across varying operational conditions and geometries(airfoils and swept wings)demonstrates exceptional agreement between the MLP’s predictions(eigenvalues and disturbance amplification factors)and traditional LST results.Furthermore,the model’s transition prediction capability is rigorously verified using National Aeronautics and Space Administration’s supersonic swept-wing crossflow-dominated transition benchmark,incorporating both stability analysis and flight test data.Results confirm the model is an efficient and reliable computational framework for transition prediction in three-dimensional finite-span wings.
基金supported by Central guidance for local scientific and technological development funding projects(Grant No.2024ZY01057)。
摘要Intraocular pressure(IOP)is a key parameter to diagnose glaucoma disease and assess the treatment effect of cornea after refractive surgery.Current refractive surgeries inevitably change the configuration of the cornea,making it difficult to measure IOP accurately using conventional methods.The prediction method proposed in this article can accurately measure the IOP after refractive surgery.In this study,firstly,the finite element models of cornea free of IOP depicted by various vertex height,thickness,and radius are established,and the deformation of the cornea under different IOP is predicted.Based on the dataset obtained from the numerical simulations and the multi-layer perceptron neural network algorithm,two prediction models for the vertex height and thickness of the cornea free of IOP and for the configuration under IOP are developed,and a prediction method for IOP is then proposed by combining the two models.Following the similar way,two prediction models respectively for the parameters of the presumptive initial configuration of the cornea to undergo refractive surgery and for those of the cornea after surgery are constructed,and a prediction method for IOP of cornea after the surgery is presented.The validity of the prediction methods for regular IOP and that after refractive surgery is demonstrated using the clinical data from some volunteers.The proposed methods provide an efficient prediction method for regular IOP and that after refractive surgery.
基金supported by the National Natural Science Foundation of China(Grant Nos.62376089,62302153,62302154)the Key Research and Development Program of Hubei Province,China(Grant No.2023BEB024)+1 种基金the Young and Middle-Aged Scientific and Technological Innovation Team Plan in Higher Education Institutions in Hubei Province,China(Grant No.T2023007)the National Natural Science Foundation of China(Grant No.U23A20318).
摘要The Multilayer Perceptron(MLP)is a fundamental neural network model widely applied in various domains,particularly for lightweight image classification,speech recognition,and natural language processing tasks.Despite its widespread success,training MLPs often encounter significant challenges,including susceptibility to local optima,slow convergence rates,and high sensitivity to initial weight configurations.To address these issues,this paper proposes a Latin Hypercube Opposition-based Elite Variation Artificial Protozoa Optimizer(LOEV-APO),which enhances both global exploration and local exploitation simultaneously.LOEV-APO introduces a hybrid initialization strategy that combines Latin Hypercube Sampling(LHS)with Opposition-Based Learning(OBL),thus improving the diversity and coverage of the initial population.Moreover,an Elite Protozoa Variation Strategy(EPVS)is incorporated,which applies differential mutation operations to elite candidates,accelerating convergence and strengthening local search capabilities around high-quality solutions.Extensive experiments are conducted on six classification tasks and four function approximation tasks,covering a wide range of problem complexities and demonstrating superior generalization performance.The results demonstrate that LOEV-APO consistently outperforms nine state-of-the-art metaheuristic algorithms and two gradient-based methods in terms of convergence speed,solution accuracy,and robustness.These findings suggest that LOEV-APO serves as a promising optimization tool for MLP training and provides a viable alternative to traditional gradient-based methods.
基金supported by the National Key R&D Program of China(2022YFA1305700 to Li J)the“Dawn”Program of Shanghai Education Commission,China(21SG33 to Li J)The National Natural Science Foundation of China(82272793 to Gao X).
摘要Objective:Prostate cancer(PCa)exhibits significant genomic differences between Western and Asian populations.This study aimed to design a predictive model applicable across diverse populations while selecting a limited set of genes suitable for clinical implementation.Methods:We utilized an integrated dataset of 1360 whole-exome and whole-genome sequences from Chinese and Western PCa cohorts to develop and evaluate the model.External validation was conducted using an independent cohort of patients.A graph neural network architecture,termed the pathway-aware multi-layered hierarchical network-Western and Asian(P-NETwa),was developed and trained on combined genomic profiles from Chinese and Western cohorts.The model employed a multilayer perceptron(MLP)to identify key signature genes from multiomics data,enabling precise prediction of PCa metastasis.Results:The model achieved an accuracy of 0.87 and an F1-score of 0.85 on Western population datasets.The application of integrated Chinese and Western population data improved the accuracy to 0.88,achieving an F1-score of 0.75.The analysis identified 18 signature genes implicated in PCa progression,including established markers(AR and TP53)and novel candidates(MUC16,MUC4,and ASB12).For clinical adoption,the model was optimized for commercially available gene panels while maintaining high classification accuracy.Additionally,a user-friendly web interface was developed to facilitate real-time prediction of primary versus metastatic status using the pre-trained P-NETwa-MLP model.Conclusion:The P-NETwa-MLP model integrates a query system that allows for efficient retrieval of prediction outcomes and associated genomic signatures via sample ID,enhancing its potential for seamless integration into clinical workflows.
基金the Deanship of Graduate Studies and Scientific Research at University of Bisha,Saudi Arabia for funding this research work through the Promising Program under Grant Number(UB-Promising-42-1445).
摘要Wind power forecasting plays a crucial role in optimizing the integration of wind energy into the grid by predicting wind patterns and energy output.This enhances the efficiency and reliability of renewable energy systems.Forecasting approaches inform energy management strategies,reduce reliance on fossil fuels,and support the broader transition to sustainable energy solutions.The primary goal of this study is to introduce an effective methodology for estimating wind power through temporal data analysis.This research advances an optimized Multilayer Perceptron(MLP)model using recently proposedmetaheuristic optimization algorithms,namely the FireHawk Optimizer(FHO)and the Non-Monopolize Search(NO).A modified version of FHO,termed FHONO,is developed by integrating NO as a local search mechanism to enhance the exploration capability and address the shortcomings of the original FHO.The developed FHONO is then employed to optimize the MLP for enhanced wind power prediction.The effectiveness of the proposed FHONO-MLP model is validated using renowned datasets from wind turbines in France.The results of the comparative analysis between FHONO-MLP,conventionalMLP,and other optimized versions of MLP show that FHONO-MLP outperforms the others,achieving an average RootMean Square Error(RMSE)of 0.105,Mean Absolute Error(MAE)of 0.082,and Coefficient of Determination(R2)of 0.967 across all datasets.These findings underscore the significant enhancement in predictive accuracy provided by FHONO and demonstrate its effectiveness in improving wind power forecasting.
摘要With the increasing popularity of mobile internet devices,speech emotion recognition has become a convenient and valuable means of human-computer interaction.The performance of speech emotion recognition depends on the discriminating and emotion-related utterance-level representations extracted from speech.Moreover,sufficient data are required to model the relationship between emotional states and speech.Mainstream emotion recognition methods cannot avoid the influence of the silence period in speech,and environmental noise significantly affects the recognition performance.This study intends to supplement the silence periods with removed speech information and applies segmentwise multilayer perceptrons to enhance the utterance-level representation aggregation.In addition,improved semisupervised learning is employed to overcome the prob-lem of data scarcity.Particular experiments are conducted to evaluate the proposed method on the IEMOCAP corpus,which reveals that it achieves 68.0%weighted accuracy and 68.8%unweighted accuracy in four emotion classifications.The experimental results demonstrate that the proposed method aggregates utterance-level more effectively and that semisupervised learning enhances the performance of our method.
基金supported by the Center for Mining,Electro-Mechanical Research of Hanoi University of Mining and Geology(HUMG),Hanoi,Vietnam。
摘要In mining or construction projects,for exploitation of hard rock with high strength properties,blasting is frequently applied to breaking or moving them using high explosive energy.However,use of explosives may lead to the flyrock phenomenon.Flyrock can damage structures or nearby equipment in the surrounding areas and inflict harm to humans,especially workers in the working sites.Thus,prediction of flyrock is of high importance.In this investigation,examination and estimation/forecast of flyrock distance induced by blasting through the application of five artificial intelligent algorithms were carried out.One hundred and fifty-two blasting events in three open-pit granite mines in Johor,Malaysia,were monitored to collect field data.The collected data include blasting parameters and rock mass properties.Site-specific weathering index(WI),geological strength index(GSI) and rock quality designation(RQD)are rock mass properties.Multi-layer perceptron(MLP),random forest(RF),support vector machine(SVM),and hybrid models including Harris Hawks optimization-based MLP(known as HHO-MLP) and whale optimization algorithm-based MLP(known as WOA-MLP) were developed.The performance of various models was assessed through various performance indices,including a10-index,coefficient of determination(R2),root mean squared error(RMSE),mean absolute percentage error(MAPE),variance accounted for(VAF),and root squared error(RSE).The a10-index values for MLP,RF,SVM,HHO-MLP and WOA-MLP are 0.953,0.933,0.937,0.991 and 0.972,respectively.R2 of HHO-MLP is 0.998,which achieved the best performance among all five machine learning(ML) models.
基金This work was partially supported by the research grant of the National University of Singapore(NUS),Ministry of Education(MOE Tier 1).
摘要To improve the performance of multilayer perceptron(MLP)neural networks activated by conventional activation functions,this paper presents a new MLP activated by univariate Gaussian radial basis functions(RBFs)with adaptive centers and widths,which is composed of more than one hidden layer.In the hidden layer of the RBF-activated MLP network(MLPRBF),the outputs of the preceding layer are first linearly transformed and then fed into the univariate Gaussian RBF,which exploits the highly nonlinear property of RBF.Adaptive RBFs might address the issues of saturated outputs,low sensitivity,and vanishing gradients in MLPs activated by other prevailing nonlinear functions.Finally,we apply four MLP networks with the rectified linear unit(ReLU),sigmoid function(sigmoid),hyperbolic tangent function(tanh),and Gaussian RBF as the activation functions to approximate the one-dimensional(1D)sinusoidal function,the analytical solution of viscous Burgers’equation,and the two-dimensional(2D)steady lid-driven cavity flows.Using the same network structure,MLP-RBF generally predicts more accurately and converges faster than the other threeMLPs.MLP-RBF using less hidden layers and/or neurons per layer can yield comparable or even higher approximation accuracy than other MLPs equipped with more layers or neurons.
基金funded by the Strategic Cooperation Technology Projects of CNPC and CUPB(ZLZX2020-03)
摘要In the early exploration of many oilfields,low-resistivity-low-contrast(LRLC)pay zones are easily overlooked due to the resistivity similarity to the water zones.Existing identification methods are model-driven and cannot yield satisfactory results when the causes of LRLC pay zones are complicated.In this study,after analyzing a large number of core samples,main causes of LRLC pay zones in the study area are discerned,which include complex distribution of formation water salinity,high irreducible water saturation due to micropores,and high shale volume.Moreover,different oil testing layers may have different causes of LRLC pay zones.As a result,in addition to the well log data of oil testing layers,well log data of adjacent shale layers are also added to the original dataset as reference data.The densitybased spatial clustering algorithm with noise(DBSCAN)is used to cluster the original dataset into 49 clusters.A new dataset is ultimately projected into a feature space with 49 dimensions.The new dataset and oil testing results are respectively treated as input and output to train the multi-layer perceptron(MLP).A total of 3192 samples are used for stratified 8-fold cross-validation,and the accuracy of the MLP is found to be 85.53%.
基金The National Natural Science Foundation of China (No.60576028)the Natural Science Foundation of Higher Education Institutions of Jiangsu Province(No.11KJB510004)
摘要To solve the excessive huge scale problem of the traditional multi-bit digital artificial neural network(ANN) hardware implementation methods,a bit-stream ANN hardware implementation method based on sigma delta(ΣΔ) modulation is presented.The bit-stream adder,multiplier,threshold function unit and fully digital ΣΔ modulator are implemented in a field programmable gate array(FPGA),and these bit-stream arithmetical units are employed to build the bit-stream artificial neuron.The function of the bit-stream artificial neuron is verified through the realization of the logic function and a linear classifier.The bit-stream perceptron based on the bit-stream artificial neuron with the pre-processed structure is proved to have the ability of nonlinear classification.The FPGA resource utilization of the bit-stream artificial neuron shows that the bit-stream ANN hardware implementation method can significantly reduce the demand of the ANN hardware resources.
基金supported by the National Natural Science Foundation of China(NSFC)(Grant No.12072217).
摘要One objective of developing machine learning(ML)-based material models is to integrate them with well-established numerical methods to solve boundary value problems(BVPs).In the family of ML models,recurrent neural networks(RNNs)have been extensively applied to capture history-dependent constitutive responses of granular materials,but these multiple-step-based neural networks are neither sufficiently efficient nor aligned with the standard finite element method(FEM).Single-step-based neural networks like the multi-layer perceptron(MLP)are an alternative to bypass the above issues but have to introduce some internal variables to encode complex loading histories.In this work,one novel Frobenius norm-based internal variable,together with the Fourier layer and residual architectureenhanced MLP model,is crafted to replicate the history-dependent constitutive features of representative volume element(RVE)for granular materials.The obtained ML models are then seamlessly embedded into the FEM to solve the BVP of a biaxial compression case and a rigid strip footing case.The obtained solutions are comparable to results from the FEM-DEM multiscale modelling but achieve significantly improved efficiency.The results demonstrate the applicability of the proposed internal variable in enabling MLP to capture highly nonlinear constitutive responses of granular materials.
摘要Owing to continuous production lines with large amount of consecutive controls, various control signals and huge logistic relations, this paper introduced the methods and principles of the development of knowledge base in a fault diagnosis expert system that was based on machine learning by the four-layer perceptron neural network. An example was presented. By combining differential function with not differential function and back propagation of error with back propagation of expectation, the four-layer perceptron neural network was established. And it was good for solving such a bottleneck problem in knowledge acquisition in expert system and enhancing real-time on-line diagnosis. A method of synthetic back propagation was designed, which broke the limit to non-differentiable function in BP neural network.
基金This work was supported by the National Natural Science Foundation of China(Grant 11822202).
摘要The dynamics of frontal and transverse shocks in gaseous detonation waves is a complex phenomenon bringing many difficulties to both numerical and experimental research.Advanced laser-optical visualization of detonation structure may provide certain information of its reactive front,but the corresponding lead shock needs to be reconstructed building the complete flow field.Using the multi-layer perceptron(MLP)approach,we propose a shock front reconstruction method which can predict evolution of the lead shock wavefront from the state of the reactive front.The method is verified through the numerical results of one-and two-dimensional unstable detonations based on the reactive Euler equations with a one-step irreversible chemical reaction model.Results show that the accuracy of the proposed method depends on the activation energy of the reactive mixture,which influences prominently the cellular detonation instability and hence,the distortion of the lead shock surface.To select the input variables for training and evaluate their influence on the effectiveness of the proposed method,five groups,one with six variables,and the other with four variables,are tested and analyzed in the MLP model.The trained MLP is tested in the cases with different activation energies,demonstrates the inspiring generalization capability.This paper offers a universal framework for predicting detonation frontal evolution and provides a novel way to interpret numerical and experimental results of detonation waves.
基金This work was supported by the National Research Foundation of Korea(NRF)grant funded by the Korea government(MSIT)(NRF-2023R1A2C1005950)Jana Shafi is supported via funding from Prince Sattam bin Abdulaziz University Project Number(PSAU/2024/R/1445).
摘要Fetal health care is vital in ensuring the health of pregnant women and the fetus.Regular check-ups need to be taken by the mother to determine the status of the fetus’growth and identify any potential problems.To know the status of the fetus,doctors monitor blood reports,Ultrasounds,cardiotocography(CTG)data,etc.Still,in this research,we have considered CTG data,which provides information on heart rate and uterine contractions during pregnancy.Several researchers have proposed various methods for classifying the status of fetus growth.Manual processing of CTG data is time-consuming and unreliable.So,automated tools should be used to classify fetal health.This study proposes a novel neural network-based architecture,the Dynamic Multi-Layer Perceptron model,evaluated from a single layer to several layers to classify fetal health.Various strategies were applied,including pre-processing data using techniques like Balancing,Scaling,Normalization hyperparameter tuning,batch normalization,early stopping,etc.,to enhance the model’s performance.A comparative analysis of the proposed method is done against the traditional machine learning models to showcase its accuracy(97%).An ablation study without any pre-processing techniques is also illustrated.This study easily provides valuable interpretations for healthcare professionals in the decision-making process.
基金supported by the Fundamental Research Funds for Higher Education Institutions of Heilongjiang Province(145209126)the Heilongjiang Province Higher Education Teaching Reform Project under Grant No.SJGY20200770.
摘要The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combination of these algorithms may not be sufficient to extract the complex structure of user interaction data.This paper presents a new approach to address such issues,utilizing the graph convolution network to extract association relations.The proposed approach mainly includes three modules:Embedding layer,forward propagation layer,and score prediction layer.The embedding layer models users and items according to their interaction information and generates initial feature vectors as input for the forward propagation layer.The forward propagation layer designs two parallel graph convolution networks with self-connections,which extract higher-order association relevance from users and items separately by multi-layer graph convolution.Furthermore,the forward propagation layer integrates the attention factor to assign different weights among the hop neighbors of the graph convolution network fusion,capturing more comprehensive association relevance between users and items as input for the score prediction layer.The score prediction layer introduces MLP(multi-layer perceptron)to conduct non-linear feature interaction between users and items,respectively.Finally,the prediction score of users to items is obtained.The recall rate and normalized discounted cumulative gain were used as evaluation indexes.The proposed approach effectively integrates higher-order information in user entries,and experimental analysis demonstrates its superiority over the existing algorithms.
基金funded by King Saud University through Researchers Supporting Program Number (RSP2024R499).
摘要The healthcare data requires accurate disease detection analysis,real-timemonitoring,and advancements to ensure proper treatment for patients.Consequently,Machine Learning methods are widely utilized in Smart Healthcare Systems(SHS)to extract valuable features fromheterogeneous and high-dimensional healthcare data for predicting various diseases and monitoring patient activities.These methods are employed across different domains that are susceptible to adversarial attacks,necessitating careful consideration.Hence,this paper proposes a crossover-based Multilayer Perceptron(CMLP)model.The collected samples are pre-processed and fed into the crossover-based multilayer perceptron neural network to detect adversarial attacks on themedical records of patients.Once an attack is detected,healthcare professionals are promptly alerted to prevent data leakage.The paper utilizes two datasets,namely the synthetic dataset and the University of Queensland Vital Signs(UQVS)dataset,from which numerous samples are collected.Experimental results are conducted to evaluate the performance of the proposed CMLP model,utilizing various performancemeasures such as Recall,Precision,Accuracy,and F1-score to predict patient activities.Comparing the proposed method with existing approaches,it achieves the highest accuracy,precision,recall,and F1-score.Specifically,the proposedmethod achieves a precision of 93%,an accuracy of 97%,an F1-score of 92%,and a recall of 92%.
摘要Considering that real communication signals corrupted by noise are generally nonstationary, and timefrequency distributions are especially suitable for the analysis of nonstationary signals, time-frequency distributions are introduced for the modulation classification of communication signals: The extracted time-frequency features have good classification information, and they are insensitive to signal to noise ratio (SNR) variation. According to good classification by the correct rate of a neural network classifier, a multilayer perceptron (MLP) classifier with better generalization, as well as, addition of time-frequency features set for classifying six different modulation types has been proposed. Computer simulations show that the MLP classifier outperforms the decision-theoretic classifier at low SNRs, and the classification experiments for real MPSK signals verify engineering significance of the MLP classifier.
基金Supported by the National Natural Science Foundation of China under Grant Nos.11421063 and 11747601the Chinese Academy of Sciences under Grant No.QYZDJ-SSW-SYS018
摘要The binary perceptron is the simplest artificial neural network formed by N input units and one output unit, with the neural states and the synaptic weights all restricted to ±1 values. The task in the teacher-student scenario is to infer the hidden weight vector by training on a set of labeled patterns. Previous efforts on the passive learning mode have shown that learning from independent random patterns is quite inefficient. Here we consider the active online learning mode in which the student designs every new Ising training pattern. We demonstrate that it is mathematically possible to achieve perfect(error-free) inference using only N designed training patterns, but this is computationally unfeasible for large systems. We then investigate two Bayesian statistical designing protocols, which require 2.3N and 1.9N training patterns, respectively, to achieve error-free inference. If the training patterns are instead designed through deductive reasoning, perfect inference is achieved using N + log_2N samples. The performance gap between Bayesian and deductive designing strategies may be shortened in future work by taking into account the possibility of ergodicity breaking in the version space of the binary perceptron.
基金the National Natural Science Foundation of China(No.U1764264/61873165)the Shanghai Automotive Industry Science and Technology Development Foundation(No.1733/1807)。
摘要Environmental perception is a key technology for autonomous driving.Owing to the limitations of a single sensor,multiple sensors are often used in practical applications.However,multi-sensor fusion faces some problems,such as the choice of sensors and fusion methods.To solve these issues,we proposed a machine learning-based fusion sensing system that uses a camera and radar,and that can be used in intelligent vehicles.First,the object detection algorithm is used to detect the image obtained by the camera;in sequence,the radar data is preprocessed,coordinate transformation is performed,and a multi-layer perceptron model for correlating the camera detection results with the radar data is proposed.The proposed fusion sensing system was verified by comparative experiments in a real-world environment.The experimental results show that the system can effectively integrate camera and radar data results,and obtain accurate and comprehensive object information in front of intelligent vehicles.