Convolutional neural networks(CNNs)have shown remarkable success across numerous tasks such as image classification,yet the theoretical understanding of their convergence remains underdeveloped compared to their empir...Convolutional neural networks(CNNs)have shown remarkable success across numerous tasks such as image classification,yet the theoretical understanding of their convergence remains underdeveloped compared to their empirical achievements.In this paper,the first filter learning framework with convergence-guaranteed learning laws for end-to-end learning of deep CNNs is proposed.Novel update laws with convergence analysis are formulated based on the mathematical representation of each layer in convolutional neural networks.The proposed learning laws enable concurrent updates of weights across all layers of the deep convolutional neural network and the analysis shows that the training errors converge to certain bounds which are dependent on the approximation errors.Case studies are conducted on benchmark datasets and the results show that the proposed concurrent filter learning framework guarantees the convergence and offers more consistent and reliable results during training with a trade-off in performance compared to stochastic gradient descent methods.This framework represents a significant step towards enhancing the reliability and effectiveness of deep convolutional neural network by developing a theoretical analysis which allows practical implementation of the learning laws with automatic tuning of the learning rate to guarantee the convergence during training.展开更多
Transformers have been widely applied to hyperspectral image classification,leveraging their self-attention mechanism for powerful global modelling.However,two key challenges remain as follows:excessive memory and com...Transformers have been widely applied to hyperspectral image classification,leveraging their self-attention mechanism for powerful global modelling.However,two key challenges remain as follows:excessive memory and computational costs from calculating correlations between all tokens(especially as image size or spectral bands increase)and limited ability to model local boundary information due to lacking explicit enhancement mechanisms.This paper proposes a novel method,bridge transformer network fused with deep graph convolution(BTDGC),to address these issues.The framework includes three components as follows:a double random masking mechanism(DRMM)that forces the model to infer masked features from context during training,a bridge transformer(BT)module with bridge tokens for cross-region feature interaction and a Deep Graph Convolutional Pooling(DGCP)module that preserves spatial topology while aggregating hierarchical information.Experiments on standard hyperspectral datasets show BTDGC outperforms mainstream methods in classification accuracy and robustness,effectively balancing global modelling and local boundary representation.The code is available at http://gffzz188fe103f8f1460asb5uk505xppck6w5n.ffgz.tsg.suse.edu.cn/jenny3489/BTDGC.展开更多
Dear Editor,This letter presents a novel graph neural network, namely modularized graph convolution network(MGCN), to address the underexplored issue in graph convolution networks(GCNs), wherein the weights for neighb...Dear Editor,This letter presents a novel graph neural network, namely modularized graph convolution network(MGCN), to address the underexplored issue in graph convolution networks(GCNs), wherein the weights for neighbor aggregation are fixed, leading to the limited capability of capturing diverse relationships among nodes for representation learning. Conventional GCNs always learn node representations in the graph according to the weights computed from the graph Laplacian, consequently overlooking the similarity and group cohesiveness of node features.展开更多
Video emotion recognition is widely used due to its alignment with the temporal characteristics of human emotional expression,but existingmodels have significant shortcomings.On the one hand,Transformermultihead self-...Video emotion recognition is widely used due to its alignment with the temporal characteristics of human emotional expression,but existingmodels have significant shortcomings.On the one hand,Transformermultihead self-attention modeling of global temporal dependency has problems of high computational overhead and feature similarity.On the other hand,fixed-size convolution kernels are often used,which have weak perception ability for emotional regions of different scales.Therefore,this paper proposes a video emotion recognition model that combines multi-scale region-aware convolution with temporal interactive sampling.In terms of space,multi-branch large-kernel stripe convolution is used to perceive emotional region features at different scales,and attention weights are generated for each scale feature.In terms of time,multi-layer odd-even down-sampling is performed on the time series,and oddeven sub-sequence interaction is performed to solve the problem of feature similarity,while reducing computational costs due to the linear relationship between sampling and convolution overhead.This paper was tested on CMU-MOSI,CMU-MOSEI,and Hume Reaction.The Acc-2 reached 83.4%,85.2%,and 81.2%,respectively.The experimental results show that the model can significantly improve the accuracy of emotion recognition.展开更多
Dear Editor,D2This letter presents a node feature similarity preserving graph convolutional framework P G.Graph neural networks(GNNs)have garnered significant attention for their efficacy in learning graph representat...Dear Editor,D2This letter presents a node feature similarity preserving graph convolutional framework P G.Graph neural networks(GNNs)have garnered significant attention for their efficacy in learning graph representations across diverse real-world applications.展开更多
Image captioning,a pivotal research area at the intersection of image understanding,artificial intelligence,and linguistics,aims to generate natural language descriptions for images.This paper proposes an efficient im...Image captioning,a pivotal research area at the intersection of image understanding,artificial intelligence,and linguistics,aims to generate natural language descriptions for images.This paper proposes an efficient image captioning model named Mob-IMWTC,which integrates improved wavelet convolution(IMWTC)with an enhanced MobileNet V3 architecture.The enhanced MobileNet V3 integrates a transformer encoder as its encoding module and a transformer decoder as its decoding module.This innovative neural network significantly reduces the memory space required and model training time,while maintaining a high level of accuracy in generating image descriptions.IMWTC facilitates large receptive fields without significantly increasing the number of parameters or computational overhead.The improvedMobileNet V3 model has its classifier removed,and simultaneously,it employs IMWTC layers to replace the original convolutional layers.This makes Mob-IMWTC exceptionally well-suited for deployment on lowresource devices.Experimental results,based on objective evaluation metrics such as BLEU,ROUGE,CIDEr,METEOR,and SPICE,demonstrate that Mob-IMWTC outperforms state-of-the-art models,including three CNN architectures(CNN-LSTM,CNN-Att-LSTM,CNN-Tran),two mainstream methods(LCM-Captioner,ClipCap),and our previous work(Mob-Tran).Subjective evaluations further validate the model’s superiority in terms of grammaticality,adequacy,logic,readability,and humanness.Mob-IMWTC offers a lightweight yet effective solution for image captioning,making it suitable for deployment on resource-constrained devices.展开更多
Accurate modeling of ship magnetic fields is important for predicting their spatial distribution to improve the magnetic stealth effect of ships.This study proposes an extrapolation model for ship magnetic fields base...Accurate modeling of ship magnetic fields is important for predicting their spatial distribution to improve the magnetic stealth effect of ships.This study proposes an extrapolation model for ship magnetic fields based on genetic algorithms and convolutional neural networks(CNNs).The magnetic probe position matrix of the traditional equivalent source is utilized as input,and the three-directional components of the magnetic field measured by the probes are employed as output.The extrapolation model for ship magnetic fields is obtained through iterative training and fitting with CNNs.Variables such as the number of magnetic dipoles,the distance between magnetic dipoles,the size and quantity of convolutional kernels,batch size,learning rate,and L2 regularization coefficient are optimized to boost the accuracy of the extrapolation model for magnetic fields.The fitting accuracy of the extrapolation model for ship magnetic fields is used as the optimization objective.Based on a finite element simulation model of ship magnetic fields,the accuracy and robustness of the CNN algorithm under different magnetic field conditions are validated using the known standard depth plane,the unknown depth at 1.125 times the standard depth plane,and the unknown depth at 1.25 times the standard depth plane.Results show that,after optimization,the fitting error for the magnetic field extrapolation model based on CNN is 1.50%for the standard depth plane,1.63%for the unknown depth at 1.125 times the standard depth plane,and 2.36%for the unknown depth at 1.25 times the standard depth plane.The error remains below 5%under varying magnetic field conditions.When a random measurement error of 0%-5%is introduced for the magnetic probes,the prediction error at 1.25 times the standard depth plane is 2.30%;with a random error of 0%-10%,the prediction error is 4.95%.This approach significantly improves the accuracy and robustness of magnetic field extrapolation,which makes it an effective and feasible method for ship magnetic field modeling.展开更多
This study proposes a multi-scale simplified residual convolutional neural network(MS-SRCNN)for the precise prediction of Mg-Nd binary alloy compositions from scanning electron microscope(SEM)images.A multi-scale data...This study proposes a multi-scale simplified residual convolutional neural network(MS-SRCNN)for the precise prediction of Mg-Nd binary alloy compositions from scanning electron microscope(SEM)images.A multi-scale data structure is established by spatially aligning and stacking SEM images at different magnifications.The MS-SRCNN significantly reduces computational runtime by over 90%compared to traditional architectures like ResNet50,VGG16,and VGG19,without compromising prediction accuracy.The model demonstrates more excellent predictive performance,achieving a>5%increase in R2 compared to single-scale models.Furthermore,the MS-SRCNN exhibits robust composition prediction capability across other Mg-based binary alloys,including Mg-La,Mg-Sn,Mg-Ce,Mg-Sm,Mg-Ag,and Mg-Y,thereby emphasizing its generalization and extrapolation potential.This research establishes a non-destructive,microstructure-informed composition analysis framework,reduces characterization time compared to traditional experiment methods and provides insights into the composition-microstructure relationship in diverse material systems.展开更多
Traffic flow prediction is of great importance in traffic planning,road resource management,and congestion mitigation.However,existing prediction have significant limitations in modeling multi-scale spatial-temporal f...Traffic flow prediction is of great importance in traffic planning,road resource management,and congestion mitigation.However,existing prediction have significant limitations in modeling multi-scale spatial-temporal features,particularly in capturing temporal periodicity and spatial dependency in dynamically evolving traffic networks.This paper proposes a novel framework of traffic flow prediction,referred to as Adaptive Graph Fusion Dual-scale Convolutional Network(AGFDCN),which integrates spatial-temporal dynamic graphs with dual-scale convolutional networks.Specifically,we introduce a Dual-Scale Temporal Network,which combines long-and short-term dilated causal convolutions with a temporal decay-aware attention mechanism to efficiently capture traffic patterns across multiple temporal scales.Furthermore,we design a Dynamic Adaptive Graph Module,which models complex spatial dependencies in traffic networks through an adaptive graph fusion mechanism and a dual-path attention-gated module.Finally,the temporal and spatial representations are integrated by employing a gated fusion mechanism,enhancing the overall prediction performance.Experimental results obtained based on three highway datasets(i.e.,PEMS04,PEMS07 and PEMS08)verify that the proposed model outperforms several state-of-the-art baselines in various evaluation metrics.Compared to the spatial-temporal graph model AGCRN with best performance in the baseline models,the proposed model exhibits significant improvements across all datasets:it achieves reduces of MAE by 42.07%and RMSE by 35.43%on PEMS04;MAE by 28.35%and RMSE by 29.28%on PEMS07;and MAE by 30.52%and RMSE by 30.73%on PEMS08,respectively,validating its effectiveness in modeling complex spatial-temporal traffic data and its robustness in handling sudden traffic changes.展开更多
The prediction of sea surface partial pressure of carbon dioxide(pCO2)in the South China Sea is crucial for understanding the region’s contribution to the global carbon budget and its interactions with climate cha...The prediction of sea surface partial pressure of carbon dioxide(pCO2)in the South China Sea is crucial for understanding the region’s contribution to the global carbon budget and its interactions with climate change.We applied the Spatiotemporal Convolutional Long Short-Term Memory(STConvLSTM)model,integrating key environmental factors including sea surface temperature(SST),sea surface salinity(SSS),and chlorophyll a(Chl a),to predict and analyze sea surface pCO2in the South China Sea.The model demonstrated high accuracy in short-term predictions(1 month),with a mean absolute error(MAE)of 0.394,a root mean square error(RMSE)of 0.659,and a coefficient of determination(R2)of 0.998.For long-term predictions(12 months),the model maintained its predictive capability,with an MAE of 0.667,RMSE of 1.255,and R2of 0.994.Feature importance analysis revealed that sea surface pCO2and SST were the main drivers of the model’s predictions,whereas Chl a and SSS had relatively minor impacts.The model’s generalization ability was further validated in the northwest Pacific Ocean and tropical Pacific Ocean,where it successfully captured the spatiotemporal variation in pCO2with small prediction errors.The ST-ConvLSTM model provides an efficient and accurate tool for forecasting and analyzing sea surface pCO2in the South China Sea,offering new insights into global carbon cycling and climate change.This study demonstrates the potential of deep learning in marine science and provides a significant technical support for global changes and marine ecosystem research.展开更多
Traffic holographic perception refers to the real-time,high-fidelity,and multi-dimensional sensing of traffic states through the fusion of heterogeneous sensors,including cameras,radars,and connected vehicle data.The ...Traffic holographic perception refers to the real-time,high-fidelity,and multi-dimensional sensing of traffic states through the fusion of heterogeneous sensors,including cameras,radars,and connected vehicle data.The multi-source perception data obtained thereby can provide a complete digital representation of the road network for the Intelligent Transportation System(ITS).However,sensors are vulnerable to environmental interference,which can result in data loss at specific points or along arterial highways for certain periods,potentially undermining system safety and decision-making reliability.To address these challenges,a deep learning method based on Graph Convolutional Networks(GCN)and Gated Recurrent Units(GRU)is proposed,leveraging Artificial Intelligence(AI)and intelligent connected technologies for real-time acquisition of multi-sensor perception data.A feature-level fusion integrates multi-source perception data.GCN captures spatial dependencies from the road network topology,while GRU extracts temporal features from time series,enabling accurate imputation of missing traffic data.The method is evaluated at intelligent connected intersections in the Beijing High-level Autonomous Driving Demonstration Area.Results show that the accuracy of long-term traffic state completion reaches 89.36%,and the Root Mean Square Error(RMSE)is reduced by 17.2%compared to the Long Short-Term Memory(LSTM)baseline.This framework provides a practical solution for deploying traffic holographic perception technology in secure and trustworthy ITS.展开更多
Partial least squares (PLS) model maximizes the covariance between process variables and quality variables,making it widely used in quality-related fault detection.However,traditional PLS methods focus primarily on li...Partial least squares (PLS) model maximizes the covariance between process variables and quality variables,making it widely used in quality-related fault detection.However,traditional PLS methods focus primarily on linear processes,leading to poor performance in dynamic nonlinear processes.In this paper,a novel quality-related fault detection method,named DiCAE-PLS,is developed by combining dynamic-inner convolutional autoencoder with PLS.In the proposed DiCAE-PLS method,latent features are first extracted through dynamic-inner convolutional autoencoder (DiCAE) to capture process dynamics and nonlinearity from process variables.Then,a PLS model is established to build the relationship between the extracted latent features and the final product quality.To detect quality-related faults,Hotelling's T2 statistic is employed.The developed quality-related fault detection is applied to the widely used industrial benchmark of the Tennessee.展开更多
With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance s...With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance strategies often struggle to accurately predict the degradation process of equipment,leading to excessive maintenance costs or potential failure risks.However,existing prediction methods based on statistical models are difficult to adapt to nonlinear degradation processes.To address these challenges,this study proposes a novel condition-based maintenance framework for planetary gearboxes.A comprehensive full-lifecycle degradation experiment was conducted to collect raw vibration signals,which were then processed using a temporal convolutional network autoencoder with multi-scale perception capability to extract deep temporal degradation features,enabling the collaborative extraction of longperiod meshing frequencies and short-term impact features from the vibration signals.Kernel principal component analysis was employed to fuse and normalize these features,enhancing the characterization of degradation progression.A nonlinear Wiener process was used to model the degradation trajectory,with a threshold decay function introduced to dynamically adjust maintenance strategies,and model parameters optimized through maximum likelihood estimation.Meanwhile,the maintenance strategy was optimized to minimize costs per unit time,determining the optimal maintenance timing and preventive maintenance threshold.The comprehensive indicator of degradation trends extracted by this method reaches 0.756,which is 41.2%higher than that of traditional time-domain features;the dynamic threshold strategy reduces the maintenance cost per unit time to 55.56,which is 8.9%better than that of the static threshold optimization.Experimental results demonstrate significant reductions in maintenance costs while enhancing system reliability and safety.This study realizes the organic integration of deep learning and reliability theory in the maintenance of planetary gearboxes,provides an interpretable solution for the predictive maintenance of complex mechanical systems,and promotes the development of condition-based maintenance strategies for planetary gearboxes.展开更多
Attosecond light sources serve as crucial tools for investigating the ultrafast electronic dynamics in matter with remarkable temporal resolution.Traditional methods face difficulties in accurately measuring attosecon...Attosecond light sources serve as crucial tools for investigating the ultrafast electronic dynamics in matter with remarkable temporal resolution.Traditional methods face difficulties in accurately measuring attosecond pulses,and the prevailing approach involves utilizing attosecond streak cameras coupled with inversion algorithms to reconstruct phase information.However,these algorithms often require multiple iterations and extensive computational time.This study investigates the utilization of autocorrelation graphs as inputs for a convolutional neural network(CNN)to invert streaking traces obtained by attosecond streak camera.We explore the noise resistance capability of autocorrelation within the CNN inversion and aim to provide a physical explanation for its effectiveness.The objective of this research is to enhance the accuracy and reliability of CNN inversion for attosecond streaking traces,enabling improved resilience against experimental noises.展开更多
Reliable traffic flow prediction is crucial for mitigating urban congestion.This paper proposes Attentionbased spatiotemporal Interactive Dynamic Graph Convolutional Network(AIDGCN),a novel architecture integrating In...Reliable traffic flow prediction is crucial for mitigating urban congestion.This paper proposes Attentionbased spatiotemporal Interactive Dynamic Graph Convolutional Network(AIDGCN),a novel architecture integrating Interactive Dynamic Graph Convolution Network(IDGCN)with Temporal Multi-Head Trend-Aware Attention.Its core innovation lies in IDGCN,which uniquely splits sequences into symmetric intervals for interactive feature sharing via dynamic graphs,and a novel attention mechanism incorporating convolutional operations to capture essential local traffic trends—addressing a critical gap in standard attention for continuous data.For 15-and 60-min forecasting on METR-LA,AIDGCN achieves MAEs of 0.75%and 0.39%,and RMSEs of 1.32%and 0.14%,respectively.In the 60-min long-term forecasting of the PEMS-BAY dataset,the AIDGCN out-performs the MRA-BGCN method by 6.28%,4.93%,and 7.17%in terms of MAE,RMSE,and MAPE,respectively.Experimental results demonstrate the superiority of our pro-posed model over state-of-the-art methods.展开更多
Image inpainting is a crucial research area in computer vision.Despite significant advancements with deep learning methods,challenges such as information loss and weak adaptability remain.This paper introduces a Trans...Image inpainting is a crucial research area in computer vision.Despite significant advancements with deep learning methods,challenges such as information loss and weak adaptability remain.This paper introduces a Transformer-based image inpainting method named Swin2FII,which integrates SwinV2 Transformer and fast Fourier convolution structure to address information loss and bottleneck issues,significantly enhancing inpainting accuracy and expanding its application scope.Swin2FII incorporates a super-resolution model,enhancing feature extraction and information transmission through efficient reconstruction,thereby improving detail recovery and stability.We employ the Charbonnier loss function to address gradient explosion,accurately estimating low-frequency signals and enhancing the precision of detail and texture reconstruction.Furthermore,combining mixed-precision training and data augmentation significantly boosts the model's adaptability and generalization ability.Experimental results show that our Swin2FII method outperforms the existing techniques on multiple public datasets.Notably,it exhibits excellent generalization and performance in a variety of scenarios and mask scales.In addition,Swin2FII also demonstrates strong capabilities in fluid image inpainting and mural image inpainting tasks.展开更多
We propose a novel fast numerical calculation method for the Rayleigh-Sommerfeld diffraction integral,which is developed based on the existing scaled convolution method.This approach enables fast cal-culations for gen...We propose a novel fast numerical calculation method for the Rayleigh-Sommerfeld diffraction integral,which is developed based on the existing scaled convolution method.This approach enables fast cal-culations for general cases of off-axis scenarios where the sampling intervals and numbers of the input and observation planes are unequal.Additionally,it allows for arbitrary adjustment of the sampling interval of the impulse response function,facilitating a manual trade-off between computational load and accuracy.The er-rors associated with this method,which is equivalent to interpolation,primarily arise from the discontinuities of the sampling matrix of the impulse response function on its boundaries of periodic extension.To address this issue,we propose the concept of the padding function and its construction method,and evaluate its ef-fectiveness in enhancing computational accuracy.The feasibility of the proposed method is verified by nu-merical simulation and compared with the direct integration DI-method in a simplified scenario.It shows that the proposed method has good computational accuracy for the general case where the sampling interval of the input and observation plane is not equal under non-near-field diffraction,and when the diffraction distance is large,although the computational accuracy of the proposed method cannot exceed that of the DI-method,the computational amount can be significantly reduced with almost no effect on the computational accuracy.This method provides a general numerical calculation scheme of diffraction in the non-near field case for areas such as computational holography.展开更多
Machine learning models have made significant advances in the establishment of structure-property relationships.However,it is still a challenge to predict the mechanical properties of the adhesive interface due to the...Machine learning models have made significant advances in the establishment of structure-property relationships.However,it is still a challenge to predict the mechanical properties of the adhesive interface due to the complexity and randomness of the polymer topologies.In this paper,we employed a graph convolutional network(GCN)model to predict the mechanical properties of a specific cross-linked polymer interfacial system,including yield strength(σy),ultimate strength(σu),failure strain(εu),and fracture toughness(Γ)utilizing molecular dynamics simulations.The results showed that the adopted GCN model can predict the mechanical properties with over 88%accuracy.Furthermore,the prediction performances for εu and σu are better than those for Γ and σy,with R2~0.73 for εu,R2~0.64 for σu,R2~0.51 for Γ,and R2~0.43 for σy.It is worth noting that the GCN model with the sum aggregator slightly outperforms that with the mean aggregator,and that models with linear regression and fully connected neural network regression provide similar predictions.The influence of input node features on prediction performance was also investigated.It was observed that the node closeness centrality is an important graph parameter in prediction.Specifically,node closeness centrality presents a more significant influence on the global mechanical properties of the adhesive interface,such as εu,σu,and Γ.Additionally,sensitivity analysis demonstrated that appropriate hyperparameters can improve computational efficiency without losing accuracy on a restricted set of data.This paper demonstrated the capacity of the GCN model to predict the mechanical properties of the adhesive interface with diverse topologies and provided a possible pathway for improving the mechanical properties of the adhesive interface by tailoring polymer structures in the future.展开更多
Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models ...Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models face several challenges,including computational complexity,noise blurring,and information loss.This paper proposes an enhanced convolutional attention network(ECANet)for liver segmentation.ECANet uses a U-shaped architecture with efficient channel-attention-based skip connections.Both the encoder and decoder are constructed using enhanced convolutional Transformer(ECT)blocks,where group convolution is integrated into the convolutional attention module for efficient Token embedding and channel disentanglement,and a Token-wise multi-layer perceptron(MLP)branch is incorporated into the wide-focus module to improve feature representation across channels.Deep supervision and a hybrid of Binary Cross-Entropy(BCE)and Dice loss are used to improve boundary accuracy.We evaluate the proposed model on the publicly available LiTS17 dataset.Experiments show that ECANet outperforms the compared CNN-based and CNN-Transformer baseline models on both quantitative and qualitative measures.展开更多
Graph neural networks(GNN)have shown strong performance in node classification tasks,yet most existing models rely on uniform or shared weight aggregation,lacking flexibility in modeling the varying strength of relati...Graph neural networks(GNN)have shown strong performance in node classification tasks,yet most existing models rely on uniform or shared weight aggregation,lacking flexibility in modeling the varying strength of relationships among nodes.This paper proposes a novel graph coupling convolutional model that introduces an adaptive weighting mechanism to assign distinct importance to neighboring nodes based on their similarity to the central node.Unlike traditional methods,the proposed coupling strategy enhances the interpretability of node interactions while maintaining competitive classification performance.The model operates in the spatial domain,utilizing adjacency list structures for efficient convolution and addressing the limitations of weight sharing through a coupling-based similarity computation.Extensive experiments are conducted on five graph-structured datasets,including Cora,Citeseer,PubMed,Reddit,and BlogCatalog,as well as a custom topology dataset constructed from the Open University Learning Analytics Dataset(OULAD)educational platform.Results demonstrate that the proposed model achieves good classification accuracy,while significantly reducing training time through direct second-order neighbor fusion and data preprocessing.Moreover,analysis of neighborhood order reveals that considering third-order neighbors offers limited accuracy gains but introduces considerable computational overhead,confirming the efficiency of first-and second-order convolution in practical applications.Overall,the proposed graph coupling model offers a lightweight,interpretable,and effective framework for multi-label node classification in complex networks.展开更多
基金supported by the Ministry of Education(MOE)Singapore,Academic Research Fund(AcRF)Tier 1(RG65/22)。
摘要Convolutional neural networks(CNNs)have shown remarkable success across numerous tasks such as image classification,yet the theoretical understanding of their convergence remains underdeveloped compared to their empirical achievements.In this paper,the first filter learning framework with convergence-guaranteed learning laws for end-to-end learning of deep CNNs is proposed.Novel update laws with convergence analysis are formulated based on the mathematical representation of each layer in convolutional neural networks.The proposed learning laws enable concurrent updates of weights across all layers of the deep convolutional neural network and the analysis shows that the training errors converge to certain bounds which are dependent on the approximation errors.Case studies are conducted on benchmark datasets and the results show that the proposed concurrent filter learning framework guarantees the convergence and offers more consistent and reliable results during training with a trade-off in performance compared to stochastic gradient descent methods.This framework represents a significant step towards enhancing the reliability and effectiveness of deep convolutional neural network by developing a theoretical analysis which allows practical implementation of the learning laws with automatic tuning of the learning rate to guarantee the convergence during training.
摘要Transformers have been widely applied to hyperspectral image classification,leveraging their self-attention mechanism for powerful global modelling.However,two key challenges remain as follows:excessive memory and computational costs from calculating correlations between all tokens(especially as image size or spectral bands increase)and limited ability to model local boundary information due to lacking explicit enhancement mechanisms.This paper proposes a novel method,bridge transformer network fused with deep graph convolution(BTDGC),to address these issues.The framework includes three components as follows:a double random masking mechanism(DRMM)that forces the model to infer masked features from context during training,a bridge transformer(BT)module with bridge tokens for cross-region feature interaction and a Deep Graph Convolutional Pooling(DGCP)module that preserves spatial topology while aggregating hierarchical information.Experiments on standard hyperspectral datasets show BTDGC outperforms mainstream methods in classification accuracy and robustness,effectively balancing global modelling and local boundary representation.The code is available at http://gffzz188fe103f8f1460asb5uk505xppck6w5n.ffgz.tsg.suse.edu.cn/jenny3489/BTDGC.
摘要Dear Editor,This letter presents a novel graph neural network, namely modularized graph convolution network(MGCN), to address the underexplored issue in graph convolution networks(GCNs), wherein the weights for neighbor aggregation are fixed, leading to the limited capability of capturing diverse relationships among nodes for representation learning. Conventional GCNs always learn node representations in the graph according to the weights computed from the graph Laplacian, consequently overlooking the similarity and group cohesiveness of node features.
基金supported,in part,by the National Nature Science Foundation of China under Grant 62272236,62376128in part,by the Natural Science Foundation of Jiangsu Province under Grant BK20201136,BK20191401.
摘要Video emotion recognition is widely used due to its alignment with the temporal characteristics of human emotional expression,but existingmodels have significant shortcomings.On the one hand,Transformermultihead self-attention modeling of global temporal dependency has problems of high computational overhead and feature similarity.On the other hand,fixed-size convolution kernels are often used,which have weak perception ability for emotional regions of different scales.Therefore,this paper proposes a video emotion recognition model that combines multi-scale region-aware convolution with temporal interactive sampling.In terms of space,multi-branch large-kernel stripe convolution is used to perceive emotional region features at different scales,and attention weights are generated for each scale feature.In terms of time,multi-layer odd-even down-sampling is performed on the time series,and oddeven sub-sequence interaction is performed to solve the problem of feature similarity,while reducing computational costs due to the linear relationship between sampling and convolution overhead.This paper was tested on CMU-MOSI,CMU-MOSEI,and Hume Reaction.The Acc-2 reached 83.4%,85.2%,and 81.2%,respectively.The experimental results show that the model can significantly improve the accuracy of emotion recognition.
基金supported by the National Natural Science Foundation of China(62402399)the New Chongqing Youth Innovation Talent Project(CSTB2024NSCQ-QCXMX0035)。
摘要Dear Editor,D2This letter presents a node feature similarity preserving graph convolutional framework P G.Graph neural networks(GNNs)have garnered significant attention for their efficacy in learning graph representations across diverse real-world applications.
基金funded by National Social Science Fund of China,grant number 23BYY197.
摘要Image captioning,a pivotal research area at the intersection of image understanding,artificial intelligence,and linguistics,aims to generate natural language descriptions for images.This paper proposes an efficient image captioning model named Mob-IMWTC,which integrates improved wavelet convolution(IMWTC)with an enhanced MobileNet V3 architecture.The enhanced MobileNet V3 integrates a transformer encoder as its encoding module and a transformer decoder as its decoding module.This innovative neural network significantly reduces the memory space required and model training time,while maintaining a high level of accuracy in generating image descriptions.IMWTC facilitates large receptive fields without significantly increasing the number of parameters or computational overhead.The improvedMobileNet V3 model has its classifier removed,and simultaneously,it employs IMWTC layers to replace the original convolutional layers.This makes Mob-IMWTC exceptionally well-suited for deployment on lowresource devices.Experimental results,based on objective evaluation metrics such as BLEU,ROUGE,CIDEr,METEOR,and SPICE,demonstrate that Mob-IMWTC outperforms state-of-the-art models,including three CNN architectures(CNN-LSTM,CNN-Att-LSTM,CNN-Tran),two mainstream methods(LCM-Captioner,ClipCap),and our previous work(Mob-Tran).Subjective evaluations further validate the model’s superiority in terms of grammaticality,adequacy,logic,readability,and humanness.Mob-IMWTC offers a lightweight yet effective solution for image captioning,making it suitable for deployment on resource-constrained devices.
摘要Accurate modeling of ship magnetic fields is important for predicting their spatial distribution to improve the magnetic stealth effect of ships.This study proposes an extrapolation model for ship magnetic fields based on genetic algorithms and convolutional neural networks(CNNs).The magnetic probe position matrix of the traditional equivalent source is utilized as input,and the three-directional components of the magnetic field measured by the probes are employed as output.The extrapolation model for ship magnetic fields is obtained through iterative training and fitting with CNNs.Variables such as the number of magnetic dipoles,the distance between magnetic dipoles,the size and quantity of convolutional kernels,batch size,learning rate,and L2 regularization coefficient are optimized to boost the accuracy of the extrapolation model for magnetic fields.The fitting accuracy of the extrapolation model for ship magnetic fields is used as the optimization objective.Based on a finite element simulation model of ship magnetic fields,the accuracy and robustness of the CNN algorithm under different magnetic field conditions are validated using the known standard depth plane,the unknown depth at 1.125 times the standard depth plane,and the unknown depth at 1.25 times the standard depth plane.Results show that,after optimization,the fitting error for the magnetic field extrapolation model based on CNN is 1.50%for the standard depth plane,1.63%for the unknown depth at 1.125 times the standard depth plane,and 2.36%for the unknown depth at 1.25 times the standard depth plane.The error remains below 5%under varying magnetic field conditions.When a random measurement error of 0%-5%is introduced for the magnetic probes,the prediction error at 1.25 times the standard depth plane is 2.30%;with a random error of 0%-10%,the prediction error is 4.95%.This approach significantly improves the accuracy and robustness of magnetic field extrapolation,which makes it an effective and feasible method for ship magnetic field modeling.
基金funded by the National Natural Science Foundation of China(No.52204407)the Natural Science Foundation of Jiangsu Province(No.BK20220595)the China Postdoctoral Science Foundation(No.2022M723689).
摘要This study proposes a multi-scale simplified residual convolutional neural network(MS-SRCNN)for the precise prediction of Mg-Nd binary alloy compositions from scanning electron microscope(SEM)images.A multi-scale data structure is established by spatially aligning and stacking SEM images at different magnifications.The MS-SRCNN significantly reduces computational runtime by over 90%compared to traditional architectures like ResNet50,VGG16,and VGG19,without compromising prediction accuracy.The model demonstrates more excellent predictive performance,achieving a>5%increase in R2 compared to single-scale models.Furthermore,the MS-SRCNN exhibits robust composition prediction capability across other Mg-based binary alloys,including Mg-La,Mg-Sn,Mg-Ce,Mg-Sm,Mg-Ag,and Mg-Y,thereby emphasizing its generalization and extrapolation potential.This research establishes a non-destructive,microstructure-informed composition analysis framework,reduces characterization time compared to traditional experiment methods and provides insights into the composition-microstructure relationship in diverse material systems.
基金supported in part by the National Nature Science Foundation of China under Grants 62476216 and 62006184in part by the Key Research and Development Program of Shaanxi Province under Grant 2024GX-YBXM-146+1 种基金in part by the Scientific Research ProgramFunded by EducationDepartment of the Shaanxi Provincial Government under Grant 23JP091the Youth Innovation Team of Shaanxi Universities.
摘要Traffic flow prediction is of great importance in traffic planning,road resource management,and congestion mitigation.However,existing prediction have significant limitations in modeling multi-scale spatial-temporal features,particularly in capturing temporal periodicity and spatial dependency in dynamically evolving traffic networks.This paper proposes a novel framework of traffic flow prediction,referred to as Adaptive Graph Fusion Dual-scale Convolutional Network(AGFDCN),which integrates spatial-temporal dynamic graphs with dual-scale convolutional networks.Specifically,we introduce a Dual-Scale Temporal Network,which combines long-and short-term dilated causal convolutions with a temporal decay-aware attention mechanism to efficiently capture traffic patterns across multiple temporal scales.Furthermore,we design a Dynamic Adaptive Graph Module,which models complex spatial dependencies in traffic networks through an adaptive graph fusion mechanism and a dual-path attention-gated module.Finally,the temporal and spatial representations are integrated by employing a gated fusion mechanism,enhancing the overall prediction performance.Experimental results obtained based on three highway datasets(i.e.,PEMS04,PEMS07 and PEMS08)verify that the proposed model outperforms several state-of-the-art baselines in various evaluation metrics.Compared to the spatial-temporal graph model AGCRN with best performance in the baseline models,the proposed model exhibits significant improvements across all datasets:it achieves reduces of MAE by 42.07%and RMSE by 35.43%on PEMS04;MAE by 28.35%and RMSE by 29.28%on PEMS07;and MAE by 30.52%and RMSE by 30.73%on PEMS08,respectively,validating its effectiveness in modeling complex spatial-temporal traffic data and its robustness in handling sudden traffic changes.
基金Supported by the National Key Research and Development Program of China(No.2023YFC3008202)the National Natural Science Foundation of China(No.42406019)the Scientific Research Fund of Zhejiang Provincial Education Department(No.Y202353066)。
摘要The prediction of sea surface partial pressure of carbon dioxide(pCO2)in the South China Sea is crucial for understanding the region’s contribution to the global carbon budget and its interactions with climate change.We applied the Spatiotemporal Convolutional Long Short-Term Memory(STConvLSTM)model,integrating key environmental factors including sea surface temperature(SST),sea surface salinity(SSS),and chlorophyll a(Chl a),to predict and analyze sea surface pCO2in the South China Sea.The model demonstrated high accuracy in short-term predictions(1 month),with a mean absolute error(MAE)of 0.394,a root mean square error(RMSE)of 0.659,and a coefficient of determination(R2)of 0.998.For long-term predictions(12 months),the model maintained its predictive capability,with an MAE of 0.667,RMSE of 1.255,and R2of 0.994.Feature importance analysis revealed that sea surface pCO2and SST were the main drivers of the model’s predictions,whereas Chl a and SSS had relatively minor impacts.The model’s generalization ability was further validated in the northwest Pacific Ocean and tropical Pacific Ocean,where it successfully captured the spatiotemporal variation in pCO2with small prediction errors.The ST-ConvLSTM model provides an efficient and accurate tool for forecasting and analyzing sea surface pCO2in the South China Sea,offering new insights into global carbon cycling and climate change.This study demonstrates the potential of deep learning in marine science and provides a significant technical support for global changes and marine ecosystem research.
基金supported in part by Beijing Natural Science Foundation under Grant L251058in part by Project of State Key Lab of Intelligent Transportation System under Grant 2024-A001.
摘要Traffic holographic perception refers to the real-time,high-fidelity,and multi-dimensional sensing of traffic states through the fusion of heterogeneous sensors,including cameras,radars,and connected vehicle data.The multi-source perception data obtained thereby can provide a complete digital representation of the road network for the Intelligent Transportation System(ITS).However,sensors are vulnerable to environmental interference,which can result in data loss at specific points or along arterial highways for certain periods,potentially undermining system safety and decision-making reliability.To address these challenges,a deep learning method based on Graph Convolutional Networks(GCN)and Gated Recurrent Units(GRU)is proposed,leveraging Artificial Intelligence(AI)and intelligent connected technologies for real-time acquisition of multi-sensor perception data.A feature-level fusion integrates multi-source perception data.GCN captures spatial dependencies from the road network topology,while GRU extracts temporal features from time series,enabling accurate imputation of missing traffic data.The method is evaluated at intelligent connected intersections in the Beijing High-level Autonomous Driving Demonstration Area.Results show that the accuracy of long-term traffic state completion reaches 89.36%,and the Root Mean Square Error(RMSE)is reduced by 17.2%compared to the Long Short-Term Memory(LSTM)baseline.This framework provides a practical solution for deploying traffic holographic perception technology in secure and trustworthy ITS.
基金supported in part by the National Natural Science Foundation of China(62573387)the Natural Science Foundation of Zhejiang province,China(LY24F030004)the Fundamental Research Funds of Zhejiang Sci-Tech University(25222139-Y).
摘要Partial least squares (PLS) model maximizes the covariance between process variables and quality variables,making it widely used in quality-related fault detection.However,traditional PLS methods focus primarily on linear processes,leading to poor performance in dynamic nonlinear processes.In this paper,a novel quality-related fault detection method,named DiCAE-PLS,is developed by combining dynamic-inner convolutional autoencoder with PLS.In the proposed DiCAE-PLS method,latent features are first extracted through dynamic-inner convolutional autoencoder (DiCAE) to capture process dynamics and nonlinearity from process variables.Then,a PLS model is established to build the relationship between the extracted latent features and the final product quality.To detect quality-related faults,Hotelling's T2 statistic is employed.The developed quality-related fault detection is applied to the widely used industrial benchmark of the Tennessee.
基金funded by scientific research projects under Grant JY2024B011.
摘要With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance strategies often struggle to accurately predict the degradation process of equipment,leading to excessive maintenance costs or potential failure risks.However,existing prediction methods based on statistical models are difficult to adapt to nonlinear degradation processes.To address these challenges,this study proposes a novel condition-based maintenance framework for planetary gearboxes.A comprehensive full-lifecycle degradation experiment was conducted to collect raw vibration signals,which were then processed using a temporal convolutional network autoencoder with multi-scale perception capability to extract deep temporal degradation features,enabling the collaborative extraction of longperiod meshing frequencies and short-term impact features from the vibration signals.Kernel principal component analysis was employed to fuse and normalize these features,enhancing the characterization of degradation progression.A nonlinear Wiener process was used to model the degradation trajectory,with a threshold decay function introduced to dynamically adjust maintenance strategies,and model parameters optimized through maximum likelihood estimation.Meanwhile,the maintenance strategy was optimized to minimize costs per unit time,determining the optimal maintenance timing and preventive maintenance threshold.The comprehensive indicator of degradation trends extracted by this method reaches 0.756,which is 41.2%higher than that of traditional time-domain features;the dynamic threshold strategy reduces the maintenance cost per unit time to 55.56,which is 8.9%better than that of the static threshold optimization.Experimental results demonstrate significant reductions in maintenance costs while enhancing system reliability and safety.This study realizes the organic integration of deep learning and reliability theory in the maintenance of planetary gearboxes,provides an interpretable solution for the predictive maintenance of complex mechanical systems,and promotes the development of condition-based maintenance strategies for planetary gearboxes.
基金Project supported by the CAS project for Young Scientists in Basic Research(Grant Nos.YSBR-059 and YSBR115)the National Natural Science Foundation of China(Grant No.92150103)。
摘要Attosecond light sources serve as crucial tools for investigating the ultrafast electronic dynamics in matter with remarkable temporal resolution.Traditional methods face difficulties in accurately measuring attosecond pulses,and the prevailing approach involves utilizing attosecond streak cameras coupled with inversion algorithms to reconstruct phase information.However,these algorithms often require multiple iterations and extensive computational time.This study investigates the utilization of autocorrelation graphs as inputs for a convolutional neural network(CNN)to invert streaking traces obtained by attosecond streak camera.We explore the noise resistance capability of autocorrelation within the CNN inversion and aim to provide a physical explanation for its effectiveness.The objective of this research is to enhance the accuracy and reliability of CNN inversion for attosecond streaking traces,enabling improved resilience against experimental noises.
摘要Reliable traffic flow prediction is crucial for mitigating urban congestion.This paper proposes Attentionbased spatiotemporal Interactive Dynamic Graph Convolutional Network(AIDGCN),a novel architecture integrating Interactive Dynamic Graph Convolution Network(IDGCN)with Temporal Multi-Head Trend-Aware Attention.Its core innovation lies in IDGCN,which uniquely splits sequences into symmetric intervals for interactive feature sharing via dynamic graphs,and a novel attention mechanism incorporating convolutional operations to capture essential local traffic trends—addressing a critical gap in standard attention for continuous data.For 15-and 60-min forecasting on METR-LA,AIDGCN achieves MAEs of 0.75%and 0.39%,and RMSEs of 1.32%and 0.14%,respectively.In the 60-min long-term forecasting of the PEMS-BAY dataset,the AIDGCN out-performs the MRA-BGCN method by 6.28%,4.93%,and 7.17%in terms of MAE,RMSE,and MAPE,respectively.Experimental results demonstrate the superiority of our pro-posed model over state-of-the-art methods.
基金the National Natural Science Founda-tion of China(No.62162027)the Jiangxi Provincial Graduate Innovation Project(No.YC2023-S533)the Science and Technology Project of Jiangxi Provin-cial Department of Education(No.GJJ210655)。
摘要Image inpainting is a crucial research area in computer vision.Despite significant advancements with deep learning methods,challenges such as information loss and weak adaptability remain.This paper introduces a Transformer-based image inpainting method named Swin2FII,which integrates SwinV2 Transformer and fast Fourier convolution structure to address information loss and bottleneck issues,significantly enhancing inpainting accuracy and expanding its application scope.Swin2FII incorporates a super-resolution model,enhancing feature extraction and information transmission through efficient reconstruction,thereby improving detail recovery and stability.We employ the Charbonnier loss function to address gradient explosion,accurately estimating low-frequency signals and enhancing the precision of detail and texture reconstruction.Furthermore,combining mixed-precision training and data augmentation significantly boosts the model's adaptability and generalization ability.Experimental results show that our Swin2FII method outperforms the existing techniques on multiple public datasets.Notably,it exhibits excellent generalization and performance in a variety of scenarios and mask scales.In addition,Swin2FII also demonstrates strong capabilities in fluid image inpainting and mural image inpainting tasks.
摘要We propose a novel fast numerical calculation method for the Rayleigh-Sommerfeld diffraction integral,which is developed based on the existing scaled convolution method.This approach enables fast cal-culations for general cases of off-axis scenarios where the sampling intervals and numbers of the input and observation planes are unequal.Additionally,it allows for arbitrary adjustment of the sampling interval of the impulse response function,facilitating a manual trade-off between computational load and accuracy.The er-rors associated with this method,which is equivalent to interpolation,primarily arise from the discontinuities of the sampling matrix of the impulse response function on its boundaries of periodic extension.To address this issue,we propose the concept of the padding function and its construction method,and evaluate its ef-fectiveness in enhancing computational accuracy.The feasibility of the proposed method is verified by nu-merical simulation and compared with the direct integration DI-method in a simplified scenario.It shows that the proposed method has good computational accuracy for the general case where the sampling interval of the input and observation plane is not equal under non-near-field diffraction,and when the diffraction distance is large,although the computational accuracy of the proposed method cannot exceed that of the DI-method,the computational amount can be significantly reduced with almost no effect on the computational accuracy.This method provides a general numerical calculation scheme of diffraction in the non-near field case for areas such as computational holography.
基金supported by the National Key R&D Program of China(Grant No.2021YFA0719200)the National Natural Science Foundation of China(Grant Nos.11672314,12272391,and 12232020)+1 种基金the CAS Project for Young Scientists in Basic Research(Grant No.YSBR-096)supported by National Supercomputing Center in Shenzhen(Shenzhen Cloud Computing Center)and the Computing Facility,Institute of Mechanics,Chinese Academy of Sciences.
摘要Machine learning models have made significant advances in the establishment of structure-property relationships.However,it is still a challenge to predict the mechanical properties of the adhesive interface due to the complexity and randomness of the polymer topologies.In this paper,we employed a graph convolutional network(GCN)model to predict the mechanical properties of a specific cross-linked polymer interfacial system,including yield strength(σy),ultimate strength(σu),failure strain(εu),and fracture toughness(Γ)utilizing molecular dynamics simulations.The results showed that the adopted GCN model can predict the mechanical properties with over 88%accuracy.Furthermore,the prediction performances for εu and σu are better than those for Γ and σy,with R2~0.73 for εu,R2~0.64 for σu,R2~0.51 for Γ,and R2~0.43 for σy.It is worth noting that the GCN model with the sum aggregator slightly outperforms that with the mean aggregator,and that models with linear regression and fully connected neural network regression provide similar predictions.The influence of input node features on prediction performance was also investigated.It was observed that the node closeness centrality is an important graph parameter in prediction.Specifically,node closeness centrality presents a more significant influence on the global mechanical properties of the adhesive interface,such as εu,σu,and Γ.Additionally,sensitivity analysis demonstrated that appropriate hyperparameters can improve computational efficiency without losing accuracy on a restricted set of data.This paper demonstrated the capacity of the GCN model to predict the mechanical properties of the adhesive interface with diverse topologies and provided a possible pathway for improving the mechanical properties of the adhesive interface by tailoring polymer structures in the future.
基金by Chengdu Science and Technology Program(2026-YF08-00034-GX).
摘要Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models face several challenges,including computational complexity,noise blurring,and information loss.This paper proposes an enhanced convolutional attention network(ECANet)for liver segmentation.ECANet uses a U-shaped architecture with efficient channel-attention-based skip connections.Both the encoder and decoder are constructed using enhanced convolutional Transformer(ECT)blocks,where group convolution is integrated into the convolutional attention module for efficient Token embedding and channel disentanglement,and a Token-wise multi-layer perceptron(MLP)branch is incorporated into the wide-focus module to improve feature representation across channels.Deep supervision and a hybrid of Binary Cross-Entropy(BCE)and Dice loss are used to improve boundary accuracy.We evaluate the proposed model on the publicly available LiTS17 dataset.Experiments show that ECANet outperforms the compared CNN-based and CNN-Transformer baseline models on both quantitative and qualitative measures.
基金Support by Sichuan Science and Technology Program[2023YFSY0026,2023YFH0004]Guangzhou Huashang University[2024HSZD01,HS2023JYSZH01].
摘要Graph neural networks(GNN)have shown strong performance in node classification tasks,yet most existing models rely on uniform or shared weight aggregation,lacking flexibility in modeling the varying strength of relationships among nodes.This paper proposes a novel graph coupling convolutional model that introduces an adaptive weighting mechanism to assign distinct importance to neighboring nodes based on their similarity to the central node.Unlike traditional methods,the proposed coupling strategy enhances the interpretability of node interactions while maintaining competitive classification performance.The model operates in the spatial domain,utilizing adjacency list structures for efficient convolution and addressing the limitations of weight sharing through a coupling-based similarity computation.Extensive experiments are conducted on five graph-structured datasets,including Cora,Citeseer,PubMed,Reddit,and BlogCatalog,as well as a custom topology dataset constructed from the Open University Learning Analytics Dataset(OULAD)educational platform.Results demonstrate that the proposed model achieves good classification accuracy,while significantly reducing training time through direct second-order neighbor fusion and data preprocessing.Moreover,analysis of neighborhood order reveals that considering third-order neighbors offers limited accuracy gains but introduces considerable computational overhead,confirming the efficiency of first-and second-order convolution in practical applications.Overall,the proposed graph coupling model offers a lightweight,interpretable,and effective framework for multi-label node classification in complex networks.