Lithology identificationwhile drilling technology can obtain rock information in real-time.However,traditional lithology identificationmodels often face limitations in feature extraction and adaptability to complex ge...Lithology identificationwhile drilling technology can obtain rock information in real-time.However,traditional lithology identificationmodels often face limitations in feature extraction and adaptability to complex geological conditions,limiting their accuracy in challenging environments.To address these challenges,a deep learning model for lithology identificationwhile drilling is proposed.The proposed model introduces a dual attention mechanism in the long short-term memory(LSTM)network,effectively enhancing the ability to capture spatial and channel dimension information.Subsequently,the crayfishoptimization algorithm(COA)is applied to optimize the model network structure,thereby enhancing its lithology identificationcapability.Laboratory test results demonstrate that the proposed model achieves 97.15%accuracy on the testing set,significantlyoutperforming the traditional support vector machine(SVM)method(81.77%).Field tests under actual drilling conditions demonstrate an average accuracy of 91.96%for the proposed model,representing a 14.31%improvement over the LSTM model alone.The proposed model demonstrates robust adaptability and generalization ability across diverse operational scenarios.This research offers reliable technical support for lithology identification while drilling.展开更多
To address the complexities associated with forecasting low-probability,low-visibility fog events and the underlying nonlinear interdependencies among various influencing variables,we present an attention mechanism-em...To address the complexities associated with forecasting low-probability,low-visibility fog events and the underlying nonlinear interdependencies among various influencing variables,we present an attention mechanism-em-bedded long short-term memory(ATT-LSTM)deep learning model for sea fog visibility hazard prediction.This archi-tecture seamlessly incorporates ATT into the conventional LSTM neural network framework.This integration enables the model to adaptively assign weights to the input features,thereby distinguishing between salient and non-salient variables.This targeted allocation enhances the contribution of considerable factors within the LSTM forecasting algorithm,opti-mizes input data,and assigns varying levels of attention to each variable.Consequently,the model substantially mitigates prediction errors in multivariate scenarios.An empirical analysis employing an independent dataset encompassing 303 foggy days over a biennial period confirmed the superior performance of the proposed ATT-LSTM model.Comparative evaluations with LSTM,logistic classification regression,and support vector machine classification regression models revealed that the ATT-LSTM model achieved a recall rate of 37%,a precision rate of 48%,an accuracy rate of 91%,and a threat score(TS)of 0.26.Among the assessed methodologies,the ATT-LSTM model outperformed the others in terms of recall,accuracy,and TS metrics.These findings confirm that the ATT-LSTM model offers a potent and innovative deep learning approach for enhancing the accuracy of low-visibility sea fog hazard predictions.展开更多
Accurate tropical cyclone track forecasting is of crucial importance for effective disaster risk management in coastal regions.These storms are recognized as one of nature's most hazardous weather phenomena.Howeve...Accurate tropical cyclone track forecasting is of crucial importance for effective disaster risk management in coastal regions.These storms are recognized as one of nature's most hazardous weather phenomena.However,traditional typhoon track prediction methods face certain limitations in handling complex meteorological data and multi-dimensional features.To improve prediction accuracy,this paper proposes an improved Wide&Deep framework.This framework utilizes a Stacked Two-layer Long Short-Term Memory(S2-LSTM)encoder in the Wide branch to model the sequential features of typhoon tracks,and incorporates a Multi-ConvGRU in the Deep branch to handle three-dimensional meteorological data.Following a dynamic/static feature decomposition,the S2-LSTM encoder processes a subset of dynamic features,effec-tively integrating typhoon position,wind speed,and rate-of-change information from multiple time steps to better capture the temporal evolution patterns of typhoon movement.Furthermore,a Coordinate Attention(CA)module is introduced,which captures positional dependencies along the vertical and horizontal dimensions within the feature maps through a factorized average pooling operation.This enhances the model's ability in identifying key areas within atmospheric fields,thus ensuring improved spatial precision in typhoon track forecasting.The model's efficacy was assessed with the 2020-2024 typhoon track dataset published by the China Meteorological Administration(CMA)and the ERA5 reanalysis product maintained by the European Centre for Medium-Range Weather Forecasts(ECMWF).The findings indicate how the two introduced enhancements to the model lead to higher precision for deep learning-based forecasts to a certain extent.展开更多
In complex network analysis,node ranking is vital for propagation prediction,structural optimization,and intervention strategy design,yet existing methods often fail to effectively integrate community information in d...In complex network analysis,node ranking is vital for propagation prediction,structural optimization,and intervention strategy design,yet existing methods often fail to effectively integrate community information in dynamic settings.To address this,this paper proposes a node ranking method that combines graph attention mechanisms with contrastive learning.Community detection is employed to extract node-level community features,and a joint embedding module is designed to fuse global and local structures,thereby incorporating community information into node representations.Based on this,a multi-layer graph attention network adaptively learns node and neighborhood features,while contrastive learning mitigates interference from dynamic evolution and strengthens the model's ability to capture multi-scale structural differences.Experiments on multiple dynamic network datasets show that the proposed method significantly outperforms existing approaches in ranking accuracy,particularly in networks with higher average degrees and clearer community structures.These results validate the effectiveness of the method in enhancing feature representation and modeling multi-scale dynamic node influence.展开更多
Single Image Super-Resolution(SISR)seeks to reconstruct high-resolution(HR)images from lowresolution(LR)inputs,thereby enhancing visual fidelity and the perception of fine details.While Transformer-based models—such ...Single Image Super-Resolution(SISR)seeks to reconstruct high-resolution(HR)images from lowresolution(LR)inputs,thereby enhancing visual fidelity and the perception of fine details.While Transformer-based models—such as SwinIR,Restormer,and HAT—have recently achieved impressive results in super-resolution tasks by capturing global contextual information,these methods often suffer from substantial computational and memory overhead,which limits their deployment on resource-constrained edge devices.To address these challenges,we propose a novel lightweight super-resolution network,termed Binary Attention-Guided Information Distillation(BAID),which integrates frequency-aware modeling with a binary attention mechanism to significantly reduce computational complexity and parameter count whilemaintaining strong reconstruction performance.The network combines a high–low frequency decoupling strategy with a local–global attention sharing mechanism,enabling efficient compression of redundant computations through binary attention guidance.At the core of the architecture lies the Attention-Guided Distillation Block(AGDB),which retains the strengths of the information distillation framework while introducing a sparse binary attention module to enhance both inference efficiency and feature representation.Extensive×4 superresolution experiments on four standard benchmarks—Set5,Set14,BSD100,and Urban100—demonstrate that BAID achieves Peak Signal-to-Noise Ratio(PSNR)values of 32.13,28.51,27.47,and 26.15,respectively,with only 1.22 million parameters and 26.1 G Floating-Point Operations(FLOPs),outperforming other state-of-the-art lightweight methods such as Information Multi-Distillation Network(IMDN)and Residual Feature Distillation Network(RFDN).These results highlight the proposed model’s ability to deliver high-quality image reconstruction while offering strong deployment efficiency,making it well-suited for image restoration tasks in resource-limited environments.展开更多
Soil Moisture(SM)monitoring using Global Navigation Satellite System-Reflectometry(GNSS-R)has often relied on observations from a single source,thereby resulting in underutilizing abundant reflected signal resources.M...Soil Moisture(SM)monitoring using Global Navigation Satellite System-Reflectometry(GNSS-R)has often relied on observations from a single source,thereby resulting in underutilizing abundant reflected signal resources.Moreover,aggregating multi-source observations without considering their heterogeneous characteristics can lead to suboptimal retrieval performance.To address these limitations,this study proposes a dual-branch attention-fusion Transformer model for global SM retrieval by integrating GNSS-R observations from the complementary Tianmu-1 and Fengyun-3 missions.The proposed model learns mission-specific feature representations and adaptively fuses them through attention-based fusion mechanism,thereby enabling effective exploitation of cross-mission comple mentary information.The integrated Tianmu-1+Fengyun-3 Level-1 dataset provides an average monthly temporal coverage of 79.7%globally.Using Soil Moisture Active Passive(SMAP)SM products as the reference,the proposed approach achieves correlation coefficient of 0.88 and root mean square error(RMSE)of 0.053 m3/m3,outperforming the conventional feature-concatenation and feature-merged baselines.Independent validation against measure ments from International Soil Moisture Network further confirms reliable performance,yielding an average correlation coefficient of 0.67 and unbiased RMSE of 0.041 m3/m3.In addition,Extended Triple Collocation(ETC)analysis dem onstrates satisfactory retrieval accuracy,with average ETC-derived correlation coefficient of 0.75 and random error standard deviation of 0.030 m3/m3.Overall,the results of this study demonstrate the effectiveness of the proposed attention-guided multi-mission SM retrieval framework and highlight its potential for enhancing spatiotemporal con tinuity of GNSS-R-based hydrological monitoring.展开更多
Landslides are one of the most significant types of geological disasters worldwide.However,current landslide disaster recognition models generally face issues such as low training efficiency,reliance on large amounts ...Landslides are one of the most significant types of geological disasters worldwide.However,current landslide disaster recognition models generally face issues such as low training efficiency,reliance on large amounts of samples,and vague feature extraction.To address these problems,this paper proposes an enhanced intelligent recognition model based on an improved residual network.Taking remote sensing images from landslide-prone areas in Bijie City,Guizhou Province,China as the research subject,we implemented data augmentation techniques to expand the datasets,subsequently partitioning it into training and validation subsets at a73:27 ratio.During model training,a transfer learning strategy was employed to improve training efficiency through the utilization of ImageNet pre-trained weights.The Res Net50 network architecture was enhanced through the integration of channel attention and spatial attention mechanisms,enabling more effective extraction of critical landslide features.Comparative analysis indicates that after introducing the attention mechanisms,the enhanced model achieved an increase of 1.49% in accuracy,0.45% in precision,1.52% in F1 score,and 0.0297 in Kappa coefficient on the validation set.Notably,recall improved by 2.59%,indicating that the improved model has enhanced landslide disaster recognition capability and overall performance.This study successfully coupled the transfer learning strategy with a dual-attention mechanism into the ResNet50 architecture,allowing the rapid construction of an efficient recognition model under limited sample conditions,significantly improving the comprehensive performance and generalisation ability of the landslide recognition model.展开更多
Intelligent transportation and autonomous driving systems have made urgent demands on the techniques with high performance on object detection in traffic scenes.This paper proposes an improved object detection model Y...Intelligent transportation and autonomous driving systems have made urgent demands on the techniques with high performance on object detection in traffic scenes.This paper proposes an improved object detection model YOLO-VSF over the YOLOv4 model,which is a representative work with excellent performance among YOLO series of object detection models.The main improvement measures include:The backbone feature extraction network CSPDarknet53 of YOLOv4 is replaced with VGG16 to improve the feature extraction capability;SENet attention mechanism is incorporated to improve the salient and correlation feature representation capability;Focal Loss is integrated into the loss function to overcome the sample imbalance problem.In addition,the detection performance of small targets is improved by increasing the resolution of input images.Experimental results show that on the VanJee traffic image dataset provided by Beijing VanJee Technology Co.,Ltd.,the proposed YOLO-VSF model achieves an average mean accuracy(mAP)of 92.21 percentage points,which improves the mAP by 3.04 percentage points compared with the YOLOv4 model while maintaining the detection speed of the original model.On the UA-DETRAC dataset,the average accuracy of YOLO-VSF is close to that of the latest YOLOv7 model with the number of parameters reduced by 1.329×107.The proposed method can provide a support for object detection in traffic scenes.展开更多
In massive multiple-input multiple-output(MIMO)systems utilizing frequency division duplexing,optimizing system performance requires user equipment(UE)to compress downlink channel state information(CSI)and transmit it...In massive multiple-input multiple-output(MIMO)systems utilizing frequency division duplexing,optimizing system performance requires user equipment(UE)to compress downlink channel state information(CSI)and transmit it to the base station(BS).As the number of antennas increases,there is a significant rise in the overhead related to CSI feedback,posing considerable challenges to the precise acquisition of CSI by the BS.Existing approaches to CSI feedback utilizing deep learning techniques face challenges such as significant feedback overhead and limited precision in the reconstruction process.This study presents a novel lightweight CSI feedback framework known as the dual attention neural network(DANet).Within the DANet architecture,a dual attention module(DAM)is designed to enhance the network's performance.This DAM includes both channel attention blocks and spatial attention blocks.The channel attention blocks direct the model's focus toward channel features rich in information content while simultaneously suppressing less significant features.This approach enables the extraction of temporal correlations within the CSI matrix.The spatial attention block aids in extracting the correlation between the delay domain and the angle domain in the CSI matrix.By enhancing neural network performance,the DAM reduces information dispersion while enhancing the representation of global interactions.Simulation results demonstrate that DANet exhibits superior normalized mean square error and cosine similarity with comparable complexity compared to existing advanced CSI feedback methods.展开更多
Base substitution,insertion,and deletion errors due to inherent technical constraints inducing unavoidable sequencing inaccuracies,limiting access to high-quality raw data and biological knowledge.To address this,we p...Base substitution,insertion,and deletion errors due to inherent technical constraints inducing unavoidable sequencing inaccuracies,limiting access to high-quality raw data and biological knowledge.To address this,we propose a deep sequence reconstruction model based on the multi-scale attention mechanism and contrastive learning(MACL),designed to enhance DNA sequence reconstruction under highly error rate conditions.The multi-scale attention mechanism includes base scale,inter-sequence and intra-sequence scale.First,the MSA Transformer fully extracts both global and local features of the base scale from the dimensions of the rows and columns.Furthermore,for the errors between sequences and the substitution errors within sequences,MACL proposes Inter-Sequence and Intra-Sequence Multi-Head Attention Mechanisms,respectively,and handles the insertion and deletion errors through the convolution module.In order to maximize the consistency of positive sample pairs in the representation space,we introduce contrastive learning and design a negative sample construction method and data augmentation that are more suitable for substitution errors in sequencing channels.Experiments on real-world DNA storage and viral genome datasets demonstrate that MACL significantly outperforms existing methods in reconstructing the DNA sequence.In particular,when combined with RS codes,MACL can losslessly reconstruct medical images in highly biased sequence(base error rate=5%)in DNA storage.In summary,the MACL introduces a novel approach to DNA sequence reconstruction in highly error rate conditions,laying a solid foundation for practical applications in DNA storage and genomics research.展开更多
Existing asphalt pavement rutting prediction models suffer from large long-term prediction errors due to their reliance on laboratory parameters and simplified assumptions.To address this issue,a dual-branch spatio-te...Existing asphalt pavement rutting prediction models suffer from large long-term prediction errors due to their reliance on laboratory parameters and simplified assumptions.To address this issue,a dual-branch spatio-temporal attention network model(DSAN)is proposed.The model is constructed by fusing temporal convolutional networks(TCN),long short-term memory networks(LSTM),and multi-head attention mechanisms to form parallel feature extraction branches for hierarchical spatio-temporal modeling.Validation is conducted based on full-scale pavement loop test results of eight typical asphalt pavement structures(AC layer thickness:12–52 cm)under 80 million equivalent standard axle loads(ESALs)accumulated during 2017–2023.Results show that the DSAN model significantly outperforms comparative models in prediction accuracy,breaking through the generalization bottleneck of traditional models for different layer thickness structures.This study provides an efficient solution for long-term performance prediction of asphalt pavements.展开更多
Modern business information systems face significant challenges in managing heterogeneous data sources,integrating disparate systems,and providing real-time decision support in complex enterprise environments.Contempo...Modern business information systems face significant challenges in managing heterogeneous data sources,integrating disparate systems,and providing real-time decision support in complex enterprise environments.Contemporary enterprises typically operate 200+interconnected systems,with research indicating that 52% of organizations manage three or more enterprise content management systems,creating information silos that reduce operational efficiency by up to 35%.While attention mechanisms have demonstrated remarkable success in natural language processing and computer vision,their systematic application to business information systems remains largely unexplored.This paper presents the theoretical foundation for a Hierarchical Attention-Based Business Information System(HABIS)framework that applies multi-level attention mechanisms to enterprise environments.We provide a comprehensive mathematical formulation of the framework,analyze its computational complexity,and present a proof-of-concept implementation with simulation-based validation that demonstrates a 42% reduction in crosssystem query latency compared to legacy ERP modules and 70% improvement in prediction accuracy over baseline methods.The theoretical framework introduces four hierarchical attention levels:system-level attention for dynamic weighting of business systems,process-level attention for business process prioritization,data-level attention for critical information selection,and temporal attention for time-sensitive pattern recognition.Our complexity analysis demonstrates that the framework achieves O(n log n)computational complexity for attention computation,making it scalable to large enterprise environments including retail supply chains with 200+system-scale deployments.The proof-of-concept implementation validates the theoretical framework’s feasibility withMSE loss of 0.439 and response times of 0.000120 s per query,demonstrating its potential for addressing key challenges in business information systems.This work establishes a foundation for future empirical research and practical implementation of attention-driven enterprise systems.展开更多
The 6D pose estimation of objects is of great significance for the intelligent assembly and sorting of industrial parts.In the industrial robot production scenarios,the 6D pose estimation of industrial parts mainly fa...The 6D pose estimation of objects is of great significance for the intelligent assembly and sorting of industrial parts.In the industrial robot production scenarios,the 6D pose estimation of industrial parts mainly faces two challenges:one is the loss of information and interference caused by occlusion and stacking in the sorting scenario,the other is the difficulty of feature extraction due to the weak texture of industrial parts.To address the above problems,this paper proposes an attention-based pixel-level voting network for 6D pose estimation of weakly textured industrial parts,namely CB-PVNet.On the one hand,the voting scheme can predict the keypoints of affected pixels,which improves the accuracy of keypoint localization even in scenarios such as weak texture and partial occlusion.On the other hand,the attention mechanism can extract interesting features of the object while suppressing useless features of surroundings.Extensive comparative experiments were conducted on both public datasets(including LINEMOD,Occlusion LINEMOD and T-LESS datasets)and self-made datasets.The experimental results indicate that the proposed network CB-PVNet can achieve accuracy of ADD(-s)comparable to state-of-the-art using only RGB images while ensuring real-time performance.Additionally,we also conducted robot grasping experiments in the real world.The balance between accuracy and computational efficiency makes the method well-suited for applications in industrial automation.展开更多
Data-driven deep learning modeling has been increasingly applied to quality prediction in complex chemical processes.However,the data show complex temporal features due to different residence times and strong coupling...Data-driven deep learning modeling has been increasingly applied to quality prediction in complex chemical processes.However,the data show complex temporal features due to different residence times and strong coupling relationships among chemical entities.This study proposes a multi-scale temporal feature extraction module to extract local dynamic temporal features across different time scales and combines it with long short-term memory(LSTM)networks to capture global temporal patterns,thereby taking full advantage of available data.In addition,variable-wise channel attention is integrated into the model to enhance attention on the essential parts of the feature maps and improve predictive performance.Furthermore,by analyzing the attention weights,the model quickly identifies the key variables that significantly affect the predictions.Finally,the model is applied to a real corn starch liquefaction process and achieves an accurate product quality prediction with an R2 value of 0.9392,which represents a 4%to 9%improvement over traditional models and demonstrates the superiority of the proposed approach.展开更多
Accurate wind speed prediction is crucial for stabilizing power grids with high wind energy penetration.This study presents a novel machine learning model that integrates clustering,deep learning,and transfer learning...Accurate wind speed prediction is crucial for stabilizing power grids with high wind energy penetration.This study presents a novel machine learning model that integrates clustering,deep learning,and transfer learning to mitigate accuracy degradation in 24-h forecasting.Initially,an optimized DB-SCAN(Density-Based Spatial Clustering of Applications with Noise)algorithm clusters wind fields based on wind direction,probability density,and spectral features,enhancing physical interpretability and reducing training complexity.Subsequently,a ResNet(Residual Network)extracts multi-scale patterns from decomposed wind signals,while transfer learning adapts the backbone network across clusters,cutting training time by over 90%.Finally,a CBAM(Convolutional Block Attention Module)attention mechanism is employed to prioritize features for LSTM-based prediction.Tested on the 2015 Jena wind speed dataset,the model demonstrates superior accuracy and robustness compared to state-of-the-art baselines.Key innovations include:(a)Physics-informed clustering for interpretable wind regime classification;(b)Transfer learning with deep feature extraction,preserving accuracy while minimizing training time;and(c)On the 2016 Jena wind speed dataset,the model achieves MAPE(Mean Absolute Percentage Error)values of 16.82%and 18.02%for the Weibull-shaped and Gaussian-shaped wind speed clusters,respectively,demonstrating the model’s robust generalization capacity.This framework offers an efficient and effective solution for long-term wind forecasting.展开更多
基金supported by the National Key Research and Development Program for Young Scientists,Chin(Grant No.2021YFC2900400)the Sichuan-Chongqing Science and Technology Innovation Cooperation Program Project,China(Grant No.2024TIAD-CYKJCXX0269)the National Natural Science Foundation of China,China(Grant No.52304123).
摘要Lithology identificationwhile drilling technology can obtain rock information in real-time.However,traditional lithology identificationmodels often face limitations in feature extraction and adaptability to complex geological conditions,limiting their accuracy in challenging environments.To address these challenges,a deep learning model for lithology identificationwhile drilling is proposed.The proposed model introduces a dual attention mechanism in the long short-term memory(LSTM)network,effectively enhancing the ability to capture spatial and channel dimension information.Subsequently,the crayfishoptimization algorithm(COA)is applied to optimize the model network structure,thereby enhancing its lithology identificationcapability.Laboratory test results demonstrate that the proposed model achieves 97.15%accuracy on the testing set,significantlyoutperforming the traditional support vector machine(SVM)method(81.77%).Field tests under actual drilling conditions demonstrate an average accuracy of 91.96%for the proposed model,representing a 14.31%improvement over the LSTM model alone.The proposed model demonstrates robust adaptability and generalization ability across diverse operational scenarios.This research offers reliable technical support for lithology identification while drilling.
基金Guangxi Key Research and Development Program(Guike AB20159013)National Natural Science Foundation of China(4206050052)China Meteorological Administration Innovation Development Project(CXFZ2022J029)。
摘要To address the complexities associated with forecasting low-probability,low-visibility fog events and the underlying nonlinear interdependencies among various influencing variables,we present an attention mechanism-em-bedded long short-term memory(ATT-LSTM)deep learning model for sea fog visibility hazard prediction.This archi-tecture seamlessly incorporates ATT into the conventional LSTM neural network framework.This integration enables the model to adaptively assign weights to the input features,thereby distinguishing between salient and non-salient variables.This targeted allocation enhances the contribution of considerable factors within the LSTM forecasting algorithm,opti-mizes input data,and assigns varying levels of attention to each variable.Consequently,the model substantially mitigates prediction errors in multivariate scenarios.An empirical analysis employing an independent dataset encompassing 303 foggy days over a biennial period confirmed the superior performance of the proposed ATT-LSTM model.Comparative evaluations with LSTM,logistic classification regression,and support vector machine classification regression models revealed that the ATT-LSTM model achieved a recall rate of 37%,a precision rate of 48%,an accuracy rate of 91%,and a threat score(TS)of 0.26.Among the assessed methodologies,the ATT-LSTM model outperformed the others in terms of recall,accuracy,and TS metrics.These findings confirm that the ATT-LSTM model offers a potent and innovative deep learning approach for enhancing the accuracy of low-visibility sea fog hazard predictions.
基金Supported by the State Key Laboratory of Climate System Prediction and Risk Management(CPRM)initiative project(Grant No.CPRM-2025-NUIST-012)the China Meteorological Administration Youth Innovation Team(CMA2023QN10)+3 种基金Sichuan Science and Technology Program(No.2025YFNH0006)Water Conservancy Science and Technology Project of Jiangsu Province(No.2025017)the funding of Fengyun Application Pioneering Project(FY-APP)(No.FY4(02P)-2024014)the Bohai Rim Regional Meteorological Science and Technology Collaborative Innovation Fund project(QYXM202409).
摘要Accurate tropical cyclone track forecasting is of crucial importance for effective disaster risk management in coastal regions.These storms are recognized as one of nature's most hazardous weather phenomena.However,traditional typhoon track prediction methods face certain limitations in handling complex meteorological data and multi-dimensional features.To improve prediction accuracy,this paper proposes an improved Wide&Deep framework.This framework utilizes a Stacked Two-layer Long Short-Term Memory(S2-LSTM)encoder in the Wide branch to model the sequential features of typhoon tracks,and incorporates a Multi-ConvGRU in the Deep branch to handle three-dimensional meteorological data.Following a dynamic/static feature decomposition,the S2-LSTM encoder processes a subset of dynamic features,effec-tively integrating typhoon position,wind speed,and rate-of-change information from multiple time steps to better capture the temporal evolution patterns of typhoon movement.Furthermore,a Coordinate Attention(CA)module is introduced,which captures positional dependencies along the vertical and horizontal dimensions within the feature maps through a factorized average pooling operation.This enhances the model's ability in identifying key areas within atmospheric fields,thus ensuring improved spatial precision in typhoon track forecasting.The model's efficacy was assessed with the 2020-2024 typhoon track dataset published by the China Meteorological Administration(CMA)and the ERA5 reanalysis product maintained by the European Centre for Medium-Range Weather Forecasts(ECMWF).The findings indicate how the two introduced enhancements to the model lead to higher precision for deep learning-based forecasts to a certain extent.
摘要In complex network analysis,node ranking is vital for propagation prediction,structural optimization,and intervention strategy design,yet existing methods often fail to effectively integrate community information in dynamic settings.To address this,this paper proposes a node ranking method that combines graph attention mechanisms with contrastive learning.Community detection is employed to extract node-level community features,and a joint embedding module is designed to fuse global and local structures,thereby incorporating community information into node representations.Based on this,a multi-layer graph attention network adaptively learns node and neighborhood features,while contrastive learning mitigates interference from dynamic evolution and strengthens the model's ability to capture multi-scale structural differences.Experiments on multiple dynamic network datasets show that the proposed method significantly outperforms existing approaches in ranking accuracy,particularly in networks with higher average degrees and clearer community structures.These results validate the effectiveness of the method in enhancing feature representation and modeling multi-scale dynamic node influence.
基金funded by Project of Sichuan Provincial Department of Science and Technology under 2025JDKP0150the Fundamental Research Funds for the Central Universities under 25CAFUC03093.
摘要Single Image Super-Resolution(SISR)seeks to reconstruct high-resolution(HR)images from lowresolution(LR)inputs,thereby enhancing visual fidelity and the perception of fine details.While Transformer-based models—such as SwinIR,Restormer,and HAT—have recently achieved impressive results in super-resolution tasks by capturing global contextual information,these methods often suffer from substantial computational and memory overhead,which limits their deployment on resource-constrained edge devices.To address these challenges,we propose a novel lightweight super-resolution network,termed Binary Attention-Guided Information Distillation(BAID),which integrates frequency-aware modeling with a binary attention mechanism to significantly reduce computational complexity and parameter count whilemaintaining strong reconstruction performance.The network combines a high–low frequency decoupling strategy with a local–global attention sharing mechanism,enabling efficient compression of redundant computations through binary attention guidance.At the core of the architecture lies the Attention-Guided Distillation Block(AGDB),which retains the strengths of the information distillation framework while introducing a sparse binary attention module to enhance both inference efficiency and feature representation.Extensive×4 superresolution experiments on four standard benchmarks—Set5,Set14,BSD100,and Urban100—demonstrate that BAID achieves Peak Signal-to-Noise Ratio(PSNR)values of 32.13,28.51,27.47,and 26.15,respectively,with only 1.22 million parameters and 26.1 G Floating-Point Operations(FLOPs),outperforming other state-of-the-art lightweight methods such as Information Multi-Distillation Network(IMDN)and Residual Feature Distillation Network(RFDN).These results highlight the proposed model’s ability to deliver high-quality image reconstruction while offering strong deployment efficiency,making it well-suited for image restoration tasks in resource-limited environments.
基金supported by the National Natural Science Foundation of China[Grant No.42574033,Grant No.42425401]the Funds for Creative Research Groups of Hubei Province[Grant No.2025AFA022].
摘要Soil Moisture(SM)monitoring using Global Navigation Satellite System-Reflectometry(GNSS-R)has often relied on observations from a single source,thereby resulting in underutilizing abundant reflected signal resources.Moreover,aggregating multi-source observations without considering their heterogeneous characteristics can lead to suboptimal retrieval performance.To address these limitations,this study proposes a dual-branch attention-fusion Transformer model for global SM retrieval by integrating GNSS-R observations from the complementary Tianmu-1 and Fengyun-3 missions.The proposed model learns mission-specific feature representations and adaptively fuses them through attention-based fusion mechanism,thereby enabling effective exploitation of cross-mission comple mentary information.The integrated Tianmu-1+Fengyun-3 Level-1 dataset provides an average monthly temporal coverage of 79.7%globally.Using Soil Moisture Active Passive(SMAP)SM products as the reference,the proposed approach achieves correlation coefficient of 0.88 and root mean square error(RMSE)of 0.053 m3/m3,outperforming the conventional feature-concatenation and feature-merged baselines.Independent validation against measure ments from International Soil Moisture Network further confirms reliable performance,yielding an average correlation coefficient of 0.67 and unbiased RMSE of 0.041 m3/m3.In addition,Extended Triple Collocation(ETC)analysis dem onstrates satisfactory retrieval accuracy,with average ETC-derived correlation coefficient of 0.75 and random error standard deviation of 0.030 m3/m3.Overall,the results of this study demonstrate the effectiveness of the proposed attention-guided multi-mission SM retrieval framework and highlight its potential for enhancing spatiotemporal con tinuity of GNSS-R-based hydrological monitoring.
基金supported by the National Natural Science Foundation of China[NSFC,Grant Nos.U22A20597,42507217]the"Unveiling and Commanding"Project of Science and Technology Program of Tibet[Grant No.XZ202303ZY0006G]the"Key Research and Development Program"Project of Science and Technology Program of Tibet[Grant Nos.XZ202501ZY0104,XZ202501ZY0132]。
摘要Landslides are one of the most significant types of geological disasters worldwide.However,current landslide disaster recognition models generally face issues such as low training efficiency,reliance on large amounts of samples,and vague feature extraction.To address these problems,this paper proposes an enhanced intelligent recognition model based on an improved residual network.Taking remote sensing images from landslide-prone areas in Bijie City,Guizhou Province,China as the research subject,we implemented data augmentation techniques to expand the datasets,subsequently partitioning it into training and validation subsets at a73:27 ratio.During model training,a transfer learning strategy was employed to improve training efficiency through the utilization of ImageNet pre-trained weights.The Res Net50 network architecture was enhanced through the integration of channel attention and spatial attention mechanisms,enabling more effective extraction of critical landslide features.Comparative analysis indicates that after introducing the attention mechanisms,the enhanced model achieved an increase of 1.49% in accuracy,0.45% in precision,1.52% in F1 score,and 0.0297 in Kappa coefficient on the validation set.Notably,recall improved by 2.59%,indicating that the improved model has enhanced landslide disaster recognition capability and overall performance.This study successfully coupled the transfer learning strategy with a dual-attention mechanism into the ResNet50 architecture,allowing the rapid construction of an efficient recognition model under limited sample conditions,significantly improving the comprehensive performance and generalisation ability of the landslide recognition model.
基金the National Natural Science Foundation of China(No.62271466)the Beijing Natural Science Foundation(No.4202025)+2 种基金the Beijing VanJee Technology Co.,Ltd.-Beijing Municipal Science and Technology Project(No.Z201100003920003)the Tianjin IoT Technology Enterprise Key Laboratory Research Project(No.VTJ-OT20230209-2)the Guizhou Provincial Sci-Tech Project(No.zk[2022]-012)。
摘要Intelligent transportation and autonomous driving systems have made urgent demands on the techniques with high performance on object detection in traffic scenes.This paper proposes an improved object detection model YOLO-VSF over the YOLOv4 model,which is a representative work with excellent performance among YOLO series of object detection models.The main improvement measures include:The backbone feature extraction network CSPDarknet53 of YOLOv4 is replaced with VGG16 to improve the feature extraction capability;SENet attention mechanism is incorporated to improve the salient and correlation feature representation capability;Focal Loss is integrated into the loss function to overcome the sample imbalance problem.In addition,the detection performance of small targets is improved by increasing the resolution of input images.Experimental results show that on the VanJee traffic image dataset provided by Beijing VanJee Technology Co.,Ltd.,the proposed YOLO-VSF model achieves an average mean accuracy(mAP)of 92.21 percentage points,which improves the mAP by 3.04 percentage points compared with the YOLOv4 model while maintaining the detection speed of the original model.On the UA-DETRAC dataset,the average accuracy of YOLO-VSF is close to that of the latest YOLOv7 model with the number of parameters reduced by 1.329×107.The proposed method can provide a support for object detection in traffic scenes.
基金National Natural Science Foundation of China(12005108)。
摘要In massive multiple-input multiple-output(MIMO)systems utilizing frequency division duplexing,optimizing system performance requires user equipment(UE)to compress downlink channel state information(CSI)and transmit it to the base station(BS).As the number of antennas increases,there is a significant rise in the overhead related to CSI feedback,posing considerable challenges to the precise acquisition of CSI by the BS.Existing approaches to CSI feedback utilizing deep learning techniques face challenges such as significant feedback overhead and limited precision in the reconstruction process.This study presents a novel lightweight CSI feedback framework known as the dual attention neural network(DANet).Within the DANet architecture,a dual attention module(DAM)is designed to enhance the network's performance.This DAM includes both channel attention blocks and spatial attention blocks.The channel attention blocks direct the model's focus toward channel features rich in information content while simultaneously suppressing less significant features.This approach enables the extraction of temporal correlations within the CSI matrix.The spatial attention block aids in extracting the correlation between the delay domain and the angle domain in the CSI matrix.By enhancing neural network performance,the DAM reduces information dispersion while enhancing the representation of global interactions.Simulation results demonstrate that DANet exhibits superior normalized mean square error and cosine similarity with comparable complexity compared to existing advanced CSI feedback methods.
基金supported by 111 Center(No.D23006)the National Natural Science Foundation of China(Nos.62572088,62272079,62502063)+9 种基金the National Foreign Expert Project of China(No.D20240244)Natural Science Foundation of Liaoning Province(Nos.2024-MS-212,2024-BS-267)Scientific Research Project of Liaoning Provincial Department of Education(No.LJ222411258005)LiaoNing Revitalization Talent Program(No.XLYC2403039)the Artificial Intelligence Innovation Development Plan Project of Liaoning Province(No.2023JH26/10300025)Joint Plan of Liaoning Province Science and Technology Plan(Nos.2024JH2/102600064,2024-MSLH-009)the Dalian Outstanding Young Science and Technology Talent Support Program(No.2022RJ08)Dalian Major Projects of Basic Research(No.2023JJ11CG002)the Dalian Young Science and Technology Star Program(No.2023RQ056)the Interdisciplinary Project of Dalian University(Nos.DLUXK-2024-YB-001,DLUXK-2025-FX-003,DLUXK-2025-QNLG-003,DLUXK-2024-QN-002).
摘要Base substitution,insertion,and deletion errors due to inherent technical constraints inducing unavoidable sequencing inaccuracies,limiting access to high-quality raw data and biological knowledge.To address this,we propose a deep sequence reconstruction model based on the multi-scale attention mechanism and contrastive learning(MACL),designed to enhance DNA sequence reconstruction under highly error rate conditions.The multi-scale attention mechanism includes base scale,inter-sequence and intra-sequence scale.First,the MSA Transformer fully extracts both global and local features of the base scale from the dimensions of the rows and columns.Furthermore,for the errors between sequences and the substitution errors within sequences,MACL proposes Inter-Sequence and Intra-Sequence Multi-Head Attention Mechanisms,respectively,and handles the insertion and deletion errors through the convolution module.In order to maximize the consistency of positive sample pairs in the representation space,we introduce contrastive learning and design a negative sample construction method and data augmentation that are more suitable for substitution errors in sequencing channels.Experiments on real-world DNA storage and viral genome datasets demonstrate that MACL significantly outperforms existing methods in reconstructing the DNA sequence.In particular,when combined with RS codes,MACL can losslessly reconstruct medical images in highly biased sequence(base error rate=5%)in DNA storage.In summary,the MACL introduces a novel approach to DNA sequence reconstruction in highly error rate conditions,laying a solid foundation for practical applications in DNA storage and genomics research.
基金supported by the Key Research and Development Plan of Shaanxi Province(Grant No.2022JBGS3-08)the Fundamental Research Funds for the Central Universities,CHD(Grant No.300102404102).
摘要Existing asphalt pavement rutting prediction models suffer from large long-term prediction errors due to their reliance on laboratory parameters and simplified assumptions.To address this issue,a dual-branch spatio-temporal attention network model(DSAN)is proposed.The model is constructed by fusing temporal convolutional networks(TCN),long short-term memory networks(LSTM),and multi-head attention mechanisms to form parallel feature extraction branches for hierarchical spatio-temporal modeling.Validation is conducted based on full-scale pavement loop test results of eight typical asphalt pavement structures(AC layer thickness:12–52 cm)under 80 million equivalent standard axle loads(ESALs)accumulated during 2017–2023.Results show that the DSAN model significantly outperforms comparative models in prediction accuracy,breaking through the generalization bottleneck of traditional models for different layer thickness structures.This study provides an efficient solution for long-term performance prediction of asphalt pavements.
摘要Modern business information systems face significant challenges in managing heterogeneous data sources,integrating disparate systems,and providing real-time decision support in complex enterprise environments.Contemporary enterprises typically operate 200+interconnected systems,with research indicating that 52% of organizations manage three or more enterprise content management systems,creating information silos that reduce operational efficiency by up to 35%.While attention mechanisms have demonstrated remarkable success in natural language processing and computer vision,their systematic application to business information systems remains largely unexplored.This paper presents the theoretical foundation for a Hierarchical Attention-Based Business Information System(HABIS)framework that applies multi-level attention mechanisms to enterprise environments.We provide a comprehensive mathematical formulation of the framework,analyze its computational complexity,and present a proof-of-concept implementation with simulation-based validation that demonstrates a 42% reduction in crosssystem query latency compared to legacy ERP modules and 70% improvement in prediction accuracy over baseline methods.The theoretical framework introduces four hierarchical attention levels:system-level attention for dynamic weighting of business systems,process-level attention for business process prioritization,data-level attention for critical information selection,and temporal attention for time-sensitive pattern recognition.Our complexity analysis demonstrates that the framework achieves O(n log n)computational complexity for attention computation,making it scalable to large enterprise environments including retail supply chains with 200+system-scale deployments.The proof-of-concept implementation validates the theoretical framework’s feasibility withMSE loss of 0.439 and response times of 0.000120 s per query,demonstrating its potential for addressing key challenges in business information systems.This work establishes a foundation for future empirical research and practical implementation of attention-driven enterprise systems.
基金supported by the Knowledge Innovation Program of Wuhan-Shuguang Project(Grant No.2023010201020443)the School-Level Scientific Research Project Funding Program of Jianghan University(Grant No.2022XKZX33)the Natural Science Foundation of Hubei Province(Grant No.2024AFB466).
摘要The 6D pose estimation of objects is of great significance for the intelligent assembly and sorting of industrial parts.In the industrial robot production scenarios,the 6D pose estimation of industrial parts mainly faces two challenges:one is the loss of information and interference caused by occlusion and stacking in the sorting scenario,the other is the difficulty of feature extraction due to the weak texture of industrial parts.To address the above problems,this paper proposes an attention-based pixel-level voting network for 6D pose estimation of weakly textured industrial parts,namely CB-PVNet.On the one hand,the voting scheme can predict the keypoints of affected pixels,which improves the accuracy of keypoint localization even in scenarios such as weak texture and partial occlusion.On the other hand,the attention mechanism can extract interesting features of the object while suppressing useless features of surroundings.Extensive comparative experiments were conducted on both public datasets(including LINEMOD,Occlusion LINEMOD and T-LESS datasets)and self-made datasets.The experimental results indicate that the proposed network CB-PVNet can achieve accuracy of ADD(-s)comparable to state-of-the-art using only RGB images while ensuring real-time performance.Additionally,we also conducted robot grasping experiments in the real world.The balance between accuracy and computational efficiency makes the method well-suited for applications in industrial automation.
基金the financial support provided by the Special Foundation for State Major Basic Research Program of China(2021YFD2101005)National Natural Science Foundation of China(22478057,22178045).
摘要Data-driven deep learning modeling has been increasingly applied to quality prediction in complex chemical processes.However,the data show complex temporal features due to different residence times and strong coupling relationships among chemical entities.This study proposes a multi-scale temporal feature extraction module to extract local dynamic temporal features across different time scales and combines it with long short-term memory(LSTM)networks to capture global temporal patterns,thereby taking full advantage of available data.In addition,variable-wise channel attention is integrated into the model to enhance attention on the essential parts of the feature maps and improve predictive performance.Furthermore,by analyzing the attention weights,the model quickly identifies the key variables that significantly affect the predictions.Finally,the model is applied to a real corn starch liquefaction process and achieves an accurate product quality prediction with an R2 value of 0.9392,which represents a 4%to 9%improvement over traditional models and demonstrates the superiority of the proposed approach.
基金funded by Science and Technology Research and Development Program Project of China Railway Group Limited(No.2023-Major-02)National Natural Science Foundation of China(Grant No.52378200)Sichuan Science and Technology Program(Grant No.2024NSFSC0017).
摘要Accurate wind speed prediction is crucial for stabilizing power grids with high wind energy penetration.This study presents a novel machine learning model that integrates clustering,deep learning,and transfer learning to mitigate accuracy degradation in 24-h forecasting.Initially,an optimized DB-SCAN(Density-Based Spatial Clustering of Applications with Noise)algorithm clusters wind fields based on wind direction,probability density,and spectral features,enhancing physical interpretability and reducing training complexity.Subsequently,a ResNet(Residual Network)extracts multi-scale patterns from decomposed wind signals,while transfer learning adapts the backbone network across clusters,cutting training time by over 90%.Finally,a CBAM(Convolutional Block Attention Module)attention mechanism is employed to prioritize features for LSTM-based prediction.Tested on the 2015 Jena wind speed dataset,the model demonstrates superior accuracy and robustness compared to state-of-the-art baselines.Key innovations include:(a)Physics-informed clustering for interpretable wind regime classification;(b)Transfer learning with deep feature extraction,preserving accuracy while minimizing training time;and(c)On the 2016 Jena wind speed dataset,the model achieves MAPE(Mean Absolute Percentage Error)values of 16.82%and 18.02%for the Weibull-shaped and Gaussian-shaped wind speed clusters,respectively,demonstrating the model’s robust generalization capacity.This framework offers an efficient and effective solution for long-term wind forecasting.