Urban drainage pipe system is an important part of city management.Automated detection of the status of storm drain in street-level images through current technologies in computer vision and AI is an important aspect ...Urban drainage pipe system is an important part of city management.Automated detection of the status of storm drain in street-level images through current technologies in computer vision and AI is an important aspect of smart city construction.In this paper,a framework based on YOLOv5s for storm drain detection(YOLOSDD)in street view is proposed.By analyzing the characteristics of small-scale targets,YOLO-SDD focuses on optimizing the Backbone network and its loss function.Series of experiments demonstrated that in the task of detecting different states of storm drain under various environmental conditions,the mean average precision(mAP@.5)of the YOLO-SDD can reach 89.6%,increasing by 2%compared with the baseline model YOLOv5s.In the presence and absence of occlusion,the average precision of storm drain detection increased by 0.9%and 3.1%,respectively.In addition,the effectiveness and generalization ability of YOLO-SDD were further validated using the storm drain dataset of Urbana-Champaign(SDUC)from Illinois,USA,and the dataset for object detection in aerial images(DOTA).Finally,this work has deployed the YOLO-SDD on the Android system,which verifies its ability of real-time detecting storm drain in different states in street scenes.展开更多
This paper suggests an improved you only look once version 8n(YOLOv8n)algorithm for apple leaf disease detection,abbreviated as ALWB-YOLOv8n.The model is comprised of four essential components.Initially,arbitrary kern...This paper suggests an improved you only look once version 8n(YOLOv8n)algorithm for apple leaf disease detection,abbreviated as ALWB-YOLOv8n.The model is comprised of four essential components.Initially,arbitrary kernel convolution(AKConv)replaces the convolution module,which significantly decreases both the model’s parameter count and its overall size.Secondly,the large selective kernel network(LSKNet)attention mechanism is added in the Backbone,which can dynamically adjust the spatial sensory domain,and experiments have proved that this method is extremely advantageous for small target detection.Third,a weighted bi-directional feature pyramid network is introduced,which enables the model to achieve multi-scale feature fusion and is more concise and faster.Finally,wise intersection over union(WIoU)is used to replace complete intersection over union(CIoU)in YOLOv8,and the idea of focal loss is introduced,which effectively solves the detection problems in cases such as apple leaves occluding each other and blurred boundaries of diseased leaves.The improved algorithm exhibits superior performance compared to other common object detection algorithms.Compared with YOLOv8n,the improved algorithm achieves 2.3%improvement in precision,3.8%improvement in recall,and 2.5%and 2.7%improvement in mAP0.5 and mAP0.5:0.95,respectively.Compared with YOLOv8n,the improved model reduces the number of parameters and size of the model and realizes real-time monitoring with a frames per second(FPS)of 50.5.展开更多
Strong mechanical vibration and acoustical signals of grinding process contain useful information related to load parameters in ball mills. It is a challenge to extract latent features and construct soft sensor model ...Strong mechanical vibration and acoustical signals of grinding process contain useful information related to load parameters in ball mills. It is a challenge to extract latent features and construct soft sensor model with high dimensional frequency spectra of these signals. This paper aims to develop a selective ensemble modeling approach based on nonlinear latent frequency spectral feature extraction for accurate measurement of material to ball volume ratio. Latent features are first extracted from different vibrations and acoustic spectral segments by kernel partial least squares. Algorithms of bootstrap and least squares support vector machines are employed to produce candidate sub-models using these latent features as inputs. Ensemble sub-models are selected based on genetic algorithm optimization toolbox. Partial least squares regression is used to combine these sub-models to eliminate collinearity among their prediction outputs. Results indicate that the proposed modeling approach has better prediction performance than previous ones.展开更多
Structured illumination microscopy(SIM)is a popular and powerful super-resolution(SR)technique in biomedical research.However,the conventional reconstruction algorithm for SIM heavily relies on the accurate prior know...Structured illumination microscopy(SIM)is a popular and powerful super-resolution(SR)technique in biomedical research.However,the conventional reconstruction algorithm for SIM heavily relies on the accurate prior knowledge of illumination patterns and signal-to-noise ratio(SNR)of raw images.To obtain high-quality SR images,several raw images need to be captured under high fluorescence level,which further restricts SIM’s temporal resolution and its applications.Deep learning(DL)is a data-driven technology that has been used to expand the limits of optical microscopy.In this study,we propose a deep neural network based on multi-level wavelet and attention mechanism(MWAM)for SIM.Our results show that the MWAM network can extract high-frequency information contained in SIM raw images and accurately integrate it into the output image,resulting in superior SR images compared to those generated using wide-field images as input data.We also demonstrate that the number of SIM raw images can be reduced to three,with one image in each illumination orientation,to achieve the optimal tradeoff between temporal and spatial resolution.Furthermore,our MWAM network exhibits superior reconstruction ability on low-SNR images compared to conventional SIM algorithms.We have also analyzed the adaptability of this network on other biological samples and successfully applied the pretrained model to other SIM systems.展开更多
In the realm of low-level vision tasks,such as image deraining and dehazing,restoring images distorted by adverse weather conditions remains a significant challenge.The emergence of abundant computational resources ha...In the realm of low-level vision tasks,such as image deraining and dehazing,restoring images distorted by adverse weather conditions remains a significant challenge.The emergence of abundant computational resources has driven the dominance of deep Convolutional Neural Networks(CNNs),supplanting traditional methods reliant on prior knowledge.However,the evolution of CNN architectures has tended towards increasing complexity,utilizing intricate structures to enhance performance,often at the expense of computational efficiency.In response,we propose the Selective Kernel Dense Residual M-shaped Network(SKDRMNet),a flexible solution adept at balancing computational efficiency with network accuracy.A key innovation is the incorporation of an M-shaped hierarchical structure,derived from the U-Net framework as M-Network(M-Net),within which the Selective Kernel Dense Residual Module(SDRM)is introduced to reinforce multi-scale semantic feature maps.Our methodology employs two sampling techniques-bilinear and pixel unshuffled and utilizes a multi-scale feature fusion approach to distil more robust spatial feature map information.During the reconstruction phase,feature maps of varying resolutions are seamlessly integrated,and the extracted features are effectively merged using the Selective Kernel Fusion Module(SKFM).Empirical results demonstrate the comprehensive superiority of SKDRMNet across both synthetic and real rain and haze datasets.展开更多
Low-dose computed tomography(LDCT)denoising is an indispensable procedure in the medical imaging field,which not only improves image quality,but can mitigate the potential hazard to patients caused by routine doses.De...Low-dose computed tomography(LDCT)denoising is an indispensable procedure in the medical imaging field,which not only improves image quality,but can mitigate the potential hazard to patients caused by routine doses.Despite the improvement in performance of the cycle-consistent generative adversarial network(CycleGAN)due to the well-paired CT images shortage,there is still a need to further reduce image noise while retaining detailed features.Inspired by the residual encoder–decoder convolutional neural network(RED-CNN)and U-Net,we propose a novel unsupervised model using CycleGAN for LDCT imaging,which injects a two-sided network into selective kernel networks(SK-NET)to adaptively select features,and uses the patchGAN discriminator to generate CT images with more detail maintenance,aided by added perceptual loss.Based on patch-based training,the experimental results demonstrated that the proposed SKFCycleGAN outperforms competing methods in both a clinical dataset and the Mayo dataset.The main advantages of our method lie in noise suppression and edge preservation.展开更多
基金the National Natural Science Foundation of China(No.41871325)Shanghai Ocean University College Student Innovation and Entrepreneur ship Training Program Project(No.A1-2005-00-300827)。
摘要Urban drainage pipe system is an important part of city management.Automated detection of the status of storm drain in street-level images through current technologies in computer vision and AI is an important aspect of smart city construction.In this paper,a framework based on YOLOv5s for storm drain detection(YOLOSDD)in street view is proposed.By analyzing the characteristics of small-scale targets,YOLO-SDD focuses on optimizing the Backbone network and its loss function.Series of experiments demonstrated that in the task of detecting different states of storm drain under various environmental conditions,the mean average precision(mAP@.5)of the YOLO-SDD can reach 89.6%,increasing by 2%compared with the baseline model YOLOv5s.In the presence and absence of occlusion,the average precision of storm drain detection increased by 0.9%and 3.1%,respectively.In addition,the effectiveness and generalization ability of YOLO-SDD were further validated using the storm drain dataset of Urbana-Champaign(SDUC)from Illinois,USA,and the dataset for object detection in aerial images(DOTA).Finally,this work has deployed the YOLO-SDD on the Android system,which verifies its ability of real-time detecting storm drain in different states in street scenes.
基金supported by the Intelligent Identification and Early Warning System for Pests and Diseases in Small-seeded Rapeseed(No.24ZYCGSN01360)the Intelligent Management Platform for Vegetable Greenhouses Project(No.YH003001)+1 种基金the Intelligent Agricultural Breeding System Project(No.YH003002)the Research and Application of AIoT Based Big Data System for Apple Tree Pest and Disease Detection(No.2024WA013)。
摘要This paper suggests an improved you only look once version 8n(YOLOv8n)algorithm for apple leaf disease detection,abbreviated as ALWB-YOLOv8n.The model is comprised of four essential components.Initially,arbitrary kernel convolution(AKConv)replaces the convolution module,which significantly decreases both the model’s parameter count and its overall size.Secondly,the large selective kernel network(LSKNet)attention mechanism is added in the Backbone,which can dynamically adjust the spatial sensory domain,and experiments have proved that this method is extremely advantageous for small target detection.Third,a weighted bi-directional feature pyramid network is introduced,which enables the model to achieve multi-scale feature fusion and is more concise and faster.Finally,wise intersection over union(WIoU)is used to replace complete intersection over union(CIoU)in YOLOv8,and the idea of focal loss is introduced,which effectively solves the detection problems in cases such as apple leaves occluding each other and blurred boundaries of diseased leaves.The improved algorithm exhibits superior performance compared to other common object detection algorithms.Compared with YOLOv8n,the improved algorithm achieves 2.3%improvement in precision,3.8%improvement in recall,and 2.5%and 2.7%improvement in mAP0.5 and mAP0.5:0.95,respectively.Compared with YOLOv8n,the improved model reduces the number of parameters and size of the model and realizes real-time monitoring with a frames per second(FPS)of 50.5.
基金Supported partially by the Post Doctoral Natural Science Foundation of China(2013M532118,2015T81082)the National Natural Science Foundation of China(61573364,61273177,61503066)+2 种基金the State Key Laboratory of Synthetical Automation for Process Industriesthe National High Technology Research and Development Program of China(2015AA043802)the Scientific Research Fund of Liaoning Provincial Education Department(L2013272)
摘要Strong mechanical vibration and acoustical signals of grinding process contain useful information related to load parameters in ball mills. It is a challenge to extract latent features and construct soft sensor model with high dimensional frequency spectra of these signals. This paper aims to develop a selective ensemble modeling approach based on nonlinear latent frequency spectral feature extraction for accurate measurement of material to ball volume ratio. Latent features are first extracted from different vibrations and acoustic spectral segments by kernel partial least squares. Algorithms of bootstrap and least squares support vector machines are employed to produce candidate sub-models using these latent features as inputs. Ensemble sub-models are selected based on genetic algorithm optimization toolbox. Partial least squares regression is used to combine these sub-models to eliminate collinearity among their prediction outputs. Results indicate that the proposed modeling approach has better prediction performance than previous ones.
基金supported by the National Natural Science Foundation of China(Grant Nos.62005307 and 61975228).
摘要Structured illumination microscopy(SIM)is a popular and powerful super-resolution(SR)technique in biomedical research.However,the conventional reconstruction algorithm for SIM heavily relies on the accurate prior knowledge of illumination patterns and signal-to-noise ratio(SNR)of raw images.To obtain high-quality SR images,several raw images need to be captured under high fluorescence level,which further restricts SIM’s temporal resolution and its applications.Deep learning(DL)is a data-driven technology that has been used to expand the limits of optical microscopy.In this study,we propose a deep neural network based on multi-level wavelet and attention mechanism(MWAM)for SIM.Our results show that the MWAM network can extract high-frequency information contained in SIM raw images and accurately integrate it into the output image,resulting in superior SR images compared to those generated using wide-field images as input data.We also demonstrate that the number of SIM raw images can be reduced to three,with one image in each illumination orientation,to achieve the optimal tradeoff between temporal and spatial resolution.Furthermore,our MWAM network exhibits superior reconstruction ability on low-SNR images compared to conventional SIM algorithms.We have also analyzed the adaptability of this network on other biological samples and successfully applied the pretrained model to other SIM systems.
摘要In the realm of low-level vision tasks,such as image deraining and dehazing,restoring images distorted by adverse weather conditions remains a significant challenge.The emergence of abundant computational resources has driven the dominance of deep Convolutional Neural Networks(CNNs),supplanting traditional methods reliant on prior knowledge.However,the evolution of CNN architectures has tended towards increasing complexity,utilizing intricate structures to enhance performance,often at the expense of computational efficiency.In response,we propose the Selective Kernel Dense Residual M-shaped Network(SKDRMNet),a flexible solution adept at balancing computational efficiency with network accuracy.A key innovation is the incorporation of an M-shaped hierarchical structure,derived from the U-Net framework as M-Network(M-Net),within which the Selective Kernel Dense Residual Module(SDRM)is introduced to reinforce multi-scale semantic feature maps.Our methodology employs two sampling techniques-bilinear and pixel unshuffled and utilizes a multi-scale feature fusion approach to distil more robust spatial feature map information.During the reconstruction phase,feature maps of varying resolutions are seamlessly integrated,and the extracted features are effectively merged using the Selective Kernel Fusion Module(SKFM).Empirical results demonstrate the comprehensive superiority of SKDRMNet across both synthetic and real rain and haze datasets.
基金funded by the National Natural Science Foundation of China(Grants No.61871277 and 61671312)in part by the Project of State Administration of Traditional Chinese Medicine of Sichuan(Grant No.2021MS012).
摘要Low-dose computed tomography(LDCT)denoising is an indispensable procedure in the medical imaging field,which not only improves image quality,but can mitigate the potential hazard to patients caused by routine doses.Despite the improvement in performance of the cycle-consistent generative adversarial network(CycleGAN)due to the well-paired CT images shortage,there is still a need to further reduce image noise while retaining detailed features.Inspired by the residual encoder–decoder convolutional neural network(RED-CNN)and U-Net,we propose a novel unsupervised model using CycleGAN for LDCT imaging,which injects a two-sided network into selective kernel networks(SK-NET)to adaptively select features,and uses the patchGAN discriminator to generate CT images with more detail maintenance,aided by added perceptual loss.Based on patch-based training,the experimental results demonstrated that the proposed SKFCycleGAN outperforms competing methods in both a clinical dataset and the Mayo dataset.The main advantages of our method lie in noise suppression and edge preservation.