The explosive proliferation of Large Language Models(LLMs)imposes significant energy and operational burdens on Geographically Distributed Data Centers(GDDCs),thereby demanding an efficient mechanism for LLMs task sch...The explosive proliferation of Large Language Models(LLMs)imposes significant energy and operational burdens on Geographically Distributed Data Centers(GDDCs),thereby demanding an efficient mechanism for LLMs task scheduling.While prior geo-distributed scheduling methods reduce cost and carbon emissions by exploiting regional heterogeneity,they largely overlook model and data reuse opportunities and the uncertainty of LLM execution times.In this paper,we introduce GCOS,to the best of our knowledge,the first green scheduling framework that incorporates a dual-cache system for both data and models,while jointly optimizing task assignment and cache migration.We firstly propose a dual-cache mechanism that decouples model and data caching to enable fine-grained reuse and minimize redundant transmissions.Subsequently,we propose the Multi-Agent Cache-aware Cooperative Scheduling(MACCS)algorithm,which leverages reinforcement learning to optimize task placement with a focus on minimizing both carbon emissions and cost.Additionally,we design a lightweight execution time predictor,DiPTree,to address the high variability in task execution times.Extensive experiments on real-world datasets demonstrate that GCOS reduces overall cost by up to 92.6%and carbon emissions by 90.3%,significantly outperforming existing baselines.展开更多
As artificial Intelligence(AI)continues to expand exponentially,particularly with the emergence of generative pre-trained transformers(GPT)based on a transformer’s architecture,which has revolutionized data processin...As artificial Intelligence(AI)continues to expand exponentially,particularly with the emergence of generative pre-trained transformers(GPT)based on a transformer’s architecture,which has revolutionized data processing and enabled significant improvements in various applications.This document seeks to investigate the security vulnerabilities detection in the source code using a range of large language models(LLM).Our primary objective is to evaluate the effectiveness of Static Application Security Testing(SAST)by applying various techniques such as prompt persona,structure outputs and zero-shot.To the selection of the LLMs(CodeLlama 7B,DeepSeek coder 7B,Gemini 1.5 Flash,Gemini 2.0 Flash,Mistral 7b Instruct,Phi 38b Mini 128K instruct,Qwen 2.5 coder,StartCoder 27B)with comparison and combination with Find Security Bugs.The evaluation method will involve using a selected dataset containing vulnerabilities,and the results to provide insights for different scenarios according to the software criticality(Business critical,non-critical,minimum effort,best effort)In detail,the main objectives of this study are to investigate if large language models outperform or exceed the capabilities of traditional static analysis tools,if the combining LLMs with Static Application Security Testing(SAST)tools lead to an improvement and the possibility that local machine learning models on a normal computer produce reliable results.Summarizing the most important conclusions of the research,it can be said that while it is true that the results have improved depending on the size of the LLM for business-critical software,the best results have been obtained by SAST analysis.This differs in“NonCritical,”“Best Effort,”and“Minimum Effort”scenarios,where the combination of LLM(Gemini)+SAST has obtained better results.展开更多
Conversational recommender systems(CRSs)focus on refining preferences and providing personalized recommendations through natural language interactions and dialogue history.Large language models(LLMs)have shown outstan...Conversational recommender systems(CRSs)focus on refining preferences and providing personalized recommendations through natural language interactions and dialogue history.Large language models(LLMs)have shown outstanding performance across various domains,thereby prompting researchers to investigate their applicability in recommendation systems.However,due to the lack of task-specific knowledge and an inefficient feature extraction process,LLMs still have suboptimal performance in recommendation tasks.Therefore,external knowledge sources,such as knowledge graphs(KGs)and knowledge bases(KBs),are often introduced to address the issue of data sparsity.Compared to KGs,KBs possess higher retrieval efficiency,making them more suitable for scenarios where LLMs serve as recommenders.To this end,we introduce a novel framework integrating LLMs with KBs for enhanced retrieval generation,namely LLMKB.LLMKB initially leverages structured knowledge to create mapping dictionaries,extracting entity-relation information from heterogeneous knowledge to construct KBs.Then,LLMKB achieves the embedding calibration between user information representations and documents in KBs through retrieval model fine-tuning.Finally,LLMKB employs retrievalaugmented generation to produce recommendations based on fused text inputs,followed by post-processing.Experiment results on two public CRS datasets demonstrate the effectiveness of our framework.Our code is publicly available at the link:http://gffzze280b34df20547e2sk0npuwb0kbbk6qnc.ffgz.tsg.suse.edu.cn/LLMKB-6FD0.展开更多
Magnesium hydride(MgH2),a promising high-capacity hydrogen storage material,is hindered by slow dehydrogenation kinetics.AIdriven catalyst discovery to address this is often hampered by the laborious extraction of ...Magnesium hydride(MgH2),a promising high-capacity hydrogen storage material,is hindered by slow dehydrogenation kinetics.AIdriven catalyst discovery to address this is often hampered by the laborious extraction of data from unstructured literature.To overcome this,we introduce a transformative“LLM to Agent”framework that synergistically integrates Large Language Models(LLMs)for automated data curation with Machine Learning(ML)for predictive design.We automatically constructed a comprehensive database of 809 MgH2catalysts(6555 data rows)with high fidelity and an~40-fold acceleration over manual methods.The resulting ML models achieved high accuracy(average R2>0.91)in predicting dehydrogenation temperature and activation energy,subsequently guiding a Genetic Algorithm(GA)in an exploratory inverse design that autonomously uncovered key design principles for high-performance catalysts.Encouragingly,a strong alignment was found between these AI-discovered principles and the design strategies of recently reported,state-of-the-art experimental systems,providing substantial evidence for the validity of our approach.The framework culminates in Cat-Advisor,a novel,domain-adapted multi-agent system.Cat-Advisor translates ML predictions and retrieval-augmented knowledge into actionable design guidance,demonstrating capabilities that surpass those of general-purpose LLMs in this specialized domain.This work delivers a practical AI toolkit for accelerated materials discovery and advances the emerging Agent-based paradigm for designing next-generation energy technologies.展开更多
In Future Mobile Internet and convergence application scenarios,existing network attack traffic detection methods are insufficient in characterizing cross-flow correlations and structural dependencies during the attac...In Future Mobile Internet and convergence application scenarios,existing network attack traffic detection methods are insufficient in characterizing cross-flow correlations and structural dependencies during the attack process,and therefore still have limited generalization ability in complex scenarios and unknown attack identification tasks.To address this issue,this paper proposes a cross-flow modeling large language model framework,which extends the traditional detection paradigm based on single-flow features to joint modeling oriented toward cross-flow context and relational structure.Specifically,this paper constructs cross-flow context through flow sorting,grouping,and cross-group sampling,and combines an inter-flow relation matrix with a dual-branch embedding mechanism to achieve structured representation and relation-aware modeling of network traffic;at the model level,by removing the causal mask and introducing a relation-aware bias into bidirectional self-attention,the representation capability of the large language model for complex attack behaviors and potential inter-flow dependencies is enhanced.Experimental results show that the proposed method overall outperforms traditional machine learning and deep learning baseline models,and demonstrates better stability and accuracy in tasks such as fine-grained classification,unknown attack identification,and cross-scenario generalization.Ablation experiments further verify the effectiveness of the proposed cross-flow context construction,dual-branch embedding,and relation-aware LLM adaptation,demonstrating that each component contributes to the overall detection performance and generalization ability.Our work shows that,after targeted structural adaptation,large language models can effectively serve non-text security tasks such as network traffic analysis,thereby supporting AI-driven security modeling for Future Mobile Internet environments.展开更多
The design of steel and alloy materials is of critical importance across a wide range of industrial applications;however,effective intelligent agent-based assistants for this domain remain limited.To address this gap,...The design of steel and alloy materials is of critical importance across a wide range of industrial applications;however,effective intelligent agent-based assistants for this domain remain limited.To address this gap,we introduce STALAgent,a large language model(LLM)-based multi-agent system specifically tailored for intelligent and automated design of steel and alloy materials.STALAgent is centered on an LLM brain with several key agents(e.g.,task assignment,semantic search,inverse design,and heat treatment simulation)that collectively form a closed-loop workflow from user query to material recommendation.This system leverages a CrewAI-based orchestrator to assign tasks and coordinate a suite of specialized agents,including tools for knowledge retrieval using a retrieval augmented generation(RAG),inverse materials design using variational encoder(VAE),and thermodynamic calculations using Pycalphad.Through case studies involving inverse alloy design tasks and knowledge-based steel design queries,we showcase the capacity of the LLM agent to offer effective and dependable guidance for steel and alloy material design.STALAgent is practical and scalable,serving as a supplementary tool for materials researchers and holding promise for extension to other materials science domains requiring scientific discovery and domain knowledge-intensive tasks.展开更多
How can AI assist doctors in generating clinical reports without compromising patient privacy?This question motivates our development of PrivLLM-Guard,a novel framework for differentially private large language models...How can AI assist doctors in generating clinical reports without compromising patient privacy?This question motivates our development of PrivLLM-Guard,a novel framework for differentially private large language models(LLMs)tailored to real-time confidential medical text generation and summarization.While LLMs have shown promise in automating clinical documentation,the sensitivity of healthcare data demands rigorous privacy protections.PrivLLM-Guard addresses this need by combining advanced—differential privacy techniques with adaptive noise calibration,ensuring robust privacy guarantees without sacrificing utility.The framework integrates bidirectional transformer encoders with autoregressive decoders,further enhanced by privacy-aware attention and gradient perturbation mechanisms.Extensive experiments on three large-scale medical datasets demonstrate BLEU-4 scores of 89.7%for generation and ROUGE-L scores of 92.3%for summarization,while maintaining strict privacy budgets.The model processes 512-token sequences in real time with an average latency of 245 ms and memory usage of just 4.2 GB.Compared to state-of-the-art privacy-preserving LLMs,PrivLLM-Guard improves the utility-privacy trade-off by 15.8%and reduces computational overhead by 23.4%.Key contributions include adaptive noise injection,dynamic privacy budgeting,and an integrated privacy auditing module—collectively advancing secure and trustworthy AI deployment in clinical environments.展开更多
Large language models(LLMs)have significantly advanced artificial intelligence(AI)by excelling in tasks such as understanding,generation,and reasoning across multiple modalities.Despite these achievements,LLMs have in...Large language models(LLMs)have significantly advanced artificial intelligence(AI)by excelling in tasks such as understanding,generation,and reasoning across multiple modalities.Despite these achievements,LLMs have inherent limitations including outdated information,hallucinations,inefficiency,lack of interpretability,and challenges in domain-specific accuracy.To address these issues,this survey explores three promising directions in the post-LLM era:knowledge empowerment,model collaboration,and model co-evolution.First,we examine methods of integrating external knowledge into LLMs to enhance factual accuracy,reasoning capabilities,and interpretability,including incorporating knowledge into training objectives,instruction tuning,retrieval-augmented inference,and knowledge prompting.Second,we discuss model collaboration strategies that leverage the complementary strengths of LLMs and smaller models to improve efficiency and domain-specific performance through techniques such as model merging,functional model collaboration,and knowledge injection.Third,we delve into model co-evolution,in which multiple models collaboratively evolve by sharing knowledge,parameters,and learning strategies to adapt to dynamic environments and tasks,thereby enhancing their adaptability and continual learning.We illustrate how the integration of these techniques advances AI capabilities in science,engineering,and society—particularly in hypothesis development,problem formulation,problem-solving,and interpretability across various domains.We conclude by outlining future pathways for further advancement and applications.展开更多
【研究目的】在全球气候变化与人类活动日趋剧烈的背景下,地质灾害愈发呈现出突发、多发、复杂等特征,对现有地质灾害风险防控体系的应对能力提出了新的挑战,亟需探索新时期地质灾害风险管理的智能化路径。【研究方法】本文系统回顾了...【研究目的】在全球气候变化与人类活动日趋剧烈的背景下,地质灾害愈发呈现出突发、多发、复杂等特征,对现有地质灾害风险防控体系的应对能力提出了新的挑战,亟需探索新时期地质灾害风险管理的智能化路径。【研究方法】本文系统回顾了近年来国内外地质灾害风险防控领域的研究进展,聚焦中国传统防控体系在风险识别、评估与管控环节面临的突出瓶颈,探讨了其技术赋能的发展过程。在此基础上,提出引入大语言模型(Large Language Models,LLMs)作为核心支撑的智能化地质灾害风险防控框架。【研究结果】本研究设计了一个基于LLMs的地质灾害风险防控体系,贯穿“智能识别-动态评估-协同管理”的全过程,推动地质灾害风险防控向智慧化、系统化方向转型。【结论】通过大语言模型与地质灾害防控场景的深度融合,有望为实现地质灾害防治现代化提供智能化的系统性解决方案。展开更多
基金supported in part by the 2024 National Society Project for Supporting National Strategies,under the program titled“Key Technology Roadmap for AI-Oriented Computing Power Networks”。
摘要The explosive proliferation of Large Language Models(LLMs)imposes significant energy and operational burdens on Geographically Distributed Data Centers(GDDCs),thereby demanding an efficient mechanism for LLMs task scheduling.While prior geo-distributed scheduling methods reduce cost and carbon emissions by exploiting regional heterogeneity,they largely overlook model and data reuse opportunities and the uncertainty of LLM execution times.In this paper,we introduce GCOS,to the best of our knowledge,the first green scheduling framework that incorporates a dual-cache system for both data and models,while jointly optimizing task assignment and cache migration.We firstly propose a dual-cache mechanism that decouples model and data caching to enable fine-grained reuse and minimize redundant transmissions.Subsequently,we propose the Multi-Agent Cache-aware Cooperative Scheduling(MACCS)algorithm,which leverages reinforcement learning to optimize task placement with a focus on minimizing both carbon emissions and cost.Additionally,we design a lightweight execution time predictor,DiPTree,to address the high variability in task execution times.Extensive experiments on real-world datasets demonstrate that GCOS reduces overall cost by up to 92.6%and carbon emissions by 90.3%,significantly outperforming existing baselines.
摘要As artificial Intelligence(AI)continues to expand exponentially,particularly with the emergence of generative pre-trained transformers(GPT)based on a transformer’s architecture,which has revolutionized data processing and enabled significant improvements in various applications.This document seeks to investigate the security vulnerabilities detection in the source code using a range of large language models(LLM).Our primary objective is to evaluate the effectiveness of Static Application Security Testing(SAST)by applying various techniques such as prompt persona,structure outputs and zero-shot.To the selection of the LLMs(CodeLlama 7B,DeepSeek coder 7B,Gemini 1.5 Flash,Gemini 2.0 Flash,Mistral 7b Instruct,Phi 38b Mini 128K instruct,Qwen 2.5 coder,StartCoder 27B)with comparison and combination with Find Security Bugs.The evaluation method will involve using a selected dataset containing vulnerabilities,and the results to provide insights for different scenarios according to the software criticality(Business critical,non-critical,minimum effort,best effort)In detail,the main objectives of this study are to investigate if large language models outperform or exceed the capabilities of traditional static analysis tools,if the combining LLMs with Static Application Security Testing(SAST)tools lead to an improvement and the possibility that local machine learning models on a normal computer produce reliable results.Summarizing the most important conclusions of the research,it can be said that while it is true that the results have improved depending on the size of the LLM for business-critical software,the best results have been obtained by SAST analysis.This differs in“NonCritical,”“Best Effort,”and“Minimum Effort”scenarios,where the combination of LLM(Gemini)+SAST has obtained better results.
摘要Conversational recommender systems(CRSs)focus on refining preferences and providing personalized recommendations through natural language interactions and dialogue history.Large language models(LLMs)have shown outstanding performance across various domains,thereby prompting researchers to investigate their applicability in recommendation systems.However,due to the lack of task-specific knowledge and an inefficient feature extraction process,LLMs still have suboptimal performance in recommendation tasks.Therefore,external knowledge sources,such as knowledge graphs(KGs)and knowledge bases(KBs),are often introduced to address the issue of data sparsity.Compared to KGs,KBs possess higher retrieval efficiency,making them more suitable for scenarios where LLMs serve as recommenders.To this end,we introduce a novel framework integrating LLMs with KBs for enhanced retrieval generation,namely LLMKB.LLMKB initially leverages structured knowledge to create mapping dictionaries,extracting entity-relation information from heterogeneous knowledge to construct KBs.Then,LLMKB achieves the embedding calibration between user information representations and documents in KBs through retrieval model fine-tuning.Finally,LLMKB employs retrievalaugmented generation to produce recommendations based on fused text inputs,followed by post-processing.Experiment results on two public CRS datasets demonstrate the effectiveness of our framework.Our code is publicly available at the link:http://gffzze280b34df20547e2sk0npuwb0kbbk6qnc.ffgz.tsg.suse.edu.cn/LLMKB-6FD0.
基金supported by the Natural Science Foundation of Hebei Province(E2023502006)Fundamental Research Fund for the Central Universities(2025MS131).
摘要Magnesium hydride(MgH2),a promising high-capacity hydrogen storage material,is hindered by slow dehydrogenation kinetics.AIdriven catalyst discovery to address this is often hampered by the laborious extraction of data from unstructured literature.To overcome this,we introduce a transformative“LLM to Agent”framework that synergistically integrates Large Language Models(LLMs)for automated data curation with Machine Learning(ML)for predictive design.We automatically constructed a comprehensive database of 809 MgH2catalysts(6555 data rows)with high fidelity and an~40-fold acceleration over manual methods.The resulting ML models achieved high accuracy(average R2>0.91)in predicting dehydrogenation temperature and activation energy,subsequently guiding a Genetic Algorithm(GA)in an exploratory inverse design that autonomously uncovered key design principles for high-performance catalysts.Encouragingly,a strong alignment was found between these AI-discovered principles and the design strategies of recently reported,state-of-the-art experimental systems,providing substantial evidence for the validity of our approach.The framework culminates in Cat-Advisor,a novel,domain-adapted multi-agent system.Cat-Advisor translates ML predictions and retrieval-augmented knowledge into actionable design guidance,demonstrating capabilities that surpass those of general-purpose LLMs in this specialized domain.This work delivers a practical AI toolkit for accelerated materials discovery and advances the emerging Agent-based paradigm for designing next-generation energy technologies.
基金funded by the National Natural Science Foundation of China,grant number U2569201the Fundamental Research Funds for the Central Universities,grant number 2025YJS015.
摘要In Future Mobile Internet and convergence application scenarios,existing network attack traffic detection methods are insufficient in characterizing cross-flow correlations and structural dependencies during the attack process,and therefore still have limited generalization ability in complex scenarios and unknown attack identification tasks.To address this issue,this paper proposes a cross-flow modeling large language model framework,which extends the traditional detection paradigm based on single-flow features to joint modeling oriented toward cross-flow context and relational structure.Specifically,this paper constructs cross-flow context through flow sorting,grouping,and cross-group sampling,and combines an inter-flow relation matrix with a dual-branch embedding mechanism to achieve structured representation and relation-aware modeling of network traffic;at the model level,by removing the causal mask and introducing a relation-aware bias into bidirectional self-attention,the representation capability of the large language model for complex attack behaviors and potential inter-flow dependencies is enhanced.Experimental results show that the proposed method overall outperforms traditional machine learning and deep learning baseline models,and demonstrates better stability and accuracy in tasks such as fine-grained classification,unknown attack identification,and cross-scenario generalization.Ablation experiments further verify the effectiveness of the proposed cross-flow context construction,dual-branch embedding,and relation-aware LLM adaptation,demonstrating that each component contributes to the overall detection performance and generalization ability.Our work shows that,after targeted structural adaptation,large language models can effectively serve non-text security tasks such as network traffic analysis,thereby supporting AI-driven security modeling for Future Mobile Internet environments.
基金supported by the Chinese Academy of Sciences Pioneer Initiative(CAS Leading Action Plan)and the NUIST Students’Platform for Innovation Training Program(No.XJDC202510300646).
摘要The design of steel and alloy materials is of critical importance across a wide range of industrial applications;however,effective intelligent agent-based assistants for this domain remain limited.To address this gap,we introduce STALAgent,a large language model(LLM)-based multi-agent system specifically tailored for intelligent and automated design of steel and alloy materials.STALAgent is centered on an LLM brain with several key agents(e.g.,task assignment,semantic search,inverse design,and heat treatment simulation)that collectively form a closed-loop workflow from user query to material recommendation.This system leverages a CrewAI-based orchestrator to assign tasks and coordinate a suite of specialized agents,including tools for knowledge retrieval using a retrieval augmented generation(RAG),inverse materials design using variational encoder(VAE),and thermodynamic calculations using Pycalphad.Through case studies involving inverse alloy design tasks and knowledge-based steel design queries,we showcase the capacity of the LLM agent to offer effective and dependable guidance for steel and alloy material design.STALAgent is practical and scalable,serving as a supplementary tool for materials researchers and holding promise for extension to other materials science domains requiring scientific discovery and domain knowledge-intensive tasks.
摘要How can AI assist doctors in generating clinical reports without compromising patient privacy?This question motivates our development of PrivLLM-Guard,a novel framework for differentially private large language models(LLMs)tailored to real-time confidential medical text generation and summarization.While LLMs have shown promise in automating clinical documentation,the sensitivity of healthcare data demands rigorous privacy protections.PrivLLM-Guard addresses this need by combining advanced—differential privacy techniques with adaptive noise calibration,ensuring robust privacy guarantees without sacrificing utility.The framework integrates bidirectional transformer encoders with autoregressive decoders,further enhanced by privacy-aware attention and gradient perturbation mechanisms.Extensive experiments on three large-scale medical datasets demonstrate BLEU-4 scores of 89.7%for generation and ROUGE-L scores of 92.3%for summarization,while maintaining strict privacy budgets.The model processes 512-token sequences in real time with an average latency of 245 ms and memory usage of just 4.2 GB.Compared to state-of-the-art privacy-preserving LLMs,PrivLLM-Guard improves the utility-privacy trade-off by 15.8%and reduces computational overhead by 23.4%.Key contributions include adaptive noise injection,dynamic privacy budgeting,and an integrated privacy auditing module—collectively advancing secure and trustworthy AI deployment in clinical environments.
基金supported in part by National Natural Science Foundation of China(62441605)。
摘要Large language models(LLMs)have significantly advanced artificial intelligence(AI)by excelling in tasks such as understanding,generation,and reasoning across multiple modalities.Despite these achievements,LLMs have inherent limitations including outdated information,hallucinations,inefficiency,lack of interpretability,and challenges in domain-specific accuracy.To address these issues,this survey explores three promising directions in the post-LLM era:knowledge empowerment,model collaboration,and model co-evolution.First,we examine methods of integrating external knowledge into LLMs to enhance factual accuracy,reasoning capabilities,and interpretability,including incorporating knowledge into training objectives,instruction tuning,retrieval-augmented inference,and knowledge prompting.Second,we discuss model collaboration strategies that leverage the complementary strengths of LLMs and smaller models to improve efficiency and domain-specific performance through techniques such as model merging,functional model collaboration,and knowledge injection.Third,we delve into model co-evolution,in which multiple models collaboratively evolve by sharing knowledge,parameters,and learning strategies to adapt to dynamic environments and tasks,thereby enhancing their adaptability and continual learning.We illustrate how the integration of these techniques advances AI capabilities in science,engineering,and society—particularly in hypothesis development,problem formulation,problem-solving,and interpretability across various domains.We conclude by outlining future pathways for further advancement and applications.
摘要【研究目的】在全球气候变化与人类活动日趋剧烈的背景下,地质灾害愈发呈现出突发、多发、复杂等特征,对现有地质灾害风险防控体系的应对能力提出了新的挑战,亟需探索新时期地质灾害风险管理的智能化路径。【研究方法】本文系统回顾了近年来国内外地质灾害风险防控领域的研究进展,聚焦中国传统防控体系在风险识别、评估与管控环节面临的突出瓶颈,探讨了其技术赋能的发展过程。在此基础上,提出引入大语言模型(Large Language Models,LLMs)作为核心支撑的智能化地质灾害风险防控框架。【研究结果】本研究设计了一个基于LLMs的地质灾害风险防控体系,贯穿“智能识别-动态评估-协同管理”的全过程,推动地质灾害风险防控向智慧化、系统化方向转型。【结论】通过大语言模型与地质灾害防控场景的深度融合,有望为实现地质灾害防治现代化提供智能化的系统性解决方案。