Behaviour rule mining extracts valuable patterns from large amounts of behavioural data,which is crucial for analysing user behaviour,monitoring systems,and detecting security threats.Traditional manual or statistical...Behaviour rule mining extracts valuable patterns from large amounts of behavioural data,which is crucial for analysing user behaviour,monitoring systems,and detecting security threats.Traditional manual or statistical methods often fail to reveal complex,hidden associations.This study therefore proposes an automated behaviour rule mining method based on an improved Apriori algorithm.This method adapts data preprocessing and feature encoding to behavioural characteristics,introduces an adaptive support threshold and incremental updating to enhance efficiency,and automates the generation and filtering of association rules from frequent behavioural sequences.When evaluated using accuracy,recall,and interpretability metrics on public user behaviour data and simulated system logs,the method was found to effectively mine meaningful rules while maintaining high efficiency with large-scale data.This work offers a scalable and interpretable approach to automated behaviour rule mining that supports intelligent analysis and decision-making.展开更多
With the continuous expansion and increasing complexity of engineering projects, cost forecasting has become particularly critical in project management. To meet the demands of the big data era, this study utilizes ex...With the continuous expansion and increasing complexity of engineering projects, cost forecasting has become particularly critical in project management. To meet the demands of the big data era, this study utilizes extensive historical engineering data to examine the intrinsic relationships and fluctuation patterns of project costs, covering data collection, preprocessing, and key factor analysis. By employing cutting-edge algorithms for comprehensive comparison and intelligent identification of cost-influencing factors, an efficient cost forecasting methodology was developed, achieving accurate predictions of cost trends. Results demonstrate that this method exhibits high forecasting accuracy across various project scenarios, effectively capturing key cost variation characteristics and providing robust insights for budget preparation and risk control. Practical validation confirms that with sufficient data resources and rigorous analysis of critical factors, cost management precision can be significantly enhanced. Overall, this research not only establishes innovative technical approaches for cost forecasting but also advances the digital transformation of project management, offering substantial practical implications and broad application prospects for improving resource allocation efficiency and optimizing project decision-making.展开更多
Maximum frequent pattern generation from a large database of transactions and items for association rule mining is an important research topic in data mining. Association rule mining aims to discover interesting corre...Maximum frequent pattern generation from a large database of transactions and items for association rule mining is an important research topic in data mining. Association rule mining aims to discover interesting correlations, frequent patterns, associations, or causal structures between items hidden in a large database. By exploiting quantum computing, we propose an efficient quantum search algorithm design to discover the maximum frequent patterns. We modified Grover’s search algorithm so that a subspace of arbitrary symmetric states is used instead of the whole search space. We presented a novel quantum oracle design that employs a quantum counter to count the maximum frequent items and a quantum comparator to check with a minimum support threshold. The proposed derived algorithm increases the rate of the correct solutions since the search is only in a subspace. Furthermore, our algorithm significantly scales and optimizes the required number of qubits in design, which directly reflected positively on the performance. Our proposed design can accommodate more transactions and items and still have a good performance with a small number of qubits.展开更多
The problem of association rule mining has gained considerable prominence in the data mining community for its use as an important tool of knowledge discovery from large scale databases. And there has been a spurt of ...The problem of association rule mining has gained considerable prominence in the data mining community for its use as an important tool of knowledge discovery from large scale databases. And there has been a spurt of research activities around this problem. However, traditional association rule mining may often derive many rules in which people are uninterested. This paper reports a generalization of association rule mining called φ association rule mining. It allows people to have different interests on different itemsets that arethe need of real application. Also, it can help to derive interesting rules and substantially reduce the amount of rules. An algorithm based on FP tree for mining φ frequent itemset is presented. It is shown by experiments that the proposed methodis efficient and scalable over large databases.展开更多
Association rules mining is a major data mining field that leads to discovery of associations and correlations among items in today’s big data environment. The conventional association rule mining focuses mainly on p...Association rules mining is a major data mining field that leads to discovery of associations and correlations among items in today’s big data environment. The conventional association rule mining focuses mainly on positive itemsets generated from frequently occurring itemsets (PFIS). However, there has been a significant study focused on infrequent itemsets with utilization of negative association rules to mine interesting frequent itemsets (NFIS) from transactions. In this work, we propose an efficient backward calculating negative frequent itemset algorithm namely EBC-NFIS for computing backward supports that can extract both positive and negative frequent itemsets synchronously from dataset. EBC-NFIS algorithm is based on popular e-NFIS algorithm that computes supports of negative itemsets from the supports of positive itemsets. The proposed algorithm makes use of previously computed supports from memory to minimize the computation time. In addition, association rules, i.e. positive and negative association rules (PNARs) are generated from discovered frequent itemsets using EBC-NFIS algorithm. The efficiency of the proposed algorithm is verified by several experiments and comparing results with e-NFIS algorithm. The experimental results confirm that the proposed algorithm successfully discovers NFIS and PNARs and runs significantly faster than conventional e-NFIS algorithm.展开更多
Mining frequent pattern in transaction database, time series databases, and many other kinds of databases have been studied popularly in data mining research. Most of the previous studies adopt Apriori like candidate ...Mining frequent pattern in transaction database, time series databases, and many other kinds of databases have been studied popularly in data mining research. Most of the previous studies adopt Apriori like candidate set generation and test approach. However, candidate set generation is very costly. Han J. proposed a novel algorithm FP growth that could generate frequent pattern without candidate set. Based on the analysis of the algorithm FP growth, this paper proposes a concept of equivalent FP tree and proposes an improved algorithm, denoted as FP growth * , which is much faster in speed, and easy to realize. FP growth * adopts a modified structure of FP tree and header table, and only generates a header table in each recursive operation and projects the tree to the original FP tree. The two algorithms get the same frequent pattern set in the same transaction database, but the performance study on computer shows that the speed of the improved algorithm, FP growth * , is at least two times as fast as that of FP growth.展开更多
With the advent of the IoT era, the amount of real-time data that is processed in data centers has increased explosively. As a result, stream mining, extracting useful knowledge from a huge amount of data in real time...With the advent of the IoT era, the amount of real-time data that is processed in data centers has increased explosively. As a result, stream mining, extracting useful knowledge from a huge amount of data in real time, is attracting more and more attention. It is said, however, that real- time stream processing will become more difficult in the near future, because the performance of processing applications continues to increase at a rate of 10% - 15% each year, while the amount of data to be processed is increasing exponentially. In this study, we focused on identifying a promising stream mining algorithm, specifically a Frequent Itemset Mining (FIsM) algorithm, then we improved its performance using an FPGA. FIsM algorithms are important and are basic data- mining techniques used to discover association rules from transactional databases. We improved on an approximate FIsM algorithm proposed recently so that it would fit onto hardware architecture efficiently. We then ran experiments on an FPGA. As a result, we have been able to achieve a speed 400% faster than the original algorithm implemented on a CPU. Moreover, our FPGA prototype showed a 20 times speed improvement compared to the CPU version.展开更多
Association rule mining is an important issue in data mining. The paper proposed an binary system based method to generate candidate frequent itemsets and corresponding supporting counts efficiently, which needs only ...Association rule mining is an important issue in data mining. The paper proposed an binary system based method to generate candidate frequent itemsets and corresponding supporting counts efficiently, which needs only some operations such as "and", "or" and "xor". Applying this idea in the existed distributed association rule mining al gorithm FDM, the improved algorithm BFDM is proposed. The theoretical analysis and experiment testify that BFDM is effective and efficient.展开更多
目的:探讨针灸治疗帕金森病非运动症状(PD-NMS)患者的辨证取穴规律,为临床治疗PD-NMS患者提供帮助。方法:采用系统性文献检索策略,查询中国知网(CNKI)、中国生物医学文献数据库(CBM)、维普中文期刊服务平台、万方数据知识服务平台(Wanfa...目的:探讨针灸治疗帕金森病非运动症状(PD-NMS)患者的辨证取穴规律,为临床治疗PD-NMS患者提供帮助。方法:采用系统性文献检索策略,查询中国知网(CNKI)、中国生物医学文献数据库(CBM)、维普中文期刊服务平台、万方数据知识服务平台(Wanfang Data)、PubMed、Embase、Web of Science等中英文数据库中有关针灸治疗PD-NMS的相关文献,提取症状、取穴处方信息构建医案数据库,采用隐结构模型、频繁项集分析等方法,分析针灸治疗PD-NMS的辨证取穴规律。检索时限均为建库至2025年2月28日。结果:系统检索中英文数据库,筛选针灸干预PD-NMS的临床文献46篇。在1 366份病历资料中提取71项症状体征、108个精准穴位定位点及114个穴位配伍方案构建结构化数据库,解析PD-NMS中医证型与取穴模式的对应规律。对症状、腧穴、证型进行频繁项集分析,挖掘出症状-腧穴频繁项集5项,包括五心烦热+腰酸+睡眠障碍+太冲等;证型-症状-腧穴频繁项集5项,包括肝肾阴虚证+五心烦热+腰酸+睡眠障碍+太冲+三阴交等。针灸治疗PD-NMS多以太冲、风池、合谷为主穴。结论:针灸治疗帕金森病非运动症状多以太冲、风池、合谷为主穴,配穴依据临床情况辨证取穴,此可为临床治疗帕金森病非运动症状提供参考。展开更多
A kind of single linked lists named aggregative chain is introduced to the algorithm, thus improving the architecture of FP tree. The new FP tree is a one-way tree and only the pointers that point its parent at each n...A kind of single linked lists named aggregative chain is introduced to the algorithm, thus improving the architecture of FP tree. The new FP tree is a one-way tree and only the pointers that point its parent at each node are kept. Route information of different nodes in a same item are compressed into aggregative chains so that the frequent patterns will be produced in aggregative chains without generating node links and conditional pattern bases. An example of Web key words retrieval is given to analyze and verify the frequent pattern algorithm in this paper.展开更多
In this paper, we propose an efficient algorithm, called FFP-Growth (shortfor fast FP-Growth) , to mine frequent itemsets. Similar to FP-Growth, FFP-Growth searches theFP-tree in the bottom-up order, but need not cons...In this paper, we propose an efficient algorithm, called FFP-Growth (shortfor fast FP-Growth) , to mine frequent itemsets. Similar to FP-Growth, FFP-Growth searches theFP-tree in the bottom-up order, but need not construct conditional pattern bases and sub-FP-trees,thus, saving a substantial amount of time and space, and the FP-tree created by it is much smallerthan that created by TD-FP-Growth, hence improving efficiency. At the same time, FFP-Growth can beeasily extended for reducing the search space as TD-FP-Growth (M) and TD-FP-Growth (C). Experimentalresults show that the algorithm of this paper is effective and efficient.展开更多
为有效解决分布式环境下频繁项集挖掘算法计算开销大、计算节点通信成本高的问题,提出一种基于Spark的频繁项集挖掘优化算法(efficient eclat on Spark,E-SPEclat)。采用位串表示项集与事务集合,利用位运算快速生成候选项集及其事务集合...为有效解决分布式环境下频繁项集挖掘算法计算开销大、计算节点通信成本高的问题,提出一种基于Spark的频繁项集挖掘优化算法(efficient eclat on Spark,E-SPEclat)。采用位串表示项集与事务集合,利用位运算快速生成候选项集及其事务集合;根据项集前缀支持度的降序对数据进行分组分区,减少节点通信开销并均衡工作负载;根据项集后缀是否为频繁2项集进行深度剪枝,减少事务集合交集计算次数。实验结果表明该算法可以有效提高频繁项集的挖掘效率。展开更多
The numerous volumes of data generated every day necessitate the deployment of new technologies capable of dealing with massive amounts of data efficiently.This is the case with Association Rules,a tool for unsupervis...The numerous volumes of data generated every day necessitate the deployment of new technologies capable of dealing with massive amounts of data efficiently.This is the case with Association Rules,a tool for unsupervised data mining that extracts information in the form of IF-THEN patterns.Although various approaches for extracting frequent itemset(prior step before mining association rules)in extremely large databases have been presented,the high computational cost and shortage of memory remain key issues to be addressed while processing enormous data.The objective of this research is to discover frequent itemset by using clustering for preprocessing and adopting the linear prefix tree algorithm for mining the maximal frequent itemset.The performance of the proposed CL-LP-MAX-tree was evaluated by comparing it with the existing FP-max algorithm.Experimentation was performed with the three different standard datasets to record evidence to prove that the proposed CL-LP-MAX-tree algorithm outperform the existing FP-max algorithm in terms of runtime and memory consumption.展开更多
To efficiently mine threat intelligence from the vast array of open-source cybersecurity analysis reports on the web,we have developed the Parallel Deep Forest-based Multi-Label Classification(PDFMLC)algorithm.Initial...To efficiently mine threat intelligence from the vast array of open-source cybersecurity analysis reports on the web,we have developed the Parallel Deep Forest-based Multi-Label Classification(PDFMLC)algorithm.Initially,open-source cybersecurity analysis reports are collected and converted into a standardized text format.Subsequently,five tactics category labels are annotated,creating a multi-label dataset for tactics classification.Addressing the limitations of low execution efficiency and scalability in the sequential deep forest algorithm,our PDFMLC algorithm employs broadcast variables and the Lempel-Ziv-Welch(LZW)algorithm,significantly enhancing its acceleration ratio.Furthermore,our proposed PDFMLC algorithm incorporates label mutual information from the established dataset as input features.This captures latent label associations,significantly improving classification accuracy.Finally,we present the PDFMLC-based Threat Intelligence Mining(PDFMLC-TIM)method.Experimental results demonstrate that the PDFMLC algorithm exhibits exceptional node scalability and execution efficiency.Simultaneously,the PDFMLC-TIM method proficiently conducts text classification on cybersecurity analysis reports,extracting tactics entities to construct comprehensive threat intelligence.As a result,successfully formatted STIX2.1 threat intelligence is established.展开更多
It is nontrivial to maintain such discovered frequent query patterns in real XML-DBMS because the transaction database of queries may allow frequent updates and such updates may not only invalidate some existing frequ...It is nontrivial to maintain such discovered frequent query patterns in real XML-DBMS because the transaction database of queries may allow frequent updates and such updates may not only invalidate some existing frequent query patterns but also generate some new frequent query patterns. In this paper, two incremental updating algorithms, FUX-QMiner and FUXQMiner, are proposed for efficient maintenance of discovered frequent query patterns and generation the new frequent query patterns when new XMI, queries are added into the database. Experimental results from our implementation show that the proposed algorithms have good performance. Key words XML - frequent query pattern - incremental algorithm - data mining CLC number TP 311 Foudation item: Supported by the Youthful Foundation for Scientific Research of University of Shanghai for Science and TechnologyBiography: PENG Dun-lu (1974-), male, Associate professor, Ph.D, research direction: data mining, Web service and its application, peerto-peer computing.展开更多
基金funded by the 2025 Key Research Project of Shenzhen Polytechnic University“Research on Key Methods for Analysis and Prediction of Social Behavior of Specific Characters on Multimodal Big Data(6025310008K)”2024 Higher Education Scientific Research Planning Project of the Chinese Society of Higher Education“Research on the Analysis of Teaching and Learning Deep Interaction Characteristics in Smart Classroom Environment Supported by Multimodal Data(24XH0407)”.
摘要Behaviour rule mining extracts valuable patterns from large amounts of behavioural data,which is crucial for analysing user behaviour,monitoring systems,and detecting security threats.Traditional manual or statistical methods often fail to reveal complex,hidden associations.This study therefore proposes an automated behaviour rule mining method based on an improved Apriori algorithm.This method adapts data preprocessing and feature encoding to behavioural characteristics,introduces an adaptive support threshold and incremental updating to enhance efficiency,and automates the generation and filtering of association rules from frequent behavioural sequences.When evaluated using accuracy,recall,and interpretability metrics on public user behaviour data and simulated system logs,the method was found to effectively mine meaningful rules while maintaining high efficiency with large-scale data.This work offers a scalable and interpretable approach to automated behaviour rule mining that supports intelligent analysis and decision-making.
摘要With the continuous expansion and increasing complexity of engineering projects, cost forecasting has become particularly critical in project management. To meet the demands of the big data era, this study utilizes extensive historical engineering data to examine the intrinsic relationships and fluctuation patterns of project costs, covering data collection, preprocessing, and key factor analysis. By employing cutting-edge algorithms for comprehensive comparison and intelligent identification of cost-influencing factors, an efficient cost forecasting methodology was developed, achieving accurate predictions of cost trends. Results demonstrate that this method exhibits high forecasting accuracy across various project scenarios, effectively capturing key cost variation characteristics and providing robust insights for budget preparation and risk control. Practical validation confirms that with sufficient data resources and rigorous analysis of critical factors, cost management precision can be significantly enhanced. Overall, this research not only establishes innovative technical approaches for cost forecasting but also advances the digital transformation of project management, offering substantial practical implications and broad application prospects for improving resource allocation efficiency and optimizing project decision-making.
摘要Maximum frequent pattern generation from a large database of transactions and items for association rule mining is an important research topic in data mining. Association rule mining aims to discover interesting correlations, frequent patterns, associations, or causal structures between items hidden in a large database. By exploiting quantum computing, we propose an efficient quantum search algorithm design to discover the maximum frequent patterns. We modified Grover’s search algorithm so that a subspace of arbitrary symmetric states is used instead of the whole search space. We presented a novel quantum oracle design that employs a quantum counter to count the maximum frequent items and a quantum comparator to check with a minimum support threshold. The proposed derived algorithm increases the rate of the correct solutions since the search is only in a subspace. Furthermore, our algorithm significantly scales and optimizes the required number of qubits in design, which directly reflected positively on the performance. Our proposed design can accommodate more transactions and items and still have a good performance with a small number of qubits.
摘要The problem of association rule mining has gained considerable prominence in the data mining community for its use as an important tool of knowledge discovery from large scale databases. And there has been a spurt of research activities around this problem. However, traditional association rule mining may often derive many rules in which people are uninterested. This paper reports a generalization of association rule mining called φ association rule mining. It allows people to have different interests on different itemsets that arethe need of real application. Also, it can help to derive interesting rules and substantially reduce the amount of rules. An algorithm based on FP tree for mining φ frequent itemset is presented. It is shown by experiments that the proposed methodis efficient and scalable over large databases.
摘要Association rules mining is a major data mining field that leads to discovery of associations and correlations among items in today’s big data environment. The conventional association rule mining focuses mainly on positive itemsets generated from frequently occurring itemsets (PFIS). However, there has been a significant study focused on infrequent itemsets with utilization of negative association rules to mine interesting frequent itemsets (NFIS) from transactions. In this work, we propose an efficient backward calculating negative frequent itemset algorithm namely EBC-NFIS for computing backward supports that can extract both positive and negative frequent itemsets synchronously from dataset. EBC-NFIS algorithm is based on popular e-NFIS algorithm that computes supports of negative itemsets from the supports of positive itemsets. The proposed algorithm makes use of previously computed supports from memory to minimize the computation time. In addition, association rules, i.e. positive and negative association rules (PNARs) are generated from discovered frequent itemsets using EBC-NFIS algorithm. The efficiency of the proposed algorithm is verified by several experiments and comparing results with e-NFIS algorithm. The experimental results confirm that the proposed algorithm successfully discovers NFIS and PNARs and runs significantly faster than conventional e-NFIS algorithm.
基金theFundoftheNationalManagementBureauofTraditionalChineseMedicine(No .2 0 0 0 J P 5 4 )
摘要Mining frequent pattern in transaction database, time series databases, and many other kinds of databases have been studied popularly in data mining research. Most of the previous studies adopt Apriori like candidate set generation and test approach. However, candidate set generation is very costly. Han J. proposed a novel algorithm FP growth that could generate frequent pattern without candidate set. Based on the analysis of the algorithm FP growth, this paper proposes a concept of equivalent FP tree and proposes an improved algorithm, denoted as FP growth * , which is much faster in speed, and easy to realize. FP growth * adopts a modified structure of FP tree and header table, and only generates a header table in each recursive operation and projects the tree to the original FP tree. The two algorithms get the same frequent pattern set in the same transaction database, but the performance study on computer shows that the speed of the improved algorithm, FP growth * , is at least two times as fast as that of FP growth.
摘要With the advent of the IoT era, the amount of real-time data that is processed in data centers has increased explosively. As a result, stream mining, extracting useful knowledge from a huge amount of data in real time, is attracting more and more attention. It is said, however, that real- time stream processing will become more difficult in the near future, because the performance of processing applications continues to increase at a rate of 10% - 15% each year, while the amount of data to be processed is increasing exponentially. In this study, we focused on identifying a promising stream mining algorithm, specifically a Frequent Itemset Mining (FIsM) algorithm, then we improved its performance using an FPGA. FIsM algorithms are important and are basic data- mining techniques used to discover association rules from transactional databases. We improved on an approximate FIsM algorithm proposed recently so that it would fit onto hardware architecture efficiently. We then ran experiments on an FPGA. As a result, we have been able to achieve a speed 400% faster than the original algorithm implemented on a CPU. Moreover, our FPGA prototype showed a 20 times speed improvement compared to the CPU version.
基金Supported by the National Natural Science Foun-dation of China (70371015)
摘要Association rule mining is an important issue in data mining. The paper proposed an binary system based method to generate candidate frequent itemsets and corresponding supporting counts efficiently, which needs only some operations such as "and", "or" and "xor". Applying this idea in the existed distributed association rule mining al gorithm FDM, the improved algorithm BFDM is proposed. The theoretical analysis and experiment testify that BFDM is effective and efficient.
摘要目的:探讨针灸治疗帕金森病非运动症状(PD-NMS)患者的辨证取穴规律,为临床治疗PD-NMS患者提供帮助。方法:采用系统性文献检索策略,查询中国知网(CNKI)、中国生物医学文献数据库(CBM)、维普中文期刊服务平台、万方数据知识服务平台(Wanfang Data)、PubMed、Embase、Web of Science等中英文数据库中有关针灸治疗PD-NMS的相关文献,提取症状、取穴处方信息构建医案数据库,采用隐结构模型、频繁项集分析等方法,分析针灸治疗PD-NMS的辨证取穴规律。检索时限均为建库至2025年2月28日。结果:系统检索中英文数据库,筛选针灸干预PD-NMS的临床文献46篇。在1 366份病历资料中提取71项症状体征、108个精准穴位定位点及114个穴位配伍方案构建结构化数据库,解析PD-NMS中医证型与取穴模式的对应规律。对症状、腧穴、证型进行频繁项集分析,挖掘出症状-腧穴频繁项集5项,包括五心烦热+腰酸+睡眠障碍+太冲等;证型-症状-腧穴频繁项集5项,包括肝肾阴虚证+五心烦热+腰酸+睡眠障碍+太冲+三阴交等。针灸治疗PD-NMS多以太冲、风池、合谷为主穴。结论:针灸治疗帕金森病非运动症状多以太冲、风池、合谷为主穴,配穴依据临床情况辨证取穴,此可为临床治疗帕金森病非运动症状提供参考。
基金Supported by the Natural Science Foundation ofLiaoning Province (20042020)
摘要A kind of single linked lists named aggregative chain is introduced to the algorithm, thus improving the architecture of FP tree. The new FP tree is a one-way tree and only the pointers that point its parent at each node are kept. Route information of different nodes in a same item are compressed into aggregative chains so that the frequent patterns will be produced in aggregative chains without generating node links and conditional pattern bases. An example of Web key words retrieval is given to analyze and verify the frequent pattern algorithm in this paper.
摘要In this paper, we propose an efficient algorithm, called FFP-Growth (shortfor fast FP-Growth) , to mine frequent itemsets. Similar to FP-Growth, FFP-Growth searches theFP-tree in the bottom-up order, but need not construct conditional pattern bases and sub-FP-trees,thus, saving a substantial amount of time and space, and the FP-tree created by it is much smallerthan that created by TD-FP-Growth, hence improving efficiency. At the same time, FFP-Growth can beeasily extended for reducing the search space as TD-FP-Growth (M) and TD-FP-Growth (C). Experimentalresults show that the algorithm of this paper is effective and efficient.
摘要为有效解决分布式环境下频繁项集挖掘算法计算开销大、计算节点通信成本高的问题,提出一种基于Spark的频繁项集挖掘优化算法(efficient eclat on Spark,E-SPEclat)。采用位串表示项集与事务集合,利用位运算快速生成候选项集及其事务集合;根据项集前缀支持度的降序对数据进行分组分区,减少节点通信开销并均衡工作负载;根据项集后缀是否为频繁2项集进行深度剪枝,减少事务集合交集计算次数。实验结果表明该算法可以有效提高频繁项集的挖掘效率。
摘要The numerous volumes of data generated every day necessitate the deployment of new technologies capable of dealing with massive amounts of data efficiently.This is the case with Association Rules,a tool for unsupervised data mining that extracts information in the form of IF-THEN patterns.Although various approaches for extracting frequent itemset(prior step before mining association rules)in extremely large databases have been presented,the high computational cost and shortage of memory remain key issues to be addressed while processing enormous data.The objective of this research is to discover frequent itemset by using clustering for preprocessing and adopting the linear prefix tree algorithm for mining the maximal frequent itemset.The performance of the proposed CL-LP-MAX-tree was evaluated by comparing it with the existing FP-max algorithm.Experimentation was performed with the three different standard datasets to record evidence to prove that the proposed CL-LP-MAX-tree algorithm outperform the existing FP-max algorithm in terms of runtime and memory consumption.
摘要To efficiently mine threat intelligence from the vast array of open-source cybersecurity analysis reports on the web,we have developed the Parallel Deep Forest-based Multi-Label Classification(PDFMLC)algorithm.Initially,open-source cybersecurity analysis reports are collected and converted into a standardized text format.Subsequently,five tactics category labels are annotated,creating a multi-label dataset for tactics classification.Addressing the limitations of low execution efficiency and scalability in the sequential deep forest algorithm,our PDFMLC algorithm employs broadcast variables and the Lempel-Ziv-Welch(LZW)algorithm,significantly enhancing its acceleration ratio.Furthermore,our proposed PDFMLC algorithm incorporates label mutual information from the established dataset as input features.This captures latent label associations,significantly improving classification accuracy.Finally,we present the PDFMLC-based Threat Intelligence Mining(PDFMLC-TIM)method.Experimental results demonstrate that the PDFMLC algorithm exhibits exceptional node scalability and execution efficiency.Simultaneously,the PDFMLC-TIM method proficiently conducts text classification on cybersecurity analysis reports,extracting tactics entities to construct comprehensive threat intelligence.As a result,successfully formatted STIX2.1 threat intelligence is established.
摘要It is nontrivial to maintain such discovered frequent query patterns in real XML-DBMS because the transaction database of queries may allow frequent updates and such updates may not only invalidate some existing frequent query patterns but also generate some new frequent query patterns. In this paper, two incremental updating algorithms, FUX-QMiner and FUXQMiner, are proposed for efficient maintenance of discovered frequent query patterns and generation the new frequent query patterns when new XMI, queries are added into the database. Experimental results from our implementation show that the proposed algorithms have good performance. Key words XML - frequent query pattern - incremental algorithm - data mining CLC number TP 311 Foudation item: Supported by the Youthful Foundation for Scientific Research of University of Shanghai for Science and TechnologyBiography: PENG Dun-lu (1974-), male, Associate professor, Ph.D, research direction: data mining, Web service and its application, peerto-peer computing.