Behaviour rule mining extracts valuable patterns from large amounts of behavioural data,which is crucial for analysing user behaviour,monitoring systems,and detecting security threats.Traditional manual or statistical...Behaviour rule mining extracts valuable patterns from large amounts of behavioural data,which is crucial for analysing user behaviour,monitoring systems,and detecting security threats.Traditional manual or statistical methods often fail to reveal complex,hidden associations.This study therefore proposes an automated behaviour rule mining method based on an improved Apriori algorithm.This method adapts data preprocessing and feature encoding to behavioural characteristics,introduces an adaptive support threshold and incremental updating to enhance efficiency,and automates the generation and filtering of association rules from frequent behavioural sequences.When evaluated using accuracy,recall,and interpretability metrics on public user behaviour data and simulated system logs,the method was found to effectively mine meaningful rules while maintaining high efficiency with large-scale data.This work offers a scalable and interpretable approach to automated behaviour rule mining that supports intelligent analysis and decision-making.展开更多
Because data warehouse is frequently changing, incremental data leads to old knowledge which is mined formerly unavailable. In order to maintain the discovered knowledge and patterns dynamically, this study presents a...Because data warehouse is frequently changing, incremental data leads to old knowledge which is mined formerly unavailable. In order to maintain the discovered knowledge and patterns dynamically, this study presents a novel algorithm updating for global frequent patterns-IPARUC. A rapid clustering method is introduced to divide database into n parts in IPARUC firstly, where the data are similar in the same part. Then, the nodes in the tree are adjusted dynamically in inserting process by "pruning and laying back" to keep the frequency descending order so that they can be shared to approaching optimization. Finally local frequent itemsets mined from each local dataset are merged into global frequent itemsets. The results of experimental study are very encouraging. It is obvious from experiment that IPARUC is more effective and efficient than other two contrastive methods. Furthermore, there is significant application potential to a prototype of Web log Analyzer in web usage mining that can help us to discover useful knowledge effectively, even help managers making decision.展开更多
Maximum frequent pattern generation from a large database of transactions and items for association rule mining is an important research topic in data mining. Association rule mining aims to discover interesting corre...Maximum frequent pattern generation from a large database of transactions and items for association rule mining is an important research topic in data mining. Association rule mining aims to discover interesting correlations, frequent patterns, associations, or causal structures between items hidden in a large database. By exploiting quantum computing, we propose an efficient quantum search algorithm design to discover the maximum frequent patterns. We modified Grover’s search algorithm so that a subspace of arbitrary symmetric states is used instead of the whole search space. We presented a novel quantum oracle design that employs a quantum counter to count the maximum frequent items and a quantum comparator to check with a minimum support threshold. The proposed derived algorithm increases the rate of the correct solutions since the search is only in a subspace. Furthermore, our algorithm significantly scales and optimizes the required number of qubits in design, which directly reflected positively on the performance. Our proposed design can accommodate more transactions and items and still have a good performance with a small number of qubits.展开更多
Mining frequent pattern in transaction database, time series databases, and many other kinds of databases have been studied popularly in data mining research. Most of the previous studies adopt Apriori like candidate ...Mining frequent pattern in transaction database, time series databases, and many other kinds of databases have been studied popularly in data mining research. Most of the previous studies adopt Apriori like candidate set generation and test approach. However, candidate set generation is very costly. Han J. proposed a novel algorithm FP growth that could generate frequent pattern without candidate set. Based on the analysis of the algorithm FP growth, this paper proposes a concept of equivalent FP tree and proposes an improved algorithm, denoted as FP growth * , which is much faster in speed, and easy to realize. FP growth * adopts a modified structure of FP tree and header table, and only generates a header table in each recursive operation and projects the tree to the original FP tree. The two algorithms get the same frequent pattern set in the same transaction database, but the performance study on computer shows that the speed of the improved algorithm, FP growth * , is at least two times as fast as that of FP growth.展开更多
A kind of single linked lists named aggregative chain is introduced to the algorithm, thus improving the architecture of FP tree. The new FP tree is a one-way tree and only the pointers that point its parent at each n...A kind of single linked lists named aggregative chain is introduced to the algorithm, thus improving the architecture of FP tree. The new FP tree is a one-way tree and only the pointers that point its parent at each node are kept. Route information of different nodes in a same item are compressed into aggregative chains so that the frequent patterns will be produced in aggregative chains without generating node links and conditional pattern bases. An example of Web key words retrieval is given to analyze and verify the frequent pattern algorithm in this paper.展开更多
As the information technology rapidly develops,many network applications appear and their communication protocols are unknown.Although many protocol keyword recognition based protocol reverse engineering methods have ...As the information technology rapidly develops,many network applications appear and their communication protocols are unknown.Although many protocol keyword recognition based protocol reverse engineering methods have been proposed,most of the keyword recognition algorithms are time consuming.This paper firstly uses the traffic clustering method F-DBSCAN to cluster the unknown protocol traffic.Then an improved CFSM(Closed Frequent Sequence Mining)algorithm is used to mine closed frequent sequences from the messages and identify protocol keywords.Finally,CFGM(Closed Frequent Group Mining)algorithm is proposed to explore the parallel,sequential and hierarchical relations between the protocol keywords and obtain accurate protocol message formats.Experimental results show that the proposed protocol formats extraction method is better than Apriori algorithm and Sequence alignment algorithm in terms of time complexity and it can achieve high keyword recognition accuracy.Additionally,based on the relations between the keywords,the method can obtain accurate protocol formats.Compared with the protocol formats obtained from the existing methods,our protocol format can better grasp the overall structure of target protocols and the results perform better in the application of protocol reverse engineering such as fuzzing test.展开更多
目的:探讨针灸治疗帕金森病非运动症状(PD-NMS)患者的辨证取穴规律,为临床治疗PD-NMS患者提供帮助。方法:采用系统性文献检索策略,查询中国知网(CNKI)、中国生物医学文献数据库(CBM)、维普中文期刊服务平台、万方数据知识服务平台(Wanfa...目的:探讨针灸治疗帕金森病非运动症状(PD-NMS)患者的辨证取穴规律,为临床治疗PD-NMS患者提供帮助。方法:采用系统性文献检索策略,查询中国知网(CNKI)、中国生物医学文献数据库(CBM)、维普中文期刊服务平台、万方数据知识服务平台(Wanfang Data)、PubMed、Embase、Web of Science等中英文数据库中有关针灸治疗PD-NMS的相关文献,提取症状、取穴处方信息构建医案数据库,采用隐结构模型、频繁项集分析等方法,分析针灸治疗PD-NMS的辨证取穴规律。检索时限均为建库至2025年2月28日。结果:系统检索中英文数据库,筛选针灸干预PD-NMS的临床文献46篇。在1 366份病历资料中提取71项症状体征、108个精准穴位定位点及114个穴位配伍方案构建结构化数据库,解析PD-NMS中医证型与取穴模式的对应规律。对症状、腧穴、证型进行频繁项集分析,挖掘出症状-腧穴频繁项集5项,包括五心烦热+腰酸+睡眠障碍+太冲等;证型-症状-腧穴频繁项集5项,包括肝肾阴虚证+五心烦热+腰酸+睡眠障碍+太冲+三阴交等。针灸治疗PD-NMS多以太冲、风池、合谷为主穴。结论:针灸治疗帕金森病非运动症状多以太冲、风池、合谷为主穴,配穴依据临床情况辨证取穴,此可为临床治疗帕金森病非运动症状提供参考。展开更多
It is nontrivial to maintain such discovered frequent query patterns in real XML-DBMS because the transaction database of queries may allow frequent updates and such updates may not only invalidate some existing frequ...It is nontrivial to maintain such discovered frequent query patterns in real XML-DBMS because the transaction database of queries may allow frequent updates and such updates may not only invalidate some existing frequent query patterns but also generate some new frequent query patterns. In this paper, two incremental updating algorithms, FUX-QMiner and FUXQMiner, are proposed for efficient maintenance of discovered frequent query patterns and generation the new frequent query patterns when new XMI, queries are added into the database. Experimental results from our implementation show that the proposed algorithms have good performance. Key words XML - frequent query pattern - incremental algorithm - data mining CLC number TP 311 Foudation item: Supported by the Youthful Foundation for Scientific Research of University of Shanghai for Science and TechnologyBiography: PENG Dun-lu (1974-), male, Associate professor, Ph.D, research direction: data mining, Web service and its application, peerto-peer computing.展开更多
In this paper,We study the Apriori and FP-growth algorithm in mining association rules and give a method for computing all the frequent item-sets in a database.Its basic idea is giving a concept based on the boolean v...In this paper,We study the Apriori and FP-growth algorithm in mining association rules and give a method for computing all the frequent item-sets in a database.Its basic idea is giving a concept based on the boolean vector business product,which be computed between all the businesses,then we can get all the two frequent item-sets(minsup=2).We basis their inclusive relation to construct a set-tree of item-sets in database transaction,and then traverse path in it and get all the frequent item-sets.Therefore,we can get minimal frequent item sets between transactions and items in the database without scanning the database and iteratively computing in Apriori algorithm.展开更多
基金funded by the 2025 Key Research Project of Shenzhen Polytechnic University“Research on Key Methods for Analysis and Prediction of Social Behavior of Specific Characters on Multimodal Big Data(6025310008K)”2024 Higher Education Scientific Research Planning Project of the Chinese Society of Higher Education“Research on the Analysis of Teaching and Learning Deep Interaction Characteristics in Smart Classroom Environment Supported by Multimodal Data(24XH0407)”.
摘要Behaviour rule mining extracts valuable patterns from large amounts of behavioural data,which is crucial for analysing user behaviour,monitoring systems,and detecting security threats.Traditional manual or statistical methods often fail to reveal complex,hidden associations.This study therefore proposes an automated behaviour rule mining method based on an improved Apriori algorithm.This method adapts data preprocessing and feature encoding to behavioural characteristics,introduces an adaptive support threshold and incremental updating to enhance efficiency,and automates the generation and filtering of association rules from frequent behavioural sequences.When evaluated using accuracy,recall,and interpretability metrics on public user behaviour data and simulated system logs,the method was found to effectively mine meaningful rules while maintaining high efficiency with large-scale data.This work offers a scalable and interpretable approach to automated behaviour rule mining that supports intelligent analysis and decision-making.
基金Supported by the National Natural Science Foundation of China(60472099)Ningbo Natural Science Foundation(2006A610017)
摘要Because data warehouse is frequently changing, incremental data leads to old knowledge which is mined formerly unavailable. In order to maintain the discovered knowledge and patterns dynamically, this study presents a novel algorithm updating for global frequent patterns-IPARUC. A rapid clustering method is introduced to divide database into n parts in IPARUC firstly, where the data are similar in the same part. Then, the nodes in the tree are adjusted dynamically in inserting process by "pruning and laying back" to keep the frequency descending order so that they can be shared to approaching optimization. Finally local frequent itemsets mined from each local dataset are merged into global frequent itemsets. The results of experimental study are very encouraging. It is obvious from experiment that IPARUC is more effective and efficient than other two contrastive methods. Furthermore, there is significant application potential to a prototype of Web log Analyzer in web usage mining that can help us to discover useful knowledge effectively, even help managers making decision.
摘要Maximum frequent pattern generation from a large database of transactions and items for association rule mining is an important research topic in data mining. Association rule mining aims to discover interesting correlations, frequent patterns, associations, or causal structures between items hidden in a large database. By exploiting quantum computing, we propose an efficient quantum search algorithm design to discover the maximum frequent patterns. We modified Grover’s search algorithm so that a subspace of arbitrary symmetric states is used instead of the whole search space. We presented a novel quantum oracle design that employs a quantum counter to count the maximum frequent items and a quantum comparator to check with a minimum support threshold. The proposed derived algorithm increases the rate of the correct solutions since the search is only in a subspace. Furthermore, our algorithm significantly scales and optimizes the required number of qubits in design, which directly reflected positively on the performance. Our proposed design can accommodate more transactions and items and still have a good performance with a small number of qubits.
基金theFundoftheNationalManagementBureauofTraditionalChineseMedicine(No .2 0 0 0 J P 5 4 )
摘要Mining frequent pattern in transaction database, time series databases, and many other kinds of databases have been studied popularly in data mining research. Most of the previous studies adopt Apriori like candidate set generation and test approach. However, candidate set generation is very costly. Han J. proposed a novel algorithm FP growth that could generate frequent pattern without candidate set. Based on the analysis of the algorithm FP growth, this paper proposes a concept of equivalent FP tree and proposes an improved algorithm, denoted as FP growth * , which is much faster in speed, and easy to realize. FP growth * adopts a modified structure of FP tree and header table, and only generates a header table in each recursive operation and projects the tree to the original FP tree. The two algorithms get the same frequent pattern set in the same transaction database, but the performance study on computer shows that the speed of the improved algorithm, FP growth * , is at least two times as fast as that of FP growth.
基金Supported by the Natural Science Foundation ofLiaoning Province (20042020)
摘要A kind of single linked lists named aggregative chain is introduced to the algorithm, thus improving the architecture of FP tree. The new FP tree is a one-way tree and only the pointers that point its parent at each node are kept. Route information of different nodes in a same item are compressed into aggregative chains so that the frequent patterns will be produced in aggregative chains without generating node links and conditional pattern bases. An example of Web key words retrieval is given to analyze and verify the frequent pattern algorithm in this paper.
基金supported by the National Key R&D Subsidized Project with 2017YFB0802900.
摘要As the information technology rapidly develops,many network applications appear and their communication protocols are unknown.Although many protocol keyword recognition based protocol reverse engineering methods have been proposed,most of the keyword recognition algorithms are time consuming.This paper firstly uses the traffic clustering method F-DBSCAN to cluster the unknown protocol traffic.Then an improved CFSM(Closed Frequent Sequence Mining)algorithm is used to mine closed frequent sequences from the messages and identify protocol keywords.Finally,CFGM(Closed Frequent Group Mining)algorithm is proposed to explore the parallel,sequential and hierarchical relations between the protocol keywords and obtain accurate protocol message formats.Experimental results show that the proposed protocol formats extraction method is better than Apriori algorithm and Sequence alignment algorithm in terms of time complexity and it can achieve high keyword recognition accuracy.Additionally,based on the relations between the keywords,the method can obtain accurate protocol formats.Compared with the protocol formats obtained from the existing methods,our protocol format can better grasp the overall structure of target protocols and the results perform better in the application of protocol reverse engineering such as fuzzing test.
摘要目的:探讨针灸治疗帕金森病非运动症状(PD-NMS)患者的辨证取穴规律,为临床治疗PD-NMS患者提供帮助。方法:采用系统性文献检索策略,查询中国知网(CNKI)、中国生物医学文献数据库(CBM)、维普中文期刊服务平台、万方数据知识服务平台(Wanfang Data)、PubMed、Embase、Web of Science等中英文数据库中有关针灸治疗PD-NMS的相关文献,提取症状、取穴处方信息构建医案数据库,采用隐结构模型、频繁项集分析等方法,分析针灸治疗PD-NMS的辨证取穴规律。检索时限均为建库至2025年2月28日。结果:系统检索中英文数据库,筛选针灸干预PD-NMS的临床文献46篇。在1 366份病历资料中提取71项症状体征、108个精准穴位定位点及114个穴位配伍方案构建结构化数据库,解析PD-NMS中医证型与取穴模式的对应规律。对症状、腧穴、证型进行频繁项集分析,挖掘出症状-腧穴频繁项集5项,包括五心烦热+腰酸+睡眠障碍+太冲等;证型-症状-腧穴频繁项集5项,包括肝肾阴虚证+五心烦热+腰酸+睡眠障碍+太冲+三阴交等。针灸治疗PD-NMS多以太冲、风池、合谷为主穴。结论:针灸治疗帕金森病非运动症状多以太冲、风池、合谷为主穴,配穴依据临床情况辨证取穴,此可为临床治疗帕金森病非运动症状提供参考。
摘要It is nontrivial to maintain such discovered frequent query patterns in real XML-DBMS because the transaction database of queries may allow frequent updates and such updates may not only invalidate some existing frequent query patterns but also generate some new frequent query patterns. In this paper, two incremental updating algorithms, FUX-QMiner and FUXQMiner, are proposed for efficient maintenance of discovered frequent query patterns and generation the new frequent query patterns when new XMI, queries are added into the database. Experimental results from our implementation show that the proposed algorithms have good performance. Key words XML - frequent query pattern - incremental algorithm - data mining CLC number TP 311 Foudation item: Supported by the Youthful Foundation for Scientific Research of University of Shanghai for Science and TechnologyBiography: PENG Dun-lu (1974-), male, Associate professor, Ph.D, research direction: data mining, Web service and its application, peerto-peer computing.
摘要In this paper,We study the Apriori and FP-growth algorithm in mining association rules and give a method for computing all the frequent item-sets in a database.Its basic idea is giving a concept based on the boolean vector business product,which be computed between all the businesses,then we can get all the two frequent item-sets(minsup=2).We basis their inclusive relation to construct a set-tree of item-sets in database transaction,and then traverse path in it and get all the frequent item-sets.Therefore,we can get minimal frequent item sets between transactions and items in the database without scanning the database and iteratively computing in Apriori algorithm.