基于影响函数的k-近邻分类

职为梅; 张婷; 范明

doi:10.11999/JEIT141433

基于影响函数的k-近邻分类

doi: 10.11999/JEIT141433

基金项目:

国家自然科学基金(61170223)和河南省教育厅科学技术研究重点项目(14A520016)资助课题

计量
- 文章访问数: 613
- HTML全文浏览量: 70
- PDF下载量: 554
- 被引次数: 0
出版历程
- 收稿日期: 2014-11-13
- 修回日期: 2015-04-03
- 刊出日期: 2015-07-19

k-nearest Neighbor Classification Based on Influence Function

摘要

摘要: 分类是一种监督学习方法，通过在训练数据集学习模型判定未知样本的类标号。与传统的分类思想不同，该文从影响函数的角度理解分类，即从训练样本集对未知样本的影响来判定未知样本的类标号。首先介绍基于影响函数分类的思想；其次给出影响函数的定义，设计3种影响函数；最后基于这3种影响函数，提出基于影响函数的k-近邻(kNN)分类方法。并将该方法应用到非平衡数据集分类中。在18个UCI数据集上的实验结果表明，基于影响函数的k-近邻分类方法的分类性能好于传统的k-近邻分类方法，且对非平衡数据集分类有效。
- 数据挖掘 /
- 监督学习 /
- 非平衡数据集分类 /
- 影响函数 /
- k-近邻
Abstract: Classification is a supervised learning. It determines the class label of an unlabeled instance by learning model based on the training dataset. Unlike traditional classification, this paper views classification problem from another perspective, that is influential function. That is, the class label of an unlabeled instance is determined by the influence of the training data set. Firstly, the idea of classification is introduced based on influence function. Secondly, the definition of influence function is given and three influence functions are designed. Finally, this paper proposes k-nearest neighbor classification method based on these three influence functions and applies it to the classification of imbalanced data sets. The experimental results on 18 UCI data sets show that the proposed method improves effectively the k-nearest neighbor generalization ability. Besides, the proposed method is effective for imbalanced classification.
- Data mining /
- Supervised learning /
- Classification of imbalanced data sets /
- Influence function /
- k-Nearest Neighbor (kNN)

HTML全文

参考文献(16)

[1]	Tan P N and Steinbach M著, 范明, 范宏建, 译. 数据挖掘入门[M]. 第2版, 北京: 人民邮电出版社, 2011: 127-187.
[2]	Quinlan J S. Induction of decision trees[J]. Machine Learning, 1986, 1(1): 81-106.
[3]	Domingos P and Pazzani M J. Beyond independence: conditions for the optimality of the simple bayesian classifier[C].?Proceedings of the International Conference on Machine Learning, Bari, Italy, 1996: 105-112.
[4]	Rumelhart D E, Hinton G E, and Williams R J. Learning representations by back-propagating errors[J]. Nature, 1986, 323(9): 533-536.
[5]	Boser B E,?Guyon I M, and Vapnik V N.?A training algorithm for optimal margin classifiers[C].?Proceedings of the Conference on Learning Theory, Pittsburgh, USA, 1992: 144-152.
[6]	Dasarathy B V. Nearest Neighbor (NN) norms: NN Pattern Classification Techniques[M]. Michigan: IEEE Computer Society Press, 1991: 64-85.
[7]	Leake D B.?Experience, introspection and expertise: learning to refine the case-based reasoning process[J].?Journal of Experimental Theoretical Artificial Intelligent, 1996, 8(3/4): 319-339.
[8]	Hinneburg A and Keim D A. An efficient approach to clustering in large multimedia databases with noise[C]. Proceedings of the Knowledge Discovery and Data Mining, New York, USA, 1998: 58-65.
[9]	html. 2014.5.
[10]	Liu X Y, Li Q Q, and Zhou Z H. Learning imbalanced multi-class data with optimal dichotomy weights[C]. Proceedings of the 13th IEEE International Conference on Data Mining, Dallas, USA, 2013: 478-487.
[11]	He H B and Edwardo A G. Learning from imbalanced Data [J]. IEEE Transactions on Knowledge and Data Engineering, 2009, 21(9): 1263-1284.
[12]	Maratea A, Petrosino A, and Manzo M. Adjusted F-measure and kernel scaling for imbalanced data learning[J]. Information Sciences, 2014(257): 331-341.
[13]	Wang S and Yao X. Multiclass imbalance problems: analysis and potential solutions[J]. IEEE Transactions on Systems, Man and Cybernetics, Part B, 2012, 42(4): 1119-1130.
[14]	Lin M, Tang K, and Yao X. Dynamic sampling approach to training neural networks for multiclass imbalance classification[J]. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(4): 647-660.
[15]	Peng L Z, Zhang H L, Yang B, et al.. A new approach for imbalanced data classification based on data gravitation[J]. Information Sciences, 2014(288): 347-373.
[16]	Menardi G and Torelli N. Training and assessing classification rules with imbalanced data[J]. Data Mining and Knowledge Discovery, 2014, 28(1): 92-122.

相关文章(20)

[1]	金艳, 李亚刚, 姬红兵. 脉冲噪声下一种自适应ASR稳健滤波方法, 电子与信息学报. doi: 10.11999/JEIT190793
[2]	杜兰, 魏迪, 李璐, 郭昱辰. 基于半监督学习的SAR目标检测网络, 电子与信息学报. doi: 10.11999/JEIT190783
[3]	张雄涛, 蒋云良, 潘兴广, 胡文军, 王士同. 基于迭代模糊聚类算法与K近邻和数据字典的集成TSK模糊分类器, 电子与信息学报. doi: 10.11999/JEIT190214
[4]	曹志义, 牛少彰, 张继威. 基于半监督学习生成对抗网络的人脸还原算法研究, 电子与信息学报. doi: 10.11999/JEIT170357
[5]	张云雷, 吴斌, 刘宇. 一种新的基于粗糙集K-均值的社区发现方法, 电子与信息学报. doi: 10.11999/JEIT160516
[6]	张涛, 唐振民. 一种基于非负低秩稀疏图的半监督学习改进算法, 电子与信息学报. doi: 10.11999/JEIT160559
[7]	王菊, 刘付显. 一种面向多属性不确定数据流的模体发现算法, 电子与信息学报. doi: 10.11999/JEIT160247
[8]	徐小龙, 李永萍. 一种基于MapReduce的知识聚类与统计机制, 电子与信息学报. doi: 10.11999/JEIT150247
[9]	赵学健, 孙知信, 袁源. 基于预判筛选的高效关联规则挖掘算法, 电子与信息学报. doi: 10.11999/JEIT151107
[10]	张亚红, 李玉鑑, 张婷. 检测多元相关关系的最大信息熵方法, 电子与信息学报. doi: 10.11999/JEIT140053
[11]	孙力娟, 陈小东, 韩崇, 郭剑. 一种新的数据流模糊聚类方法, 电子与信息学报. doi: 10.11999/JEIT141415
[12]	李奕, 吴小俊. 基于监督学习的Takagi Sugeno Kang模糊系统图像融合方法研究, 电子与信息学报. doi: 10.3724/SP.J.1146.2013.00400
[13]	江逸茗, 兰巨龙, 郭通, 田铭. 一种面向可重构网络的业务聚类方法, 电子与信息学报. doi: 10.3724/SP.J.1146.2012.00973
[14]	赵振华, 郝晓弘. 局部保持鉴别投影及其在人脸识别中的应用, 电子与信息学报. doi: 10.3724/SP.J.1146.2012.00601
[15]	王力, 吴成东, 陈东岳. 基于密度权期望最大与分裂合并策略的线状模式挖掘, 电子与信息学报. doi: 10.3724/SP.J.1146.2011.01014
[16]	罗小建, 胡斌. 单圈T函数输出序列k-错线性复杂度研究, 电子与信息学报. doi: 10.3724/SP.J.1146.2010.00853
[17]	张清华, 幸禹可, 周玉兰. 基于粒计算的增量式知识获取方法, 电子与信息学报. doi: 10.3724/SP.J.1146.2010.00217
[18]	姜园, 张朝阳, 仇佩亮, 周东方. 用于数据挖掘的聚类算法, 电子与信息学报.
[19]	王晓晔, 王正欧. K-最近邻分类技术的改进算法, 电子与信息学报.
[20]	王晓晔, 王正欧. 正则化训练的神经网络与粗集理论相结合的股票时间序列数据挖掘技术, 电子与信息学报.