Proposing a method for regression based on feature extraction and hesitant fuzzy sets

Document Type : Original Article

Authors

1 1Department of Computer Engineering, Shahid Bahonar University of Kerman, Kerman, Iran

2 Department of Applied Mathematics, Graduate University of Advanced Technology, Kerman, Iran

Abstract

In this paper, an effective method for regression is presented in which a variety of fuzzy clustering methods and concepts of Hesitant fuzzy sets are used. First, the fuzzy clustering algorithm is applied to the data, and after projecting the cluster membership function on different features, the number of clusters of fuzzy sets is obtained on each dimension (or feature). We then consider these fuzzy sets as a hesitant fuzzy set on each feature, and we obtain the Hesitant Fuzzy Correlation Coefficient Matrix (HFCCM) for the attributes. Subsequently, a nonlinear mapping based on the principal components analysis of the HFCCM is used to convert the dataset's features into new features. Finally, the new extracted features are assigned to the fuzzy clustering algorithm and a Sugeno fuzzy regression system is fitted. The proposed method was compared with some other methods to several regression datasets. The results of the experiments indicate that the proposed method is successful in extracting and reducing the characteristics, as well as increasing the regression accuracy. Also, the number of rules of the fuzzy regression model in the proposed method is fairly low.

Keywords

Main Subjects

References

[1]
F. Aghaeipoor, and M. Eftekhari, “EEFR-R: extracting effective fuzzy rules for regression problems through the cooperation of association rule mining concepts and evolutionary algorithms,” Soft Comput., vol. 23, no. 22, pp. 11737–11757, 2019.
25 Post hoc
[2]
L.X. Wang, and J.M. Mendel, “Generating fuzzy rules by learning from examples,” IEEE Trans. Syst., pp. 1414-1427, 1992.
[3]
H. A. Bazoobandi, and M. Eftekhari, “A differential evolution and spatial distribution based local search for training fuzzy Wavelet neural network,” Int. J. Eng., 27, 8, 1185-1194, 2014.
[4]
J. JSR, “ANFIS: Adaptive-NetworkBased Fuzzy Inference System,” I IEEE Trans. Syst., vol. 23, no. 3, pp. 665-685, 1993.
 [5]
M. Eftekhari, M. Eftekhari, and H. Karimpour, “Neuro-fuzzy adaptive control of a revolute stewart 2 platform carrying payloads of unknown inertia,” Robotica, vol. 33, no.9, 2001-2024, 2015.
[6]
M. Mahdizadeh, and M. Eftekhari, “Generating fuzzy rule base classifier for highly imbalanced datasets using a hybrid of evolutionary algorithms and subtractive clustering,” Journal of Intelligent and Fuzzy Systems, 27, 6, 3033-3046, 2014.
[7]
M. Eftekhari, and M. Mahdizadeh, “A novel cost sensitive imbalanced classification method based on new hybrid fuzzy Cost assigning approaches, fuzzy clustering and evolutionary algorithms,” Int. J. Eng. Trans. B, vol. 28, no. 8, pp. 1160-1168, 2015.
[8]
M. Hosseinzadeh, and M. Eftekhari, “Using fuzzy under-sampling and fuzzy PCA to improve imbalanced classification through Rotation Forest algorithm,” in: Comput. Sci. Softw. Eng. (CSSE), 2015 Int. Symp., IEEE, pp. 1–7, 2015.
[9] M. Khamar, and M. Eftekhari, “Multi-manifold based rotation forest for classification,” Appl. Soft Comput., vol. 68, pp. 626-635, 2018.
[10]
I. Jolliffe, “Principal Component Analysis,” Second Edition ed., Springer, 2002.
[11]
M.K. Ebrahimpour, and M. Eftekhari, “Distributed feature selection: A hesitant fuzzy correlation concept for microarray high-dimensional datasets,” Chemom. Intell. Lab. Syst., vol. 173, no. 1, pp. 51-64, 2018.
[12]
V. Torra, “Hesitant fuzzy sets,” Int. J. Intell. Syst, vol. 25, pp. 529-539, 2010.
[13]
[14]
L., Bingsheng et al., “An interval-valued intuitionistic fuzzy principal component analysis model-based method for complex multi-attribute large-group decision-making,” Eur. J. Oper. Res., vol. 245, no. 1, pp. 209-225, 2015.
V. Singh, N. K. Verma and Y. Cui, “Type-2 fuzzy PCA approach in extracting salient features for molecular cancer diagnostics and
[15]
prognostics,” IEEE Trans. Nanobiosci., vol. 18, no. 3, pp. 482-489, 2019. C.-T. S. Jyh-Shing Roger Jang, “Neuro-fuzzy and soft computing: A computational approach to learning and machine intelligence,” Upper Saddle River, NJ, USA: Prentice-Hall, Inc, 1997.
[16]
J. Mendel, “Uncertain rule-based fuzzy systems,” Springer, pp. 259–306, 2017.
[17]
R.M. Rodríguez et al., “Hesitant fuzzy sets: state of the art and future directions,” Int. J. Intell. Syst., vol. 29, no. 6, pp. 495–524, 2014.

Files

History

  • Receive Date: 16 January 2019
  • Revise Date: 28 October 2019
  • Accept Date: 29 December 2019
  • First Publish Date: 21 January 2020

Share

How to cite

Statistics