An information theoretic approach to generating fuzzy hypercubes for if-then classifiers.
Saved in:
| Title: | An information theoretic approach to generating fuzzy hypercubes for if-then classifiers. |
|---|---|
| Authors: | Makrehchi, Masoud1, Kamel, Mohamed S.2 |
| Source: | Journal of Intelligent & Fuzzy Systems. 2011, Vol. 22 Issue 1, p33-52. 20p. |
| Subjects: | Information theory, Fuzzy hypergraphs, Combinatorial optimization, Genetic algorithms, Coding theory, Data distribution, Fuzzy logic, Experimental design |
| Abstract: | In this paper, a framework for automatic generation of fuzzy membership functions and fuzzy rules from training data is proposed. The main focus of this paper is designing fuzzy if-then classifiers; however the proposed method can be employed in designing a wide range of fuzzy system applications. After the fuzzy membership functions are modeled by their supports, an optimization technique, based on a multi-objective real coded genetic algorithm with adaptive cross over and mutation probabilities, is implemented to find near optimal supports. Employing interpretability constraint in parameter representation and encoding, we ensure that the generated fuzzy membership function does have a semantic meaning. The fitness function of the genetic algorithm, which estimates the quality of the generated membership functions, consists of two elements: (i) the Shannon entropy and mutual information measures to measure diversity of the data distribution in a hypercube; and (ii) the number of generated fuzzy rules addressing the measure of compactness of the fuzzy system. Finally membership functions are tuned to yield optimal classifier hypercubes, which represent the predictivity and discriminating power of the classifier. Fuzzy rules of the classifier are derived from the optimal hypercubes. Using the proposed approach to designing fuzzy if-then classifiers, we are also able to evaluate the generated membership functions and compare the results with that of other techniques which have been previously reported in the literature.Using the experimental result, we show that the proposed approach outperforms other techniques in low resolutions. It means that theproposed approach can achieve satisfying result with lower complexity. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Intelligent & Fuzzy Systems is the property of Sage Publications Inc. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 57284603 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: An information theoretic approach to generating fuzzy hypercubes for if-then classifiers. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Makrehchi%2C+Masoud%22">Makrehchi, Masoud</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Kamel%2C+Mohamed+S%2E%22">Kamel, Mohamed S.</searchLink><relatesTo>2</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Intelligent+%26+Fuzzy+Systems%22">Journal of Intelligent & Fuzzy Systems</searchLink>. 2011, Vol. 22 Issue 1, p33-52. 20p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Information+theory%22">Information theory</searchLink><br /><searchLink fieldCode="DE" term="%22Fuzzy+hypergraphs%22">Fuzzy hypergraphs</searchLink><br /><searchLink fieldCode="DE" term="%22Combinatorial+optimization%22">Combinatorial optimization</searchLink><br /><searchLink fieldCode="DE" term="%22Genetic+algorithms%22">Genetic algorithms</searchLink><br /><searchLink fieldCode="DE" term="%22Coding+theory%22">Coding theory</searchLink><br /><searchLink fieldCode="DE" term="%22Data+distribution%22">Data distribution</searchLink><br /><searchLink fieldCode="DE" term="%22Fuzzy+logic%22">Fuzzy logic</searchLink><br /><searchLink fieldCode="DE" term="%22Experimental+design%22">Experimental design</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: In this paper, a framework for automatic generation of fuzzy membership functions and fuzzy rules from training data is proposed. The main focus of this paper is designing fuzzy if-then classifiers; however the proposed method can be employed in designing a wide range of fuzzy system applications. After the fuzzy membership functions are modeled by their supports, an optimization technique, based on a multi-objective real coded genetic algorithm with adaptive cross over and mutation probabilities, is implemented to find near optimal supports. Employing interpretability constraint in parameter representation and encoding, we ensure that the generated fuzzy membership function does have a semantic meaning. The fitness function of the genetic algorithm, which estimates the quality of the generated membership functions, consists of two elements: (i) the Shannon entropy and mutual information measures to measure diversity of the data distribution in a hypercube; and (ii) the number of generated fuzzy rules addressing the measure of compactness of the fuzzy system. Finally membership functions are tuned to yield optimal classifier hypercubes, which represent the predictivity and discriminating power of the classifier. Fuzzy rules of the classifier are derived from the optimal hypercubes. Using the proposed approach to designing fuzzy if-then classifiers, we are also able to evaluate the generated membership functions and compare the results with that of other techniques which have been previously reported in the literature.Using the experimental result, we show that the proposed approach outperforms other techniques in low resolutions. It means that theproposed approach can achieve satisfying result with lower complexity. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Intelligent & Fuzzy Systems is the property of Sage Publications Inc. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=57284603 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3233/ifs-2010-0472 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 20 StartPage: 33 Subjects: – SubjectFull: Information theory Type: general – SubjectFull: Fuzzy hypergraphs Type: general – SubjectFull: Combinatorial optimization Type: general – SubjectFull: Genetic algorithms Type: general – SubjectFull: Coding theory Type: general – SubjectFull: Data distribution Type: general – SubjectFull: Fuzzy logic Type: general – SubjectFull: Experimental design Type: general Titles: – TitleFull: An information theoretic approach to generating fuzzy hypercubes for if-then classifiers. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Makrehchi, Masoud – PersonEntity: Name: NameFull: Kamel, Mohamed S. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Text: 2011 Type: published Y: 2011 Identifiers: – Type: issn-print Value: 10641246 Numbering: – Type: volume Value: 22 – Type: issue Value: 1 Titles: – TitleFull: Journal of Intelligent & Fuzzy Systems Type: main |
| ResultId | 1 |
