Encoding a Categorical Independent Variable for Input to TerrSet’s Multi-Layer Perceptron

TitleEncoding a Categorical Independent Variable for Input to TerrSet’s Multi-Layer Perceptron
Publication TypeJournal Article
Year of Publication2021
AuthorsEvenden E, Jr RGilmore Po
JournalISPRS International Journal of Geo-Information
Volume10
Pagination686
Date Publishedoct
ISSN2220-9964
Abstract

The profession debates how to encode a categorical variable for input to machine learning algorithms, such as neural networks. A conventional approach is to convert a categorical variable into a collection of binary variables, which causes a burdensome number of correlated variables. TerrSet’s Land Change Modeler proposes encoding a categorical variable onto the continuous closed interval from 0 to 1 based on each category’s Population Evidence Likelihood (PEL) for input to the Multi-Layer Perceptron, which is a type of neural network. We designed examples to test the wisdom of these encodings. The results show that encoding a categorical variable based on each category’s Sample Empirical Probability (SEP) produces results similar to binary encoding and superior to PEL encoding. The Multi-Layer Perceptron’s sigmoidal smoothing function can cause PEL encoding to produce nonsensical results, while SEP encoding produces straightforward results. We reveal the encoding methods by illustrating how a dependent variable gains across an independent variable that has four categories. The results show that PEL can differ substantially from SEP in ways that have important implications for practical extrapolations. If users must encode a categorical variable for input to a neural network, then we recommend SEP encoding, because SEP efficiently produces outputs that make sense.

URLhttps://www.mdpi.com/2220-9964/10/10/686
DOI10.3390/ijgi10100686
Citation Keyevenden_encoding_2021