The formula for information gain is give by,
Information Gain = entropy(parent) – [average entropy(children)]
Can the entropy be zero, which means in some case:
entropy(parent) == [average entropy(children)]
"When H(S) = 0, the set S is perfectly classified (i.e. all elements in S are of the same class)." -- https://en.wikipedia.org/wiki/ID3_algorithm
H(S) = entropy ;)
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With