Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Decision Tree - Can the Entropy of a Node be Zero?

The formula for information gain is give by,

Information Gain = entropy(parent) – [average entropy(children)]

Can the entropy be zero, which means in some case:

entropy(parent) == [average entropy(children)]
like image 450
Kevin217 Avatar asked Nov 15 '25 19:11

Kevin217


1 Answers

"When H(S) = 0, the set S is perfectly classified (i.e. all elements in S are of the same class)." -- https://en.wikipedia.org/wiki/ID3_algorithm

H(S) = entropy ;)

like image 128
Guiem Bosch Avatar answered Nov 18 '25 19:11

Guiem Bosch



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!