Big Data Analytics with Java by Mehta Rajat

Author:Mehta, Rajat [Mehta, Rajat]
Language: eng
Format: azw3
Publisher: Packt Publishing
Published: 2017-07-31T04:00:00+00:00

As seen in the preceding formula, if i is one such item in the set(x) then we find its probability within the set and multiply it by the logarithmic of its probability (log to the base 2). We do this for all the different discrete classes within the impure set and sum up all the calculated values for each different class in the set.

Let's understand this with a simple example.

Suppose you have a set of different fruits such as:

Set(fruits) = {apples, apples, apples, orange, orange, orange, orange, orange}

On this set, we find the probability of pulling each fruit.

So, it will be calculated as follows:

Probability(apple) = 3/8

Probability(orange) = 5/8

So, the Entropy for the Set (fruits) will be:

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.