What IDF value does "the" get?
corpus: 4 documents term "the" appears in all 4 idf(t) = log(N / df(t))
- 0
- 1
- 4
- 2
log(4 / 4) = log(1) = 0, so a word found in every document carries no TF-IDF weight.
Play AI & ML ▸
corpus: 4 documents term "the" appears in all 4 idf(t) = log(N / df(t))