Alex Rivera | Logout

Algorithm to detect similar documents in python script

Asked 2008-09-19T12:47:32.310
10

I need to write a module to detect similar documents. I have read many papers of fingerprints of documents techniques and others, but I do not know how to write code or implement such a solution. The algorithm should work for Chinese, Japanese, English and German language or be language independent. How can I accomplish this?

python algorithm diff
Edit
Report

1 Answer

2

There is a rather good talk on neural networks on Google Techtalks that talks about using layered Boltzmann machines to generate feature vectors for documents that can then be used to measure document distance. The main issue is the requirement to have a large sample document set to train the network to discover relevant features.

answered 2008-09-19T15:24:41.450

Your Answer