Advice on String Similarity Metrics (Java). Distance, sounds like or combo?

Posted by andreas on Stack Overflow See other posts from Stack Overflow or by andreas
Published on 2010-04-21T13:01:48Z Indexed on 2010/04/21 23:03 UTC
Read the original article Hit count: 476

Filed under:

string

|

similarity

|

string-similarity

|

java

|

algorithm

Hello,

A part of a process requires to apply String Similarity Algorithms.

The results of this process will be stored and produce lets say SS_Dataset.

Based on this Dataset, further decisions will have to be made.

My questions are:

Should i apply one or more string similarity algorithms to produce SS_Dataset ?
Any comparisons between algorithms that calculate the 'distance' and the 'Sounds Like' similarity ?

Does one family of algorithms produces more accurate results over the other? Does a combination give more accurate results on similarity?

Can you recommend implementations that you have worked with?

My implementation will include packages from the following libraries

http://www.dcs.shef.ac.uk/~sam/simmetrics.html

http://jtmt.sourceforge.net/

Regards,

© Stack Overflow or respective owner

Related posts about string

Read array dump output and generates the correspondent XML file

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, The text below is the dump of a multidimensional array, dumped by the var_dump() PHP function. I need a Java function that reads a file with a content like this (attached) and returns it in XML. For a reference, in site http://pear.php.net/package/Var_Dump/ you can find the code (in PHP) that… >>> More
Formatting a date string when the string sits inside another string

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I'm trying to figure out a way to format a date string that sits inside string using javascript. The string can be: "hello there From 2010-03-04 00:00:00.0 to 2010-03-31 00:00:00.0" or "stuff like 2010-03-04 20:00:00.0 and 2010-03-31 00:00:02.0 blah blah" I'd like it to end up like: "stuff… >>> More
Using String+string+string vs using string.replace

as seen on Stack Overflow - Search for 'Stack Overflow'
A colleague told me that using the following method: string url = "SomeURL"; string ext = "SomeExt"; string sub = "SomeSub"; string subSub = "moreSub"; string Url = @"http://www." + Url +@"/"+ ext +@"/"+ sub + subSub; is not efficenet (takes more resources) and it is preferred to use the… >>> More
vb.net string concatenation string + function output + string = string + function output and no more

as seen on Stack Overflow - Search for 'Stack Overflow'
The following output produces a string with no closing xml tag. m_rFlight.Layout = m_rFlight.Layout + "<G3Grid:Spots>" + Me.gvwSpots.LayoutToString() + "</G3Grid:Spots>" This following code works correctly m_rFlight.Layout = m_rFlight.Layout + "<G3Grid:Spots>" + Me.gvwSpots.LayoutToString() m_rFlight… >>> More
Trying to convert simple midlet application to Android application but running into problems.

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi I am trying to do some threading in Android so I took an old threading assignment I had done fora midlet and took out the midlet code and replaced it with android code(such as textview). package com.assignment1; import android.app.Activity; import android.os.Bundle; import android.widget.TextView; public… >>> More

Related posts about similarity

Find cosine similarity in R

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm wondering if there is a built in function in R that can find the cosine similarity (or cosine distance) between two arrays? Currently, I implemented my own function, but I can't help but think that R should already come with one :) Thanks, Derek >>> More
fast similarity detection

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a large collection of objects and I need to figure out the similarities between them. To be exact: given two objects I can compute their dissimilarity as a number, a metric - higher values mean less similarity and 0 means the objects have identical contents. The cost of computing this number… >>> More
Lucene numDocs and doqFreq on custom similarity class

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi All, im doing an aplication with Lucene (im a noob with it) and im facing some problems. My aplication uses the Lucene 2.4.0 library with a custom similaraty implementation (the jar is imported) In my app im calculating doqFreq and numDocs manually (im adding the values of all indexes and then… >>> More
Document Similarity: Comparing two documents efficiently

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a loop that calculates the similarity between two documents. It collects all the tokens in a document and their scores, and places them in dictionary. It then compares the dictionaries This is what I have so far, it works, but is super slow: # Doc A cursor1.execute("SELECT token, tfidf_norm… >>> More
Advice on String Similarity Metrics (Java). Distance, sounds like or combo?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello, A part of a process requires to apply String Similarity Algorithms. The results of this process will be stored and produce lets say SS_Dataset. Based on this Dataset, further decisions will have to be made. My questions are: Should i apply one or more string similarity algorithms… >>> More