I have tried many different ways to do this task:
- Levenshtein
- Fuzzy
- Damerau Levenshtein
- Jaro Winkler
- Smith Waterman Gotoh
My code:
<?php
echo levenshtein("ЛИЧНА КАРТАlоемптY CARO Пренные ЂУРЂЕВИЋ Hercinian","Михајло Ђурђевић")."<br>";
?>
Output:
All of this is working properly with the English language. however, In my case, I have many different languages[Arabic, Chinese, Russian...etc]. Some letters in these languages are similar to each other.
Example:
in Arabic "ت" & "ث"
in Chinese "已" & "巳"
in Russian "ћ" & "h"
How to deal with these letters multibyte language to get good accuracy?
