Thinking how to fix this and make the search do the right thing for chinese characters.
What would be the right way to determine word boundries in chinese text ? Can we rely on whitespace for that, or is there a different rule ?
If no rule at all maybe add the "*" internally for words that have chinese characters (check unicode ranges).
Thinking how to fix this and make the search do the right thing for chinese characters.
What would be the right way to determine word boundries in chinese text ? Can we rely on whitespace for that, or is there a different rule ?
If no rule at all maybe add the "*" internally for words that have chinese characters (check unicode ranges).