logilab-database #146815 Tokenize does not recognize unicode caracters [validation pending]

Tokenize does not recognize any unicode stop words caracters
(f.e 'right single quotation mark' (\u2019))

prioritynormal
typebug
done in1.11.2
load1.000
load left0.000
closed by#751a6b50392a [fti] take account of the Windows apostrophe \u2019 character (closes #146815)
patch[fti] take account of the Windows apostrophe \u2019 character (closes #146815) [applied]

Workflow history

from state (3)to statecommentdateUser
donevalidation pending2014/02/20 13:37 UTCjcristau
in-progressdone2014/02/20 12:44 UTC 
openin-progress2014/01/14 13:03 UTC 

Ticket #146815 - latest update on 2014/02/20, created on 2013/06/17 by Katia Saurfelt