[Israel.pm] text lexical analyzing

Yona Shlomo yona at cs.technion.ac.il
Wed Sep 19 05:52:49 PDT 2007


On Wed, 19 Sep 2007, VladimirB at ladpc.co.il wrote:

> Are someone know about module for text lexical analyzing?
> I need some tool to determinate in plain text file (in fact - source file of Cobol program) strings are appropriate to words of regular English. For example: string 'CALL' is true, and 'CLL' - isn't.

Assuming that you know how to properly tokenize words, then
all you need is to check each token against a dictionary or
some morphological analyzer for English.

-- 
Shlomo Yona
yona at cs.technion.ac.il
http://yeda.cs.technion.ac.il/~yona/



More information about the Perl mailing list