SWI-Prolog tokenize_atom/2 replacement?

Posted by Shark on Stack Overflow See other posts from Stack Overflow or by Shark
Published on 2010-03-27T11:15:09Z Indexed on 2010/03/27 11:23 UTC
Read the original article Hit count: 585

Filed under:
|
|

What I need to do is to break atom to tokens. E. g.:

tokenize_string('Hello, World!', L).

would unify L=['Hello',',','World','!']. Exactly as tokenize_atom/2 do. But when I try to use tokenize_atom/2 with non-latin letters it fails. Is there any universal replacement or how I can write one? Thanks in advance.

© Stack Overflow or respective owner

Related posts about swi-prolog

Related posts about prolog