SWI-Prolog tokenize_atom/2 replacement?
Posted
by Shark
on Stack Overflow
See other posts from Stack Overflow
or by Shark
Published on 2010-03-27T11:15:09Z
Indexed on
2010/03/27
11:23 UTC
Read the original article
Hit count: 588
What I need to do is to break atom to tokens. E. g.:
tokenize_string('Hello, World!', L).
would unify L=['Hello',',','World','!']
. Exactly as tokenize_atom/2
do. But when I try to use tokenize_atom/2
with non-latin letters it fails. Is there any universal replacement or how I can write one? Thanks in advance.
© Stack Overflow or respective owner