Replace token in ANTLR

Posted by user1019710 on Stack Overflow See other posts from Stack Overflow or by user1019710
Published on 2012-03-26T19:35:37Z Indexed on 2012/03/27 17:29 UTC
Read the original article Hit count: 225

Filed under:

antlr

|

antlr3

I want to replace a token using ANTLR.

I tried with TokenRewriteStream and replace, but it didn't work.

Any suggestions?

  ANTLRStringStream in = new ANTLRStringStream(source);
  MyLexer lexer = new MyLexer(in);
  TokenRewriteStream tokens = new TokenRewriteStream(lexer);
  for(Object obj : tokens.getTokens()) {
     CommonToken token = (CommonToken)obj;  
     tokens.replace(token, "replacement");
  }

The lexer finds all occurences of single-line comments, and i want to replace them in the original source too.

© Stack Overflow or respective owner

Related posts about antlr

Antlr question: cannot get Antlr tool to compile simple file from ANTLRWorks

as seen on Stack Overflow - Search for 'Stack Overflow'
Here is the grammar file: grammar fred; test : 'fred'; Here is the batch file to launch the tool: SET JAVA_HOME=C:\Program Files\Java\jdk1.6.0_24 SET PATH=%PATH%;%JAVA_HOME%\bin SET ANTLR_HOME=c:/users/don/workspace/antlrAssign/lib/ java -cp %ANTLR_HOME%/antlr-3.3-complete.jar antlr.Tool… >>> More
Improving ANTLR DSL parse-error messages

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm working on a domain-specific language (DSL) for non-programmers. Non-programmers make a lot of grammar mistakes: they misspell keywords, they don't close parentheses, they don't terminate blocks, etc. I'm using ANTLR to generate my parser; it provides a nifty mechanism for handling RecognitionExceptions… >>> More
ANTLR - accessing token values in c/c++

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello, I am trying to parse integers and to access their value in antlr 3.2. I already found out how to do this in Java: //token definition INT : '0'..'9'+; //rule to access token value: start : val=INT {Integer x = Integer.valueOf( $val.text ).intValue(); } ; ... but I couldn't… >>> More
Removing Left Recursion in ANTLR

as seen on Stack Overflow - Search for 'Stack Overflow'
As is explained in http://stackoverflow.com/questions/2652060/removing-left-recursion , there are two ways to remove the left recursion. Modify the original grammar to remove the left recursion using some procedure Write the grammar originally not to have the left recursion What people normally… >>> More
Jar not found when executing class

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi there, I'm working through the ANTLR book and there are many examples that should be easy to compile using the command line. Some information to get te problem: antlr-3.2.jar contains the ANTLR classes. I added the antlr-3.2.jar to the CLASSPATH environment variable (Windows 7) and when compiling… >>> More

Related posts about antlr3

Parsing some particular statements with antlr3 in C target

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello all! I have some questions about antlr3 with tree grammar in C target. I have almost done my interpretor (functions, variables, boolean and math expressions ok) and i have kept the most difficult statements for the end (like if, switch, etc.) 1) I would like interpreting a simple loop statement: repeat:… >>> More
Island grammar antlr3...

as seen on Stack Overflow - Search for 'Stack Overflow'
What are and how to use the "island grammar" in antlr3? >>> More
How to get rid of the following multiple alternatives warnings in my ANTLR3 grammar?

as seen on Stack Overflow - Search for 'Stack Overflow'
[11:45:19] warning(200): mygrammar.g:14:57: Decision can match input such as "','" using multiple alternatives: 1, 2 As a result, alternative(s) 2 were disabled for that input [11:45:19] warning(200): C:\Users\Jarrod Roberson\mygrammar.g:14:57: Decision can match input such as "','" using multiple… >>> More
Lexer antlr3 token problem

as seen on Stack Overflow - Search for 'Stack Overflow'
Can I construct a token ENDPLUS: '+' (options (greedy = false;):.) * '+' ; being considered by the lexer only if it is preceded by a token PREwithout including in ENDPLUS? PRE: '<<' ; Thanks. >>> More
Why does Antlr not generate a lexer java file?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, Antlr3 does not generate Mylexer.java. I use AntlrWorks... when I have grammar starting like grammar mylexer; It does generate myParser.java It looks like a simple thing.. I wonder what may be the reason.. and the solution... I get no error message. >>> More