[ragel-users] For very basic XML tokenizing, do I really need Ragel's full scanner functionality?

Seamus Abshere seamus at abshere.net
Wed Jun 8 18:35:40 UTC 2011


Nate,

Thanks! You made me realize I was asking a simpler and more general 
question. I updated 
http://stackoverflow.com/questions/6274424/for-very-basic-tokenizing-do-i-really-need-ragels-full-scanner-functionality

Everybody,

I realized that asking about XML tokenizing was a red herring, because 
what I'm doing is not specific to XML. It's like asking how to tokenize

> The quick brown STARTANIMALfoxSTOPANIMAL jumps over the lazy STARTANIMALdogSTOPANIMAL and other stories

into (note that we want the STARTANIMAL stuff)

> token 1: STARTANIMALfoxSTOPANIMAL
> token 2: STARTANIMALdogSTOPANIMAL

Would you write the tokenizer using ()* instead of |**|?

Best,
Seamus

On 6/8/11 12:33 PM, Nate wrote:
> http://code.google.com/p/libgdx/source/browse/trunk/gdx/src/com/badlogic/gdx/utils/Xml.rl


_______________________________________________
ragel-users mailing list
ragel-users at complang.org
http://www.complang.org/mailman/listinfo/ragel-users



More information about the ragel-users mailing list