Fri, 20 Mar 2009 09:51:41 +0100allow non-printable symbols within string tokens;
wenzelm [Fri, 20 Mar 2009 09:51:41 +0100] rev 30600
allow non-printable symbols within string tokens;

Thu, 19 Mar 2009 22:05:37 +0100merged
wenzelm [Thu, 19 Mar 2009 22:05:37 +0100] rev 30599
merged

Thu, 19 Mar 2009 22:05:00 +0100proper spacing before ML antiquotations -- note that @ may be part of symbolic ML identifiers;
wenzelm [Thu, 19 Mar 2009 22:05:00 +0100] rev 30598
proper spacing before ML antiquotations -- note that @ may be part of symbolic ML identifiers;

Thu, 19 Mar 2009 21:05:40 +0100eval_antiquotes: joint scanning of ML tokens and antiquotations;
wenzelm [Thu, 19 Mar 2009 21:05:40 +0100] rev 30597
eval_antiquotes: joint scanning of ML tokens and antiquotations;

Thu, 19 Mar 2009 21:04:53 +0100added scan_antiq;
wenzelm [Thu, 19 Mar 2009 21:04:53 +0100] rev 30596
added scan_antiq;
more robust scan_ml: plain scanning without cut, regular Symbol_Pos.content instead of Symbol_Pos.implode (which contains spurious Symbol.DEL is used with proper positions);

Thu, 19 Mar 2009 19:49:09 +0100RAW: provide dummy Isar.main to make tty work gracefully (with ML toplevel);
wenzelm [Thu, 19 Mar 2009 19:49:09 +0100] rev 30595
RAW: provide dummy Isar.main to make tty work gracefully (with ML toplevel);

Thu, 19 Mar 2009 18:20:27 +0100added tokenize;
wenzelm [Thu, 19 Mar 2009 18:20:27 +0100] rev 30594
added tokenize;
internal scan_str: ensure Symbol.is_regular, otherwise it might swallow the stopper and crash!

Thu, 19 Mar 2009 16:56:51 +0100parameterized datatype antiquote and read operation;
wenzelm [Thu, 19 Mar 2009 16:56:51 +0100] rev 30593
parameterized datatype antiquote and read operation;

Thu, 19 Mar 2009 15:44:14 +0100Antiquote.Text: keep full position information;
wenzelm [Thu, 19 Mar 2009 15:44:14 +0100] rev 30592
Antiquote.Text: keep full position information;

Thu, 19 Mar 2009 15:22:53 +0100OuterLex.read_antiq;
wenzelm [Thu, 19 Mar 2009 15:22:53 +0100] rev 30591
OuterLex.read_antiq;