This project has moved and is read-only. For the latest updates, please go here.

map reduce kind of implementation

Aug 21, 2011 at 8:50 PM


i am trying to build a stat engine with sql. i have created the langugae for it, i am thinking of parallel execution of a code part. for example


%map i=1 to 10

    %let x=i-1

    insert into temp_summary (sal, count_emp)

    select sal, count(distinct empid) from empid where emp like '%{x}';


    insert into summary (sal, count_emp)

    select sum(ysal), sum(count_emp) from temp_summary);




map command should start execution of the nested script in different threads and %map will wait till all the threads complete and then execute the nested script till % end command

Aug 22, 2011 at 3:23 AM

I don't understand - are asking a question? what is the problem, if there's any? or you just make an announcement? :)

Aug 22, 2011 at 10:33 AM

Sorry, I mised the question.

I am wondering how the parser can be modified to to achieve this, any help would be appreciated.


Aug 22, 2011 at 1:18 PM

The parser certainly remains the same, you would need a special interpreter. You may continue to use Interpreter class from Irony (better stick to version 2, in sources currently, early preview). In any case you'd need a set of special AST nodes for your constructs. So in these custom AST nodes implement Evaluate behavior with this multi-threading stuff.