Can I implement MapReduce in Python?

#1

Can I implement Map Reduce job in python? For example, can I create an entity that extends MapReduce and then create a .py file to implement a map function similar to below?

PythonDataJob.c3typ
entity type PythonDataJob extends MapReduce<Type, void, void, void> {

@py (env = 'runtime')
map: function(batch, objs, job)
}

PythonDataJob.py
def map (batch, objs, job):

0 Likes

#2

Yes, of course. Have you tried it and gotten any issues I can look at?

0 Likes