hadoop - Identify number of Mappers & Reducers launched in a Pig script -
i'm using hortonworks' sandbox vm run hadoop services. executed pig filter script in tez mode. unlike hive, pig log (console) doesn't show information number of mappers & reducers being executed. looking @ wrong place?
when running in tez mode, doesn’t have mappers or reducers. tez uses dag (directed acyclic graph) of tasks process data. mappers/reducers replaced vertices , edges. if using ambari, provides “tez view” more details job. additionally, may able enable/install tez ui (https://tez.apache.org/tez-ui.html) see information.
Comments
Post a Comment