首页| JavaScript| HTML/CSS| Matlab| PHP| Python| Java| C/C++/VC++| C#| ASP| 其他|
购买积分 购买会员 激活码充值

您现在的位置是:虫虫源码 > 其他 > 为Hadoop执行并行任务没有写Map/Reduce代理

为Hadoop执行并行任务没有写Map/Reduce代理

资 源 简 介

Motivation This project is to assist normal users who are not familiar with hadoop to utilize an existing hadoop environment to run parallel jobs. The simple idea is to make the existing hadoop enviroment be a thread pool. How to Use The user does not need to know how to write map/reduce function or how to submit a hadoop job. The proxy is a container of threads. The user only needs to insert his(or her) created threads into the container and invoke the execution function. Then, the proxy will automatically send these threads to hadoop server and transform them into map/reduce functions. For example: ``` public class Test1 { /** * @param args */ public static void main(String[] args) { // TODO Auto-generated method stub try { ProxyClient proxy = new ProxyClient("hadoopxxxxserver.cs.xxx.edu"); proxy.addTask(new TestTask("a b c d e f"));
VIP VIP
0.219515s