Hadoop

  1. Cloud Computing
  2. Hadoop
    1. Set up Hadoop in Eclipse
      Hadoop on Windows with Eclipse 

    2. Hadoop Example
      MyMaxTemperatureWithCombiner.java, MaxTemperatureMapper.java, MaxTemperatureReducer.java

      How to run the example codes:

      1. You need to set up Hadoop as shown above (Set up Hadoop in Eclipse)
      2. make a directory named "tempIn" at your hadoop:
        bin/hadoop fs -mkdir tempIn
      3. copy input files 1901 and 1902 to your HDF:
        bin/hadoop fs -cp 1901 tempIn/
        bin/hadoop fs -cp 1902 tempIn/
      4. In the eclipse IDE, imports three java files above under package named "edu.calstatela.hipic.hadoop.util"
      5. Start Hadoop cluster as shown above (Set up Hadoop in Eclipse)
      6. In the eclipse IDE, Right click on MyMaxTemperatureWithCombiner.java, choose "Run as" > "Run Hadoop Application"
      7. You will see the map/reduce results at the HDF folder "tempOut" in DFS Location of eclipse IDE

Question or need Consulting: email at Dr. Jongwook Woo