Hadoop: Big Data Transformation and Analytics with Hadoop

December 4, 2012 @ 6:30 pm – December 4, 2012 @ 8:30 pm
275 3rd St
Cambridge, MA 02142

Excited about big data, and want to get hands-on playing with data sets and popular data tools? It’s time to Code Big or Go Home!

  • Date / time: December 4, 2012 @ 18:30 – 20:30
  • Location: hack/reduce (275 3rd St, Cambridge, MA 02142)
  • Cost: free (limited to 50 attendees)
  • See this event page to learn more.

See this 


  • Background: Basic programming skills (e.g. with Java or Python). Knowledge on Big Data or Hadoop is NOT required.
  • Laptop: Bring a Linux or Mac laptop with the software tools mentioned in the Prerequisites section here preinstalled. Users of a Windows laptop can install a Linux virtual machine (e.g. see notes here).
  • Mindset: Excited to learn new tools and gain relevant skill sets


In this session, we will teach you how to program and operate Hadoop, the poster child technology enabler of Big Data. Why should you care? Take a look at this exploding chart of Hadoop job trends. Even CEOs are starting to care about Hadoop.  Oh by the way, it’s open source and free to use.

By attending this session, you will be able to:

  • Gain hands-on big data experiences with the experts
  • Learn a cutting-edge tool that may help you tackle open problems at your current job, or open up new career opportunities
  • Network with fellow hack / reduce technologists and find ways to work together on big data problems

Session Agenda

In this 90-minute session, we will cover the following ground:

  • Write and execute Java-based Map Reduce (MR) jobs to analyze the data at hand
  • Program MR jobs with other languages (e.g. python, ruby) via Hadoop Streaming
  • Basic usage of HDFS, the Hadoop file system to deploy and run MR jobs
  • Introduction to monitoring and performance tuning on Hadoop
  • Declarative data processing on Hadoop via HIVE

By the end of this session, you will be able to program and run Hadoop jobs on your own computer as well as on the cloud.


Mingsheng Hong

Chief Data Scientist at Hadapt
hack / reduce Contributor


Mingsheng Hong is Chief Data Scientist at Hadapt, driving the product roadmap and incubating analytic use cases. Prior to this role, Mingsheng was Field CTO at Vertica, an HP company, and was instrumental in its product development and positioning.

Mingsheng obtained his Computer Science Ph.D. degree at Cornell University, where he built Cayuga, the world’s first expressive and scalable CEP engine. Mingsheng also co-founded the Microsoft CEDR event processing project, which became the Microsoft StreamInsight technology shipped with SQL Server 2008 and 2012.

Mingsheng is a frequent speaker on Big Data, and has given talks, lectures and demos at Hadoop World, TDWI conferences, the Cube and Harvard Business School.

Greg Lu

Software Engineer at Hopper
Founding Member of hack / reduce Hackathons

Greg Lu is a software engineer at Hopper, a travel search engine company. He is well versed in Java, Hadoop/Mapreduce (distributed filesystem and computation), Cassandra and HBase (distributed databases), Heritrix (web crawling), and Solr/Lucene (search and indexing).

Greg is also the technical organizer of HackReduce (hackreduce.org), where he implemented an automated cluster management system in EC2 for creating and expanding the multiple Hadoop clusters (300-500 instances), as well as mentoring the participants during the one day hackathon events.

Greg began his software career as a web developer for over 6 years, starting with PHP and then Ruby on Rails for the later 5. He has also worked with many other languages and technologies throughout my own explorations and studies.

460 thoughts on “Hadoop: Big Data Transformation and Analytics with Hadoop”

  1. Pingback: Where can i buy
  2. Pingback: loan without check
  3. Pingback: pay day max
  4. Pingback: Trackback
  5. Pingback: sam waltonman
  6. Pingback: website
  7. Pingback: More Info
  8. Pingback: here
  9. Pingback: Recommended Site
  10. Pingback: her explanation
  11. Pingback: Trackback
  12. Pingback: Atlanta GA SEO
  13. Pingback: Trackback
  14. Pingback: anchor
  15. Pingback: driving record
  16. Pingback: books of ra online
  17. Pingback: book of ra .apk
  18. Pingback: iherb coupon
  19. Pingback: iherb coupons
  20. Pingback: iherb promo code
  21. Pingback: redirected here
  22. Pingback: Dogecoin
  23. Pingback: Action Games
  24. Pingback: Try These Guys Out
  25. Pingback: Trackback...
  26. Pingback: My Homepage
  27. Pingback: water ionizers
  28. Pingback: Hot Friv Games
  29. Pingback: seo in kansas city
  30. Pingback: buy cialis
  31. Pingback: www.redsox.me
  32. Pingback: texto interesante
  33. Pingback: Search
  34. Pingback: water ionizer
  35. Pingback: fuck buddy in
  36. Pingback: Homepage
  37. Pingback: Start
  38. Pingback: Advogado familia
  39. Pingback: Logo design
  40. Pingback: Health
  41. Pingback: Finance
  42. Pingback: Liberty
  43. Pingback: lisätietoa
  44. Pingback: mark cobb
  45. Pingback: iherb coupon codes
  46. Pingback: city
  47. Pingback: iherb coupon
  48. Pingback: iherb coupon
  49. Pingback: Business
  50. Pingback: Jack Boucaut
  51. Pingback: davep.me
  52. Pingback: cialis montrГ©al
  53. Pingback: Camp
  54. Pingback: location de linge
  55. Pingback: serial number
  56. Pingback: this website
  57. Pingback: Tech
  58. Pingback: continue reading
  59. Pingback: Karmaloop Coupons
  60. Pingback: pastor carter
  61. Pingback: Home
  62. Pingback: Diindolylmethane
  63. Pingback: listing house
  64. Pingback: Fashion
  65. Pingback: gu10 led bulb
  66. Pingback: Pussy
  67. Pingback: Adelgaza20
  68. Pingback: download
  69. Pingback: Diamond Buyers
  70. Pingback: book fo ra
  71. Pingback: ppi claims
  72. Pingback: cigar of the month
  73. Pingback: check over here
  74. Pingback: demenagement
  75. Pingback: dallas roof repair
  76. Pingback: Healt
  77. Pingback: voyeurism
  78. Pingback: Book of Ra
  79. Pingback: ????? ?????
  80. Pingback: Movemynt Products
  81. Pingback: shirts
  82. Pingback: Click here
  83. Pingback: e cig reviews
  84. Pingback: colonsentry.info
  85. Pingback: moved here
  86. Pingback: reference
  87. Pingback: Omen Interactive
  88. Pingback: vitamin c serum 20
  89. Pingback: reishi
  90. Pingback: kangan water
  91. Pingback: Zed
  92. Pingback: e liquid
  93. Pingback: novedades
  94. Pingback: information
  95. Pingback: bhw
  96. Pingback: lucid dreaming
  97. Pingback: tampa local seo
  98. Pingback: help moppy
  99. Pingback: foreclosure
  100. Pingback: package holidays
  101. Pingback: Make money online
  102. Pingback: neapo.info
  103. Pingback: Party Shop
  104. Pingback: Read Full Report
  105. Pingback: ??????????? ?Θ???
  106. Pingback: japan shopping
  107. Pingback: berita hari ini
  108. Pingback: additional reading
  109. Pingback: agencja kreatywna
  110. Pingback: Skup zlota Bemowo
  111. Pingback: waclaw berent
  112. Pingback: fotograf poznan
  113. Pingback: wózek na zakupy
  114. Pingback: tynki
  115. Pingback: can 2015
  116. Pingback: cialis mastercard
  117. Pingback: 24 Hour Bail Bonds
  118. Pingback: M88
  119. Pingback: slots us
  120. Pingback: education
  121. Pingback: Wp Weekend Phoenix
  122. Pingback: Wp Weekend Phoenix
  123. Pingback: Green tea
  124. Pingback: students
  125. Pingback: spelautomater
  126. Pingback: London
  127. Pingback: get uk loan
  128. Pingback: one month loans uk
  129. Pingback: hefalimp cardijon
  130. Pingback: travel in boracay
  131. Pingback: NCWISE Login
  132. Pingback: warcraft
  133. Pingback: Logiciel EBP
  134. Pingback: Bitcoin Hosting
  135. Pingback: Dallas remodel
  136. Pingback: wiedza o winie
  137. Pingback: krakowianian
  138. Pingback: gcsrdsmgkrnggkxrv
  139. Pingback: Home 3D Printers
  140. Pingback: Business
  141. Pingback: o sushi
  142. Pingback: Pen Polish
  143. Pingback: chicken coop ideas
  144. Pingback: mice at home
  145. Pingback: go to this site
  146. Pingback: scmrgscvgxrfmgckg
  147. Pingback: News
  148. Pingback: qzdcgzscbfsdgvvhid
  149. Pingback: this site
  150. Pingback: DUI Lawyer Denver
  151. Pingback: arkitektforbundet
  152. Pingback: pearl powder
  153. Pingback: gcrmgskrfhxfsxg
  154. Pingback: Indian Caterer
  155. Pingback: ek haseena thi
  156. Pingback: my review here
  157. Pingback: gta 5 hack
  158. Pingback: kemeja import
  159. Pingback: online slots
  160. Pingback: home page,
  161. Pingback: official site
  162. Pingback: online marketing
  163. Pingback: download music
  164. Pingback: free apple ipad
  165. Pingback: click here.,
  166. Pingback: sacred 3 trainer
  167. Pingback: You Can Check Here
  168. Pingback: belki zadania
  169. Pingback: my review here
  170. Pingback: JPC
  171. Pingback: Grand Canyon Tours
  172. Pingback: Nepal Tourism
  173. Pingback: set
  174. Pingback: buy a dog online
  175. Pingback: travel advice
  176. Pingback: seo experts
  177. Pingback: Vintage beads
  178. Pingback: attorney
  179. Pingback: discount program
  180. Pingback: web site
  181. Pingback: balance your life
  182. Pingback: neon sign atlanta
  183. Pingback: ionized water
  184. Pingback: arkitekter
  185. Pingback: Football quotes
  186. Pingback: kargo
  187. Pingback: uslugi bhp
  188. Pingback: Flashwireless.com
  189. Pingback: website
  190. Pingback: surgical tweezers
  191. Pingback: reverse Kennesaw
  192. Pingback: water ionizers
  193. Pingback: paddle hair brush
  194. Pingback: withdrawal ease
  195. Pingback: buy seo
  196. Pingback: bay area
  197. Pingback: carmen yellow
  198. Pingback: zaimo
  199. Pingback: parkingi pyrzowice
  200. Pingback: wymiana online
  201. Pingback: funny commercials
  202. Pingback: shop
  203. Pingback: perfume
  204. Pingback: gold investing
  205. Pingback: warehouse for rent
  206. Pingback: Adrian Kolodziej
  207. Pingback: More Information
  208. Pingback: Demir
  209. Pingback: Podcast
  210. Pingback: computer tower
  211. Pingback: paleo recipe book
  212. Pingback: lostsaga
  213. Pingback: hotofferbd
  214. Pingback: YouTube,
  215. Pingback: best e cigarette
  216. Pingback: fiverr backlinks
  217. Pingback: viagra
  218. Pingback: Tube Viper X
  219. Pingback: Making Money
  220. Pingback: annuity quotes
  221. Pingback: buy youtube likes
  222. Pingback: free movies
  223. Pingback: minoxidil
  224. Pingback: m88 online casino
  225. Pingback: sex
  226. Pingback: car cd player
  227. Pingback: Kamagra
  228. Pingback: ??δ?σε??
  229. Pingback: Ollie Bottin
  230. Pingback: catch a cheater
  231. Pingback: dressing table
  232. Pingback: Sophia hills
  233. Pingback: Orginal Source
  234. Pingback: luftaufnahme
  235. Pingback: Begum Law Firm
  236. Pingback: blind dogs
  237. Pingback: License
  238. Pingback: Detroit
  239. Pingback: Optimax Reviews
  240. Pingback: New Songs 2014
  241. Pingback: relationship
  242. Pingback: Deals
  243. Pingback: Coupon Codes
  244. Pingback: Discount codes
  245. Pingback: free forums
  246. Pingback: Discounts
  247. Pingback: Ultralase Reviews
  248. Pingback: Keith Appleby
  249. Pingback: here
  250. Pingback: healthy snacks
  251. Pingback: sick of law suits
  252. Pingback: sports
  253. Pingback: Shaahin Cheyene

Leave a Reply