Hack/Reduce Ottawa: Shopping & Dating Hacks

We had an excellent Hack/Reduce event again this weekend in Ottawa. Our knowledge has been expanded again, we now know how desperate daters can get and at what time people do their online shopping among other things.

In order to get all the tech to work and keep the clusters humming a lot of coffee and pizza was consumed. I would be afraid to calculate how much.

Most importantly, we saw a lot of great Hack/Reductions by the participants. Actually, first and foremost it was a great weekend for the Hack/Reduce team again – the best way to spend a Saturday – for real! Thanks!

We want to thank all the participants who made it out and the sponsors of course: Hopper, Infoglutton and Shopify.

Here’s a short description of some of the presentations we saw:


Jean-Claude Batista (@jcbatista) , Taswar Bhati (@taswarbhatti) , Joel Sachs, Andrew Clunis (@orospakr), (Petro Verkhogliad)

The Hackify team worked on the shopify dataset with information about US Shopify orders. The team used Ruby and the streaming api.

Firstly, the team analyzed where people shop the most. Naturally, the answer was California (largest state).
Second, the team wanted to find the date when people had shopped the most, which was on August 19th between noon and 6pm ($185891).

The team concluded that using Ruby with the streaming api makes it easy to do map/reduce and that Hadoop is cool!


Petro Verkhogliad (@vpetro)

Petro first worked with the Hackify team but then turned to using Python which he was more familiar with. Petro also analyzed the Shopify shopping data.

Petro found that people shop the most at 9am in the morning and 9pm in the evening. The most popular shopping day is Friday with Saturday as a close second.

Geographically most shopping is done by Californians ordering from California.


Rod Dunne, Marc Lepage, Mohamed Mansour (@mohamedmansour) , Alexis Brunet

Code: https://github.com/mlepage/HackReduce

Team-RIM was voted as winner by the participants. They worked on the google n-grams data and the Amazon review data. First, the team calculated the amount of alliterative 2-grams by letter per year. They also calculated the amount of alliterative 2-grams by letter per year.

For the amazon review data, team-RIM calculated the average rating given on specific dates calculated over all of the years in the dataset. You can see that all products are almost given a rating of 4. You can also notice that right after christmas the ratings drop off, ie. people give worse review right after christmas.

The amazon dataset also includes data over how useful reviews are. The reviews can be voted up or down on amazon by users. Team-RIM analyzed this data and came to the conclusion that reviews that give a higher rating to a product are considered more useful.
The team also analyzed the usefulness of reviews based on the review length. From the picture we can see that 50-60 character reviews are considered most useful. As a bonus, the team calculated that products received worse reviews as time went by.

Pascal – Analysis of the most desperate daters

Pascal from Hopper wanted to find the most desperate daters. He analyzed the amount of profile views by users. According to his analysis, some users are checking so many profiles that with a 30-second timeframe it amounts to full-time work. (~17k views per month… Which amounts to something like 60 profile views every working hour…)

Pascal also found the most visited profiles.

Lastly, Pascal analyzed how users use the Mate1 site. The results were quite surprising, as 23% of users only view one other profile. 65% only ever check 10 profiles.


JF (@jeanfrancoisim) from Hopper also analyzed the dating dataset.

First, JF mapped the birth year of users to their hotness by gender. JF calculated hotness with the following formula: (msgs received+msgs sent) * ((msgs received+10)/(msgs sent+10)).

The red dots represent women and blue dots men. We can clearly see that the woman demographic is all in all younger. I’m afraid to draw any other conclusions from the results…

Next JF mapped hotness and height by gender. You could easily see that men are taller than women but it is unclear if height directly influences hotness.

As a last analysis JF mapped income to hotness. Most people answered “rather not say” to this question, why most datapoints are in the second column. It’s also unclear if income influences hotness.


Steven Noble (@snoble), Chris Saunders(@chris_saunders) , David Underwood (@davefp)

The XKCD team wanted to test the internet “truism” that has been said in a xkcd comic: “Wikipedia trivia: if you take any article, click on the first link in the article text not in parentheses or italics, and then repeat, you will eventually end up at “Philosophy”

The team didn’t really end up with a result for this since it turned out to be difficult to only include the actual article content and not all of the other links on the page. They started their work in Clojure but later ended up using java instead.

Team Dating 8

Martin Samson (@pgdown) , Edgar Acosta, David Germain

Team 8 explored the dating dataset with the goal of measuring popularity/hotness and correlating it to other factors.
The team started by analyzing some basic measures for profiles.

They created their own popularity formula.

The team made some nice graphs mapping times listed vs. messages received, times listed vs. profile views, popularity vs. number of times viewed..

The team used streaming with Python and fought with it for a while. Lesson: Do not use the same file name for the mapper and the reducer scripts.

Learnt: Do not use the same file name for the mapper and reducer scripts.

Team weather and crime

Richard Desmarais, Chris Camden, Philippe Savoie, Ryan McLeod, Eric Ax, Manuel Belmadani (@pragmatwit)

The weather and crime team created a web interface that could answer queries such as “What is the maximum temperature in january 2007”. When the search query is launched it will run through the dataset and give you the answer. The team used python streaming.

Team UOttawaNLP + others

Chris Fournier (@cfournie ), Oana Frunza, Alistair Kennedy, Russell Luo, Dominic Plouffe (@dplouffe )

Team UOttawa analyzed the sentiment of the Amazon reviews. As expected, there were clear differences in sentiment between the good and the bad reviews.


In the end, we let the participants vote for the best Hack/Reduction. Team-RIM with their n-grams and Amazon analyses took the win… Congrats!


Thanks to everyone for coming, the Hack/Reduce team had a great time and it was amazing to meet you all. We hope you keep hacking and we hope we’ll see you next time!


Enhanced by Zemanta

722 thoughts on “Hack/Reduce Ottawa: Shopping & Dating Hacks”

  1. Pingback: visit usmore here
  2. Pingback: Prostate Cancer
  3. Pingback: Kids
  4. Pingback: viral stories
  5. Pingback: NeelasNapa
  6. Pingback: cuba sms
  7. Pingback: Walton Dade
  8. Pingback: NJ online casino
  9. Pingback: art deco
  10. Pingback: Halon Extinguisher
  11. Pingback: Commercial Exhaust
  12. Pingback: receive sms
  13. Pingback: State wid quote
  14. Pingback: maykool 15% Off
  15. Pingback: nails fungal
  16. Pingback: diet detox
  17. Pingback: wypozycjonowanie
  18. Pingback: e cigarette kits
  19. Pingback: e cig
  20. Pingback: bron wiatrowa
  21. Pingback: Hotel
  22. Pingback: free credit score
  23. Pingback: Del Huelle
  24. Pingback: identity theft
  25. Pingback: China Travel
  26. Pingback: $0.75 ebooks
  27. Pingback: click here
  28. Pingback: website
  29. Pingback: cambogia extract
  30. Pingback: read more
  31. Pingback: vapor cigarettes
  32. Pingback: vapor cigarettes
  33. Pingback: Read This
  34. Pingback: intruder alarm
  35. Pingback: muchas noticias
  36. Pingback: Austin Local SEO
  37. Pingback: index
  38. Pingback: property updates
  39. Pingback: woodworker
  40. Pingback: cuentos
  41. Pingback: cuentos clasicos
  42. Pingback: plomberie paris
  43. Pingback: H AND R login info
  44. Pingback: profisfinanse.pl
  45. Pingback: Cindy Crawford
  46. Pingback: seo-superior.com
  47. Pingback: pixelitas.com
  48. Pingback: dentrepairhelp.com
  49. Pingback: Marc Sparks
  50. Pingback: ilahi dinle
  51. Pingback: my blog
  52. Pingback: dieta
  53. Pingback: informacion veraz
  54. Pingback: Dallas SEO Company
  55. Pingback: sochi 2014 1
  56. Pingback: read review
  57. Pingback: Where can i buy
  58. Pingback: Cooper
  59. Pingback: Where can i buy
  60. Pingback: fannie freddie mac
  61. Pingback: Genesis
  62. Pingback: my blog
  63. Pingback: one hour e loans
  64. Pingback: cash for you loan
  65. Pingback: money assistance
  66. Pingback: click here
  67. Pingback: Trackback
  68. Pingback: sam waltonman
  69. Pingback: mobile development
  70. Pingback: vladislav davidzon
  71. Pingback: Trackback
  72. Pingback: crossinvest
  73. Pingback: mailbox yellow
  74. Pingback: vigrx plus reviews
  75. Pingback: iherb coupons
  76. Pingback: iherb coupon
  77. Pingback: clik here
  78. Pingback: canape cuir design
  79. Pingback: clik here to view
  80. Pingback: Slot Machine
  81. Pingback: Mltd Coupon
  82. Pingback: permaculture
  83. Pingback: Trackback...
  84. Pingback: seo services
  85. Pingback: Angry Birds Epic
  86. Pingback: buy cialis
  87. Pingback: sex on cams
  88. Pingback: credit reports
  89. Pingback: cheap sunglasses
  90. Pingback: Show box
  91. Pingback: cialis montreal
  92. Pingback: optimization
  93. Pingback: Discover More Here
  94. Pingback: search for hotels
  95. Pingback: plombier paris 5
  96. Pingback: plombier paris
  97. Pingback: Logo design
  98. Pingback: Health
  99. Pingback: Delhi Escorts
  100. Pingback: clean
  101. Pingback: penile hydro pump
  102. Pingback: Finance
  103. Pingback: Psoriasis ointment
  104. Pingback: rental cars
  105. Pingback: Liberty
  106. Pingback: hairy anus
  107. Pingback: mark cobb
  108. Pingback: ionized water
  109. Pingback: Trading
  110. Pingback: island
  111. Pingback: gopro
  112. Pingback: iherb coupon code
  113. Pingback: read this article
  114. Pingback: Business
  115. Pingback: workout obsession
  116. Pingback: healthy diet plan
  117. Pingback: Camp
  118. Pingback: Porn
  119. Pingback: product key
  120. Pingback: Technology
  121. Pingback: poplar table
  122. Pingback: zeolite detox
  123. Pingback: about this
  124. Pingback: software
  125. Pingback: pastor carter
  126. Pingback: Primerica scam
  127. Pingback: Diindolylmethane
  128. Pingback: Fashion
  129. Pingback: Best Dance Music
  130. Pingback: water ionizers
  131. Pingback: led bulbs
  132. Pingback: Download Porn
  133. Pingback: find out more
  134. Pingback: MQL Programmer
  135. Pingback: bentyl uses
  136. Pingback: home design
  137. Pingback: ppi claim
  138. Pingback: Sarasota SEO
  139. Pingback: kratom extrakt
  140. Pingback: e-liquid
  141. Pingback: Financial
  142. Pingback: wooden windows
  143. Pingback: LACAN
  144. Pingback: Core Products
  145. Pingback: class d airspace
  146. Pingback: smartphone
  147. Pingback: Click here
  148. Pingback: exercise
  149. Pingback: magazin online
  150. Pingback: LINK M88
  151. Pingback: great post to read
  152. Pingback: kangen
  153. Pingback: bhw
  154. Pingback: skin tags
  155. Pingback: help moppy
  156. Pingback: liposuction cost
  157. Pingback: mini
  158. Pingback: stallions for sale
  159. Pingback: Praca za granica
  160. Pingback: Brody
  161. Pingback: Gelesis Pill
  162. Pingback: Energy Booster
  163. Pingback: costa rica reisen
  164. Pingback: acne quístico
  165. Pingback: birmingham hotels
  166. Pingback: world gossip newsm
  167. Pingback: making
  168. Pingback: ionized water
  169. Pingback: ebay japan
  170. Pingback: berita hari ini
  171. Pingback: umowa zlecenie
  172. Pingback: waclaw berent
  173. Pingback: Drukarnia Madimo
  174. Pingback: Amddram
  175. Pingback: Stars du foot
  176. Pingback: twitter
  177. Pingback: Sexy Nightwear
  178. Pingback: Bail Bonds Jail
  179. Pingback: great post to read
  180. Pingback: M88
  181. Pingback: Wp Weekend Phoenix
  182. Pingback: her imports
  183. Pingback: Green tea
  184. Pingback: Joyería
  185. Pingback: Easy Recovery
  186. Pingback: Clicking Here
  187. Pingback: ice age 2 movie
  188. Pingback: London
  189. Pingback: NCWISE Login
  190. Pingback: cataclysm
  191. Pingback: Bitcoin VPS
  192. Pingback: hop over to here
  193. Pingback: Dallas remodel
  194. Pingback: jak dbac o siebie
  195. Pingback: meble do szkoly
  196. Pingback: elblag noclegi
  197. Pingback: 3d pen
  198. Pingback: Marjory Wildcraft
  199. Pingback: ksiegowosc kraków
  200. Pingback: jak sie robi sushi
  201. Pingback: Learn More
  202. Pingback: mice at home
  203. Pingback: suaradotcom
  204. Pingback: Kommode
  205. Pingback: gdc home interiors
  206. Pingback: visit the website
  207. Pingback: profit secrets
  208. Pingback: News
  209. Pingback: Bariatric Surgery
  210. Pingback: water ionizers
  211. Pingback: Out Of The Box SEO
  212. Pingback: havearkitekt
  213. Pingback: astro headsets
  214. Pingback: Read This
  215. Pingback: rich topup
  216. Pingback: jobs at mcdonalds
  217. Pingback: tabasco
  218. Pingback: size extender
  219. Pingback: lose weight fast
  220. Pingback: daily news
  221. Pingback: canadian pharmacy
  222. Pingback: tabasco
  223. Pingback: Inspiration
  224. Pingback: Cheap Viagra
  225. Pingback: website hosting
  226. Pingback: sacred 3 trainer
  227. Pingback: vidcommx review
  228. Pingback: great site
  229. Pingback: Free Expendables 3
  230. Pingback: this link,
  231. Pingback: http://lechtim.pl
  232. Pingback: sacred 3 trainer
  233. Pingback: szkolenie bhp
  234. Pingback: Skin Care
  235. Pingback: Nepal News
  236. Pingback: buying cds online
  237. Pingback: Explore more at
  238. Pingback: Copenhagen
  239. Pingback: Williams Law Group
  240. Pingback: travel guides
  241. Pingback: newsday
  242. Pingback: stress management
  243. Pingback: trenddoll.com
  244. Pingback: task tracking
  245. Pingback: their site
  246. Pingback: diagwnismos
  247. Pingback: balance your life
  248. Pingback: antalya escort
  249. Pingback: dildo
  250. Pingback: arkitekter
  251. Pingback: website seo
  252. Pingback: kargo
  253. Pingback: stainless tweezers
  254. Pingback: website
  255. Pingback: Tanning Lotion
  256. Pingback: phone repair
  257. Pingback: amour
  258. Pingback: cunt with big dick
  259. Pingback: withdrawal ease
  260. Pingback: paddle hair brush
  261. Pingback: goarticles
  262. Pingback: paleo recipe book
  263. Pingback: inherited
  264. Pingback: buy youtube views
  265. Pingback: used-generators
  266. Pingback: banned commercials
  267. Pingback: Isabelle
  268. Pingback: Ultrasonic
  269. Pingback: pineapple smoothie
  270. Pingback: katalog stron
  271. Pingback: tanktop
  272. Pingback: kantor internetowy
  273. Pingback: my knee scooter
  274. Pingback: neuk hoer in
  275. Pingback: Health Articles
  276. Pingback: Demir Furniture
  277. Pingback: Max Keiser
  278. Pingback: of pregnancy
  279. Pingback: weight loss pills
  280. Pingback: 10 best diet pills
  281. Pingback: computer sales
  282. Pingback: best pay day loans
  283. Pingback: buiten trappen
  284. Pingback: fiverr backlinks
  285. Pingback: directory
  286. Pingback: criminal lawyer
  287. Pingback: Making Money
  288. Pingback: garage epoxy
  289. Pingback: tragos
  290. Pingback: Appliance
  291. Pingback: jobs
  292. Pingback: LA CAN
  293. Pingback: zobu implantu cena
  294. Pingback: ??δε????σα
  295. Pingback: Coy Cranker
  296. Pingback: tv production
  297. Pingback: silicone needles
  298. Pingback: Invention
  299. Pingback: Hermine Demar
  300. Pingback: sigma
  301. Pingback: Promotional Codes
  302. Pingback: Deals
  303. Pingback: ENG210EXT review
  304. Pingback: Discount codes
  305. Pingback: shemale webcams
  306. Pingback: backlink checker
  307. Pingback: sports
  308. Pingback: Tech Support
  309. Pingback: computers
  310. Pingback: Dating Love
  311. Pingback: poor
  312. Pingback: renting a flute
  313. Pingback: silver flutes
  314. Pingback: Bogota
  315. Pingback: partagas cigars
  316. Pingback: yaki onigiri
  317. Pingback: habanos
  318. Pingback: Nolasco
  319. Pingback: pai de santo
  320. Pingback: Sukneles
  321. Pingback: bestine
  322. Pingback: cigar
  323. Pingback: cialis 20mg avis
  324. Pingback: rat zapper
  325. Pingback: Lookup by Phone
  326. Pingback: buy cuban cigars
  327. Pingback: numbers

Comments are closed.