recentpopularlog in

ianweatherhogg : big   67

Backpressuring in Streams | Node.js
Node.js® is a JavaScript runtime built on Chrome's V8 JavaScript engine.
node  stream  back  pressure  big  file  pipe  5* 
april 2019 by ianweatherhogg
Best approach to handling large CSV file? : Python
I have a large csv file I need to edit and run some statistical analysis on several attributes. What is the best way to handle this without...
reddit  python  csv  big  file 
september 2016 by ianweatherhogg
A Billion Taxi Rides on Amazon EMR running Spark
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, Postgres, Spark, Python & More...
spark  amazon  elastic  map  reduce  configuration  hive  big  data  cloud 
april 2016 by ianweatherhogg
Question about tackling csv files that are about 1.5 GB. : Python
I was planning on using the Pandas library (specifically DataFrame objects) and Numpy to do some analytic work on this data I have, but ipython...
reddit  python  big  file  csv 
october 2015 by ianweatherhogg
Project Tungsten: Bringing Spark Closer to Bare Metal | Databricks blog
Project Tungsten focuses on improving the performance of Spark applications, pushing it closer to the limits of hardware.
spark  big  data  java 
may 2015 by ianweatherhogg
Create huge files on Linux | Regular Expressions
Tools to create large files on Linux or empty them.
linux  file  generator  dd  big 
december 2014 by ianweatherhogg
Introduction | H2O World Training
Full day of immersive training with H2O.
book  deep  learn  machine  big  data 
november 2014 by ianweatherhogg
Parking in Westminster: An Analysis in Haskell | Idontgetoutmuch's Weblog
I had a fun weekend analysing car parking data in Westminster at the Future Cities Hackathon along with Amit Nandi Bart Baddeley Jackie Steinitz Ian Ozsvald Mateusz Łapsa-Malawski Apparently in the world of car parking where Westminster leads the rest of UK follows. For example Westminster is rolling out individual parking bay monitors. Our analysis…
haskell  data  analytics  csv  big  file  date  parser  literal 
november 2014 by ianweatherhogg
Handling Large Data File Using Scala and Akka | Knoldus
We needed to handle large data files reaching size Gigabytes in scala based Akka application of ours. We are interested in reading data from the file and then operating on it. In our application a single line in a file forms a unit of data to be worked upon. That means that we can only…
big  data  file  scala  akka 
february 2014 by ianweatherhogg

Copy this bookmark:





to read