recentpopularlog in

ianweatherhogg : csv   73

Processing Large CSV files with Elixir Streams
Elixir Streams are extremely powerful when we need to process large CSV files. Let's see the difference between a greedy and lazy approach.
elixir  stream  file  csv  bitcoin  data  chunk  compose 
february 2019 by ianweatherhogg
Towards GPGPU JSON parsing | Raph Levien’s blog
The amount of computing resources available on general purpose GPU hardware is vastly greater than in scalar CPUs. A continuing trend is to move computation from CPU to GPGPU. Some computations (most 3D graphics operations, many machine learning tasks) can be expressed efficiently in terms of primitives that GPUs offer. However, tasks such as JSON parsing are traditionally considered as serial algorithms and are not often implemented on GPU.
gpu  rust  csv  json  parser 
october 2018 by ianweatherhogg
Best approach to handling large CSV file? : Python
I have a large csv file I need to edit and run some statistical analysis on several attributes. What is the best way to handle this without...
reddit  python  csv  big  file 
september 2016 by ianweatherhogg
Question about tackling csv files that are about 1.5 GB. : Python
I was planning on using the Pandas library (specifically DataFrame objects) and Numpy to do some analytic work on this data I have, but ipython...
reddit  python  big  file  csv 
october 2015 by ianweatherhogg
the-art-of-command-line - Master the command line, in one page
github  bash  command  line  debug  network  json  csv  tool  resource 
june 2015 by ianweatherhogg
24 days of Rust - csv |
Zbigniew Siciarz - Python and Django programmer, webdeveloper, open standards enthusiast. I make the internetz.
rust  csv 
june 2015 by ianweatherhogg
Data Science at the Command Line
We data scientists love to create exciting data visualizations and insightful statistical models. However, before we get to that point, usually much effort goes into obtaining, scrubbing, and exploring the required data. The command line, although invented decades ago, is an amazing environment for performing such data science tasks. By combining small, yet powerful, command-line tools you can quickly explore your data and hack together prototypes. New tools such as parallel, jq, and...
bash  command  line  tool  5*  csv  curl  json  parser  parallel  r  screen  scraping  sed  ssh  sequence  xml 
december 2014 by ianweatherhogg
Parking in Westminster: An Analysis in Haskell | Idontgetoutmuch's Weblog
I had a fun weekend analysing car parking data in Westminster at the Future Cities Hackathon along with Amit Nandi Bart Baddeley Jackie Steinitz Ian Ozsvald Mateusz Łapsa-Malawski Apparently in the world of car parking where Westminster leads the rest of UK follows. For example Westminster is rolling out individual parking bay monitors. Our analysis…
haskell  data  analytics  csv  big  file  date  parser  literal 
november 2014 by ianweatherhogg
textql - Execute SQL against structured text like CSV or TSV
go  sql  select  csv 
february 2014 by ianweatherhogg
el-csv - Parse CSV data in elisp
csv  emacs  mode  github 
november 2013 by ianweatherhogg

Copy this bookmark:

to read