recentpopularlog in

tsuomela : data-collection   41

Data use regulation: The libertarian push behind a new take on privacy.
"The newfound support of privacy regulation among big businesses masks a radically deregulatory agenda. A regime that only pays attention to use erects a Potemkin Village of privacy. From a distance, it looks sound. But living within it we will find no shelter from the sun or rain."
data  ethics  privacy  law  regulation  collecting  data-collection 
september 2014 by tsuomela
Welcome to the Data Documentation Initiative | DDI - Data Documentation Initiative
"Welcome to the Data Documentation Initiative A metadata specification for the social and behavioral sciences  Use DDI to: Document your data across the life cycle Interoperate with others Do Data Intelligently (DDI)!"
data-collection  data  management  social-science  metadata  specification  documentation  xml 
february 2013 by tsuomela
Premium Twitter Data from Gnip
Gnip has offered easy access to Twitter’s free data streams and dozens of other social media feeds since 2008. In November 2010, Gnip became the first authorized reseller of Twitter data.
twitter  social-networks  research  analytics  data-collection  data-sources 
june 2012 by tsuomela
EOSDIS - Earth Data Website
EOSDIS enables the collection, processing, archive and distribution of Earth science data.
data  data-collection  data-curation  infrastructure  science  climate  environment  earth-science  nasa 
june 2012 by tsuomela
National Snow and Ice Data Center (NSIDC)
The National Snow and Ice Data Center (NSIDC) supports research into our world's frozen realms: the snow, ice, glaciers, frozen ground, and climate interactions that make up Earth's cryosphere.

NSIDC manages and distributes scientific data, creates tools for data access, supports data users, performs scientific research, and educates the public about the cryosphere.
data  data-collection  data-curation  infrastructure  science  climate  cryosphere  precipitation  environment  ice  meteorology 
june 2012 by tsuomela
Assessing citizen science data quality: an invasive species case study - Crall - Conservation Letters - Wiley Online Library
An increase in the number of citizen science programs has prompted an examination of their ability to provide data of sufficient quality. We tested the ability of volunteers relative to professionals in identifying invasive plant species, mapping their distributions, and estimating their abundance within plots. We generally found that volunteers perform almost as well as professionals in some areas, but that we should be cautious about data quality in both groups. We analyzed predictors of volunteer success (age, education, experience, science literacy, attitudes) in training-related skills, but these proved to be poor predictors of performance and could not be used as effective eligibility criteria. However, volunteer success with species identification increased with their self-identified comfort level. Based on our case study results, we offer lessons learned and their application to other programs and provide recommendations for future research in this area.
citizen-science  biology  ecology  data-collection  accuracy  research 
july 2011 by tsuomela
d8taplex
"d8taplex is a resource for finding and manipulating data from the web."
data-collection  data  visualization  time-series 
april 2011 by tsuomela
Scrapy | An open source web scraping framework for Python
"Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing."
web-programming  programming  python  library  scraping  data-collection  online 
march 2011 by tsuomela
earthsensors.txt
" We are now interconnected enough for amateur scientists and hobbyists to help professional scientists with sensors scattered over the earth collecting data. "
citizen-science  distributed  data-collection  data  earth-science 
march 2011 by tsuomela
The 70 Online Databases that Define Our Planet - Technology Review
So in the interests of stimulating this debate, I'm reproducing here Helbing's list of websites that are potential sources of data for an Earth Simulator. It makes for fascinating, if unnerving, reading:
data  data-collection  earth  simulation 
december 2010 by tsuomela
SocialSci | Further Science!
SocialSci connects researchers with a global online community to make real scientific discoveries. Take a study, further science, and get paid while you’re at it!
social-science  research  crowdsourcing  collaboration  citizen-science  internet  data-collection  online  survey  psychology 
december 2010 by tsuomela
The golden age (is ending) | Cosmic Variance | Discover Magazine
As has been oft remarked on this blog, we are in a golden age of astrophysics and cosmology. The data is pouring down from the heavens, in large part from 14 state-of-the-art NASA space telescopes. However, this cornucopia of astronomy is about to come to a crashing stop. We are at the high-water mark, and the next few years are going to see a rapid decline in the number of observatories in space. In five years most, if not all, of these telescopes will be defunct (WMAP is already in the graveyard), and it’s not clear what will be replacing them.
astronomy  astrophysics  physics  observatory  space  data-collection  history  funding 
october 2010 by tsuomela
Datamob: Public data put to good use
Public data put to good use. - Datamob aims to show, in a very simple way, how public data sources are being used.

Our listings emphasize the connection between data posted by governments and public institutions and the interfaces people are building to explore that data.
data  visualization  statistics  technology  internet  public  data-sources  data-collection  api  open-government  public-data 
april 2010 by tsuomela
Digital Curation Centre: Digital Curation Tools: Audit & Certification of Digital Repositories
The Data Audit Framework (DAF) provides organisations with the means to identify, locate, describe and assess how they are managing their research data assets. DAF combines a set of methods with an online tool to enable data auditors to gather this information. DAF will help ensure that research data produced in UK Higher Education Institutions is preserved and remains accessible in the long term.
data-curation  science  data-collection  academic 
november 2009 by tsuomela
Announcing the Public Terabyte Dataset project « Elastic Web Mining | Bixolabs
We’re very excited to announce the Public Terabyte Dataset project.

This is a high quality crawl of top web sites, using AWS’s Elastic Map Reduce, Concurrent’s Cascading workflow API, and Bixolab’s elastic web mining platform.
web  data-collection  crawl 
november 2009 by tsuomela
GraphClick - Graph and Movie Digitizer for Mac OS X - Free Download
You have the picture of a graph but not the corresponding data? You want to retrieve the trajectory of an object from a QuickTime movie? GraphClick is then simply the best way to solve the problem! You just have to click on the image and the obtained coordinates of the points can be directly exported into any other application.
macintosh  software  graphics  graphing  data-collection 
august 2009 by tsuomela
Irreplaceable data : The Book of Trogool
A hierarchy of needs for data-curation: acquisition, physical medium, bitrot, format viability, usability, fidelity to original.
data-curation  data-collection  scholarly-communication  preservation  archive 
july 2009 by tsuomela
U.S. Global Change Research Information Office
Since 1993, disseminating scientific research information useful in preventing, mitigating, or adapting to the effects of global change.
global-warming  government  data-collection  research  federal 
june 2009 by tsuomela
[0906.0485] First results from the PARSE.Insight project: HEP survey on data preservation, re-use and (open) access
There is growing interest in the issues of preservation and re-use of the records of science, in the "digital era". The aim of the PARSE.Insight project, partly financed by the European Commission under the Seventh Framework Program, is twofold: to provide an assessment of the current activities, trends and risks in the field of digital preservation of scientific results, from primary data to published articles
data-collection  archive  preservation  physics  science  curation 
june 2009 by tsuomela
LittleSis » Profiling the powers that be
LittleSis is an involuntary facebook of powerful Americans, collaboratively edited by people like you.
politics  crowdsourcing  wiki  data-collection  data  networking 
january 2009 by tsuomela
Scrubyt Documentation - File: README
A simple to learn and use, yet very powerful web extraction framework written in Ruby. Navigate through the Web, Extract, query, transform and save relevant data from the Web page of your interest by the concise and easy to use DSL.
programming  library  ruby  web  scraping  data-collection 
december 2008 by tsuomela
Public Data Sets on Amazon Web Services (AWS)
Public Data Sets on AWS provides a centralized repository of public data sets that can be seamlessly integrated into AWS cloud-based applications. AWS is hosting the public data sets at no charge for the community, and like all AWS services, users pay only for the compute and storage they use for their own applications.
public-data  open-access  data-mining  data-processing  data-collection  public  commons 
december 2008 by tsuomela
McIDAS
Welcome to the McIDAS Website. In existence since 1973, McIDAS (Man computer Interactive Data Access System) is a suite of sophisticated software packages that perform a wide variety of functions with satellite imagery, observational reports, numerical forecasts, and other geophysical data. Those functions include displaying, analyzing, interpreting, acquiring and managing the data.
meteorology  data-collection  data-processing  satellite  imagery  remote-sensing  gis  weather  software 
december 2008 by tsuomela

Copy this bookmark:





to read