recentpopularlog in
« earlier  
Google Cloud Status Dashboard
On Tuesday, 17 July 2018, customers using Google Cloud App Engine, Google HTTP(S) Load Balancer, or TCP/SSL Proxy Load Balancers experienced elevated error rates ranging between 33% and 87% for a duration of 32 minutes. Customers observed errors consisting of either 502 return codes, or connection resets. We apologize to our customers whose services or businesses were impacted during this incident, and we are taking immediate steps to improve the platform’s performance and availability. We will be providing customers with a SLA credit for the affected timeframe that impacted the Google Cloud HTTP(S) Load Balancer, TCP/SSL Proxy Load Balancer and Google App Engine products.
cloud  outage  google 
6 minutes ago
Redfin, Opendoor, Zillow and the Great iBuyer Game
A few weeks ago, Zillow put its first home under contract as a seller in Phoenix, consummating its entry into the “iBuyer” space. Zillow joins a fleet of competitors—including Opendoor, Offerpad, Knock and Redfin Now—that let home sellers close in days instead of months by directly buying homes at a (mostly) fair price and flipping them back on the market.

There are now multiple iBuyers operating in Phoenix, including Opendoor, Offerpad and Zillow. In a previous analysis, I noted some of the reasons why certain markets appeal to iBuyers: homogenous inventory and high transaction volume to maximize the accuracy of the automated valuation models (AVMs) that generate the offers, warm weather to minimize climate-related rehab surprises, and low taxes to reduce transfer and holding costs.
3 hours ago
Google Cloud Platform Blog: Introducing commercial Kubernetes applications in GCP Marketplace
Popular open-source Kubernetes apps available now
In addition to our new commercial offerings, GCP Marketplace already features popular open-source projects that are ready to deploy into Kubernetes. These apps are packaged and maintained by Google Cloud and implement best practices for running on Kubernetes Engine and GCP. Each app includes clustered images and documented upgrade steps, so it’s ready to run in production.
enterprise  gcp  kubernetes 
18 hours ago
GitHub - ansible/ansible-jupyter-kernel: Jupyter Notebook Kernel for running Ansible Tasks and Playbooks
The Ansible Jupyter Kernel adds a kernel backend for Jupyter to interface directly with Ansible and construct plays and tasks and execute them on the fly.
ansible  jupyter 
19 hours ago
Growing A Brand to $1.1M/month at 23 Years Old - Starter Story
What platform/tools do you use for your business?
Sales Platform: Shopify

Email Marketing: Klaviyo

Email Capture: Spin-a-Sale

Ambassador Program:

Sales Tax: Avalara

Backorders: Back in Stock Alerts

DPA/Retargeting Ads: Flexify (for our product feed)

Fulfillment: ShipMonk

Customer Service: Slack channels for internal communication and ZenDesk for customer communication
startup  Business 
macOS VPN architecture from System Preferences down to nesessionmanager
macOS 10.13 contains a built-in VPN client that natively supports L2TP over IPSec as well as IKEv2.

In this post I describe some parts of the internal architecture of the macOS VPN client. This information will be used in a following article to build an application that replicates some functionalities of the VPN status in the menu bar. This application will also allow to auto connect to an IKEv2 VPN service, something that is currently not possible on macOS.

For Apple employees reading this blog post, you can find my bug report 41950946: scutil doesn't support IKEv2 VPN services here: rdar://41950946.

Please note that I describe undocumented internal APIs of macOS 10.13.5. Apple could change the implementation at any time. The notes below could become outdated and I give no guarantee that it is completely accurate.
Mac  MacOS  VPN  networking 
Google Cloud Filestore is a Cloud NAS with NFSv3
There are two tiers, a $0.20 per GB month standard tier and a $0.30 per GB month premium tier. Both can handle up to 64TB shares but the premium version caps out at 700MB/s while the standard offering is a 180MB/s offering, or about the speed of a single rotating 3.5″ disk.
GCP  storage  NFS  cloud 
2 days ago
Supercharging the Git Commit Graph IV: Bloom Filters – Microsoft DevOps Blog
We’ve been discussing the commit-graph feature in Git 2.18 and how we can use generation numbers to accelerate commit walks. One area where we can get significant speedup is when presenting output in topological order. This allows us to walk a much smaller list of commits than before. One place where this breaks down is when we apply a filter to our results.

For instance, if we filter by a path, then we are asking for a set of commits that modified that path. The following Git command returns the commits that changed “The/Path/To/My/File.txt” in the master branch:
git  bloomfilter  performance 
2 days ago
Designing a GraphQL API · GitHub
Welcome! This document will walk you through designing a new GraphQL API (or a new piece of an existing GraphQL API). API design is a challenging task that strongly rewards iteration, experimentation, and a thorough understanding of your business domain.
graphql  API 
2 days ago
Harness the Power of Static Site Generators to Create Presentations |
No prior knowledge of Hugo or Reveal.js is required but a basic understanding of how static site generators work will be helpful. I recommend trying this tutorial if you haven’t created a static site before.
hugo  presentation  slides 
2 days ago
How to Analyze Billions of Records per Second on a Single Desktop PC | Clemens' Blog
This article gives an overview of LocustDB [1], a new and extremely fast open-source analytics database built in Rust. Part 1 gives some background on analytical query systems and my goals for LocustDB. Part 2 presents benchmark results produced on a data set of 1.46 billion taxi rides and demonstrates median speedups of 3.6x over ClickHouse and 2.1x over tuned kdb+. Part 3 is an architecture deep dive that follows two SQL statements through the guts of the query engine. Part 4 concludes with random learnings, thoughts on Rust, and other incoherent ramblings.
rust  analytics 
2 days ago
XARs: An efficient system for self-contained executables – Facebook Code
XARs are single, highly compressed files containing all necessary executable dependencies. They execute with the same speed as natively installed applications and are designed to be the fastest way to distribute and execute large Python applications while maintaining maximum compatibility with the existing open source Python ecosystem. XARs can be run from anywhere on the filesystem, and they remove the need for virtual environments as well as worries about modules installed as part of the operating system. Executables simply work, and dependencies are isolated from the machine the system is running on. This creates a performant, hermetically compressed executable for Python packages. In sum, XARs are designed to serve a wide variety of use cases and to perform faster than all other self-contained executable distribution approaches.
deployment  distribution  python 
2 days ago
terriblecode - Easy and Open Website Analytics
Fathom is dead simple site analytics tool that’s open source that you can deploy onto your own infra! It’s built using go and and javascript and it’s source code is available right now on Github.
2 days ago
Guide to Multi-Cloud Backup Solutions
Keeping data in multiple clouds provides a clear advantage for reliability, but it also can provide a cost savings, as well. Using multiple cloud providers can simultaneously provide geographically dispersed backups while taking advantage of the lower storage costs available from competitively-priced cloud providers.

In this post, we take a closer look at solutions that support multiple public clouds and allow you to keep several backup copies in different and dispersed clouds.
cloud  backup  filesystem  storage  archiving 
2 days ago
KidBright32 Board is Thailand's BBC Micro:Bit Equivalent
Just having a board is not sufficient for teaching STEAM, so various courses / tutorials / lessons have been made available on KidBright website (in Thai language), and  KidBright32 board is programmed using visual programming in KidBright IDE, heavily inspired from Scratch, and working in Windows, Linux, and Mac OS. You’ll find KidBright github account with more resources, although some are closed source including KidBright IDE. If you somehow got hold of the board, and you find visual programming is not for you after all, KidBrght32 is also supported in Arduino core for ESP32.
esp8266  esp32  raspi  SoC 
2 days ago
Google AI Blog: Improving Connectomics by an Order of Magnitude
We will continue to improve connectomics reconstruction technology, with the aim of fully automating synapse-resolution connectomics and contributing to ongoing connectomics projects at the Max Planck Institute and elsewhere. In order to help support the larger research community in developing connectomics techniques, we have also open-sourced the TensorFlow code for the flood-filling network approach, along with WebGL visualization software for 3d datasets that we developed to help us understand and improve our reconstruction results.
ai  connectomics 
2 days ago
GraphQL on Postgres | Hasura
Query across tables & views with powerful filtering, pagination and pattern search.

Insert Mutations
Insert single or multiple objects. Make upsert operations on conflict to simplify app logic.

Update Mutations
Update objects based on a condition. Update to Increment/multiply directly.

Delete Mutations
Delete one object or in bulk based on a conditio
postgres  graphql 
3 days ago
GitHub - hasura/graphql-engine: Blazing fast, instant GraphQL APIs on Postgres with fine grained access control
Hasura GraphQL Engine is a blazing-fast GraphQL server that gives you instant GraphQL APIs over Postgres. Hasura helps you build GraphQL apps backed by Postgres or incrementally move to GraphQL for existing applications using Postgres.

Read more at and the docs.
graphql  postgreSQL 
3 days ago
How Image Optimisation Decreased my Website's Page Weight by 62%
Compressing images is all about reducing file size while maintaining an acceptable level of visual quality. To compress the images on my site, imagemin was my tool of choice.

To use imagemin, make sure you have Node.js installed then open a terminal window, cd into your project’s folder and run the following command:
compression  imageProcessing  webdev  node.js 
3 days ago
Building a Node JS interactive CLI – codeburst
In this post, I’ll teach you how to build a CLI that asks some questions and creates a file, based on the answers.
cli  node.js 
3 days ago
How to Learn Ruby on Rails in 2018, the Ultimate Guide - Mix & Go
In a previous post, I’ve covered what Ruby is used for, so I won’t repeat that here. This post is about the Ruby on Rails framework, not the Ruby language.
ruby  rubyonrails 
3 days ago
Building the Operating System for White Box Hardware
Today, we’re releasing our vision for an Open Architecture for a Disaggregated Network Operating System (dNOS). We hope it’s a conversation starter. We want to get hardware and software makers, open source developers, telecom companies, standards bodies and others to others to start thinking about how we can all push this concept forward.
You can read our whitepaper here.
networking  opensource  routing  switching 
3 days ago
Will Amazon White Box Switches Take On Cisco, Juniper & Arista? | Light Reading
"As it does in many other categories, Amazon plans to use price to undercut rivals," according to the report. "The company could price its white-box switches between 70% and 80% less than comparable switches from Cisco, one of the people with knowledge of the program estimated."
trend  networking  Amazon 
3 days ago
6 IDEs you need to know about | Ubuntu blog
Linux has long been a favourite platform with developers due to the rich array of languages and toolchains available. In this article we highlight 6 IDEs that can boost your productivity. Each IDE is just a Snap away so you can easily craft your complete development workstation in seconds. Here are six of the best IDEs every developer should know about and an additional 14 bonus IDEs mentioned throughout the article for you to discover.
IDE  snap  trend 
3 days ago
Graphical environments in the world of IoT | Ubuntu blog
Mir is a system-level implementation of a graphical server that is fast, light, and secure. The Mir graphical stack works across different platforms and driver models and is easy to integrate into many IoT solutions. It was first conceived over 6 years ago as part of an initiative by Canonical to unify the graphical environment across all devices, including desktop, TV, and mobile devices and continues to be developed with new features and modern standards like the Wayland protocol. As Mir is designed specifically with security in mind, the problems that X windows has are not applicable to Mir. Memory and disk space usage is much lower than other solutions making Mir an excellent choice for the IoT.
graphics  Mir 
3 days ago
Istio: The New Open Source Cloud Hotness | Light Reading
Istio provides "networking for microservices," Compton said. It's a layer of infrastructure between a service and the network, also known as a "service mesh."
service  mesh  itsio 
3 days ago
GitHub - mapbox/robosat: Semantic segmentation on aerial and satellite imagery. Extracts features such as: buildings, parking lots, roads, water

RoboSat is an end-to-end pipeline written in Python 3 for feature extraction from aerial and satellite imagery. Features can be anything visually distinguishable in the imagery for example: buildings, parking lots, roads, or cars.

Have a look at

this OpenStreetMap diary post where we first introduced RoboSat and show some results.
this OpenStreetMap diary post where we extract building footprints based on drone imagery in Tanzania.
The tools RoboSat comes with can be categorized as follows:

data preparation: creating a dataset for training feature extraction models
training and modeling: segmentation models for feature extraction in images
post-processing: turning segmentation results into cleaned and simple geometries
Tools work with the Slippy Map tile format to abstract away geo-referenced imagery behind tiles of the same size.
ai  cartography  mapping  gis 
3 days ago
Neil Fraser: Writing: Differential Synchronization
Keeping two or more copies of the same document synchronized with each other in real-time is a complex challenge. This paper describes the differential synchronization algorithm. Differential synchronization offers scalability, fault-tolerance, and responsive collaborative editing across an unreliable network.
algorithms  synchronization  cs 
3 days ago
Modern codecs like AV1 can bring better quality video to the open web
Open source, all the way down
AV1 is well on its way to becoming a viable alternative to patented video codecs. As of June 2018, the AV1 1.0 specification is stable and available for public use on a royalty-free basis. Looking for a deep dive into the specific technologies that made the leap from Daala to AV1? Check out our Hacks post, AV1: next generation video – The Constrained Directional Enhancement Filter.
AV1  video  codec 
4 days ago
SFML is multi-media
SFML provides a simple interface to the various components of your PC, to ease the development of games and multimedia applications. It is composed of five modules: system, window, graphics, audio and network.
multimedia  game  graphics 
4 days ago
96-core NanoPi Fire3 cluster computer blows past RPi rigs in benchmarks
The Odroid-MC1 products are primarily designed to run Docker Swarm. Many of the cluster systems are designed to run Docker or other cloud-based software. Last year Alex Ellis, for example, posted a tutorial on creating a Serverless Raspberry Pi cluster that runs Docker and the OpenFaaS framework. Indeed, as with edge computing devices running modified versions of cloud software, such as AWS Greengrass, cluster computers based on SBCs show another example of how the embedded and enterprise server worlds are interacting in interesting new ways using Linux.
Raspi  cluster  performance  cloud  MPI 
4 days ago
Subjects - OpenStax
And backed by additional learning resources. Review our OpenStax textbooks and decide if they are right for your course. Simple to adopt, free to use. We make it easy to improve student access to higher education.
free  books 
4 days ago
A Decade of Reversal: An Analysis of 146 Contradicted Medical Practices - Mayo Clinic Proceedings
We reviewed 2044 original articles, 1344 of which concerned a medical practice. Of these, 981 articles (73.0%) examined a new medical practice, whereas 363 (27.0%) tested an established practice. A total of 947 studies (70.5%) had positive findings, whereas 397 (29.5%) reached a negative conclusion. A total of 756 articles addressing a medical practice constituted replacement, 165 were back to the drawing board, 146 were medical reversals, 138 were reaffirmations, and 139 were inconclusive. Of the 363 articles testing standard of care, 146 (40.2%) reversed that practice, whereas 138 (38.0%) reaffirmed it.
medicine  reversals 
5 days ago
Understanding vendor lock-in and breaking the cycle - ayush sharma's notes ☕ + 🎧 + 🕹️
So, how do we avoid lock-in?
Short answer? We can’t. We’re always locked in somewhere, even with DIY solutions there are limitations. So the trick is to contain where to be locked-in. There are usually 2 strategies:
devops  lockin 
5 days ago
What is a zero-knowledge proof? | Zero-Knowledge Proofs
What is a zero-knowledge proof?

Zero Knowledge Proofs: An illustrated primer
What are zk-SNARKs?
“The Functionality of zk-SNARK” challenge set in “The Hunting of the SNARK”.
“Probabilistic Proof Systems” course notes
algorithm  cryptography  proof 
5 days ago
How to scale a distributed system (PDF)
What is this, and who’s it for?
Lessons learned from the trenches building distributed systems for 8+ years at Cloudera and in open source communities.
distributed  design  scale 
5 days ago
GitHub - rtr7/router7: pure-Go small home internet router
router7 is a pure-Go implementation of a small home internet router. It comes with all the services required to make a fiber7 internet connection work (DHCPv4, DHCPv6, DNS, etc.).

Note that this project should be considered a (working!) tech demo. Feature requests will likely not be implemented, and see for details about which contributions are welcome.
networking  router  golang 
5 days ago
Graph Data Structures for Beginners | Adrian Mejia Blog
As we saw, Graphs can help to model many real-life scenarios such as airports, social networks, internet and so on. We covered some of most basic algorithms such as Breadth-First Search (BFS) and Depth-First Search (DFS). Also, we talk about implementations trade-offs such as adjacency list and matrix. There are many other applications that we are going to cover in another post such as finding the shortest path between nodes and different exciting graph algorithms.
graphtheory  graphs  graphics  diagram 
6 days ago
Google Cloud Platform - The Good, Bad, and Ugly (It's Mostly Good) - Deps
Google Cloud has created a compelling offering, with a mix of rock-solid infrastructure, plus unique value-added products like Spanner, Pub/Sub, and Global Load Balancing. They’ve been able to learn from what AWS got right and wrong. Their products integrate well together and are simple to understand. The downside to Google’s more deliberate approach is that it can sometimes feel like AWS is not just ahead of GCP, but accelerating away. I’m hopeful that the upcoming Google Cloud Next will bring more parity with AWS’ offerings.

For companies that don’t want to spend a lot of time learning and dealing with the complexities of AWS, I recommend looking at Google Cloud. If I had to start all over again, I would still happily choose Google Cloud.
cloud  google  aws 
6 days ago
YouTube TV goes down during the World Cup | TechCrunch
Croatia scored and the score is now 1-1 against England. If you’re a YouTube TV subscriber, you might not know that because YouTube TV has been down for around 40 minutes. Update: It’s back just in time for extra time. People who pay $40 a month to subscribe to live TV on YouTube are arguably mad. One of the main reasons YouTube TV makes sense is that it lets you watch live sports. You won’t find any soccer match on Netflix or HBO Now after all. YouTube has tweeted about the issue, but this isn’t a quick downtime. As Owen Williams tweeted, if Google can’t keep the live stream up during the World Cup, it’s unclear which company can do it. Maybe our live-streaming future is not ready yet.
cloud  outage  youtube 
7 days ago
Apple's AirPods and Live Listen are a revolution for the hearing impaired — Quartz
They’re one of Apple’s newer products that have an innovative design, are functional, and have the potential to change the way we communicate. In the near term, they could revolutionize how people with hearing loss interact with the world.
Last month, it was reported that Apple would add Live Listen, a feature that allows people to hear conversations in noisy settings, to AirPods later this year. The feature has been around since 2014. It uses the iPhone as a mic and connects to Apple-certified hearing aids to amplify hearing. When the next version of Apple’s key mobile software, iOS 12, is released, AirPod users will have access to the feature, though it’s recommended that those who require hearing aids still use them and not simply rely on AirPods for clarity and amplification.
apple  hearing  accessibility  audio  sound 
8 days ago
GitHub - chubin/ the only cheat sheet you need
the only cheat sheet you need

has simple curl/browser interface;
covers 55 programming languages, several DBMSes, and more than 1000 most important UNIX/Linux commands;
provides access to the best community driven cheat sheets repositories in the world as well as to StackOverflow;
available everywhere, no installation needed;
ultrafast, returns answers, as a rule, within 100 ms;
has a convenient command line client,, that is very advantageous and helpful, though not mandatory;
can be used directly from code editors, without opening a browser and not switching your mental context;
supports a special mode (stealth mode), where it can be used fully invisibly, not even touching a key and not making a sound.
CheatSheet  cli  opensource 
8 days ago
Google Cloud Platform Blog: 7 best practices for building containers
Kubernetes Engine is a great place to run your workloads at scale. But before being able to use Kubernetes, you need to containerize your applications. You can run most applications in a Docker container without too much hassle. However, effectively running those containers in production and streamlining the build process is another story. There are a number of things to watch out for that will make your security and operations teams happier. This post provides tips and best practices to help you effectively build containers.
Docker  sysadmin  devops 
8 days ago
How I Fully Quit Google (And You Can, Too) – Member Feature Stories – Medium
Other Resources
I created this resource not to be an all-encompassing guide but a story of how I was able to quit Google. Here are some resources that show other alternatives. Some are far too technical for me, and others I just didn’t have time to explore.
Localization Lab has a detailed list of open source or privacy-tech projects — some highly technical, others quite user friendly.
Framasoft has an entire suite of mostly open-source Google alternatives, though many are just in French.
Restore Privacy has also collected a list of alternatives.
Google  alternatives  devops  sysadmin 
8 days ago
Docs | PingCAP
TiDB (The pronunciation is: /‘taɪdiːbi:/ tai-D-B, etymology: titanium) is an open-source distributed scalable Hybrid Transactional and Analytical Processing (HTAP) database. It features infinite horizontal scalability, strong consistency, and high availability. TiDB is MySQL compatible and serves as a one-stop data warehouse for both OLTP (Online Transactional Processing) and OLAP (Online Analytical Processing) workloads.
Database  analytics  ETL 
8 days ago
Fathom · simple, trustworthy website analytics
Fathom does just that. It tracks users on a website (without collecting personal data) and give you a non-nerdy breakdown of your top content and top referrers. It does so with user-centric rights and privacy, and without selling, sharing or giving away the data you collect. It's a simple and easy to use for website owners at any technical level.
webdev  analytics  golang 
9 days ago
How to Analyze Billions of Records per Second on a Single Desktop PC | Clemens' Blog
This article gives an overview of LocustDB [1], a new and extremely fast open-source analytics database built in Rust. Part 1 gives some background on analytical query systems and my goals for LocustDB. Part 2 presents benchmark results produced on a data set of 1.46 billion taxi rides and demonstrates median speedups of 3.6x over ClickHouse and 2.1x over tuned kdb+. Part 3 is an architecture deep dive that follows two SQL statements through the guts of the query engine. Part 4 concludes with random learnings, thoughts on Rust, and other incoherent ramblings.
analytics  performance  rust  proglang 
9 days ago
How to Analyze Billions of Records per Second on a Single Desktop PC | Clemens' Blog | Page 4
Finally, I will conclude with various random learnings I acquired while working on LocustDB and give some unsolicited thoughts on Rust. This is not meant to be a comprehensive evaluation of Rust, but rather specific examples where I found Rust to work particularly well (or poorly) on this project. This section is arranged to start off with general learnings and devolve into arcane areas of Rust towards the end. Lest anyone get the wrong impression, let me pre-face this section by saying that I have found Rust to be an incredibly well designed, fun and productive language to work with. Massive kudos to the team at Mozilla and the many external contributors.
rust  proglang 
9 days ago
Fedora CoreOS, Red Hat CoreOS, and the future of Container Linux | CoreOS
Finally, Fedora CoreOS will serve as the community upstream of Red Hat CoreOS. Where Fedora CoreOS will strive to embrace the full range of use cases supported by Container Linux today, Red Hat CoreOS will provide a focused operating system dedicated to enabling deployments of Red Hat OpenShift at scale.
coreos  redhat 
9 days ago
Introducing Lemur – Netflix TechBlog – Medium
Toward Better Certificate Management
Certificate management is not a new challenge, tools like EJBCA, OpenCA, and more recently Let’s Encrypt are all helping to make certificate management easier. When setting out to make certificate management better we had two main goals: First, increase the usability and convenience of procuring a certificate in such a way that would not be intimidating to users. Second, harden the procurement process by generating high strength keys and handling them with care.
Meet Lemur!
Lemur is a certificate management framework that acts as a broker between certificate authorities and internal deployment and management tools. This allows us to build in defaults and templates for the most common use cases, reduce the need for a developer to be exposed to sensitive key material, and provides a centralized location from which to manage and monitor all aspects of the certificate lifecycle.
devops  security  certificate  Lemur 
9 days ago
Google Cloud Platform Blog: Introducing Jib — build Java Docker images better
To address this challenge, we're excited to announce Jib, an open-source Java containerizer from Google that lets Java developers build containers using the Java tools they know. Jib is a fast and simple container image builder that handles all the steps of packaging your application into a container image. It does not require you to write a Dockerfile or have docker installed, and it is directly integrated into Maven and Gradle—just add the plugin to your build and you'll have your Java application containerized in no time.
java  docker  jib 
9 days ago
[no title]
This is a course on the rapid-prototyping of rapid-prototyping machines, covering the theory and practice of digital fabrication. There will be weekly lectures, theory readings, and machine development projects throughout the semester. MAS.863/4.140 (How To Make (almost) Anything) or equivalent experience is required as a prerequisite, including safety training and shop access. Enrollment will be by application.
mit  course  fabrication 
9 days ago
Reinforcement learning’s foundational flaw
Maybe for some very fundamental and general problems (such as the ones young babies deal with) it makes sense to start from scratch and do pure RL, since these problems are so broad it's hard to do anything else. But for the vast majority of problems in AI, there is no clear benefit in starting from scratch; we know what we want the AI agent to learn and can provide demonstrations or instructions for the skill. And in fact, starting from scratch is a primary reason for many of the widely agreed upon limitations of current AI and RL:

Current AI is data-hungry (that is, sample-inefficient – in most cases, massive amounts of data are needed for state of the art AI methods to be useful. This is particularly bad for pure RL techniques; recall how AlphaGo Zero needed millions of games of Go to get to an ELO score of 0, which most people would manage after right away. By definition, learning from scratch is just about the least sample-efficient approach there can be.
Current AI is opaque – in most cases, we have nothing but high-level intuitions about what an AI algorithm learns and how it works. For most AI problems, we want the algorithms to be predictable and explainable; a big neural net that just learns whatever it wants from scratch given just the low level reward signal and maybe an environment model (just how AlphaGo Zero works) is just about the least explainable and predictable approach to learning there can be.
Current AI is narrow – in most cases, the AI models we build can only do one very narrow task and can easily be broken. Learning every single skill from scratch limits the ability to learn anything but one specific thing.
Current AI is brittle – in most cases, our AI models generalize well to unseen inputs only with massive amounts of data and are even then still surprisingly easy to break.
So, we tend to know what we want the AI agent to learn. If the AI agent were a person, we could explain the task and probably provide some tips. But AI agents are not people -- might we do that for an AI agent? Turns out, in quite a few ways. Read on and find out in Part 2.
10 days ago
Browsh is a fully-modern text-based browser. It renders anything that a modern browser can; HTML5, CSS3, JS, video and even WebGL. It can be used from a terminal or from within a normal browser. It's main purpose is to significantly reduce bandwidth and thus both increase browsing speeds and decrease bandwidth costs.
text  browser  html5 
10 days ago
“Breakthrough” algorithm exponentially faster than any previous one | Harvard John A. Paulson School of Engineering and Applied Sciences
“This research is a real breakthrough for large-scale discrete optimization,” said Andreas Krause, professor of Computer Science at ETH Zurich, who was not involved in the research. “One of the biggest challenges in machine learning is finding good, representative subsets of data from large collections of images or videos to train machine learning models.  This research could identify those subsets quickly and have substantial practical impact on these large-scale data summarization problems.”
optimization  cs  algorithms 
10 days ago
» 60 Years of Urban Change
The last half of the 20th Century made a big impact on the urban form of American cities. The most rapid change occurred during the mid-century urban renewal period that cleared large tracts of urban land for new highways, parking, and public facilities or housing projects. Fine-grained networks of streets and buildings on small lots were replaced with superblocks and megastructures. While the period did make way for impressive new projects in many cities, many scars are still unhealed.
We put together these sliders to show how cities have changed over half a century. Select a region to view and click and drag the slider bar as shown in the image to compare cities before and after this period.
urban  cities 
10 days ago
High-power thermoelectric generator utilises thermal difference of only 5°c
According to the Japanese researchers, this experimentally demonstrated a high-power density of 12 microwatts per 1cm2, enough to drive sensors or realise intermittent wireless communication, at a small thermal difference of only 5ºC.
iot  power 
10 days ago
Intel’s Toxic Culture – Monday Note
Who wants to be Intel’s new CEO? The job description should include the impossible task of undoing a company culture that allowed itself to miss the mobile revolution because it thought it couldn’t afford to participate.
10 days ago
Ask HN: What are your favorite statistics and probability textbooks? | Hacker News
I took stats in undergrad, but it was a very rudimentary "push x sequence of buttons on your calculator in y situation" ordeal and left me with less applicable knowledge than I'd like.
Since sometime after graduation, I've taken up serious study of higher-level maths as a hobby. I think it will be most useful in my career if I also have a strong grasp on probability and statistics.

[edit] The suggestions so far have been great, but it occured to me to add that I'm working through Spivak and Apostol right now with Dedekind's essays on the side. Hopefully that gives an idea of the tone/rigor I'm after. Answers to problems is also ideal.
probability  statistics  analytics  books 
10 days ago
Version Control Before Git with CVS
In 2007, Linus Torvalds gave a talk about Git at Google. Git was very new then, so the talk was basically an attempt to persuade a roomful of skeptical programmers that they should use Git, even though Git was so different from anything then available. If you haven’t already seen the talk, I highly encourage you to watch it. Linus is an entertaining speaker, even if he never fails to be his brash self. He does an excellent job of explaining why the distributed model of version control is better than the centralized one. A lot of his criticism is reserved for CVS in particular.

Git is a complex tool. Learning it can be a frustrating experience. But I’m also continually amazed at the things that Git can do. In comparison, CVS is simple and straightforward, though often unable to do many of the operations we now take for granted. Going back and using CVS for a while is an excellent way to find yourself with a new appreciation for Git’s power and flexibility. It illustrates well why understanding the history of software development can be so beneficial—picking up and re-examining obsolete tools will teach you volumes about the why behind the tools we use today.

If you enjoyed this post, more like it come out every two weeks! Follow @TwoBitHistory on Twitter or subscribe to the RSS feed to make sure you know when a new post is out.
git  subversion  culture  history 
10 days ago
Summary - FHIR v3.0.1
FHIR® – Fast Healthcare Interoperability Resources ( – is a next generation standards framework created by HL7. FHIR combines the best features of HL7's v2 , HL7 v3 and CDA product lines while leveraging the latest web standards and applying a tight focus on implementability.

FHIR solutions are built from a set of modular components called "Resources". These resources can easily be assembled into working systems that solve real world clinical and administrative problems at a fraction of the price of existing alternatives. FHIR is suitable for use in a wide variety of contexts – mobile phone apps, cloud communications, EHR-based data sharing, server communication in large institutional healthcare providers, and much more.
FHIR  healthcare  data 
11 days ago
Scalable Data Science With FHIR - Engineering Health
The FHIR standard started as a better way to exchange healthcare data, but it also provides a solid basis for deep analytics and Machine Learning at scale. This post looks at an example from the recent FHIR DevDays conference that does just that. You can also run the interactive FHIR data engineering tutorial used in the conference yourself.

Our first step is to bring FHIR data into a data lake — a computational environment where our analysis can easily and efficiently work through petabytes of data. We’ll look at some patterns for doing so, with concrete examples using the open source Bunsen and Apache Spark projects.
11 days ago
A data cleaner's cookbook - About
About this website

This is version 1 of a cookbook that will help you check whether a data table (defined on the data tables page) is properly structured and free from formatting errors, inconsistencies, duplicates and other data headaches.

All the data-auditing and -cleaning recipes on this website use GNU/Linux tools in a BASH shell and work on plain text files. If your data table is in a spreadsheet or a database, you first need to export the table as a text file, or copy/paste it into a text editor (explained on this page) and save the pasted text as a file.
etl  data 
12 days ago
One cable to rule them all: a look at Apple's retired connectors through the years
There has been a near-constant debate about Apple and the choices it has made with ports and connectors spanning the company's entire history. AppleInsider takes a look back at most of the different ways Apple devices have connected over the years —and what they tell us about the company itself.
apple  history  cable 
12 days ago
The Taming of Chance, from Jeff Watson : Daily Speculations
Here's a free copy of Ian Hacking's scholarly book on the history of probability theory. Much like Clews has a revered place in any spec's library, Hacking's tome should be given the same respect. This is good weekend reading.
probability  book 
12 days ago
Visualization of Road Network Reachability with - GraphHopper Directions API
With the GraphHopper Isochrone API it is possible to create polygons of areas that you can reach from a certain location in e.g. 10 minutes for different modes of transport, like car or walking. This is useful for a number of purposes like finding the best location for a new supermarket or the valuation of a building area. Read more about Isochrone maps at wikipedia.
mapping  gis  routing  webgl  webdev 
12 days ago
Codius - Open-source Hosting Platform for Smart Programs
Peer-to-peer Hosting
There are many ways to host reliable services. But they all require constant maintenance, abandoned projects die.

Codius lets you turn your service into a peer-to-peer network. That means as long as there is one person out there using it, it'll keep running and it'll never be down.

Learn More »

Decentralized Apps
It's great that we have decentralized currencies like Bitcoin. But right now you have to choose between centralized, user-friendly and decentralized, annoying wallets.

With Codius, you can get the full spectrum of decentralization. Choose anything from total centralization to complete distribution.

Learn More »
decentralized  blockchain  containers 
12 days ago
Why Most Published Research Findings Are False
There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this essay, I discuss the implications of these problems for the conduct and interpretation of research.
science  research  publishing  statistics 
13 days ago
GitHub - kitze/JSUI: A powerful UI toolkit for managing JavaScript apps

🛠 A tool for visually organizing, creating and managing JavaScript projects.
It doesn't matter if it's a frontend or a backend app or what framework it's using. If it has a package.json, it belongs here.
IDE  development  devops  deployment 
13 days ago
GitHub - postlight/awesome-cms: 📚 A collection of open and closed source Content Management Systems (CMS) for your perusal.
A collection of 116 open and closed source Content Management Systems (CMS) for your perusal. Check out the blog post on the creation of Awesome CMS.
CMS  resource  reference 
13 days ago
REST vs GraphQL APIs, the Good, the Bad, the Ugly | Moesif’s Musings on Software
GraphQL APIs can be exciting new technology, but it is important to understand the tradeoffs before making such architectural decisions. Some APIs such as those with very few entities and relationships across entities like analytics APIs may not be suited for GraphQL. Whereas applications with many different domain objects like e-commerce where you have items, users, orders, payments, and so on may be able to leverage GraphQL much more.

In fact, GraphQL vs REST is like comparing SQL technologies vs noSQL. There are certain applications where it makes sense to model complex entities in a SQL Db. Whereas other apps that only have “messages” as in high volume chat apps or analytics APIs where the only entity is an “event” may be more suited using something like Cassandra.
graphql  REST 
13 days ago
A Tutorial Introduction to Kubernetes
Kubernetes is the hottest kid on the block among container orchestration tools right now. I started writing this post when we decided to go with Kubernetes at Twyla a year ago, and since then, the developments in the ecosystem have been simply overwhelming. In my opinion, the attention Kubernetes gets is completely deserved, due to the following reasons:

It is a complete solution that is based on a fundamental set of ideas. These ideas are explained in the Borg, Omega and Kubernetes article that compares the consecutive orchestration solutions developed at Google, and the lessons learned.
kubernetes  docker  containers  devops 
13 days ago
“Perhaps it is simpler to say that Intel…was disrupted”
Coming full circle, imagine now that there’s no SoC, no WWAN, no low power chip — these were all new assumptions in the world of mobile. But one really big assumptions — that graphics would be just a feature — turned out to be a huge problem.
13 days ago
Binary decision diagram - Wikipedia
A Boolean function can be represented as a rooted, directed, acyclic graph, which consists of several decision nodes and terminal nodes. There are two types of terminal nodes called 0-terminal and 1-terminal. Each decision node
is labeled by Boolean variable
and has two child nodes called low child and high child. The edge from node
to a low (or high) child represents an assignment of
to 0 (resp. 1). Such a BDD is called 'ordered' if different variables appear in the same order on all paths from the root. A BDD is said to be 'reduced' if the following two rules have been applied to its graph:
Merge any isomorphic subgraphs.
Eliminate any node whose two children are isomorphic.
In popular usage, the term BDD almost always refers to Reduced Ordered Binary Decision Diagram (ROBDD in the literature, used when the ordering and reduction aspects need to be emphasized). The advantage of an ROBDD is that it is canonical (unique) for a particular function and variable order.[1] This property makes it useful in functional equivalence checking and other operations like functional technology mapping.
A path from the root node to the 1-terminal represents a (possibly partial) variable assignment for which the represented Boolean function is true. As the path descends to a low (or high) child from a node, then that node's variable is assigned to 0 (resp. 1).
13 days ago
« earlier      
per page:    204080120160

Copy this bookmark:

to read