Unpacking the complexity of blockchain, term by term.
So, what is a blockchain? It's a complicated question because the inventor of Bitcoin, the pseudonymous Satoshi Nakamoto
, didn't use the term in the original Bitcoin paper
. For many, “the blockchain” is nothing more than a shorthand for "how Bitcoin works." But more usefully, the blockchain is a distributed ledger, shared by untrusted participants, with strong guarantees about accuracy and consistency. What does that mean? Let's unpack it term by term:
If you go into antiquarian bookstores, you may have seen piles of books from the 19th century in which accountants entered transactions by hand. Those are ledgers. Ledgers are lists of transactions: items sold, and for how much; items purchased, and for how much. Those transactions are dated (timestamped) and ordered. Ledgers are strictly append-only: transactions can be added, but you can’t go back and edit or Continue reading "What is a blockchain?"
MLPerf is a new set of benchmarks compiled by a growing list of industry and academic contributors.
We are in an empirical era for machine learning, and it’s important to be able to identify tools that enable efficient experimentation with end-to-end machine learning pipelines. Organizations that are using and deploying machine learning are confronted with a plethora of options for training models and model inference, at the edge and on cloud services. To that end,MLPerf
, a new set of benchmarks compiled by a growing list of industry and academic contributors,was recently announced at the recent Artificial Intelligence conference
History lessons learned
2017 Turing Award winner David Patterson gives a brief overview of the 40-year history of computing benchmarks: he lists fallacies and lessons learned and he describes some
Continue reading "A new benchmark suite for machine learning"
Answers to the three most commonly asked questions about maintaining GDPR-compliant machine learning programs.
Much has been made about the potential impact of the EU’s General Data Protection Regulation (GDPR)
on data science programs. But there’s perhaps no more important—or uncertain—question than how the regulation will impact machine learning (ML), in particular. Given the recent advancements in ML, and given increasing investments in the field by global organizations, ML is fast becoming the future of enterprise data science.
This article aims to demystify this intersection between ML and the GDPR, focusing on the three biggest questions I’ve received at Immuta about maintaining GDPR-compliant data science and R&D programs. Granted, with an enforcement data of May 25, the GDPR has yet to come into full effect, and a good deal of what we do know about how it will be enforced is either vague or evolving (or both!). But key Continue reading "How will the GDPR impact machine learning?"
O’Reilly Media Podcast: JP Phillips, platform engineer at IBM Cloud, on problem solving with containers and Kubernetes, and how developers can get started.
There has been a surge of interest in containers, microservices, and Kubernetes in recent years, fueled by the need for developers to share apps that will scale and run in a consistent manner across many different environments. Whether it’s dev, staging, testing, or production, developers need assurance that the code they deploy to one environment is going to work in another. Containers, microservices, and Kubernetes provide such assurance.
In this episode of the O’Reilly Media Podcast, I talk with JP Phillips, platform engineer at IBM Cloud
. IBM is driving development in the container space, as shown through last year’s launch of Istio
, an open cloud service that allows developers to connect, manage, and secure networks of different microservices. Istio, a joint collaboration between IBM, Google, and
Continue reading "Kubernetes and containers for enterprise developers"
Learn how to build fast, secure, accessible experiences at the O’Reilly Fluent conference this June.
To become more fluent in the language of the global, expanding, maturing web, you’ll want to attend Fluent in San Jose
this year. If you're working on the modern web—whether you're independent or part of a large team—and you want to experience hands-on learning, make meaningful connections, and share ideas across communities, then Fluent offers a number of ways to learn the tools, techniques, and tech you’ll need.
Fluent covers a broad range of technologies and topics to provide web programming professionals with the skills, connections, and inspiration needed to build better online and mobile experiences. Even better, you’ll have a variety of ways to learn—from focused 2-day training courses to tutorials to sessions. This year’s program is organized around three tracks: developer experience, web pillars, and beyond code.
Developer experience: Tools, platforms, and techniques
Continue reading "Being a great front-end developer means being fluent in tools, accessibility, and teamwork"
The O'Reilly Velocity Conference in San Jose will cover what you need to know to build high-performance, resilient, and secure systems.
Let’s face it, your systems aren't getting any less complex, and the list of skills you need to build and maintain them keeps growing. Modern systems pose a number of thorny challenges: they are inherently complex and span multiple technologies, groups, and sometimes different organizations altogether. Most poignantly, they tend to fail in the most unexpected and spectacular ways. At Velocity this year, we’ve identified three primary areas of focus to help you build and run the systems that power modern businesses: performance, resilience, and security.
The larger your applications get, the harder it is to understand their performance and troubleshoot problems. This increased complexity in applications and services requires new methods for monitoring and improved observability. Here are some sessions designed to help you tackle performance issues:
The O’Reilly Podcast: Brendan Eich on disrupting advertising, decentralizing payments, and privacy by design.
In this episode of the O’Reilly Podcast
at the upcoming O’Reilly Fluent Conference
, July 11-14, 2018, in San Jose.
Fixing the broken web: According to Eich, we’ve built a web that’s allowed “surveillance capitalism, where advertisers and publishers can’t make a match without third parties to track and to run ads.” Content producers can’t make the web work with just subscriptions, and consumers are tired of exchanging privacy and data for slow-performing sites and the increased risk of privacy invasion.
Disrupting the third-party advertising model: Eich says, “There's huge disruption happening where internet and television advertising merge. And the advertising model that Continue reading "The web is broken; let’s fix it"
Get insights on rebuilding the web, neuroevolution, data engineers vs. data scientists, the blockchain, and design thinking.
This list gathers five of our most popular articles covering tools, technologies, and trends relevant to engineering leaders.
The web was never supposed to be a few walled gardens of concentrated content owned by a few major publishers; it was supposed to be a cacophony of different sites and voices.
Read the article.
I don't want to underestimate the difficulty of this project, or overestimate its chances of success. We'd certainly have to get used to sites that aren't as glossy or complex as the ones we have now. We might have to revisit some of the most hideous bits of the first-generation web, including those awful GeoCities pages. We would probably need to avoid fancy, dynamic websites; and, before you think this
Continue reading "5 popular articles for engineering leaders"
The O’Reilly Data Show Podcast: Jason Dai on the first year of BigDL and AI in China.
In this episode of the Data Show
, I spoke with Jason Dai
, CTO of Big Data Technologies at Intel, and one of my co-chairs for the AI Conference in Beijing
. I wanted to check in on the status of BigDL
, specifically how companies have been using this deep learning library on top of Apache Spark, and discuss some newly added features. It turns out there are quite a number of companies already using BigDL in production, and we talked about some of the popular uses cases he’s encountered. We recorded this podcast while we were at the AI Conference in Beijing
, so I wanted to get Dai’s thoughts on the adoption of AI technologies among Chinese companies and local/state government agencies.
Continue reading Companies in China are moving quickly to embrace AI technologies.