Current Issue Past Issues Topics May 17, 2022 Volume 20, issue 2 PDF Case Studies A discussion with James Agnew, Pat Helland, and Adam Cole With the full clout of the Centers for Medicare and Medicaid Services currently being brought to bear on healthcare providers to meet high standards for patient data interoperability and accessibility, it would be easy to assume the only reason this goal wasn't accomplished long ago is simply a lack of will. Interoperable data? How hard can that be?
Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.
Claim your profile
Articles by Pat Helland
Autonomous Computing
Current Issue Past Issues Topics April 4, 2022 Volume 20, issue 1 PDF We frequently compute across autonomous boundaries but the implications of the patterns to ensure independence are rarely discussed. Pat Helland Starting 23 years ago, I spoke about how autonomy impacts our designs. By 2001, I had presented my ideas at a number of conferences. I regret not having set them to prose at the time. Many of the ideas moved forward to be called service-oriented architecture (SOA) in the early 2000s.
Autonomous Computing (short version)
Abstract Over 20 years ago, I spoke about how autonomy impacts our designs. By 2001, I presented these ideas at a number of conferences. I regret not setting them to prose. Many of these ideas moved forward to be called SOA (Service Oriented Architecture) in the early 2000s. Now, in 2021, as these principles still influence our designs, we don’t talk enough about them or their implications. This paper introduces a concept called a fiefdom.
Don't Get Stuck in the "Con" Game
Current Issue Past Issues Topics Check out Pat's Scattered Thoughts on Distributed Systems pathelland.substack.com Escaping the Singularity August 5, 2021 Volume 19, issue 3 PDF Escaping the Singularity Consistency, convergence, and confluence are not the same! Eventual consistency and eventual convergence aren't the same as confluence, either. Pat Helland, Salesforce Like many others, I've fallen victim to using the phrase eventual consistency.
My Personal - ACM Queue
Current Issue Past Issues Topics The March/April 2021 issue of acmqueue is out now Subscribers and ACM Professional members login here Check out Pat's Scattered Thoughts on Distributed Systems pathelland.substack.com Escaping the Singularity June 3, 2021 Volume 19, issue 2 PDF Escaping the Singularity How could I miss such a simple thing? Pat Helland For decades, I thought the C in transactional ACID was the weakest property. Just shows how I was a dummy for 37 years.
Fail-fast Is Failing... Fast!
Current Issue Past Issues Topics The January/February 2021 issue of acmqueue is out now Subscribers and ACM Professional members login here Check out Pat's Scattered Thoughts on Distributed Systems pathelland.substack.com Escaping the Singularity March 25, 2021 Volume 19, issue 1 PDF Escaping the Singularity Changes in compute environments are placing pressure on tried-and-true distributed-systems solutions.
I Am SO Glad I’m Uncoordinated!
Sometime around 1962 or 1963, I was six or seven years old. I was trotted down to the Little League field and told I should sign up. It wasn’t too bad standing in the outfield until I understood they were SERIOUS that I should move into the path of the approaching ball! The odds of me lining up the mitt to the oncoming ball were vanishingly small. I lasted less than a week in Little League. So, I took up reading books and that’s served me well.
Baleen Analytics
Current Issue Past Issues Topics The September/October 2020 issue of acmqueue is out now Subscribers and ACM Professional members login here Escaping the Singularity January 7, 2021 Volume 18, issue 6 PDF Escaping the Singularity It's Not Your Grandmother's Database Anymore Large-scale filtering of data provides serendipitous surprises. Pat Helland Baleen is a substance found in the mouths of the largest whales in the ocean.
Data on the Outside versus Data on the Inside
Home/Magazine Archive/November 2020 (Vol. 63, No. 11)/Data on the Outside versus Data on the Inside/Full Text By Pat Helland Communications of the ACM, November 2020, Vol. 63 No. 11, Pages 111-118 10.1145/3410623 Comments View as: Print Mobile App ACM Digital Library Full Text (PDF) In the Digital Edition Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook Credit: Getty Images Recently, there has been a lot of interest in services.
Don’t Get Stuck in the “Con” Game (V2)
This is a major rewrite of yesterday’s post Don’t Get Stick in the “Con” Game. I’ve added a bunch more stuff (including on Linearizability and the CAP theorem). Like many others, I’ve fallen victim to using the term eventual consistency. As I’ve reflected on this, it’s clear that the meaning of this is fuzzy. Different communities within computer science use the word “consistency” in varying ways. Even within our different communities, we are inconsistent in our use of consistency.
Pat Helland on Software Architecture and Urban Planning
00:16 Introductions 00:16 Wesley Reisz: Hello and welcome to another edition of the InfoQ podcast. My name is Wes Reisz, co-host to the podcast and chair for QCon San Francisco. Today on the podcast, we are talking about urban planning (or at least urban planning and how it relates to software architecture). 00:36 Wesley Reisz: Our guest today is Pat Helland. Pat is extremely well known for his thoughts in distributed systems.
Data on the Outside vs. Data on the Inside
Current Issue Past Issues Topics The May/June 2020 issue of acmqueue is out now Subscribers and ACM Professional members login here Databases PDF August 2, 2020 Volume 18, issue 3 Data kept outside SQL has different characteristics from data kept inside. Pat Helland Recently, there has been a lot of interest in services. These can be microservices or just services. In each case, the service provides a function with its own code and data, and operates independently of partners.
The Best Place to Build a Subway
Home/Magazine Archive/July 2020 (Vol. 63, No. 7)/The Best Place to Build a Subway/Full Text By Pat Helland Communications of the ACM, July 2020, Vol. 63 No. 7, Pages 36-39 10.1145/3386269 Comments View as: Print Mobile App ACM Digital Library Full Text (PDF) In the Digital Edition Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook Credit: Getty Images Many engineering projects are big and complex.
The Best Place to Build a Subway
Current Issue Past Issues Topics The January/February 2020 issue of acmqueue is out now Subscribers and ACM Professional members login here Escaping the Singularity System Evolution PDF March 24, 2020 Volume 18, issue 1 Escaping the Singularity It's Not Your Grandmother's Database Anymore Building projects despite (and because of) existing complex systems Pat Helland Many engineering projects are big and complex.
Mind Your State for Your State of Mind
Transcript Helland: Most of my talks, most of my papers come from when I'm just sitting around staring at the ceiling. They're not necessarily directly to do with my day job. It's more driven by annoying the people around me because I'm staring at the ceiling and not paying attention. This is "Mind your State for your State of Mind." This talk is a paper in the "Communications of the ACM," so if you're interested, just look for the title, look for my name. Go google it and you'll pop it up.
Space Time Discontinuum
By Pat Helland Communications of the ACM, January 2020, Vol. 63 No. 1, Pages 54-56 10.1145/3369744 Comments View as: Print Mobile App ACM Digital Library In the Digital Edition Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook Credit: Getty Images Increasingly, calculations are based on timed events originating at many sources. By comparing, contrasting, joining, and noodling over these inputs, you can derive some interesting results.
Space Time Discontinuum
Current Issue Past Issues Topics The September/October 2019 issue of acmqueue is out now Subscribers and ACM Professional members login here Escaping the Singularity Databases PDF November 18, 2019 Volume 17, issue 5 Escaping the Singularity It's Not Your Grandmother's Database Anymore! Combining data from many sources may cause painful delays. Pat Helland Increasingly, calculations are based on timed events originating at many sources.
Write Amplification vs. Read Perspiration
By Pat Helland Communications of the ACM, November 2019, Vol. 62 No. 11, Pages 111-113 10.1145/3359334 Comments View as: Print Mobile App ACM Digital Library In the Digital Edition Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook Credit: Getty Images Increasingly in computing systems, when you write something into durable storage it is in need of reorganization later. Personally, I'm pretty darned disorganized and I lose stuff a lot.
Write Amplification Versus Read Perspiration
Current Issue Past Issues Topics The July/August 2019 issue of acmqueue is out now Subscribers and ACM Professional members login here Escaping the Singularity Databases PDF September 23, 2019 Volume 17, issue 4 Escaping the Singularity... It's Not Your Grandmother's Database Anymore The tradeoffs between write and read Pat Helland Increasingly in computing systems, when you write something into durable storage it is in need of reorganization later.
Extract, Shoehorn, and Load
By Pat Helland Communications of the ACM, July 2019, Vol. 62 No. 7, Pages 32-33 10.1145/3331132 Comments View as: Print Mobile App ACM Digital Library In the Digital Edition Share: Send by email Share on reddit Share on StumbleUpon Share on Hacker News Share on Tweeter Share on Facebook Credit: Lars Christensen A lot of data is moved from system to system in an important and increasing part of the computing landscape. This is traditionally known as ETL (extract, transform, and load).
Extract, Shoehorn, and Load
Current Issue Past Issues Topics June 15, 2019 | Palace Hotel, San Francisco ACM-IMS Interdisciplinary Summit on the Foundations of Data Science ACM and the Institute of Mathematical Statistics are bringing together speakers and panelists to address topics such as deep learning, reinforcement learning, fairness, ethics, and the future of data science. Jeannette Wing and David Madigan are the event Co-Chairs.
Identity by Any Other Name
By Pat Helland Communications of the ACM, April 2019, Vol. 62 No. 4, Page 80 10.1145/3303870 Comments View as: Print Mobile App ACM Digital Library In the Digital Edition Share: Send by email Share on reddit Share on StumbleUpon Share on Tweeter Share on Facebook Credit: Richard Devonshire "What's in a name? That which we call a rose by any other name would smell as sweet." —William Shakespeare (Romeo and Juliet) No entries found Log in to Read the Full Article
Identity by Any Other Name
Current Issue Past Issues Topics The January/February 2019 issue of acmqueue is out now Subscribers and ACM Professional members login here Databases PDF February 19, 2019 Volume 16, issue 6 The complex cacophony of intertwined systems Pat Helland, Salesforce.com "What's in a name? That which we call a rose by any other name would smell as sweet." —William Shakespeare (Romeo and Juliet) As distributed systems scale in size and heterogeneity, increasingly they are connected by identifiers.
Mind Your State for Your State of Mind
Mind Your State for Your State of Mind Applications have had an interesting evolution as they have moved into the distributed and scalable world. Similarly, storage and its cousin databases have changed side by side with applications. Many times, the semantics, performance, and failure models of storage and applications do a subtle dance as they change in support of changing business requirements and environmental challenges. Adding scale to the mix has really stirred things up.
Consistently Eventual
In recent years, there has been a lot of excitement over eventual consistency.6 Heck, I get pretty excited about it! Eventual consistency is an aspect of some data that says its underlying value is unknown until work on that item settles down. It turns out that, in many cases, there are data items for which the work never settles down.
Consistently Eventual
The March/April issue of acmqueue is out now In recent years, there has been a lot of excitement over eventual consistency.6 Heck, I get pretty excited about it! Eventual consistency is an aspect of some data that says its underlying value is unknown until work on that item settles down. It turns out that, in many cases, there are data items for which the work never settles down.
XML and JSON Are Like Cardboard
XML and JSON Are Like Cardboard Today's world, cardboard is an ever-important part of life. Given the major investment of resources and money, you might question whether it's worth it. It turns out the efficiencies and savings from cardboard outstrip the costs to manufacture and later recycle it. Semi-structured representations of data are not the cheapest format. There is typically a lot of extra stuff like angle brackets contained in it.
XML and JSON Are Like Cardboard
In today's world, cardboard is an ever-important part of life. Given the major investment of resources and money, you might question whether it's worth it. It turns out that the efficiencies and savings from cardboard outstrip the costs to manufacture and later recycle it. Semi-structured representations of data are not the cheapest format. There's typically a lot of extra stuff like angle brackets contained in it.
Side Effects, Front and Center
We think of computation in terms of its consequences. The big MapReduce job returns a large result. Web interactions display information. Enterprise applications update the database and return an answer. These are the reasons we do our work. What we rarely discuss are the side effects of doing the work we intend. Side effects may be unwanted, or they may actually cause desired behavior at different layers of the system.
Side Effects, Front and Center!
It's Not Your Grandmother's Database Anymore We think of computation in terms of its consequences. The big MapReduce job returns a large result. Web interactions display information. Enterprise applications update the database and return an answer. These are the reasons we do our work. What we rarely discuss are the side effects of doing the work we intend. Side effects may be unwanted, or they may actually cause desired behavior at different layers of the system.
Communications of the ACM
Too Big NOT to Fail Web-scale computing means running hundreds of thousands of servers. It requires a fundamentally different approach from smaller environments. Consistent server hardware and datacenter plans, as well as consistent and simple configurations, are essential. Everything is designed to expect and embrace failure without human intervention. Operations must be largely autonomous. Software must assume crashes. Development, test, and deployment must have integrated and automated solutions.
Too Big NOT to Fail
Web-scale computing means running hundreds of thousands of servers. It requires a fundamentally different approach from smaller environments. Consistent server hardware and data center plans, as well as consistent and simple configurations, are essential. Everything is designed to expect and embrace failure without human intervention. Operations must be largely autonomous. Software must assume crashes. Development, test, and deployment must have integrated and automated solutions.
Life Beyond Distributed Transactions
Transactions are amazingly powerful mechanisms, and I've spent the majority of my almost 40-year career working on them. In 1982, I first worked to provide transactions on the Tandem NonStop System. This system had a mean time between failures measured in years4 and included a geographically distributed two-phase commit offering excellent availability for strongly consistent transactions.
Life Beyond Distributed Transactions
This is an updated and abbreviated version of a paper by the same name first published in CIDR (Conference on Innovative Database Research) 2007. Transactions are amazingly powerful mechanisms, and I've spent the majority of my almost 40-year career working on them. In 1982, I first worked to provide transactions on the Tandem NonStop System.
Communications of the ACM
Metadata defines the shape, the form, and how to understand our data. It is following the trend taken by natural languages in our increasingly interconnected world. While many concepts can be communicated using shared metadata, no one can keep up with the number of disparate new concepts needed to have a common understanding.
The Power of Babble
Metadata defines the shape, the form, and how to understand our data. It is following the trend taken by natural languages in our increasingly interconnected world. While many concepts can be communicated using shared metadata, no one can keep up with the number of disparate new concepts needed to have a common understanding.
The Singular Success of SQL
SQL has been singularly successful in its impact on the database industry. Nothing has come remotely close to its ubiquity. Its success comes from its high-level use of relational algebra allowing set-oriented operations on data shaped as rows, columns, cells, and tables. SQL's impact can be seen in two broad areas. First, the programmer can accomplish a lot very easily with set-oriented operations. Second, the high-level expression of the programmer's intent has empowered huge performance gains.
The Singular Success of SQL
SQL has been singularly successful in its impact on the database industry. Nothing has come remotely close to its ubiquity. Its success comes from its high-level use of relational algebra allowing set-oriented operations on data shaped as rows, columns, cells, and tables. SQL's impact can be seen in two broad areas. First, the programmer can accomplish a lot very easily with set-oriented operations. Second, the high-level expression of the programmer's intent has empowered huge performance gains.
Standing on Distributed Shoulders of Giants
If you squint hard enough, many of the challenges of distributed computing appear similar to the work done by the great physicists. Dang, those fellows were smart! Here, we examine some of the most important physics breakthroughs and draw some whimsical parallels to phenomena in the world of computing... just for fun. Isaac Newton (1642 - 1727) was a brilliant physicist who defined the foundations for classical mechanics, laws of motion, and universal gravitation.
Standing on Distributed Shoulders of Giants
If you squint hard enough, many of the challenges of distributed computing appear similar to the work done by the great physicists. Dang, those fellows were smart! Here, I examine some of the most important physics breakthroughs and draw some whimsical parallels to phenomena in the world of computing ... just for fun. Please select one of the options below for access to premium content and features.
Immutability Changes Everything
There is an inexorable trend toward storing and sending immutable data. We need immutability to coordinate at a distance, and we can afford immutability as storage gets cheaper. This article is an amuse-bouche sampling the repeated patterns of computing that leverage immutability. Climbing up and down the compute stack really does yield a sense of déjà vu all over again.
Condos and Clouds
Living in a condominium (commonly known as a condo) has its constraints and its services. By defining the lifestyle and limits on usage patterns, it is possible to pack many homes close together and to provide the residents with many conveniences. Condo living can offer a great value to those interested and willing to live within its constraints and enjoy the sharing of common services.
Idempotence Is Not a Medical Condition
The definition of distributed computing can be confusing. Sometimes, it refers to a tightly coupled cluster of computers working together to look like one larger computer. More often, however, it refers to a bunch of loosely related applications chattering together without a lot of system-level support. This lack of support in distributed computing environments makes it difficult to write applications that work together. Messages sent between systems do not have crisp guarantees for delivery.
Show More
loading
Actions
Is this you?
As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.Get in touch with Pat
Contact Pat, search articles and posts on X, monitor coverage, and track replies from one place.
Learn more about Muck Rack