July 23, 2019·4 min read·engineeringcockroachdbcommunitycloud

ESCAPE19 proposes a forum for operating across cloud providers

Cockroach Labs announces an October conference about hybrid and multi-cloud systems. The useful engineering questions concern data placement and operational boundaries as much as application portability.

A conference organized around one cloud provider has a natural limit when the architecture under discussion includes its competitors. Cockroach Labs is proposing a separate forum for that discussion with ESCAPE/19, announced today as a conference about hybrid and multi-cloud infrastructure.

The July 23 announcement schedules the inaugural event for October 16 and 17 in New York City. It invites technical and business talks about actual multi-cloud problems. Cockroach Labs is partnering with Slower as a founding sponsor and content partner to help construct the agenda.

I am interested in the operational questions this creates for distributed databases. CockroachDB makes consistency across nodes an explicit design goal, but placing those nodes in different environments adds decisions that a SQL connection alone cannot answer. The value of this conference will depend on how concretely speakers explain those decisions.

The announcement identifies an agenda gap

Jim Walker's announcement contrasts the proposed event with conferences run by individual cloud providers. Its argument is that those events frame technical discussion around their own platforms, while organizations operating across platforms need a place to compare experiences.

That is the organizer's stated rationale, not evidence that every provider event has the same restrictions. The useful part of the proposal is the set of questions it makes available for discussion. These include data management, federation, security and the business consequences of depending on a single provider.

A shared vocabulary is necessary because hybrid and multi-cloud are broad descriptions. An organization combining an existing datacenter with public cloud infrastructure faces a different arrangement from an application spanning several public providers. Both can fit the conference's proposed scope without sharing the same failure model.

The announcement invites operators and application developers as well as business owners. That is appropriate because architecture choices affect who operates the service and who bears its cost. A design that is technically deployable in two places can still require separate operational arrangements in each.

The conference has not occurred as of this post. The announcement says more speakers will be named over the following weeks and opens a call for papers. Its proposed scope can be assessed now, while claims about the eventual talks or outcomes would be premature.

Data locality makes portability incomplete

CockroachDB's April 19.1 release announcement supplies a concrete example of the questions a multi-cloud discussion should address. The optimizer can consider index locality, while follower reads can use nearby replicas for eligible historical queries.

These capabilities distinguish being able to run the database in a location from making a particular query use nearby data. The former concerns deployment. The latter depends on placement and on the semantics of the operation.

Follower reads illustrate the semantic constraint clearly. The announcement requires a sufficiently old AS OF SYSTEM TIME timestamp. A local replica is useful for this path because the query accepts a historical version. That does not establish the same routing choice for a transaction that needs current data and performs writes.

Locality-aware index selection has another prerequisite. The release says it relies on per-index zones. A discussion of multi-cloud database performance therefore needs to include how those indexes are placed, not merely which provider hosts the SQL endpoint.

My preference is for talks that expose these conditions. A topology description without transaction and query requirements can hide the reason one design has acceptable latency and another does not. The historical-read example gives a specific way to explain the tradeoff without reducing it to a slogan about portability.

An operational account needs more than a provider list

The proposed agenda asks how to reduce dependence on a single provider and how to compare public-cloud options. Those are useful business questions, but the engineering account needs to identify what the application actually requires from each environment.

For a database-backed service, a provider list does not describe where data resides or which operation crosses a network boundary. It also does not identify which account administers the components. Those details determine whether changing environments is a deployment task or a wider change to the operating model.

This is why a conference about real implementations can be useful. A speaker can explain the particular constraint that forced a placement choice and the consequences that followed. Another organization can then compare that constraint with its own requirements instead of copying the topology without its rationale.

The announcement's call for both technical and business submissions recognizes that the reasons for a multi-cloud design may originate outside the database. The database still has to preserve its own contract within the chosen arrangement. An application's need for consistent transactions does not disappear because procurement or geographic requirements introduce another provider.

ESCAPE/19 is currently an invitation to assemble those accounts. Its announced partnership with Slower is intended to broaden the agenda beyond Cockroach Labs' focus on data. The next substantive information will be the selected speakers and talks, while today's announcement establishes the event's dates, location and open call for experience from organizations addressing hybrid and multi-cloud infrastructure.