The final ETP v1.2 Release Candidate 2 (RC2) is available for review and comments.
The Energistics Transfer Protocol (ETP) specifies messages and behaviors for the efficient transfer of data between software applications and technologies, including real-time streaming. ETP has been designed to meet the special needs of oil and gas exploration and production (E&P) data, and particularly the WITSML, PRODML and RESQML data formats.
The current published version, ETP v1.1, has been deployed in several experimental and operational implementations. Results show ETP reduces data latency to about 1 second—from 10–15 seconds, which is typical of SOAP protocols. Also, ETP uses a binary encoding which requires 10x less bandwidth, compared to a purely XML format. These results mean faster, more efficient transfer of data for oil and gas operations, which ultimately supports faster and better decisions.
Based on real-world use and testing, ETP v1.2 RC1 (December 2019) delivered an enhanced design and added features to support existing and new E&P workflows. Significant new capabilities included:
- More robust data-streaming protocols, which include a “simple streamer” for WITS-like data transfers, and two new streaming protocols—one producer-driven and one consumer-driven—to meet the various demands of real-time operations, including new workflows like auto-startup at the rig site.
- New protocols and improved design to better support all Energistics data models: WITSML, RESQML and PRODML. While technically ETP v1.1 supported all Energistics data models, ETP v1.2RC1 now includes: a re-designed shared Discovery protocol; a new companion Dataspaces protocol; and new capabilities such as the DataArray protocol to transfer large, binary arrays of heterogeneous data values (e.g., for RESQML interpretation and modeling data and PRODML DAS data); and the Transaction protocol to ensure successful completion or rollback of a set of related tasks.
- New query capabilities for Discovery, Store and GrowingObject protocols, which use an OData-like syntax. These advanced query capabilities help support existing and new industry workflows.
ETP v1.2 RC2 (November 2020) includes changes and new functionality to address feedback from the first release candidate, and to support workflows for eventual consistency between data stores.
Additionally, ETP v1.2 (when published) and WITSML v2.0 can be considered a complete replacement for WITSML v126.96.36.199.
The ETP v1.2 RC2 download package is a zip file that includes:
- Avro schemas for each message of each ETP subprotocol
- ETP v1.2 RC Specification document (pdf file) that describes required behaviors
- An XMI file (which may be imported into any UML modeling tool)
- A feedback form (to capture and submit your comments and issues during your ETP testing)
Industry stakeholders and interested parties are requested to download the package, review all materials, and implement/test those protocols that are relevant to their organization. Download the zip file here. Comments and issues should be submitted starting now until February 15, 2021.
Note that Petrotechnical Data Systems (https://pds.group) has confirmed that they will make available a new version of their Development Kit for ETP that is compatible with ETP v1.2 RC2 by November 30, 2020, which will make it easier and more efficient to test code based on RC2. A technical walkthrough for developers is scheduled for December 17, 2020, more info here
More on the DevKit (current version) here.