Marketplace

Datagram@DataProc

Updated March 18, 2024

Neoflex Datagram is a data integration platform. Datagram@DataProc is a complex solution that includes the Neoflex Datagram visual editor integrated with the Apache Spark cluster on Yandex Data Proc services.

You can use the Neoflex Datagram visual editor to design applications for processing data from different sources, such as Oracle, Microsoft SQL Server, PostgreSQL, Hadoop, HBase, XML, Excel, and CSV, as well as upload data based on source metadata. Neoflex Datagram supports both batch and stream processing.

The application, which is developed as a collection of diagrams, is converted to Scala code, then to executable modules, and then run on Apache Oozie and Apache Livy.

Streaming mode is supported by Apache Kafka and Spark Streaming. Integration with BRMS enables you to apply business rules to event streams in real time.

Benefits

  • Viewing the contents and structure of data sources and sinks.
  • Loading data directly from sources without defining intermediate transformation steps.
  • Tracking data stream object sources down to the individual fields (lineage).
  • Partially converting and displaying intermediate results, individual transformation steps, and branches.
  • Viewing generated application code.
  • Automatically validating data after transformation.
  • Supporting Spark Catalyst Optimizer for converting complex queries to code.
Billing type
Hourly (Pay as you go)
Type
Virtual Machine
Category
Analytics
Developer tools
Databases
Publisher
Neoflex
Use cases
  • Uploading data to analytics systems.
  • Migrating databases to the cloud.
  • Visually designing Data Pipelines.
  • Stream data processing.
  • Developing BigData stack solutions.
Technical support

Neoflex
Neoflex provides technical support to Datagram users in Yandex Cloud. You can contact technical support by email at support-datagram@neoflex.ru. Support engineers are available to take your requests between 9 AM and 6 PM on business days.

Yandex Cloud
Yandex Cloud technical support is available 24/7 to respond to requests. The types of requests available and their response time depend on your pricing plan. You can enable paid support in the management console. Learn more about requesting technical support.

Yandex Cloud does not provide technical support for this product. If you have any issues, please refer to the developer’s information resources.

Product IDs
image_id:
fd87prh5j1p766acfc9g
family_id:
neoflex-datagram-dataproc
Product composition
SoftwareVersion
Ubuntu18.04
- -
Terms
By using this product you agree to the Yandex Cloud Marketplace Terms of Service and the terms and conditions of the following software: Datagram (EULA)
Billing type
Hourly (Pay as you go)
Type
Virtual Machine
Category
Analytics
Developer tools
Databases
Publisher
Neoflex

Similar products