Composable DataOps Blog
Composable DataOps Blog
Composable has an SDK for deploying resources between two instances of Composable. For example, a source instance may be a development environment and the target instance may be the production environment. Resources can include Dataflows, QueryViews, DataPortals, Keys, WebApps, etc.…
Composable has an API for every action that you can perform through its UI. All services are documented here: Below is an example script for executing operations on the UserService. The first part of the script loads the necessary…
The WebService we’ll be creating is a simple API endpoint that accepts a Time Zone as a parameter and returns current date and time. To create a Web Service, first create a new DataFlow and add two modules: “Web Receive”…
Composable’s DataFlow designer is a powerful tool for rapid development of data pipelines in an intuitive, visual setting. However, some users with programming experience may prefer developing DataFlows in code instead of visually, which is made possible by Composable’s FluentAPI.…
Tutorial “Effective October 1, 2022, we will begin to permanently disable Basic Auth in all tenants, regardless of usage, with the exception of SMTP Auth.” Due to the recent deprecation of both Exchange Online and support for Basic Authentication,…
What is a Predicate? A predicate is an operation on an Input object which produces a boolean (true/false) result. It can be helpful to think of a predicates as “Yes or No” questions; “Is this car red?” “Is this building…
Have you ever received the error System.IO.PathTooLongException: The specified path, file name, or both are too long. The fully qualified file name must be less than 260 characters, and the directory name must be less than 248 characters.? If so,…
In this post, we’ll be going over how to configure an ODBC connection to DataBricks within Composable so you can run spark queries from Composable resources (i.e. QueryViews and DataFlows). The first thing you’ll need to do is install the…
For a previous task, I was reliant on external API’s to work correctly and to know when functionality had changed. With proper acceptance/validation testing on foreign API’s, you can sleep a little bit better at night knowing that the behavior…
This post will cover two recent additions to Composable DataFlows that have yet to receive a comprehensive write-up: DataFlow Resume and Pinned Results. We’ll be discussing them together due to their conceptual overlap; both facilitate DataFlow development and debugging by…