Composable DataOps Blog
Composable DataOps Blog
The purpose of this Spotlight is to demonstrate the use of the DoWhile module to loop within a Composable DataFlow. Our scenario: The Fibonacci sequence is one of the best-known series in Mathematics. The series is composed of Fibonacci numbers,…
The purpose of this Spotlight is to demonstrate the mechanics of a simple, classic For loop within a Composable DataFlow. Our scenario: We are told to expect delivery of a plain-text dataset with the following column names: first name, last…
Composable’s DataFlow designer is a powerful tool for rapid development of data pipelines in an intuitive, visual setting. However, some users with programming experience may prefer developing DataFlows in code instead of visually, which is made possible by Composable’s FluentAPI.…
Tutorial “Effective October 1, 2022, we will begin to permanently disable Basic Auth in all tenants, regardless of usage, with the exception of SMTP Auth.” Due to the recent deprecation of both Exchange Online and support for Basic Authentication,…
What is a Predicate? A predicate is an operation on an Input object which produces a boolean (true/false) result. It can be helpful to think of a predicates as “Yes or No” questions; “Is this car red?” “Is this building…
For a previous task, I was reliant on external API’s to work correctly and to know when functionality had changed. With proper acceptance/validation testing on foreign API’s, you can sleep a little bit better at night knowing that the behavior…
This post will cover two recent additions to Composable DataFlows that have yet to receive a comprehensive write-up: DataFlow Resume and Pinned Results. We’ll be discussing them together due to their conceptual overlap; both facilitate DataFlow development and debugging by…
Anyone who works with lots of data can attest that dealing with time and timezones can be tricky business. At Composable, we orchestrate millions of pieces of date/time data through our platform each day. Often, when working with dates, you’ll…