The purpose of this Spotlight is to demonstrate the use of the DoWhile module to loop within a Composable DataFlow. Our scenario: The Fibonacci sequence is one of the best-known…
Posts published in “DataOps”
The purpose of this Spotlight is to demonstrate the mechanics of a simple, classic For loop within a Composable DataFlow. Our scenario: We are told to expect delivery of a…
DRY When building out any logical process, it is common to imagine reusability of components that you have built. Whether that is making a copy for yourself to take in…
Many first time users of Composable have asked “How does Composable compare to Streamsets?” I finally had the opportunity to use Streamsets in a real-life setting a couple of months…
Business use cases sometimes demand the orchestration or migration of data from one Relational Database Management System (RDBMS) to another. For example, moving data from MySQL to Oracle, or from…
In my last blog post I talked about an ongoing supervised learning project at one of our clients’ office (involving me, plus a team of data scientists at the client),…
When thinking about managing and analyzing large and complex datasets, it can be helpful to remember that the volume of data is often not the biggest hurdle for effective analysis,…