Composable DataOps Blog
Composable DataOps Blog
Many first time users of Composable have asked “How does Composable compare to Streamsets?” I finally had the opportunity to use Streamsets in a real-life setting a couple of months ago, and boy am I glad I did. Hopefully this…
By default, the C drive on an Azure VM is only 127 GB. Usually, after a few programs are installed and perhaps a Sql Database is setup, you’re on your way to filling up the hard drive. After running the…
We often think of Composable as an IDE for developing data-intensive applications, and we, therefore, strive to provide a full development experience within the Composable web UI. To further that goal, we added global DataFlow level error handling options that…
As we dive into 2019, we’d like to tell you about one of the Composable team’s proudest accomplishments from the last year — the launch of Composable DataOps Platform 2.0. In 2018, we dramatically overhauled the user experience of Composable’s…
Composable has recently added progress-tracking features, including progress metrics and animations. Both of these aim to elucidated DataFlow execution by showing the modules that are currently executing and highlighting potential bottlenecks. When executing a DataFlow, users will now see blue…
Business use cases sometimes demand the orchestration or migration of data from one Relational Database Management System (RDBMS) to another. For example, moving data from MySQL to Oracle, or from Oracle to DB2. In this tutorial, we will work through…
At Composable, we develop MSIs for deploying and upgrading instances of the Composable platform. Anytime we want to update an instance, we just simply double click on the latest Composable installer, and we’re all set. The MSI does everything, and…
Anyone who works with lots of data can attest that dealing with time and timezones can be tricky business. At Composable, we orchestrate millions of pieces of date/time data through our platform each day. Often, when working with dates, you’ll…
Composable is at its heart a platform founded on extensibility. Users can extend our core DataFlow engine with custom modules for their use case, actions in Composable can be scripted via our Fluent API, and automated processes can be packaged…
Software engineers have always been told to parameterize their SQL queries. Why? It avoids any possibilities of SQL injection. Rather than an arbitrary value being formatted into the SQL query, the value is sent as a separate named-value pair, and…
In my last blog post I talked about an ongoing supervised learning project at one of our client’s office (involving me, plus a team of data scientists at the client), the aim being to predict a set of human decisions…
In the vast landscape of data analytics and business intelligence tools, it can be challenging to navigate through the sea of options (see our previous post). At Composable, we have always been proud of offering a unique and powerful solution…
Composable is not only a technology firm but also an outcome-driven partner for our clients. Our approach revolves around leveraging our deep technical expertise and adopting a robust systems engineering mindset to assist our clients in tackling complex technical projects…
Getting Started Information security is a top priority for IT professionals, as it ensures compliance adherence and timely project delivery. When it comes to serving a web application like Composable, enabling HTTPS is paramount for safeguarding the confidentiality and integrity…
When it comes to CRMs these days, Salesforce has maintained its industry leadership for quite some time. But its analytics and reporting capabilities surrounding the data it controls has always been a bit lacking. For creating cross cutting reports and…
When you’re working with large numbers of images, using standard tools like ImageMagick can often feel like an endless cycle of combing through man pages and StackOverflow posts to find the magical sequence of flags to get the results you want. And…
We recently had a client who needed to query data from a legacy system built on FoxPro. What is FoxPro you ask? Fox Software was a company Microsoft purchased back in the early 90s, and they developed a system that…
We recently found an interesting quirk in the Composable DataFlow designer. Spin Module inputs seemed to randomly change values. While editing a DataFlow, sometimes a number would flip from 0 to 1, or 0 to -1, or 1 to 2.…
When thinking about managing and analyzing large and complex datasets, it can be helpful to remember that the volume of data is often not the biggest hurdle for effective analysis, but rather the variety of data sources and formats you…
The search box in Composable DataPortals supports many different powerful search features. In this post we provide an overview of the features you can use when searching tables in Composable DataPortals. Including search boxes for each column field in a…