In this post I would like to take up for discussion a topic that comes up quite often in coversation that oscilate around workflows. Especially common when you talk with Java developers that have interest or experience in that field.
So, what can you expect from this article?
A high level comparion of Apache Camel and workflows - what they have in common, what is the difference between them and how they
can be combined without the need to choose one or the other but take the best of both to bring an ultimate solution to your business problems.
Apache Camel
"Apache Camel is an Open Source integration framework that empowers you to quickly and easily integrate various systems consuming or producing data"
It is really popular, it does a great job, it has active community and it evolves all the time. I could spent almost complete article about Camel and
its strenghts in the integration area but I would like to mainly focus on its capabilities that are in many cases compared with workflows.
Let's start with what is at the heart of Camel - routes. These are definition of the integration logic to be exected. It can be as simple as receiving message on one channel and then putting that message on another. But it can also be way more complex than that, it implements Enterprise Integration Patterns which cover significant area of system integration. But it also comes with components - sort of connectors (consumers or producers or both) that allow routes to connect to outside world.
These capabilities make Camel also a good fit for one of the use cases that workflows are usually considered - service orchestration. And yes, it can do that very well, especially if that orchestration is stateless or short lived. It can cover it pretty well - including error handling, retries, routing, and so on.
So if it is so good why it hasn't replaced workflows?
The main reason for that is the state - as soon as the use case requires persisting state of the execution, Camel does not provide that out of the box. And if you ask me
it's actually good design decision to keep it like that. For that workflows are more prepared, let's expore that in more details.
Workflows
Workflows on the other hand are not really meant to be for integration. Or to rephrese it - only for integration. The biggest misconception about workflows is that they are only for service orchestration. While that is one of common use cases it is not the only one. Quite the opposite, the full power of workflows is with another one - business entity life cycle management. This might sound fancy, but the idea behind this term is actually to use workflows as a definition of the complete life cycle of the entity of your business.
To give an example, imaging automotive industry, product development where one of the most important business entities is a part.
- Every thing is made of parts
- Parts have defined life cycle
- Parts are managed by systems and humans
- Parts are composed and used in various situations
As it can be already deducted, the best landscape for workflows is within the stateful environment. Meaning there is a need to keep the data of the given instance after execution is completed. This brings the concept of long lived execution instances aka workflow instance. Workflows are build of two main parts
- definition - which is sort of a blue print that defines what can happen
- instance - which is a individual representation of the blue print
You might ask can workflows be used for stateless use cases? And the answer is - of course they can and in many situations they are but it does not mean they should always be used. As with everything, use the right tool for the job... which brings us to the next section - why not combining both for the ultimate solution?
Combining Apache Camel and workflows
We explored both Apache Camel and Workflows from the point of thier capabilities (very briefly as both can do a lot) so let's look at an idea to combine both for their strengths that be:
- Apache Camel for its fantastic capabilities to connect to essentially everything
- Workflow for its excellent capabilities of state management and human actors interaction
That's exactly what Automatiko does, it laverages Camel for integration purpose via messaging concept that is well defined in workflows. To be more precise when it comes techincalities, Automatiko uses Reactive Messaging specification to combine Apache Camel and Workflow messaging. Let's take a look at simple example that uses camel file component to watch a folder for files and for each file a new instance of the workflow is started.
Start workflow based on incomin file watched by Camel.
As can be seen on the screenshot above, camel endpoint is defined as attribute on the message defined in the workflow. More details how messaging (and Camel integration) works can be found in Automatiko documentation
Combining both will give a lot of power to build sofisticated business solution that bring visibility to the team and allow to make use of battle tested integration capabilities of Camel. At the same time not ubusing it for stateful use cases where state and the data needs to be kept.
When to use which?
That's essentially the main question for this article to answer. The simple and short answer would be - if you have pure integration use case that do not involve state then go ahead and use Apache Camel - it was designed and made for that. But if you need to support long running instances, retries over time (like after a day, week etc) or you need to involve human actors then workflows will certainly fit better.
Last but not least, I'd like to point out once again, do not consider workflows to be orchestration only - even though there is a lot of buzz about that use case from many vendors consider it more for expressing your business logic as you might already know it, workflows are also known as business processes and they are well understood by a lot of business stake holders.
Interested to know more?
Here are few links that can help you to learn more about the concepts described here:
Photographs by Unsplash.