Last week I presented on Apache Kafka – twice. Once to a group of over 100 students, once to 30+ colleagues. In both instances, I invited attendees to partake in a workshop with hands-on labs to get acquainted with Apache Kafka. I had prepared a Docker Compose based Kafka platform […]
SOA
Articles on Oracle Fusion Middleware such as Oracle BPEL PM, Oracle Enterprise Service Bus, Oracle Business Rules, Web Service Manager and Service Oriented Architecture in general.
Filesystem events to Elasticsearch / Kibana through Kafka Connect / Kafka
Filesystem events are useful to monitor. They can indicate a security breach. They can also help understanding how a complex system works by looking at the files it reads and writes. When monitoring events, you can expect a lot of data to be generated quickly. The events might be interesting […]
Securing Oracle Service Bus REST services with OAuth2 client credentials flow (without using additional products)
OAuth2 is a popular authentication framework. As a service provider it is thus common to provide support for OAuth2. How can you do this on a plain WebLogic Server / Service Bus without having to install additional products (and possibly have to pay for licenses)? If you just want to […]
Running Kafka, KSQL and the Confluent Open Source Platform 4.x using Docker Compose on a Windows machine
For conducting some experiments and preparing several demonstrations I needed a locally running Kafka Cluster (of a recent release) in combination with a KSQL server instance. Additional components from the Core Kafka Project and the Confluent Open Source Platform (release 4.1) would be convenient to have. I needed everything to […]
Simple CQRS – Tweets to Apache Kafka to Elastic Search Index using a little Node code
Put simply – CQRS (Command Query Responsibility Segregation) is an architecture pattern that recognizes the fact that it may be wise to separate the database that processes data manipulations from the engines that handle queries. When data retrieval requires special formats, scale, availability, TCO, location, search options and response times, […]
SOA Suite 12c in Docker containers. Only a couple of commands, no installers, no third party scripts
For developers, installing a full blown local SOA Suite environment has never been a favorite (except for a select few). It is time consuming and requires you to download and run various installers after each other. If you want to start clean (and you haven’t taken precautions), it could be […]
Get going with KSQL on Kubernetes
This article describes how to quickly get going with KSQL on Kubernetes. KSQL is Confuent’s ‘continuous streaming query language’. It allows us to write SQL-like queries that operate on Kafka Topics. Queries that join, filter and aggregate – for each event that gets produced and over time windows. Results are […]
15 Minutes to get a Kafka Cluster running on Kubernetes – and start producing and consuming from a Node application
For workshop I will present on microservices and communication patterns I need attendees to have their own local Kafka Cluster. I have found a way to have them up and running in virtually no time at all. Thanks to the combination of: Kubernetes Minikube The Yolean/kubernetes-kafka GitHub Repo with Kubernetes […]
How to install the Oracle Integration Cloud on premises connectivity agent (18.1.3)
Recapitulation on how to install the Oracle Integration Cloud on premises connectivity agent Recently (april 2018) I gained access to the new Oracle Integration Cloud (OIC), version 18.1.3.180112.1616-762, and wanted to make an integration connection to an on-premise database. For this purpose, an on premise connectivity agent needs to be […]
Automate calls to SOAP and REST webservices using simple Python scripts
Probably not many people will tell you running batches over webservices is a good idea. Sometimes though, it can be handy to have a script available to generate webservice calls based on a template message with variables and automate processing the response messages. In addition, if you have a large […]
Recording, slides and code resources for Oracle Code session: Real Time UI with Apache Kafka Streaming Analytics of Fast Data and Server Push
On YouTube, you will find the 44 min recording of my talk on Oracle Code San Francisco (October 2017): https://www.youtube.com/watch?v=khP3yHmbtpM The slides are on SlideShare: Real Time UI with Apache Kafka Streaming Analytics of Fast Data and Server Push (OracleCode San Francisco 2017) from Lucas Jellema All code sources are […]
Oracle SOA Suite and WebLogic: Overview of key and keystore configuration
Keystores and the keys within can be used for security on the transport layer and application layer in Oracle SOA Suite and WebLogic Server. Keystores hold private keys (identity) but also public certificates (trust). This is important when WebLogic / SOA Suite acts as the server but also when it […]
Oracle SOA Suite: Want performance? Don’t log so much and clean up your database!
The Oracle SOA Suite infrastructure, especially composites, use the database intensively. Not only are the process definitions stored in the database, also a lot of audit information gets written there. The SOA infrastructure database, if not well managed, will grow and will eventually have detrimental effects on performance. In this […]
Oracle SOA Suite: Two-way SSL with TLS1.2 made easy (slightly less complicated)
Transport layer security (TLS) is not an easy topic. Many blogs have been written about this already. Surprisingly though, I did not find a single blog which was more or less complete and provided me with everything I needed to know to get this working on SOA Suite 12.2.1. In […]
Development and Runtime Experiences with a Canonical Data Model Part I: Standards & Guidelines
Introduction In my previous blog I’ve explained what a Canonical Data Model (CDM) is and why you should use it. This blog is about how to do this. I will share my experiences on how to create and use a CDM. I gained these experiences at several projects, small ones, […]
Development and Runtime Experiences with a Canonical Data Model Part II: XML Namespace Standards
This blog is about XML namespace standards. Primary for using them in a Canonical Data Model (CDM), but also interesting for anyone who has to define XML data by creating XML Schema files (XSD). This blogpost is the second part of a trilogy about my experiences in using and developing […]
Development and Runtime Experiences with a Canonical Data Model Part III: Dependency Management & Interface Tailoring
Introduction This blogpost is part III, the last part of a trilogy on how to create and use a Canonical Data Model (CDM). The first blogpost contains part I in which I share my experiences in developing a CDM and provide you with lots of standards and guidelines for creating […]
Oracle SOA Suite: Find that composite instance!
When executing BPM or BPEL processes, they are usually executed in the context of a specific entity. Sometimes you want to find instances involved with a specific entity. There are different ways to make this easy. You can for example use composite instance titles or sensors and set them to […]
Oracle Public Cloud – Invoking ICS endpoints from SOA CS – configure SSL certificate and basic authentication
As part of the Soaring through the Clouds demo of 17 Oracle Public Cloud services, I had to integrate SOA CS with both ACCS (Application Container Cloud) and ICS (Integration Cloud Service). Calls from Service Bus and SOA Composites running in SOA Suite 12c on SOA CS to endpoints on […]
Oracle Service Bus : Service Exploring via WebLogic Server MBeans with JMX
At a public sector organization in the Netherlands there was the need to make an inventory of the deployed OSB services in order to find out, the dependencies with certain external web services (which were on a list to become deprecated). For this, in particular the endpoints of business services […]
Oracle Service Bus : disable / enable a proxy service via WebLogic Server MBeans with JMX
At a public sector organization in the Netherlands an OSB proxy service was (via JMS) reading messages from a WebLogic queue. These messages where then send to a back-end system. Every evening during a certain time period the back-end system was down. So therefor and also in case of planned […]
Kafka Streams and NodeJS – Consuming and periodically reporting in Node.JS on the results from a Kafka Streams streaming analytics application
In several previous articles on Apache Kafka, Kafka Streams and Node.JS for interacting with Apache Kafka, I have described how to create a Node.JS application that publishes messages to a Kafka Topic (based on entries in a CSV file), how to create a simple Kafka Streams Java application that processes […]
Oracle Service Bus: Produce messages to a Kafka topic
Oracle Service Bus is a powerful tool to provide features like transformation, throttling, virtualization of messages coming from different sources. There is a (recently opensourced!) Kafka transport available for Oracle Service Bus (see here). Oracle Service Bus can thus be used to do all kinds of interesting things to messages […]
Oracle Service Bus: Pipeline alerts in Splunk using SNMP traps
Oracle Service Bus provides a reporting activity called Alert. The OSB pipeline alerts use a persistent store. This store is file based. Changing the persistent store to JDBC based, does not cause pipeline alerts to be stored in a database instead of on disk. When the persistent store on disk […]
Gebruik van de “Standaard Zaak-en Documentservices 1.1” van Kwaliteitsinstituut Nederlandse Gemeenten (KING), almede MTOM/XOP t.b.v. een koppeling tussen diverse applicaties (gerealiseerd binnen OSB 11g) aangaande het proces van vergunningverlening voor een organisatie in de publieke sector
Voor een organisatie in de publieke sector werd aan AMIS gevraagd om met behulp van Oracle Service BUS 11g, een koppeling te realiseren tussen diverse applicaties aangaande het proces van vergunningverlening, zodat de daarbij benodigde gegevens eenvoudiger geautomatiseerd verwerkt konden worden. Belangrijke randvoorwaarden uit het Solution Design waren: het hanteren […]
Beats and Fusion Middleware
This is the 6th blog in a series on the Elastic product stack. This blog will cover how Beats fits into the mix with Logstash, Kibana and Elasticsearch. The series cover: 1. Elasticsearch and Oracle Middleware – is there an opportunity? 2. Installation of Elasticsearch: installation and the indexing of […]
Logstash and Fusion Middleware
This is the 5th blog in a series on the Elastic product stack. This blog will cover how Logstash can pick up Fusion Middleware log files and put the log file lines into Elasticsearch. The series cover: 1. Elasticsearch and Oracle Middleware – is there an opportunity? 2. Installation of […]
Kibana for ACM dashboards
This is the 4th blog in a series on the Elastic product stack. This blog will cover the Kibana product. The series cover: 1. Elasticsearch and Oracle Middleware – is there an opportunity? 2. Installation of Elasticsearch: installation and the indexing of – human generated – documents 3. Elasticsearch and […]
Elasticsearch and Oracle ACM data
This blog is one of a series of 6 blogs around the combination of Elasticsearch (‘the ELK stack’) and Oracle Adaptive Case Management. The series cover: 1. Elasticsearch and Oracle Middleware – is there an opportunity? 2. Installation of Elasticsearch: installation and the indexing of – human generated – documents […]
Installation of Elasticsearch
This blog is one of a series of 6 blogs around the combination of Elasticsearch (‘the ELK stack’) and Oracle Adaptive Case Management. The series cover: 1. Elasticsearch and Oracle Middleware – is there an opportunity? 2. Installation of Elasticsearch: installation and the indexing of – human generated – documents […]
Elasticsearch and Oracle Middleware – is there an opportunity?
Introduction In a couple of blog articles I will described how to get started with Elasticsearch and Oracle Fusion Middleware. Elasticsearch is described on the elastic.co website as ‘Elasticsearch is a distributed, RESTful search and analytics engine capable of solving a growing number of use cases.’ Blogs 3 and 4 […]
Oracle Service Bus: A quickstart for the Kafka transport
As mentioned on the following blog post by Lucas Jellema, Kafka is going to play a part in several Oracle products. For some usecases it might eventually even replace JMS. In order to allow for easy integration with Kafka, you can use Oracle Service Bus to create a virtualization layer […]
The Oracle Integration Platform Portfolio as per OOW 2016 – on premises and primarily in the cloud
One of the very first capabilities Oracle ever introduced in its PaaS portfolio was integration. It was clear from the onset of any talk about clouds that facilities to do integration between cloud and on premises as well as between various clouds [from different vendors] would be essential. With its […]
Cloud based Human Workflow and Business Process automation – PCS, BPM Suite on the Cloud, BPM Suite on Premises
On premises BPM Suite has been Oracle’s flagship product for business process automation for many years. Based on the industry standard of BPMN and tightly integrated with SOA Suite for integrations, it has been widely used to implement complex and typically long running business processes. The recent addition of Adaptive […]
Java Callout from Business Rules
Goal and warning This blog will show how to invoke java code directly from within a Business Rules component. I didn’t manage to find this in the Oracle product documentation, which is actually a good thing. Invoking java code with business logic directly from within the Business Rules is normally […]
What can we learn from the Microservices movement?
If you’re into integration, SOA or web services, you’ve probably heard the term Microservices fairly often lately. Is applying Microservices architecture the one-size-fits-all solution that can replace the traditional one-size-fits-all SOA solution that doesn’t fit anymore? Of course not, because the world isn’t just black and white and both architectural […]
Benefits of a Canonical Data Model (CDM) in a SOA environment
Introduction The last few years I’ve been working in several SOA related projects, small projects as well as quite large projects. Almost all of these projects use a Canonical Data Model (CDM). In this post I will explain what a CDM is and point out what the benefits are of […]
FTP Adapter Configuration for SFTP
Introduction At my current project incoming data files, located at a third party FTP server, have to be read using SFTP. Despite of several blog posts and the FTP Adapter documentation of Oracle, it took us a full day to get a working SFTP configuration. I use this blogpost to […]
Oracle SOA Suite Code Quality: SonarQube Quality Gates, XML Plugin and custom XPath rules
There are several ways to do code quality checks in SOA Suite. In this blog post I will describe a minimal effort setup which uses Jenkins 2.9, SonarQube 5.6 and the SonarQube XML Plugin 1.4.1. SonarQube is a popular tool to check and visualize code quality. An XML Plugin is […]
Seamless source “migration” from SOA Suite 12.1.3 to 12.2.1 using WLST and XSLT
When you migrate sources from SOA Suite 12.1.3 to SOA Suite 12.2.1, the only change I’ve seen JDeveloper do to the (SCA and Service Bus) code is updating versions in the pom.xml files from 12.1.3 to 12.2.1 (and some changes to jws and jpr files). Service Bus 12.2.1 has some […]