After implementing OIA on a number of real-world engagements, I’ve slowly grown tired of the 3rd party clover ETL scheduler configured OOTB for data imports. From my experience, many organizations have a centralized ETL framework for manipulations so there’s no logical justification to segregate OIA’s required ETL efforts. But what if they’re missing an ETL framework? Were talking about the minority of companies here though here’s an alterative to scheduling imports into OIA.
As clover ETL is a 3rd party technology, you are required to purchase at an independent license, probably the GUI desktop version for 1 system, costing a whopping $4000.
As an alterative, I have stewed more toward the concept of java pre-processors (JPPs) to accommodate the code modification and conformance checking. I find Individuals also prefer the scalability of java as a technology to clover.
The image presents the concept of a JPPs becoming the intermediate from converting any data feeds into the acceptable OIA format, which can then be dropped into the OIA staging repository in preparation to importing them into OIA.
With this in mind, I have been suggesting this alternative to companies though I only recently came across the idea of java classes as java beans and allowing OIA’s spring framework to schedule the alteration.
For scheduling purposes, the java file should extend the TimerTask package which will make the manipulations required to then populate this into the OIA staging as a new file.
I have created a new file called jpp-etl.xml, which resides within the WEB-INF directory and altered the web.xml (to reference the jpp-etl.xml file). Once configured, OIA can then take the responsibility on the ETL effort without the dependency of OOTB clover graphs.
About the author
Daniel is a Technical Manager with over 10 years of consulting expertise in the Identity and Access Management space.Daniel has built from scratch this blog as well as technicalconfessions.com
Follow Daniel on twitter @nervouswiggles
Comments
Other Posts
AS I was migrating my environment into an S3 environment, I wanted to leverage off the SES services that AWS provide, more specifically, to leverage the off the SMTP functionality by sending an email via PHP
Read More...
The WeMos D1 is a ESP8266 WiFi based board is an extension to the current out-of-the-box library that comes with the Arduino installation. Because of this, you need to import in the libraries as well as acknowledging the specific board. This process is highly confusion with a number of different individuals talking about a number of different ways to integrate.
Read More...
NameID element must be present as part of the Subject in the Response message, please enable it in the IDP configuration.
Read More...
For what I see, there's not too many supportive documentations out there that will demonstrate how provision AD group membership with the ICF connector using OpenIDM. The use of the special ldapGroups attribute is not explained anywhere in the Integrators guides to to the date of this blog. This quick blog identifies the tasks required to provision AD group membership from OpenIDM to AD using the LDAP ICF connector. However this doesn't really explain what ldapGroups actually does and there's no real worked example of how to go from an Assignment to ldapGroups to an assigned group in AD. I wrote up a wiki article for my own reference: AD group memberships automatically to users This is just my view, others may disagree, but I think the implementation experience could be improved with some more documentation and a more detailed example here.
Read More...
In the past, the similar error occurred though for the Oracle Identity Management solution. invalidcredentialexception remote framework key is invalid Because they all share the ICF connector framework, the error/solution would be the same.
Read More...
org.forgerock.script.exception.ScriptCompilationException: missing ; before statement
Read More...
ForgeRock IDM - org.forgerock.script.exception.ScriptCompilationException: missing ; before statement
Read More...
When performing the attempt of a reconciliation from ForgeRock IDM to Active Directory, I would get the following error
Read More...
In the past, the similar error occurred though for the Oracle Identity Management solution. invalidcredentialexception remote framework key is invalid Because they all share the ICF connector framework, the error/solution would be the same.
Read More...
During the reconcilation from OpenIDM to the ICF google apps connector, the following error response would occur. ERROR Caused by com.google.api.client.auth.oauth2.TokenResponseException 400 Bad Request - invalid_grant
Read More...