Oracle® Fusion Middleware

Release Notes for Oracle Data Integrator

12c (12.2.1)

E57996-01

October 2015

This document describes known issues associated with Oracle Data Integrator and includes information regarding post-installation patches. It includes the following sections:

- Section 1, "Oracle Data Integrator 12.2.1 ReadMe File"

- Section 2, "Oracle Data Integrator Console Issues and Workarounds"

- Section 3, "Configuration Issues and Workarounds"

- Section 4, "Design-Time Environment Issues and Workarounds"

- Section 5, "Technologies and Knowledge Module Issues and Workarounds"

- Section 6, "Post-install Patch Information for Oracle Data Integrator 12c"

1 Oracle Data Integrator 12.2.1 ReadMe File

A ReadMe file is included in your distribution. It is located in the top level directory of the zip. The ReadMe file includes information about this release (features, prerequisites, install/uninstall instructions). You must use the ReadMe file to install ODI 12.2.1. Please read the entire ReadMe file before proceeding.

2 Oracle Data Integrator Console Issues and Workarounds

This section contains information on the following:

- Section 2.1, "Accessibility Settings are Not Working"

2.1 Accessibility Settings are Not Working

Accessibility settings can only be applied to the components whose accessibility settings are not managed at the ADF level. [20584947]

3 Configuration Issues and Workarounds

This section contains information on the following issues:

- Section 3.1, "999 is a Prohibited Master Repository ID"

- Section 3.2, "Domain Assisted Schema Upgrade (DASU) Does Not Pre-populate ODI Supervisor Credentials"

3.1 999 is a Prohibited Master Repository ID

999 is a prohibited master repository ID and should not be used. [21083009]

3.2 Domain Assisted Schema Upgrade (DASU) Does Not Pre-populate ODI Supervisor Credentials

In the Oracle Fusion Middleware Upgrade Assistant, when the All Schemas Used by Domain option is selected, the Supervisor credentials for ODI are not pre-populated in the first instance as the domain does not contain them. If there are multiple ODI schemas, the Upgrade Assistant populates the user entry using the first set of credentials. [20323393]

4 Design-Time Environment Issues and Workarounds

This section contains information on the following issues:

- Section 4.1, "Preferences that are Not Used in Oracle Data Integrator Appear in ODI Studio"

- Section 4.2, "Attributes are Not Copied when Duplicating a New Datastore"

- Section 4.3, "Unable to Generate a Scenario Using the Client Library Package"

- Section 4.4, "Non-ASCII Characters in a Hive Table are Not Displayed Properly"

4.1 Preferences that are Not Used in Oracle Data Integrator Appear in ODI Studio

Preferences that are not used in ODI are getting picked up from the JDeveloper IDE by default and these features appear in ODI Studio > Tools > Preferences. [21656747]

4.2 Attributes are Not Copied when Duplicating a New Datastore

If you attempt to duplicate a newly created datastore with attributes without first closing the tab of the newly created datastore, the attributes are not copied.

As a workaround, save and close the newly created datastore with attributes before selecting Duplicate Selection. [21572433]

4.3 Unable to Generate a Scenario Using the Client Library Package

If you attempt to generate a scenario for a map using the client library package, the following error is displayed:

java.lang.NoClassDefFoundError: groovy/lang/Binding

As a workaround, copy MW_HOME/oracle_common/modules/groovy-all-2.3.7.jar locally and add the jar file to the classpath. [21510593]

4.4 Non-ASCII Characters in a Hive Table are Not Displayed Properly

Non-ASCII characters in a Hive table that is based on a utf-8 encoded file are not displayed properly. As a workaround, specify -J-Dfile.encoding=utf8 and start ODI Studio to view Non-ASCII characters in a Hive table. [19632983]

5 Technologies and Knowledge Module Issues and Workarounds

This section contains information on the following issues:

- Section 5.1, "LKM Hive to File Direct Fails when Exporting to HDFS"

- Section 5.2, "Log Files are Deleted Even in Case of Failure when Using the OdiOSCommand on Oozie"

- Section 5.3, "Error Displayed During Oozie Initialization"

- Section 5.4, "SQOOP KMs Fail on Oozie"

- Section 5.5, "Teradata and SQL Server Do Not Allow ORDER BY in Subqueries"

- Section 5.6, "Pig Does Not Provide Implicit Type Conversion"

- Section 5.7, "Mapping Execution Fails in Pig"

- Section 5.8, "Complex Aggregation Not Supported by Pig Latin"

- Section 5.9, "Mapping Editor May Not Display All Template IKMs"

- Section 5.10, "Date Comparison May Not Work as Expected if the Date is a String Datatype"

- Section 5.11, "LKM File to Oracle (External Table) Limitation"

- Section 5.12, "XKM SQL Distinct Limitation"

- Section 5.13, "The UNION_DISTINCT Pig Operator Does Not Remove Duplicate Outputs"

- Section 5.14, "Log Level and Log File Not Displayed in the Complex File Dataserver Properties"

- Section 5.15, "BinaryType Data Type Not Supported in Spark 1.1"

- Section 5.16, "Hive Complex Datatypes Not Supported by LKM Spark to Hive"

- Section 5.17, "Unable to Store Alias Error in Pig"

- Section 5.18, "KMs Replaced During Repository Upgrade"

- Section 5.19, "Erroneously Published SDK API Classes Removed from the 12.2.1 Javadocs"

5.1 LKM Hive to File Direct Fails when Exporting to HDFS

When executing a mapping using LKM Hive to File Direct, it fails and the following error is displayed:

ODI-1227: Task Unload Hive data-LKM Hive to File Direct- fails on the source connection HIVE_DATA_SERVER

This is caused due to Hive bugs, HIVE-5672 and HIVE-6410, which cause the INSERT OVERWRITE statement to fail when writing to HDFS. Please note that these Hive bugs are already fixed and the issue is resolved when upgraded to a recent version of CDH and Hortonworks. [21529011]

5.2 Log Files are Deleted Even in Case of Failure when Using the OdiOSCommand on Oozie

Many KMs that use OdiOSCommand use the OUT_FILE/ERR_FILE parameters to redirect output into log files.The directory for such files is based on the KM option TEMP_DIR, which uses a default value of System.getProperty("java.io.tmpdir"). This causes ODI on Oozie to use an Oozie job temporary directory, which gets cleaned up on job completion, irrespective of whether or not the job was successful. This results in the log files not being available after execution.

As a workaround, when executing on Oozie, overwrite the KM option TEMP_DIR to a specific temporary directory. [21232650]

5.3 Error Displayed During Oozie Initialization

There is an issue with the OdiLogRetriever.properties file and the oozie.coord.application.path value does not get appended to it and the following error is displayed: [21410186]

E0504: App directory doesn't exist

5.4 SQOOP KMs Fail on Oozie

KMs using SQOOP fail when executed on Oozie on a CDH version prior to 5.4.1.

As a workaround, set KM option EXTRA_HADOOP_CONF_PROPERTIES to --skip-dist-cache. Another workaround for this issue is to upload all SQOOP jars into HDFS in the directory reported in FileNotFoundException. For example: [21232570]

hdfs dfs -mkdir -p /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/jars
hdfs dfs -copyFromLocal
/opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/jars/* /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/jars

5.5 Teradata and SQL Server Do Not Allow ORDER BY in Subqueries

Teradata and SQL Server do not allow ORDER BY in subqueries. [20873100, 20816875]

5.6 Pig Does Not Provide Implicit Type Conversion

When specifying constant expressions, the datatype for the constant must exactly match the attribute datatype because Pig does not provide implicit type conversion. For example, if the attribute is defined as DOUBLE, the constant expression for this attribute should be set to 999.0 instead of 999. [20808984]

5.7 Mapping Execution Fails in Pig

When a mapping is processed using Pig and there is an Aggregate component in the Pig staging area, the Having clause must be set differently from similar mappings for SQL-based technologies. [20723728]

5.8 Complex Aggregation Not Supported by Pig Latin

When using the Aggregate component in Pig staging, you cannot specify a complex expression in an aggregate function, for example, SUM(source.col1 + source.col2). This kind of aggregation is called "complex aggregation" and Pig Latin does not support this. If complex expression is needed, the Expression component must be added to the mapping ahead of the Aggregate component. [20302859]

5.9 Mapping Editor May Not Display All Template IKMs

The Mapping Editor may not correctly list the imported Template IKMs for selection. To list the imported IKMs, you must change the Target Integration type from its default (Control Append) to either Incremental Update or None. [20583432]

5.10 Date Comparison May Not Work as Expected if the Date is a String Datatype

In the Spark project, if the source file uses File technology, ODI converts the Date into a string datatype. This may cause the Date comparison to fail. [20029929]

5.11 LKM File to Oracle (External Table) Limitation

When executing a mapping, it may fail at the Create Work View task and the following error may be displayed:

ODI-1228: Task Create work view-LKM File to Oracle (EXTERNAL TABLE)- fails on the target connection SVR2_ORACLE.
Caused By: java.sql.SQLSyntaxErrorException: ORA-00955: name is already used by an existing object

This happens when the work table name is truncated to meet the maximum length specified in Oracle DB. To resolve this issue, check the Use unique Temporary Object Names option in the Physical Mapping tab. [20142371]

5.12 XKM SQL Distinct Limitation

When a mapping is created with Oracle as source and Oracle as target using a Distinct component and the XKM SQL Distinct is selected in the DISTINCT node, the mapping fails and the following error is displayed:

The physical node DISTINCT_ cannot be supported by technology Oracle on execution unit src_UNIT of mapping Mapping New_Mapping[11] owning folder=ODIOGG.First Folder

To resolve this issue, upgrade the topology information so Support Distinct Operator is set to True. [20234590]

5.13 The UNION_DISTINCT Pig Operator Does Not Remove Duplicate Outputs

The UNION Pig operator uses the following modifiers to specify the uniqueness characteristic: [20368827]

- unspecified – Perform a DISTINCT operation on output

- DISTINCT – Perform a DISTINCT operation on input, but not output

- ALL – Do not perform a DISTINCT operation on input or output

5.14 Log Level and Log File Not Displayed in the Complex File Dataserver Properties

When creating a Complex File dataserver, the log level (ll) and log file (lf) properties are not displayed in the Properties tab. [20377218]

5.15 BinaryType Data Type Not Supported in Spark 1.1

The Hive datatype, BinaryType, is not supported in Spark 1.1. When using LKM Hive to Spark with Spark 1.1 the following error is displayed in the Spark execution log: [20260906, 20391714]

HIVE ValueError: not supported type: <type 'bytearray'>

5.16 Hive Complex Datatypes Not Supported by LKM Spark to Hive

The following Hive complex datatypes are not supported:

- MapType

- UnionType

- ArrayType

Using these complex datatypes causes an unknown issue. [20141453, 20391743]

5.17 Unable to Store Alias Error in Pig

If the mapping execution in Pig fails and the Unable to store alias error is displayed, the pig.optimizer.rules.disabled property for the Pig server should be set to FilterLogicExpressionSimplifier. [20520865]

5.18 KMs Replaced During Repository Upgrade

By default, all loaded KMs in the repository are replaced during repository upgrade, irrespective of whether they are modified or not. Do not upgrade the KMs during repository upgrade.

The following are the workarounds to upgrade the KMs:

- If you have SAP KMs, you must not upgrade the KMs during repository upgrade. The new SAP KMs require new ODI SAP components. Using new SAP KMs with old ODI SAP components causes any SAP mappings to fail.
As a workaround, uncheck Replace KMs with Mandatory Updates when upgrading the ODI repositories. To upgrade SAP KMs, follow the upgrade instructions given in the Application Adapters Guide for Oracle Data Integrator for the respective ODI SAP adapter.

- If you have any custom KMs, the customizations are lost if you upgrade the KMs during repository upgrade.
As a workaround, uncheck Replace KMs with Mandatory Updates when upgrading the ODI repositories. After you upgrade the repositories, manually replace only those KMs that you want to upgrade.

5.19 Erroneously Published SDK API Classes Removed from the 12.2.1 Javadocs

Due to a bug in Javadoc generation, 41 internal classes were erroneously published in the 12.1.2, 12.1.3, and 12.1.3.0.1 public SDK API Javadocs. These classes were intended for internal use and have been removed from the 12.2.1 public SDK APIs. The classes removed from the 12.2.1 Javadocs are listed below and if you are using any of these classes in your program, correct your program and remove their usage: [21700125]

- AdapterException

- ComponentDefinitionParser

- ComponentRegistryHelper

- ExecutionUnit.GenerationType

- FCONamedObject

- FCOPropertyOwner

- FCORoot

- IMapReferenceOwner

- IMappingObject.SyncState

- IModelObjectChange

- IModelObjectChange.ChangeType

- IObjectAdapterFactory

- LocationAdapterBase

- MapAttribute.ConnectionTypeInfo

- MapAttribute.ConnectionTypeSelector

- MapAttribute.DefaultConnectionTypeSelector

- MapComponent

- MapComponentOwner

- MapComponentType.uidef

- MapPhysicalDesign.ContextualComponentTreeNode

- MapPhysicalDesign.ExecutionUnitConfiguration

- MapPhysicalDesign.ExecutionUnitGraph

- MapPhysicalDesign.ExecutionUnitGraphNode

- MapPhysicalDesign.MapPhysicalDesignConfig

- MapPhysicalDesign.NodeConfiguration

- MapPhysicalDesign.PushDirection

- MapPhysicalNode.RMCStackPropertyManager

- MapRootContainer

- MappingGenericTechnology.MappingLanguage

- MappingGenericTechnology.MappingLanguageElement

- MappingGenericTechnology.MappingSubLanguage

- NamedObject

- OdiComponent

- OdiInterface.IPersistenceComparable

- PropertyOwner

- ResourceLoader

- ResourceLoader.ResourceCandidate

- ReusableMappingComponent.RMCConnectorPointDelegate

- Root

- RootIssue.TextPos

- TargetLoadOrderException

6 Post-install Patch Information for Oracle Data Integrator 12c

After installing Oracle Data Integrator 12c (12.2.1) you should preform the following:

1. Make a backup of your ODI repository schema.

2. Upgrade all ODI repositories associated with the installation using the Upgrade Assistant. See your Upgrade documentation for detailed upgrade instructions.

Warning:
Once the ODI repository is upgraded it cannot be reverted back even if you remove the patch. So make sure you make a proper backup of your existing ODI repository so that it can be restored if you remove this patch in the future for any reason.

3. For setting up new domains with this patch, follow the instructions in Oracle Fusion Middleware Installing and Configuring Oracle Data Integrator.

4. Clearing of the JDev cache is required for all installations where the ODI Client is to be launched:

- For Unix platforms
Locate system12.2.1.0.0 in your Home directory and remove it.

For example: rm -rf $HOME/.odi/system12.2.1.0.0

- For Windows platforms:
Locate system12.2.1.0.0 in your Home directory and remove it.

For example: delete C:\Users\<username>\AppData\Roaming\odi

5. Start ODI Studio.

6. Depending upon the installation type, start Standalone Agent or all servers (AdminServer and all Managed server(s)).

7 Documentation Accessibility

For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.

Oracle® Fusion Middleware Release Notes for Oracle Data Integrator, 12c (12.2.1)

E57996-01

Copyright © 2010, 2015, Oracle and/or its affiliates. All rights reserved.

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.

This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.

Oracle Legal Notices

Copyright Notice

Copyright © 1994-2015, Oracle and/or its affiliates. All rights reserved.

Trademark Notice

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.

License Restrictions Warranty/Consequential Damages Disclaimer

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.

Warranty Disclaimer

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

Restricted Rights Notice

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

Hazardous Applications Notice

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.

Third-Party Content, Products, and Services Disclaimer

This software or hardware and documentation may provide access to or information on content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services.

Alpha and Beta Draft Documentation Notice

If this document is in preproduction status:

This documentation is in preproduction status and is intended for demonstration and preliminary use only. It may not be specific to the hardware on which you are using the software. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to this documentation and will not be responsible for any loss, costs, or damages incurred due to the use of this documentation.