Problem Note 18170: Teradata FASTLOAD performance problems in SAS® 9
Loading data from SAS to Teradata using SAS/Access® Interface to
Teradata's FASTLOAD functionality has shown worse performance in SAS 9
compared to SAS 8.
In order to address this issue, the following steps must be taken:
- Install the hot fix referenced in the link below
- Use the FBUFSIZE data set option to force SAS to use a 32K buffer
size to send data to Teradata
- Change the value of resp_buf_len to 32767 in your clispb.dat file
- Use the OVERRIDE_RESP_LEN=YES LIBNAME option to force SAS to use
the resp_buf_len setting in the clispb.dat file
- Set DBCOMMIT=0 in the LIBNAME statement
The FBUFSIZE data set option should be set to 32000. SAS 9 normally
sends 64000-byte buffers. Setting FBUFSIZE to 32000 reverts the buffer
size back to the SAS 8.2 default.
Setting the resp_buf_len to 32767 in the clispb.dat file and using
OVERRIDE_RESP_LEN=YES forces SAS 9 to revert to the SAS 8.2 default for
the Teradata client response buffer.
By default, a COMMIT is issued after inserting 1000 rows. Setting
DBCOMMIT=0 will allow all rows to be inserted prior to a COMMIT, thus
speeding up the process.
An example of using all of these settings after applying the hot fix is
below:
libname mylib teradata user=xyz password=xyz OVERRIDE_RESP_LEN=YES
DBCOMMIT=0;
data mylib.test(FASTLOAD=YES FBUFSIZE=32000);
do i=1 to 100000;
output;
end;
run;
Select the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
SAS System | SAS/ACCESS Interface to Teradata | Microsoft® Windows® for 64-Bit Itanium-based Systems | 9.1 TS1M3 SP4 | 9.2 TS1M0 |
64-bit Enabled Solaris | 9.1 TS1M3 SP4 | 9.2 TS1M0 |
HP-UX IPF | 9.1 TS1M3 SP4 | 9.2 TS1M0 |
Linux | 9.1 TS1M3 SP4 | 9.2 TS1M0 |
Linux on Itanium | 9.1 TS1M3 SP4 | 9.2 TS1M0 |
64-bit Enabled HP-UX | 9.1 TS1M3 SP4 | 9.2 TS1M0 |
64-bit Enabled AIX | 9.1 TS1M3 SP4 | 9.2 TS1M0 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | medium |
Topic: | SAS Reference ==> LIBNAME Engines Data Management ==> Data Sources ==> External Databases ==> Teradata
|
Date Modified: | 2006-08-02 08:41:40 |
Date Created: | 2006-07-27 07:29:34 |