Problem Note 62781: The manifest file for a Redshift bulk load does not include all data files when you use SAS/ACCESS® Interface to Amazon Redshift
 |  |  |  |  |
When you use the BL_USE_MANIFEST=YES bulk-load option, the manifest file that is generated is incomplete. This issue occurs for large loads that require multiple files to be recorded in the manifest file. As a result, a bulk load using this option results in an incomplete load of the data.
As a workaround, set BL_USE_MANIFEST=NO to allow the bulk-load option to run successfully.
Here is an example workaround:
libname libred redshift server=rs-server db=rs-db user=user-ID pwd=password port=5439;
data libred.myclass(
bulkload=yes
bl_bucket=myBucket
bl_key=99999
bl_secret=12345
bl_default_dir='/tmp'
bl_region='us-east-1'
bl_use_manifest=no);
set sashelp.class;
run;
bulkload=yes
bl_bucket=myBucket
bl_key=99999
bl_secret=12345
bl_default_dir='/tmp'
bl_region='us-east-1'
bl_use_manifest=no);
set sashelp.class;
run;
Click the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
| Product Family | Product | System | Product Release | SAS Release | ||
| Reported | Fixed* | Reported | Fixed* | |||
| SAS System | SAS/ACCESS Interface to Amazon Redshift | Windows 7 Home Premium x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 |
| Windows 7 Home Premium 32 bit | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Windows 7 Enterprise x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Windows 7 Enterprise 32 bit | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows Server 2012 Std | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows Server 2012 R2 Std | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows Server 2012 R2 Datacenter | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows Server 2012 Datacenter | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows Server 2008 for x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows Server 2008 R2 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows Server 2008 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 10 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 8.1 Pro x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 8.1 Pro 32-bit | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 8.1 Enterprise x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 8.1 Enterprise 32-bit | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 8 Pro x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 8 Pro 32-bit | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 8 Enterprise x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft Windows 8 Enterprise 32-bit | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Microsoft® Windows® for x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Windows 7 Professional 32 bit | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Windows 7 Professional x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Windows 7 Ultimate 32 bit | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Windows 7 Ultimate x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| 64-bit Enabled AIX | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| 64-bit Enabled Solaris | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| HP-UX IPF | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Linux for x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
| Solaris for x64 | 9.41 | 9.42 | 9.4 TS1M4 | 9.4 TS1M5 | ||
A fix for this issue for SAS/ACCESS Interface to Amazon Redshift 9.41 is available at:
https://tshf.sas.com/techsup/download/hotfix/HF2/C7J.html#62781
When you use the bulk-load option, the manifest file is overwritten for each data file created. This behavior results in only a single file being recorded in the manifest, which causes the bulk-load option to potentially load only a portion of the expected data.
| Type: | Problem Note |
| Priority: | high |
| Date Modified: | 2018-08-17 16:36:21 |
| Date Created: | 2018-08-16 13:50:18 |