Starting with the 5.16.0 release, Mainframe Connector creates a table
that logs all the errors that it encountered during the transcoding process
using the qsam decode
and qsam encode
commands. This table is called the spillover dataset. The spillover dataset
output format can be any of the following:
- Optimized Row Columnar (ORC) file
- Queued Sequential Access Method (QSAM) file
You can use this information to audit or debug your transcoding process.
Spillover dataset created by qsam decode
As part of the decoding process the qsam decode command creates
a spillover dataset with the following schema.
| Field name | Type | Description |
|---|---|---|
| Row | number |
The record number in which an error is encountered. The first record is record 1. If the record number is not available, -1 is used. |
| Field | string |
The full name of the field that failed to be decoded. |
| Error | string |
The error that caused the record decoding to fail. |
| Record | bytes |
The entire record. |
Spillover dataset created by qsam encode
As part of the encoding process the qsam encode command creates
a spillover dataset with the following schema. For QSAM files, we recommend
that you use a file with variable record length of at least 1024.
| Field name | Type | Description |
|---|---|---|
| Row | number |
The record number that encountered the error. The first record is record 1. Some encoding sources may not provide a consistent row number. In that case the row is -1. |
| Field | string |
The full name of the field that failed to be encoded. |
| Error | string |
The error that caused the record encoding to fail. |
| Record | string |
The entire record encoded as JSON. |