Transfer-Control Files for Log File Transfers
Transfer-control (.info) files provide metadata information about file transfers so that partners can verify that Audience Manager handled file transfers correctly.
Audience Manager sends a transfer-control file to a partner with every file transfer. Due to the multi-thread nature of the FTP publisher, the transfer-control file might be sent before the actual files are finished transferring.
The metadata in the .info file lets partners:
- Determine when a full transfer cycle is complete (the total number of files in the sequence have been delivered);
- Determine whether any given file in the sequence is complete/correct (by examining the size of the file in bytes and the total number of lines);
- Validate the number of rows in raw files verses the number of rows after the files have been loaded in the database on the receiving end (size of file in lines).
File Naming Conventions
The transfer-control file has the same name as the root of the batch/sequence with a .info file extension.s
For example, if the first file in the sequence were named: ftp_12345_67890_full_1500727351632-1.sync, the control file would be named ftp_12345_67890_iter_1500727351632.info.
File Format
{
Files: [
{
FileByteSize: 293029329,
FileLineCount: 36893908,
FileName: "ftp_12345_67890_full_1500727351632-1.sync.gz",
FileSequenceNumber: 1,
md5: "983g634be2ad5263c6a6c4958bf61d9f"
},
{
FileByteSize: 293039238,
FileLineCount: 36895184,
FileName: "ftp_12345_67890_full_1500727351632-2.sync.gz",
FileSequenceNumber: 2,
md5: "6sn9907c8e78cfd78409622e7b55a984"
},
{
FileByteSize: 293050833,
FileLineCount: 36896787,
FileName: "ftp_12345_67890_full_1500727351632-3.sync.gz",
FileSequenceNumber: 3,
md5: "7cdfb8e74cd6cec1jy6vel21ccb4a962"
},
{
FileByteSize: 218425764,
FileLineCount: 27498226,
FileName: "ftp_12345_67890_full_1500727351632-4.sync.gz",
FileSequenceNumber: 4,
md5: "7hs53149f8a2444457g968f04cbbdee5"
}
],
Totals: {
FileName: "ftp_12345_67890_full_1500727351632.sync",
TotalByteSize: 1097545164,
TotalNumberFiles: 4,
TotalNumberLines: 138184105
}
}
NOTE
The batch total numbers are exclusive of the .info file itself. That is, the totals do not include the .info file, its byte size, or its line count.
Byte sizes of files and line counts are inclusive of any header and spacer (blank) lines/rows. In order to get the count of actual data lines/rows, subtract headers.
Total lines in batch and total byte size are inclusive of any header and space rows.
de293fbf-b489-49b0-8daa-51ed303af695