Problem Note 63984: Large tab-separated value (TSV) files consume disk space in SAS® Viya®
 |  |  |  |  |
Problem
Tab separated values (TSV) files in the operations-infrastructure data mart (/opt/sas/viya/config/var/lib/evmsvrops/evdm/) consume a large amount of disk space. If available disk space is less than 1 GB In SAS® Viya® 3.4, or less than 500 MB in SAS® Viya® 3.3, the sas-stream and extract, transform, load (ETL) processes suspend operation.
The following symptoms can also occur before all disk space is consumed:
- Log messages (or no recent ones) do not appear on the SAS® Environment Manager Logs page.
- Charts do not appear on the SAS Environment Manager Machines page.
- Charts in SAS Environment Manager seem to load data endlessly.
Background Information
TSV files contain performance metrics and log message data that are collected from across an entire deployment of SAS Viya. These TSV files are stored in the operations-infrastructure data mart. Each TSV file contains a particular type of data for a single day. Each day at midnight in Coordinated Universal Time (UTC), a new TSV file is created for each of these types of data. This data appears primarily through the SAS Environment Manager web application. Log messages are on the Dashboard and the Logs page, and performance metrics are on the Dashboard and the Machines page. The TSV files that are located in /opt/sas/viya/config/var/lib/evmsvrops/evdm/log/log contain all the log messages that are generated from all components across all machines in a SAS Viya deployment. For more information about TSV files, see the “Operations Infrastructure” chapter in SAS® Viya® 3.4 Administration.
Click the Hot Fix tab in this note for a link to instructions about accessing and applying the software update.
Important: You should apply this hot fix even if you have not observed the issues that are described in this SAS Note.
The hot fix addresses several issues to mitigate the problems caused by large TSV files.
However, the hot fix does not eliminate large TSV files. To help reduce the size of TSV files, you can decrease the number of log messages that are generated by doing one of the following:
- Fix any problems in the components that can cause a large number of log messages.
- Adjust the log level of one or more components (for example, change threshold levels from DEBUG to INFO or from INFO to WARN for specific components -- see the “Logging” chapter in SAS® Viya® 3.4 Administration).
Operating System and Release Information
| Product Family | Product | System | Product Release | SAS Release | ||
| Reported | Fixed* | Reported | Fixed* | |||
| SAS System | SAS Viya | Linux for x64 | 3.3 | 3.4 | Viya | Viya |