Data purging is an option to remove historical data in WSO2 Identity Server Analytics. This is important since it is not possible to delete tables or table data in WSO2 Identity Server Analytics. By purging data, you can achieve high performance in IS data analysis without removing analyzed summary data. Only data from the stream data generated by identity server is purged. This data is contained in the following tables:
Make sure you do not purge data in tables other than those mentioned above because that deletes your summarized historical data.
There are two ways to purge data in IS Analytics:
Using the Management Console
To schedule data purging via the Management Console, follow the steps below:
- Log in to the WSO2 IS Analytics Management Console.
- In the Main tab, click Data Explorer (Manage > Interactive Analysis) to open the Data Explorer page.
- Select the required table in the Table Name field, and click Schedule Data Purging as shown below.
This opens the Schedule Data Purging dialog box.
- In the Schedule Data Purging dialog box, set the time and days within which you want to purge data as shown below. Then click Save.
Using the global method
This action affects all tenants.
- Open the
Change the contents under the
<analytics-data-purging>property as shown below:
- Save your changes.
To verify if the automatic purging task runs successfully, do the following.
Check the server log at the relevant time at which the task is scheduled to run. You should see a log similar to the one shown below.
Check the difference in the database table size to check if it has reduced once the purging task has run. You can run a database query similar to the MYSQL query shown below to check the size of the event store table.
For instructions on how to retrieve the relevant table names related to purging, see Retrieving the Actual Name of a Table in the WSO2 Data Analytics Server documentation.