Question

• Explain three strategies to clean and validate data.
• Provide examples of when each strategy would be used.

Answer 1

Strategy to keep data clean:

The typical activities in the maintenance of the DBMS its utilities and applications are as follows:

• First and foremost important activity is to monitor the system to ensure the database is up and running perfectly.
• Next, is to do a full backup of the database so that there is no redundancy in all the locations where the database backup is being saved.
• The next step is to perform a live replication so that we can read slave and hot fallback with the cluster.
• To check the storage is it enough to make the database running for the rest of the time.
• To perform a check on the archival strategy so that the online transaction database isn't building up too much over time.
• Running queries for a long time so that we can understand what is happening in the database index wise and when will it be hitting a tipping point.

Hence, these are some of the activities which must be checked while validating the data in the database.

Yes, obviously we must consider application performance tuning to be the main part of such validation processes. The main reason behind it is as follows:

• It will help us to know whether the application is being worked perfectly and up to what regressions are they failing to perform as expected. This will help us in finding out the limitations of our applications so that changes can be made accordingly.
• It will also keep us posted with certain changes in the application when the inputs are not as expected to make it a part of testing so that nothing can be overloaded when the application goes live.

Hence, these are some of the points we must remember while performing the cleaning and validation of the data.