90 likes | 213 Views
The tech industry has been abuzz about big data lately; everyone from the medical industry to the government of China has been tapping into it due to its potential to streamline the massive amounts of information they deal with on a daily basis.
E N D
Quality Control and Big Data • The tech industry has been abuzz about big data lately; everyone from the medical industry to the government of China has been tapping into it due to its potential to streamline the massive amounts of information they deal with on a daily basis. 2
Quality Control and Big Data • Wikipedia defines big data as “a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications;” basically, it’s a way to handle massive data systems that are difficult to work with using conventional methodology, such as ETL Testing(extract, transform, load). 3
Quality Control and Big Data • It’s a technology that requires its own careful methods of implementation and data processing, but it also provides interesting new challenges for testers as well. • It’s often incredibly difficult to know for sure not only that data is being transmitted properly on these systems, but also that the best possible data is being used. 4
Quality Control and Big Data • Therefore, when testing big data, verifying data quality is one of the biggest concerns; this requires that a wide array of software testing methodologies are performed for both functional and non-functional testing. • Big data obviously necessitates the same testing that would be performed for any database regardless of size; 5
Quality Control and Big Data • A diverse approach which can incorporate a variety of methodologies will give a more complete picture of any errors that are present in the system. • In this way, big data testing is similar to the testing performed for any database, in that a more diverse approach which incorporates multiple methodologies can sometimes give the most complete picture. 6
Quality Control and Big Data • Some of the biggest aspects of big data testing are the following: • Defining test strategies for both structured and unstructured data validation • Setting up an optimal test environment • Working with non-relational databases • Performing non-functional testing • Read more here: http://www.qualitestgroup.com/blog/test-methodologies-and-philosophies/quality-control-big-data/ 7