text: 200,111,1217132405552644096,4111874585,Manuel Rigger,"We propose Pivoted Query Synthesis (PQS), a new approach for finding logic bugs in DBMS (see <LINK>). Using PQS, we found ~100 previously unknown (and many critical) bugs in widely-used DBMS (e.g., SQLite3, MySQL, and PostgreSQL). Work with @zhendongsu. <LINK> PQS effectively tackles both test query and oracle generation. Its core idea is to choose a randomly-selected ""pivot row"" and generate a query whose result set must contain the pivot row. If the result set returned by the DBMS fails to fetch the pivot row, a bug is found. To our knowledge, this is the largest and most successful testing campaign against such production DBMS (<LINK> lists all PQS bugs). Stay tuned for more work on testing DBMS. For example, our ongoing work has found an additional 100+ bugs via another new approach I also want to highlight the great work done by the DBMS developers. The SQLite developers in particular fixed bugs very quickly, which is why we focused on testing SQLite.",https://arxiv.org/abs/2001.04174,"Relational databases are used ubiquitously. They are managed by database management systems (DBMS), which allow inserting, modifying, and querying data using a domain-specific language called Structured Query Language (SQL). Popular DBMS have been extensively tested by fuzzers, which have been successful in finding crash bugs. However, approaches to finding logic bugs, such as when a DBMS computes an incorrect result set, have remained mostly untackled. Differential testing is an effective technique to test systems that support a common language by comparing the outputs of these systems. However, this technique is ineffective for DBMS, because each DBMS typically supports its own SQL dialect. To this end, we devised a novel and general approach that we have termed Pivoted Query Synthesis. The core idea of this approach is to automatically generate queries for which we ensure that they fetch a specific, randomly selected row, called the pivot row. If the DBMS fails to fetch the pivot row, the likely cause is a bug in the DBMS. We tested our approach on three widely-used and mature DBMS, namely SQLite, MySQL, and PostgreSQL. In total, we reported 123 bugs in these DBMS, 99 of which have been fixed or verified, demonstrating that the approach is highly effective and general. We expect that the wide applicability and simplicity of our approach will enable the improvement of robustness of many DBMS. ",Testing Database Engines via Pivoted Query Synthesis,4,"['We propose Pivoted Query Synthesis (PQS), a new approach for finding logic bugs in DBMS (see <LINK>). Using PQS, we found ~100 previously unknown (and many critical) bugs in widely-used DBMS (e.g., SQLite3, MySQL, and PostgreSQL). Work with @zhendongsu. <LINK>', 'PQS effectively tackles both test query and oracle generation. Its core idea is to choose a randomly-selected ""pivot row"" and generate a query whose result set must contain the pivot row. If the result set returned by the DBMS fails to fetch the pivot row, a bug is found.', 'To our knowledge, this is the largest and most successful testing campaign against such production DBMS (https://t.co/aB0tUYgEv0 lists all PQS bugs). Stay tuned for more work on testing DBMS. For example, our ongoing work has found an additional 100+ bugs via another new approach', 'I also want to highlight the great work done by the DBMS developers. The SQLite developers in particular fixed bugs very quickly, which is why we focused on testing SQLite.']",20,01,970