DeviQA

Catalyst is the application for BABC therapists designed to collect, sort, and proceed all data in one place with the ability to create different reports, view graphs, and print documents.

Web App Testing, Mobile Testing, Dedicated QA Team

• 25% Critical Bugs Reported
• 45% Major Defects Reported
• 150 Confluence Pages Created
• 60 Stories Created

Before improvement

• Lack of QA resources
• No ability to execute regression testing before each release
• Clearly defined tasks at the beginning of the project for QA team

After improvement

• Created detailed specifications with clear acceptance criteria
• The first release completed three months after we started working on the project
• Created and fully stabilized the testing process
• Created and maintained flexible check lists
• Execution of smoke tests based on the checklist helped the team to find and fix critical bugs on the feature development stage
• Full support of all popular browsers and mobile devices
• All versions were released at the appointed time
• Prevented huge number of blockers and crashes caused by the big amount of merging
• Assisted in the organization of the release process in the App Store/Google Play
• Integrated short team meetings to be sure all team is on the same page

Learn more: https://www.deviqa.com/case-studies/catalyst/

Quality Management Software platform is a user-friendly tool designed for construction companies and inspectors in order to collect and analyze data on the works carried out on the construction sites.

Test Automation, Mobile Testing, Web App Testing

• 100 Automation Scenarios Developed
• 1800+ User Stories Passed Testing
• 3000 Bugs Reported
• 100+ Regression Test Cases Added
• 300 Performance Reports Submitted

Before improvement:

• Test cases didn't cover the major software areas
• Development workflow was unstable and changed from sprint to sprint
• Regression testing was slow and contained redundant tests
• Each team member worked independently, and there was a lack of communication
• There were no automated tests
• The project had an enormous number of minor bugs which significantly worsened user experience
• The software didn't provide mobile device support

After improvement:

• A great number of complicated test cases have been added to cover all major areas
• Regression testing has been released from the redundant tests to speed up its running
• Principles of effective communication and teamwork have been applied
• An automated test suite has been developed from scratch
• Build automation has been expanded, many new scenarios for new features have been added
• The automated test suite runs on several environments every day to check the current state and performance of all servers
• Development workflow has been optimized and made more stable by means of Retrospective, Demo, and weekly meetings
• The software has been enabled to support multiple mobile application for iOS and Android

Learn more: https://www.deviqa.com/case-studies/qms/

The project is an application for the easy management of points of sale. It lets to improve communication across the teams, streamline operations, optimize performance, and empower data-driven business decisions.

Mobile Testing, Web App Testing

• 550+ Bugs Reported
• 4000+ Test-Cases Designed
• 900 Average Number Of Tests During Release
• 95% Percent Of Bugs Are Caught Before Release To Production

Before improvement:

• Lack of test cases
• Improper testing of new features before release
• Absence of a consistent QA process - stories and epics were tested by managers and developers
• There were a lot of post-release bugs

After improvement:

• A full scope of test documentation was created
• Specifications were updated with clear acceptance criteria
• Much more defects are caught earlier as the QA team gets to the active work at the development stage
• Web-platform and iOS/Android apps are totally covered with test cases, and their number continues to increase as the project is evolving. Such high test coverage immensely improves product quality
• Full support of all the widely used browsers and mobile devices

Learn more: https://www.deviqa.com/case-studies/retail/

Biznessapps - mobile do-it-yourself platform application that allows small and medium-sized businesses to create mobile apps with relative ease.

Web App Testing, Mobile Testing

• 17,000+ Defects Found
• 700+ Blockers Detected
• 3,000+ Critical Bugs Detected
• 6,800+ Major Bugs Detected
• 5,000+ Minor Bugs Detected
• 90% Coverage Of Test Cases

Before improvement:

• No QA on the project, as result chaotic testing from the developers side only
• Many of the bugs were missed during regular test passes
• A huge number of major/critical issues in the production environment
• Not structured, not informative bug reports
• Lack of setup of the bug tracking system, messy board
• Lack of the test documentation
• Insufficiently qualified customer support
• Random releases with not thoroughly tested functionality

After improvement:

• Structured and formalized the testing process
• Covered more than 90% of the app with test cases
• Updated the Jira workflow
• Cleaned up the bug tracking system from old bugs
• Full support of all popular browsers and mobile devices
• The ratings of the mobile apps in the AppStore and Google Play increased
• Reduced the number of customer support issues by more than 50%
• Helped the CS team to understand all the subtleties of the application
• App took 1ST place in Customer Happiness Awards in North America

Learn more: https://www.deviqa.com/case-studies/biznessapps/

Test Automation, Performance Testing, Web App Testing

• 5000+ Threads For Performance
• 1000+ Tests Developed
• 200 Machines Used
• 3 Full Time Qa Automation Engineers

Before improvement:

• A lot of issues related to the real time update for bets.
• Failed expectations in the site performance between the expected quantity of the online users and real quantity of the online users

After improvement:

• Developed a test suite that was able to generate test data based on the number of browsers in Kubernetes cluster.
• Test farm was developed to execute our tests in parallel from 200 machines.
• Major bottlenecks were found on the frontend, backend, and GraphQl server.
• Developed a solution that avoids login bottleneck to check that more than 10000 customers can work with the application in the same time
• Developed an automated test suite that can be easily expanded due to the requirements about the amount of online users
• Provided an exact amount of users that can be online at the same time in the application

Learn more: https://www.deviqa.com/case-studies/betting/

Test Automation, Web App Testing, Performance Testing, QA Consulting

• 25,000 Auto Tests Developed
• 6+ Platforms Were Covered By Auto Tests
• 10x Faster Testing Time
• 10 Parallel Threads
• 500k+ Files Uploaded
• 30 Machines Used

Before improvement:

• Every time a developer triggered the tests, it was by hand in a terminal
• The team had a big and complicated file with the results
• Tests took more than 20 hours for completion
• The history of the test runs was unavailable
• The test suite architecture was unscalable
• UI tests were absent
• All test results were missed if some tests failed due to technical reason

After improvement:

• We reduced the build time by a factor of 10
• Configured how to run tests in simple way without the involvement of a tech person
• Created a reporting system that allowed the team to view clean reports even if the results contained 10k rows
• Configured file processing selection on the number machines (Azure Cloud, Google Cloud).
• Autotests for uploading files were running in parallel on 30 different machines, with 10 threads on each machine.
• Test cases covered 80% of the application
• We added UI tests that were triggered automatically after each deploy
• We stored the main test result file and also stored results for each machine simultaneously

Learn more: https://www.deviqa.com/case-studies/solegate-mimecast/

Test Automation, Mobile Testing, Web App Testing, Dedicated QA Team

• 2000 automated tests developed
• 16 parallel threads configured to run these tests
• 12 000 bugs reported
• 10 000 + test cases developed
• 70% more mainainable test suite vs competitors
• 45% defects reported with status major 

Before improvement:

• Tests were unstable
• Each run had a different number of randomly failed tests
• The team was not able to rely on the original tests to make the release
• The architecture of the test suite could not be scaled and was difficult to maintain for a large number of tests
• Tests took many hours to be completed
• Tests couldn't be integrated with other testing and DevOps tools

After improvement:

• Designed the architecture of the test framework from scratch
• Built a test suite which ran auto-tests using 16 threads on multiple machines.
• Results to be received much more quickly
• Improved test speeds by adding the prerequisite testing data directly to the database
• Integrated auto tests with Jenkins, TestRail, and Jira to have a complete test ecosystem up and running
• More than 90% of the app was covered by automation tests

Learn more: https://www.deviqa.com/case-studies/sprinklr/ 

Mobile Automation Testing, Dedicated QA Team, Web App Testing, Performance Testing

• 1,000+ Auto Tests Developed
• 6 Parallel Threads
• 30% "Critical" Bugs Reported
• 80% Coverage Of Application Tests
• 200+ Bugs Reported

Before improvement:

• Test suite was developed without maintenance and scalability support in mind
• Bugs were poorly described

After improvement:

• SoftNAS benefited by getting test results faster and receiving stable automated tests that led to them being able to deploy
• Significantly improved the quality of products
• Integrated performance testing suite into Continuous Integration process.
• Low level API automation test suite was developed from scratch
• The number of issues reduced to 25 % after automation was properly implemented

Learn more: https://www.deviqa.com/case-studies/soft-nas/

Web App Testing, Manual Testing, Test Automation

• 859 Reported Issues
• 103 Issues With "Critical" Priority Reported
• 1176 Test Automated Scenarios

Before improvement:

• A product was unstable and loaded with bugs
• Feature stories were too perplexed and long
• Most stories contained outdated descriptions with irrelevant test cases
• There was a lack of test documentation
• There were no automated tests

After improvement:

• The product became stable and robust
• Automated testing was introduced
• New test suites for sub-apps were created from scratch
• More than 90% of the application functionality was covered by tests
• Bug reports were standardized and improved with all required information and attachments
• All critical bugs were found and fixed at the feature development stage due to the execution of smoke testing based on the designed checklist

Learn more: https://www.deviqa.com/case-studies/xola/

Mobile Automation Testing, Performance Testing, Mobile Testing, QA Consulting

• 64gb Ram Server With 15 Vms
• 2,000 Auto Tests Developed
• 45 Parallel Threads
• 15 Virtual Machines
• 400% Efficiency
• 6 Browsers

Before improvement:

• There was no formal QA process on the project
• Bugs were poorly described

After improvement:

• Multi-threading allowed us to reduce the time taken for all 2000 scenarios run from 12 hours to 2 hours
• Integrated our web automation tests with bug tracking and team management systems
• The statistics about all test runs are stored on CI side
• Designed a complex architectural solution for automated tests from scratch
• Automation regression testing took 2 hours instead of 2 weeks of manual testing activities

Learn more: https://www.deviqa.com/case-studies/weheartit/ 

Mobile Automation Testing, Dedicated QA Team, Web App Testing, Performance Testing

• 1,400 Tests Designed
• 20 Parallel Threads
• 50 Jenkins Jobs For Testing
• 25,000 Hours Of Work
• 3 Headless Browsers
• 60% Major Bugs Detected

Before improvement:

• Customers faced a huge amount of issues
• Low percentage of app coverage by auto tests
• Long running tests
• Uninformative test results

After improvement:

• Decreased the number of client issues and speed up the process of delivering new, well-tested features for customers
• We build an automated test system that includes integration, performance, acceptance, and end-to-end testing solutions for web and mobile parts of application across all environments
• Speed up auto tests by running them in multiple threads and simultaneously for different areas
• Configured a mailing system that sends test results to every relevant person and Slack channel with other useful information
• Covered main functionality for iOS and Android applications
• Added performance tests for different services of the system
• Each QA was assigned to the separate product team to improve workflow and communication

Learn more: https://www.deviqa.com/case-studies/cipher-health/ 

Mobile Automation Testing, Mobile Testing, QA Consulting

• 500+ AUTOMATED TESTS
• 120+ BUGS FOUND
• 1000+ TEST CASES DESIGNED
• 3 THREADS
• 40% CRITICAL AND MAJOR BUGS

Before improvement:

• No automation tests
• The regression testing took about 5 days
• Poor and outdated test cases
• Not informative bug reports

After improvement:

• Set up and use CI (continuous integration) based on Jenkins
• Kept in touch with clients in-house testing team
• QA Lead participated in the formation of test cases to automate testing at each sprint
• Built an effective process with the customer development and testing teams
• Time of regression testing decreased from 5 days to 46 hours
• Mobile and desktop apps were covered with autotests for all main functionalities
• Automation tests run on 3 real devices in parallel
• All legacy test cases were updated
• More than 3200 test cases created
• Standardized bug reports with all required info and attachment 

Learn more: https://www.deviqa.com/case-studies/messenger/

A technology company that integrating software into dental lab fabrication, logistics, and data to transform the dental service experience.

Mobile Automation Testing, Mobile Testing, QA Consulting

• 8000 Bugs Reported;
• 90% Test Cases Coverage;
• 3300 Auto Tests Developed;
• 7000 Test Cases Designed;
• 700 Critical Defects Found;
• 3000 Major Issues Reported.

Before improvement:

• The lack of test documentation
• Existing workflow in Jira didn't allow to understand how many bugs were left unfixed before the release and their priorities.

After improvement:

• Integrated TestRail with Jira to have full access to related test results on Jira side
• Developed an architecture of the automation test suites
• Added multithreading to run tests in parallel on 10 different threads, which reduced the time of the test run in 7 times.
• Used Appium and ran tests on AWS Device Farm using real devices as well as on our local mobile physical devices.
• Covered more than 90 % of the application with the test cases
• Covered more than 80% of web/mobile apps by automated tests.
• Several rounds of performance testing were done. Detailed report with the bottlenecks and our recommendations for the improvements were provided.
• Tests were integrated into an existing CI/CD process
• Security Testing was performed quarterly

Learn more: https://www.deviqa.com/case-studies/dental/

Compass is a real-estate tool that turns business relationships into results. It is a web-based customer relationship management tool that allows companies to oversee and manage communication activities using an easy-to-use and well-built interface.

Web App Testing, Mobile Testing, Test Automation, Dedicated QA Team

• 6000+ Test Cases Created
• >40% Tests Cases Automated
• 1500+ Passed Test Runs
• 12000+ Bugs Reported
• 6000+ Tickets With Major/Critical/Blocker Statuses

Before improvement:

• Didn't have a formal QA process
• Testing was carried out by the devs
• Negative quality of tests
• Didn't make automated testing
• Project had a well-detailed specification

After improvement:

• Set up a formal QA process
• Developed BDD scenarios based on a detailed specification
• Full coverage of the application by test cases
• UI automated tests for web application
• Automation smoke test run before each deployment to check main functionality
• Automated API tests
• Detailed Automatically Reports Generation which were sent to the customer
• UI automated tests for iOS and Android
• Parallel autotests run on all supported browsers
• Project had a well-detailed specification

Learn more: https://www.deviqa.com/case-studies/compass/