Age | Commit message (Collapse) | Author | Files | Lines | |
---|---|---|---|---|---|
2022-03-21 | regtest: Add a command to download files | Albert Astals Cid | 1 | -0/+69 | |
2018-11-18 | regtest: Fix file opened in wrong mode. | Elliott Sales de Andrade | 1 | -3/+2 | |
2018-11-18 | regtest: Fix Printer.printerr. | Elliott Sales de Andrade | 1 | -2/+2 | |
2018-11-18 | regtest: Replace execfile with plain read & exec. | Elliott Sales de Andrade | 1 | -1/+2 | |
2018-11-18 | regtest: Enable new-style division everywhere. | Elliott Sales de Andrade | 22 | -25/+29 | |
2018-11-18 | regtest: Enable absolute import on all files. | Elliott Sales de Andrade | 22 | -22/+22 | |
2018-11-18 | regtest: Replace tabs with spaces. | Elliott Sales de Andrade | 1 | -1/+1 | |
2018-11-18 | regtest: Use print function everywhere. | Elliott Sales de Andrade | 22 | -1/+23 | |
2018-11-18 | regtest: Fix iteration through dictionary on Py3. | Elliott Sales de Andrade | 2 | -7/+2 | |
2018-11-18 | regtest: Don't use exceptions for Printer singleton. | Elliott Sales de Andrade | 1 | -14/+12 | |
In Python 3, exceptions must derive from the BaseException class, which Printer definitely does not do. | |||||
2017-12-21 | regtest: Add an option to exit after n failures | Carlos Garcia Campos | 4 | -3/+68 | |
Note that running jobs are not cancelled when max failures is reached, so we usually end up getting more failures than the maximum. | |||||
2017-09-24 | regtest: change default value of utils dir to ../build/utils | Carlos Garcia Campos | 1 | -1/+1 | |
2016-01-02 | regtest: Fix the number of worker threads spawned reported in log of ↵ | Carlos Garcia Campos | 1 | -1/+1 | |
run-tests command | |||||
2016-01-02 | regtest: Limit the number of worker threads to the number of documents to ↵ | Adam Reichold | 1 | -9/+18 | |
create references The same way we do for the run-tests command. | |||||
2016-01-01 | regtest: Allow to interrupt run-tests and create-refs commands when multiple ↵ | Carlos Garcia Campos | 3 | -4/+72 | |
threads are used The Queue join implementation uses a non-timed wait that blocks the main thread, making it impossible to interrupt it with CTRL+C or sending SIGINT signal. Using any timeout value for wait would fix the problem, but Queue doesn't allow to pass a timeout to the join method. The Queue implementation is actually quite simple, so we can just add our own implementation with only the things we really need and use a timeout value when calling wait() in join(). | |||||
2016-01-01 | regtest: Do not use the log printer with the TestReferences lock held | Adam Reichold | 1 | -1/+1 | |
2015-12-04 | regtest: Pass always both the owner and user passwords to the tools | Carlos Garcia Campos | 4 | -4/+4 | |
2015-12-03 | regtest: Fix testing text backend | Carlos Garcia Campos | 1 | -1/+1 | |
Fix a typo in previous commit. | |||||
2015-12-03 | regtest: Add support for testing password protected documents | Carlos Garcia Campos | 9 | -15/+49 | |
Similar to how skipped file works, you can pass a passwords file from the command line or add a Passwords file to your docs directory. This file should be a python file containing a "passwords" dictionary where the key is the test document and the value is the password required to open that document. | |||||
2015-06-04 | regtest: Disable pretty diffs for text files in HTML reports | Carlos Garcia Campos | 1 | -2/+5 | |
difflib is entering in an infinite loop with some files, so disable it for now. We need to either fix that somehow or find a different way to generate pretty diffs of text files. | |||||
2014-11-07 | regtest: Update references also for tests that no longer crash | Carlos Garcia Campos | 2 | -0/+26 | |
We are currently updating the refs only when we have checksums to compare, but if a test used to crash there's no md5 file in refs. | |||||
2014-10-30 | regtest: Try to fix again the paths of the resources in the generated HTML ↵ | Carlos Garcia Campos | 1 | -24/+23 | |
report Use always relatives paths for the resources under the out directory, and absolute paths for all other resources when no-absolute-path command line option is used. | |||||
2014-10-29 | regtest: respect --no-absolute-paths when creating the pretty diff links | Carlos Garcia Campos | 1 | -6/+10 | |
2014-10-27 | regtest: Add an option to create the HTML report without absolute paths | Carlos Garcia Campos | 2 | -4/+15 | |
It uses the paths as received from the command line attributes. | |||||
2014-10-26 | regtest: Fix png diff generation with python-pil pillow fork | Carlos Garcia Campos | 1 | -1/+1 | |
Use from PIL import Image instead of just import Image, since pillow only doesn't support import Image without using PIL.Image. | |||||
2014-10-26 | regtest: Limit the number of worker threads to the number of documents to test | Carlos Garcia Campos | 1 | -9/+18 | |
We are always spawning all the threads even if the documents to test is less than the worker threads. Also optimize the case of running only one test to not spwn any thread. | |||||
2014-10-26 | regtest: Allow to run groups of tests individually | Carlos Garcia Campos | 3 | -13/+49 | |
Now it's possible to pass more than one argument to run-tests command and optionally the docs directory. When more than one test is passed and the docs directory is not provided, the common base path of all passed tests is used as docs directory. The tests passed can be documents or directories, using absolute paths or paths relative to the docs directory. This also allows us to update the refs for a group of tests. | |||||
2013-12-15 | regtest: Add a command line option to create-report command to not launch ↵ | Carlos Garcia Campos | 2 | -3/+7 | |
the browser | |||||
2013-12-15 | regtest: Return an exist status code depending on whether the command succeeded | Carlos Garcia Campos | 8 | -10/+20 | |
2013-12-06 | regtest: Limit the stderr files to ~1MB | Carlos Garcia Campos | 1 | -1/+5 | |
Some tests send a lot of information to stderr, usually due to parsing errors in buggy documents. More than 1MB of stderr output is diffcult to hanlde and in most cases it's redundant with a lot of duplicated messages. This patch reduced the size of the refs dir for the complete test suite by 1GB. | |||||
2013-12-06 | regtest: Save checksum results sorted in md5 files | Carlos Garcia Campos | 1 | -1/+1 | |
We are using os.listdir() to get the list of test results that returns files in arbitrary order. | |||||
2013-12-06 | regtest: Show also the tests expected to crash/fail to run but don't fail | Carlos Garcia Campos | 1 | -1/+7 | |
2013-12-06 | regtest: Improve readability of test results | Carlos Garcia Campos | 1 | -20/+47 | |
Show a summary of tests failed per backend with the percentages and use a new line for every test in the result instead of using a comma separated line. | |||||
2013-11-29 | regtest: Do not buffer stderr output | Carlos Garcia Campos | 1 | -10/+30 | |
Some buggy documents can produce a huge stderr output because of parsing errors or whatever. We could give a file directly to Popen to write the stderr file, but we only want to create the file when there's output, because it's what we use to know whether the command produced output or not. So, instead of buffering the whole output and then write it to the file, now we read from the pipe while the command is running, writing the output in chunks to the file. This improves a lot the memory consumption when running some tests. | |||||
2013-11-29 | regtest: Read test results in chunks to get the md5 digest | Carlos Garcia Campos | 1 | -7/+12 | |
Some backends can generate huge results, like huge postscript files that we don't want to load in memory to get the md5. So, instead of creating thr md5 object with the entire file, we feed it with chunks of data using the update method. This improves a lot the memory consumption and performance as well. | |||||
2013-11-29 | regtest: Remove unused method _check_exit_status2 | Carlos Garcia Campos | 1 | -20/+0 | |
It was used when the backends ran in parallel odd and even pages, but it's no longer used since threads support was added. | |||||
2013-11-29 | regtest: Do not store the current line in Printer but only its length | Carlos Garcia Campos | 1 | -5/+5 | |
We are not using the line text anymore, but only the length. | |||||
2013-11-27 | regtest: Do not consider docs with no refs as skipped | Carlos Garcia Campos | 1 | -17/+23 | |
Handle them differently as new docs, and show them in the summary suggesting to use create-refs command to include them in the test suite. | |||||
2013-11-27 | regtest: Use number of tests run to show the progress | Carlos Garcia Campos | 3 | -112/+118 | |
Instead of using the number of document tested. We don't really need to set a number to a particular document, we only want to know the progress of the whole process. This ensures that the progress is shown in the correct order. It also simplifies the code a bit. Also improved the output formatting to make it easier to read. | |||||
2012-12-29 | regtest: Print test results when the test has finished | Carlos Garcia Campos | 2 | -15/+28 | |
To make sure the result corresponds to the test now that we are using multiple threads. | |||||
2012-12-08 | regtest: Use the number of cpus as default number of worker threads | Carlos Garcia Campos | 1 | -3/+5 | |
2012-12-08 | regtest: Remove trailing whitespaces | Carlos Garcia Campos | 3 | -13/+13 | |
2012-12-06 | implement parallel testing using Python's Queue class | Adam Reichold | 6 | -34/+104 | |
2012-10-21 | regstest: Add print_test_result_ln() and use it for failed test results | Carlos Garcia Campos | 2 | -5/+8 | |
To make sure they are always shown. | |||||
2012-10-21 | regtest: Do not rewrite lines in verbose mode | Carlos Garcia Campos | 1 | -1/+1 | |
2012-09-23 | regtest: Reduce the noise of the default output when running tests | Carlos Garcia Campos | 8 | -29/+137 | |
Show permanent information only about failed tests, without the details about the failing pages. Previous verbose output is available passing --verbose command line output. | |||||
2012-04-01 | regtest: remove debug print to show bisect exit status in Bisect.py | Carlos Garcia Campos | 1 | -1/+0 | |
2012-04-01 | regtest: Fix crash when creating HTML report for a single test | Carlos Garcia Campos | 1 | -4/+1 | |
2012-04-01 | regtest: Don't show results for crashed or failed to run tests in HTML report | Carlos Garcia Campos | 1 | -0/+2 | |
2012-03-11 | regtest: Add find-regression command to run git bisect automatically | Carlos Garcia Campos | 4 | -0/+339 | |