curl-curl/tests/unit
Stefan Eissing 909af1a43b
multi: do transfer book keeping using mid
Change multi's book keeping of transfers to no longer use lists, but a
special table and bitsets for unsigned int values.

`multi-xfers` is the `uint_tbl` where `multi_add_handle()` inserts a new
transfer which assigns it a unique identifier `mid`. Use bitsets to keep
track of transfers that are in state "process" or "pending" or
"msgsent".

Use sparse bitsets to replace `conn->easyq` and event handlings tracking
of transfers per socket. Instead of pointers, keep the mids involved.

Provide base data structures and document them in docs/internal:
* `uint_tbl`: a table of transfers with `mid` as lookup key,
   handing out a mid for adds between 0 - capacity.
* `uint_bset`: a bitset keeping unsigned ints from 0 - capacity.
* `uint_spbset`: a sparse bitset for keeping a small number of
  unsigned int values
* `uint_hash`: for associating `mid`s with a pointer.

This makes the `mid` the recommended way to refer to transfers inside
the same multi without risk of running into a UAF.

Modifying table and bitsets is safe while iterating over them. Overall
memory requirements are lower as with the double linked list apprach.

Closes #16761
2025-04-17 17:28:38 +02:00
..
.gitignore tests: git ignore the bundle executables built 2025-03-17 17:19:15 +01:00
CMakeLists.txt build: do not apply curl debug macros to tests/server by default 2025-03-14 12:59:32 +01:00
curlcheck.h Makefile.mk: drop in favour of autotools and cmake (MS-DOS, AmigaOS3) 2024-12-16 23:20:55 +01:00
Makefile.am make: clean tests better 2025-04-06 13:12:55 +02:00
Makefile.inc multi: do transfer book keeping using mid 2025-04-17 17:28:38 +02:00
README.md docs: use lowercase curl and libcurl 2025-01-02 17:15:54 +01:00
unit1300.c cmake: fix clang-tidy builds to verify tests, fix fallouts 2025-03-24 10:14:58 +01:00
unit1302.c tests: speed up builds with single-binary test bundles 2024-09-22 09:51:15 +02:00
unit1303.c tidy-up: use CURL_ARRAYSIZE() 2025-02-19 00:59:45 +01:00
unit1304.c build: enable -Wcast-qual, fix or silence compiler warnings 2025-03-10 22:30:15 +01:00
unit1305.c dnscache: slight refactoring 2025-04-03 16:40:56 +02:00
unit1307.c tidy-up: use CURL_ARRAYSIZE() 2025-02-19 00:59:45 +01:00
unit1309.c lib/src: white space edits to comply better with code style 2024-09-19 14:59:12 +02:00
unit1323.c tidy-up: use CURL_ARRAYSIZE() 2025-02-19 00:59:45 +01:00
unit1330.c copyright: update all copyright lines and remove year ranges 2023-01-03 09:19:21 +01:00
unit1395.c urlapi: remove percent encoded dot sequences from the URL path 2025-03-31 08:52:26 +02:00
unit1396.c copyright: update all copyright lines and remove year ranges 2023-01-03 09:19:21 +01:00
unit1397.c gskit: remove 2023-08-07 20:57:48 +02:00
unit1398.c build: fix compiling with GCC 4.x versions 2025-01-22 11:26:15 +01:00
unit1399.c lib/src: white space edits to comply better with code style 2024-09-19 14:59:12 +02:00
unit1600.c copyright: update all copyright lines and remove year ranges 2023-01-03 09:19:21 +01:00
unit1601.c lib: add ability to disable auths individually 2023-09-07 17:45:06 +02:00
unit1602.c src: fix potential macro confusion in cmake unity builds 2024-08-22 10:45:04 +02:00
unit1603.c src: fix potential macro confusion in cmake unity builds 2024-08-22 10:45:04 +02:00
unit1605.c copyright: update all copyright lines and remove year ranges 2023-01-03 09:19:21 +01:00
unit1606.c tests: speed up builds with single-binary test bundles 2024-09-22 09:51:15 +02:00
unit1607.c dnscache: slight refactoring 2025-04-03 16:40:56 +02:00
unit1608.c test1608: make it build and get skipped without shuffle DNS support 2023-08-17 17:17:59 +02:00
unit1609.c dnscache: slight refactoring 2025-04-03 16:40:56 +02:00
unit1610.c lib: prefer CURL_SHA256_DIGEST_LENGTH over the unprefixed name 2024-08-13 10:04:06 +02:00
unit1611.c md4: only build when used 2023-05-13 09:57:35 +02:00
unit1612.c lib: remove function pointer typecasts for hmac/sha256/md5 2024-10-15 14:32:39 +02:00
unit1614.c CI: move Azure jobs to GHA, fix fallouts, sshserver, runtests tweaks 2024-09-16 10:00:17 +02:00
unit1615.c tidy-up: use CURL_ARRAYSIZE() 2025-02-19 00:59:45 +01:00
unit1616.c hash_offt: standalone hash for curl_off_t 2025-03-01 18:42:10 +01:00
unit1620.c cmake: fix clang-tidy builds to verify tests, fix fallouts 2025-03-24 10:14:58 +01:00
unit1621.c unit tests: use the unit test infrastructure better 2023-04-01 08:59:38 -07:00
unit1650.c build: enable -Wcast-qual, fix or silence compiler warnings 2025-03-10 22:30:15 +01:00
unit1651.c build: fix some -Wsign-conversion/-Warith-conversion warnings 2023-12-19 12:45:28 +00:00
unit1652.c multi: event based rework 2025-02-22 14:47:40 +01:00
unit1653.c checksrc: disallow spaces before labels 2023-05-18 20:45:04 +02:00
unit1654.c cmake: fix clang-tidy builds to verify tests, fix fallouts 2025-03-24 10:14:58 +01:00
unit1655.c tidy-up: use CURL_ARRAYSIZE() 2025-02-19 00:59:45 +01:00
unit1656.c tidy-up: make per-file ARRAYSIZE macros global as CURL_ARRAYSIZE 2025-02-07 14:21:59 +01:00
unit1657.c tidy-up: use CURL_ARRAYSIZE() 2025-02-19 00:59:45 +01:00
unit1658.c test1658: add unit test for the HTTPS RR decoder 2025-04-05 21:03:47 +02:00
unit1660.c strparse: string parsing helper functions 2024-12-12 16:00:52 +01:00
unit1661.c cmake: fix clang-tidy builds to verify tests, fix fallouts 2025-03-24 10:14:58 +01:00
unit1663.c cmake: fix clang-tidy builds to verify tests, fix fallouts 2025-03-24 10:14:58 +01:00
unit1664.c strparse: speed up the hex parser somewhat 2025-02-19 07:49:06 +01:00
unit2600.c build: add Windows CE / CeGCC support, with CI jobs 2025-02-21 13:56:34 +01:00
unit2601.c bufq: unwrite fix 2024-10-03 13:27:36 +02:00
unit2602.c trace: make tracing available in non-debug builds 2023-08-03 17:32:25 +02:00
unit2603.c CI: move Azure jobs to GHA, fix fallouts, sshserver, runtests tweaks 2024-09-16 10:00:17 +02:00
unit2604.c build: enable -Wcast-qual, fix or silence compiler warnings 2025-03-10 22:30:15 +01:00
unit3200.c cmake: fix clang-tidy builds to verify tests, fix fallouts 2025-03-24 10:14:58 +01:00
unit3205.c GHA: extend clang-tidy jobs with more build options, add Windows job 2025-03-24 12:37:43 +01:00
unit3211.c multi: do transfer book keeping using mid 2025-04-17 17:28:38 +02:00
unit3212.c multi: do transfer book keeping using mid 2025-04-17 17:28:38 +02:00
unit3213.c multi: do transfer book keeping using mid 2025-04-17 17:28:38 +02:00

Unit tests

The goal is to add tests for all functions in libcurl. If functions are too big and complicated, we should split them into smaller and testable ones.

Build Unit Tests

./configure --enable-debug is required for the unit tests to build. To enable unit tests, there is a separate static libcurl built that is used exclusively for linking unit test programs. Just build everything as normal, and then you can run the unit test cases as well.

Run Unit Tests

Unit tests are run as part of the regular test suite. If you have built everything to run unit tests, to can do 'make test' at the root level. Or you can cd tests and make and then invoke individual unit tests with ./runtests.pl NNNN where NNNN is the specific test number.

Debug Unit Tests

If a specific test fails you get told. The test case then has output left in the %LOGDIR subdirectory, but most importantly you can re-run the test again using gdb by doing ./runtests.pl -g NNNN. That is, add a -g to make it start up gdb and run the same case using that.

Write Unit Tests

We put tests that focus on an area or a specific function into a single C source file. The source file should be named unitNNNN.c where NNNN is a previously unused number.

Add your test to tests/unit/Makefile.inc (if it is a unit test). Add your test data filename to tests/data/Makefile.am

You also need a separate file called tests/data/testNNNN (using the same number) that describes your test case. See the test1300 file for inspiration and the tests/FILEFORMAT.md documentation.

For the actual C file, here's a simple example:


    #include "curlcheck.h"

    #include "a libcurl header.h" /* from the lib dir */

    static CURLcode unit_setup( void )
    {
      /* whatever you want done first */
      return CURLE_OK;
    }

    static void unit_stop( void )
    {
      /* done before shutting down and exiting */
    }

    UNITTEST_START

      /* here you start doing things and checking that the results are good */

      fail_unless( size == 0 , "initial size should be zero" );
      fail_if( head == NULL , "head should not be initiated to NULL" );

      /* you end the test code like this: */

    UNITTEST_STOP