mirror of
https://git.jabber.space/devs/cproof.git
synced 2026-07-19 08:26:21 +00:00
jabber.developer2
b1d820462a
End-to-end performance and correctness harness for the flat-file +
SQLite database backends. Lives in tests/bench/, built only on
demand (`make bench`); not part of `make check`.
Components
gen_history (P1)
Deterministic corpus generator. Knobs: lines, contacts, years,
seed, stanza-id mode (uuid/libpurple/conversations/mixed), LMC
rate, MAM-OOO rate, resources/contact, length profile
(short/mixed/long/extreme). Emits the canonical
flatlog/<account>/<contact>/history.log layout used by
ff_verify_integrity. ~340 LOC.
bench_runner (P1, P2.5)
S1 cold tail-access via sparse index
S2 warm tail-access (page cache hot)
S3 deep pagination (1000 binary-search lookups)
S4 first-time index build (cold file -> ff_state_ensure_fresh)
S5 incremental extend (asserts no full rebuild path)
S6 real ff_verify_integrity over the contact tree
Reports total/err/warn/info issue counts in the CSV note.
bench_long_messages (P2)
L1-L14 long-message stress: 1KB up to 9.9MB bodies, plus
oversized line rejection (10MB+1 -> ff_readline returns ""),
embedded-newline / pipe / emoji body patterns, full parse on
100x1MB, 1000x100KB sustained append.
bench_failure_modes (P3)
F1-F15 failure-injection: truncated last line, mid-file CRLF,
mid-file BOM, LMC cycle, LMC depth>FF_MAX_LMC_DEPTH, manual
': ' in resource, RTL/ZWSP, Latin-1 byte, empty body,
mtime/inode flip, empty file. Each test asserts expected issue
levels and reports PASS/FAIL.
bench_export_import (P5)
Links real database_export.c + database_sqlite.c + database.c
and drives log_database_export_to_flatfile /
log_database_import_from_flatfile under load.
Subcommands: seed, export, import, roundtrip, verify.
S7a/b export, S8a/b import, S8e roundtrip with full byte-by-byte
content diff of every row in (from_jid, to_jid, message,
timestamp, type, stanza_id, archive_id, encryption, replace_id).
Make targets
bench-quick / bench / bench-full
bench-longmsg, bench-failure
bench-multicontact, bench-lmc, bench-ooo
bench-export, bench-import, bench-roundtrip
bench-pipeline, bench-pipeline-max (1M rows)
bench-compare, bench-update-baseline
Volume controls: BENCH_VOLUME (small/medium/max), BENCH_PIPE_ROWS,
BENCH_PIPE_ROWS_MAX, BENCH_DATA_DIR, BENCH_CSV.
Baseline + regression checking (P4)
tests/bench/baseline.csv 51 rows: S1-S6 x {small,lmc,ooo}
+ L1-L14 + F1-F15 (11 of 15) +
S7/S8 x {pipe100k, pipe1M}.
compare_baseline.py median over duplicate rows;
exits 1 on any (scenario, volume)
slowdown >= threshold (default 25%).
Verified at scale
bench-pipeline-max: 1,000,000 rows, full content diff
seed 17 s, export 304 s, import 31 s, idempotent re-import 10 s,
diff 2.7 s -- mismatches=0.
Findings surfaced by the harness
Export scales super-linearly: 4 s @ 100k -> 304 s @ 1M (76x for
10x rows). Cause: g_slist_sort on the merged list + per-row
ProfMessage/ff_parsed_line_t allocations. RSS peaks at 1.4 GB
on 1M. Worth a follow-up.
Export progress reporting only fires during the write phase --
the merge+sort phase (~95% of wall time at 1M) is silent.
/history export and /history import are blocking on the main
UI thread; profanity is frozen for the duration (~5 min @ 1M).
ff_readline sets *truncated=TRUE on partial-write tail but
ff_verify_integrity does not surface this -- partial writes
go unflagged (failure-injection F1).
Parser silently truncates body at first unescaped ': ' if a
resource was manually edited to contain it (F9).
In gen_history (caught by the bench's own real-verify pass):
g_strndup mid-codepoint truncation on UTF-8 bank strings -- fixed.
Linkage strategy
database_flatfile.c + parser + verify + common.c are linked
unconditionally. The export/import bench additionally links
database.c + database_sqlite.c + database_export.c. bench_stubs.c
provides minimal stubs for log_*, prefs_*, connection_get_jid,
jid_create, files_*, message_*, ui hooks. integrity_issue_free
is a weak symbol so it falls back to the real database.c
implementation when that file is linked.
138 lines
2.1 KiB
Plaintext
138 lines
2.1 KiB
Plaintext
# git ls-files --others --exclude-from=.git/info/exclude
|
|
# Lines that start with '#' are comments.
|
|
# For a project mostly in C, the following would be a good set of
|
|
# exclude patterns (uncomment them if you want to use them):
|
|
# *.[oa]
|
|
# *~
|
|
|
|
# IDE
|
|
.codelite/
|
|
profanity.mk
|
|
profanity.project
|
|
profanity.workspace
|
|
compile_commands.json
|
|
.tern-port
|
|
.tern-project
|
|
.cproject
|
|
.project
|
|
.settings/
|
|
.vscode/
|
|
*.plist/
|
|
|
|
# autotools
|
|
.libs/
|
|
/Makefile
|
|
/Makefile.in
|
|
_configs.sed
|
|
aclocal.m4
|
|
autom4te.cache/
|
|
build-aux/
|
|
config.log
|
|
config.status
|
|
configure
|
|
configure*~
|
|
libprofanity.la
|
|
libtool
|
|
m4/
|
|
**/.deps/
|
|
**.dirstamp
|
|
src/config.h
|
|
src/config.h.in
|
|
src/config.h.in~
|
|
src/gitversion.h
|
|
src/gitversion.h.in
|
|
src/stamp-h1
|
|
src/plugins/profapi.lo
|
|
|
|
# clangd
|
|
.cache/
|
|
|
|
# out-of-tree build folders
|
|
build*/
|
|
|
|
# binaries
|
|
profanity
|
|
**/*.o
|
|
|
|
# test output
|
|
tests/functionaltests/functionaltests
|
|
tests/functionaltests/functionaltests.log
|
|
tests/functionaltests/functionaltests.trs
|
|
tests/unittests/unittests
|
|
tests/unittests/unittests.log
|
|
tests/unittests/unittests.trs
|
|
test-suite.log
|
|
test-files/
|
|
test-logs/
|
|
|
|
# valgrind output
|
|
profval*
|
|
|
|
# local scripts
|
|
clean-test.sh
|
|
gen_docs.sh
|
|
gitpushall.sh
|
|
|
|
# website files
|
|
main_fragment.html
|
|
toc_fragment.html
|
|
|
|
# valgrind files
|
|
valgrind.out
|
|
my-prof.supp
|
|
|
|
# Generate docs
|
|
apidocs/python/_build/
|
|
apidocs/python/modules.rst
|
|
apidocs/python/prof.rst
|
|
apidocs/python/src/prof.pyc
|
|
apidocs/python/plugin.rst
|
|
apidocs/python/src/plugin.pyc
|
|
apidocs/c/html/
|
|
apidocs/c/doxygen_sqlite3.db
|
|
|
|
# Temp Vim files
|
|
**/*.swp
|
|
|
|
# Virtual envs
|
|
python2/
|
|
python3/
|
|
|
|
.DS_Store
|
|
.gdbinit
|
|
*.bak
|
|
*.orig
|
|
*.patch
|
|
*.rej
|
|
breaks
|
|
|
|
*.tar.*
|
|
*.zip
|
|
*.log*
|
|
coverage/
|
|
*.gcno
|
|
*.gcda
|
|
*.gcov
|
|
coverage.info
|
|
|
|
# Bench harness build artefacts (sources are committed; binaries/CSVs aren't)
|
|
tests/bench/gen_history
|
|
tests/bench/bench_runner
|
|
tests/bench/bench_long_messages
|
|
tests/bench/bench_failure_modes
|
|
tests/bench/bench_export_import
|
|
tests/bench/*.o
|
|
tests/bench/.deps/
|
|
tests/bench/current.csv
|
|
tests/bench/full.csv
|
|
tests/bench/quick.csv
|
|
tests/bench/longmsg.csv
|
|
tests/bench/fail.csv
|
|
tests/bench/multi.csv
|
|
tests/bench/lmc.csv
|
|
tests/bench/ooo.csv
|
|
tests/bench/pipe.csv
|
|
tests/bench/pipeline.csv
|
|
tests/bench/maxpipeline.csv
|
|
tests/bench/imp.csv
|