Quick Start
Get started in three steps.
curl -O https://bankstatemently.com/benchmark/statements/bsb-001-statement.pdf
your-parser bsb-001-statement.pdf > result.jsonHASH=$(shasum -a 256 bsb-001-statement.pdf | cut -d' ' -f1)
curl -X POST https://api.bankstatemently.com/v1/benchmark/evaluate \
-H "Content-Type: application/json" \
-H "X-API-Key: your-api-key" \
-d "{\"contentHash\": \"$HASH\", \"transactions\": $(cat result.json)}"Why Bank Statement Parsing Is Hard
Real-world bank statements contain dozens of formatting quirks that break naive parsers.
Missing Year in Dates
Statements omit the year from transaction dates (e.g., "03/15" instead of "03/15/2025"), which makes it impossible to sort or reconcile without guessing.
In 5 statementsBlank Dates for Same-Day Transactions
Statements only print the date on the first transaction of each day — the rest have blank date cells.
In 1 statementPlus/Minus Sign After the Amount
Statements place the plus or minus sign after the amount (e.g., "123.45-" instead of "-123.45").
In 0 statementsCurrency Symbols Breaking Numeric Parsing
Statements embed currency symbols (e.g., "$1,234.56") directly in amount cells, which breaks numeric parsing in Excel and most CSV importers.
In 2 statementsNo Visible Table Lines or Borders
Statements sometimes lack clear row or column lines.
In 1 statementSeparate Credit & Debit Columns
Statements use separate Credit and Debit columns in some formats, while others use a single Amount column with signs.
In 10 statementsDescriptions Wrapped Across Lines
Transaction descriptions often span multiple lines in the PDF, making it hard to tell where one transaction ends and the next begins.
In 1 statementPhantom Balance Rows on Every Page
Statements repeat "Balance brought forward" and "Balance carried forward" rows on every page.
In 1 statementThe Dataset
Basic5 statements
Intermediate5 statements
Advanced5 statements
How Scoring Works
Your score is measured across two dimensions:
Extraction Accuracy
Field-by-field comparison of dates, amounts, descriptions, and balances against ground truth.
Statement Integrity
Balance reconciliation, total validation, and row-level alignment across the full statement.