Finding the page that answers a question about a 10-K
Page-level retrieval over 360 SEC filings, scored on FinanceBench's 150 public questions. A company and period filter and statement routing do most of the work; an embedding hybrid tied BM25 at about five times the latency, so BM25 ships.
Ask a 10-K a question
Runs in your browser on 84 SEC filings
- (a miss)
- 360 filings
- 1 filing: American Express 2022 10-K
- 260 pages
- balance sheet first
FinanceBench's answer is page 98. This pipeline ranks it first; BM25 over every page ranked it below 100.
-
1Page 98Balance sheetLabeled answer
Table of Contents CONSOLIDATED BALANCE SHEETS December 31 (Millions, except share data) 2022 2021 Assets Cash and cash equivalents Cash and due from banks (includes restricted cash of consolidated variable interest entities: 2022, $5; 2021, $11) $ 5,510 $ 1,292 Interest-bearing deposits in other ban…
-
2Page 152
…s our maximum credit exposure of the on-balance sheet assets by category as of December 31: (Billions) 2022 2021 Individuals: $ 156 $ 131 United States 129 108 Outside the United States 27 23 Institutions: Financial services 36 24 Other 17 15 U.S. Government and agencies 4 2 Total on-balance sheet $…
-
3Page 65
…apital adequacy guidelines. On- and off-balance sheet items are weighted for risk, with off-balance sheet items converted to balance sheet equivalents, using risk conversion factors, before being allocated a risk-adjusted weight. Off-balance sheet exposures comprise a minimal part of the total risk-…
| Measure | Value |
|---|---|
| Hit@10, 100 questions | 0.14 to 0.71 |
| Company and period filter | +0.29 |
| Statement routing | +0.28 |
| Company name left out of the query (0.75) | +0.04, within noise |
| BM25 on one core | 126 req/s, 12 ms p95 |
- SEC filing PDFs
- PyMuPDF page text
- Company and period filter
- BM25
- Statement routing
- FastAPI service