25.1 Purpose
- The Transparency Dashboard gives the research community verifiable, up-to-date information about how our publishing program performs—editorial speed, rigor, openness, integrity actions, inclusion, accessibility, and preservation. Numbers are accompanied by clear definitions, methods, and time windows so they are interpretable and auditable.
25.2 Scope
- The dashboard covers all journals we publish. Journal-level views roll up to portfolio totals. Unless stated, metrics apply to research content (original research, short reports, methods, datasets, software papers) and exclude front matter (editorials, news), corrections, and retractions.
25.3 Update Cadence & Windows
- Update cadence: monthly refresh; quarterly static snapshots (DOI-assigned) for citation and reference.
- Windows displayed: rolling 6-month and 12-month windows, with exact start/end dates on every chart/table. Historical archives are browsable by quarter.
25.4 Publication & Download
- Each metric has: definition, formula, denominator, inclusions/exclusions, time window, and last refresh timestamp.
- Users can download CSV and JSON for every view; quarterly snapshots have a landing page with a DOI and version notes.
- A machine-readable schema (see 25.12) describes fields to support reuse and auditing.
25.5 Metric Families (what we publish)
- Editorial Workflow
- Submissions received; desk-reject rate.
- Median Time to First Decision (calendar days).
- Median Time Acceptance→Publication (calendar days).
- Revise cycles per accepted paper (median, IQR).
- Transfer offers/acceptance within portfolio.
- Rigor & Integrity
- Articles with methods/statistics review beyond standard peer review (share).
- Articles with open data/code/materials (three separate percentages).
- Corrections / Expressions of Concern / Retractions (counts and per-1,000 articles; reasons categorized).
- Post-publication audits initiated and outcomes (Section 24 categories).
- Ethics & Registration
- Clinical trial prospective registration rate and registry ID presence rate.
- Human/animal research with ethics statement present (share).
- Data sharing plan presence in trials.
- Peer Review Transparency
- Review models used (double-anonymized / single-anonymized / open / transparent), per article share.
- Articles with published peer-review files (share).
- Reviewer turnaround (median days) and report length (median word count), where available.
- Openness & Licensing
- License mix (CC BY, CC BY-NC, CC BY-NC-ND, other).
- Self-archiving (AAM) links present (share).
- TDM-readiness (machine-readable license embedded; share).
- Accessibility
- Pages meeting WCAG 2.2 AA checks (rate).
- Articles with tagged PDF/UA (share).
- Media with captions/transcripts (share).
- Preservation & Indexing
- Articles deposited with LOCKSS/CLOCKSS / Portico (share).
- Metadata completeness rates (ORCID for all authors; ROR for affiliations; license URI; funder IDs).
- Indexing coverage (where confirmed by index).
- Equity, Inclusion & Fees (aggregated, privacy-preserving)
- Waiver/discount utilization (share), by World Bank income group and by field.
- APC distribution (median, IQR) for OA venues.
- Geographic distribution of corresponding authors (region-level).
- Accessible-format requests fulfilled (count, on-time rate).
- Community & Complaints
- Appeals received → outcomes (upheld / revision invited / not upheld).
- Editorial-process complaints (counts, median resolution days).
- Conduct reports — aggregated counts and actions.
25.6 Definitions & Formulas (examples, published on the dashboard)
- Median Time to First Decision (days) = median over articles in window of (decision_date − submission_date).
- Open Data Share (%) = (# articles in window with a Data Availability Statement that links to a functioning repository landing page and passes automated link check) ÷ (# articles in window) × 100.
- Correction Rate (per 1,000) = 1,000 × (# corrections posted in window) ÷ (# articles published in same window).
- WCAG Pass Rate (%) = pages passing automated checks for AA success criteria ÷ pages tested × 100; manual audits reported separately.
- A full glossary accompanies the dashboard; every metric displays its denominator and any exclusions (e.g., editorials).
25.7 Methods & Quality Controls
- Provenance: Metrics are computed from submission/production logs, DOI/metadata deposits, and preservation receipts.
- Link checks: Automated, nightly validation of repository and license links; failures are flagged and reduce the “open” metric until fixed.
- Outlier handling: We publish medians and IQRs; means are shown only when distributions are symmetric.
- Missing data: We show counts missing and exclude them from denominators only when justified (rule published beside metric).
- Audit trail: Each refresh stores inputs, code hash, and outputs; quarterly snapshots are reproducible from frozen inputs.
25.8 Privacy, Ethics & Fairness
- Aggregation thresholds: We suppress or group categories with n < 5 to prevent re-identification.
- No ranking league tables between journals without context; comparisons include confidence intervals and caveats.
- Sensitive attributes (e.g., gender) are not inferred; any voluntary self-reported attributes are shown only as high-level aggregates with explicit consent and opt-out.
25.9 Anti-Gaming & Integrity of Metrics
- Definitions and code are public; retroactive restatements are logged with reasons.
- We prohibit marketing claims that cherry-pick windows or exclude relevant content.
- Periodic internal audits and, where appropriate, external assurance review methodology and samples.
25.10 Accessibility of the Dashboard
- Conforms to WCAG 2.2 AA: keyboard-operable filters, high contrast, screen-reader labels, downloadable data tables for each chart, and text alternatives for insights.
- All charts include plain-language summaries and list sample sizes.
25.11 Changelog & Versioning
- Every quarterly snapshot has a DOI, semantic version (e.g., 2025.Q3.v1), and changelog describing metric changes, bug fixes, and restatements.
- “Methodology changes” badges appear on affected charts for one full window after any definitional update.
25.12 Data & API Schema (summary)
- Endpoints: /portfolio, /journal/{issn}, /timeseries/{metric}, /snapshot/{quarter} (JSON & CSV).
- Core fields: metric_id, metric_name, definition_url, window_start, window_end, value, units, denominator, n_missing, ci_low, ci_high, journal_id, journal_title, subject_area, last_refreshed, method_version.
- Licensing: Data released under CC BY 4.0; code samples under an OSI license.
- Rate limits: Optimized for reproducible harvesting; bulk downloads via snapshot files.
25.13 Journal-Level Pages
- Each journal page displays a subset of portfolio metrics with the same definitions, plus any journal-specific notes (e.g., specialized article types). Where a journal uses a different peer-review model for a subset, this is indicated with in-chart notes.
25.14 Interpretation Guidance (on the dashboard)
- Medians and IQRs are more robust than means for skewed timelines.
- Longer time to publication may reflect thorough revision rounds or complex production (e.g., large datasets).
- Open data/code shares can vary by field due to ethics or IP constraints; we encourage controlled-access routes rather than simple binaries.
25.15 Responsibilities & Contacts
- Owner: Research Integrity & Analytics Team.
- Data stewards: Journal Managing Editors (inputs), Product Analytics (pipelines), Accessibility Lead (conformance).
- Contact: Dashboard feedback channel; we acknowledge within 5 business days and log issues publicly.
25.16 Continuous Improvement
- Annual community consultation on new metrics (e.g., replication packages quality, FAIRness scores).
- Pilot studies may appear as experimental metrics labeled clearly and excluded from portfolio rollups until validated.