Learn ResearchArcade

Explore our datasets, utilities, data model, and storage layers.

Start here to understand ResearchArcade's comprehensive academic data infrastructure—from pre-built datasets to processing utilities, graph-based data modeling, and flexible storage formats.

Datasets

SQL Dataset

ArXiv and OpenReview data stored in PostgreSQL relational dataset.

/learn/arxiv-sql-dataset.html

CSV Dataset

ArXiv and OpenReview data stored in csv dataset supported by pandas dataframe.

/learn/openreview-csv-dataset.html

Utilities

ArXiv Paper Crawling

Tools for fetching papers from ArXiv API with metadata and PDFs.

/learn/arxiv-paper-crawling.html

ArXiv Paper Processing

Convert ArXiv papers into structured graph representations with entities and relations.

/learn/arxiv-paper-processing.html

ArXiv Paragraph Processing

Extract and process paragraph-level text with reference tracking and graph construction.

/learn/arxiv-paragraph-processing.html

OpenReview Paper Crawling

Fetch papers, reviews, and decisions from OpenReview API endpoints.

/learn/openreview-paper-crawling.html

OpenReview PDF Processing

Extract text, figures, and tables from OpenReview PDF submissions.

/learn/openreview-pdf-processing.html

OpenReview Processing

End-to-end pipeline for transforming OpenReview data into graph format.

/learn/openreview-processing.html

Data Model & Schema

Entities (Nodes)

Paper, section, paragraph, figure, table, author, review, revision, decision, and venue entities.

/learn/entities.html

Relations (Edges)

Authorship, citation, contains, refers, revises, reviews, and rebuts relationships.

/learn/relations.html

Schema Details

Cardinalities, required fields, primary keys, stable IDs, and cross-source linking rules.

/learn/schema-details.html

Storage Layers & Exports

SQL Storage

SQL dialect support, DDL snapshots, indexing strategies, and query optimization.

/learn/sql-storage.html

CSV Storage

Per-table CSV specifications, format conventions, and best practices.

/learn/csv-storage.html

JSON Storage

Per-entity JSON schemas and document structure for flexible exports.

/learn/json-storage.html

Format Conversion

Round-trip conversion between SQL, CSV, and JSON with data integrity preservation.

/learn/format-conversion.html