OpenViSTAI · Agents · Blockchain · Crypto
Submit a project
Menu
Search & Research AI

Arxiv Sanity Lite

Arxiv Sanity Lite is an open-source Python and Flask web application that polls the arXiv API for new papers, lets users tag papers of interest, and recommends related papers using SVMs over TF-IDF features derived from abstracts. Its interface supports searching, ranking, sorting and filtering results, and it can send scheduled recommendation emails based on users' tags.

Explore the practical guide ↓

Independent OpenViST project profile, based on linked sources.

Arxiv Sanity Lite — OpenViST project profile in Search & Research AI.
OpenViST project illustration. See the linked sources for product details.
Understand the project

Practical overview

When it fits

Use it to follow research interests across newly retrieved arXiv papers, especially when you want related-paper recommendations alongside search and sorting in a web interface.

Who it is for

  • Researchers who want to organize arXiv papers around topics they follow.
  • Readers looking for recommendations of new papers related to papers they have tagged.
  • Operators who want to run a self-hosted arXiv monitoring and discovery site.

Documented uses

  • Tag papers that represent a research interest.
  • Find related new papers using recommendations based on those tags.
  • Search, rank, sort and filter the collected paper results.
  • Receive periodic email recommendations based on saved tags.
Before you choose

Requirements & limits

  • The documented paper retrieval source is the arXiv API; another scholarly source would require changes to retrieval and data handling.
  • Self-hosting requires installing the Python requirements and running separate retrieval, feature-computation and Flask-serving stages.
  • Email recommendations are optional and use the separate send_emails.py script with SendGrid.
  • The README notes that search currently iterates through the database.

Check current requirements in the official documentation. Source-based guidance does not mean OpenViST has run or independently tested this project.

Source-based practical guide

Set up a local Arxiv Sanity Lite instance

Install the documented Python requirements, update the paper database, compute features, and start the Flask server.

Before you start

  • Python 3
  • The project's repository and requirements file
  • Access to the arXiv API for retrieving new papers

Steps

  1. Install dependencies with the command below.

    Documented command
    pip install -r requirements.txt

  2. Run the command below to retrieve new papers.

    Documented command
    python3 arxiv_daemon.py --num 2000

  3. If new papers were added, run the command below to compute TF-IDF features.

    Documented command
    python3 compute.py

  4. Set FLASK_APP=serve.py and run flask run to serve the application locally.

Expected outcome

A locally served Flask application with its database stored in the `data` directory.

Guide limitations

  • The documented retrieval workflow targets arXiv; using another source requires adapting retrieval and data handling.
  • The README says search iterates through the database, which may affect performance as collections grow.
Documentation 1 ↗
Source-based practical guide

Configure scheduled recommendation emails

Add the documented email-sending stage for periodic recommendations based on users' tags.

Before you start

  • An installed Arxiv Sanity Lite instance
  • The SendGrid package, installed with pip install sendgrid

Steps

  1. Install SendGrid with the command below.

    Documented command
    pip install sendgrid

  2. Use the project's send_emails.py script to send recommendations.

  3. Schedule the script periodically; the README describes running it as a daily cron job.

Expected outcome

A scheduled email stage for new-paper recommendations based on tags.

Guide limitations

  • The README does not detail email-provider account setup or configuration.
Documentation 1 ↗
Evidence and transparency

Sources & review

Official repository ↗
Source record details
Source availability
Active
Sources checked
15 October 2026
Original website title
karpathy/arxiv-sanity-lite · Official homepage title · retained in its source language
How we review sourcesSuggest a correction