arxiv-sanity-lite

arxiv-sanity-lite helps researchers stay on top of new papers in their field without drowning in noise. Instead of browsing the entire arxiv repository, you tag papers you find interesting, and the system learns what you care about and recommends similar new papers as they're posted. You get a clean web interface to search, filter, and sort results, and optionally receive daily email digests of recommendations tailored to your interests.

The system works by regularly downloading new papers from arxiv and analyzing their abstracts. It uses a machine learning technique (SVMs applied to text features) to find papers similar to ones you've tagged as interesting. When you mark a paper as relevant to, say, "neural networks" or "computer vision," the system builds a profile of that tag and automatically surfaces new papers that match that profile. The whole thing is lightweight and runs cheaply—the author hosts the live version on a $5/month server that indexes about 30,000 papers.

The typical workflow is straightforward: visit the site, search or browse papers, tag ones that matter to you, and let the recommendations flow in. Over time, as you refine your tags, the recommendations get more precise. Researchers, graduate students, and anyone trying to keep current in a fast-moving field would benefit from this, since manually checking arxiv every day is tedious and you'll inevitably miss relevant work. The daily email feature (optional) means you can get a digest of promising papers delivered to your inbox without logging in.

The project is intentionally stripped down compared to the original arxiv-sanity—it's a rewrite focused on simplicity rather than bells and whistles. All the data is stored locally in a simple database that the author acknowledges could be more efficient, and the search is a basic scan rather than an optimized index. But for a few thousand papers, it's more than fast enough, and the tradeoff keeps the code maintainable and deployable on minimal infrastructure.