SSARE serves as an efficient and scalable resource for semantic search and article recommendations, catering primarily to political news data.
SSARE is Open Politics' data aggregation system and vector storage endpoint. It aims to create up-to-date and relevant datasets for the LLMs to work with. A microservice infrastructure continuously scrapes news sites and stores them in a vector storage and a relational database (Postgres). Sources can be added with Python scripts which yield a dataframe with: URL | Headline | Paragraphs | Source. Just clone the service, add your scripts and bring your own data endpoint into production.
Status: | Active |
---|---|
Founded: | 2024 |
Parent Organization: | Open Politics |
Open Source: | Yes |
Last Modified: | 11/26/2024 |
Added on: | 11/22/2024 |