ragnar 0.2.1
CRAN release: 2025-08-19
ragnar_register_tool_retrieve()now registers a tool that will not return previously returned chunks, enabling the LLM to perform deeper searches of a ragnar store with repeated tool calls (#106).Updates for ellmer v0.3.0 and duckdb v1.3.1 (#99)
Improved docs and error message in
ragnar_store_insert()(@mattwarkentin, #88)ragnar_find_links()can now parsesitemap.xmlfiles. It also gains avalidateargument, allowing for sending aHEADrequest to each link and filtering out broken links (#83).ragnar_inspector()now renders all urls as clickable links in the chunk markdown viewer, even if url is not a formal markdown link (#82).Before running examples and tests we now check if ragnar can load DuckDB extensions. This fixes issues in environments where DuckDB pre-built binaries for extensions are not compatible with the installed DuckDB version (#94).
Added
embed_lm_studioto use LMStudio as an embedding provider (#100).Fixed a bug causing
ragnar_retrieve()to fail when documents were inserted without an origin (#102).We now suppress a “Couldn’t find ffmpeg or avconv” warning when importing markitdown when using
read_as_markdown(). The warning would only be relevant for users doing audio transcription (#103).Added
embed_google_geminito use Google Gemini API as an embedding provider (#105).
ragnar 0.2.0
CRAN release: 2025-07-12
ragnar_store_create()gains a new argument:version, with default2. Store version 2 adds support for chunk deoverlapping on retrieval and automatic chunk augmentation with headings. To support these features, the internal schema and ingestion requirements are different. Seemarkdown_chunk()and new S7 classesMarkdownDocumentandMarkdownDocumentChunks. Backwards compatibility is maintained with version = 1. (#58, #39, #36)ragnar_store_create()now supports Date and POSIXct classes supplied toextra_cols.ragnar_store_create()now supports remote MotherDuck Databases specified withmd:<dbname>as thelocationargument. (#50)ragnar_retrieve()and friends gain afilterargument, adding support for efficiently filtering retrieval results.ragnar_retrieve_bm25()gains argumentsb,k, andconjunctive(#56).ragnar_retrieve_vss()gains argumentquery_vector, supporting workflows that preprocess the query string before embedding.ragnar_retrieve_vss()set of validmethodchoices have been updated to a narrower set to ensure that anHNSWindex scan is used.Passing a
tbl(store)toragnar_retrieve()is deprecated.New chunker
markdown_chunk()with support for chunk heading context generation, semantic boundary selection, overlapping chunks, document segmentation, and more. (#56)New function
embed_google_vertex()(@dfalbel, #49)New function
embed_databricks()(@atheriel, #45)New function
ragnar_chunks_view()for quickly previewing chunks (#42)ragnar_register_tool_retrieve()gains optionalnameandtitlearguments to allow for more descriptive tool registration. These values can also be set inragnar_store_create()(#43).ragnar_read()andread_as_markdown()now accept paths that begin with~(@topepo, #46, #48).-
Changes to
read_as_markdown()HTML conversion (#40, #51):- New arguments
html_extract_selectorsandhtml_zap_selectorsprovide a flexible way to exclude some html page elements from being included in the converted markdown. - code blocks now include the language, if available.
- Fixed handling of nested code fences in markdown output.
- New arguments
