hellmer - Batch Processing for Chat Models
Batch processing framework for 'ellmer' chat models. Provides both sequential and parallel processing of chat interactions with features including tool calling and structured data extraction. Enables workflow management through progress tracking and recovery, automatic retry with backoff, and timeout handling. Additional quality-of-life features include verbosity control and sound notifications. Parallel processing is implemented via the 'future' framework. Includes methods for retrieving progress status, chat texts, and chat objects.
Last updated 5 days ago
batchbatch-processingellmerllm
5.32 score 7 stars 241 downloadsbatchLLM - Batch Process LLM Text Completions Using a Data Frame
Batch process large language model (LLM) text completions using data frame rows, with support for OpenAI's 'GPT' (<https://chat.openai.com>), Anthropic's 'Claude' (<https://claude.ai>), and Google's 'Gemini' (<https://gemini.google.com>). Includes features such as local storage, metadata logging, API rate limiting delays, and a 'shiny' app addin.
Last updated 1 months ago
depreciated
4.85 score 11 stars 6 scripts 234 downloadssamesies - Compare Similarity Across Text, Factors, or Numbers
Compare lists of texts, factors, or numerical values to measure their similarity. The motivating use case is evaluating the similarity of large language model responses across models, providers, or prompts. Approximate string matching is implemented using 'stringdist'.
Last updated 5 days ago
3.65 score 3 stars 145 downloadsredquack - Transfer 'REDCap' Data to 'DuckDB'
Provides a single function to transfer 'REDCap' (Research Electronic Data Capture) data to 'DuckDB'. Processes data in chunks to handle large datasets while minimizing memory usage. Features include resuming incomplete transfers, converting column types, tracking progress, and logging operations in the database.
Last updated 4 hours ago
duckdbredcap
3.30 score 2 stars 13 downloads