API for localLLM
Running Local LLMs with 'llama.cpp' Backend

Global functions
.acquire_download_lock Source code
.apply_model_chat_template Source code
.as_annotation_df Source code
.check_model_memory_requirements Source code
.check_repeat_last_n Source code
.clean_output Source code
.coerce_prompt_frame Source code
.cohen_kappa Source code
.detect_gpu_info Source code
.detect_gpu_layers Source code
.detect_total_ram_bytes Source code
.detect_vulkan_linux Source code
.detect_vulkan_windows Source code
.document_format_details Source code
.document_format_entries Source code
.document_normalise_metadata Source code
.document_record_event Source code
.document_session_facts Source code
.download_model_to_cache Source code
.download_with_auth Source code
.download_with_retry Source code
.empty_ollama_df Source code
.ensure_backend_loaded Source code
.ensure_model_loaded Source code
.ensure_quick_llama_ready Source code
.ensure_system_profile Source code
.explore_detect_gpu_layers Source code
.explore_generation_summary Source code
.explore_spec_summary Source code
.fallback_ollama_name Source code
.format_prompt_header Source code
.generate_in_batches Source code
.generate_multiple Source code
.generate_single Source code
.get_cache_path Source code
.get_default_model Source code
.get_download_url Source code
.get_model_cache_dir Source code
.get_or_create_handles Source code
.hash_attach_metadata Source code
.hash_model_identifier Source code
.hash_normalise_model_source Source code
.hash_payload Source code
.infer_levels Source code
.is_backend_loaded Source code Source code
.is_lock_stale Source code
.is_ollama_reference Source code
.is_pid_alive Source code
.is_url Source code
.is_valid_gguf_file Source code
.krippendorff_alpha Source code
.lib_path Source code
.list_cached_models Source code
.localllm_detect_system_profile Source code
.localllm_message Source code
.localllm_restore_quiet Source code
.localllm_set_quiet Source code
.match_ollama_reference Source code
.match_ollama_reference_df Source code
.models_list_to_df Source code
.name_to_title Source code
.normalise_model_specs Source code
.ollama_candidate_roots Source code
.onAttach Source code
.onUnload Source code
.parse_ollama_manifest Source code
.preflight_hf_authorization Source code
.prompts_from_template Source code
.prompts_from_vector Source code
.read_lock_file Source code
.read_ollama_manifests Source code
.release_download_lock Source code
.render_field Source code
.render_list_as_prompt Source code
.render_prompt_dataframe Source code
.render_prompt_vector Source code
.render_unnamed_list Source code
.resolve_model_name Source code
.resolve_model_path Source code
.resolve_prompts_source Source code
.run_model_over_data Source code
.safe_detect_cores Source code
.safe_list Source code
.safe_system2 Source code
.safety_warnings_enabled Source code
.scan_ollama_root Source code
.select_ollama_model Source code
.select_ollama_model_df Source code
.singularize Source code
.spec_model_source Source code
.truth_column Source code
.try_create_lock Source code
.validate_generation_params Source code
.validate_sink Source code
.verify_file_integrity Source code
.warn_if_context_large Source code
.warn_if_model_exceeds_system Source code
.warn_if_prompt_near_limit Source code
.wide_annotation_matrix Source code
.with_download_timeout Source code
.with_hf_token Man page Source code
`%||%` Source code
ag_news_sample Man page
annotation_sink_csv Man page Source code
apply_chat_template Man page Source code
apply_gemma_chat_template Man page Source code
backend_free Man page Source code
backend_init Man page Source code
compute_confusion_matrices Man page Source code
context_create Man page Source code
detokenize Man page Source code
document_end Man page Source code
document_start Man page Source code
download_model Man page Source code
explore Man page Source code
generate Man page Source code
generate_parallel Man page Source code
get_lib_path Man page Source code
get_model_cache_dir Man page Source code
hardware_profile Man page Source code
install_localLLM Man page Source code
intercoder_reliability Man page Source code
lib_is_installed Man page Source code
list_cached_models Man page Source code
list_ollama_models Man page Source code
localLLM Man page
localLLM-package Man page
model_load Man page Source code
model_metadata Man page Source code
quick_llama Man page Source code
quick_llama_reset Man page Source code
set_hf_token Man page Source code
smart_chat_template Man page Source code
tokenize Man page Source code
tokenize_test Man page Source code
validate Man page Source code
localLLM documentation built on Nov. 3, 2026, 1:09 a.m.