Man pages for pangoling
Access to Large Language Model Predictions
| causal_config | Returns the configuration of a causal model |
| causal_lp-defunct | Get the log probability of each element of a vector of words... |
| causal_lp_mats-defunct | Get a list of matrices with the log probabilities of possible... |
| causal_next_tokens_pred_tbl | Generate next tokens after a context and their predictability... |
| causal_next_tokens_tbl-defunct | Get the possible next tokens and their log probabilities for... |
| causal_predictability | Compute predictability using a causal transformer model |
| causal_pred_mats | Generate a list of predictability matrices using a causal... |
| causal_preload | Preloads a causal language model |
| causal_tokens_lp_tbl-defunct | Get the log probability of each token in a sentence (or group... |
| df_jaeger14 | Self-Paced Reading Dataset on Chinese Relative Clauses |
| df_sent | Example dataset: Two word-by-word sentences |
| installed_py_pangoling | Check if the required Python dependencies for 'pangoling' are... |
| install_py_pangoling | Install the Python packages needed for 'pangoling' |
| masked_config | Returns the configuration of a masked model |
| masked_lp-defunct | Get the log probability of a target word (or phrase) given a... |
| masked_preload | Preloads a masked language model |
| masked_targets_pred | Get the predictability of a target word (or phrase) given a... |
| masked_tokens_pred_tbl | Get the possible tokens and their log probabilities for each... |
| masked_tokens_tbl-defunct | Get the possible tokens and their log probabilities for each... |
| ntokens | The number of tokens in a string or vector of strings |
| pangoling-defunct | Defunct functions in package 'pangoling'. |
| pangoling-package | pangoling: Access to Large Language Model Predictions |
| perplexity_calc | Calculates perplexity |
| set_cache_folder | Set cache folder for HuggingFace transformers |
| tokenize_lst | Tokenize an input |
| transformer_vocab | Returns the vocabulary of a model |
