PyPI page
Home page
Author:
Bryan Sanchez
Summary:
Behavioral auditing toolkit for LLMs — audit any model across 8 dimensions (factual, toxicity, bias, sycophancy, reasoning, refusal, deception, over-refusal) using teacher-forced confidence probes.
Latest version:
2.6.0
Required dependencies:
datasets
|
mlx
|
mlx-lm
|
numpy
|
scipy
|
torch
|
transformers
Optional dependencies:
datasets
|
gradio
|
lm-eval
|
matplotlib
|
pandas
|
peft
|
pytest
|
rho-eval
|
safetensors
|
seaborn
|
tqdm
Downloads last day:
1
Downloads last week:
55
Downloads last month:
115