PyPI page
Home page
Author:
Cheng-Yuan King
License:
MIT
Summary:
An adversarial benchmark foundry for LLM safety: audit attack corpora, score benchmark staleness, compare defences (ASR + false-refusal), test multilingual over-refusal, and export safe challenge packs.
Latest version:
0.5.1
Required dependencies:
anthropic
|
datasets
|
httpx
|
ollama
|
openai
|
pandas
|
pydantic
|
python-dotenv
|
pyyaml
|
rich
|
tenacity
|
typer
Optional dependencies:
accelerate
|
agentdojo
|
bitsandbytes
|
hatchling
|
inspect-ai
|
matplotlib
|
mypy
|
opencc
|
plotly
|
pre-commit
|
pytest
|
pytest-asyncio
|
pytest-cov
|
ruff
|
sentencepiece
|
streamlit
|
transformers
|
types-pyyaml
Downloads last day:
2
Downloads last week:
26
Downloads last month:
58
7-day smoothing