PyPI page
Home page
Author:
Dr. Fouad Bousetouane
License:
Apache-2.0
Summary:
The open-source, domain-aware test harness for AI agents. Run multi-turn adversarial evaluations with jury-based scoring across production-critical metrics — hallucination, policy compliance, drift, tool use, manipulation resistance. BYO LLM. BYO traps.
Latest version:
0.7.3
Required dependencies:
httpx
|
jinja2
|
langchain
|
langchain-core
|
langgraph
|
litellm
|
pydantic
|
python-frontmatter
|
pyyaml
|
rich
|
typer
Optional dependencies:
beautifulsoup4
|
build
|
ipykernel
|
jupyter
|
mkdocs-material
|
mkdocstrings
|
nbformat
|
pillow
|
pre-commit
|
pypdf
|
pyright
|
pytest
|
pytest-asyncio
|
pytest-cov
|
python-docx
|
ruff
|
twine
Downloads last day:
10
Downloads last week:
365
Downloads last month:
759