PyPI page
Home page
Author:
None
License:
MIT License
Copyright (c) 2023 Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, Karthik R Narasimhan
Permission is hereby granted, fr...
Summary:
The official SWE-bench package - a benchmark for evaluating LMs on software engineering
Latest version:
4.1.0
Required dependencies:
beautifulsoup4
|
chardet
|
datasets
|
docker
|
ghapi
|
gitpython
|
modal
|
pre-commit
|
python-dotenv
|
requests
|
rich
|
tenacity
|
tqdm
|
unidiff
Optional dependencies:
anthropic
|
flash_attn
|
jedi
|
mike
|
mkdocs
|
mkdocs-glightbox
|
mkdocs-include-markdown-plugin
|
mkdocs-material
|
mkdocstrings
|
mkdocstrings-python
|
openai
|
peft
|
protobuf
|
pymdown-extensions
|
pytest
|
pytest-cov
|
requests
|
sentencepiece
|
tiktoken
|
torch
|
transformers
|
triton
Downloads last day:
456,130
Downloads last week:
3,777,617
Downloads last month:
8,911,102