-
- Downloads
Add S3 storage integration for crawler and evaluation; Infrastructure example; Documentation;
Showing
- .env 9 additions, 8 deletions.env
- README.md 123 additions, 59 deletionsREADME.md
- crawler/crawler.py 156 additions, 42 deletionscrawler/crawler.py
- crawler/message_queue.py 89 additions, 0 deletionscrawler/message_queue.py
- crawler/storage.py 85 additions, 0 deletionscrawler/storage.py
- evaluation/evaluate.py 71 additions, 57 deletionsevaluation/evaluate.py
- evaluation/requirements.txt 0 additions, 6 deletionsevaluation/requirements.txt
- evaluation/storage.py 101 additions, 0 deletionsevaluation/storage.py
- infra/docker-compose.yml 22 additions, 0 deletionsinfra/docker-compose.yml
- infra/minio/Dockerfile 6 additions, 0 deletionsinfra/minio/Dockerfile
- infra/minio/entrypoint.sh 22 additions, 0 deletionsinfra/minio/entrypoint.sh
- pypi_malregistry/README.md 0 additions, 0 deletionspypi_malregistry/README.md
- requirements.txt 15 additions, 2 deletionsrequirements.txt
- runner.py 22 additions, 2 deletionsrunner.py
- sandbox/.ssh/id_pub.rsa 0 additions, 1 deletionsandbox/.ssh/id_pub.rsa
- sandbox/Dockerfile 10 additions, 13 deletionssandbox/Dockerfile
- scheduler/scheduler.py 169 additions, 0 deletionsscheduler/scheduler.py
- scheduler/storage.py 85 additions, 0 deletionsscheduler/storage.py
- worker/Dockerfile 1 addition, 1 deletionworker/Dockerfile
- worker/__init__.py 0 additions, 0 deletionsworker/__init__.py
Loading
Please register or sign in to comment