Skip to content

New benchmarking suite #42

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
May 19, 2025
Merged

New benchmarking suite #42

merged 8 commits into from
May 19, 2025

Conversation

sarahmish
Copy link
Contributor

Resolve #36

sarahmish and others added 4 commits May 16, 2025 21:47
…tection Support (#39)

* Core Changed to get normal behavior in pipeline

* Transformation changed

* anomalies.py changed

* Hugginface.py changed : no restrictions token, and also has normal as input if 1-shot

* Timeseries preprocessing.py

* jsons files added for primitives

* jsons files added for primitives

* pipelines 0shot and 1shot added

* add boolean for restrict_tokens in HF

* good messages.json for prompt

* Added load_normal in sigllm.data

* Fixed load_normal in sigllm.data

* Fixed lint format

* Fixed lint format Ruff

* Fixed from review Sarah

* Fixed lint format after working on Sarah's reviews

* Dataset prompter parameters

* .jons removed from input names in 1_shot pipeline.json

* .jons removed from input names in 1_shot pipeline.json

* fix PR issues & add unittests

* add unittests for parse_anomaly_response

* remove unused functions

* add new functionality tests

* update ubuntu image

* change normal->single

* fix lint

* swap normal -> single

---------

Co-authored-by: Salim Cherkaoui <salim31@dai-desk32.lids.mit.edu>
Co-authored-by: Sarah Alnegheimish <sarahalnegheimish@gmail.com>
@sarahmish sarahmish merged commit b850ea9 into master May 19, 2025
22 checks passed
@sarahmish sarahmish deleted the benchmarking-suite branch May 19, 2025 14:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add benchmarking suite to sigllm
2 participants