Aqua rat

[jonas-becker]

merge after #143

[github-actions]

Coverage Report

Name                                                        Stmts   Miss Branch BrPart  Cover
---------------------------------------------------------------------------------------------
mallm/__init__.py                                               1      0      0      0   100%
mallm/agents/__init__.py                                        0      0      0      0   100%
mallm/agents/agent.py                                          85     42     18      3    47%
mallm/agents/draftProposer.py                                  11      1      2      1    85%
mallm/agents/panelist.py                                       11      6      2      0    38%
mallm/agents/policyFeedback.py                                 26     12      2      1    54%
mallm/coordinator.py                                          159     71     54      7    52%
mallm/decision_protocol/__init__.py                             0      0      0      0   100%
mallm/decision_protocol/approval_voting.py                     47     31     10      0    28%
mallm/decision_protocol/consensus.py                           52     11     10      1    74%
mallm/decision_protocol/consensus_voting.py                    74     56     20      0    19%
mallm/decision_protocol/cumulative_voting.py                   57     39     18      0    24%
mallm/decision_protocol/protocol.py                           150    117     60      1    16%
mallm/decision_protocol/ranked_voting.py                       45     30     12      0    26%
mallm/decision_protocol/simple_voting.py                       47     31     10      0    28%
mallm/decision_protocol/summary.py                             29     14      4      0    45%
mallm/discourse_policy/__init__.py                              0      0      0      0   100%
mallm/discourse_policy/collective_refinement.py                61     46     14      1    21%
mallm/discourse_policy/debate.py                               87     70     32      1    15%
mallm/discourse_policy/memory.py                               20      7      2      1    64%
mallm/discourse_policy/policy.py                               94     72     26      1    19%
mallm/discourse_policy/relay.py                                22      9      2      1    58%
mallm/discourse_policy/report.py                               26     13      4      1    47%
mallm/evaluation/__init__.py                                    0      0      0      0   100%
mallm/evaluation/evaluator.py                                 211    211    118      0     0%
mallm/evaluation/metrics/__init__.py                            0      0      0      0   100%
mallm/evaluation/metrics/bertscore.py                           9      9      0      0     0%
mallm/evaluation/metrics/bleu.py                                9      9      0      0     0%
mallm/evaluation/metrics/ifeval.py                             90     90     18      0     0%
mallm/evaluation/metrics/meteor.py                             20     20      2      0     0%
mallm/evaluation/metrics/metric.py                             10     10      0      0     0%
mallm/evaluation/metrics/qa.py                                 52     52     14      0     0%
mallm/evaluation/metrics/rouge.py                              10     10      0      0     0%
mallm/evaluation/plotting/__init__.py                           0      0      0      0   100%
mallm/evaluation/plotting/plots.py                            139    139     22      0     0%
mallm/models/Chat.py                                           82     53     24      0    27%
mallm/models/__init__.py                                        2      0      0      0   100%
mallm/models/discussion/FreeTextResponseGenerator.py           56     37     14      0    27%
mallm/models/discussion/JSONResponseGenerator.py               69     52     18      0    20%
mallm/models/discussion/ResponseGenerator.py                  147     96     40      1    28%
mallm/models/discussion/SimpleResponseGenerator.py             44     28     12      0    29%
mallm/models/discussion/SplitFreeTextResponseGenerator.py      30     20      4      0    29%
mallm/models/discussion/__init__.py                             0      0      0      0   100%
mallm/models/personas/ExpertGenerator.py                       31     21      8      0    26%
mallm/models/personas/IPIPPersonaGenerator.py                  49     40     20      0    13%
mallm/models/personas/MockGenerator.py                          9      0      0      0   100%
mallm/models/personas/NoPersonaGenerator.py                    11      2      0      0    82%
mallm/models/personas/PersonaGenerator.py                       9      1      0      0    89%
mallm/models/personas/__init__.py                               0      0      0      0   100%
mallm/scheduler.py                                            303    303     50      0     0%
mallm/scripts/__init__.py                                       0      0      0      0   100%
mallm/scripts/batch_mallm.py                                  106    106     24      0     0%
mallm/utils/CustomFormatter.py                                 10     10      0      0     0%
mallm/utils/__init__.py                                         0      0      0      0   100%
mallm/utils/config.py                                          98     48     28      1    40%
mallm/utils/dicts.py                                           28      0      0      0   100%
mallm/utils/enums.py                                           10      0      0      0   100%
mallm/utils/evaluation/__init__.py                              0      0      0      0   100%
mallm/utils/evaluation/instructions.py                        698    698    144      0     0%
mallm/utils/evaluation/instructions_registry.py                19     19      4      0     0%
mallm/utils/evaluation/instructions_util.py                    61     61     12      0     0%
mallm/utils/functions.py                                       12     12      6      0     0%
mallm/utils/task_instructions.py                                1      0      0      0   100%
mallm/utils/types.py                                           91     17     14      0    70%
mallm/utils/utils.py                                           35     35      0      0     0%
---------------------------------------------------------------------------------------------
TOTAL                                                        3665   2887    898     22    18%