change verbosity and device descriptions
Browse files- dmxMetric.py +2 -1
dmxMetric.py
CHANGED
@@ -20,10 +20,11 @@ Args:
|
|
20 |
batch_size (Optional[Union[int, str]]): Batch size for model, defaults to None.
|
21 |
max_batch_size (Optional[int]): Maximum batch size to try with automatic batch size detection, defaults to None.
|
22 |
limit (Optional[Union[int, float]]): Limit the number of examples per task, defaults to None.
|
|
|
23 |
revision (str): Model revision to use, defaults to 'main'.
|
24 |
trust_remote_code (bool): Whether to trust remote code, defaults to False.
|
25 |
log_samples (bool): If True, logs all model outputs and documents, defaults to True.
|
26 |
-
verbosity (str): Logging verbosity level, defaults to '
|
27 |
**kwargs: Additional keyword arguments to pass to `lm_eval.evaluate`.
|
28 |
|
29 |
Returns:
|
|
|
20 |
batch_size (Optional[Union[int, str]]): Batch size for model, defaults to None.
|
21 |
max_batch_size (Optional[int]): Maximum batch size to try with automatic batch size detection, defaults to None.
|
22 |
limit (Optional[Union[int, float]]): Limit the number of examples per task, defaults to None.
|
23 |
+
device (Optional[str]): Device to run on. If None, defaults to 'cuda' if available, otherwise 'cpu'.
|
24 |
revision (str): Model revision to use, defaults to 'main'.
|
25 |
trust_remote_code (bool): Whether to trust remote code, defaults to False.
|
26 |
log_samples (bool): If True, logs all model outputs and documents, defaults to True.
|
27 |
+
verbosity (str): Logging verbosity level, defaults to 'INFO'.
|
28 |
**kwargs: Additional keyword arguments to pass to `lm_eval.evaluate`.
|
29 |
|
30 |
Returns:
|