wanzin commited on
Commit
f383068
1 Parent(s): 221fdce

change verbosity and device descriptions

Browse files
Files changed (1) hide show
  1. dmxMetric.py +2 -1
dmxMetric.py CHANGED
@@ -20,10 +20,11 @@ Args:
20
  batch_size (Optional[Union[int, str]]): Batch size for model, defaults to None.
21
  max_batch_size (Optional[int]): Maximum batch size to try with automatic batch size detection, defaults to None.
22
  limit (Optional[Union[int, float]]): Limit the number of examples per task, defaults to None.
 
23
  revision (str): Model revision to use, defaults to 'main'.
24
  trust_remote_code (bool): Whether to trust remote code, defaults to False.
25
  log_samples (bool): If True, logs all model outputs and documents, defaults to True.
26
- verbosity (str): Logging verbosity level, defaults to 'CRITICAL'.
27
  **kwargs: Additional keyword arguments to pass to `lm_eval.evaluate`.
28
 
29
  Returns:
 
20
  batch_size (Optional[Union[int, str]]): Batch size for model, defaults to None.
21
  max_batch_size (Optional[int]): Maximum batch size to try with automatic batch size detection, defaults to None.
22
  limit (Optional[Union[int, float]]): Limit the number of examples per task, defaults to None.
23
+ device (Optional[str]): Device to run on. If None, defaults to 'cuda' if available, otherwise 'cpu'.
24
  revision (str): Model revision to use, defaults to 'main'.
25
  trust_remote_code (bool): Whether to trust remote code, defaults to False.
26
  log_samples (bool): If True, logs all model outputs and documents, defaults to True.
27
+ verbosity (str): Logging verbosity level, defaults to 'INFO'.
28
  **kwargs: Additional keyword arguments to pass to `lm_eval.evaluate`.
29
 
30
  Returns: