/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing Anthropic from langchain root module is no longer supported. Please use langchain_community.llms.Anthropic instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing HuggingFaceHub from langchain root module is no longer supported. Please use langchain_community.llms.HuggingFaceHub instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing OpenAI from langchain root module is no longer supported. Please use langchain_community.llms.OpenAI instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing Anthropic from langchain root module is no longer supported. Please use langchain_community.llms.Anthropic instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing HuggingFaceHub from langchain root module is no longer supported. Please use langchain_community.llms.HuggingFaceHub instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/chat_models/__init__.py:33: LangChainDeprecationWarning: Importing chat models from langchain is deprecated. Importing from langchain will no longer be supported as of langchain==0.2.0. Please import from langchain-community instead:

`from langchain_community.chat_models import ChatOpenAI`.

To install langchain-community run `pip install -U langchain-community`.
  warnings.warn(
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/langchain/chat_models/__init__.py:33: LangChainDeprecationWarning: Importing chat models from langchain is deprecated. Importing from langchain will no longer be supported as of langchain==0.2.0. Please import from langchain-community instead:

`from langchain_community.chat_models import ChatOpenAI`.

To install langchain-community run `pip install -U langchain-community`.
  warnings.warn(
/Volumes/workplace/fmcore/fmcore/src/fmcore/prompt_tuner/evaluator/base_evaluator.py:13: GenericBeforeBaseModelWarning: Classes should inherit from `BaseModel` before generic classes (e.g. `typing.Generic[T]`) for pydantic generics to work properly.
  class BaseEvaluator(Generic[I, O], MutableTyped, Registry, ABC):
/Volumes/workplace/fmcore/fmcore/src/fmcore/prompt_tuner/evaluator/llm_as_a_judge_boolean/llm_as_a_judge_boolean_evaluator.py:17: GenericBeforeBaseModelWarning: Classes should inherit from `BaseModel` before generic classes (e.g. `typing.Generic[T]`) for pydantic generics to work properly.
  class LLMAsJudgeBooleanEvaluator(BaseEvaluator[Dict, bool]):
/Volumes/workplace/fmcore/fmcore/src/fmcore/prompt_tuner/evaluator/classification/classification_evaluator.py:9: GenericBeforeBaseModelWarning: Classes should inherit from `BaseModel` before generic classes (e.g. `typing.Generic[T]`) for pydantic generics to work properly.
  class ClassificationEvaluator(BaseEvaluator[Dict, bool]):
Running Prompt Tuner with Classification
Running Prompt Tuner with Boolean as judge
{'task_type': 'TEXT_GENERATION', 'dataset_config': {'inputs': {'TRAIN': {'name': 'train', 'path': 's3://dc-test-rajsiba/auto_prompt_tuner/datasets/ads_copilot/', 'storage': S3, 'format': PARQUET, 'contents': None, 'file_glob': None, 'data_schema': None}}, 'output': {'name': 'output', 'path': 's3://dc-test-rajsiba/auto_prompt_tuner/outputs/ads_copilot', 'storage': S3, 'format': PARQUET, 'contents': None, 'file_glob': None, 'data_schema': None}}, 'prompt_config': {'prompt': 'Identify the right plan based on converstaion history and the latest query\n\n', 'input_fields': [{'name': 'conversation_history', 'description': 'This field represents conversation history with the advertiser', 'field_type': 'string'}, {'name': 'latest_query', 'description': 'This field represents latest query from the advertiser', 'field_type': 'string'}], 'output_fields': [{'name': 'label', 'description': "This field represents the selected plan, can be one of 'BID_BUDGET_RECOMMENDATION', 'INAPPROPRIATE_OFF_TOPIC_PLAN',  'EDUCATIONAL' or 'OPEN_DOMAIN_DIALOG_PLAN'", 'field_type': 'string'}]}, 'framework': 'DSPY', 'optimizer_config': {'evaluator_config': {'evaluator_type': 'CLASSIFICATION', 'evaluator_params': {'prediction_field': 'input.label', 'ground_truth_field': 'output.label', 'groundTruth': ''}}, 'teacher_config': {'provider_type': 'BEDROCK', 'model_id': 'anthropic.claude-3-5-sonnet-20240620-v1:0', 'model_params': {'temperature': 1.0, 'max_tokens': 4096, 'top_p': 0.9}, 'provider_params_list': [{'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::863518436859:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::615299746603:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::615299746603:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::710271919393:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::710271919393:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::872515274170:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::872515274170:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::339712890513:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::339712890513:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::760397367430:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::760397367430:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::268097248272:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::268097248272:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::932671304170:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::932671304170:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::957971773207:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::957971773207:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}]}, 'student_config': {'provider_type': 'BEDROCK', 'model_id': 'anthropic.claude-3-haiku-20240307-v1:0', 'model_params': {'temperature': 0.1, 'max_tokens': 4096, 'top_p': 0.9}, 'provider_params_list': [{'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::863518436859:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::615299746603:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::615299746603:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::710271919393:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::710271919393:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::872515274170:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::872515274170:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::339712890513:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::339712890513:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::760397367430:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::760397367430:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::268097248272:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::268097248272:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::932671304170:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::932671304170:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::957971773207:role/ModelFactoryBedrockAccessRole', 'region': 'us-east-1'}, {'retries': {'max_retries': 50, 'backoff_factor': 1.0, 'jitter': 1.0, 'retryable_exceptions': ['InvalidSignatureException', 'ThrottlingException', 'ModelTimeoutException', 'ServiceUnavailableException', 'ModelNotReadyException', 'ServiceQuotaExceededException', 'ModelErrorException', 'EndpointConnectionError']}, 'rate_limit': {'max_rate': 1000, 'time_period': 60}, 'role_arn': 'arn:aws:iam::957971773207:role/ModelFactoryBedrockAccessRole', 'region': 'us-west-2'}]}, 'optimizer_type': 'MIPRO_V2', 'optimizer_params': {'optimizer_metric': 'ACCURACY', 'num_candidates': 10, 'max_errors': 10, 'minibatch': False, 'auto': 'light'}}}

Read 0 row(s):   0%|          | 0/2 [00:00<?, ?file/s]
Read 0 row(s):   0%|          | 0/2 [00:00<?, ?file/s]
Read 0 row(s):  50%|█████     | 1/2 [00:03<00:03,  3.78s/file]
Read 0 row(s):  50%|█████     | 1/2 [00:03<00:03,  3.78s/file]
Read 326 row(s):  50%|█████     | 1/2 [00:03<00:03,  3.78s/file]
Read 326 row(s):  50%|█████     | 1/2 [00:03<00:03,  3.78s/file]
Read 326 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.87s/file]
Read 326 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.87s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.87s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.87s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.87s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  1.87s/file]
Read 652 row(s): 100%|██████████| 2/2 [00:04<00:00,  2.01s/file]
2025/04/21 09:25:43 INFO dspy.teleprompt.mipro_optimizer_v2: 
RUNNING WITH THE FOLLOWING LIGHT AUTO RUN SETTINGS:
num_trials: 7
minibatch: True
num_candidates: 5
valset size: 100
Bootstrapping set 1/5

Bootstrapping set 2/5
2025/04/21 09:25:43 INFO dspy.teleprompt.mipro_optimizer_v2: 
Bootstrapping set 3/5
==> STEP 1: BOOTSTRAP FEWSHOT EXAMPLES <==
2025/04/21 09:25:43 INFO dspy.teleprompt.mipro_optimizer_v2: These will be used as few-shot example candidates for our program and for creating instructions.

2025/04/21 09:25:43 INFO dspy.teleprompt.mipro_optimizer_v2: Bootstrapping N=5 sets of demonstrations...

  0%|          | 0/391 [00:00<?, ?it/s]
  0%|          | 1/391 [00:03<20:36,  3.17s/it]
  1%|          | 2/391 [00:05<18:20,  2.83s/it]
  1%|          | 3/391 [00:07<15:55,  2.46s/it]
  1%|          | 4/391 [00:09<13:58,  2.17s/it]
  1%|          | 4/391 [00:09<15:19,  2.38s/it]
Bootstrapped 4 full traces after 4 examples for up to 1 rounds, amounting to 4 attempts.
Bootstrapping set 4/5

  0%|          | 0/391 [00:00<?, ?it/s]
  0%|          | 1/391 [00:02<17:04,  2.63s/it]
  1%|          | 2/391 [00:04<15:47,  2.44s/it]
  1%|          | 3/391 [00:07<14:55,  2.31s/it]
  1%|          | 3/391 [00:07<15:16,  2.36s/it]
Bootstrapped 3 full traces after 3 examples for up to 1 rounds, amounting to 3 attempts.
Bootstrapping set 5/5

  0%|          | 0/391 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 1/391 [00:01<10:05,  1.55s/it]
  0%|          | 1/391 [00:01<10:05,  1.55s/it]
Bootstrapped 1 full traces after 1 examples for up to 1 rounds, amounting to 1 attempts.
2025/04/21 09:26:01 INFO dspy.teleprompt.mipro_optimizer_v2: 
==> STEP 2: PROPOSE INSTRUCTION CANDIDATES <==
2025/04/21 09:26:01 INFO dspy.teleprompt.mipro_optimizer_v2: We will use the few-shot examples from the previous step, a generated dataset summary, a summary of the program code, and a randomly selected prompting tip to propose instructions.
2025/04/21 09:26:25 INFO dspy.teleprompt.mipro_optimizer_v2: 
Proposing instructions...

/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: Proposed Instructions for Predictor 0:

2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: 0: Identify the right plan based on converstaion history and the latest query

2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: 1: You are an AI assistant for a major digital advertising platform. Your responses directly impact millions of dollars in advertising spend and the success of countless businesses. A critical error in classification could lead to significant financial losses or damage to brand reputations.

Your task is to carefully analyze the conversation history (if provided) and the latest query from an advertiser. You must then:

1. Provide a detailed, step-by-step reasoning process that explains your thought process.
2. Classify the query into one of these categories:
   - BID_BUDGET_RECOMMENDATION: For queries about advertising budgets or bidding strategies.
   - INAPPROPRIATE_OFF_TOPIC_PLAN: For irrelevant or inappropriate queries.
   - EDUCATIONAL: For queries seeking information on advertising topics.
   - OPEN_DOMAIN_DIALOG_PLAN: For general conversation or queries that don't fit other categories.

Your classification will determine how the query is handled, potentially affecting the advertiser's campaign performance and budget allocation. Misclassification could result in lost revenue, wasted ad spend, or damage to the advertiser's business.

Approach this task with the utmost care and attention to detail. Consider all aspects of the query, including context from the conversation history, industry-specific terminology, and potential implications of the advertiser's request. Your goal is to provide the most accurate and helpful classification to ensure the advertiser receives the appropriate support and guidance.

Remember, the success of countless businesses relies on your accurate analysis and classification. Treat each query as if it could make or break a company's advertising strategy.

2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: 2: You are an AI assistant specialized in digital advertising. Your task is to analyze the conversation history (if provided) and the latest query from an advertiser to determine the most appropriate response plan. Follow these steps:

1. Carefully read the conversation history (if available) and the latest query.
2. Analyze the content and intent of the query, considering any context from the conversation history.
3. Determine if the query is related to digital advertising. If it's inappropriate or off-topic, classify it as such.
4. For advertising-related queries, identify if it's seeking educational information or requesting budget/bidding recommendations.
5. Use step-by-step reasoning to explain your thought process and justify your classification.
6. Based on your analysis, assign one of the following labels:
   - BID_BUDGET_RECOMMENDATION: For queries about advertising budgets, bidding strategies, or campaign performance optimization.
   - INAPPROPRIATE_OFF_TOPIC_PLAN: For queries unrelated to digital advertising or inappropriate content.
   - EDUCATIONAL: For queries seeking information, explanations, or guidance on advertising concepts, features, or best practices.
   - OPEN_DOMAIN_DIALOG_PLAN: For general queries or those that don't clearly fit into the other categories.

Provide your reasoning in a clear, logical manner, and then state the final label. Your response should be informative, professional, and tailored to the specific query and context provided.

2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: 3: You are an ethical digital advertising assistant specializing in query analysis and response planning. Your task is to carefully examine the conversation history (if provided) and the latest query from an advertiser. Based on this information, you need to:

1. Generate a step-by-step reasoning process that analyzes the query's intent, context, and implications.
2. Classify the query into one of four categories: BID_BUDGET_RECOMMENDATION, INAPPROPRIATE_OFF_TOPIC_PLAN, EDUCATIONAL, or OPEN_DOMAIN_DIALOG_PLAN.

Consider the following guidelines:

- For BID_BUDGET_RECOMMENDATION: Identify queries related to advertising budgets, bidding strategies, or financial aspects of digital advertising.
- For EDUCATIONAL: Recognize queries seeking information about digital advertising concepts, best practices, or industry trends.
- For OPEN_DOMAIN_DIALOG_PLAN: Classify general conversation starters or queries not directly related to advertising but still appropriate for discussion.
- For INAPPROPRIATE_OFF_TOPIC_PLAN: Flag any queries that are unethical, potentially harmful, or completely unrelated to digital advertising.

In your reasoning, always prioritize ethical considerations. If a query seems to exploit vulnerabilities or promote harmful practices, classify it as INAPPROPRIATE_OFF_TOPIC_PLAN.

Provide your step-by-step reasoning first, followed by the appropriate label. Ensure your analysis is thorough, context-aware, and aligned with responsible advertising practices.

2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: 4: Analyze the conversation history (if provided) and the latest query from the advertiser. Determine the most appropriate response category by following these steps:

1. Examine the content and intent of the latest query.
2. Consider any relevant context from the conversation history.
3. Classify the query into one of these categories:
   - BID_BUDGET_RECOMMENDATION: For questions about advertising budgets or bidding strategies.
   - EDUCATIONAL: For queries seeking information about advertising concepts or features.
   - INAPPROPRIATE_OFF_TOPIC_PLAN: For queries not related to advertising or marketing.
   - OPEN_DOMAIN_DIALOG_PLAN: For general conversation or queries that don't fit other categories.
4. Provide step-by-step reasoning for your classification.
5. Output the reasoning and the chosen category label.

2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: 

2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: ==> STEP 3: FINDING OPTIMAL PROMPT PARAMETERS <==
2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: We will evaluate the program over a series of trials with different combinations of instructions and few-shot examples to find the optimal combination using Bayesian Optimization.

2025/04/21 09:28:50 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 1 / 8 - Full Evaluation of Default Program ==
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/100 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/100 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/100 [00:01<01:55,  1.16s/it]
Average Metric: 2.00 / 2 (100.0%):   1%|          | 1/100 [00:01<01:55,  1.16s/it]
Average Metric: 2.00 / 2 (100.0%):   2%|▏         | 2/100 [00:01<00:55,  1.77it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 3 (100.0%):   2%|▏         | 2/100 [00:01<00:55,  1.77it/s]
Average Metric: 3.00 / 4 (75.0%):   3%|▎         | 3/100 [00:01<00:54,  1.77it/s] 
Average Metric: 3.00 / 4 (75.0%):   4%|▍         | 4/100 [00:01<00:24,  3.90it/s]
Average Metric: 3.00 / 5 (60.0%):   4%|▍         | 4/100 [00:01<00:24,  3.90it/s]
Average Metric: 3.00 / 5 (60.0%):   5%|▌         | 5/100 [00:01<00:22,  4.27it/s]
Average Metric: 4.00 / 6 (66.7%):   5%|▌         | 5/100 [00:01<00:22,  4.27it/s]
Average Metric: 4.00 / 7 (57.1%):   6%|▌         | 6/100 [00:02<00:22,  4.27it/s]
Average Metric: 4.00 / 7 (57.1%):   7%|▋         | 7/100 [00:02<00:30,  3.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 8 (62.5%):   7%|▋         | 7/100 [00:02<00:30,  3.03it/s]
Average Metric: 5.00 / 8 (62.5%):   8%|▊         | 8/100 [00:02<00:27,  3.34it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 9 (55.6%):   8%|▊         | 8/100 [00:02<00:27,  3.34it/s]
Average Metric: 5.00 / 9 (55.6%):   9%|▉         | 9/100 [00:02<00:24,  3.71it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 10 (60.0%):   9%|▉         | 9/100 [00:03<00:24,  3.71it/s]
Average Metric: 6.00 / 10 (60.0%):  10%|█         | 10/100 [00:03<00:25,  3.58it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 11 (54.5%):  10%|█         | 10/100 [00:03<00:25,  3.58it/s]
Average Metric: 6.00 / 11 (54.5%):  11%|█         | 11/100 [00:03<00:22,  3.94it/s]
Average Metric: 6.00 / 12 (50.0%):  11%|█         | 11/100 [00:03<00:22,  3.94it/s]
Average Metric: 6.00 / 12 (50.0%):  12%|█▏        | 12/100 [00:03<00:20,  4.20it/s]
Average Metric: 6.00 / 13 (46.2%):  12%|█▏        | 12/100 [00:04<00:20,  4.20it/s]
Average Metric: 6.00 / 13 (46.2%):  13%|█▎        | 13/100 [00:04<00:26,  3.26it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 14 (42.9%):  13%|█▎        | 13/100 [00:04<00:26,  3.26it/s]
Average Metric: 6.00 / 14 (42.9%):  14%|█▍        | 14/100 [00:04<00:28,  2.97it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 15 (40.0%):  14%|█▍        | 14/100 [00:04<00:28,  2.97it/s]
Average Metric: 6.00 / 16 (37.5%):  15%|█▌        | 15/100 [00:05<00:28,  2.97it/s]
Average Metric: 6.00 / 16 (37.5%):  16%|█▌        | 16/100 [00:05<00:27,  3.08it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 17 (41.2%):  16%|█▌        | 16/100 [00:05<00:27,  3.08it/s]
Average Metric: 7.00 / 17 (41.2%):  17%|█▋        | 17/100 [00:05<00:24,  3.39it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 18 (38.9%):  17%|█▋        | 17/100 [00:05<00:24,  3.39it/s]
Average Metric: 7.00 / 18 (38.9%):  18%|█▊        | 18/100 [00:05<00:27,  3.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 19 (36.8%):  18%|█▊        | 18/100 [00:05<00:27,  3.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 20 (40.0%):  19%|█▉        | 19/100 [00:06<00:26,  3.03it/s]
Average Metric: 8.00 / 20 (40.0%):  20%|██        | 20/100 [00:06<00:25,  3.14it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 21 (38.1%):  20%|██        | 20/100 [00:06<00:25,  3.14it/s]
Average Metric: 8.00 / 21 (38.1%):  21%|██        | 21/100 [00:06<00:22,  3.56it/s]
Average Metric: 8.00 / 22 (36.4%):  21%|██        | 21/100 [00:06<00:22,  3.56it/s]
Average Metric: 8.00 / 22 (36.4%):  22%|██▏       | 22/100 [00:06<00:25,  3.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 23 (39.1%):  22%|██▏       | 22/100 [00:06<00:25,  3.03it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 24 (37.5%):  23%|██▎       | 23/100 [00:07<00:25,  3.03it/s]
Average Metric: 9.00 / 25 (36.0%):  24%|██▍       | 24/100 [00:07<00:25,  3.03it/s]
Average Metric: 9.00 / 25 (36.0%):  25%|██▌       | 25/100 [00:07<00:14,  5.04it/s]
Average Metric: 10.00 / 26 (38.5%):  25%|██▌       | 25/100 [00:07<00:14,  5.04it/s]
Average Metric: 10.00 / 26 (38.5%):  26%|██▌       | 26/100 [00:07<00:15,  4.82it/s]
Average Metric: 11.00 / 27 (40.7%):  26%|██▌       | 26/100 [00:08<00:15,  4.82it/s]
Average Metric: 11.00 / 27 (40.7%):  27%|██▋       | 27/100 [00:08<00:26,  2.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 28 (39.3%):  27%|██▋       | 27/100 [00:08<00:26,  2.76it/s]
Average Metric: 11.00 / 28 (39.3%):  28%|██▊       | 28/100 [00:08<00:24,  2.90it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 29 (41.4%):  28%|██▊       | 28/100 [00:08<00:24,  2.90it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 30 (43.3%):  29%|██▉       | 29/100 [00:09<00:24,  2.90it/s]
Average Metric: 13.00 / 30 (43.3%):  30%|███       | 30/100 [00:09<00:20,  3.41it/s]
Average Metric: 14.00 / 31 (45.2%):  30%|███       | 30/100 [00:09<00:20,  3.41it/s]
Average Metric: 14.00 / 31 (45.2%):  31%|███       | 31/100 [00:09<00:18,  3.82it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 32 (43.8%):  31%|███       | 31/100 [00:09<00:18,  3.82it/s]
Average Metric: 14.00 / 32 (43.8%):  32%|███▏      | 32/100 [00:09<00:17,  3.82it/s]
Average Metric: 14.00 / 33 (42.4%):  32%|███▏      | 32/100 [00:09<00:17,  3.82it/s]
Average Metric: 14.00 / 33 (42.4%):  33%|███▎      | 33/100 [00:09<00:18,  3.70it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 34 (41.2%):  33%|███▎      | 33/100 [00:10<00:18,  3.70it/s]
Average Metric: 14.00 / 34 (41.2%):  34%|███▍      | 34/100 [00:10<00:19,  3.45it/s]
Average Metric: 15.00 / 35 (42.9%):  34%|███▍      | 34/100 [00:10<00:19,  3.45it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 36 (44.4%):  35%|███▌      | 35/100 [00:10<00:18,  3.45it/s]
Average Metric: 16.00 / 36 (44.4%):  36%|███▌      | 36/100 [00:10<00:16,  3.93it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 17.00 / 37 (45.9%):  36%|███▌      | 36/100 [00:11<00:16,  3.93it/s]
Average Metric: 17.00 / 37 (45.9%):  37%|███▋      | 37/100 [00:11<00:21,  2.90it/s]
Average Metric: 17.00 / 38 (44.7%):  37%|███▋      | 37/100 [00:11<00:21,  2.90it/s]
Average Metric: 18.00 / 39 (46.2%):  38%|███▊      | 38/100 [00:11<00:21,  2.90it/s]
Average Metric: 18.00 / 39 (46.2%):  39%|███▉      | 39/100 [00:11<00:15,  4.05it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 18.00 / 40 (45.0%):  39%|███▉      | 39/100 [00:11<00:15,  4.05it/s]
Average Metric: 18.00 / 40 (45.0%):  40%|████      | 40/100 [00:11<00:13,  4.53it/s]
Average Metric: 18.00 / 41 (43.9%):  40%|████      | 40/100 [00:11<00:13,  4.53it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 42 (45.2%):  41%|████      | 41/100 [00:11<00:13,  4.53it/s]
Average Metric: 19.00 / 42 (45.2%):  42%|████▏     | 42/100 [00:11<00:10,  5.77it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 43 (44.2%):  42%|████▏     | 42/100 [00:12<00:10,  5.77it/s]
Average Metric: 19.00 / 43 (44.2%):  43%|████▎     | 43/100 [00:12<00:19,  2.99it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 20.00 / 44 (45.5%):  43%|████▎     | 43/100 [00:12<00:19,  2.99it/s]
Average Metric: 20.00 / 44 (45.5%):  44%|████▍     | 44/100 [00:12<00:17,  3.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 21.00 / 45 (46.7%):  44%|████▍     | 44/100 [00:12<00:17,  3.21it/s]
Average Metric: 21.00 / 46 (45.7%):  45%|████▌     | 45/100 [00:12<00:17,  3.21it/s]
Average Metric: 21.00 / 47 (44.7%):  46%|████▌     | 46/100 [00:13<00:16,  3.21it/s]
Average Metric: 21.00 / 47 (44.7%):  47%|████▋     | 47/100 [00:13<00:11,  4.52it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 21.00 / 48 (43.8%):  47%|████▋     | 47/100 [00:13<00:11,  4.52it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 49 (44.9%):  48%|████▊     | 48/100 [00:15<00:11,  4.52it/s]
Average Metric: 22.00 / 49 (44.9%):  49%|████▉     | 49/100 [00:15<00:22,  2.25it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 23.00 / 50 (46.0%):  49%|████▉     | 49/100 [00:15<00:22,  2.25it/s]
Average Metric: 24.00 / 51 (47.1%):  50%|█████     | 50/100 [00:15<00:22,  2.25it/s]
Average Metric: 24.00 / 51 (47.1%):  51%|█████     | 51/100 [00:15<00:15,  3.11it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 25.00 / 52 (48.1%):  51%|█████     | 51/100 [00:15<00:15,  3.11it/s]
Average Metric: 25.00 / 52 (48.1%):  52%|█████▏    | 52/100 [00:15<00:15,  3.05it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 53 (49.1%):  52%|█████▏    | 52/100 [00:15<00:15,  3.05it/s]
Average Metric: 26.00 / 53 (49.1%):  53%|█████▎    | 53/100 [00:15<00:14,  3.27it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 27.00 / 54 (50.0%):  53%|█████▎    | 53/100 [00:15<00:14,  3.27it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 27.00 / 54 (50.0%):  54%|█████▍    | 54/100 [00:16<00:13,  3.50it/s]
Average Metric: 28.00 / 55 (50.9%):  54%|█████▍    | 54/100 [00:16<00:13,  3.50it/s]
Average Metric: 28.00 / 55 (50.9%):  55%|█████▌    | 55/100 [00:16<00:12,  3.47it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 56 (51.8%):  55%|█████▌    | 55/100 [00:16<00:12,  3.47it/s]
Average Metric: 29.00 / 56 (51.8%):  56%|█████▌    | 56/100 [00:16<00:14,  3.04it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 57 (50.9%):  56%|█████▌    | 56/100 [00:16<00:14,  3.04it/s]
Average Metric: 29.00 / 57 (50.9%):  57%|█████▋    | 57/100 [00:16<00:12,  3.42it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 58 (50.0%):  57%|█████▋    | 57/100 [00:17<00:12,  3.42it/s]
Average Metric: 29.00 / 58 (50.0%):  58%|█████▊    | 58/100 [00:17<00:10,  3.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 30.00 / 59 (50.8%):  58%|█████▊    | 58/100 [00:17<00:10,  3.96it/s]
Average Metric: 30.00 / 59 (50.8%):  59%|█████▉    | 59/100 [00:17<00:12,  3.38it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 60 (51.7%):  59%|█████▉    | 59/100 [00:17<00:12,  3.38it/s]
Average Metric: 31.00 / 60 (51.7%):  60%|██████    | 60/100 [00:17<00:12,  3.29it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 61 (52.5%):  60%|██████    | 60/100 [00:17<00:12,  3.29it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 33.00 / 62 (53.2%):  61%|██████    | 61/100 [00:18<00:11,  3.29it/s]
Average Metric: 33.00 / 62 (53.2%):  62%|██████▏   | 62/100 [00:18<00:12,  3.00it/s]
Average Metric: 33.00 / 63 (52.4%):  62%|██████▏   | 62/100 [00:18<00:12,  3.00it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 34.00 / 64 (53.1%):  63%|██████▎   | 63/100 [00:18<00:12,  3.00it/s]
Average Metric: 35.00 / 65 (53.8%):  64%|██████▍   | 64/100 [00:18<00:12,  3.00it/s]
Average Metric: 35.00 / 65 (53.8%):  65%|██████▌   | 65/100 [00:18<00:07,  4.57it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 66 (54.5%):  65%|██████▌   | 65/100 [00:19<00:07,  4.57it/s]
Average Metric: 36.00 / 66 (54.5%):  66%|██████▌   | 66/100 [00:19<00:07,  4.80it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 67 (53.7%):  66%|██████▌   | 66/100 [00:19<00:07,  4.80it/s]
Average Metric: 36.00 / 67 (53.7%):  67%|██████▋   | 67/100 [00:19<00:06,  5.39it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 68 (52.9%):  67%|██████▋   | 67/100 [00:20<00:06,  5.39it/s]
Average Metric: 36.00 / 68 (52.9%):  68%|██████▊   | 68/100 [00:20<00:12,  2.60it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 37.00 / 69 (53.6%):  68%|██████▊   | 68/100 [00:20<00:12,  2.60it/s]
Average Metric: 37.00 / 69 (53.6%):  69%|██████▉   | 69/100 [00:20<00:09,  3.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 38.00 / 70 (54.3%):  69%|██████▉   | 69/100 [00:20<00:09,  3.19it/s]
Average Metric: 38.00 / 71 (53.5%):  70%|███████   | 70/100 [00:20<00:09,  3.19it/s]
Average Metric: 38.00 / 71 (53.5%):  71%|███████   | 71/100 [00:20<00:06,  4.65it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 39.00 / 72 (54.2%):  71%|███████   | 71/100 [00:20<00:06,  4.65it/s]
Average Metric: 39.00 / 72 (54.2%):  72%|███████▏  | 72/100 [00:20<00:06,  4.38it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 73 (54.8%):  72%|███████▏  | 72/100 [00:21<00:06,  4.38it/s]
Average Metric: 40.00 / 73 (54.8%):  73%|███████▎  | 73/100 [00:21<00:08,  3.23it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 74 (55.4%):  73%|███████▎  | 73/100 [00:21<00:08,  3.23it/s]
Average Metric: 41.00 / 74 (55.4%):  74%|███████▍  | 74/100 [00:21<00:08,  3.00it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 75 (54.7%):  74%|███████▍  | 74/100 [00:22<00:08,  3.00it/s]
Average Metric: 41.00 / 75 (54.7%):  75%|███████▌  | 75/100 [00:22<00:09,  2.60it/s]
Average Metric: 42.00 / 76 (55.3%):  75%|███████▌  | 75/100 [00:22<00:09,  2.60it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 43.00 / 77 (55.8%):  76%|███████▌  | 76/100 [00:22<00:09,  2.60it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 43.00 / 78 (55.1%):  77%|███████▋  | 77/100 [00:22<00:08,  2.60it/s]
Average Metric: 43.00 / 78 (55.1%):  78%|███████▊  | 78/100 [00:22<00:05,  3.93it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 44.00 / 79 (55.7%):  78%|███████▊  | 78/100 [00:22<00:05,  3.93it/s]
Average Metric: 44.00 / 79 (55.7%):  79%|███████▉  | 79/100 [00:22<00:05,  4.12it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 45.00 / 80 (56.2%):  79%|███████▉  | 79/100 [00:23<00:05,  4.12it/s]
Average Metric: 45.00 / 80 (56.2%):  80%|████████  | 80/100 [00:23<00:05,  3.51it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 46.00 / 81 (56.8%):  80%|████████  | 80/100 [00:23<00:05,  3.51it/s]
Average Metric: 46.00 / 81 (56.8%):  81%|████████  | 81/100 [00:23<00:05,  3.67it/s]
Average Metric: 47.00 / 82 (57.3%):  81%|████████  | 81/100 [00:23<00:05,  3.67it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 48.00 / 83 (57.8%):  82%|████████▏ | 82/100 [00:23<00:04,  3.67it/s]
Average Metric: 48.00 / 84 (57.1%):  83%|████████▎ | 83/100 [00:24<00:04,  3.67it/s]
Average Metric: 48.00 / 84 (57.1%):  84%|████████▍ | 84/100 [00:24<00:04,  3.22it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 49.00 / 85 (57.6%):  84%|████████▍ | 84/100 [00:25<00:04,  3.22it/s]
Average Metric: 49.00 / 85 (57.6%):  85%|████████▌ | 85/100 [00:25<00:05,  2.82it/s]
Average Metric: 49.00 / 86 (57.0%):  85%|████████▌ | 85/100 [00:25<00:05,  2.82it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 49.00 / 87 (56.3%):  86%|████████▌ | 86/100 [00:25<00:04,  2.82it/s]
Average Metric: 49.00 / 87 (56.3%):  87%|████████▋ | 87/100 [00:25<00:03,  4.02it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 49.00 / 88 (55.7%):  87%|████████▋ | 87/100 [00:25<00:03,  4.02it/s]
Average Metric: 50.00 / 89 (56.2%):  88%|████████▊ | 88/100 [00:25<00:02,  4.02it/s]
Average Metric: 50.00 / 89 (56.2%):  89%|████████▉ | 89/100 [00:25<00:02,  4.49it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 90 (55.6%):  89%|████████▉ | 89/100 [00:26<00:02,  4.49it/s]
Average Metric: 50.00 / 90 (55.6%):  90%|█████████ | 90/100 [00:26<00:03,  3.16it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 91 (56.0%):  90%|█████████ | 90/100 [00:26<00:03,  3.16it/s]
Average Metric: 51.00 / 91 (56.0%):  91%|█████████ | 91/100 [00:26<00:02,  3.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 52.00 / 92 (56.5%):  91%|█████████ | 91/100 [00:26<00:02,  3.19it/s]
Average Metric: 52.00 / 92 (56.5%):  92%|█████████▏| 92/100 [00:26<00:02,  3.35it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 93 (57.0%):  92%|█████████▏| 92/100 [00:26<00:02,  3.35it/s]
Average Metric: 53.00 / 93 (57.0%):  93%|█████████▎| 93/100 [00:26<00:01,  3.93it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 54.00 / 94 (57.4%):  93%|█████████▎| 93/100 [00:27<00:01,  3.93it/s]
Average Metric: 54.00 / 94 (57.4%):  94%|█████████▍| 94/100 [00:27<00:01,  4.34it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 54.00 / 95 (56.8%):  94%|█████████▍| 94/100 [00:27<00:01,  4.34it/s]
Average Metric: 55.00 / 96 (57.3%):  95%|█████████▌| 95/100 [00:27<00:01,  4.34it/s]
Average Metric: 55.00 / 96 (57.3%):  96%|█████████▌| 96/100 [00:27<00:01,  3.13it/s]
Average Metric: 55.00 / 97 (56.7%):  96%|█████████▌| 96/100 [00:28<00:01,  3.13it/s]
Average Metric: 55.00 / 97 (56.7%):  97%|█████████▋| 97/100 [00:28<00:00,  3.46it/s]
Average Metric: 56.00 / 98 (57.1%):  97%|█████████▋| 97/100 [00:28<00:00,  3.46it/s]
Average Metric: 56.00 / 99 (56.6%):  98%|█████████▊| 98/100 [00:28<00:00,  3.46it/s]
Average Metric: 56.00 / 99 (56.6%):  99%|█████████▉| 99/100 [00:28<00:00,  4.27it/s]
Average Metric: 57.00 / 100 (57.0%):  99%|█████████▉| 99/100 [00:28<00:00,  4.27it/s]
Average Metric: 57.00 / 100 (57.0%): 100%|██████████| 100/100 [00:28<00:00,  3.51it/s]
2025/04/21 09:29:18 INFO dspy.evaluate.evaluate: Average Metric: 57 / 100 (57.0%)
2025/04/21 09:29:18 INFO dspy.teleprompt.mipro_optimizer_v2: Default program score: 57.0

/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/optuna/_experimental.py:31: ExperimentalWarning: Argument ``multivariate`` is an experimental feature. The interface can change in the future.
  warnings.warn(
2025/04/21 09:29:18 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 2 / 8 - Minibatch ==
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:38,  1.62s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:38,  1.62s/it]
Average Metric: 2.00 / 2 (100.0%):   8%|▊         | 2/25 [00:01<00:17,  1.31it/s]
Average Metric: 2.00 / 3 (66.7%):   8%|▊         | 2/25 [00:02<00:17,  1.31it/s] 
Average Metric: 2.00 / 3 (66.7%):  12%|█▏        | 3/25 [00:02<00:13,  1.66it/s]
Average Metric: 2.00 / 4 (50.0%):  12%|█▏        | 3/25 [00:02<00:13,  1.66it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 5 (60.0%):  16%|█▌        | 4/25 [00:02<00:12,  1.66it/s]
Average Metric: 3.00 / 5 (60.0%):  20%|██        | 5/25 [00:02<00:06,  2.95it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 6 (50.0%):  20%|██        | 5/25 [00:02<00:06,  2.95it/s]
Average Metric: 3.00 / 6 (50.0%):  24%|██▍       | 6/25 [00:02<00:06,  3.07it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 7 (57.1%):  24%|██▍       | 6/25 [00:03<00:06,  3.07it/s]
Average Metric: 4.00 / 7 (57.1%):  28%|██▊       | 7/25 [00:03<00:07,  2.52it/s]
Average Metric: 5.00 / 8 (62.5%):  28%|██▊       | 7/25 [00:04<00:07,  2.52it/s]
Average Metric: 5.00 / 8 (62.5%):  32%|███▏      | 8/25 [00:04<00:08,  2.04it/s]
Average Metric: 6.00 / 9 (66.7%):  32%|███▏      | 8/25 [00:04<00:08,  2.04it/s]
Average Metric: 6.00 / 9 (66.7%):  36%|███▌      | 9/25 [00:04<00:06,  2.44it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 10 (70.0%):  36%|███▌      | 9/25 [00:04<00:06,  2.44it/s]
Average Metric: 7.00 / 10 (70.0%):  40%|████      | 10/25 [00:04<00:05,  2.81it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 11 (72.7%):  40%|████      | 10/25 [00:05<00:05,  2.81it/s]
Average Metric: 8.00 / 11 (72.7%):  44%|████▍     | 11/25 [00:05<00:07,  1.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 12 (75.0%):  44%|████▍     | 11/25 [00:05<00:07,  1.92it/s]
Average Metric: 9.00 / 12 (75.0%):  48%|████▊     | 12/25 [00:05<00:05,  2.27it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 13 (69.2%):  48%|████▊     | 12/25 [00:05<00:05,  2.27it/s]
Average Metric: 9.00 / 14 (64.3%):  52%|█████▏    | 13/25 [00:05<00:05,  2.27it/s]
Average Metric: 9.00 / 14 (64.3%):  56%|█████▌    | 14/25 [00:05<00:03,  3.62it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 15 (60.0%):  56%|█████▌    | 14/25 [00:06<00:03,  3.62it/s]
Average Metric: 9.00 / 15 (60.0%):  60%|██████    | 15/25 [00:06<00:02,  3.64it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 16 (62.5%):  60%|██████    | 15/25 [00:06<00:02,  3.64it/s]
Average Metric: 10.00 / 16 (62.5%):  64%|██████▍   | 16/25 [00:06<00:02,  3.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 17 (64.7%):  64%|██████▍   | 16/25 [00:06<00:02,  3.85it/s]
Average Metric: 11.00 / 17 (64.7%):  68%|██████▊   | 17/25 [00:06<00:02,  2.97it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 18 (61.1%):  68%|██████▊   | 17/25 [00:07<00:02,  2.97it/s]
Average Metric: 11.00 / 18 (61.1%):  72%|███████▏  | 18/25 [00:07<00:03,  2.28it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 19 (63.2%):  72%|███████▏  | 18/25 [00:07<00:03,  2.28it/s]
Average Metric: 12.00 / 19 (63.2%):  76%|███████▌  | 19/25 [00:07<00:02,  2.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 20 (65.0%):  76%|███████▌  | 19/25 [00:08<00:02,  2.85it/s]
Average Metric: 13.00 / 20 (65.0%):  80%|████████  | 20/25 [00:08<00:01,  2.72it/s]
Average Metric: 14.00 / 21 (66.7%):  80%|████████  | 20/25 [00:08<00:01,  2.72it/s]
Average Metric: 14.00 / 21 (66.7%):  84%|████████▍ | 21/25 [00:08<00:01,  2.77it/s]
Average Metric: 15.00 / 22 (68.2%):  84%|████████▍ | 21/25 [00:08<00:01,  2.77it/s]
Average Metric: 16.00 / 23 (69.6%):  88%|████████▊ | 22/25 [00:08<00:01,  2.77it/s]
Average Metric: 16.00 / 23 (69.6%):  92%|█████████▏| 23/25 [00:08<00:00,  4.14it/s]
Average Metric: 17.00 / 24 (70.8%):  92%|█████████▏| 23/25 [00:09<00:00,  4.14it/s]
Average Metric: 17.00 / 24 (70.8%):  96%|█████████▌| 24/25 [00:09<00:00,  2.73it/s]
Average Metric: 18.00 / 25 (72.0%):  96%|█████████▌| 24/25 [00:10<00:00,  2.73it/s]
Average Metric: 18.00 / 25 (72.0%): 100%|██████████| 25/25 [00:10<00:00,  2.02it/s]
Average Metric: 18.00 / 25 (72.0%): 100%|██████████| 25/25 [00:10<00:00,  2.44it/s]
2025/04/21 09:29:28 INFO dspy.evaluate.evaluate: Average Metric: 18 / 25 (72.0%)
2025/04/21 09:29:28 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 72.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 1', 'Predictor 0: Few-Shot Set 1'].
2025/04/21 09:29:28 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [72.0]
2025/04/21 09:29:28 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/21 09:29:28 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/21 09:29:28 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/21 09:29:28 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 3 / 8 - Minibatch ==
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 0.00 / 1 (0.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 0.00 / 1 (0.0%):   4%|▍         | 1/25 [00:01<00:38,  1.61s/it]
Average Metric: 1.00 / 2 (50.0%):   4%|▍         | 1/25 [00:01<00:38,  1.61s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 3 (33.3%):   8%|▊         | 2/25 [00:01<00:36,  1.61s/it]
Average Metric: 1.00 / 3 (33.3%):  12%|█▏        | 3/25 [00:01<00:10,  2.16it/s]
Average Metric: 2.00 / 4 (50.0%):  12%|█▏        | 3/25 [00:02<00:10,  2.16it/s]
Average Metric: 2.00 / 4 (50.0%):  16%|█▌        | 4/25 [00:02<00:08,  2.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 5 (60.0%):  16%|█▌        | 4/25 [00:02<00:08,  2.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 6 (66.7%):  20%|██        | 5/25 [00:02<00:08,  2.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 7 (71.4%):  24%|██▍       | 6/25 [00:03<00:07,  2.40it/s]
Average Metric: 5.00 / 7 (71.4%):  28%|██▊       | 7/25 [00:03<00:06,  2.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 8 (75.0%):  28%|██▊       | 7/25 [00:03<00:06,  2.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 9 (77.8%):  32%|███▏      | 8/25 [00:03<00:06,  2.63it/s]
Average Metric: 7.00 / 9 (77.8%):  36%|███▌      | 9/25 [00:03<00:05,  2.74it/s]
Average Metric: 8.00 / 10 (80.0%):  36%|███▌      | 9/25 [00:03<00:05,  2.74it/s]
Average Metric: 9.00 / 11 (81.8%):  40%|████      | 10/25 [00:04<00:05,  2.74it/s]
Average Metric: 9.00 / 11 (81.8%):  44%|████▍     | 11/25 [00:04<00:04,  3.20it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 12 (75.0%):  44%|████▍     | 11/25 [00:04<00:04,  3.20it/s]
Average Metric: 9.00 / 12 (75.0%):  48%|████▊     | 12/25 [00:04<00:04,  3.16it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 13 (76.9%):  48%|████▊     | 12/25 [00:04<00:04,  3.16it/s]
Average Metric: 10.00 / 13 (76.9%):  52%|█████▏    | 13/25 [00:04<00:03,  3.08it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 14 (71.4%):  52%|█████▏    | 13/25 [00:05<00:03,  3.08it/s]
Average Metric: 10.00 / 14 (71.4%):  56%|█████▌    | 14/25 [00:05<00:03,  2.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 15 (73.3%):  56%|█████▌    | 14/25 [00:05<00:03,  2.96it/s]
Average Metric: 11.00 / 15 (73.3%):  60%|██████    | 15/25 [00:05<00:03,  3.20it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 16 (75.0%):  60%|██████    | 15/25 [00:05<00:03,  3.20it/s]
Average Metric: 12.00 / 16 (75.0%):  64%|██████▍   | 16/25 [00:05<00:02,  3.91it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 17 (76.5%):  64%|██████▍   | 16/25 [00:05<00:02,  3.91it/s]
Average Metric: 13.00 / 17 (76.5%):  68%|██████▊   | 17/25 [00:05<00:01,  4.51it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 18 (72.2%):  68%|██████▊   | 17/25 [00:05<00:01,  4.51it/s]
Average Metric: 13.00 / 18 (72.2%):  72%|███████▏  | 18/25 [00:05<00:01,  4.75it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 19 (73.7%):  72%|███████▏  | 18/25 [00:06<00:01,  4.75it/s]
Average Metric: 14.00 / 19 (73.7%):  76%|███████▌  | 19/25 [00:06<00:01,  3.35it/s]
Average Metric: 15.00 / 20 (75.0%):  76%|███████▌  | 19/25 [00:07<00:01,  3.35it/s]
Average Metric: 15.00 / 20 (75.0%):  80%|████████  | 20/25 [00:07<00:02,  2.34it/s]
Average Metric: 16.00 / 21 (76.2%):  80%|████████  | 20/25 [00:07<00:02,  2.34it/s]
Average Metric: 16.00 / 21 (76.2%):  84%|████████▍ | 21/25 [00:07<00:01,  2.28it/s]
Average Metric: 17.00 / 22 (77.3%):  84%|████████▍ | 21/25 [00:07<00:01,  2.28it/s]
Average Metric: 18.00 / 23 (78.3%):  88%|████████▊ | 22/25 [00:07<00:01,  2.28it/s]
Average Metric: 18.00 / 23 (78.3%):  92%|█████████▏| 23/25 [00:07<00:00,  3.75it/s]
Average Metric: 19.00 / 24 (79.2%):  92%|█████████▏| 23/25 [00:07<00:00,  3.75it/s]
Average Metric: 19.00 / 24 (79.2%):  96%|█████████▌| 24/25 [00:07<00:00,  4.18it/s]
Average Metric: 19.00 / 25 (76.0%):  96%|█████████▌| 24/25 [00:08<00:00,  4.18it/s]
Average Metric: 19.00 / 25 (76.0%): 100%|██████████| 25/25 [00:08<00:00,  3.31it/s]
Average Metric: 19.00 / 25 (76.0%): 100%|██████████| 25/25 [00:08<00:00,  2.97it/s]
2025/04/21 09:29:37 INFO dspy.evaluate.evaluate: Average Metric: 19 / 25 (76.0%)
2025/04/21 09:29:37 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 76.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 2', 'Predictor 0: Few-Shot Set 1'].
2025/04/21 09:29:37 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [72.0, 76.0]
2025/04/21 09:29:37 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/21 09:29:37 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/21 09:29:37 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/21 09:29:37 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 4 / 8 - Minibatch ==
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:38,  1.59s/it]
Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:38,  1.59s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 3 (66.7%):   8%|▊         | 2/25 [00:01<00:36,  1.59s/it] 
Average Metric: 2.00 / 3 (66.7%):  12%|█▏        | 3/25 [00:01<00:10,  2.15it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 4 (75.0%):  12%|█▏        | 3/25 [00:01<00:10,  2.15it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 5 (80.0%):  16%|█▌        | 4/25 [00:01<00:09,  2.15it/s]
Average Metric: 4.00 / 5 (80.0%):  20%|██        | 5/25 [00:01<00:05,  3.97it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 6 (83.3%):  20%|██        | 5/25 [00:01<00:05,  3.97it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 7 (85.7%):  24%|██▍       | 6/25 [00:03<00:04,  3.97it/s]
Average Metric: 6.00 / 7 (85.7%):  28%|██▊       | 7/25 [00:03<00:08,  2.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 8 (87.5%):  28%|██▊       | 7/25 [00:03<00:08,  2.21it/s]
Average Metric: 8.00 / 9 (88.9%):  32%|███▏      | 8/25 [00:03<00:07,  2.21it/s]
Average Metric: 9.00 / 10 (90.0%):  36%|███▌      | 9/25 [00:03<00:07,  2.21it/s]
Average Metric: 9.00 / 10 (90.0%):  40%|████      | 10/25 [00:03<00:04,  3.44it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 11 (90.9%):  40%|████      | 10/25 [00:03<00:04,  3.44it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 12 (91.7%):  44%|████▍     | 11/25 [00:04<00:04,  3.44it/s]
Average Metric: 11.00 / 12 (91.7%):  48%|████▊     | 12/25 [00:04<00:03,  3.40it/s]
Average Metric: 11.00 / 13 (84.6%):  48%|████▊     | 12/25 [00:04<00:03,  3.40it/s]
Average Metric: 11.00 / 13 (84.6%):  52%|█████▏    | 13/25 [00:04<00:03,  3.13it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 14 (85.7%):  52%|█████▏    | 13/25 [00:05<00:03,  3.13it/s]
Average Metric: 12.00 / 14 (85.7%):  56%|█████▌    | 14/25 [00:05<00:04,  2.49it/s]
Average Metric: 12.00 / 15 (80.0%):  56%|█████▌    | 14/25 [00:05<00:04,  2.49it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 16 (75.0%):  60%|██████    | 15/25 [00:05<00:04,  2.49it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 17 (76.5%):  64%|██████▍   | 16/25 [00:05<00:03,  2.49it/s]
Average Metric: 13.00 / 17 (76.5%):  68%|██████▊   | 17/25 [00:05<00:02,  3.47it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 18 (77.8%):  68%|██████▊   | 17/25 [00:06<00:02,  3.47it/s]
Average Metric: 14.00 / 18 (77.8%):  72%|███████▏  | 18/25 [00:06<00:01,  3.70it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 19 (78.9%):  72%|███████▏  | 18/25 [00:06<00:01,  3.70it/s]
Average Metric: 15.00 / 19 (78.9%):  76%|███████▌  | 19/25 [00:06<00:02,  2.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 20 (80.0%):  76%|███████▌  | 19/25 [00:06<00:02,  2.92it/s]
Average Metric: 16.00 / 21 (76.2%):  80%|████████  | 20/25 [00:07<00:01,  2.92it/s]
Average Metric: 16.00 / 21 (76.2%):  84%|████████▍ | 21/25 [00:07<00:01,  3.24it/s]
Average Metric: 17.00 / 22 (77.3%):  84%|████████▍ | 21/25 [00:07<00:01,  3.24it/s]
Average Metric: 18.00 / 23 (78.3%):  88%|████████▊ | 22/25 [00:07<00:00,  3.24it/s]
Average Metric: 18.00 / 23 (78.3%):  92%|█████████▏| 23/25 [00:07<00:00,  3.67it/s]
Average Metric: 19.00 / 24 (79.2%):  92%|█████████▏| 23/25 [00:07<00:00,  3.67it/s]
Average Metric: 20.00 / 25 (80.0%):  96%|█████████▌| 24/25 [00:08<00:00,  3.67it/s]
Average Metric: 20.00 / 25 (80.0%): 100%|██████████| 25/25 [00:08<00:00,  2.52it/s]
Average Metric: 20.00 / 25 (80.0%): 100%|██████████| 25/25 [00:08<00:00,  2.82it/s]
2025/04/21 09:29:46 INFO dspy.evaluate.evaluate: Average Metric: 20 / 25 (80.0%)
2025/04/21 09:29:46 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 80.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 4', 'Predictor 0: Few-Shot Set 1'].
2025/04/21 09:29:46 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [72.0, 76.0, 80.0]
2025/04/21 09:29:46 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/21 09:29:46 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/21 09:29:46 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/21 09:29:46 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 5 / 8 - Minibatch ==
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:34,  1.45s/it]
Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:34,  1.45s/it]
Average Metric: 2.00 / 2 (100.0%):   8%|▊         | 2/25 [00:01<00:16,  1.39it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 3 (100.0%):   8%|▊         | 2/25 [00:01<00:16,  1.39it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 4 (75.0%):  12%|█▏        | 3/25 [00:01<00:15,  1.39it/s] 
Average Metric: 3.00 / 4 (75.0%):  16%|█▌        | 4/25 [00:02<00:07,  2.65it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 5 (80.0%):  16%|█▌        | 4/25 [00:02<00:07,  2.65it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 6 (83.3%):  20%|██        | 5/25 [00:02<00:07,  2.65it/s]
Average Metric: 5.00 / 6 (83.3%):  24%|██▍       | 6/25 [00:02<00:04,  4.35it/s]
Average Metric: 6.00 / 7 (85.7%):  24%|██▍       | 6/25 [00:03<00:04,  4.35it/s]
Average Metric: 6.00 / 7 (85.7%):  28%|██▊       | 7/25 [00:03<00:08,  2.16it/s]
Average Metric: 7.00 / 8 (87.5%):  28%|██▊       | 7/25 [00:03<00:08,  2.16it/s]
Average Metric: 8.00 / 9 (88.9%):  32%|███▏      | 8/25 [00:03<00:07,  2.16it/s]
Average Metric: 8.00 / 9 (88.9%):  36%|███▌      | 9/25 [00:03<00:04,  3.37it/s]
Average Metric: 8.00 / 10 (80.0%):  36%|███▌      | 9/25 [00:04<00:04,  3.37it/s]
Average Metric: 8.00 / 10 (80.0%):  40%|████      | 10/25 [00:04<00:06,  2.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 11 (81.8%):  40%|████      | 10/25 [00:04<00:06,  2.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 12 (83.3%):  44%|████▍     | 11/25 [00:04<00:05,  2.46it/s]
Average Metric: 10.00 / 12 (83.3%):  48%|████▊     | 12/25 [00:04<00:03,  3.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 13 (84.6%):  48%|████▊     | 12/25 [00:05<00:03,  3.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 14 (85.7%):  52%|█████▏    | 13/25 [00:05<00:03,  3.76it/s]
Average Metric: 12.00 / 14 (85.7%):  56%|█████▌    | 14/25 [00:05<00:04,  2.44it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 15 (86.7%):  56%|█████▌    | 14/25 [00:05<00:04,  2.44it/s]
Average Metric: 14.00 / 16 (87.5%):  60%|██████    | 15/25 [00:05<00:04,  2.44it/s]
Average Metric: 14.00 / 16 (87.5%):  64%|██████▍   | 16/25 [00:05<00:02,  3.22it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 17 (82.4%):  64%|██████▍   | 16/25 [00:06<00:02,  3.22it/s]
Average Metric: 14.00 / 17 (82.4%):  68%|██████▊   | 17/25 [00:06<00:02,  3.57it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 18 (83.3%):  68%|██████▊   | 17/25 [00:06<00:02,  3.57it/s]
Average Metric: 15.00 / 18 (83.3%):  72%|███████▏  | 18/25 [00:06<00:01,  3.55it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 19 (84.2%):  72%|███████▏  | 18/25 [00:07<00:01,  3.55it/s]
Average Metric: 16.00 / 19 (84.2%):  76%|███████▌  | 19/25 [00:07<00:02,  2.34it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 17.00 / 20 (85.0%):  76%|███████▌  | 19/25 [00:07<00:02,  2.34it/s]
Average Metric: 17.00 / 20 (85.0%):  80%|████████  | 20/25 [00:07<00:02,  2.29it/s]
Average Metric: 17.00 / 21 (81.0%):  80%|████████  | 20/25 [00:07<00:02,  2.29it/s]
Average Metric: 18.00 / 22 (81.8%):  84%|████████▍ | 21/25 [00:07<00:01,  2.29it/s]
Average Metric: 18.00 / 22 (81.8%):  88%|████████▊ | 22/25 [00:07<00:00,  3.48it/s]
Average Metric: 18.00 / 23 (78.3%):  88%|████████▊ | 22/25 [00:07<00:00,  3.48it/s]
Average Metric: 18.00 / 24 (75.0%):  92%|█████████▏| 23/25 [00:07<00:00,  3.48it/s]
Average Metric: 19.00 / 25 (76.0%):  96%|█████████▌| 24/25 [00:08<00:00,  3.48it/s]
Average Metric: 19.00 / 25 (76.0%): 100%|██████████| 25/25 [00:08<00:00,  3.54it/s]
Average Metric: 19.00 / 25 (76.0%): 100%|██████████| 25/25 [00:08<00:00,  2.89it/s]
2025/04/21 09:29:55 INFO dspy.evaluate.evaluate: Average Metric: 19 / 25 (76.0%)
2025/04/21 09:29:55 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 76.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 2', 'Predictor 0: Few-Shot Set 1'].
2025/04/21 09:29:55 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [72.0, 76.0, 80.0, 76.0]
2025/04/21 09:29:55 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/21 09:29:55 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/21 09:29:55 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/21 09:29:55 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 6 / 8 - Minibatch ==

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:29,  1.22s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:29,  1.22s/it]
Average Metric: 2.00 / 2 (100.0%):   8%|▊         | 2/25 [00:01<00:15,  1.51it/s]
Average Metric: 2.00 / 3 (66.7%):   8%|▊         | 2/25 [00:01<00:15,  1.51it/s] 
Average Metric: 2.00 / 3 (66.7%):  12%|█▏        | 3/25 [00:01<00:09,  2.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 4 (75.0%):  12%|█▏        | 3/25 [00:01<00:09,  2.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 5 (60.0%):  16%|█▌        | 4/25 [00:01<00:08,  2.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 6 (50.0%):  20%|██        | 5/25 [00:02<00:08,  2.40it/s]
Average Metric: 3.00 / 6 (50.0%):  24%|██▍       | 6/25 [00:02<00:04,  4.14it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 7 (57.1%):  24%|██▍       | 6/25 [00:02<00:04,  4.14it/s]
Average Metric: 4.00 / 7 (57.1%):  28%|██▊       | 7/25 [00:02<00:06,  2.61it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 8 (62.5%):  28%|██▊       | 7/25 [00:02<00:06,  2.61it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 9 (55.6%):  32%|███▏      | 8/25 [00:03<00:06,  2.61it/s]
Average Metric: 5.00 / 9 (55.6%):  36%|███▌      | 9/25 [00:03<00:04,  3.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 10 (60.0%):  36%|███▌      | 9/25 [00:03<00:04,  3.85it/s]
Average Metric: 6.00 / 10 (60.0%):  40%|████      | 10/25 [00:03<00:03,  4.35it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 11 (63.6%):  40%|████      | 10/25 [00:03<00:03,  4.35it/s]
Average Metric: 7.00 / 11 (63.6%):  44%|████▍     | 11/25 [00:03<00:03,  4.36it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 12 (66.7%):  44%|████▍     | 11/25 [00:03<00:03,  4.36it/s]
Average Metric: 8.00 / 12 (66.7%):  48%|████▊     | 12/25 [00:03<00:02,  4.72it/s]
Average Metric: 9.00 / 13 (69.2%):  48%|████▊     | 12/25 [00:04<00:02,  4.72it/s]
Average Metric: 9.00 / 13 (69.2%):  52%|█████▏    | 13/25 [00:04<00:03,  3.24it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 14 (71.4%):  52%|█████▏    | 13/25 [00:04<00:03,  3.24it/s]
Average Metric: 10.00 / 14 (71.4%):  56%|█████▌    | 14/25 [00:04<00:04,  2.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 15 (73.3%):  56%|█████▌    | 14/25 [00:04<00:04,  2.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 16 (75.0%):  60%|██████    | 15/25 [00:05<00:04,  2.43it/s]
Average Metric: 12.00 / 16 (75.0%):  64%|██████▍   | 16/25 [00:05<00:02,  3.34it/s]
Average Metric: 12.00 / 17 (70.6%):  64%|██████▍   | 16/25 [00:05<00:02,  3.34it/s]
Average Metric: 12.00 / 17 (70.6%):  68%|██████▊   | 17/25 [00:05<00:02,  3.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 18 (72.2%):  68%|██████▊   | 17/25 [00:05<00:02,  3.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 19 (73.7%):  72%|███████▏  | 18/25 [00:05<00:02,  3.01it/s]
Average Metric: 14.00 / 19 (73.7%):  76%|███████▌  | 19/25 [00:05<00:01,  4.30it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 20 (75.0%):  76%|███████▌  | 19/25 [00:06<00:01,  4.30it/s]
Average Metric: 15.00 / 20 (75.0%):  80%|████████  | 20/25 [00:06<00:02,  2.49it/s]
Average Metric: 15.00 / 21 (71.4%):  80%|████████  | 20/25 [00:06<00:02,  2.49it/s]
Average Metric: 15.00 / 22 (68.2%):  84%|████████▍ | 21/25 [00:06<00:01,  2.49it/s]
Average Metric: 15.00 / 22 (68.2%):  88%|████████▊ | 22/25 [00:06<00:00,  3.63it/s]
Average Metric: 16.00 / 23 (69.6%):  88%|████████▊ | 22/25 [00:06<00:00,  3.63it/s]
Average Metric: 17.00 / 24 (70.8%):  92%|█████████▏| 23/25 [00:06<00:00,  3.63it/s]
Average Metric: 17.00 / 25 (68.0%):  96%|█████████▌| 24/25 [00:07<00:00,  3.63it/s]
Average Metric: 17.00 / 25 (68.0%): 100%|██████████| 25/25 [00:07<00:00,  3.62it/s]
Average Metric: 17.00 / 25 (68.0%): 100%|██████████| 25/25 [00:07<00:00,  3.23it/s]
2025/04/21 09:30:03 INFO dspy.evaluate.evaluate: Average Metric: 17 / 25 (68.0%)
2025/04/21 09:30:03 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 68.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 4', 'Predictor 0: Few-Shot Set 3'].
2025/04/21 09:30:03 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [72.0, 76.0, 80.0, 76.0, 68.0]
2025/04/21 09:30:03 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/21 09:30:03 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/21 09:30:03 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/21 09:30:03 INFO dspy.teleprompt.mipro_optimizer_v2: == Trial 7 / 8 - Minibatch ==
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/25 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/25 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   4%|▍         | 1/25 [00:01<00:29,  1.22s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 2 (100.0%):   4%|▍         | 1/25 [00:01<00:29,  1.22s/it]
Average Metric: 2.00 / 2 (100.0%):   8%|▊         | 2/25 [00:01<00:13,  1.72it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 3 (66.7%):   8%|▊         | 2/25 [00:01<00:13,  1.72it/s] 
Average Metric: 2.00 / 4 (50.0%):  12%|█▏        | 3/25 [00:01<00:12,  1.72it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 5 (40.0%):  16%|█▌        | 4/25 [00:01<00:12,  1.72it/s]
Average Metric: 2.00 / 5 (40.0%):  20%|██        | 5/25 [00:01<00:04,  4.75it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 6 (50.0%):  20%|██        | 5/25 [00:01<00:04,  4.75it/s]
Average Metric: 3.00 / 6 (50.0%):  24%|██▍       | 6/25 [00:01<00:04,  4.27it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 7 (57.1%):  24%|██▍       | 6/25 [00:02<00:04,  4.27it/s]
Average Metric: 4.00 / 7 (57.1%):  28%|██▊       | 7/25 [00:02<00:06,  2.78it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 8 (62.5%):  28%|██▊       | 7/25 [00:02<00:06,  2.78it/s]
Average Metric: 5.00 / 8 (62.5%):  32%|███▏      | 8/25 [00:02<00:04,  3.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 9 (66.7%):  32%|███▏      | 8/25 [00:02<00:04,  3.43it/s]
Average Metric: 6.00 / 9 (66.7%):  36%|███▌      | 9/25 [00:02<00:04,  3.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 10 (70.0%):  36%|███▌      | 9/25 [00:02<00:04,  3.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 11 (72.7%):  40%|████      | 10/25 [00:03<00:04,  3.63it/s]
Average Metric: 8.00 / 11 (72.7%):  44%|████▍     | 11/25 [00:03<00:03,  4.36it/s]
Average Metric: 9.00 / 12 (75.0%):  44%|████▍     | 11/25 [00:03<00:03,  4.36it/s]
Average Metric: 9.00 / 12 (75.0%):  48%|████▊     | 12/25 [00:03<00:03,  3.62it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 13 (69.2%):  48%|████▊     | 12/25 [00:04<00:03,  3.62it/s]
Average Metric: 9.00 / 13 (69.2%):  52%|█████▏    | 13/25 [00:04<00:03,  3.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 14 (71.4%):  52%|█████▏    | 13/25 [00:04<00:03,  3.21it/s]
Average Metric: 10.00 / 14 (71.4%):  56%|█████▌    | 14/25 [00:04<00:03,  3.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 15 (73.3%):  56%|█████▌    | 14/25 [00:04<00:03,  3.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 16 (68.8%):  60%|██████    | 15/25 [00:04<00:03,  3.01it/s]
Average Metric: 11.00 / 16 (68.8%):  64%|██████▍   | 16/25 [00:04<00:02,  3.73it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 17 (70.6%):  64%|██████▍   | 16/25 [00:04<00:02,  3.73it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 18 (72.2%):  68%|██████▊   | 17/25 [00:05<00:02,  3.73it/s]
Average Metric: 13.00 / 18 (72.2%):  72%|███████▏  | 18/25 [00:05<00:02,  3.42it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 19 (73.7%):  72%|███████▏  | 18/25 [00:05<00:02,  3.42it/s]
Average Metric: 14.00 / 19 (73.7%):  76%|███████▌  | 19/25 [00:05<00:01,  3.12it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 20 (75.0%):  76%|███████▌  | 19/25 [00:05<00:01,  3.12it/s]
Average Metric: 16.00 / 21 (76.2%):  80%|████████  | 20/25 [00:05<00:01,  3.12it/s]
Average Metric: 17.00 / 22 (77.3%):  84%|████████▍ | 21/25 [00:06<00:01,  3.12it/s]
Average Metric: 17.00 / 22 (77.3%):  88%|████████▊ | 22/25 [00:06<00:00,  4.60it/s]
Average Metric: 18.00 / 23 (78.3%):  88%|████████▊ | 22/25 [00:06<00:00,  4.60it/s]
Average Metric: 19.00 / 24 (79.2%):  92%|█████████▏| 23/25 [00:07<00:00,  4.60it/s]
Average Metric: 19.00 / 24 (79.2%):  96%|█████████▌| 24/25 [00:07<00:00,  3.21it/s]
Average Metric: 20.00 / 25 (80.0%):  96%|█████████▌| 24/25 [00:08<00:00,  3.21it/s]
Average Metric: 20.00 / 25 (80.0%): 100%|██████████| 25/25 [00:08<00:00,  2.24it/s]
Average Metric: 20.00 / 25 (80.0%): 100%|██████████| 25/25 [00:08<00:00,  3.00it/s]
2025/04/21 09:30:11 INFO dspy.evaluate.evaluate: Average Metric: 20 / 25 (80.0%)
2025/04/21 09:30:11 INFO dspy.teleprompt.mipro_optimizer_v2: Score: 80.0 on minibatch of size 25 with parameters ['Predictor 0: Instruction 0', 'Predictor 0: Few-Shot Set 1'].
2025/04/21 09:30:11 INFO dspy.teleprompt.mipro_optimizer_v2: Minibatch scores so far: [72.0, 76.0, 80.0, 76.0, 68.0, 80.0]
2025/04/21 09:30:11 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0]
2025/04/21 09:30:11 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 57.0
2025/04/21 09:30:11 INFO dspy.teleprompt.mipro_optimizer_v2: ========================================


2025/04/21 09:30:11 INFO dspy.teleprompt.mipro_optimizer_v2: ===== Trial 8 / 8 - Full Evaluation =====
2025/04/21 09:30:11 INFO dspy.teleprompt.mipro_optimizer_v2: Doing full eval on next top averaging program (Avg Score: 80.0) from minibatch trials...
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/100 [00:00<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/100 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/100 [00:01<01:59,  1.21s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 2.00 / 2 (100.0%):   1%|          | 1/100 [00:01<01:59,  1.21s/it]
Average Metric: 2.00 / 2 (100.0%):   2%|▏         | 2/100 [00:01<00:58,  1.67it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 3.00 / 3 (100.0%):   2%|▏         | 2/100 [00:01<00:58,  1.67it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 4 (100.0%):   3%|▎         | 3/100 [00:01<00:58,  1.67it/s]
Average Metric: 4.00 / 4 (100.0%):   4%|▍         | 4/100 [00:01<00:37,  2.53it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 5 (80.0%):   4%|▍         | 4/100 [00:01<00:37,  2.53it/s] /Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 4.00 / 6 (66.7%):   5%|▌         | 5/100 [00:02<00:37,  2.53it/s]
Average Metric: 4.00 / 6 (66.7%):   6%|▌         | 6/100 [00:02<00:23,  4.08it/s]
Average Metric: 5.00 / 7 (71.4%):   6%|▌         | 6/100 [00:02<00:23,  4.08it/s]
Average Metric: 5.00 / 7 (71.4%):   7%|▋         | 7/100 [00:02<00:30,  3.00it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 8 (75.0%):   7%|▋         | 7/100 [00:03<00:30,  3.00it/s]
Average Metric: 6.00 / 8 (75.0%):   8%|▊         | 8/100 [00:03<00:42,  2.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 9 (77.8%):   8%|▊         | 8/100 [00:03<00:42,  2.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 8.00 / 10 (80.0%):   9%|▉         | 9/100 [00:03<00:41,  2.19it/s]
Average Metric: 8.00 / 10 (80.0%):  10%|█         | 10/100 [00:03<00:28,  3.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 9.00 / 11 (81.8%):  10%|█         | 10/100 [00:03<00:28,  3.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 12 (83.3%):  11%|█         | 11/100 [00:04<00:27,  3.18it/s]
Average Metric: 10.00 / 12 (83.3%):  12%|█▏        | 12/100 [00:04<00:21,  4.05it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 13 (84.6%):  12%|█▏        | 12/100 [00:04<00:21,  4.05it/s]
Average Metric: 11.00 / 13 (84.6%):  13%|█▎        | 13/100 [00:04<00:24,  3.54it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 14 (78.6%):  13%|█▎        | 13/100 [00:05<00:24,  3.54it/s]
Average Metric: 11.00 / 14 (78.6%):  14%|█▍        | 14/100 [00:05<00:35,  2.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 15 (73.3%):  14%|█▍        | 14/100 [00:05<00:35,  2.43it/s]
Average Metric: 12.00 / 16 (75.0%):  15%|█▌        | 15/100 [00:05<00:35,  2.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 17 (70.6%):  16%|█▌        | 16/100 [00:05<00:34,  2.43it/s]
Average Metric: 12.00 / 17 (70.6%):  17%|█▋        | 17/100 [00:05<00:19,  4.25it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 12.00 / 18 (66.7%):  17%|█▋        | 17/100 [00:05<00:19,  4.25it/s]
Average Metric: 12.00 / 18 (66.7%):  18%|█▊        | 18/100 [00:05<00:21,  3.80it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 19 (68.4%):  18%|█▊        | 18/100 [00:06<00:21,  3.80it/s]
Average Metric: 13.00 / 19 (68.4%):  19%|█▉        | 19/100 [00:06<00:28,  2.86it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 20 (65.0%):  19%|█▉        | 19/100 [00:06<00:28,  2.86it/s]
Average Metric: 13.00 / 20 (65.0%):  20%|██        | 20/100 [00:06<00:24,  3.28it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 21 (66.7%):  20%|██        | 20/100 [00:06<00:24,  3.28it/s]
Average Metric: 14.00 / 21 (66.7%):  21%|██        | 21/100 [00:06<00:21,  3.65it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 22 (68.2%):  21%|██        | 21/100 [00:07<00:21,  3.65it/s]
Average Metric: 15.00 / 22 (68.2%):  22%|██▏       | 22/100 [00:07<00:20,  3.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 16.00 / 23 (69.6%):  22%|██▏       | 22/100 [00:07<00:20,  3.89it/s]
Average Metric: 16.00 / 24 (66.7%):  23%|██▎       | 23/100 [00:07<00:19,  3.89it/s]
Average Metric: 16.00 / 24 (66.7%):  24%|██▍       | 24/100 [00:07<00:16,  4.58it/s]
Average Metric: 17.00 / 25 (68.0%):  24%|██▍       | 24/100 [00:08<00:16,  4.58it/s]
Average Metric: 17.00 / 25 (68.0%):  25%|██▌       | 25/100 [00:08<00:27,  2.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 18.00 / 26 (69.2%):  25%|██▌       | 25/100 [00:08<00:27,  2.69it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 27 (70.4%):  26%|██▌       | 26/100 [00:08<00:27,  2.69it/s]
Average Metric: 19.00 / 27 (70.4%):  27%|██▋       | 27/100 [00:08<00:19,  3.84it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 20.00 / 28 (71.4%):  27%|██▋       | 27/100 [00:08<00:19,  3.84it/s]
Average Metric: 20.00 / 28 (71.4%):  28%|██▊       | 28/100 [00:08<00:21,  3.30it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 21.00 / 29 (72.4%):  28%|██▊       | 28/100 [00:09<00:21,  3.30it/s]
Average Metric: 21.00 / 29 (72.4%):  29%|██▉       | 29/100 [00:09<00:22,  3.13it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 21.00 / 30 (70.0%):  29%|██▉       | 29/100 [00:09<00:22,  3.13it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 21.00 / 31 (67.7%):  30%|███       | 30/100 [00:09<00:22,  3.13it/s]
Average Metric: 21.00 / 31 (67.7%):  31%|███       | 31/100 [00:09<00:20,  3.36it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 32 (68.8%):  31%|███       | 31/100 [00:09<00:20,  3.36it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 23.00 / 33 (69.7%):  32%|███▏      | 32/100 [00:09<00:20,  3.36it/s]
Average Metric: 23.00 / 34 (67.6%):  33%|███▎      | 33/100 [00:10<00:19,  3.36it/s]
Average Metric: 23.00 / 34 (67.6%):  34%|███▍      | 34/100 [00:10<00:14,  4.47it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 35 (68.6%):  34%|███▍      | 34/100 [00:10<00:14,  4.47it/s]
Average Metric: 24.00 / 35 (68.6%):  35%|███▌      | 35/100 [00:10<00:17,  3.66it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 36 (66.7%):  35%|███▌      | 35/100 [00:11<00:17,  3.66it/s]
Average Metric: 24.00 / 36 (66.7%):  36%|███▌      | 36/100 [00:11<00:18,  3.47it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 25.00 / 37 (67.6%):  36%|███▌      | 36/100 [00:11<00:18,  3.47it/s]
Average Metric: 25.00 / 37 (67.6%):  37%|███▋      | 37/100 [00:11<00:18,  3.42it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 38 (68.4%):  37%|███▋      | 37/100 [00:11<00:18,  3.42it/s]
Average Metric: 26.00 / 38 (68.4%):  38%|███▊      | 38/100 [00:11<00:19,  3.11it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 27.00 / 39 (69.2%):  38%|███▊      | 38/100 [00:11<00:19,  3.11it/s]
Average Metric: 27.00 / 39 (69.2%):  39%|███▉      | 39/100 [00:11<00:16,  3.75it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 28.00 / 40 (70.0%):  39%|███▉      | 39/100 [00:12<00:16,  3.75it/s]
Average Metric: 28.00 / 40 (70.0%):  40%|████      | 40/100 [00:12<00:14,  4.21it/s]
Average Metric: 29.00 / 41 (70.7%):  40%|████      | 40/100 [00:12<00:14,  4.21it/s]
Average Metric: 29.00 / 41 (70.7%):  41%|████      | 41/100 [00:12<00:16,  3.52it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 30.00 / 42 (71.4%):  41%|████      | 41/100 [00:12<00:16,  3.52it/s]
Average Metric: 30.00 / 42 (71.4%):  42%|████▏     | 42/100 [00:12<00:14,  4.08it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 43 (72.1%):  42%|████▏     | 42/100 [00:13<00:14,  4.08it/s]
Average Metric: 31.00 / 43 (72.1%):  43%|████▎     | 43/100 [00:13<00:17,  3.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 44 (70.5%):  43%|████▎     | 43/100 [00:13<00:17,  3.21it/s]
Average Metric: 31.00 / 44 (70.5%):  44%|████▍     | 44/100 [00:13<00:22,  2.45it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 45 (68.9%):  44%|████▍     | 44/100 [00:13<00:22,  2.45it/s]
Average Metric: 32.00 / 46 (69.6%):  45%|████▌     | 45/100 [00:13<00:22,  2.45it/s]
Average Metric: 32.00 / 46 (69.6%):  46%|████▌     | 46/100 [00:13<00:14,  3.82it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 33.00 / 47 (70.2%):  46%|████▌     | 46/100 [00:13<00:14,  3.82it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 34.00 / 48 (70.8%):  47%|████▋     | 47/100 [00:14<00:13,  3.82it/s]
Average Metric: 34.00 / 48 (70.8%):  48%|████▊     | 48/100 [00:14<00:10,  4.78it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 35.00 / 49 (71.4%):  48%|████▊     | 48/100 [00:14<00:10,  4.78it/s]
Average Metric: 35.00 / 49 (71.4%):  49%|████▉     | 49/100 [00:14<00:12,  4.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 50 (72.0%):  49%|████▉     | 49/100 [00:15<00:12,  4.10it/s]
Average Metric: 36.00 / 50 (72.0%):  50%|█████     | 50/100 [00:15<00:16,  3.08it/s]
Average Metric: 37.00 / 51 (72.5%):  50%|█████     | 50/100 [00:15<00:16,  3.08it/s]
Average Metric: 37.00 / 51 (72.5%):  51%|█████     | 51/100 [00:15<00:20,  2.41it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 38.00 / 52 (73.1%):  51%|█████     | 51/100 [00:15<00:20,  2.41it/s]
Average Metric: 39.00 / 53 (73.6%):  52%|█████▏    | 52/100 [00:16<00:19,  2.41it/s]
Average Metric: 39.00 / 53 (73.6%):  53%|█████▎    | 53/100 [00:16<00:14,  3.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 54 (74.1%):  53%|█████▎    | 53/100 [00:16<00:14,  3.19it/s]
Average Metric: 40.00 / 54 (74.1%):  54%|█████▍    | 54/100 [00:16<00:12,  3.70it/s]
Average Metric: 41.00 / 55 (74.5%):  54%|█████▍    | 54/100 [00:16<00:12,  3.70it/s]
Average Metric: 41.00 / 55 (74.5%):  55%|█████▌    | 55/100 [00:16<00:10,  4.24it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 42.00 / 56 (75.0%):  55%|█████▌    | 55/100 [00:17<00:10,  4.24it/s]
Average Metric: 42.00 / 56 (75.0%):  56%|█████▌    | 56/100 [00:17<00:16,  2.67it/s]
Average Metric: 42.00 / 57 (73.7%):  56%|█████▌    | 56/100 [00:17<00:16,  2.67it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 42.00 / 58 (72.4%):  57%|█████▋    | 57/100 [00:17<00:16,  2.67it/s]
Average Metric: 42.00 / 58 (72.4%):  58%|█████▊    | 58/100 [00:17<00:14,  2.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 43.00 / 59 (72.9%):  58%|█████▊    | 58/100 [00:17<00:14,  2.89it/s]
Average Metric: 43.00 / 59 (72.9%):  59%|█████▉    | 59/100 [00:17<00:11,  3.42it/s]
Average Metric: 44.00 / 60 (73.3%):  59%|█████▉    | 59/100 [00:18<00:11,  3.42it/s]
Average Metric: 44.00 / 60 (73.3%):  60%|██████    | 60/100 [00:18<00:10,  3.72it/s]
Average Metric: 45.00 / 61 (73.8%):  60%|██████    | 60/100 [00:18<00:10,  3.72it/s]
Average Metric: 45.00 / 61 (73.8%):  61%|██████    | 61/100 [00:18<00:09,  4.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 46.00 / 62 (74.2%):  61%|██████    | 61/100 [00:18<00:09,  4.09it/s]
Average Metric: 46.00 / 62 (74.2%):  62%|██████▏   | 62/100 [00:18<00:12,  3.16it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 47.00 / 63 (74.6%):  62%|██████▏   | 62/100 [00:18<00:12,  3.16it/s]
Average Metric: 47.00 / 63 (74.6%):  63%|██████▎   | 63/100 [00:18<00:10,  3.47it/s]
Average Metric: 48.00 / 64 (75.0%):  63%|██████▎   | 63/100 [00:19<00:10,  3.47it/s]
Average Metric: 48.00 / 64 (75.0%):  64%|██████▍   | 64/100 [00:19<00:10,  3.38it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 49.00 / 65 (75.4%):  64%|██████▍   | 64/100 [00:19<00:10,  3.38it/s]
Average Metric: 49.00 / 65 (75.4%):  65%|██████▌   | 65/100 [00:19<00:09,  3.79it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 66 (75.8%):  65%|██████▌   | 65/100 [00:20<00:09,  3.79it/s]
Average Metric: 50.00 / 66 (75.8%):  66%|██████▌   | 66/100 [00:20<00:14,  2.32it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 67 (76.1%):  66%|██████▌   | 66/100 [00:20<00:14,  2.32it/s]
Average Metric: 52.00 / 68 (76.5%):  67%|██████▋   | 67/100 [00:20<00:14,  2.32it/s]
Average Metric: 52.00 / 68 (76.5%):  68%|██████▊   | 68/100 [00:20<00:10,  3.04it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 52.00 / 69 (75.4%):  68%|██████▊   | 68/100 [00:21<00:10,  3.04it/s]
Average Metric: 52.00 / 69 (75.4%):  69%|██████▉   | 69/100 [00:21<00:11,  2.66it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 70 (75.7%):  69%|██████▉   | 69/100 [00:21<00:11,  2.66it/s]
Average Metric: 53.00 / 70 (75.7%):  70%|███████   | 70/100 [00:21<00:09,  3.18it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 54.00 / 71 (76.1%):  70%|███████   | 70/100 [00:21<00:09,  3.18it/s]
Average Metric: 54.00 / 71 (76.1%):  71%|███████   | 71/100 [00:21<00:09,  3.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 55.00 / 72 (76.4%):  71%|███████   | 71/100 [00:21<00:09,  3.10it/s]
Average Metric: 56.00 / 73 (76.7%):  72%|███████▏  | 72/100 [00:21<00:09,  3.10it/s]
Average Metric: 56.00 / 73 (76.7%):  73%|███████▎  | 73/100 [00:21<00:06,  4.29it/s]
Average Metric: 57.00 / 74 (77.0%):  73%|███████▎  | 73/100 [00:22<00:06,  4.29it/s]
Average Metric: 57.00 / 74 (77.0%):  74%|███████▍  | 74/100 [00:22<00:08,  3.24it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 58.00 / 75 (77.3%):  74%|███████▍  | 74/100 [00:23<00:08,  3.24it/s]
Average Metric: 58.00 / 75 (77.3%):  75%|███████▌  | 75/100 [00:23<00:09,  2.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 59.00 / 76 (77.6%):  75%|███████▌  | 75/100 [00:23<00:09,  2.63it/s]
Average Metric: 59.00 / 76 (77.6%):  76%|███████▌  | 76/100 [00:23<00:08,  2.78it/s]
Average Metric: 60.00 / 77 (77.9%):  76%|███████▌  | 76/100 [00:23<00:08,  2.78it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 60.00 / 78 (76.9%):  77%|███████▋  | 77/100 [00:23<00:08,  2.78it/s]
Average Metric: 60.00 / 78 (76.9%):  78%|███████▊  | 78/100 [00:23<00:06,  3.62it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 61.00 / 79 (77.2%):  78%|███████▊  | 78/100 [00:23<00:06,  3.62it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 62.00 / 80 (77.5%):  79%|███████▉  | 79/100 [00:24<00:05,  3.62it/s]
Average Metric: 62.00 / 80 (77.5%):  80%|████████  | 80/100 [00:24<00:06,  3.06it/s]
Average Metric: 63.00 / 81 (77.8%):  80%|████████  | 80/100 [00:24<00:06,  3.06it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 64.00 / 82 (78.0%):  81%|████████  | 81/100 [00:24<00:06,  3.06it/s]
Average Metric: 64.00 / 82 (78.0%):  82%|████████▏ | 82/100 [00:24<00:04,  3.78it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 65.00 / 83 (78.3%):  82%|████████▏ | 82/100 [00:25<00:04,  3.78it/s]
Average Metric: 65.00 / 83 (78.3%):  83%|████████▎ | 83/100 [00:25<00:04,  3.74it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 65.00 / 84 (77.4%):  83%|████████▎ | 83/100 [00:25<00:04,  3.74it/s]
Average Metric: 65.00 / 84 (77.4%):  84%|████████▍ | 84/100 [00:25<00:06,  2.47it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 65.00 / 85 (76.5%):  84%|████████▍ | 84/100 [00:26<00:06,  2.47it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 66.00 / 86 (76.7%):  85%|████████▌ | 85/100 [00:26<00:06,  2.47it/s]
Average Metric: 66.00 / 86 (76.7%):  86%|████████▌ | 86/100 [00:26<00:04,  3.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 67.00 / 87 (77.0%):  86%|████████▌ | 86/100 [00:26<00:04,  3.21it/s]
Average Metric: 67.00 / 87 (77.0%):  87%|████████▋ | 87/100 [00:26<00:03,  3.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 67.00 / 88 (76.1%):  87%|████████▋ | 87/100 [00:26<00:03,  3.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 68.00 / 89 (76.4%):  88%|████████▊ | 88/100 [00:26<00:03,  3.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 69.00 / 90 (76.7%):  89%|████████▉ | 89/100 [00:27<00:03,  3.63it/s]
Average Metric: 69.00 / 90 (76.7%):  90%|█████████ | 90/100 [00:27<00:03,  3.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 70.00 / 91 (76.9%):  90%|█████████ | 90/100 [00:27<00:03,  3.21it/s]
Average Metric: 70.00 / 91 (76.9%):  91%|█████████ | 91/100 [00:27<00:02,  3.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 71.00 / 92 (77.2%):  91%|█████████ | 91/100 [00:27<00:02,  3.40it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 72.00 / 93 (77.4%):  92%|█████████▏| 92/100 [00:27<00:02,  3.40it/s]
Average Metric: 72.00 / 93 (77.4%):  93%|█████████▎| 93/100 [00:27<00:01,  4.43it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 73.00 / 94 (77.7%):  93%|█████████▎| 93/100 [00:28<00:01,  4.43it/s]
Average Metric: 73.00 / 94 (77.7%):  94%|█████████▍| 94/100 [00:28<00:01,  3.10it/s]
Average Metric: 74.00 / 95 (77.9%):  94%|█████████▍| 94/100 [00:28<00:01,  3.10it/s]
Average Metric: 74.00 / 96 (77.1%):  95%|█████████▌| 95/100 [00:29<00:01,  3.10it/s]
Average Metric: 74.00 / 96 (77.1%):  96%|█████████▌| 96/100 [00:29<00:01,  3.29it/s]
Average Metric: 75.00 / 97 (77.3%):  96%|█████████▌| 96/100 [00:29<00:01,  3.29it/s]
Average Metric: 75.00 / 97 (77.3%):  97%|█████████▋| 97/100 [00:29<00:00,  3.50it/s]
Average Metric: 76.00 / 98 (77.6%):  97%|█████████▋| 97/100 [00:29<00:00,  3.50it/s]
Average Metric: 76.00 / 98 (77.6%):  98%|█████████▊| 98/100 [00:29<00:00,  3.92it/s]
Average Metric: 77.00 / 99 (77.8%):  98%|█████████▊| 98/100 [00:29<00:00,  3.92it/s]
Average Metric: 77.00 / 99 (77.8%):  99%|█████████▉| 99/100 [00:29<00:00,  3.48it/s]
Average Metric: 78.00 / 100 (78.0%):  99%|█████████▉| 99/100 [00:30<00:00,  3.48it/s]
Average Metric: 78.00 / 100 (78.0%): 100%|██████████| 100/100 [00:30<00:00,  2.89it/s]
Average Metric: 78.00 / 100 (78.0%): 100%|██████████| 100/100 [00:30<00:00,  3.28it/s]
2025/04/21 09:30:42 INFO dspy.evaluate.evaluate: Average Metric: 78 / 100 (78.0%)
2025/04/21 09:30:42 INFO dspy.teleprompt.mipro_optimizer_v2: New best full eval score! Score: 78.0
2025/04/21 09:30:42 INFO dspy.teleprompt.mipro_optimizer_v2: Full eval scores so far: [57.0, 78.0]
2025/04/21 09:30:42 INFO dspy.teleprompt.mipro_optimizer_v2: Best full score so far: 78.0
2025/04/21 09:30:42 INFO dspy.teleprompt.mipro_optimizer_v2: =======================
2025/04/21 09:30:42 INFO dspy.teleprompt.mipro_optimizer_v2: 

2025/04/21 09:30:42 INFO dspy.teleprompt.mipro_optimizer_v2: Returning best identified program with score 78.0!
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/130 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/130 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/130 [00:01<03:57,  1.84s/it]
Average Metric: 2.00 / 2 (100.0%):   1%|          | 1/130 [00:01<03:57,  1.84s/it]
Average Metric: 2.00 / 3 (66.7%):   2%|▏         | 2/130 [00:01<03:55,  1.84s/it] 
Average Metric: 3.00 / 4 (75.0%):   2%|▏         | 3/130 [00:01<03:53,  1.84s/it]
Average Metric: 4.00 / 5 (80.0%):   3%|▎         | 4/130 [00:01<03:51,  1.84s/it]
Average Metric: 5.00 / 6 (83.3%):   4%|▍         | 5/130 [00:01<03:49,  1.84s/it]
Average Metric: 6.00 / 7 (85.7%):   5%|▍         | 6/130 [00:01<03:47,  1.84s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 7.00 / 8 (87.5%):   5%|▌         | 7/130 [00:02<03:46,  1.84s/it]
Average Metric: 7.00 / 8 (87.5%):   6%|▌         | 8/130 [00:02<00:36,  3.31it/s]
Average Metric: 7.00 / 9 (77.8%):   6%|▌         | 8/130 [00:02<00:36,  3.31it/s]
Average Metric: 8.00 / 10 (80.0%):   7%|▋         | 9/130 [00:02<00:36,  3.31it/s]
Average Metric: 9.00 / 11 (81.8%):   8%|▊         | 10/130 [00:02<00:36,  3.31it/s]
Average Metric: 10.00 / 12 (83.3%):   8%|▊         | 11/130 [00:02<00:35,  3.31it/s]
Average Metric: 11.00 / 13 (84.6%):   9%|▉         | 12/130 [00:02<00:35,  3.31it/s]
Average Metric: 12.00 / 14 (85.7%):  10%|█         | 13/130 [00:02<00:35,  3.31it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 15 (86.7%):  11%|█         | 14/130 [00:03<00:35,  3.31it/s]
Average Metric: 13.00 / 15 (86.7%):  12%|█▏        | 15/130 [00:03<00:20,  5.53it/s]
Average Metric: 14.00 / 16 (87.5%):  12%|█▏        | 15/130 [00:03<00:20,  5.53it/s]
Average Metric: 15.00 / 17 (88.2%):  12%|█▏        | 16/130 [00:03<00:20,  5.53it/s]
Average Metric: 16.00 / 18 (88.9%):  13%|█▎        | 17/130 [00:03<00:20,  5.53it/s]
Average Metric: 16.00 / 19 (84.2%):  14%|█▍        | 18/130 [00:03<00:20,  5.53it/s]
Average Metric: 17.00 / 20 (85.0%):  15%|█▍        | 19/130 [00:03<00:20,  5.53it/s]
Average Metric: 18.00 / 21 (85.7%):  15%|█▌        | 20/130 [00:03<00:19,  5.53it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 22 (86.4%):  16%|█▌        | 21/130 [00:04<00:19,  5.53it/s]
Average Metric: 19.00 / 22 (86.4%):  17%|█▋        | 22/130 [00:04<00:19,  5.55it/s]
Average Metric: 20.00 / 23 (87.0%):  17%|█▋        | 22/130 [00:04<00:19,  5.55it/s]
Average Metric: 21.00 / 24 (87.5%):  18%|█▊        | 23/130 [00:04<00:19,  5.55it/s]
Average Metric: 22.00 / 25 (88.0%):  18%|█▊        | 24/130 [00:04<00:19,  5.55it/s]
Average Metric: 23.00 / 26 (88.5%):  19%|█▉        | 25/130 [00:04<00:18,  5.55it/s]
Average Metric: 23.00 / 27 (85.2%):  20%|██        | 26/130 [00:04<00:18,  5.55it/s]
Average Metric: 24.00 / 28 (85.7%):  21%|██        | 27/130 [00:04<00:18,  5.55it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 29 (82.8%):  22%|██▏       | 28/130 [00:05<00:18,  5.55it/s]
Average Metric: 24.00 / 29 (82.8%):  22%|██▏       | 29/130 [00:05<00:15,  6.44it/s]
Average Metric: 25.00 / 30 (83.3%):  22%|██▏       | 29/130 [00:05<00:15,  6.44it/s]
Average Metric: 25.00 / 31 (80.6%):  23%|██▎       | 30/130 [00:05<00:15,  6.44it/s]
Average Metric: 26.00 / 32 (81.2%):  24%|██▍       | 31/130 [00:05<00:15,  6.44it/s]
Average Metric: 27.00 / 33 (81.8%):  25%|██▍       | 32/130 [00:05<00:15,  6.44it/s]
Average Metric: 28.00 / 34 (82.4%):  25%|██▌       | 33/130 [00:05<00:15,  6.44it/s]
Average Metric: 29.00 / 35 (82.9%):  26%|██▌       | 34/130 [00:05<00:14,  6.44it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 36 (80.6%):  27%|██▋       | 35/130 [00:06<00:14,  6.44it/s]
Average Metric: 29.00 / 36 (80.6%):  28%|██▊       | 36/130 [00:06<00:15,  6.18it/s]
Average Metric: 30.00 / 37 (81.1%):  28%|██▊       | 36/130 [00:07<00:15,  6.18it/s]
Average Metric: 30.00 / 37 (81.1%):  28%|██▊       | 37/130 [00:07<00:15,  5.96it/s]
Average Metric: 31.00 / 38 (81.6%):  28%|██▊       | 37/130 [00:07<00:15,  5.96it/s]
Average Metric: 31.00 / 39 (79.5%):  29%|██▉       | 38/130 [00:07<00:15,  5.96it/s]
Average Metric: 31.00 / 40 (77.5%):  30%|███       | 39/130 [00:07<00:15,  5.96it/s]
Average Metric: 31.00 / 41 (75.6%):  31%|███       | 40/130 [00:07<00:15,  5.96it/s]
Average Metric: 32.00 / 42 (76.2%):  32%|███▏      | 41/130 [00:07<00:14,  5.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 43 (74.4%):  32%|███▏      | 42/130 [00:07<00:14,  5.96it/s]
Average Metric: 33.00 / 44 (75.0%):  33%|███▎      | 43/130 [00:07<00:14,  5.96it/s]
Average Metric: 33.00 / 44 (75.0%):  34%|███▍      | 44/130 [00:07<00:09,  9.33it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 34.00 / 45 (75.6%):  34%|███▍      | 44/130 [00:07<00:09,  9.33it/s]
Average Metric: 34.00 / 46 (73.9%):  35%|███▍      | 45/130 [00:07<00:09,  9.33it/s]
Average Metric: 35.00 / 47 (74.5%):  35%|███▌      | 46/130 [00:07<00:08,  9.33it/s]
Average Metric: 35.00 / 47 (74.5%):  36%|███▌      | 47/130 [00:07<00:10,  7.79it/s]
Average Metric: 36.00 / 48 (75.0%):  36%|███▌      | 47/130 [00:07<00:10,  7.79it/s]
Average Metric: 37.00 / 49 (75.5%):  37%|███▋      | 48/130 [00:07<00:10,  7.79it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 38.00 / 50 (76.0%):  38%|███▊      | 49/130 [00:07<00:10,  7.79it/s]
Average Metric: 39.00 / 51 (76.5%):  38%|███▊      | 50/130 [00:08<00:10,  7.79it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 39.00 / 51 (76.5%):  39%|███▉      | 51/130 [00:08<00:09,  8.33it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 52 (76.9%):  39%|███▉      | 51/130 [00:09<00:09,  8.33it/s]
Average Metric: 41.00 / 53 (77.4%):  40%|████      | 52/130 [00:09<00:09,  8.33it/s]
Average Metric: 41.00 / 53 (77.4%):  41%|████      | 53/130 [00:09<00:13,  5.54it/s]
Average Metric: 41.00 / 54 (75.9%):  41%|████      | 53/130 [00:09<00:13,  5.54it/s]
Average Metric: 42.00 / 55 (76.4%):  42%|████▏     | 54/130 [00:09<00:13,  5.54it/s]
Average Metric: 43.00 / 56 (76.8%):  42%|████▏     | 55/130 [00:09<00:13,  5.54it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 44.00 / 57 (77.2%):  43%|████▎     | 56/130 [00:09<00:13,  5.54it/s]
Average Metric: 45.00 / 58 (77.6%):  44%|████▍     | 57/130 [00:09<00:13,  5.54it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 46.00 / 59 (78.0%):  45%|████▍     | 58/130 [00:09<00:12,  5.54it/s]
Average Metric: 46.00 / 59 (78.0%):  45%|████▌     | 59/130 [00:09<00:08,  8.06it/s]
Average Metric: 47.00 / 60 (78.3%):  45%|████▌     | 59/130 [00:09<00:08,  8.06it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 48.00 / 61 (78.7%):  46%|████▌     | 60/130 [00:09<00:08,  8.06it/s]
Average Metric: 48.00 / 61 (78.7%):  47%|████▋     | 61/130 [00:09<00:08,  7.93it/s]
Average Metric: 49.00 / 62 (79.0%):  47%|████▋     | 61/130 [00:09<00:08,  7.93it/s]
Average Metric: 49.00 / 63 (77.8%):  48%|████▊     | 62/130 [00:09<00:08,  7.93it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 50.00 / 64 (78.1%):  48%|████▊     | 63/130 [00:09<00:08,  7.93it/s]
Average Metric: 50.00 / 64 (78.1%):  49%|████▉     | 64/130 [00:09<00:07,  9.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 65 (78.5%):  49%|████▉     | 64/130 [00:10<00:07,  9.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 66 (77.3%):  50%|█████     | 65/130 [00:10<00:07,  9.10it/s]
Average Metric: 51.00 / 66 (77.3%):  51%|█████     | 66/130 [00:10<00:11,  5.71it/s]
Average Metric: 52.00 / 67 (77.6%):  51%|█████     | 66/130 [00:10<00:11,  5.71it/s]
Average Metric: 52.00 / 68 (76.5%):  52%|█████▏    | 67/130 [00:10<00:11,  5.71it/s]
Average Metric: 52.00 / 68 (76.5%):  52%|█████▏    | 68/130 [00:10<00:09,  6.51it/s]
Average Metric: 52.00 / 69 (75.4%):  52%|█████▏    | 68/130 [00:10<00:09,  6.51it/s]
Average Metric: 52.00 / 70 (74.3%):  53%|█████▎    | 69/130 [00:10<00:09,  6.51it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 71 (74.6%):  54%|█████▍    | 70/130 [00:10<00:09,  6.51it/s]
Average Metric: 54.00 / 72 (75.0%):  55%|█████▍    | 71/130 [00:11<00:09,  6.51it/s]
Average Metric: 54.00 / 72 (75.0%):  55%|█████▌    | 72/130 [00:11<00:06,  9.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 55.00 / 73 (75.3%):  55%|█████▌    | 72/130 [00:11<00:06,  9.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 56.00 / 74 (75.7%):  56%|█████▌    | 73/130 [00:11<00:05,  9.63it/s]
Average Metric: 56.00 / 74 (75.7%):  57%|█████▋    | 74/130 [00:11<00:06,  9.00it/s]
Average Metric: 56.00 / 75 (74.7%):  57%|█████▋    | 74/130 [00:11<00:06,  9.00it/s]
Average Metric: 57.00 / 76 (75.0%):  58%|█████▊    | 75/130 [00:11<00:06,  9.00it/s]
Average Metric: 58.00 / 77 (75.3%):  58%|█████▊    | 76/130 [00:11<00:05,  9.00it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 59.00 / 78 (75.6%):  59%|█████▉    | 77/130 [00:11<00:05,  9.00it/s]
Average Metric: 59.00 / 78 (75.6%):  60%|██████    | 78/130 [00:11<00:04, 11.73it/s]
Average Metric: 59.00 / 79 (74.7%):  60%|██████    | 78/130 [00:11<00:04, 11.73it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 60.00 / 80 (75.0%):  61%|██████    | 79/130 [00:12<00:04, 11.73it/s]
Average Metric: 60.00 / 80 (75.0%):  62%|██████▏   | 80/130 [00:12<00:07,  6.27it/s]
Average Metric: 61.00 / 81 (75.3%):  62%|██████▏   | 80/130 [00:12<00:07,  6.27it/s]
Average Metric: 62.00 / 82 (75.6%):  62%|██████▏   | 81/130 [00:12<00:07,  6.27it/s]
Average Metric: 62.00 / 82 (75.6%):  63%|██████▎   | 82/130 [00:12<00:08,  5.46it/s]
Average Metric: 63.00 / 83 (75.9%):  63%|██████▎   | 82/130 [00:12<00:08,  5.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 64.00 / 84 (76.2%):  64%|██████▍   | 83/130 [00:12<00:08,  5.46it/s]
Average Metric: 65.00 / 85 (76.5%):  65%|██████▍   | 84/130 [00:12<00:08,  5.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 65.00 / 86 (75.6%):  65%|██████▌   | 85/130 [00:13<00:08,  5.46it/s]
Average Metric: 65.00 / 86 (75.6%):  66%|██████▌   | 86/130 [00:13<00:05,  7.94it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 66.00 / 87 (75.9%):  66%|██████▌   | 86/130 [00:13<00:05,  7.94it/s]
Average Metric: 66.00 / 88 (75.0%):  67%|██████▋   | 87/130 [00:13<00:05,  7.94it/s]
Average Metric: 66.00 / 88 (75.0%):  68%|██████▊   | 88/130 [00:13<00:04,  8.72it/s]
Average Metric: 67.00 / 89 (75.3%):  68%|██████▊   | 88/130 [00:13<00:04,  8.72it/s]
Average Metric: 68.00 / 90 (75.6%):  68%|██████▊   | 89/130 [00:13<00:04,  8.72it/s]
Average Metric: 68.00 / 90 (75.6%):  69%|██████▉   | 90/130 [00:13<00:04,  8.80it/s]
Average Metric: 69.00 / 91 (75.8%):  69%|██████▉   | 90/130 [00:13<00:04,  8.80it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 70.00 / 92 (76.1%):  70%|███████   | 91/130 [00:13<00:04,  8.80it/s]
Average Metric: 71.00 / 93 (76.3%):  71%|███████   | 92/130 [00:13<00:04,  8.80it/s]
Average Metric: 71.00 / 93 (76.3%):  72%|███████▏  | 93/130 [00:13<00:03, 10.19it/s]
Average Metric: 71.00 / 94 (75.5%):  72%|███████▏  | 93/130 [00:13<00:03, 10.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 72.00 / 95 (75.8%):  72%|███████▏  | 94/130 [00:14<00:03, 10.19it/s]
Average Metric: 72.00 / 95 (75.8%):  73%|███████▎  | 95/130 [00:14<00:07,  4.93it/s]
Average Metric: 73.00 / 96 (76.0%):  73%|███████▎  | 95/130 [00:14<00:07,  4.93it/s]
Average Metric: 73.00 / 96 (76.0%):  74%|███████▍  | 96/130 [00:14<00:06,  5.26it/s]
Average Metric: 74.00 / 97 (76.3%):  74%|███████▍  | 96/130 [00:14<00:06,  5.26it/s]
Average Metric: 75.00 / 98 (76.5%):  75%|███████▍  | 97/130 [00:14<00:06,  5.26it/s]
Average Metric: 76.00 / 99 (76.8%):  75%|███████▌  | 98/130 [00:14<00:06,  5.26it/s]
Average Metric: 76.00 / 99 (76.8%):  76%|███████▌  | 99/130 [00:14<00:04,  7.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 76.00 / 100 (76.0%):  76%|███████▌  | 99/130 [00:14<00:04,  7.09it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 76.00 / 101 (75.2%):  77%|███████▋  | 100/130 [00:15<00:04,  7.09it/s]
Average Metric: 76.00 / 101 (75.2%):  78%|███████▊  | 101/130 [00:15<00:03,  7.81it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 77.00 / 102 (75.5%):  78%|███████▊  | 101/130 [00:15<00:03,  7.81it/s]
Average Metric: 78.00 / 103 (75.7%):  78%|███████▊  | 102/130 [00:15<00:03,  7.81it/s]
Average Metric: 79.00 / 104 (76.0%):  79%|███████▉  | 103/130 [00:15<00:03,  7.81it/s]
Average Metric: 80.00 / 105 (76.2%):  80%|████████  | 104/130 [00:15<00:03,  7.81it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 81.00 / 106 (76.4%):  81%|████████  | 105/130 [00:15<00:03,  7.81it/s]
Average Metric: 82.00 / 107 (76.6%):  82%|████████▏ | 106/130 [00:15<00:03,  7.81it/s]
Average Metric: 82.00 / 107 (76.6%):  82%|████████▏ | 107/130 [00:15<00:01, 13.86it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 83.00 / 108 (76.9%):  82%|████████▏ | 107/130 [00:15<00:01, 13.86it/s]
Average Metric: 84.00 / 109 (77.1%):  83%|████████▎ | 108/130 [00:15<00:01, 13.86it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 85.00 / 110 (77.3%):  84%|████████▍ | 109/130 [00:16<00:01, 13.86it/s]
Average Metric: 85.00 / 110 (77.3%):  85%|████████▍ | 110/130 [00:16<00:03,  5.93it/s]
Average Metric: 86.00 / 111 (77.5%):  85%|████████▍ | 110/130 [00:16<00:03,  5.93it/s]
Average Metric: 87.00 / 112 (77.7%):  85%|████████▌ | 111/130 [00:16<00:03,  5.93it/s]
Average Metric: 88.00 / 113 (77.9%):  86%|████████▌ | 112/130 [00:16<00:03,  5.93it/s]
Average Metric: 88.00 / 114 (77.2%):  87%|████████▋ | 113/130 [00:16<00:02,  5.93it/s]
Average Metric: 89.00 / 115 (77.4%):  88%|████████▊ | 114/130 [00:16<00:02,  5.93it/s]
Average Metric: 90.00 / 116 (77.6%):  88%|████████▊ | 115/130 [00:16<00:02,  5.93it/s]
Average Metric: 90.00 / 117 (76.9%):  89%|████████▉ | 116/130 [00:16<00:02,  5.93it/s]
Average Metric: 91.00 / 118 (77.1%):  90%|█████████ | 117/130 [00:16<00:02,  5.93it/s]
Average Metric: 91.00 / 118 (77.1%):  91%|█████████ | 118/130 [00:16<00:01, 11.17it/s]
Average Metric: 92.00 / 119 (77.3%):  91%|█████████ | 118/130 [00:16<00:01, 11.17it/s]
Average Metric: 93.00 / 120 (77.5%):  92%|█████████▏| 119/130 [00:16<00:00, 11.17it/s]
Average Metric: 93.00 / 121 (76.9%):  92%|█████████▏| 120/130 [00:16<00:00, 11.17it/s]
Average Metric: 94.00 / 122 (77.0%):  93%|█████████▎| 121/130 [00:17<00:00, 11.17it/s]
Average Metric: 94.00 / 122 (77.0%):  94%|█████████▍| 122/130 [00:17<00:00,  9.96it/s]
Average Metric: 95.00 / 123 (77.2%):  94%|█████████▍| 122/130 [00:17<00:00,  9.96it/s]
Average Metric: 96.00 / 124 (77.4%):  95%|█████████▍| 123/130 [00:17<00:00,  9.96it/s]
Average Metric: 97.00 / 125 (77.6%):  95%|█████████▌| 124/130 [00:17<00:00,  9.96it/s]
Average Metric: 97.00 / 125 (77.6%):  96%|█████████▌| 125/130 [00:17<00:00, 11.21it/s]
Average Metric: 98.00 / 126 (77.8%):  96%|█████████▌| 125/130 [00:17<00:00, 11.21it/s]
Average Metric: 99.00 / 127 (78.0%):  97%|█████████▋| 126/130 [00:17<00:00, 11.21it/s]
Average Metric: 99.00 / 128 (77.3%):  98%|█████████▊| 127/130 [00:18<00:00, 11.21it/s]
Average Metric: 99.00 / 128 (77.3%):  98%|█████████▊| 128/130 [00:18<00:00,  7.11it/s]
Average Metric: 100.00 / 129 (77.5%):  98%|█████████▊| 128/130 [00:18<00:00,  7.11it/s]
Average Metric: 101.00 / 130 (77.7%):  99%|█████████▉| 129/130 [00:18<00:00,  7.11it/s]
Average Metric: 101.00 / 130 (77.7%): 100%|██████████| 130/130 [00:18<00:00,  6.14it/s]
Average Metric: 101.00 / 130 (77.7%): 100%|██████████| 130/130 [00:18<00:00,  6.93it/s]
2025/04/21 09:33:05 INFO dspy.evaluate.evaluate: Average Metric: 101 / 130 (77.7%)
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/131 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/131 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/131 [00:01<03:28,  1.60s/it]
Average Metric: 2.00 / 2 (100.0%):   1%|          | 1/131 [00:01<03:28,  1.60s/it]
Average Metric: 3.00 / 3 (100.0%):   2%|▏         | 2/131 [00:01<03:26,  1.60s/it]
Average Metric: 3.00 / 4 (75.0%):   2%|▏         | 3/131 [00:01<03:25,  1.60s/it] 
Average Metric: 4.00 / 5 (80.0%):   3%|▎         | 4/131 [00:01<03:23,  1.60s/it]
Average Metric: 4.00 / 6 (66.7%):   4%|▍         | 5/131 [00:01<03:21,  1.60s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 7 (71.4%):   5%|▍         | 6/131 [00:01<03:20,  1.60s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 8 (62.5%):   5%|▌         | 7/131 [00:01<03:18,  1.60s/it]
Average Metric: 5.00 / 8 (62.5%):   6%|▌         | 8/131 [00:01<00:23,  5.20it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 5.00 / 9 (55.6%):   6%|▌         | 8/131 [00:02<00:23,  5.20it/s]
Average Metric: 5.00 / 10 (50.0%):   7%|▋         | 9/131 [00:02<00:23,  5.20it/s]
Average Metric: 5.00 / 10 (50.0%):   8%|▊         | 10/131 [00:02<00:19,  6.08it/s]
Average Metric: 6.00 / 11 (54.5%):   8%|▊         | 10/131 [00:02<00:19,  6.08it/s]
Average Metric: 7.00 / 12 (58.3%):   8%|▊         | 11/131 [00:02<00:19,  6.08it/s]
Average Metric: 8.00 / 13 (61.5%):   9%|▉         | 12/131 [00:02<00:19,  6.08it/s]
Average Metric: 9.00 / 14 (64.3%):  10%|▉         | 13/131 [00:03<00:19,  6.08it/s]
Average Metric: 9.00 / 14 (64.3%):  11%|█         | 14/131 [00:03<00:23,  4.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 15 (66.7%):  11%|█         | 14/131 [00:03<00:23,  4.96it/s]
Average Metric: 10.00 / 16 (62.5%):  11%|█▏        | 15/131 [00:03<00:23,  4.96it/s]
Average Metric: 11.00 / 17 (64.7%):  12%|█▏        | 16/131 [00:03<00:23,  4.96it/s]
Average Metric: 11.00 / 17 (64.7%):  13%|█▎        | 17/131 [00:03<00:17,  6.56it/s]
Average Metric: 12.00 / 18 (66.7%):  13%|█▎        | 17/131 [00:03<00:17,  6.56it/s]
Average Metric: 13.00 / 19 (68.4%):  14%|█▎        | 18/131 [00:03<00:17,  6.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 20 (65.0%):  15%|█▍        | 19/131 [00:03<00:17,  6.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 13.00 / 21 (61.9%):  15%|█▌        | 20/131 [00:03<00:16,  6.56it/s]
Average Metric: 13.00 / 21 (61.9%):  16%|█▌        | 21/131 [00:03<00:11,  9.25it/s]
Average Metric: 14.00 / 22 (63.6%):  16%|█▌        | 21/131 [00:04<00:11,  9.25it/s]
Average Metric: 15.00 / 23 (65.2%):  17%|█▋        | 22/131 [00:04<00:11,  9.25it/s]
Average Metric: 15.00 / 23 (65.2%):  18%|█▊        | 23/131 [00:04<00:22,  4.82it/s]
Average Metric: 16.00 / 24 (66.7%):  18%|█▊        | 23/131 [00:04<00:22,  4.82it/s]
Average Metric: 17.00 / 25 (68.0%):  18%|█▊        | 24/131 [00:04<00:22,  4.82it/s]
Average Metric: 17.00 / 26 (65.4%):  19%|█▉        | 25/131 [00:04<00:21,  4.82it/s]
Average Metric: 17.00 / 27 (63.0%):  20%|█▉        | 26/131 [00:04<00:21,  4.82it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 18.00 / 28 (64.3%):  21%|██        | 27/131 [00:04<00:21,  4.82it/s]
Average Metric: 18.00 / 28 (64.3%):  21%|██▏       | 28/131 [00:04<00:13,  7.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 19.00 / 29 (65.5%):  21%|██▏       | 28/131 [00:04<00:13,  7.85it/s]
Average Metric: 20.00 / 30 (66.7%):  22%|██▏       | 29/131 [00:04<00:12,  7.85it/s]
Average Metric: 21.00 / 31 (67.7%):  23%|██▎       | 30/131 [00:04<00:12,  7.85it/s]
Average Metric: 21.00 / 31 (67.7%):  24%|██▎       | 31/131 [00:04<00:11,  8.64it/s]
Average Metric: 22.00 / 32 (68.8%):  24%|██▎       | 31/131 [00:04<00:11,  8.64it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 33 (66.7%):  24%|██▍       | 32/131 [00:04<00:11,  8.64it/s]
Average Metric: 23.00 / 34 (67.6%):  25%|██▌       | 33/131 [00:04<00:11,  8.64it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 35 (68.6%):  26%|██▌       | 34/131 [00:05<00:11,  8.64it/s]
Average Metric: 24.00 / 35 (68.6%):  27%|██▋       | 35/131 [00:05<00:09, 10.25it/s]
Average Metric: 25.00 / 36 (69.4%):  27%|██▋       | 35/131 [00:05<00:09, 10.25it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 37 (70.3%):  27%|██▋       | 36/131 [00:06<00:09, 10.25it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 37 (70.3%):  28%|██▊       | 37/131 [00:06<00:16,  5.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 27.00 / 38 (71.1%):  28%|██▊       | 37/131 [00:06<00:16,  5.56it/s]
Average Metric: 28.00 / 39 (71.8%):  29%|██▉       | 38/131 [00:06<00:16,  5.56it/s]
Average Metric: 28.00 / 39 (71.8%):  30%|██▉       | 39/131 [00:06<00:14,  6.55it/s]
Average Metric: 29.00 / 40 (72.5%):  30%|██▉       | 39/131 [00:06<00:14,  6.55it/s]
Average Metric: 30.00 / 41 (73.2%):  31%|███       | 40/131 [00:06<00:13,  6.55it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 42 (73.8%):  31%|███▏      | 41/131 [00:06<00:13,  6.55it/s]
Average Metric: 31.00 / 42 (73.8%):  32%|███▏      | 42/131 [00:06<00:10,  8.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 43 (74.4%):  32%|███▏      | 42/131 [00:06<00:10,  8.63it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 44 (72.7%):  33%|███▎      | 43/131 [00:06<00:10,  8.63it/s]
Average Metric: 32.00 / 44 (72.7%):  34%|███▎      | 44/131 [00:06<00:09,  9.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 45 (71.1%):  34%|███▎      | 44/131 [00:06<00:09,  9.01it/s]
Average Metric: 33.00 / 46 (71.7%):  34%|███▍      | 45/131 [00:06<00:09,  9.01it/s]
Average Metric: 33.00 / 46 (71.7%):  35%|███▌      | 46/131 [00:06<00:10,  8.29it/s]
Average Metric: 34.00 / 47 (72.3%):  35%|███▌      | 46/131 [00:06<00:10,  8.29it/s]
Average Metric: 35.00 / 48 (72.9%):  36%|███▌      | 47/131 [00:06<00:10,  8.29it/s]
Average Metric: 36.00 / 49 (73.5%):  37%|███▋      | 48/131 [00:06<00:10,  8.29it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 37.00 / 50 (74.0%):  37%|███▋      | 49/131 [00:06<00:09,  8.29it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 38.00 / 51 (74.5%):  38%|███▊      | 50/131 [00:07<00:09,  8.29it/s]
Average Metric: 38.00 / 51 (74.5%):  39%|███▉      | 51/131 [00:07<00:11,  6.89it/s]
Average Metric: 39.00 / 52 (75.0%):  39%|███▉      | 51/131 [00:07<00:11,  6.89it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 39.00 / 53 (73.6%):  40%|███▉      | 52/131 [00:08<00:11,  6.89it/s]
Average Metric: 39.00 / 53 (73.6%):  40%|████      | 53/131 [00:08<00:10,  7.16it/s]
Average Metric: 40.00 / 54 (74.1%):  40%|████      | 53/131 [00:08<00:10,  7.16it/s]
Average Metric: 41.00 / 55 (74.5%):  41%|████      | 54/131 [00:08<00:10,  7.16it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 56 (73.2%):  42%|████▏     | 55/131 [00:08<00:10,  7.16it/s]
Average Metric: 41.00 / 56 (73.2%):  43%|████▎     | 56/131 [00:08<00:08,  8.86it/s]
Average Metric: 41.00 / 57 (71.9%):  43%|████▎     | 56/131 [00:08<00:08,  8.86it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 42.00 / 58 (72.4%):  44%|████▎     | 57/131 [00:08<00:08,  8.86it/s]
Average Metric: 42.00 / 58 (72.4%):  44%|████▍     | 58/131 [00:08<00:08,  8.90it/s]
Average Metric: 43.00 / 59 (72.9%):  44%|████▍     | 58/131 [00:08<00:08,  8.90it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 44.00 / 60 (73.3%):  45%|████▌     | 59/131 [00:08<00:08,  8.90it/s]
Average Metric: 44.00 / 60 (73.3%):  46%|████▌     | 60/131 [00:08<00:06, 10.22it/s]
Average Metric: 45.00 / 61 (73.8%):  46%|████▌     | 60/131 [00:08<00:06, 10.22it/s]
Average Metric: 46.00 / 62 (74.2%):  47%|████▋     | 61/131 [00:08<00:06, 10.22it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 47.00 / 63 (74.6%):  47%|████▋     | 62/131 [00:08<00:06, 10.22it/s]
Average Metric: 47.00 / 63 (74.6%):  48%|████▊     | 63/131 [00:08<00:05, 12.85it/s]
Average Metric: 47.00 / 64 (73.4%):  48%|████▊     | 63/131 [00:08<00:05, 12.85it/s]
Average Metric: 48.00 / 65 (73.8%):  49%|████▉     | 64/131 [00:09<00:05, 12.85it/s]
Average Metric: 48.00 / 65 (73.8%):  50%|████▉     | 65/131 [00:09<00:09,  7.30it/s]
Average Metric: 49.00 / 66 (74.2%):  50%|████▉     | 65/131 [00:09<00:09,  7.30it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 49.00 / 67 (73.1%):  50%|█████     | 66/131 [00:09<00:08,  7.30it/s]
Average Metric: 49.00 / 67 (73.1%):  51%|█████     | 67/131 [00:09<00:10,  6.30it/s]
Average Metric: 50.00 / 68 (73.5%):  51%|█████     | 67/131 [00:09<00:10,  6.30it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 69 (73.9%):  52%|█████▏    | 68/131 [00:09<00:10,  6.30it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 70 (72.9%):  53%|█████▎    | 69/131 [00:09<00:09,  6.30it/s]
Average Metric: 51.00 / 70 (72.9%):  53%|█████▎    | 70/131 [00:09<00:07,  7.83it/s]
Average Metric: 51.00 / 71 (71.8%):  53%|█████▎    | 70/131 [00:09<00:07,  7.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 52.00 / 72 (72.2%):  54%|█████▍    | 71/131 [00:10<00:07,  7.83it/s]
Average Metric: 52.00 / 73 (71.2%):  55%|█████▍    | 72/131 [00:10<00:07,  7.83it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 53.00 / 74 (71.6%):  56%|█████▌    | 73/131 [00:10<00:07,  7.83it/s]
Average Metric: 53.00 / 74 (71.6%):  56%|█████▋    | 74/131 [00:10<00:05, 10.20it/s]
Average Metric: 54.00 / 75 (72.0%):  56%|█████▋    | 74/131 [00:10<00:05, 10.20it/s]
Average Metric: 55.00 / 76 (72.4%):  57%|█████▋    | 75/131 [00:10<00:05, 10.20it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 56.00 / 77 (72.7%):  58%|█████▊    | 76/131 [00:10<00:05, 10.20it/s]
Average Metric: 56.00 / 77 (72.7%):  59%|█████▉    | 77/131 [00:10<00:05, 10.49it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 57.00 / 78 (73.1%):  59%|█████▉    | 77/131 [00:10<00:05, 10.49it/s]
Average Metric: 58.00 / 79 (73.4%):  60%|█████▉    | 78/131 [00:10<00:05, 10.49it/s]
Average Metric: 58.00 / 79 (73.4%):  60%|██████    | 79/131 [00:10<00:06,  7.46it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 59.00 / 80 (73.8%):  60%|██████    | 79/131 [00:10<00:06,  7.46it/s]
Average Metric: 60.00 / 81 (74.1%):  61%|██████    | 80/131 [00:11<00:06,  7.46it/s]
Average Metric: 60.00 / 81 (74.1%):  62%|██████▏   | 81/131 [00:11<00:06,  7.59it/s]
Average Metric: 60.00 / 82 (73.2%):  62%|██████▏   | 81/131 [00:11<00:06,  7.59it/s]
Average Metric: 61.00 / 83 (73.5%):  63%|██████▎   | 82/131 [00:11<00:06,  7.59it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 62.00 / 84 (73.8%):  63%|██████▎   | 83/131 [00:11<00:06,  7.59it/s]
Average Metric: 62.00 / 84 (73.8%):  64%|██████▍   | 84/131 [00:11<00:04,  9.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 63.00 / 85 (74.1%):  64%|██████▍   | 84/131 [00:11<00:04,  9.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 63.00 / 86 (73.3%):  65%|██████▍   | 85/131 [00:11<00:04,  9.48it/s]
Average Metric: 63.00 / 86 (73.3%):  66%|██████▌   | 86/131 [00:11<00:06,  6.96it/s]
Average Metric: 63.00 / 87 (72.4%):  66%|██████▌   | 86/131 [00:11<00:06,  6.96it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 64.00 / 88 (72.7%):  66%|██████▋   | 87/131 [00:11<00:06,  6.96it/s]
Average Metric: 65.00 / 89 (73.0%):  67%|██████▋   | 88/131 [00:11<00:06,  6.96it/s]
Average Metric: 66.00 / 90 (73.3%):  68%|██████▊   | 89/131 [00:11<00:06,  6.96it/s]
Average Metric: 66.00 / 90 (73.3%):  69%|██████▊   | 90/131 [00:11<00:03, 10.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 67.00 / 91 (73.6%):  69%|██████▊   | 90/131 [00:12<00:03, 10.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 68.00 / 92 (73.9%):  69%|██████▉   | 91/131 [00:12<00:03, 10.48it/s]
Average Metric: 68.00 / 92 (73.9%):  70%|███████   | 92/131 [00:12<00:04,  9.29it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 68.00 / 93 (73.1%):  70%|███████   | 92/131 [00:12<00:04,  9.29it/s]
Average Metric: 69.00 / 94 (73.4%):  71%|███████   | 93/131 [00:12<00:04,  9.29it/s]
Average Metric: 69.00 / 94 (73.4%):  72%|███████▏  | 94/131 [00:12<00:03, 10.06it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 70.00 / 95 (73.7%):  72%|███████▏  | 94/131 [00:12<00:03, 10.06it/s]
Average Metric: 71.00 / 96 (74.0%):  73%|███████▎  | 95/131 [00:12<00:03, 10.06it/s]
Average Metric: 71.00 / 96 (74.0%):  73%|███████▎  | 96/131 [00:12<00:03, 10.77it/s]
Average Metric: 71.00 / 97 (73.2%):  73%|███████▎  | 96/131 [00:12<00:03, 10.77it/s]
Average Metric: 72.00 / 98 (73.5%):  74%|███████▍  | 97/131 [00:13<00:03, 10.77it/s]
Average Metric: 72.00 / 98 (73.5%):  75%|███████▍  | 98/131 [00:13<00:04,  7.15it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 73.00 / 99 (73.7%):  75%|███████▍  | 98/131 [00:13<00:04,  7.15it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 74.00 / 100 (74.0%):  76%|███████▌  | 99/131 [00:13<00:04,  7.15it/s]
Average Metric: 74.00 / 100 (74.0%):  76%|███████▋  | 100/131 [00:13<00:04,  7.54it/s]
Average Metric: 74.00 / 101 (73.3%):  76%|███████▋  | 100/131 [00:13<00:04,  7.54it/s]
Average Metric: 75.00 / 102 (73.5%):  77%|███████▋  | 101/131 [00:13<00:03,  7.54it/s]
Average Metric: 75.00 / 102 (73.5%):  78%|███████▊  | 102/131 [00:13<00:03,  7.44it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 76.00 / 103 (73.8%):  78%|███████▊  | 102/131 [00:13<00:03,  7.44it/s]
Average Metric: 76.00 / 103 (73.8%):  79%|███████▊  | 103/131 [00:13<00:04,  6.30it/s]
Average Metric: 77.00 / 104 (74.0%):  79%|███████▊  | 103/131 [00:13<00:04,  6.30it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 78.00 / 105 (74.3%):  79%|███████▉  | 104/131 [00:14<00:04,  6.30it/s]
Average Metric: 78.00 / 105 (74.3%):  80%|████████  | 105/131 [00:14<00:03,  7.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 79.00 / 106 (74.5%):  80%|████████  | 105/131 [00:14<00:03,  7.92it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 80.00 / 107 (74.8%):  81%|████████  | 106/131 [00:14<00:03,  7.92it/s]
Average Metric: 80.00 / 107 (74.8%):  82%|████████▏ | 107/131 [00:14<00:02,  9.11it/s]
Average Metric: 81.00 / 108 (75.0%):  82%|████████▏ | 107/131 [00:14<00:02,  9.11it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 81.00 / 109 (74.3%):  82%|████████▏ | 108/131 [00:14<00:02,  9.11it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 82.00 / 110 (74.5%):  83%|████████▎ | 109/131 [00:14<00:02,  9.11it/s]
Average Metric: 82.00 / 110 (74.5%):  84%|████████▍ | 110/131 [00:14<00:02, 10.01it/s]
Average Metric: 82.00 / 111 (73.9%):  84%|████████▍ | 110/131 [00:14<00:02, 10.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 83.00 / 112 (74.1%):  85%|████████▍ | 111/131 [00:14<00:01, 10.01it/s]
Average Metric: 83.00 / 112 (74.1%):  85%|████████▌ | 112/131 [00:14<00:02,  7.85it/s]
Average Metric: 84.00 / 113 (74.3%):  85%|████████▌ | 112/131 [00:14<00:02,  7.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 84.00 / 114 (73.7%):  86%|████████▋ | 113/131 [00:14<00:02,  7.85it/s]
Average Metric: 84.00 / 114 (73.7%):  87%|████████▋ | 114/131 [00:15<00:01,  8.69it/s]
Average Metric: 85.00 / 115 (73.9%):  87%|████████▋ | 114/131 [00:15<00:01,  8.69it/s]
Average Metric: 85.00 / 116 (73.3%):  88%|████████▊ | 115/131 [00:15<00:01,  8.69it/s]
Average Metric: 86.00 / 117 (73.5%):  89%|████████▊ | 116/131 [00:15<00:01,  8.69it/s]
Average Metric: 87.00 / 118 (73.7%):  89%|████████▉ | 117/131 [00:15<00:01,  8.69it/s]
Average Metric: 87.00 / 119 (73.1%):  90%|█████████ | 118/131 [00:15<00:01,  8.69it/s]
Average Metric: 87.00 / 119 (73.1%):  91%|█████████ | 119/131 [00:15<00:00, 12.25it/s]
Average Metric: 88.00 / 120 (73.3%):  91%|█████████ | 119/131 [00:15<00:00, 12.25it/s]
Average Metric: 88.00 / 121 (72.7%):  92%|█████████▏| 120/131 [00:15<00:00, 12.25it/s]
Average Metric: 88.00 / 121 (72.7%):  92%|█████████▏| 121/131 [00:15<00:00, 10.61it/s]
Average Metric: 89.00 / 122 (73.0%):  92%|█████████▏| 121/131 [00:15<00:00, 10.61it/s]
Average Metric: 90.00 / 123 (73.2%):  93%|█████████▎| 122/131 [00:15<00:00, 10.61it/s]
Average Metric: 90.00 / 123 (73.2%):  94%|█████████▍| 123/131 [00:15<00:00, 10.51it/s]
Average Metric: 91.00 / 124 (73.4%):  94%|█████████▍| 123/131 [00:15<00:00, 10.51it/s]
Average Metric: 92.00 / 125 (73.6%):  95%|█████████▍| 124/131 [00:15<00:00, 10.51it/s]
Average Metric: 92.00 / 125 (73.6%):  95%|█████████▌| 125/131 [00:15<00:00,  9.48it/s]
Average Metric: 92.00 / 126 (73.0%):  95%|█████████▌| 125/131 [00:16<00:00,  9.48it/s]
Average Metric: 93.00 / 127 (73.2%):  96%|█████████▌| 126/131 [00:16<00:00,  9.48it/s]
Average Metric: 93.00 / 127 (73.2%):  97%|█████████▋| 127/131 [00:16<00:00,  9.01it/s]
Average Metric: 94.00 / 128 (73.4%):  97%|█████████▋| 127/131 [00:16<00:00,  9.01it/s]
Average Metric: 95.00 / 129 (73.6%):  98%|█████████▊| 128/131 [00:16<00:00,  9.01it/s]
Average Metric: 95.00 / 129 (73.6%):  98%|█████████▊| 129/131 [00:16<00:00,  9.99it/s]
Average Metric: 96.00 / 130 (73.8%):  98%|█████████▊| 129/131 [00:16<00:00,  9.99it/s]
Average Metric: 97.00 / 131 (74.0%):  99%|█████████▉| 130/131 [00:16<00:00,  9.99it/s]
Average Metric: 97.00 / 131 (74.0%): 100%|██████████| 131/131 [00:16<00:00,  9.21it/s]
Average Metric: 97.00 / 131 (74.0%): 100%|██████████| 131/131 [00:16<00:00,  7.87it/s]
2025/04/21 09:33:23 INFO dspy.evaluate.evaluate: Average Metric: 97 / 131 (74.0%)
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/130 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 0.00 / 1 (0.0%):   0%|          | 0/130 [00:01<?, ?it/s]
Average Metric: 0.00 / 1 (0.0%):   1%|          | 1/130 [00:01<03:32,  1.65s/it]
Average Metric: 0.00 / 2 (0.0%):   1%|          | 1/130 [00:01<03:32,  1.65s/it]
Average Metric: 1.00 / 3 (33.3%):   2%|▏         | 2/130 [00:01<03:31,  1.65s/it]
Average Metric: 2.00 / 4 (50.0%):   2%|▏         | 3/130 [00:01<03:29,  1.65s/it]
Average Metric: 3.00 / 5 (60.0%):   3%|▎         | 4/130 [00:01<03:27,  1.65s/it]
Average Metric: 3.00 / 6 (50.0%):   4%|▍         | 5/130 [00:01<03:26,  1.65s/it]
Average Metric: 4.00 / 7 (57.1%):   5%|▍         | 6/130 [00:01<03:24,  1.65s/it]
Average Metric: 5.00 / 8 (62.5%):   5%|▌         | 7/130 [00:01<03:22,  1.65s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 9 (66.7%):   6%|▌         | 8/130 [00:01<03:21,  1.65s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 10 (60.0%):   7%|▋         | 9/130 [00:02<03:19,  1.65s/it]
Average Metric: 6.00 / 10 (60.0%):   8%|▊         | 10/130 [00:02<00:28,  4.21it/s]
Average Metric: 7.00 / 11 (63.6%):   8%|▊         | 10/130 [00:02<00:28,  4.21it/s]
Average Metric: 7.00 / 12 (58.3%):   8%|▊         | 11/130 [00:02<00:28,  4.21it/s]
Average Metric: 7.00 / 13 (53.8%):   9%|▉         | 12/130 [00:02<00:28,  4.21it/s]
Average Metric: 8.00 / 14 (57.1%):  10%|█         | 13/130 [00:02<00:27,  4.21it/s]
Average Metric: 9.00 / 15 (60.0%):  11%|█         | 14/130 [00:02<00:27,  4.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 16 (62.5%):  12%|█▏        | 15/130 [00:02<00:27,  4.21it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 11.00 / 17 (64.7%):  12%|█▏        | 16/130 [00:03<00:27,  4.21it/s]
Average Metric: 11.00 / 17 (64.7%):  13%|█▎        | 17/130 [00:03<00:20,  5.56it/s]
Average Metric: 12.00 / 18 (66.7%):  13%|█▎        | 17/130 [00:03<00:20,  5.56it/s]
Average Metric: 13.00 / 19 (68.4%):  14%|█▍        | 18/130 [00:03<00:20,  5.56it/s]
Average Metric: 13.00 / 20 (65.0%):  15%|█▍        | 19/130 [00:03<00:19,  5.56it/s]
Average Metric: 14.00 / 21 (66.7%):  15%|█▌        | 20/130 [00:03<00:19,  5.56it/s]
Average Metric: 14.00 / 22 (63.6%):  16%|█▌        | 21/130 [00:03<00:19,  5.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 23 (65.2%):  17%|█▋        | 22/130 [00:03<00:19,  5.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 15.00 / 24 (62.5%):  18%|█▊        | 23/130 [00:04<00:19,  5.56it/s]
Average Metric: 15.00 / 24 (62.5%):  18%|█▊        | 24/130 [00:04<00:14,  7.35it/s]
Average Metric: 15.00 / 25 (60.0%):  18%|█▊        | 24/130 [00:04<00:14,  7.35it/s]
Average Metric: 16.00 / 26 (61.5%):  19%|█▉        | 25/130 [00:04<00:14,  7.35it/s]
Average Metric: 16.00 / 27 (59.3%):  20%|██        | 26/130 [00:04<00:14,  7.35it/s]
Average Metric: 16.00 / 28 (57.1%):  21%|██        | 27/130 [00:04<00:14,  7.35it/s]
Average Metric: 17.00 / 29 (58.6%):  22%|██▏       | 28/130 [00:04<00:13,  7.35it/s]
Average Metric: 18.00 / 30 (60.0%):  22%|██▏       | 29/130 [00:04<00:13,  7.35it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 18.00 / 31 (58.1%):  23%|██▎       | 30/130 [00:05<00:13,  7.35it/s]
Average Metric: 18.00 / 31 (58.1%):  24%|██▍       | 31/130 [00:05<00:14,  6.94it/s]
Average Metric: 18.00 / 32 (56.2%):  24%|██▍       | 31/130 [00:05<00:14,  6.94it/s]
Average Metric: 19.00 / 33 (57.6%):  25%|██▍       | 32/130 [00:05<00:14,  6.94it/s]
Average Metric: 19.00 / 34 (55.9%):  25%|██▌       | 33/130 [00:05<00:13,  6.94it/s]
Average Metric: 20.00 / 35 (57.1%):  26%|██▌       | 34/130 [00:05<00:13,  6.94it/s]
Average Metric: 20.00 / 36 (55.6%):  27%|██▋       | 35/130 [00:05<00:13,  6.94it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 20.00 / 37 (54.1%):  28%|██▊       | 36/130 [00:05<00:13,  6.94it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 20.00 / 38 (52.6%):  28%|██▊       | 37/130 [00:05<00:13,  6.94it/s]
Average Metric: 20.00 / 38 (52.6%):  29%|██▉       | 38/130 [00:05<00:11,  7.97it/s]
Average Metric: 20.00 / 39 (51.3%):  29%|██▉       | 38/130 [00:05<00:11,  7.97it/s]
Average Metric: 20.00 / 40 (50.0%):  30%|███       | 39/130 [00:05<00:11,  7.97it/s]
Average Metric: 20.00 / 41 (48.8%):  31%|███       | 40/130 [00:05<00:11,  7.97it/s]
Average Metric: 20.00 / 42 (47.6%):  32%|███▏      | 41/130 [00:05<00:11,  7.97it/s]
Average Metric: 21.00 / 43 (48.8%):  32%|███▏      | 42/130 [00:05<00:11,  7.97it/s]
Average Metric: 21.00 / 44 (47.7%):  33%|███▎      | 43/130 [00:05<00:10,  7.97it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 21.00 / 45 (46.7%):  34%|███▍      | 44/130 [00:06<00:10,  7.97it/s]
Average Metric: 21.00 / 45 (46.7%):  35%|███▍      | 45/130 [00:06<00:10,  8.23it/s]
Average Metric: 22.00 / 46 (47.8%):  35%|███▍      | 45/130 [00:06<00:10,  8.23it/s]
Average Metric: 22.00 / 47 (46.8%):  35%|███▌      | 46/130 [00:06<00:10,  8.23it/s]
Average Metric: 22.00 / 48 (45.8%):  36%|███▌      | 47/130 [00:06<00:10,  8.23it/s]
Average Metric: 22.00 / 49 (44.9%):  37%|███▋      | 48/130 [00:06<00:09,  8.23it/s]
Average Metric: 23.00 / 50 (46.0%):  38%|███▊      | 49/130 [00:06<00:09,  8.23it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 24.00 / 51 (47.1%):  38%|███▊      | 50/130 [00:06<00:09,  8.23it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 25.00 / 52 (48.1%):  39%|███▉      | 51/130 [00:07<00:09,  8.23it/s]
Average Metric: 25.00 / 52 (48.1%):  40%|████      | 52/130 [00:07<00:09,  8.44it/s]
Average Metric: 26.00 / 53 (49.1%):  40%|████      | 52/130 [00:07<00:09,  8.44it/s]
Average Metric: 27.00 / 54 (50.0%):  41%|████      | 53/130 [00:07<00:09,  8.44it/s]
Average Metric: 28.00 / 55 (50.9%):  42%|████▏     | 54/130 [00:07<00:09,  8.44it/s]
Average Metric: 28.00 / 56 (50.0%):  42%|████▏     | 55/130 [00:07<00:08,  8.44it/s]
Average Metric: 28.00 / 57 (49.1%):  43%|████▎     | 56/130 [00:07<00:08,  8.44it/s]
Average Metric: 28.00 / 58 (48.3%):  44%|████▍     | 57/130 [00:07<00:08,  8.44it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 28.00 / 59 (47.5%):  45%|████▍     | 58/130 [00:08<00:08,  8.44it/s]
Average Metric: 28.00 / 59 (47.5%):  45%|████▌     | 59/130 [00:08<00:08,  8.51it/s]
Average Metric: 29.00 / 60 (48.3%):  45%|████▌     | 59/130 [00:08<00:08,  8.51it/s]
Average Metric: 30.00 / 61 (49.2%):  46%|████▌     | 60/130 [00:08<00:08,  8.51it/s]
Average Metric: 30.00 / 62 (48.4%):  47%|████▋     | 61/130 [00:08<00:08,  8.51it/s]
Average Metric: 31.00 / 63 (49.2%):  48%|████▊     | 62/130 [00:08<00:07,  8.51it/s]
Average Metric: 31.00 / 64 (48.4%):  48%|████▊     | 63/130 [00:08<00:07,  8.51it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 32.00 / 65 (49.2%):  49%|████▉     | 64/130 [00:08<00:07,  8.51it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 33.00 / 66 (50.0%):  50%|█████     | 65/130 [00:09<00:07,  8.51it/s]
Average Metric: 33.00 / 66 (50.0%):  51%|█████     | 66/130 [00:09<00:07,  8.87it/s]
Average Metric: 34.00 / 67 (50.7%):  51%|█████     | 66/130 [00:09<00:07,  8.87it/s]
Average Metric: 35.00 / 68 (51.5%):  52%|█████▏    | 67/130 [00:09<00:07,  8.87it/s]
Average Metric: 35.00 / 69 (50.7%):  52%|█████▏    | 68/130 [00:09<00:06,  8.87it/s]
Average Metric: 35.00 / 70 (50.0%):  53%|█████▎    | 69/130 [00:09<00:06,  8.87it/s]
Average Metric: 35.00 / 71 (49.3%):  54%|█████▍    | 70/130 [00:09<00:06,  8.87it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 35.00 / 72 (48.6%):  55%|█████▍    | 71/130 [00:09<00:06,  8.87it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 73 (49.3%):  55%|█████▌    | 72/130 [00:09<00:06,  8.87it/s]
Average Metric: 36.00 / 73 (49.3%):  56%|█████▌    | 73/130 [00:09<00:06,  8.85it/s]
Average Metric: 37.00 / 74 (50.0%):  56%|█████▌    | 73/130 [00:09<00:06,  8.85it/s]
Average Metric: 37.00 / 75 (49.3%):  57%|█████▋    | 74/130 [00:09<00:06,  8.85it/s]
Average Metric: 37.00 / 76 (48.7%):  58%|█████▊    | 75/130 [00:09<00:06,  8.85it/s]
Average Metric: 38.00 / 77 (49.4%):  58%|█████▊    | 76/130 [00:09<00:06,  8.85it/s]
Average Metric: 39.00 / 78 (50.0%):  59%|█████▉    | 77/130 [00:09<00:05,  8.85it/s]
Average Metric: 40.00 / 79 (50.6%):  60%|██████    | 78/130 [00:09<00:05,  8.85it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 41.00 / 80 (51.2%):  61%|██████    | 79/130 [00:10<00:05,  8.85it/s]
Average Metric: 41.00 / 80 (51.2%):  62%|██████▏   | 80/130 [00:10<00:05,  9.30it/s]
Average Metric: 41.00 / 81 (50.6%):  62%|██████▏   | 80/130 [00:10<00:05,  9.30it/s]
Average Metric: 42.00 / 82 (51.2%):  62%|██████▏   | 81/130 [00:10<00:05,  9.30it/s]
Average Metric: 42.00 / 83 (50.6%):  63%|██████▎   | 82/130 [00:10<00:05,  9.30it/s]
Average Metric: 43.00 / 84 (51.2%):  64%|██████▍   | 83/130 [00:10<00:05,  9.30it/s]
Average Metric: 44.00 / 85 (51.8%):  65%|██████▍   | 84/130 [00:10<00:04,  9.30it/s]
Average Metric: 44.00 / 86 (51.2%):  65%|██████▌   | 85/130 [00:10<00:04,  9.30it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 44.00 / 87 (50.6%):  66%|██████▌   | 86/130 [00:11<00:04,  9.30it/s]
Average Metric: 44.00 / 87 (50.6%):  67%|██████▋   | 87/130 [00:11<00:04,  9.29it/s]
Average Metric: 45.00 / 88 (51.1%):  67%|██████▋   | 87/130 [00:11<00:04,  9.29it/s]
Average Metric: 46.00 / 89 (51.7%):  68%|██████▊   | 88/130 [00:11<00:04,  9.29it/s]
Average Metric: 47.00 / 90 (52.2%):  68%|██████▊   | 89/130 [00:11<00:04,  9.29it/s]
Average Metric: 47.00 / 91 (51.6%):  69%|██████▉   | 90/130 [00:11<00:04,  9.29it/s]
Average Metric: 48.00 / 92 (52.2%):  70%|███████   | 91/130 [00:11<00:04,  9.29it/s]
Average Metric: 48.00 / 93 (51.6%):  71%|███████   | 92/130 [00:11<00:04,  9.29it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 49.00 / 94 (52.1%):  72%|███████▏  | 93/130 [00:12<00:03,  9.29it/s]
Average Metric: 49.00 / 94 (52.1%):  72%|███████▏  | 94/130 [00:12<00:03,  9.01it/s]
Average Metric: 50.00 / 95 (52.6%):  72%|███████▏  | 94/130 [00:12<00:03,  9.01it/s]
Average Metric: 50.00 / 96 (52.1%):  73%|███████▎  | 95/130 [00:12<00:03,  9.01it/s]
Average Metric: 51.00 / 97 (52.6%):  74%|███████▍  | 96/130 [00:12<00:03,  9.01it/s]
Average Metric: 52.00 / 98 (53.1%):  75%|███████▍  | 97/130 [00:12<00:03,  9.01it/s]
Average Metric: 53.00 / 99 (53.5%):  75%|███████▌  | 98/130 [00:12<00:03,  9.01it/s]
Average Metric: 54.00 / 100 (54.0%):  76%|███████▌  | 99/130 [00:12<00:03,  9.01it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 55.00 / 101 (54.5%):  77%|███████▋  | 100/130 [00:13<00:03,  9.01it/s]
Average Metric: 55.00 / 101 (54.5%):  78%|███████▊  | 101/130 [00:13<00:03,  8.24it/s]
Average Metric: 56.00 / 102 (54.9%):  78%|███████▊  | 101/130 [00:13<00:03,  8.24it/s]
Average Metric: 57.00 / 103 (55.3%):  78%|███████▊  | 102/130 [00:13<00:03,  8.24it/s]
Average Metric: 58.00 / 104 (55.8%):  79%|███████▉  | 103/130 [00:13<00:03,  8.24it/s]
Average Metric: 59.00 / 105 (56.2%):  80%|████████  | 104/130 [00:13<00:03,  8.24it/s]
Average Metric: 60.00 / 106 (56.6%):  81%|████████  | 105/130 [00:13<00:03,  8.24it/s]
Average Metric: 61.00 / 107 (57.0%):  82%|████████▏ | 106/130 [00:13<00:02,  8.24it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 62.00 / 108 (57.4%):  82%|████████▏ | 107/130 [00:13<00:02,  8.24it/s]
Average Metric: 62.00 / 108 (57.4%):  83%|████████▎ | 108/130 [00:13<00:02,  9.84it/s]
Average Metric: 63.00 / 109 (57.8%):  83%|████████▎ | 108/130 [00:13<00:02,  9.84it/s]
Average Metric: 64.00 / 110 (58.2%):  84%|████████▍ | 109/130 [00:13<00:02,  9.84it/s]
Average Metric: 64.00 / 111 (57.7%):  85%|████████▍ | 110/130 [00:13<00:02,  9.84it/s]
Average Metric: 64.00 / 112 (57.1%):  85%|████████▌ | 111/130 [00:13<00:01,  9.84it/s]
Average Metric: 65.00 / 113 (57.5%):  86%|████████▌ | 112/130 [00:13<00:01,  9.84it/s]
Average Metric: 66.00 / 114 (57.9%):  87%|████████▋ | 113/130 [00:13<00:01,  9.84it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 66.00 / 115 (57.4%):  88%|████████▊ | 114/130 [00:13<00:01,  9.84it/s]
Average Metric: 66.00 / 115 (57.4%):  88%|████████▊ | 115/130 [00:13<00:01, 11.34it/s]
Average Metric: 66.00 / 116 (56.9%):  88%|████████▊ | 115/130 [00:13<00:01, 11.34it/s]
Average Metric: 67.00 / 117 (57.3%):  89%|████████▉ | 116/130 [00:13<00:01, 11.34it/s]
Average Metric: 68.00 / 118 (57.6%):  90%|█████████ | 117/130 [00:13<00:01, 11.34it/s]
Average Metric: 68.00 / 119 (57.1%):  91%|█████████ | 118/130 [00:14<00:01, 11.34it/s]
Average Metric: 68.00 / 119 (57.1%):  92%|█████████▏| 119/130 [00:14<00:00, 12.51it/s]
Average Metric: 69.00 / 120 (57.5%):  92%|█████████▏| 119/130 [00:14<00:00, 12.51it/s]
Average Metric: 69.00 / 121 (57.0%):  92%|█████████▏| 120/130 [00:14<00:00, 12.51it/s]
Average Metric: 69.00 / 121 (57.0%):  93%|█████████▎| 121/130 [00:14<00:00, 10.69it/s]
Average Metric: 69.00 / 122 (56.6%):  93%|█████████▎| 121/130 [00:14<00:00, 10.69it/s]
Average Metric: 70.00 / 123 (56.9%):  94%|█████████▍| 122/130 [00:14<00:00, 10.69it/s]
Average Metric: 70.00 / 123 (56.9%):  95%|█████████▍| 123/130 [00:14<00:00, 10.56it/s]
Average Metric: 71.00 / 124 (57.3%):  95%|█████████▍| 123/130 [00:14<00:00, 10.56it/s]
Average Metric: 72.00 / 125 (57.6%):  95%|█████████▌| 124/130 [00:14<00:00, 10.56it/s]
Average Metric: 72.00 / 125 (57.6%):  96%|█████████▌| 125/130 [00:14<00:00, 10.26it/s]
Average Metric: 73.00 / 126 (57.9%):  96%|█████████▌| 125/130 [00:14<00:00, 10.26it/s]
Average Metric: 74.00 / 127 (58.3%):  97%|█████████▋| 126/130 [00:15<00:00, 10.26it/s]
Average Metric: 74.00 / 127 (58.3%):  98%|█████████▊| 127/130 [00:15<00:00,  9.58it/s]
Average Metric: 75.00 / 128 (58.6%):  98%|█████████▊| 127/130 [00:15<00:00,  9.58it/s]
Average Metric: 75.00 / 129 (58.1%):  98%|█████████▊| 128/130 [00:15<00:00,  9.58it/s]
Average Metric: 75.00 / 129 (58.1%):  99%|█████████▉| 129/130 [00:15<00:00,  8.20it/s]
Average Metric: 76.00 / 130 (58.5%):  99%|█████████▉| 129/130 [00:15<00:00,  8.20it/s]
Average Metric: 76.00 / 130 (58.5%): 100%|██████████| 130/130 [00:15<00:00,  8.35it/s]
2025/04/21 09:33:40 INFO dspy.evaluate.evaluate: Average Metric: 76 / 130 (58.5%)
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

  0%|          | 0/131 [00:00<?, ?it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 1.00 / 1 (100.0%):   0%|          | 0/131 [00:01<?, ?it/s]
Average Metric: 1.00 / 1 (100.0%):   1%|          | 1/131 [00:01<02:58,  1.37s/it]
Average Metric: 1.00 / 2 (50.0%):   1%|          | 1/131 [00:01<02:58,  1.37s/it] 
Average Metric: 2.00 / 3 (66.7%):   2%|▏         | 2/131 [00:01<02:57,  1.37s/it]
Average Metric: 3.00 / 4 (75.0%):   2%|▏         | 3/131 [00:01<02:55,  1.37s/it]
Average Metric: 4.00 / 5 (80.0%):   3%|▎         | 4/131 [00:01<02:54,  1.37s/it]
Average Metric: 5.00 / 6 (83.3%):   4%|▍         | 5/131 [00:01<02:52,  1.37s/it]
Average Metric: 5.00 / 7 (71.4%):   5%|▍         | 6/131 [00:01<02:51,  1.37s/it]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 6.00 / 8 (75.0%):   5%|▌         | 7/131 [00:02<02:50,  1.37s/it]
Average Metric: 6.00 / 8 (75.0%):   6%|▌         | 8/131 [00:02<00:26,  4.73it/s]
Average Metric: 6.00 / 9 (66.7%):   6%|▌         | 8/131 [00:02<00:26,  4.73it/s]
Average Metric: 7.00 / 10 (70.0%):   7%|▋         | 9/131 [00:02<00:25,  4.73it/s]
Average Metric: 7.00 / 11 (63.6%):   8%|▊         | 10/131 [00:02<00:25,  4.73it/s]
Average Metric: 8.00 / 12 (66.7%):   8%|▊         | 11/131 [00:02<00:25,  4.73it/s]
Average Metric: 9.00 / 13 (69.2%):   9%|▉         | 12/131 [00:02<00:25,  4.73it/s]
Average Metric: 9.00 / 14 (64.3%):  10%|▉         | 13/131 [00:02<00:24,  4.73it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 10.00 / 15 (66.7%):  11%|█         | 14/131 [00:02<00:24,  4.73it/s]
Average Metric: 10.00 / 15 (66.7%):  11%|█▏        | 15/131 [00:02<00:19,  6.10it/s]
Average Metric: 11.00 / 16 (68.8%):  11%|█▏        | 15/131 [00:02<00:19,  6.10it/s]
Average Metric: 12.00 / 17 (70.6%):  12%|█▏        | 16/131 [00:02<00:18,  6.10it/s]
Average Metric: 12.00 / 18 (66.7%):  13%|█▎        | 17/131 [00:02<00:18,  6.10it/s]
Average Metric: 12.00 / 19 (63.2%):  14%|█▎        | 18/131 [00:02<00:18,  6.10it/s]
Average Metric: 12.00 / 20 (60.0%):  15%|█▍        | 19/131 [00:02<00:18,  6.10it/s]
Average Metric: 13.00 / 21 (61.9%):  15%|█▌        | 20/131 [00:02<00:18,  6.10it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 14.00 / 22 (63.6%):  16%|█▌        | 21/131 [00:03<00:18,  6.10it/s]
Average Metric: 14.00 / 22 (63.6%):  17%|█▋        | 22/131 [00:03<00:15,  7.23it/s]
Average Metric: 14.00 / 23 (60.9%):  17%|█▋        | 22/131 [00:03<00:15,  7.23it/s]
Average Metric: 15.00 / 24 (62.5%):  18%|█▊        | 23/131 [00:03<00:14,  7.23it/s]
Average Metric: 16.00 / 25 (64.0%):  18%|█▊        | 24/131 [00:03<00:14,  7.23it/s]
Average Metric: 16.00 / 26 (61.5%):  19%|█▉        | 25/131 [00:03<00:14,  7.23it/s]
Average Metric: 16.00 / 27 (59.3%):  20%|█▉        | 26/131 [00:03<00:14,  7.23it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 17.00 / 28 (60.7%):  21%|██        | 27/131 [00:03<00:14,  7.23it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 18.00 / 29 (62.1%):  21%|██▏       | 28/131 [00:04<00:14,  7.23it/s]
Average Metric: 18.00 / 29 (62.1%):  22%|██▏       | 29/131 [00:04<00:13,  7.62it/s]
Average Metric: 19.00 / 30 (63.3%):  22%|██▏       | 29/131 [00:04<00:13,  7.62it/s]
Average Metric: 20.00 / 31 (64.5%):  23%|██▎       | 30/131 [00:04<00:13,  7.62it/s]
Average Metric: 21.00 / 32 (65.6%):  24%|██▎       | 31/131 [00:04<00:13,  7.62it/s]
Average Metric: 21.00 / 33 (63.6%):  24%|██▍       | 32/131 [00:04<00:12,  7.62it/s]
Average Metric: 21.00 / 34 (61.8%):  25%|██▌       | 33/131 [00:04<00:12,  7.62it/s]
Average Metric: 22.00 / 35 (62.9%):  26%|██▌       | 34/131 [00:04<00:12,  7.62it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 22.00 / 36 (61.1%):  27%|██▋       | 35/131 [00:05<00:12,  7.62it/s]
Average Metric: 22.00 / 36 (61.1%):  27%|██▋       | 36/131 [00:05<00:10,  9.16it/s]
Average Metric: 23.00 / 37 (62.2%):  27%|██▋       | 36/131 [00:05<00:10,  9.16it/s]
Average Metric: 24.00 / 38 (63.2%):  28%|██▊       | 37/131 [00:05<00:10,  9.16it/s]
Average Metric: 24.00 / 39 (61.5%):  29%|██▉       | 38/131 [00:05<00:10,  9.16it/s]
Average Metric: 25.00 / 40 (62.5%):  30%|██▉       | 39/131 [00:05<00:10,  9.16it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 25.00 / 41 (61.0%):  31%|███       | 40/131 [00:05<00:09,  9.16it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 42 (61.9%):  31%|███▏      | 41/131 [00:05<00:09,  9.16it/s]
Average Metric: 26.00 / 42 (61.9%):  32%|███▏      | 42/131 [00:05<00:08, 10.97it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 26.00 / 43 (60.5%):  32%|███▏      | 42/131 [00:06<00:08, 10.97it/s]
Average Metric: 26.00 / 44 (59.1%):  33%|███▎      | 43/131 [00:06<00:08, 10.97it/s]
Average Metric: 26.00 / 44 (59.1%):  34%|███▎      | 44/131 [00:06<00:11,  7.64it/s]
Average Metric: 27.00 / 45 (60.0%):  34%|███▎      | 44/131 [00:06<00:11,  7.64it/s]
Average Metric: 28.00 / 46 (60.9%):  34%|███▍      | 45/131 [00:06<00:11,  7.64it/s]
Average Metric: 29.00 / 47 (61.7%):  35%|███▌      | 46/131 [00:06<00:11,  7.64it/s]
Average Metric: 29.00 / 48 (60.4%):  36%|███▌      | 47/131 [00:06<00:10,  7.64it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 29.00 / 49 (59.2%):  37%|███▋      | 48/131 [00:06<00:10,  7.64it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 30.00 / 50 (60.0%):  37%|███▋      | 49/131 [00:06<00:10,  7.64it/s]
Average Metric: 30.00 / 50 (60.0%):  38%|███▊      | 50/131 [00:06<00:10,  7.87it/s]
Average Metric: 30.00 / 51 (58.8%):  38%|███▊      | 50/131 [00:06<00:10,  7.87it/s]
Average Metric: 30.00 / 52 (57.7%):  39%|███▉      | 51/131 [00:06<00:10,  7.87it/s]
Average Metric: 30.00 / 53 (56.6%):  40%|███▉      | 52/131 [00:06<00:10,  7.87it/s]
Average Metric: 31.00 / 54 (57.4%):  40%|████      | 53/131 [00:06<00:09,  7.87it/s]
Average Metric: 31.00 / 55 (56.4%):  41%|████      | 54/131 [00:06<00:09,  7.87it/s]
Average Metric: 31.00 / 56 (55.4%):  42%|████▏     | 55/131 [00:06<00:09,  7.87it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 31.00 / 57 (54.4%):  43%|████▎     | 56/131 [00:07<00:09,  7.87it/s]
Average Metric: 31.00 / 57 (54.4%):  44%|████▎     | 57/131 [00:07<00:08,  8.56it/s]
Average Metric: 32.00 / 58 (55.2%):  44%|████▎     | 57/131 [00:07<00:08,  8.56it/s]
Average Metric: 33.00 / 59 (55.9%):  44%|████▍     | 58/131 [00:07<00:08,  8.56it/s]
Average Metric: 34.00 / 60 (56.7%):  45%|████▌     | 59/131 [00:07<00:08,  8.56it/s]
Average Metric: 35.00 / 61 (57.4%):  46%|████▌     | 60/131 [00:07<00:08,  8.56it/s]
Average Metric: 35.00 / 62 (56.5%):  47%|████▋     | 61/131 [00:07<00:08,  8.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 63 (57.1%):  47%|████▋     | 62/131 [00:07<00:08,  8.56it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 36.00 / 64 (56.2%):  48%|████▊     | 63/131 [00:08<00:07,  8.56it/s]
Average Metric: 36.00 / 64 (56.2%):  49%|████▉     | 64/131 [00:08<00:08,  8.19it/s]
Average Metric: 37.00 / 65 (56.9%):  49%|████▉     | 64/131 [00:08<00:08,  8.19it/s]
Average Metric: 37.00 / 66 (56.1%):  50%|████▉     | 65/131 [00:08<00:08,  8.19it/s]
Average Metric: 37.00 / 67 (55.2%):  50%|█████     | 66/131 [00:08<00:07,  8.19it/s]
Average Metric: 38.00 / 68 (55.9%):  51%|█████     | 67/131 [00:08<00:07,  8.19it/s]
Average Metric: 39.00 / 69 (56.5%):  52%|█████▏    | 68/131 [00:08<00:07,  8.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 70 (57.1%):  53%|█████▎    | 69/131 [00:08<00:07,  8.19it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 40.00 / 71 (56.3%):  53%|█████▎    | 70/131 [00:09<00:07,  8.19it/s]
Average Metric: 40.00 / 71 (56.3%):  54%|█████▍    | 71/131 [00:09<00:06,  8.76it/s]
Average Metric: 40.00 / 72 (55.6%):  54%|█████▍    | 71/131 [00:09<00:06,  8.76it/s]
Average Metric: 41.00 / 73 (56.2%):  55%|█████▍    | 72/131 [00:09<00:06,  8.76it/s]
Average Metric: 42.00 / 74 (56.8%):  56%|█████▌    | 73/131 [00:09<00:06,  8.76it/s]
Average Metric: 42.00 / 75 (56.0%):  56%|█████▋    | 74/131 [00:09<00:06,  8.76it/s]
Average Metric: 43.00 / 76 (56.6%):  57%|█████▋    | 75/131 [00:09<00:06,  8.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 43.00 / 77 (55.8%):  58%|█████▊    | 76/131 [00:09<00:06,  8.76it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 43.00 / 78 (55.1%):  59%|█████▉    | 77/131 [00:09<00:06,  8.76it/s]
Average Metric: 43.00 / 78 (55.1%):  60%|█████▉    | 78/131 [00:09<00:05,  9.48it/s]
Average Metric: 43.00 / 79 (54.4%):  60%|█████▉    | 78/131 [00:09<00:05,  9.48it/s]
Average Metric: 43.00 / 80 (53.8%):  60%|██████    | 79/131 [00:09<00:05,  9.48it/s]
Average Metric: 44.00 / 81 (54.3%):  61%|██████    | 80/131 [00:09<00:05,  9.48it/s]
Average Metric: 44.00 / 82 (53.7%):  62%|██████▏   | 81/131 [00:09<00:05,  9.48it/s]
Average Metric: 45.00 / 83 (54.2%):  63%|██████▎   | 82/131 [00:09<00:05,  9.48it/s]
Average Metric: 46.00 / 84 (54.8%):  63%|██████▎   | 83/131 [00:09<00:05,  9.48it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 47.00 / 85 (55.3%):  64%|██████▍   | 84/131 [00:10<00:04,  9.48it/s]
Average Metric: 47.00 / 85 (55.3%):  65%|██████▍   | 85/131 [00:10<00:05,  8.91it/s]
Average Metric: 48.00 / 86 (55.8%):  65%|██████▍   | 85/131 [00:10<00:05,  8.91it/s]
Average Metric: 48.00 / 87 (55.2%):  66%|██████▌   | 86/131 [00:10<00:05,  8.91it/s]
Average Metric: 49.00 / 88 (55.7%):  66%|██████▋   | 87/131 [00:10<00:04,  8.91it/s]
Average Metric: 49.00 / 89 (55.1%):  67%|██████▋   | 88/131 [00:10<00:04,  8.91it/s]
Average Metric: 50.00 / 90 (55.6%):  68%|██████▊   | 89/131 [00:10<00:04,  8.91it/s]
Average Metric: 51.00 / 91 (56.0%):  69%|██████▊   | 90/131 [00:10<00:04,  8.91it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 51.00 / 92 (55.4%):  69%|██████▉   | 91/131 [00:11<00:04,  8.91it/s]
Average Metric: 51.00 / 92 (55.4%):  70%|███████   | 92/131 [00:11<00:04,  9.39it/s]
Average Metric: 52.00 / 93 (55.9%):  70%|███████   | 92/131 [00:11<00:04,  9.39it/s]
Average Metric: 53.00 / 94 (56.4%):  71%|███████   | 93/131 [00:11<00:04,  9.39it/s]
Average Metric: 54.00 / 95 (56.8%):  72%|███████▏  | 94/131 [00:11<00:03,  9.39it/s]
Average Metric: 54.00 / 96 (56.2%):  73%|███████▎  | 95/131 [00:11<00:03,  9.39it/s]
Average Metric: 54.00 / 97 (55.7%):  73%|███████▎  | 96/131 [00:11<00:03,  9.39it/s]
Average Metric: 55.00 / 98 (56.1%):  74%|███████▍  | 97/131 [00:11<00:03,  9.39it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 55.00 / 99 (55.6%):  75%|███████▍  | 98/131 [00:12<00:03,  9.39it/s]
Average Metric: 55.00 / 99 (55.6%):  76%|███████▌  | 99/131 [00:12<00:03,  9.27it/s]
Average Metric: 56.00 / 100 (56.0%):  76%|███████▌  | 99/131 [00:12<00:03,  9.27it/s]
Average Metric: 57.00 / 101 (56.4%):  76%|███████▋  | 100/131 [00:12<00:03,  9.27it/s]
Average Metric: 58.00 / 102 (56.9%):  77%|███████▋  | 101/131 [00:12<00:03,  9.27it/s]
Average Metric: 59.00 / 103 (57.3%):  78%|███████▊  | 102/131 [00:12<00:03,  9.27it/s]
Average Metric: 60.00 / 104 (57.7%):  79%|███████▊  | 103/131 [00:12<00:03,  9.27it/s]
Average Metric: 60.00 / 105 (57.1%):  79%|███████▉  | 104/131 [00:12<00:02,  9.27it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 61.00 / 106 (57.5%):  80%|████████  | 105/131 [00:12<00:02,  9.27it/s]
Average Metric: 61.00 / 106 (57.5%):  81%|████████  | 106/131 [00:12<00:02,  9.91it/s]
Average Metric: 62.00 / 107 (57.9%):  81%|████████  | 106/131 [00:12<00:02,  9.91it/s]
Average Metric: 63.00 / 108 (58.3%):  82%|████████▏ | 107/131 [00:12<00:02,  9.91it/s]
Average Metric: 63.00 / 109 (57.8%):  82%|████████▏ | 108/131 [00:12<00:02,  9.91it/s]
Average Metric: 63.00 / 110 (57.3%):  83%|████████▎ | 109/131 [00:12<00:02,  9.91it/s]
Average Metric: 64.00 / 111 (57.7%):  84%|████████▍ | 110/131 [00:12<00:02,  9.91it/s]
Average Metric: 65.00 / 112 (58.0%):  85%|████████▍ | 111/131 [00:12<00:02,  9.91it/s]/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()
/Users/rajsiba/miniconda3/envs/fmcore/lib/python3.11/site-packages/aiolimiter/leakybucket.py:102: RuntimeWarning: This AsyncLimiter instance is being re-used across loops. Please create a new limiter per event loop as re-use can lead to undefined behaviour.
  _warn_reuse()

Average Metric: 65.00 / 113 (57.5%):  85%|████████▌ | 112/131 [00:13<00:01,  9.91it/s]
Average Metric: 65.00 / 113 (57.5%):  86%|████████▋ | 113/131 [00:13<00:01, 10.68it/s]
Average Metric: 65.00 / 114 (57.0%):  86%|████████▋ | 113/131 [00:13<00:01, 10.68it/s]
Average Metric: 65.00 / 115 (56.5%):  87%|████████▋ | 114/131 [00:13<00:01, 10.68it/s]
Average Metric: 65.00 / 116 (56.0%):  88%|████████▊ | 115/131 [00:13<00:01, 10.68it/s]
Average Metric: 66.00 / 117 (56.4%):  89%|████████▊ | 116/131 [00:13<00:01, 10.68it/s]
Average Metric: 67.00 / 118 (56.8%):  89%|████████▉ | 117/131 [00:13<00:01, 10.68it/s]
Average Metric: 67.00 / 119 (56.3%):  90%|█████████ | 118/131 [00:13<00:01, 10.68it/s]
Average Metric: 67.00 / 119 (56.3%):  91%|█████████ | 119/131 [00:13<00:00, 13.67it/s]
Average Metric: 68.00 / 120 (56.7%):  91%|█████████ | 119/131 [00:13<00:00, 13.67it/s]
Average Metric: 68.00 / 121 (56.2%):  92%|█████████▏| 120/131 [00:13<00:00, 13.67it/s]
Average Metric: 69.00 / 122 (56.6%):  92%|█████████▏| 121/131 [00:13<00:00, 13.67it/s]
Average Metric: 69.00 / 122 (56.6%):  93%|█████████▎| 122/131 [00:13<00:00, 12.14it/s]
Average Metric: 69.00 / 123 (56.1%):  93%|█████████▎| 122/131 [00:13<00:00, 12.14it/s]
Average Metric: 69.00 / 124 (55.6%):  94%|█████████▍| 123/131 [00:13<00:00, 12.14it/s]
Average Metric: 69.00 / 124 (55.6%):  95%|█████████▍| 124/131 [00:13<00:00, 11.25it/s]
Average Metric: 70.00 / 125 (56.0%):  95%|█████████▍| 124/131 [00:14<00:00, 11.25it/s]
Average Metric: 70.00 / 126 (55.6%):  95%|█████████▌| 125/131 [00:14<00:00, 11.25it/s]
Average Metric: 70.00 / 126 (55.6%):  96%|█████████▌| 126/131 [00:14<00:00, 11.10it/s]
Average Metric: 71.00 / 127 (55.9%):  96%|█████████▌| 126/131 [00:14<00:00, 11.10it/s]
Average Metric: 72.00 / 128 (56.2%):  97%|█████████▋| 127/131 [00:14<00:00, 11.10it/s]
Average Metric: 72.00 / 128 (56.2%):  98%|█████████▊| 128/131 [00:14<00:00, 10.76it/s]
Average Metric: 73.00 / 129 (56.6%):  98%|█████████▊| 128/131 [00:14<00:00, 10.76it/s]
Average Metric: 74.00 / 130 (56.9%):  98%|█████████▊| 129/131 [00:14<00:00, 10.76it/s]
Average Metric: 74.00 / 130 (56.9%):  99%|█████████▉| 130/131 [00:14<00:00, 11.22it/s]
Average Metric: 74.00 / 131 (56.5%):  99%|█████████▉| 130/131 [00:14<00:00, 11.22it/s]
Average Metric: 74.00 / 131 (56.5%): 100%|██████████| 131/131 [00:14<00:00,  8.78it/s]
2025/04/21 09:33:55 INFO dspy.evaluate.evaluate: Average Metric: 74 / 131 (56.5%)
An error occurred (404) when calling the HeadObject operation: Not Found
An error occurred (404) when calling the HeadObject operation: Not Found
An error occurred (404) when calling the HeadObject operation: Not Found
An error occurred (404) when calling the HeadObject operation: Not Found
An error occurred (404) when calling the HeadObject operation: Not Found
