Bases: fireworks.utilities.fw_serializers.FWSerializable, object
Bases: fireworks.utilities.fw_serializers.FWSerializable
This serves an Abstract class for implementing Duplicate Finders
Given a spec, returns a database query that gives potential candidates for duplicated Fireworks.
Parameters: | spec (dict) – spec to check for duplicates |
---|
Method that checks whether two specs are identical enough to be considered duplicates. Return true if duplicated.
Args: spec1 (dict) spec2 (dict)
Returns: | bool |
---|
Compile statistics of completed Fireworks/Workflows for past <num_intervals> <interval>, e.g. past 5 days.
Parameters: | |
---|---|
Returns: | list, with each item being a dictionary of statistics for a given interval |
Convert the list of stats from FWReport.get_stats() to a string representation for viewing.
Parameters: | decorated_stat_list ([dict]) – |
---|---|
Returns: | str |
Turns a list of keys (from flatten_to_keys) into a dict of <str>:count, i.e. counts the number of times each key appears.
Parameters: |
|
---|---|
Returns: | dict |
Launch the jobs in the job packing mode.
Parameters: |
|
---|
A single manager to ping all launches during multiprocess launches
Parameters: |
|
---|
Initializes shared data with multiprocessing parameters and starts a rapidfire.
Parameters: |
|
---|
Parse node list and processor list from nodefile contents
Parameters: | |
---|---|
Returns: | (([int],[int])) the node list and processor list for each job |
Create each sub job and start a rocket launch in each one
Parameters: |
|
---|---|
Returns: | ([multiprocessing.Process]) all the created processes |
Get daily summary of fireworks for a specified time range :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param time_field: (str) The field to query time range. Default is “time_end”. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) A summary of daily fireworks stats for the specified time range.
Get fireworks summary for a specified time range.
Parameters: |
|
---|---|
Returns: | (list) A summary of fireworks stats for the specified time range. |
Get launch summary for a specified time range.
Parameters: |
|
---|---|
Returns: | (list) A summary of launch stats for the specified time range. |
Get workflow summary for a specified time range. :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param time_field: (str) The field to query time range. Default is “updated_on”. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) A summary of workflow stats for the specified time range.
Group fizzled fireworks for a specified time range by a specified key. :param group_by: (str) Database field used to group fireworks items. :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param include_ids: (bool) If return fw_ids. Default is False. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) A summary of fizzled fireworks for group by the specified key.
Get days with higher failure ratio :param error_ratio: (float) Threshold of error ratio to define as a catastrophic day :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param time_field: (str) The field to query time range. Default is “time_end”. :param include_ids: (bool) If return fw_ids. Default is False. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) Dates with higher failure ratio with optional failed fw_ids.