Bases: fireworks.utilities.fw_serializers.FWSerializable, object
Parameters: |
|
---|
Bases: fireworks.utilities.fw_serializers.FWSerializable
This serves an Abstract class for implementing Duplicate Finders
Given a spec, returns a database query that gives potential candidates for duplicated FireWorks.
Parameters: | spec – spec to check for duplicates |
---|
Method that checks whether two specs are identical enough to be considered duplicates. Return true if duplicated. :param spec1: (dict) :param spec2: (dict)
Parameters: | lpad – (LaunchPad) |
---|
Compile statistics of completed Fireworks/Workflows for past <num_intervals> <interval>, e.g. past 5 days.
Parameters: |
|
---|---|
Returns: | list, with each item being a dictionary of statistics for a given interval |
Convert the list of stats from FWReport.get_stats() to a string representation for viewing.
Parameters: | decorated_stat_list – list of dict |
---|---|
Returns: | String |
Parameters: | lpad – (LaunchPad) |
---|
Turns a list of keys (from flatten_to_keys) into a dict of <str>:count, i.e. counts the number of times each key appears :param list_keys: :param filter_truncated: :return:
Converts a dictionary into a list of keys, with string values “key1.key2:val”
Parameters: |
|
---|---|
Returns: | [<str>] |
Launch the jobs in the job packing mode. :param launchpad: (LaunchPad) object :param fworker: (FWorker) object :param loglvl: (str) level at which to output logs :param nlaunches: (int) 0 means ‘until completion’, -1 or “infinite” means to loop forever :param num_jobs: (int) number of sub jobs :param sleep_time: (int) secs to sleep between rapidfire loop iterations :param total_node_list: ([str]) contents of NODEFILE (doesn’t affect execution) :param ppn: (int) processors per node (doesn’t affect execution) :param timeout: (int) # of seconds after which to stop the rapidfire process :param exclude_current_node: Don’t use the script launching node as a compute node
A single manager to ping all launches during multiprocess launches
Parameters: |
|
---|
Initializes shared data with multiprocessing parameters and starts a rapidfire
Parameters: |
|
---|
Parse node list and processor list from nodefile contents
Parameters: |
|
---|---|
Returns: | (([int],[int])) the node list and processor list for each job |
Create each sub job and start a rocket launch in each one
Parameters: |
|
---|---|
Returns: | ([multiprocessing.Process]) all the created processes |
Object to get Fireworks running stats from a LaunchPad :param lpad: (LaunchPad) A LaunchPad object that manages the Fireworks database
Get daily summary of fireworks for a specified time range :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param time_field: (str) The field to query time range. Default is “time_end”. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) A summary of daily fireworks stats for the specified time range.
Get fireworks summary for a specified time range. :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param time_field: (str) The field to query time range. Default is “updated_on”. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) A summary of fireworks stats for the specified time range.
Get launch summary for a specified time range. :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param time_field: (str) The field to query time range. Default is “time_end”. :param query: (dict) Additional Pymongo queries to filter entries for process. :param runtime_stats: (bool) If return runtime stats. Default is False. :param include_ids: (bool) If return fw_ids. Default is False. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) A summary of launch stats for the specified time range.
Get workflow summary for a specified time range. :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param time_field: (str) The field to query time range. Default is “updated_on”. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) A summary of workflow stats for the specified time range.
Group fizzled fireworks for a specified time range by a specified key. :param group_by: (str) Database field used to group fireworks items. :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param include_ids: (bool) If return fw_ids. Default is False. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) A summary of fizzled fireworks for group by the specified key.
Get days with higher failure ratio :param error_ratio: (float) Threshold of error ratio to define as a catastrophic day :param query_start: (str) The start time (inclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is 30 days before current time. :param query_end: (str) The end time (exclusive) to query in isoformat (YYYY-MM-DDTHH:MM:SS.mmmmmm). Default is current time. :param query: (dict) Additional Pymongo queries to filter entries for process. :param time_field: (str) The field to query time range. Default is “time_end”. :param include_ids: (bool) If return fw_ids. Default is False. :param args: (dict) Time difference to calculate query_start from query_end. Accepts arguments in python datetime.timedelta function. args and query_start can not be given at the same time. Default is 30 days. :return: (list) Dates with higher failure ratio with optional failed fw_ids.