Print stats and example failures Parameters See expect.py for details summary ( n=3, print_fn=None, format_example_fn=None, n_per_testcase=3 ) ¶ Sets and updates expectation function ParametersĮxpect ( function) – Expectation function, takes an AbstractTest (self) as parameter
NARUTO ULTIMATE NINJA STORM REVOLUTION PC ADULT MOD UPDATE
Update self.results (run tests) from list of predictions and confidences Parameters Run_from_preds_confs ( preds, confs, overwrite=False ) ¶ Ignore_header ( bool) – If True, skip first line in the file Pred_and_softmax: each line has a prediction and all softmax probabilities, separated by a spaceįormat_fn ( function) – If not None, function that reads a line in the input file and outputs a tuple of (prediction, confidence) Pred_and_conf: each line has a prediction and a confidence value, separated by a space Softmax: each line has prediction probabilities separated by spacesīinary_conf: each line has the prediction probability of class 1 (binary) Update self.results (run tests) from a prediction file Parametersįile_format ( string) – None, or one of ‘pred_only’, ‘softmax’, binary_conf’, ‘pred_and_conf’, ‘pred_and_softmax’, ‘squad’,
Run_from_file ( path, file_format=None, format_fn=None, ignore_header=False, overwrite=False ) ¶ Seed ( int) – Seed to use if n is not None N ( int) – If not None, number of samples to draw Verbose ( bool) – If True, print extra information Overwrite ( bool) – If False, raise exception if results already exist Outputs a tuple (predictions, confidences) Predict_and_confidence_fn ( function) – Takes as input a list of examples Recovers a previously computed example_list_and_indices run ( predict_and_confidence_fn, overwrite=False, verbose=True, n=None, seed=None ) ¶ Also updates self.result_indexes with the second list.įail_idxs ( ) ¶ filtered_idxs ( ) ¶ form_test_info ( name=None, description=None, capability=None ) ¶ form_testcases ( n_per_testcase=3 ) ¶ static from_file ( file ) ¶ get_stats ( ) ¶ print ( xs, preds, confs, expect_results, labels=None, meta=None, format_example_fn=None, nsamples=3 ) ¶ print_stats ( ) ¶ recover_example_list_and_indices ( ) ¶
)Īlso updates n_idxs if n is not None to indicate which testcases Tuple(list, list) – First list is a list of examplesįor example, let’s say we have two testcases ( and. AbstractTest ( data, expect, labels=None, meta=None, agg_fn='all', templates=None, print_first=None, name=None, capability=None, description=None ) ¶īases: abc.ABC example_list_and_indices ( n=None, seed=None ) ¶ Checklist package ¶ Submodules ¶ checklist.abstract_test module ¶ class checklist.abstract_test.
0 kommentar(er)
