Commits bpm24 from gedi

README.md

@@ -5,7 +5,8 @@
 
 - [Requirements](#requirements)
 - [Installation](#installation)
-- [Usage](#usage)
+- [General Usage](#general-usage)
+- [Experiments](#experiments)
 - [References](#references)
 
 ## Requirements
@@ -22,29 +23,154 @@ conda install pyrfr swig
 ```
 ## Installation
 - `conda env create -f .conda.yml`
-- Install [Feature Extractor for Event Data (feeed)](https://github.com/lmu-dbs/feeed) in the newly installed conda environment: `pip install feeed`
 
 ### Startup
 ```console
 conda activate gedi
 python main.py -o config_files/options/baseline.json -a config_files/algorithm/experiment_test.json
 ```
-## Usage
-Our pipeline offers several pipeline steps, which can be run sequentially or partially:
-- feature_extraction
-- generation
-- benchmark
-- evaluation_plotter
+The last step should take only a few minutes to run.
 
-We also include two notebooks, which output experimental results as in our paper.
+## General Usage
+Our pipeline offers several pipeline steps, which can be run sequentially or partially ordered:
+- [Feature Extraction](#feature-extraction)
+- [Generation](#generation)
+- [Benchmark](#benchmark)
+- [Evaluation Plotter](https://github.com/lmu-dbs/gedi/blob/16-documentation-update-readme/README.md#evaluation-plotting)
 
 To run different steps of the GEDI pipeline, please adapt the `.json` accordingly.
 ```console
 conda activate gedi
-python main.py -o config_files/options/baseline.json -a config_files/algorithm/<pipeline-step>.json
+python main.py -o config_files/options/baseline.json -a config_files/algorithm/pipeline_steps/<pipeline-step>.json
 ```
 For reference of possible keys and values for each step, please see `config_files/algorithm/experiment_test.json`.
-To run the whole pipeline please create a new `.json` file, specifying all steps you want to run and specify desired keys and values for each step. 
+To run the whole pipeline please create a new `.json` file, specifying all steps you want to run and specify desired keys and values for each step.
+To reproduce results from out paper, please refer to [Experiments](#experiments).
+
+### Feature Extraction
+---
+To extract the features on the event-log level and use them for hyperparameter optimization, we employ the following script:
+```console
+conda activate gedi
+python main.py -o config_files/options/baseline.json -a config_files/algorithm/pipeline_steps/feature_extraction.json
+```
+The JSON file consists of the following key-value pairs:
+
+- pipeline_step: denotes the current step in the pipeline (here: feature_extraction)
+- input_path: folder to the input files
+- feature params: defines a dictionary, where the inner dictionary consists of a key-value pair 'feature_set' with a list of features being extracted from the references files. A list of valid features can be looked up from the FEEED extractor
+- output_path: defines the path, where plots are saved to
+- real_eventlog_path: defines the file with the features extracted from the real event logs
+- plot_type: defines the style of the output plotting (possible values: violinplot, boxplot)
+- font_size: label font size of the output plot
+- boxplot_widht: width of the violinplot/boxplot
+
+
+### Generation
+---
+After having extracted meta features from the files, the next step is to generate event log data accordingly. Generally, there are two settings on how the targets are defined: i) meta feature targets are defined by the meta features from the real event log data; ii) a configuration space is defined which resembles the feasible meta features space. 
+
+The command to execute the generation step is given by a exemplarily generation.json file:
+
+```console
+conda activate gedi
+python main.py -o config_files/options/baseline.json -a config_files/algorithm/pipeline_steps/generation.json
+```
+
+In the `generation.json`, we have the following key-value pairs:
+
+* pipeline_step: denotes the current step in the pipeline (here: event_logs_generation)
+* output_path: defines the output folder
+* generator_params: defines the configuration of the generator itself. For the generator itself, we can set values for the general 'experiment', 'config_space', 'n_trials', and a specific 'plot_reference_feature' being used for plotting
+
+    - experiment: defines the path to the input file which contains the features that are used for the optimization step. The 'objectives' define the specific features, which are the optimization criteria.
+    - config_space: here, we define the configuration of the generator module (here: process tree generator). The process tree generator can process input information which defines characteristics for the generated data (a more thorough overview of the params can be found [here](https://github.com/tjouck/PTandLogGenerator):
+
+        - mode: most frequent number of visible activities
+        - sequence: the probability of adding a sequence operator to the tree
+        - choice: the probability of adding a choice operator to the tree
+        - parallel: the probability of adding a parallel operator to the tree
+        - loop: the probability of adding a loop operator to the tree
+        - silent: probability to add silent activity to a choice or loop operator
+        - lt_dependency: the probability of adding a random dependency to the tree
+        - num_traces: the number of traces in the event log
+        - duplicate: the probability of duplicating an activity label
+        - or: probability to add an or operator to the tree
+
+    - n_trials: the maximum number of trials for the hyperparameter optimization to find a feasible solution to the specific configuration being used as the target
+
+    - plot_reference_feature: defines the feature, which is used on the x-axis on the output plots, i.e., each feature defined in the 'objectives' of the 'experiment' is plotted against the reference feature being defined in this value
+
+### Benchmark
+The benchmarking defines the downstream task which is used for evaluating the goodness of the synthesized event log datasets with the metrics of real-world datasets. The command to execute a benchmarking is shown in the following script:
+
+```console
+conda activate gedi
+python main.py -o config_files/options/baseline.json -a config_files/algorithm/pipeline_steps/benchmark.json
+```
+
+In the `benchmark.json`, we have the following key-value pairs:
+
+* pipeline_step: denotes the current step in the pipeline (here: benchmark_test)
+* benchmark_test: defines the downstream task. Currently (in v 1.0), only `discovery` for process discovery is implemented
+* input_path: defines the input folder where the synthesized event log data are stored
+* output_path: defines the output folder
+* miners: defines the miners for the downstream task 'discovery' which are used in the benchmarking. In v 1.0 the miners 'inductive' for inductive miner, 'heuristics' for heuristics miner, 'imf' for inductive miner infrequent, as well as 'ilp' for integer linear programming are implemented
+
+
+### Evaluation Plotting
+The purpose of the evaluation plotting step is used just for visualization. Some examples of how the plotter can be used is shown in the following exemplarily script:
+
+
+```console
+conda activate gedi
+python main.py -o config_files/options/baseline.json -a config_files/algorithm/pipeline_steps/evaluation_plotter.json
+```
+
+Generally, in the `evaluation_plotter.json`, we have the following key-value pairs:
+
+* pipeline_step: denotes the current step in the pipeline (here: evaluation_plotter)
+* input_path: defines the input file or the input folder which is considered for the visualizations. If a single file is specified, only the features in that file are considered whereas in the case of specifying a folder, the framework iterates over all files and uses them for plotting
+* plot_reference_feature: defines the feature that is used on the x-axis on the output plots, i.e., each feature defined in the input file is plotted against the reference feature being defined in this value
+* targets: defines the target values which are also used as reference. Likewise to the input_path, the targets can be specified by a single file or by a folder
+* output_path: defines where to store the plots
+
+## Experiments
+In this repository, experiments can be run selectively or from scratch, as preferred. For this purpose, we linked both inputs and outputs for each stage. In this section, we present the reproduction of generated event data, as in our paper, as well as the [visualization of evaluation figures](#visualizations).
+We present two settings for generating intentional event logs, using [real targets](#generating-data-with-real-targets) or using [grid targets](#generating-data-with-grid-targets). Both settings output `.xes` event logs, `.json` and `.csv` files containing feature values, as well as evaluation results, from running a [process discovery benchmark](#benchmark), for the generated event logs.
+
+### Generating data with real targets
+To execute the experiments with real targets, we employ the [experiment_real_targets.json](config_files/algorithm/experiment_real_targets.json). The script's pipeline will output the [generated event logs (GenBaselineED)](data/event_logs/GenBaselineED), which optimize their feature values towards [real-world event data features](data/BaselineED_feat.csv), alongside their respectively measured [feature values](data/GenBaselineED_feat.csv) and [benchmark metrics values](data/GenBaselineED_bench.csv).
+
+```console
+conda activate gedi
+python main.py -o config_files/options/baseline.json -a config_files/algorithm/experiment_real_targets.json
+```
+
+### Generating data with grid targets
+To execute the experiments with grid targets, a single [configuration](config_files/algorithm/grid_2obj) can be selected or all [grid objectives](data/grid_2obj) can be run with one command using the following script. This script will output the [generated event logs (GenED)](data/event_logs/GenED), alongside their respectively measured [feature values](data/GenED_feat.csv) and [benchmark metrics values](data/GenED_bench.csv).
+```
+conda activate gedi
+python execute_grid_experiments.py config_files/algorithm/grid_2obj
+```
+We employ the [experiment_grid_2obj_configfiles_fabric.ipynb](notebooks/experiment_grid_2obj_configfiles_fabric.ipynb) to create all necessary [configuration](config_files/algorithm/grid_2obj) and [objective](data/grid_2obj) files for this experiment. For more details about these config_files, please refer to [Feature Extraction](#feature-extraction), [Generation](#generation), and [Benchmark](#benchmark).
+
+### Visualizations
+To run the visualizations, we employ [jupyter notebooks](https://jupyter.org/install) and [add the installed environment to the jupyter notebook](https://medium.com/@nrk25693/how-to-add-your-conda-environment-to-your-jupyter-notebook-in-just-4-steps-abeab8b8d084). We then start all visualizations by running e.g.: `jupyter noteboook`. In the following, we describe the `.ipynb`-files in the folder `\notebooks` to reproduce the figures from our paper. 
+
+#### [Fig. 4 and fig. 5 Representativeness](notebooks/gedi_figs4and5_representativeness.ipynb)
+To visualize the coverage of the feasible feature space of generated event logs compared to existing real-world benchmark datasets, in this notebook, we conduct a principal component analysis on the features of both settings. The first two principal components are utilized to visualize the coverage which is further highlighted by computing a convex hull of the 2D mapping.  Additionally, we visualize the distribution of each meta feature we used in the paper as a boxplot. Additional features can be extracted with FEEED. Therefore, the notebook contains the figures 4 and 5 in the paper. 
+
+#### [Fig. 6 Benchmark Boxplots](notebooks/gedi_fig6_benchmark_boxplots.ipynb)
+This notebook is used to visualize the metric distribution of real event logs compared to the generated ones. It shows 5 different metrics on 3 various process discovery techniques. We use 'fitness,', 'precision', 'fscore', 'size', 'cfc' (control-flow complexity) as metrics and as 'heuristic miner', 'ilp' (integer linear programming), and 'imf' (inductive miner infrequent) as miners. The notebook outputs the visualization shown in Fig.6 in the paper.
+
+#### [Fig. 7 and fig. 8 Benchmark's Statistical Tests](notebooks/gedi_figs7and8_benchmarking_statisticalTests.ipynb)
+
+This notebook is used to answer the question if there is a statistically significant relation between feature similarity and performance metrics for the downstream tasks of process discovery. For that, we compute the pearson coefficient, as well as the kendall's tau coefficient. This elucidates the correlation between the features with metric scores being used for process discovery. Each coefficient is calculated for three different settings: i) real-world datasets; ii) synthesized event log data with real-world targets; iii) synthesized event log data with grid objectives. Figures 7 and 8 shown in the paper refer to this notebook.
+
+#### [Fig. 9 Consistency and fig. 10 Limitations](notebooks/gedi_figs9and10_consistency.ipynb)
+Likewise to the evaluation on the statistical tests in notebook `gedi_figs7and8_benchmarking_statisticalTests.ipynb`, this notebook is used to compute the differences between two correlation matrices $\Delta C = C_1 - C_2$. This logic is employed to evaluate and visualize the distance of two correlation matrices. Furthermore, we show how significant scores are retained from the correlations being evaluated on real-world datasets coompared to synthesized event log datasets with real-world targets. In Fig. 9 and 10 in the paper, the results of the notebook are shown. 
+
 
 ## References
-The framework used by `GEDI` is taken directly from the original paper by [Maldonado](mailto:andreamalher.[email protected]), Frey, Tavares, Rehwald and Seidl. If you would like to discuss the paper, or corresponding research questions on benchmarking process mining tasks please email the authors.
+The framework used by `GEDI` is taken directly from the original paper by [...]. If you would like to discuss the paper, or corresponding research questions on benchmarking process mining tasks please email the authors.

config_files/algorithm/augmentation.json

@@ -1,12 +0,0 @@
-[
-  {
-    "pipeline_step": "instance_augmentation",
-    "augmentation_params":
-    {
-        "method":"SMOTE", "no_samples":20,
-        "feature_selection": ["n_traces", "n_unique_traces", "ratio_unique_traces_per_trace", "trace_len_min", "trace_len_max", "trace_len_mean", "trace_len_median", "trace_len_mode", "trace_len_std", "trace_len_variance", "trace_len_q1", "trace_len_q3", "trace_len_iqr", "trace_len_geometric_mean", "trace_len_geometric_std", "trace_len_harmonic_mean", "trace_len_skewness", "trace_len_kurtosis", "trace_len_coefficient_variation", "trace_len_entropy", "trace_len_hist1", "trace_len_hist2", "trace_len_hist3", "trace_len_hist4", "trace_len_hist5", "trace_len_hist6", "trace_len_hist7", "trace_len_hist8", "trace_len_hist9", "trace_len_hist10", "trace_len_skewness_hist", "trace_len_kurtosis_hist", "ratio_most_common_variant", "ratio_top_1_variants", "ratio_top_5_variants", "ratio_top_10_variants", "ratio_top_20_variants", "ratio_top_50_variants", "ratio_top_75_variants", "mean_variant_occurrence", "std_variant_occurrence", "skewness_variant_occurrence", "kurtosis_variant_occurrence", "n_unique_activities", "activities_min", "activities_max", "activities_mean", "activities_median", "activities_std", "activities_variance", "activities_q1", "activities_q3", "activities_iqr", "activities_skewness", "activities_kurtosis", "n_unique_start_activities", "start_activities_min", "start_activities_max", "start_activities_mean", "start_activities_median", "start_activities_std", "start_activities_variance", "start_activities_q1", "start_activities_q3", "start_activities_iqr", "start_activities_skewness", "start_activities_kurtosis", "n_unique_end_activities", "end_activities_min", "end_activities_max", "end_activities_mean", "end_activities_median", "end_activities_std", "end_activities_variance", "end_activities_q1", "end_activities_q3", "end_activities_iqr", "end_activities_skewness", "end_activities_kurtosis", "entropy_trace", "entropy_prefix", "entropy_global_block", "entropy_lempel_ziv", "entropy_k_block_diff_1", "entropy_k_block_diff_3", "entropy_k_block_diff_5", "entropy_k_block_ratio_1", "entropy_k_block_ratio_3", "entropy_k_block_ratio_5", "entropy_knn_3", "entropy_knn_5", "entropy_knn_7", "epa_variant_entropy", "epa_normalized_variant_entropy", "epa_sequence_entropy", "epa_normalized_sequence_entropy", "epa_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_linear_forgetting", "epa_sequence_entropy_exponential_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]
-    },
-    "input_path": "data/bpic_features.csv",
-    "output_path": "output"
-  }
-]

config_files/algorithm/experiment_real_targets.json

@@ -0,0 +1,41 @@
+[
+   {
+    "pipeline_step": "event_logs_generation",
+    "output_path": "output",
+    "generator_params": {
+      "experiment": {
+        "input_path": "data/BaselineED_feat.csv",
+        "objectives":["ratio_variants_per_number_of_traces","ratio_most_common_variant","ratio_top_10_variants","epa_normalized_variant_entropy","epa_normalized_sequence_entropy","epa_normalized_sequence_entropy_linear_forgetting","epa_normalized_sequence_entropy_exponential_forgetting"]},
+        "config_space": {
+        "mode": [5, 20],
+        "sequence": [0.01, 1],
+        "choice": [0.01, 1],
+        "parallel": [0.01, 1],
+        "loop": [0.01, 1],
+        "silent": [0.01, 1],
+        "lt_dependency": [0.01, 1],
+        "num_traces": [10, 10001],
+        "duplicate": [0],
+        "or": [0]
+      },
+      "n_trials": 200,
+      "plot_reference_feature": ""
+    }
+  },
+  {
+    "pipeline_step": "feature_extraction",
+    "input_path": "output/BaselineED_feat/7_ense_enseef_enself_enve_rmcv_rt10v_rutpt/",
+    "input_path": "output/features/BaselineED_feat/7_ense_enseef_enself_enve_rmcv_rt10v_rutpt/",
+    "feature_params": {"feature_set":["ratio_variants_per_number_of_traces","ratio_most_common_variant","ratio_top_10_variants","epa_normalized_variant_entropy","epa_normalized_sequence_entropy","epa_normalized_sequence_entropy_linear_forgetting","epa_normalized_sequence_entropy_exponential_forgetting"]},
+    "output_path": "output/plots",
+    "real_eventlog_path": "data/BaselineED_feat.csv",
+    "plot_type": "boxplot"
+  },
+  {
+    "pipeline_step": "benchmark_test",
+    "benchmark_test": "discovery",
+    "input_path": "output/BaselineED_feat/7_ense_enseef_enself_enve_rmcv_rt10v_rutpt/",
+    "output_path":"output",
+    "miners" : ["heu", "imf", "ilp"]
+  }
+]

config_files/algorithm/experiment_test.json

@@ -3,7 +3,7 @@
     "pipeline_step": "instance_augmentation",
     "augmentation_params":{"method":"SMOTE", "no_samples":2,
         "feature_selection": ["ratio_top_20_variants", "epa_normalized_sequence_entropy_linear_forgetting"]},
-    "input_path": "data/bpic_features.csv",
+    "input_path": "data/test/bpic_features.csv",
     "output_path": "output"
   },
   {
@@ -39,7 +39,7 @@
     "input_path": "data/test",
     "feature_params": {"feature_set":["trace_length"]},
     "output_path": "output/plots",
-    "real_eventlog_path": "data/bpic_features.csv",
+    "real_eventlog_path": "data/BaselineED_feat.csv",
     "plot_type": "boxplot"
   },
   {
@@ -47,6 +47,6 @@
     "benchmark_test": "discovery",
     "input_path":"data/test",
     "output_path":"output",
-    "miners" : ["inductive", "heuristics", "imf", "ilp"]
+    "miners" : ["inductive", "heu", "imf", "ilp"]
   }
 ]

config_files/algorithm/feature_extraction.json

@@ -1,10 +0,0 @@
-[
-  {
-    "pipeline_step": "feature_extraction",
-    "input_path": "data/test",
-    "feature_params": {"feature_set":["simple_stats", "trace_length", "trace_variant", "activities", "start_activities", "end_activities", "eventropies", "epa_based"]},
-    "output_path": "output/plots",
-    "real_eventlog_path": "data/bpic_features.csv",
-    "plot_type": "boxplot"
-  }
-]

config_files/algorithm/fix_24.json

@@ -1,34 +0,0 @@
-[
-  {
-    "pipeline_step": "event_logs_generation",
-    "output_path":"data/generated",
-    "generator_params": {
-      "objectives": {
-      "normalized_sequence_entropy_linear_forgetting": 0.05,
-      "ratio_top_20_variants": 0.4
-      },
-      "config_space": {
-        "mode": [5, 40],
-        "sequence": [0.01, 1],
-        "choice": [0.01, 1],
-        "parallel": [0.01, 1],
-        "loop": [0.01, 1],
-        "silent": [0.01, 1],
-        "lt_dependency": [0.01, 1],
-        "num_traces": [100, 1001],
-        "duplicate": [0],
-        "or": [0]
-      },
-      "n_trials": 20
-    }
-  },  
-  {
-    "pipeline_step": "feature_extraction",
-    "input_path": "data/generated",
-    "feature_params": {"feature_set":["simple_stats", "trace_length", "trace_variant", "activities", "start_activities", "end_activities", "entropies", "complexity"]},
-    "feature_params": {"feature_set":["trace_length"]},
-    "output_path": "output/plots",
-    "real_eventlog_path": "data/log_meta_features.csv",
-    "plot_type": "boxplot"
-  }
-]

config_files/algorithm/grid_2obj/generator_grid_2objectives_ense_enseef.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_ense_enseef.csv", "objectives": ["epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_ense_enseef/2_ense_enseef", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_ense_enseef/2_ense_enseef", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_ense_enself.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_ense_enself.csv", "objectives": ["epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_ense_enself/2_ense_enself", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_ense_enself/2_ense_enself", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_ense_enve.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_ense_enve.csv", "objectives": ["epa_normalized_sequence_entropy", "epa_normalized_variant_entropy"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_ense_enve/2_ense_enve", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_ense_enve/2_ense_enve", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_ense_rmcv.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_ense_rmcv.csv", "objectives": ["epa_normalized_sequence_entropy", "ratio_most_common_variant"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_ense_rmcv/2_ense_rmcv", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_ense_rmcv/2_ense_rmcv", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_ense_rt10v.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_ense_rt10v.csv", "objectives": ["epa_normalized_sequence_entropy", "ratio_top_10_variants"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_ense_rt10v/2_ense_rt10v", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_ense_rt10v/2_ense_rt10v", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_ense_rvpnot.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_ense_rvpnot.csv", "objectives": ["epa_normalized_sequence_entropy", "ratio_variants_per_number_of_traces"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_ense_rvpnot/2_ense_rvpnot", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_ense_rvpnot/2_ense_rvpnot", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enseef_enself.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enseef_enself.csv", "objectives": ["epa_normalized_sequence_entropy_exponential_forgetting", "epa_normalized_sequence_entropy_linear_forgetting"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enseef_enself/2_enseef_enself", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enseef_enself/2_enseef_enself", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enseef_enve.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enseef_enve.csv", "objectives": ["epa_normalized_sequence_entropy_exponential_forgetting", "epa_normalized_variant_entropy"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enseef_enve/2_enseef_enve", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enseef_enve/2_enseef_enve", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enseef_rmcv.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enseef_rmcv.csv", "objectives": ["epa_normalized_sequence_entropy_exponential_forgetting", "ratio_most_common_variant"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enseef_rmcv/2_enseef_rmcv", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enseef_rmcv/2_enseef_rmcv", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enseef_rt10v.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enseef_rt10v.csv", "objectives": ["epa_normalized_sequence_entropy_exponential_forgetting", "ratio_top_10_variants"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enseef_rt10v/2_enseef_rt10v", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enseef_rt10v/2_enseef_rt10v", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enseef_rvpnot.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enseef_rvpnot.csv", "objectives": ["epa_normalized_sequence_entropy_exponential_forgetting", "ratio_variants_per_number_of_traces"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enseef_rvpnot/2_enseef_rvpnot", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enseef_rvpnot/2_enseef_rvpnot", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enself_enve.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enself_enve.csv", "objectives": ["epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_variant_entropy"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enself_enve/2_enself_enve", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enself_enve/2_enself_enve", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enself_rmcv.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enself_rmcv.csv", "objectives": ["epa_normalized_sequence_entropy_linear_forgetting", "ratio_most_common_variant"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enself_rmcv/2_enself_rmcv", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enself_rmcv/2_enself_rmcv", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enself_rt10v.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enself_rt10v.csv", "objectives": ["epa_normalized_sequence_entropy_linear_forgetting", "ratio_top_10_variants"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enself_rt10v/2_enself_rt10v", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enself_rt10v/2_enself_rt10v", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enself_rvpnot.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enself_rvpnot.csv", "objectives": ["epa_normalized_sequence_entropy_linear_forgetting", "ratio_variants_per_number_of_traces"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enself_rvpnot/2_enself_rvpnot", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enself_rvpnot/2_enself_rvpnot", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enve_rmcv.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enve_rmcv.csv", "objectives": ["epa_normalized_variant_entropy", "ratio_most_common_variant"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enve_rmcv/2_enve_rmcv", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enve_rmcv/2_enve_rmcv", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enve_rt10v.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enve_rt10v.csv", "objectives": ["epa_normalized_variant_entropy", "ratio_top_10_variants"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enve_rt10v/2_enve_rt10v", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enve_rt10v/2_enve_rt10v", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_enve_rvpnot.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_enve_rvpnot.csv", "objectives": ["epa_normalized_variant_entropy", "ratio_variants_per_number_of_traces"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_enve_rvpnot/2_enve_rvpnot", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_enve_rvpnot/2_enve_rvpnot", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_rmcv_rt10v.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_rmcv_rt10v.csv", "objectives": ["ratio_most_common_variant", "ratio_top_10_variants"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_rmcv_rt10v/2_rmcv_rt10v", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_rmcv_rt10v/2_rmcv_rt10v", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_rmcv_rvpnot.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_rmcv_rvpnot.csv", "objectives": ["ratio_most_common_variant", "ratio_variants_per_number_of_traces"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_rmcv_rvpnot/2_rmcv_rvpnot", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_rmcv_rvpnot/2_rmcv_rvpnot", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/grid_2obj/generator_grid_2objectives_rt10v_rvpnot.json

@@ -0,0 +1 @@
+[{"pipeline_step": "event_logs_generation", "output_path": "output/generated/grid_2obj", "generator_params": {"experiment": {"input_path": "data/grid_2obj/grid_2objectives_rt10v_rvpnot.csv", "objectives": ["ratio_top_10_variants", "ratio_variants_per_number_of_traces"]}, "config_space": {"mode": [5, 20], "sequence": [0.01, 1], "choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1], "silent": [0.01, 1], "lt_dependency": [0.01, 1], "num_traces": [10, 10001], "duplicate": [0], "or": [0]}, "n_trials": 200}}, {"pipeline_step": "feature_extraction", "input_path": "output/features/generated/grid_2obj/grid_2objectives_rt10v_rvpnot/2_rt10v_rvpnot", "feature_params": {"feature_set": ["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]}, "output_path": "output/plots", "real_eventlog_path": "data/BaselineED_feat.csv", "plot_type": "boxplot"}, {"pipeline_step": "benchmark_test", "benchmark_test": "discovery", "input_path": "output/generated/grid_2obj/grid_2objectives_rt10v_rvpnot/2_rt10v_rvpnot", "output_path": "output", "miners": ["heu", "imf", "ilp"]}]

config_files/algorithm/pipeline_steps/augmentation.json

@@ -0,0 +1,12 @@
+[
+  {
+    "pipeline_step": "instance_augmentation",
+    "augmentation_params":
+    {
+        "method":"SMOTE", "no_samples":20,
+        "feature_selection": ["n_traces", "n_unique_traces", "ratio_variants_per_number_of_traces", "trace_len_min", "trace_len_max", "trace_len_mean", "trace_len_median", "trace_len_mode", "trace_len_std", "trace_len_variance", "trace_len_q1", "trace_len_q3", "trace_len_iqr", "trace_len_geometric_mean", "trace_len_geometric_std", "trace_len_harmonic_mean", "trace_len_skewness", "trace_len_kurtosis", "trace_len_coefficient_variation", "trace_len_entropy", "trace_len_hist1", "trace_len_hist2", "trace_len_hist3", "trace_len_hist4", "trace_len_hist5", "trace_len_hist6", "trace_len_hist7", "trace_len_hist8", "trace_len_hist9", "trace_len_hist10", "trace_len_skewness_hist", "trace_len_kurtosis_hist", "ratio_most_common_variant", "ratio_top_1_variants", "ratio_top_5_variants", "ratio_top_10_variants", "ratio_top_20_variants", "ratio_top_50_variants", "ratio_top_75_variants", "mean_variant_occurrence", "std_variant_occurrence", "skewness_variant_occurrence", "kurtosis_variant_occurrence", "n_unique_activities", "activities_min", "activities_max", "activities_mean", "activities_median", "activities_std", "activities_variance", "activities_q1", "activities_q3", "activities_iqr", "activities_skewness", "activities_kurtosis", "n_unique_start_activities", "start_activities_min", "start_activities_max", "start_activities_mean", "start_activities_median", "start_activities_std", "start_activities_variance", "start_activities_q1", "start_activities_q3", "start_activities_iqr", "start_activities_skewness", "start_activities_kurtosis", "n_unique_end_activities", "end_activities_min", "end_activities_max", "end_activities_mean", "end_activities_median", "end_activities_std", "end_activities_variance", "end_activities_q1", "end_activities_q3", "end_activities_iqr", "end_activities_skewness", "end_activities_kurtosis", "entropy_trace", "entropy_prefix", "entropy_global_block", "entropy_lempel_ziv", "entropy_k_block_diff_1", "entropy_k_block_diff_3", "entropy_k_block_diff_5", "entropy_k_block_ratio_1", "entropy_k_block_ratio_3", "entropy_k_block_ratio_5", "entropy_knn_3", "entropy_knn_5", "entropy_knn_7", "epa_variant_entropy", "epa_normalized_variant_entropy", "epa_sequence_entropy", "epa_normalized_sequence_entropy", "epa_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_linear_forgetting", "epa_sequence_entropy_exponential_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]
+    },
+    "input_path": "data/test/bpic_features.csv",
+    "output_path": "output"
+  }
+]

config_files/algorithm/{benchmark.json → pipeline_steps/benchmark.json}

@@ -4,6 +4,6 @@
     "benchmark_test": "discovery",
     "input_path":"data/test",
     "output_path":"output",
-    "miners" : ["inductive", "heuristics", "imf", "ilp"]
+    "miners" : ["inductive", "heu", "imf", "ilp"]
   }
 ]

config_files/algorithm/{evaluation_plotter.json → pipeline_steps/evaluation_plotter.json}

@@ -1,7 +1,7 @@
 [
     {
         "pipeline_step": "evaluation_plotter",
-        "input_path": "output/features/generated/34_bpic_features/",
+        "input_path": "output/features/generated/BaselineED_feat/",
         "input_path": "output/features/generated/grid_2obj/",
         "input_path": ["output/features/generated/grid_1obj/", "output/features/generated/grid_2obj/"],
         "input_path": "output/features/generated/grid_1obj/1_enve_feat.csv",
@@ -9,7 +9,7 @@
         "reference_feature": "epa_normalized_sequence_entropy",
         "reference_feature": "epa_normalized_sequence_entropy_exponential_forgetting",
         "reference_feature": "epa_normalized_variant_entropy",
-        "targets": "data/34_bpic_features.csv",
+        "targets": "data/BaselineED_feat.csv",
         "targets": "data/grid_experiments/grid_2obj/",
         "targets": ["data/grid_experiments/grid_1obj/", "data/grid_experiments/grid_2obj/"],
         "targets": "data/grid_experiments/grid_1obj/grid_1objectives_enve.csv",

config_files/algorithm/pipeline_steps/feature_extraction.json

@@ -0,0 +1,12 @@
+[
+  {
+    "pipeline_step": "feature_extraction",
+    "input_path": "data/test",
+    "feature_params": {"feature_set":["ratio_variants_per_number_of_traces", "ratio_most_common_variant", "ratio_top_10_variants", "epa_normalized_variant_entropy", "epa_normalized_sequence_entropy", "epa_normalized_sequence_entropy_linear_forgetting", "epa_normalized_sequence_entropy_exponential_forgetting"]},
+    "output_path": "output/plots",
+    "real_eventlog_path": "data/BaselineED_feat.csv",
+    "plot_type": "boxplot",
+    "font_size": 24,
+    "boxplot_width":10
+  }
+]

config_files/algorithm/test/generator_2bpic_2objectives_ense_enseef.json

@@ -1,7 +1,7 @@
 [{"pipeline_step": "event_logs_generation",
 "output_path": "output/generated",
 "generator_params": {"experiment":
-	{"input_path": "data/2_bpic_features.csv",
+	{"input_path": "data/test/2_bpic_features.csv",
 	"objectives": ["epa_normalized_sequence_entropy",
 	"epa_normalized_sequence_entropy_exponential_forgetting"]},
 	"config_space": {"mode": [5, 20], "sequence": [0.01, 1],
@@ -12,4 +12,4 @@
 	"input_path": "output/features/generated/2_bpic_features/2_ense_enseef",
 	"feature_params": {"feature_set": ["simple_stats", "trace_length", "trace_variant", "activities",
 	"start_activities", "end_activities", "eventropies", "epa_based"]}, "output_path": "output/plots",
-	"real_eventlog_path": "data/2_bpic_features.csv", "plot_type": "boxplot"}]
+	"real_eventlog_path": "data/test/2_bpic_features.csv", "plot_type": "boxplot"}]

config_files/algorithm/test/generator_grid_1objectives_rt10v.json

@@ -1,7 +1,7 @@
 [{"pipeline_step": "event_logs_generation",
 "output_path": "output/generated/grid_1obj",
 "generator_params": {"experiment":
-	{"input_path": "data/grid_experiments/grid_1objectives_rt10v.csv",
+	{"input_path": "data/test/grid_experiments/grid_1objectives_rt10v.csv",
 	"objectives": ["ratio_top_10_variants"]},
 	"config_space": {"mode": [5, 20], "sequence": [0.01, 1],
 	"choice": [0.01, 1], "parallel": [0.01, 1], "loop": [0.01, 1],
@@ -12,5 +12,5 @@
  "input_path": "output/features/generated/grid_1obj/grid_1objectives_rt10v/1_rt10v",
  "feature_params": {"feature_set": ["simple_stats", "trace_length", "trace_variant",
  "activities", "start_activities", "end_activities", "eventropies", "epa_based"]},
- "output_path": "output/plots", "real_eventlog_path": "data/2_bpic_features.csv",
+ "output_path": "output/plots", "real_eventlog_path": "data/test/2_bpic_features.csv",
  "plot_type": "boxplot"}]

config_files/algorithm/test/generator_grid_2objectives_ense_enself.json

@@ -1,7 +1,7 @@
 [{"pipeline_step": "event_logs_generation",
 "output_path": "output/generated/grid_2obj",
 "generator_params": {"experiment":
-	{"input_path": "data/2_grid_test.csv",
+	{"input_path": "data/test/2_grid_test.csv",
 	"objectives": ["epa_normalized_sequence_entropy",
 		"epa_normalized_sequence_entropy_linear_forgetting"]},
 	"config_space": {"mode": [5, 20], "sequence": [0.01, 1],
@@ -15,5 +15,5 @@
 	"feature_params": {"feature_set": ["simple_stats", "trace_length", "trace_variant",
 		"activities", "start_activities", "end_activities", "eventropies", "epa_based"]},
 	"output_path": "output/plots",
-	"real_eventlog_path": "data/2_bpic_features.csv",
+	"real_eventlog_path": "data/test/2_bpic_features.csv",
 	"plot_type": "boxplot"}]

dashboard.py

@@ -1,295 +0,0 @@
-from copy import deepcopy
-from meta_feature_extraction.simple_stats import simple_stats
-from meta_feature_extraction.trace_length import trace_length
-from meta_feature_extraction.trace_variant import trace_variant
-from meta_feature_extraction.activities import activities
-from meta_feature_extraction.start_activities import start_activities
-from meta_feature_extraction.end_activities import end_activities
-from meta_feature_extraction.entropies import entropies
-from pm4py import discover_petri_net_inductive as inductive_miner
-from pm4py import generate_process_tree
-from pm4py import save_vis_petri_net, save_vis_process_tree
-from pm4py.algo.filtering.log.variants import variants_filter
-from pm4py.algo.simulation.tree_generator import algorithm as tree_generator
-from pm4py.algo.simulation.playout.process_tree import algorithm as playout
-from pm4py.objects.conversion.log import converter as log_converter
-from pm4py.objects.log.exporter.xes import exporter as xes_exporter
-from pm4py.objects.log.importer.xes import importer as xes_importer
-from pm4py.objects.log.util import dataframe_utils
-from pm4py.sim import play_out
-
-import matplotlib.image as mpimg
-import os
-import pandas as pd
-import streamlit as st
-
-OUTPUT_PATH = "output"
-SAMPLE_EVENTS = 500
-
-@st.cache(allow_output_mutation=True)
-def load_from_xes(uploaded_file):
-    bytes_data = uploaded_file.getvalue()
-    log1 = xes_importer.deserialize(bytes_data)
-    get_stats(log1)
-    return log1
-
-@st.cache
-def load_from_csv(uploaded_file, sep):
-    if uploaded_file is not None:
-        df = pd.read_csv(uploaded_file, sep=sep, index_col=False)
-        return df
-
-def get_stats(log, save=True):
-    """Returns the statistics of an event log."""
-    num_traces = len(log)
-    num_events = sum([len(c) for c in log])
-    num_utraces = len(variants_filter.get_variants(log))
-    if save:
-        st.session_state["num_traces"] = num_traces
-        st.session_state["num_events"] = num_events
-        st.session_state["num_utraces"] = num_utraces
-    return num_utraces, num_traces, num_events
-
-#@st.cache
-def df_to_log(df, case_id, activity, timestamp):
-    df.rename(columns={case_id: 'case:concept:name',
-                       activity: 'concept:name',
-                       timestamp: "time:timestamp"}, inplace=True)
-    temp = dataframe_utils.convert_timestamp_columns_in_df(df)
-    #temp = temp.sort_values(timestamp)
-    log = log_converter.apply(temp)
-    return log, 'concept:name', "time:timestamp"
-
-def read_uploaded_file(uploaded_file):
-    extension = uploaded_file.name.split('.')[-1]
-    log_name = uploaded_file.name.split('.')[-2]
-
-    st.sidebar.write("Loaded ", extension.upper(), '-File: ', uploaded_file.name)
-    if extension == "xes":
-        event_log = load_from_xes(uploaded_file)
-        log_columns = [*list(event_log[0][0].keys())]
-        convert_button = False
-        case_id = "case:concept:name"
-        activity = "concept:name"
-        timestamp = "time:timestamp"
-        default_act_id = log_columns.index("concept:name")
-        default_tst_id = log_columns.index("time:timestamp")
-
-        event_df = log_converter.apply(event_log, variant=log_converter.Variants.TO_DATA_FRAME)
-        df_path = OUTPUT_PATH+"/"+log_name+".csv"
-        event_df.to_csv(df_path, sep =";", index=False)
-        return event_log, event_df, case_id, activity
-
-    elif extension == "csv":
-        sep = st.sidebar.text_input("Columns separator", ";")
-        event_df = load_from_csv(uploaded_file, sep)
-        old_df = deepcopy(event_df)
-        log_columns = event_df.columns
-
-        case_id = st.sidebar.selectbox("Choose 'case' column:", log_columns)
-        activity = st.sidebar.selectbox("Choose 'activity' column:", log_columns, index=0)
-        timestamp = st.sidebar.selectbox("Choose 'timestamp' column:", log_columns, index=0)
-
-        convert_button = st.sidebar.button('Confirm selection')
-        if convert_button:
-            temp = deepcopy(event_df)
-            event_log, activity, timestamp = df_to_log(temp, case_id, activity, timestamp)
-            #xes_exporter.apply(event_log, INPUT_XES)
-            log_columns = [*list(event_log[0][0].keys())]
-            st.session_state['log'] = event_log
-            return event_log, event_df, case_id, activity
-
-def sample_log_traces(complete_log, sample_size):
-    '''
-    Samples random traces out of logs.
-    So that number of events is slightly over SAMPLE_SIZE.
-    :param complete_log: Log extracted from xes
-    '''
-
-    log_traces = variants_filter.get_variants(complete_log)
-    keys = list(log_traces.keys())
-    sample_traces = {}
-    num_evs = 0
-    while num_evs < sample_size:
-        if len(keys) == 0:
-            break
-        random_trace = keys.pop()
-        sample_traces[random_trace] = log_traces[random_trace]
-        evs = sum([len(case_id) for case_id in sample_traces[random_trace]])
-        num_evs += evs
-    log1 = variants_filter.apply(complete_log, sample_traces)
-    return log1
-
-def show_process_petrinet(event_log, filter_info, OUTPUT_PATH):
-            OUTPUT_PLOT = f"{OUTPUT_PATH}_{filter_info}".replace(":","").replace(".","")+".png" # OUTPUT_PATH is OUTPUT_PATH+INPUT_FILE
-
-            try:
-                fig_pt = mpimg.imread(OUTPUT_PLOT)
-                st.write("Loaded from memory")
-            except FileNotFoundError:
-                net, im, fm = inductive_miner(event_log)
-                           # parameters={heuristics_miner.Variants.CLASSIC.value.Parameters.DEPENDENCY_THRESH: 0.99,
-                           #     pn_visualizer.Variants.FREQUENCY.value.Parameters.FORMAT: "png"})
-                #parameters = {pn_visualizer.Variants.FREQUENCY.value.Parameters.FORMAT: "png"}
-                save_vis_petri_net(net, im, fm, OUTPUT_PLOT)
-                st.write("Saved in: ", OUTPUT_PLOT)
-            fig_pt = mpimg.imread(OUTPUT_PLOT)
-            st.image(fig_pt)
-
-def show_loaded_event_log(event_log, event_df):
-        get_stats(event_log)
-        st.write("### Loaded event-log")
-        col1, col2 = st.columns(2)
-        with col2:
-            st.dataframe(event_df)
-        with col1:
-            show_process_petrinet(event_log, None, OUTPUT_PATH+"running-example")
-
-def extract_meta_features(log, log_name):
-    mtf_cols = ["log", "n_traces", "n_unique_traces", "ratio_unique_traces_per_trace", "n_events", "trace_len_min", "trace_len_max",
-                "trace_len_mean", "trace_len_median", "trace_len_mode", "trace_len_std", "trace_len_variance", "trace_len_q1",
-                "trace_len_q3", "trace_len_iqr", "trace_len_geometric_mean", "trace_len_geometric_std", "trace_len_harmonic_mean",
-                "trace_len_skewness", "trace_len_kurtosis", "trace_len_coefficient_variation", "trace_len_entropy", "trace_len_hist1",
-                "trace_len_hist2", "trace_len_hist3", "trace_len_hist4", "trace_len_hist5", "trace_len_hist6", "trace_len_hist7",
-                "trace_len_hist8", "trace_len_hist9", "trace_len_hist10", "trace_len_skewness_hist", "trace_len_kurtosis_hist",
-                "ratio_most_common_variant", "ratio_top_1_variants", "ratio_top_5_variants", "ratio_top_10_variants", "ratio_top_20_variants",
-                "ratio_top_50_variants", "ratio_top_75_variants", "mean_variant_occurrence", "std_variant_occurrence", "skewness_variant_occurrence",
-                "kurtosis_variant_occurrence", "n_unique_activities", "activities_min", "activities_max", "activities_mean", "activities_median",
-                "activities_std", "activities_variance", "activities_q1", "activities_q3", "activities_iqr", "activities_skewness",
-                "activities_kurtosis", "n_unique_start_activities", "start_activities_min", "start_activities_max", "start_activities_mean",
-                "start_activities_median", "start_activities_std", "start_activities_variance", "start_activities_q1", "start_activities_q3",
-                "start_activities_iqr", "start_activities_skewness", "start_activities_kurtosis", "n_unique_end_activities", "end_activities_min",
-                "end_activities_max", "end_activities_mean", "end_activities_median", "end_activities_std", "end_activities_variance",
-                "end_activities_q1", "end_activities_q3", "end_activities_iqr", "end_activities_skewness", "end_activities_kurtosis", "entropy_trace",
-                "entropy_prefix", "entropy_global_block", "entropy_lempel_ziv", "entropy_k_block_diff_1", "entropy_k_block_diff_3",
-                "entropy_k_block_diff_5", "entropy_k_block_ratio_1", "entropy_k_block_ratio_3", "entropy_k_block_ratio_5", "entropy_knn_3",
-                "entropy_knn_5", "entropy_knn_7"]
-    features = [log_name]
-    features.extend(simple_stats(log))
-    features.extend(trace_length(log))
-    features.extend(trace_variant(log))
-    features.extend(activities(log))
-    features.extend(start_activities(log))
-    features.extend(end_activities(log))
-    features.extend(entropies(log_name, OUTPUT_PATH))
-
-    mtf = pd.DataFrame([features], columns=mtf_cols)
-
-    st.dataframe(mtf)
-    return mtf
-
-def generate_pt(mtf):
-    OUTPUT_PLOT = f"{OUTPUT_PATH}/generated_pt".replace(":","").replace(".","")#+".png" # OUTPUT_PATH is OUTPUT_PATH+INPUT_FILE
-
-    st.write("### PT Gen configurations")
-    col1, col2, col3, col4, col5, col6 = st.columns(6)
-    with col1:
-            param_mode = st.text_input('Mode', str(round(mtf['activities_median'].iat[0]))) #?
-            st.write("Sum of probabilities must be one")
-    with col2:
-            param_min = st.text_input('Min', str(mtf['activities_min'].iat[0]))
-            param_seq = st.text_input('Probability Sequence', 0.25)
-    with col3:
-            param_max = st.text_input('Max', str(mtf['activities_max'].iat[0]))
-            param_cho = st.text_input('Probability Choice (XOR)', 0.25)
-    with col4:
-            param_nmo = st.text_input('Number of models', 1)
-            param_par = st.text_input('Probability Parallel', 0.25)
-    with col5:
-            param_dup = st.text_input('Duplicates', 0)
-            param_lop = st.text_input('Probability Loop', 0.25)
-    with col6:
-            param_sil = st.text_input('Silent', 0.2)
-            param_or = st.text_input('Probability Or', 0.0)
-
-    PT_PARAMS = {tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.MODE: round(float(param_mode)), #most frequent number of visible activities
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.MIN: int(param_min), #minimum number of visible activities
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.MAX: int(param_max), #maximum number of visible activities
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.SEQUENCE: float(param_seq), #probability to add a sequence operator to tree
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.CHOICE: float(param_cho), #probability to add a choice (XOR) operator to tree
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.PARALLEL: float(param_par), #probability to add a parallel operator to tree
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.LOOP: float(param_lop), #probability to add a loop operator to tree
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.OR: float(param_or), #probability to add an or operator to tree
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.SILENT: float(param_sil), #probability to add silent activity to a choice or loop operator
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.DUPLICATE: int(param_dup), #probability to duplicate an activity label
-            tree_generator.Variants.PTANDLOGGENERATOR.value.Parameters.NO_MODELS: int(param_nmo)} #number of trees to generate from model population
-
-    process_tree = generate_process_tree(parameters=PT_PARAMS)
-    save_vis_process_tree(process_tree, OUTPUT_PLOT+"_tree.png")
-
-    st.write("### Playout configurations")
-
-    param_ntraces = st.text_input('Number of traces', str(mtf['n_traces'].iat[0]))
-    PO_PARAMS = {playout.Variants.BASIC_PLAYOUT.value.Parameters.NO_TRACES : int(param_ntraces)}
-
-    ptgen_log = play_out(process_tree, parameters=PO_PARAMS)
-
-    net, im, fm = inductive_miner(ptgen_log)
-    save_vis_petri_net(net, im, fm, OUTPUT_PLOT+".png")
-    st.write("Saved in: ", OUTPUT_PLOT)
-    fig_pt_net = mpimg.imread(OUTPUT_PLOT+".png")
-    fig_pt_tree = mpimg.imread(OUTPUT_PLOT+"_tree.png")
-
-    fcol1, fcol2 = st.columns(2)
-    with fcol1:
-        st.image(fig_pt_tree)
-    with fcol2:
-        st.image(fig_pt_net)
-    extract_meta_features(ptgen_log, "gen_pt")
-
-
-if __name__ == '__main__':
-    st.set_page_config(layout='wide')
-    """
-    # Event Log Generator
-    """
-    start_options =  ['Event-Log', 'Meta-features']
-    start_preference = st.sidebar.selectbox("Do you want to start with a log or with metafeatures?", start_options,0)
-    #lets_start = st.sidebar.button("Let's start with "+start_preference+'!')
-
-    if start_preference==start_options[0]:
-        st.sidebar.write("Upload a dataset in csv or xes-format:")
-        uploaded_file = st.sidebar.file_uploader("Pick a logfile")
-
-        bar = st.progress(0)
-
-        os.makedirs(OUTPUT_PATH, exist_ok=True)
-        event_log = st.session_state['log'] if "log" in st.session_state else None
-        if uploaded_file:
-            event_log, event_df, case_id, activity_id = read_uploaded_file(uploaded_file)
-            #event_log = deepcopy(event_log)
-
-            use_sample = st.sidebar.checkbox('Use random sample', True)
-            if use_sample:
-                sample_size = st.sidebar.text_input('Sample size of approx number of events', str(SAMPLE_EVENTS))
-                sample_size = int(sample_size)
-
-                event_log = sample_log_traces(event_log, sample_size)
-                sample_cases = [event_log[i].attributes['concept:name'] for i in range(0, len(event_log))]
-                event_df = event_df[event_df[case_id].isin(sample_cases)]
-
-            show_loaded_event_log(event_log, event_df)
-            ext_mtf = extract_meta_features(event_log, "running-example")
-            generate_pt(ext_mtf)
-
-    elif start_preference==start_options[1]:
-        LOG_COL = 'log'
-        st.sidebar.write("Upload a dataset in csv-format")
-        uploaded_file = st.sidebar.file_uploader("Pick a file containing meta-features")
-
-        bar = st.progress(0)
-
-        os.makedirs(OUTPUT_PATH, exist_ok=True)
-        event_log = st.session_state[LOG_COL] if "log" in st.session_state else None
-        if uploaded_file:
-            sep = st.sidebar.text_input("Columns separator", ";")
-            mtf = load_from_csv(uploaded_file, sep)
-            st.dataframe(mtf)
-
-            log_options = mtf['log'].unique()
-            log_preference = st.selectbox("What log should we use for generating a new event-log?", log_options,1)
-            mtf_selection = mtf[mtf[LOG_COL]==log_preference]
-            generate_pt(mtf_selection)
-            st.write("##### Original")
-            st.write(mtf_selection)
-

data/BaselineED_bench.csv

@@ -0,0 +1,21 @@
+log,fitness_ilp,precision_ilp,fscore_ilp,size_ilp,pnsize_ilp,cfc_ilp,fitness_imf,precision_imf,fscore_imf,size_imf,pnsize_imf,cfc_imf,fitness_heu,precision_heu,fscore_heu,size_heu,pnsize_heu,cfc_heu
+BPIC12,,,,,,,0.999782450408571,0.106249999999999,0.192086381040032,69,41,37,,,,,,
+BPIC13cp,0.999955347339294,0.792379879879879,0.8841476594077591,20.0,8.0,6.0,0.990412853232678,0.9470205909661912,0.9682307987170752,15,10,9,0.989977119234364,0.8684298767708941,0.925228660364203,14.0,9.0,8.0
+BPIC13inc,0.99997694649763,0.625730547968199,0.7697770045565601,19.0,7.0,5.0,0.957240933170762,0.716391417907929,0.819486058514255,16,10,8,0.99128117000846,0.8850810072924521,0.935175678848088,14.0,8.0,8.0
+BPIC13op,0.99993033237412,0.9065645824471852,0.950961282086593,10.0,5.0,3.0,0.8513195049834781,0.9065645824471852,0.8780739493381781,17,10,8,0.990133346397138,0.9620563035495712,0.975892918274616,12.0,7.0,7.0
+BPIC14dc_p,,,,,,,0.9998326981312632,1.0,0.9999163420675672,606,366,364,0.92732126656531,1.0,0.962290286162716,547.0,364.0,364.0
+BPIC14di_p,,,,,,,0.999900009999,1.0,0.9999500024998752,10,4,2,1.0,1.0,1.0,10.0,2.0,2.0
+BPIC15f2,,,,,,,0.9677497565467512,0.010598531351998,0.0209674330962,381,134,115,,,,,,
+BPIC16c_p,0.999843623073484,0.75266316984805,0.8588217446396421,270.0,123.0,120.0,0.8853691071783161,0.9174262372560932,0.901112653845042,110,38,34,0.7688674244586541,0.9952442715088632,0.8675311223109071,92.0,50.0,49.0
+BPIC16wm_p,0.9999495832135112,1.0,0.999974790971276,4.0,3.0,1.0,0.999900004026629,1.0,0.999949999513391,5,4,2,0.999900004026629,1.0,0.999949999513391,5.0,4.0,2.0
+BPIC17,,,,,,,0.930672500139456,0.244851509976953,0.387702105600728,73,48,40,,,,,,
+BPIC17ol,0.999984636044501,0.6172893728926371,0.7633584481974761,39.0,18.0,15.0,0.9960693326660932,0.898064579352246,0.944531514451642,14,6,4,0.9107234276582472,1.0,0.9532760361602052,24.0,12.0,9.0
+BPIC20a,0.999962791752526,0.188093126224035,0.316628409088329,89.0,38.0,38.0,0.9368177153041932,0.375765199161425,0.5363828699729011,36,21,18,0.8903598625893641,0.867035609327888,0.878542955546676,40.0,19.0,18.0
+BPIC20b,0.99998483485473,0.11309976930835,0.203215557399531,193.0,94.0,90.0,0.8859445593469291,0.348704855833889,0.500438693033593,79,46,43,0.6970214666884511,0.9141924615708572,0.7909710302567481,124.0,62.0,55.0
+BPIC20c,,,,,,,0.7723547059308711,0.190996223166598,0.306257724619519,122,71,67,,,,,,
+BPIC20d,0.999976992746818,0.213233968166344,0.351511928441461,170.0,82.0,79.0,0.867127706306101,0.40344856566562,0.5506815089742241,78,45,41,0.778405152397002,0.8877260430015661,0.8294791282917191,110.0,57.0,55.0
+BPIC20e,0.9999625734194992,0.177946979285382,0.302129002909987,101.0,43.0,43.0,0.9184257431784232,0.38688423100734,0.544429207489319,46,29,25,0.8957327113789421,0.808290592116352,0.8497681013791021,48.0,23.0,22.0
+HD,0.999957093840268,0.412049000421671,0.583611250200463,67.0,29.0,26.0,0.9784476270770972,0.759636896649265,0.8552690146197981,45,29,27,0.7266871858430181,0.8474784912426241,0.782448466293276,61.0,33.0,26.0
+RTFMP,0.9999788763172012,0.589212029307434,0.7415088783783841,43.0,17.0,14.0,0.878359786969879,0.7802754349784181,0.8264174735665141,41,25,20,0.847745391902833,0.991356698750484,0.9139439048749932,47.0,25.0,22.0
+RWABOCSL,0.999985675961848,0.18194590014049,0.307874495646305,133.0,62.0,58.0,0.8277414379848941,0.252082243592322,0.386468499184599,77,45,43,0.7998506743994891,0.680938416422287,0.7356200217515501,83.0,43.0,38.0
+SEPSIS,0.9999870882139372,0.19811033775102,0.330703956956029,96.0,47.0,44.0,0.9605344308961652,0.443996632051641,0.6072831901523931,43,27,23,0.650269438232782,0.7023809523809521,0.675321384593596,64.0,33.0,29.0

data/{baseline_ED_feat.csv → BaselineED_feat.csv}

@@ -1,4 +1,4 @@
-log,ratio_unique_traces_per_trace,ratio_most_common_variant,ratio_top_10_variants,epa_normalized_variant_entropy,epa_normalized_sequence_entropy,epa_normalized_sequence_entropy_linear_forgetting,epa_normalized_sequence_entropy_exponential_forgetting
+log,ratio_variants_per_number_of_traces,ratio_most_common_variant,ratio_top_10_variants,epa_normalized_variant_entropy,epa_normalized_sequence_entropy,epa_normalized_sequence_entropy_linear_forgetting,epa_normalized_sequence_entropy_exponential_forgetting
 BPIC16wm_p,0.002882363538101243,0.29580255809764006,0.7141055665645829,0.0,0.0,0.0,0.0
 BPIC15f5,0.9974048442906575,0.0017301038062283738,0.10207612456747404,0.648702019618582,0.6032598312788823,0.34240966430145864,0.4045799140620184
 BPIC15f1,0.97581317764804,0.006672226855713094,0.12176814011676397,0.6528546738228733,0.610294028540377,0.270241403634718,0.3639276823477533

data/GenBaselineED_bench.csv

@@ -0,0 +1,25 @@
+log,fitness_ilp,precision_ilp,fscore_ilp,size_ilp,pnsize_ilp,cfc_ilp,fitness_imf,precision_imf,fscore_imf,size_imf,pnsize_imf,cfc_imf,fitness_heu,precision_heu,fscore_heu,size_heu,pnsize_heu,cfc_heu
+genELBPIC12_04231_02756_02261_07083_0262_06863_03336,0.999983354100017,0.128493715326455,0.227725631143263,54.0,10.0,28.0,0.9099497610012792,0.397165646466794,0.552974562177985,48,30,26,0.938048056994855,0.492925487219797,0.6462562461747551,49.0,30.0,30.0
+genELBPIC13cp_03109_02884_02865_07054_03315_08406_01231,0.9999801548798732,0.395704287667927,0.567028509892201,47.0,22.0,12.0,0.980044672023712,0.631207493904786,0.7678643410683581,37,28,11,0.347586684851292,0.9355932203389832,0.5068653966783401,47.0,30.0,17.0
+genELBPIC13inc_04047_03916_03911_07178_02322_07944_02,0.999958215484349,0.408035700462898,0.5795744516613001,25.0,8.0,12.0,0.9686666193751672,0.691338675620024,0.8068368212742281,31,18,16,0.985072402672326,0.712919969188461,0.8271860328700411,29.0,18.0,18.0
+genELBPIC13op_02768_0263_02621_0703_02173_07692_01319,0.9999849524483452,0.468847352024922,0.6383850567451991,18.0,7.0,7.0,0.9999267492461212,0.6979087706782,0.8220556586844351,21,14,10,0.63766810311605,0.82383808095952,0.7188957146869801,20.0,12.0,10.0
+genELBPIC14dc_p_04193_03267_03126_04708_00749_07651_00484,0.9999801548798732,0.395704287667927,0.567028509892201,47.0,22.0,12.0,0.980044672023712,0.631207493904786,0.7678643410683581,37,28,11,0.347586684851292,0.9355932203389832,0.5068653966783401,46.0,29.0,16.0
+genELBPIC15f1_06103_03639_02702_06529_00067_01218_09758,0.9999851056034972,0.7639844601581931,0.866197576079873,50.0,34.0,12.0,0.9999702116506732,0.7639844601581931,0.8661919884129461,32,33,4,0.244571491396844,0.970825492684492,0.390713884832271,48.0,28.0,13.0
+genELBPIC15f2_06024_03905_03172_0628_00024_01034_09952,0.9999670209931352,0.99625386996904,0.998106992083072,14.0,6.0,4.0,0.9999670209931352,0.99625386996904,0.998106992083072,14,6,4,0.598731029752207,0.771688142034321,0.6742953476423611,12.0,2.0,4.0
+genELBPIC15f3_06057_04049_03415_06618_00106_01377_09574,0.999994016598948,0.187744606298656,0.316136024084765,37.0,11.0,14.0,0.8327048201120321,0.49525012025012,0.6211011379360081,43,28,24,,,,,,
+genELBPIC15f4_06039_04128_03559_0653_00028_01026_09962,0.999977383275612,0.302621609334747,0.464632272467502,38.0,11.0,17.0,0.946902744936401,0.63868632378007,0.7628380455854801,42,27,20,0.675397479517932,0.902480467048128,0.7725984561543561,31.0,18.0,18.0
+genELBPIC15f5_06033_04046_03424_06487_00017_01021_09974,0.999983354100017,0.128493715326455,0.227725631143263,54.0,10.0,28.0,0.9099497610012792,0.397165646466794,0.552974562177985,48,30,26,0.938048056994855,0.492925487219797,0.6462562461747551,49.0,30.0,30.0
+genELBPIC16c_p_06838_04701_04047_08995_01018_04248_04381,0.999977812170716,0.969934322549258,0.9847269679872972,13.0,8.0,3.0,0.951125602902324,0.969934322549258,0.960437886489628,13,8,4,0.818032265179306,0.74400127547631,0.779262458626504,17.0,10.0,10.0
+genELBPIC16wm_p_00_00_00_00_02958_07141_00029,0.9999835444611692,0.31221384063791,0.475856310241554,38.0,14.0,15.0,0.853166759305167,0.6460181552942631,0.735281165968741,39,25,21,0.7559297979920231,0.842836745090442,0.797021195137192,31.0,18.0,16.0
+genELBPIC17_04616_02905_02319_07417_00335_05313_05056,0.9999529422841532,0.943943512563813,0.9711413284222972,53.0,22.0,16.0,0.9999170610110152,0.943943512563813,0.971124406425324,32,22,10,,,,,,
+genELBPIC17ol_01051_0066_00527_08135_03806_03806_00004,0.9999783279433192,0.340552711229226,0.5080752639070121,42.0,14.0,12.0,0.935457409263567,0.79857953477885,0.8616161786652851,44,28,24,0.8887581366581631,0.8234395340870161,0.854852916190842,41.0,24.0,17.0
+genELBPIC19_0328_03203_03202_06455_01998_09464_00476,0.999959264300715,0.499102378696454,0.6658592723568011,17.0,6.0,5.0,0.999890512287676,0.976915568570034,0.988269530105323,17,12,9,0.5636771288053071,0.9640768588137012,0.711407831532712,10.0,6.0,4.0
+genELBPIC20a_01648_01044_00854_06965_04398_09501_00094,,,,,,,0.9168707487964872,0.314787191876771,0.468667734435799,46,28,24,,,,,,
+genELBPIC20b_03394_01938_01456_07583_02123_08113_01168,0.999969621176065,0.427355623100303,0.598802049151352,21.0,7.0,6.0,0.99991994157317,0.902439024390243,0.9486819182778732,21,14,11,0.6965863019071621,0.8709677419354831,0.7740775519905101,13.0,7.0,5.0
+genELBPIC20c_04202_02155_01373_07337_01353_07575_02092,0.9999529422841532,0.943943512563813,0.9711413284222972,53.0,22.0,16.0,0.9999170610110152,0.943943512563813,0.971124406425324,32,22,10,,,,,,
+genELBPIC20d_0317_02144_01849_07238_02711_08228_00962,0.999982296525308,0.484721663109443,0.652942397986183,44.0,20.0,10.0,0.9999179179170272,0.7032408784863411,0.8257399797307741,35,27,11,0.225420538815396,0.637019197304859,0.333002306545369,55.0,36.0,23.0
+genELBPIC20e_0189_01187_00976_07037_04373_09335_00129,0.999970639140175,0.880258899676375,0.9363038249811212,23.0,12.0,5.0,0.9999185975932092,0.8029049230541211,0.890646871938623,26,20,11,0.344766967838924,0.996734180708667,0.5123231114582241,20.0,11.0,6.0
+genELHD_02541_01546_01185_07991_05166_09063_00493,0.999959264300715,0.499102378696454,0.6658592723568011,17.0,6.0,5.0,0.999890512287676,0.976915568570034,0.988269530105323,17,12,9,0.5636771288053071,0.9640768588137012,0.711407831532712,10.0,6.0,4.0
+genELRTFMP_01119_00684_00526_07694_03756_09931_00015,0.999977812170716,0.969934322549258,0.9847269679872972,13.0,8.0,3.0,0.951125602902324,0.969934322549258,0.960437886489628,13,8,4,0.818032265179306,0.74400127547631,0.779262458626504,17.0,10.0,10.0
+genELRWABOCSL_02355_01381_01006_06894_04972_0887_00809,0.999955496609388,0.8994933189848441,0.947067676789098,10.0,7.0,2.0,0.999933093365992,1.0,0.999966545563834,12,9,4,0.530065017562215,1.0,0.692866004356787,6.0,5.0,0.0
+genELSEPSIS_05223_02995_02194_06958_00333_02743_08057,0.9999529422841532,0.943943512563813,0.9711413284222972,53.0,22.0,16.0,0.9999170610110152,0.943943512563813,0.971124406425324,32,22,10,,,,,,

data/{GenBaseline_ED_feat.csv → GenBaselineED_feat.csv}

@@ -1,4 +1,4 @@
-ratio_unique_traces_per_trace,ratio_most_common_variant,ratio_top_10_variants,epa_normalized_variant_entropy,epa_normalized_sequence_entropy,epa_normalized_sequence_entropy_linear_forgetting,epa_normalized_sequence_entropy_exponential_forgetting,log
+ratio_variants_per_number_of_traces,ratio_most_common_variant,ratio_top_10_variants,epa_normalized_variant_entropy,epa_normalized_sequence_entropy,epa_normalized_sequence_entropy_linear_forgetting,epa_normalized_sequence_entropy_exponential_forgetting,log
 0.21031587365053903,0.23750499800079902,0.7944822071171531,0.8436095804469511,0.454318645274405,0.207520432496227,0.288223924276644,BPIC20c
 0.22916666666666602,0.208333333333333,0.39583333333333304,0.401685982808314,0.245964987620705,0.029935020945679004,0.10766848262252701,BPIC20b
 0.493082835183603,0.12929120409906,0.556105892399658,0.80784773712104,0.49684445215246903,0.276433398156238,0.33730492928925604,BPIC15f1

data/GenBaseline_ED_bench.csv

@@ -1,25 +0,0 @@
-log,fitness_heuristics,precision_heuristics,fscore_heuristics,size_heuristics,pnsize_heuristics,cfc_heuristics,fitness_ilp,precision_ilp,fscore_ilp,size_ilp,pnsize_ilp,cfc_ilp,fitness_imf,precision_imf,fscore_imf,size_imf,pnsize_imf,cfc_imf
-genELBPIC20b_03394_01938_01456_07583_02123_08113_01168,0.6965863019071621,0.8709677419354831,0.7740775519905101,13.0,7.0,5.0,0.999969621176065,0.427355623100303,0.598802049151352,21.0,7.0,6.0,0.99991994157317,0.902439024390243,0.9486819182778732,21,14,11
-genELBPIC15f1_06103_03639_02702_06529_00067_01218_09758,0.244571491396844,0.970825492684492,0.390713884832271,48.0,28.0,13.0,0.9999851056034972,0.7639844601581931,0.866197576079873,50.0,34.0,12.0,0.9999702116506732,0.7639844601581931,0.8661919884129461,32,33,4
-genELBPIC12_04231_02756_02261_07083_0262_06863_03336,0.938048056994855,0.492925487219797,0.6462562461747551,49.0,30.0,30.0,0.999983354100017,0.128493715326455,0.227725631143263,54.0,10.0,28.0,0.9099497610012792,0.397165646466794,0.552974562177985,48,30,26
-genELRTFMP_01119_00684_00526_07694_03756_09931_00015,0.818032265179306,0.74400127547631,0.779262458626504,17.0,10.0,10.0,0.999977812170716,0.969934322549258,0.9847269679872972,13.0,8.0,3.0,0.951125602902324,0.969934322549258,0.960437886489628,13,8,4
-genELBPIC15f5_06033_04046_03424_06487_00017_01021_09974,0.938048056994855,0.492925487219797,0.6462562461747551,49.0,30.0,30.0,0.999983354100017,0.128493715326455,0.227725631143263,54.0,10.0,28.0,0.9099497610012792,0.397165646466794,0.552974562177985,48,30,26
-genELHD_02541_01546_01185_07991_05166_09063_00493,0.5636771288053071,0.9640768588137012,0.711407831532712,10.0,6.0,4.0,0.999959264300715,0.499102378696454,0.6658592723568011,17.0,6.0,5.0,0.999890512287676,0.976915568570034,0.988269530105323,17,12,9
-genELBPIC13op_02768_0263_02621_0703_02173_07692_01319,0.63766810311605,0.82383808095952,0.7188957146869801,20.0,12.0,10.0,0.9999849524483452,0.468847352024922,0.6383850567451991,18.0,7.0,7.0,0.9999267492461212,0.6979087706782,0.8220556586844351,21,14,10
-genELRWABOCSL_02355_01381_01006_06894_04972_0887_00809,0.530065017562215,1.0,0.692866004356787,6.0,5.0,0.0,0.999955496609388,0.8994933189848441,0.947067676789098,10.0,7.0,2.0,0.999933093365992,1.0,0.999966545563834,12,9,4
-genELBPIC13inc_04047_03916_03911_07178_02322_07944_02,0.985072402672326,0.712919969188461,0.8271860328700411,29.0,18.0,18.0,0.999958215484349,0.408035700462898,0.5795744516613001,25.0,8.0,12.0,0.9686666193751672,0.691338675620024,0.8068368212742281,31,18,16
-genELBPIC15f2_06024_03905_03172_0628_00024_01034_09952,0.598731029752207,0.771688142034321,0.6742953476423611,12.0,2.0,4.0,0.9999670209931352,0.99625386996904,0.998106992083072,14.0,6.0,4.0,0.9999670209931352,0.99625386996904,0.998106992083072,14,6,4
-genELBPIC20e_0189_01187_00976_07037_04373_09335_00129,0.344766967838924,0.996734180708667,0.5123231114582241,20.0,11.0,6.0,0.999970639140175,0.880258899676375,0.9363038249811212,23.0,12.0,5.0,0.9999185975932092,0.8029049230541211,0.890646871938623,26,20,11
-genELBPIC20d_0317_02144_01849_07238_02711_08228_00962,0.225420538815396,0.637019197304859,0.333002306545369,55.0,36.0,23.0,0.999982296525308,0.484721663109443,0.652942397986183,44.0,20.0,10.0,0.9999179179170272,0.7032408784863411,0.8257399797307741,35,27,11
-genELBPIC14dc_p_04193_03267_03126_04708_00749_07651_00484,0.347586684851292,0.9355932203389832,0.5068653966783401,46.0,29.0,16.0,0.9999801548798732,0.395704287667927,0.567028509892201,47.0,22.0,12.0,0.980044672023712,0.631207493904786,0.7678643410683581,37,28,11
-genELBPIC16c_p_06838_04701_04047_08995_01018_04248_04381,0.818032265179306,0.74400127547631,0.779262458626504,17.0,10.0,10.0,0.999977812170716,0.969934322549258,0.9847269679872972,13.0,8.0,3.0,0.951125602902324,0.969934322549258,0.960437886489628,13,8,4
-genELBPIC17ol_01051_0066_00527_08135_03806_03806_00004,0.8887581366581631,0.8234395340870161,0.854852916190842,41.0,24.0,17.0,0.9999783279433192,0.340552711229226,0.5080752639070121,42.0,14.0,12.0,0.935457409263567,0.79857953477885,0.8616161786652851,44,28,24
-genELBPIC19_0328_03203_03202_06455_01998_09464_00476,0.5636771288053071,0.9640768588137012,0.711407831532712,10.0,6.0,4.0,0.999959264300715,0.499102378696454,0.6658592723568011,17.0,6.0,5.0,0.999890512287676,0.976915568570034,0.988269530105323,17,12,9
-genELBPIC13cp_03109_02884_02865_07054_03315_08406_01231,0.347586684851292,0.9355932203389832,0.5068653966783401,47.0,30.0,17.0,0.9999801548798732,0.395704287667927,0.567028509892201,47.0,22.0,12.0,0.980044672023712,0.631207493904786,0.7678643410683581,37,28,11
-genELBPIC15f4_06039_04128_03559_0653_00028_01026_09962,0.675397479517932,0.902480467048128,0.7725984561543561,31.0,18.0,18.0,0.999977383275612,0.302621609334747,0.464632272467502,38.0,11.0,17.0,0.946902744936401,0.63868632378007,0.7628380455854801,42,27,20
-genELBPIC20c_04202_02155_01373_07337_01353_07575_02092,,,,,,,0.9999529422841532,0.943943512563813,0.9711413284222972,53.0,22.0,16.0,0.9999170610110152,0.943943512563813,0.971124406425324,32,22,10
-genELBPIC15f3_06057_04049_03415_06618_00106_01377_09574,,,,,,,0.999994016598948,0.187744606298656,0.316136024084765,37.0,11.0,14.0,0.8327048201120321,0.49525012025012,0.6211011379360081,43,28,24
-genELBPIC16wm_p_00_00_00_00_02958_07141_00029,,,,,,,0.9999835444611692,0.31221384063791,0.475856310241554,38.0,14.0,15.0,0.853166759305167,0.6460181552942631,0.735281165968741,39,25,21
-genELSEPSIS_05223_02995_02194_06958_00333_02743_08057,,,,,,,0.9999529422841532,0.943943512563813,0.9711413284222972,53.0,22.0,16.0,0.9999170610110152,0.943943512563813,0.971124406425324,32,22,10
-genELBPIC17_04616_02905_02319_07417_00335_05313_05056,,,,,,,0.9999529422841532,0.943943512563813,0.9711413284222972,53.0,22.0,16.0,0.9999170610110152,0.943943512563813,0.971124406425324,32,22,10
-genELBPIC20a_01648_01044_00854_06965_04398_09501_00094,,,,,,,,,,,,,0.9168707487964872,0.314787191876771,0.468667734435799,46,28,24

data/baseline_ED_bench.csv

@@ -1,18 +0,0 @@
-log,fitness_heuristics,precision_heuristics,fscore_heuristics,size_heuristics,pnsize_heuristics,cfc_heuristics,fitness_ilp,precision_ilp,fscore_ilp,size_ilp,pnsize_ilp,cfc_ilp,fitness_imf,precision_imf,fscore_imf,size_imf,pnsize_imf,cfc_imf
-BPIC16wm_p,0.999900004026629,1.0,0.999949999513391,5.0,4.0,2.0,0.9999495832135112,1.0,0.999974790971276,4.0,3.0,1.0,0.999900004026629,1.0,0.999949999513391,5,4,2
-BPIC13op,0.990133346397138,0.9620563035495712,0.975892918274616,12.0,7.0,7.0,0.99993033237412,0.9065645824471852,0.950961282086593,10.0,5.0,3.0,0.8513195049834781,0.9065645824471852,0.8780739493381781,17,10,8
-BPIC13cp,0.989977119234364,0.8684298767708941,0.925228660364203,14.0,9.0,8.0,0.999955347339294,0.792379879879879,0.8841476594077591,20.0,8.0,6.0,0.990412853232678,0.9470205909661912,0.9682307987170752,15,10,9
-RTFMP,0.847745391902833,0.991356698750484,0.9139439048749932,47.0,25.0,22.0,0.9999788763172012,0.589212029307434,0.7415088783783841,43.0,17.0,14.0,0.878359786969879,0.7802754349784181,0.8264174735665141,41,25,20
-SEPSIS,0.650269438232782,0.7023809523809521,0.675321384593596,64.0,33.0,29.0,0.9999870882139372,0.19811033775102,0.330703956956029,96.0,47.0,44.0,0.9605344308961652,0.443996632051641,0.6072831901523931,43,27,23
-HD,0.7266871858430181,0.8474784912426241,0.782448466293276,61.0,33.0,26.0,0.999957093840268,0.412049000421671,0.583611250200463,67.0,29.0,26.0,0.9784476270770972,0.759636896649265,0.8552690146197981,45,29,27
-BPIC20d,0.778405152397002,0.8877260430015661,0.8294791282917191,110.0,57.0,55.0,0.999976992746818,0.213233968166344,0.351511928441461,170.0,82.0,79.0,0.867127706306101,0.40344856566562,0.5506815089742241,78,45,41
-BPIC13inc,0.99128117000846,0.8850810072924521,0.935175678848088,14.0,8.0,8.0,0.99997694649763,0.625730547968199,0.7697770045565601,19.0,7.0,5.0,0.957240933170762,0.716391417907929,0.819486058514255,16,10,8
-BPIC14di_p,1.0,1.0,1.0,10.0,2.0,2.0,,,,,,,0.999900009999,1.0,0.9999500024998752,10,4,2
-BPIC20e,0.8957327113789421,0.808290592116352,0.8497681013791021,48.0,23.0,22.0,0.9999625734194992,0.177946979285382,0.302129002909987,101.0,43.0,43.0,0.9184257431784232,0.38688423100734,0.544429207489319,46,29,25
-BPIC14dc_p,0.92732126656531,1.0,0.962290286162716,547.0,364.0,364.0,,,,,,,0.9998326981312632,1.0,0.9999163420675672,606,366,364
-BPIC16c_p,0.7688674244586541,0.9952442715088632,0.8675311223109071,92.0,50.0,49.0,0.999843623073484,0.75266316984805,0.8588217446396421,270.0,123.0,120.0,0.8853691071783161,0.9174262372560932,0.901112653845042,110,38,34
-BPIC20a,0.8903598625893641,0.867035609327888,0.878542955546676,40.0,19.0,18.0,0.999962791752526,0.188093126224035,0.316628409088329,89.0,38.0,38.0,0.9368177153041932,0.375765199161425,0.5363828699729011,36,21,18
-BPIC20b,0.6970214666884511,0.9141924615708572,0.7909710302567481,124.0,62.0,55.0,0.99998483485473,0.11309976930835,0.203215557399531,193.0,94.0,90.0,0.8859445593469291,0.348704855833889,0.500438693033593,79,46,43
-RWABOCSL,0.7998506743994891,0.680938416422287,0.7356200217515501,83.0,43.0,38.0,0.999985675961848,0.18194590014049,0.307874495646305,133.0,62.0,58.0,0.8277414379848941,0.252082243592322,0.386468499184599,77,45,43
-BPIC17ol,0.9107234276582472,1.0,0.9532760361602052,24.0,12.0,9.0,0.999984636044501,0.6172893728926371,0.7633584481974761,39.0,18.0,15.0,0.9960693326660932,0.898064579352246,0.944531514451642,14,6,4
-BPIC20c,,,,,,,,,,,,,0.7723547059308711,0.190996223166598,0.306257724619519,122,71,67

data/grid_1obj/grid_1objectives_ense.csv

@@ -1,12 +0,0 @@
-task,epa_normalized_sequence_entropy
-task_1,0.0
-task_2,0.1
-task_3,0.2
-task_4,0.3
-task_5,0.4
-task_6,0.5
-task_7,0.6
-task_8,0.7
-task_9,0.8
-task_10,0.9
-task_11,1.0

data/grid_1obj/grid_1objectives_enseef.csv

@@ -1,12 +0,0 @@
-task,epa_normalized_sequence_entropy_exponential_forgetting
-task_1,0.0
-task_2,0.1
-task_3,0.2
-task_4,0.3
-task_5,0.4
-task_6,0.5
-task_7,0.6
-task_8,0.7
-task_9,0.8
-task_10,0.9
-task_11,1.0

data/grid_1obj/grid_1objectives_enself.csv

@@ -1,12 +0,0 @@
-task,epa_normalized_sequence_entropy_linear_forgetting
-task_1,0.0
-task_2,0.1
-task_3,0.2
-task_4,0.3
-task_5,0.4
-task_6,0.5
-task_7,0.6
-task_8,0.7
-task_9,0.8
-task_10,0.9
-task_11,1.0

data/grid_1obj/grid_1objectives_enve.csv

@@ -1,12 +0,0 @@
-task,epa_normalized_variant_entropy
-task_1,0.0
-task_2,0.1
-task_3,0.2
-task_4,0.3
-task_5,0.4
-task_6,0.5
-task_7,0.6
-task_8,0.7
-task_9,0.8
-task_10,0.9
-task_11,1.0

data/grid_1obj/grid_1objectives_rmcv.csv

@@ -1,12 +0,0 @@
-task,ratio_most_common_variant
-task_1,0.0
-task_2,0.1
-task_3,0.2
-task_4,0.3
-task_5,0.4
-task_6,0.5
-task_7,0.6
-task_8,0.7
-task_9,0.8
-task_10,0.9
-task_11,1.0

data/grid_1obj/grid_1objectives_rt10v.csv

@@ -1,12 +0,0 @@
-task,ratio_top_10_variants
-task_1,0.0
-task_2,0.1
-task_3,0.2
-task_4,0.3
-task_5,0.4
-task_6,0.5
-task_7,0.6
-task_8,0.7
-task_9,0.8
-task_10,0.9
-task_11,1.0