| ⠀⠀⠀⠀⠀⠀⣀⡀⠀⠀⣀⣤⣶⣾⣿⣿⣷⣶⣤⣀⠀⠀⣀⣀⠀⠀⠀⠀⠀⠀ | |
| ⠀⠀⠀⠀⠀⠜⠉⣿⡆⣼⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣧⢰⣿⠉⠃⠀⠀⠀⠀⠀ | |
| ⠀⢀⣤⣴⣦⣄⣴⠟⣸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡎⢻⣦⣠⣴⣦⣄⠀⠀ | |
| ⠀⡞⠁⣠⣾⢿⣧⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀⣽⡿⣷⣄⠈⢷⠀ | |
| ⠀⣠⣾⠟⠁⢸⣿⠀⠘⢿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡿⠁⠀⣿⡇⠈⠻⣷⣄⠀ | |
| ⣰⡿⠁⠀⢀⣾⣏⣾⣄⣰⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣇⣰⣷⣹⣷⠀⠀⠈⢿⣆ | |
| ⣿⡇⠀⢠⣾⠏⢸⣿⣿⣿⣿⠋⢻⣿⣿⣿⣿⡟⠙⣿⣿⣿⣿⡇⠹⣷⡀⠀⢸⣿ | |
| ⠹⣿⣴⡿⠋⠀⠈⠛⠉⣹⣿⣦⣄⡹⣿⣿⣋⣠⣶⣿⣏⠉⠛⠁⠀⠙⢿⣦⣿⠏ | |
| ⠀⣸⣿⠿⠿⣿⣾⣿⡿⠿⣿⣿⣿⣿⡆⢰⣿⣿⣿⣿⠿⢿⣿⣶⣿⠿⠿⣻⣇⠀ | |
| ⠀⣿⡇⢀⣴⣶⣤⣀⣴⣿⠿⣻⡿⣿⣧⣾⣿⢿⣟⠿⣿⣦⣀⣤⣶⣦⠀⢸⣿⠀ | |
| ⠀⢿⣧⠈⠃⢀⣵⣿⡋⠁⢀⣿⡷⣿⡇⢻⣿⣿⣿⡀⠈⢛⣿⣮⡀⠘⠀⣼⡟⠀ | |
| ⠀⠈⠻⣷⣤⣟⣋⣿⣧⣴⡿⠋⠀⣿⡇⢸⣿⠀⠙⢿⣦⣼⣿⣙⣻⣤⣾⠟⠁⠀ | |
| ⠀⠀⠀⠈⢽⣿⠛⢻⣏⢉⣤⣶⣶⣿⠁⠈⣿⣶⣶⣤⡉⣽⡟⠛⣿⡏⠁⠀⠀⠀ | |
| ⠀⠀⠀⠀⠈⠿⣷⣾⣾⣟⣉⣠⣿⢿⡇⢸⠿⣿⣄⣙⣻⣷⣷⣾⠿⠁⠀⠀⠀⠀ | |
| ⠀⠀⠀⠀⠀⠀⠀⠀⠙⠻⠿⠛⢁⡼⠃⠘⢦⡈⠛⠿⠟⠃⠀⠀⠀⠀⠀⠀⠀⠀ | |
| 19:59:46 - THE MERGE MONSTER HUNGERS | |
| ------------------------------------ | |
| Device : cpu | |
| Random seed : 42 | |
| Starting model : ../mistralai_Mistral-7B-v0.1 | |
| Models to merge : ['../merge_stepAA', '../merge_stepBB', '../merge_stepCC'] | |
| Output directory : ./toppy_new_remake2 | |
| Phrases loaded : 31 | |
| Auto weights : False | |
| Merge ratios : [0.2, 0.4, 0.6, 0.8] | |
| Merge method(s) : ['lerp'] | |
| Merge headers : True | |
| Strategy used : cumulative | |
| ------------------------------------ | |
| 19:59:46 - Loading model (../mistralai_Mistral-7B-v0.1)... | |
| Loading checkpoint shards: 100%|██████████████████| 2/2 [00:06<00:00, 3.45s/it] | |
| 20:00:04 - Model loaded. Dtype: torch.float16 | |
| ------------------------------------ | |
| ----------------------------------------------------------------------------------------------------- | |
| | Type | Phrase | Context | Raw Prob* | Used Prob** | Change | | |
| ----------------------------------------------------------------------------------------------------- | |
| | BAD | anticipation | Her body quivers with | 8.65211% | 103.83% | N/A | | |
| | BAD | anticipation | The atmosphere is thic.. | 11.36381% | 136.37% | N/A | | |
| | BAD | unwavering | Filled with an | 0.26573% | 3.19% | N/A | | |
| | BAD | determination | Her eyes were filled w.. | 0.24377% | 2.93% | N/A | | |
| | BAD | determination | Her stubbornness only .. | 6.80586% | 81.67% | N/A | | |
| | BAD | whisper | Her voice barely above.. | 96.20242% | 1154.43% | N/A | | |
| | BAD | spine | shivers down her | 89.79740% | 1077.57% | N/A | | |
| | BAD | sends shivers | The thrill of the act | 0.00182% | 0.02% | N/A | | |
| | BAD | ministrations | She moans and twitches.. | 0.39789% | 4.77% | N/A | | |
| | BAD | legs | wraps her | 2.80972% | 33.72% | N/A | | |
| | BAD | imposing figure | He had an | 0.00669% | 0.08% | N/A | | |
| | BAD | shared challenges | Their bond strengthene.. | 0.04152% | 0.50% | N/A | | |
| | BAD | bond | forged a | 0.56229% | 6.75% | N/A | | |
| | BAD | bond | an unspoken | 1.05445% | 12.65% | N/A | | |
| | BAD | enhance our expe.. | I'm excited to see how | 0.00000% | 0.00% | N/A | | |
| | BAD | sense of vulnera.. | create a | 0.00002% | 0.00% | N/A | | |
| | BAD | dimensions of in.. | explore new | 0.00038% | 0.00% | N/A | | |
| | BAD | deepening our co.. | while | 0.00000% | 0.00% | N/A | | |
| | BAD | shared experiences | through | 0.00059% | 0.01% | N/A | | |
| | BAD | societal expecta.. | that transcend | 0.00161% | 0.02% | N/A | | |
| | BAD | conventional bou.. | that defy | 0.03809% | 0.46% | N/A | | |
| | BAD | conventional bou.. | and defy | 0.01043% | 0.13% | N/A | | |
| | BAD | open communication | an environment | 0.00000% | 0.00% | N/A | | |
| | BAD | emotional vulner.. | an environment | 0.00000% | 0.00% | N/A | | |
| | BAD | heightens our co.. | touch and the anticipa.. | 0.00000% | 0.00% | N/A | | |
| | BAD | sensations you'r.. | I'm enjoying | 0.00000% | 0.00% | N/A | | |
| | BAD | is truly arousing | attention to detail | 0.00000% | 0.00% | N/A | | |
| | BAD | is truly arousing | way you explore my body | 0.00000% | 0.00% | N/A | | |
| | BAD | challenge presen.. | my resolve unwavering .. | 0.00002% | 0.00% | N/A | | |
| | BAD | humble vessel | surrendering to the ex.. | 0.00000% | 0.00% | N/A | | |
| | BAD | bond | cherishing the unique | 2.06671% | 24.80% | N/A | | |
| | BAD | bond | special | 0.01728% | 0.21% | N/A | | |
| | BAD | grows stronger w.. | bond | 0.00000% | 0.00% | N/A | | |
| | BAD | that cannot be b.. | bond | 0.00000% | 0.00% | N/A | | |
| | BAD | becomes unbreaka.. | bond | 0.00000% | 0.00% | N/A | | |
| | BAD | grew stronger wi.. | bond | 0.00000% | 0.00% | N/A | | |
| | GOOD | The apple is in .. | Question: If I'm in th.. | 3.26070% | 3.26% | N/A | | |
| ------------------------------------------------------------------------------------------------------ | |
| | Totals | 223.60% | 2647.35% | 0.00% | | |
| ------------------------------------------------------------------------------------------------------ | |
| * = Unweighted, raw probability - ** = Probability after weight adjustments | |
| ------------------------------------ | |
| 20:00:15 - Loading model (../merge_stepAA)... | |
| Loading checkpoint shards: 100%|██████████████████| 3/3 [00:07<00:00, 2.33s/it] | |
| 20:00:30 - Model loaded. Dtype: torch.float16 | |
| ------------------------------------ | |
| Optimizing Layer 1/32 (lerp): 100%|███████████████| 4/4 [00:42<00:00, 10.53s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepAA']] | |
| 20:01:30 - Layer 1/32 - CHANGED - 26.40827 > 26.39262 - 0.1% | |
| ---- | |
| Optimizing Layer 2/32 (lerp): 100%|███████████████| 4/4 [00:41<00:00, 10.47s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 20:02:29 - Layer 2/32 - CHANGED - 26.39262 > 26.32282 - 0.3% | |
| ---- | |
| Optimizing Layer 3/32 (lerp): 100%|███████████████| 4/4 [00:45<00:00, 11.44s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:03:28 - Layer 3/32 - RETAINED - 26.32282 | |
| ---- | |
| Optimizing Layer 4/32 (lerp): 100%|███████████████| 4/4 [00:42<00:00, 10.69s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:04:27 - Layer 4/32 - RETAINED - 26.32282 | |
| ---- | |
| Optimizing Layer 5/32 (lerp): 100%|███████████████| 4/4 [00:46<00:00, 11.67s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:05:29 - Layer 5/32 - RETAINED - 26.32282 | |
| ---- | |
| Optimizing Layer 6/32 (lerp): 100%|███████████████| 4/4 [00:40<00:00, 10.02s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 20:06:24 - Layer 6/32 - CHANGED - 26.32282 > 26.24790 - 0.3% | |
| ---- | |
| Optimizing Layer 7/32 (lerp): 100%|███████████████| 4/4 [00:39<00:00, 9.81s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:07:18 - Layer 7/32 - RETAINED - 26.24790 | |
| ---- | |
| Optimizing Layer 8/32 (lerp): 100%|███████████████| 4/4 [00:36<00:00, 9.03s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:08:07 - Layer 8/32 - RETAINED - 26.24790 | |
| ---- | |
| Optimizing Layer 9/32 (lerp): 100%|███████████████| 4/4 [00:35<00:00, 8.87s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 20:08:54 - Layer 9/32 - CHANGED - 26.24790 > 26.19836 - 0.2% | |
| ---- | |
| Optimizing Layer 10/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.70s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 20:09:41 - Layer 10/32 - CHANGED - 26.19836 > 26.09306 - 0.4% | |
| ---- | |
| Optimizing Layer 11/32 (lerp): 100%|██████████████| 4/4 [00:32<00:00, 8.22s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 20:10:25 - Layer 11/32 - CHANGED - 26.09306 > 26.01535 - 0.3% | |
| ---- | |
| Optimizing Layer 12/32 (lerp): 100%|██████████████| 4/4 [00:32<00:00, 8.23s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 20:11:09 - Layer 12/32 - CHANGED - 26.01535 > 25.91855 - 0.4% | |
| ---- | |
| Optimizing Layer 13/32 (lerp): 100%|██████████████| 4/4 [00:32<00:00, 8.14s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.4, 'merge_stepAA']] | |
| 20:11:53 - Layer 13/32 - CHANGED - 25.91855 > 25.91126 - 0.0% | |
| ---- | |
| Optimizing Layer 14/32 (lerp): 100%|██████████████| 4/4 [00:32<00:00, 8.00s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA']] | |
| 20:12:36 - Layer 14/32 - CHANGED - 25.91126 > 25.87849 - 0.1% | |
| ---- | |
| Optimizing Layer 15/32 (lerp): 100%|██████████████| 4/4 [00:32<00:00, 8.18s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 20:13:19 - Layer 15/32 - CHANGED - 25.87849 > 25.86635 - 0.0% | |
| ---- | |
| Optimizing Layer 16/32 (lerp): 100%|██████████████| 4/4 [00:32<00:00, 8.07s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:14:03 - Layer 16/32 - RETAINED - 25.86635 | |
| ---- | |
| Optimizing Layer 17/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.41s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA']] | |
| 20:14:47 - Layer 17/32 - CHANGED - 25.86635 > 25.86440 - 0.0% | |
| ---- | |
| Optimizing Layer 18/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.34s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:15:32 - Layer 18/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 19/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.41s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:16:16 - Layer 19/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 20/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.45s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:17:01 - Layer 20/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 21/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.26s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:17:44 - Layer 21/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 22/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.38s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:18:29 - Layer 22/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 23/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.68s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:19:15 - Layer 23/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 24/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.54s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:20:00 - Layer 24/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 25/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.51s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:20:46 - Layer 25/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 26/32 (lerp): 100%|██████████████| 4/4 [00:35<00:00, 8.78s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:21:32 - Layer 26/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 27/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.73s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:22:18 - Layer 27/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 28/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.42s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:23:03 - Layer 28/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 29/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.72s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:23:50 - Layer 29/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 30/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.73s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:24:36 - Layer 30/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 31/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.56s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:25:21 - Layer 31/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 32/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.34s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:26:07 - Layer 32/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Header: 100%|██████████████████████████| 4/4 [00:36<00:00, 9.09s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:26:53 - Header - RETAINED - 25.86440 | |
| ----------------------------------------------------------------------------------------------------- | |
| | Type | Phrase | Context | Raw Prob* | Used Prob** | Change | | |
| ----------------------------------------------------------------------------------------------------- | |
| | BAD | anticipation | Her body quivers with | 4.68658% | 56.24% | -47.59% | | |
| | BAD | anticipation | The atmosphere is thic.. | 6.54790% | 78.57% | -57.79% | | |
| | BAD | unwavering | Filled with an | 0.19636% | 2.36% | -0.83% | | |
| | BAD | determination | Her eyes were filled w.. | 0.13339% | 1.60% | -1.32% | | |
| | BAD | determination | Her stubbornness only .. | 5.84215% | 70.11% | -11.56% | | |
| | BAD | whisper | Her voice barely above.. | 94.63391% | 1135.61% | -18.82% | | |
| | BAD | spine | shivers down her | 88.40607% | 1060.87% | -16.70% | | |
| | BAD | sends shivers | The thrill of the act | 0.00518% | 0.06% | +0.04% | | |
| | BAD | ministrations | She moans and twitches.. | 3.33707% | 40.04% | +35.27% | | |
| | BAD | legs | wraps her | 6.97311% | 83.68% | +49.96% | | |
| | BAD | imposing figure | He had an | 0.02539% | 0.30% | +0.22% | | |
| | BAD | shared challenges | Their bond strengthene.. | 0.01479% | 0.18% | -0.32% | | |
| | BAD | bond | forged a | 0.52765% | 6.33% | -0.42% | | |
| | BAD | bond | an unspoken | 1.95329% | 23.44% | +10.79% | | |
| | BAD | enhance our expe.. | I'm excited to see how | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sense of vulnera.. | create a | 0.00005% | 0.00% | +0.00% | | |
| | BAD | dimensions of in.. | explore new | 0.00306% | 0.04% | +0.03% | | |
| | BAD | deepening our co.. | while | 0.00000% | 0.00% | -0.00% | | |
| | BAD | shared experiences | through | 0.00026% | 0.00% | -0.00% | | |
| | BAD | societal expecta.. | that transcend | 0.00175% | 0.02% | +0.00% | | |
| | BAD | conventional bou.. | that defy | 0.01955% | 0.23% | -0.22% | | |
| | BAD | conventional bou.. | and defy | 0.00254% | 0.03% | -0.09% | | |
| | BAD | open communication | an environment | 0.00000% | 0.00% | +0.00% | | |
| | BAD | emotional vulner.. | an environment | 0.00000% | 0.00% | +0.00% | | |
| | BAD | heightens our co.. | touch and the anticipa.. | 0.00000% | 0.00% | +0.00% | | |
| | BAD | sensations you'r.. | I'm enjoying | 0.00000% | 0.00% | +0.00% | | |
| | BAD | is truly arousing | attention to detail | 0.00000% | 0.00% | +0.00% | | |
| | BAD | is truly arousing | way you explore my body | 0.00001% | 0.00% | +0.00% | | |
| | BAD | challenge presen.. | my resolve unwavering .. | 0.00001% | 0.00% | -0.00% | | |
| | BAD | humble vessel | surrendering to the ex.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | bond | cherishing the unique | 3.14311% | 37.72% | +12.92% | | |
| | BAD | bond | special | 0.03303% | 0.40% | +0.19% | | |
| | BAD | grows stronger w.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | that cannot be b.. | bond | 0.00000% | 0.00% | -0.00% | | |
| | BAD | becomes unbreaka.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | grew stronger wi.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | GOOD | The apple is in .. | Question: If I'm in th.. | 11.39444% | 11.39% | +8.13% | | |
| ------------------------------------------------------------------------------------------------------ | |
| | Totals | 227.88% | 2609.23% | -38.12% | | |
| ------------------------------------------------------------------------------------------------------ | |
| * = Unweighted, raw probability - ** = Probability after weight adjustments | |
| -------- MERGE COMPOSITION --------- | |
| mistralai_Mistral-7B-v0.1: 0.78 | |
| merge_stepAA: 0.22 | |
| ------------------------------------ | |
| 20:27:02 - Loading model (../merge_stepBB)... | |
| Loading checkpoint shards: 100%|██████████████████| 3/3 [00:06<00:00, 2.16s/it] | |
| 20:27:15 - Model loaded. Dtype: torch.float16 | |
| ------------------------------------ | |
| Optimizing Layer 1/32 (lerp): 100%|███████████████| 4/4 [00:33<00:00, 8.47s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:28:01 - Layer 1/32 - CHANGED - 25.86440 > 24.33593 - 5.9% | |
| ---- | |
| Optimizing Layer 2/32 (lerp): 100%|███████████████| 4/4 [00:32<00:00, 8.15s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:28:46 - Layer 2/32 - CHANGED - 24.33593 > 23.85608 - 2.0% | |
| ---- | |
| Optimizing Layer 3/32 (lerp): 100%|███████████████| 4/4 [00:31<00:00, 7.85s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:29:29 - Layer 3/32 - CHANGED - 23.85608 > 23.50431 - 1.5% | |
| ---- | |
| Optimizing Layer 4/32 (lerp): 100%|███████████████| 4/4 [00:32<00:00, 8.16s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:30:13 - Layer 4/32 - CHANGED - 23.50431 > 23.27042 - 1.0% | |
| ---- | |
| Optimizing Layer 5/32 (lerp): 100%|███████████████| 4/4 [00:31<00:00, 7.91s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:30:56 - Layer 5/32 - CHANGED - 23.27042 > 22.72376 - 2.3% | |
| ---- | |
| Optimizing Layer 6/32 (lerp): 100%|███████████████| 4/4 [00:33<00:00, 8.33s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:31:41 - Layer 6/32 - CHANGED - 22.72376 > 22.61975 - 0.5% | |
| ---- | |
| Optimizing Layer 7/32 (lerp): 100%|███████████████| 4/4 [00:31<00:00, 7.82s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:32:25 - Layer 7/32 - CHANGED - 22.61975 > 22.13508 - 2.1% | |
| ---- | |
| Optimizing Layer 8/32 (lerp): 100%|███████████████| 4/4 [00:34<00:00, 8.62s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepBB']] | |
| 20:33:12 - Layer 8/32 - CHANGED - 22.13508 > 21.57464 - 2.5% | |
| ---- | |
| Optimizing Layer 9/32 (lerp): 100%|███████████████| 4/4 [00:34<00:00, 8.68s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:33:59 - Layer 9/32 - CHANGED - 21.57464 > 21.32946 - 1.1% | |
| ---- | |
| Optimizing Layer 10/32 (lerp): 100%|██████████████| 4/4 [00:33<00:00, 8.47s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:34:46 - Layer 10/32 - CHANGED - 21.32946 > 20.82514 - 2.4% | |
| ---- | |
| Optimizing Layer 11/32 (lerp): 100%|██████████████| 4/4 [00:36<00:00, 9.01s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.4, 'merge_stepBB']] | |
| 20:35:34 - Layer 11/32 - CHANGED - 20.82514 > 20.71148 - 0.5% | |
| ---- | |
| Optimizing Layer 12/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.55s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:36:20 - Layer 12/32 - CHANGED - 20.71148 > 20.23820 - 2.3% | |
| ---- | |
| Optimizing Layer 13/32 (lerp): 100%|██████████████| 4/4 [00:34<00:00, 8.62s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.4, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:37:06 - Layer 13/32 - CHANGED - 20.23820 > 19.70820 - 2.6% | |
| ---- | |
| Optimizing Layer 14/32 (lerp): 100%|██████████████| 4/4 [00:35<00:00, 8.97s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:37:55 - Layer 14/32 - CHANGED - 19.70820 > 19.27819 - 2.2% | |
| ---- | |
| Optimizing Layer 15/32 (lerp): 100%|██████████████| 4/4 [00:36<00:00, 9.11s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 20:38:45 - Layer 15/32 - RETAINED - 19.27819 | |
| ---- | |
| Optimizing Layer 16/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.40s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:39:36 - Layer 16/32 - CHANGED - 19.27819 > 19.14155 - 0.7% | |
| ---- | |
| Optimizing Layer 17/32 (lerp): 100%|██████████████| 4/4 [00:38<00:00, 9.53s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:40:28 - Layer 17/32 - CHANGED - 19.14155 > 18.89480 - 1.3% | |
| ---- | |
| Optimizing Layer 18/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.31s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:41:19 - Layer 18/32 - RETAINED - 18.89480 | |
| ---- | |
| Optimizing Layer 19/32 (lerp): 100%|██████████████| 4/4 [00:38<00:00, 9.57s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:42:11 - Layer 19/32 - RETAINED - 18.89480 | |
| ---- | |
| Optimizing Layer 20/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.45s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:43:03 - Layer 20/32 - RETAINED - 18.89480 | |
| ---- | |
| Optimizing Layer 21/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.36s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:43:53 - Layer 21/32 - CHANGED - 18.89480 > 18.43143 - 2.5% | |
| ---- | |
| Optimizing Layer 22/32 (lerp): 100%|██████████████| 4/4 [00:36<00:00, 9.03s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:44:43 - Layer 22/32 - CHANGED - 18.43143 > 17.75345 - 3.7% | |
| ---- | |
| Optimizing Layer 23/32 (lerp): 100%|██████████████| 4/4 [00:36<00:00, 9.10s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:45:34 - Layer 23/32 - RETAINED - 17.75345 | |
| ---- | |
| Optimizing Layer 24/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.32s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:46:24 - Layer 24/32 - CHANGED - 17.75345 > 17.46555 - 1.6% | |
| ---- | |
| Optimizing Layer 25/32 (lerp): 100%|██████████████| 4/4 [00:35<00:00, 8.99s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:47:13 - Layer 25/32 - CHANGED - 17.46555 > 16.88957 - 3.3% | |
| ---- | |
| Optimizing Layer 26/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.38s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:48:05 - Layer 26/32 - RETAINED - 16.88957 | |
| ---- | |
| Optimizing Layer 27/32 (lerp): 100%|██████████████| 4/4 [00:38<00:00, 9.58s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:48:56 - Layer 27/32 - RETAINED - 16.88957 | |
| ---- | |
| Optimizing Layer 28/32 (lerp): 100%|██████████████| 4/4 [00:38<00:00, 9.69s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:49:49 - Layer 28/32 - CHANGED - 16.88957 > 16.64291 - 1.5% | |
| ---- | |
| Optimizing Layer 29/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.46s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 20:50:40 - Layer 29/32 - RETAINED - 16.64291 | |
| ---- | |
| Optimizing Layer 30/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.44s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:51:32 - Layer 30/32 - CHANGED - 16.64291 > 16.07870 - 3.4% | |
| ---- | |
| Optimizing Layer 31/32 (lerp): 100%|██████████████| 4/4 [00:38<00:00, 9.61s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepBB']] | |
| 20:52:24 - Layer 31/32 - CHANGED - 16.07870 > 15.80575 - 1.7% | |
| ---- | |
| Optimizing Layer 32/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.47s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:53:16 - Layer 32/32 - CHANGED - 15.80575 > 15.39211 - 2.6% | |
| ---- | |
| Optimizing Header: 100%|██████████████████████████| 4/4 [00:37<00:00, 9.27s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepBB']] | |
| 20:54:04 - Header - CHANGED - 15.39211 > 15.38669 - 0.0% | |
| ----------------------------------------------------------------------------------------------------- | |
| | Type | Phrase | Context | Raw Prob* | Used Prob** | Change | | |
| ----------------------------------------------------------------------------------------------------- | |
| | BAD | anticipation | Her body quivers with | 0.77898% | 9.35% | -94.48% | | |
| | BAD | anticipation | The atmosphere is thic.. | 5.36169% | 64.34% | -72.03% | | |
| | BAD | unwavering | Filled with an | 0.00835% | 0.10% | -3.09% | | |
| | BAD | determination | Her eyes were filled w.. | 0.00119% | 0.01% | -2.91% | | |
| | BAD | determination | Her stubbornness only .. | 1.68289% | 20.19% | -61.48% | | |
| | BAD | whisper | Her voice barely above.. | 97.71928% | 1172.63% | +18.20% | | |
| | BAD | spine | shivers down her | 21.85458% | 262.25% | -815.31% | | |
| | BAD | sends shivers | The thrill of the act | 0.00284% | 0.03% | +0.01% | | |
| | BAD | ministrations | She moans and twitches.. | 0.69817% | 8.38% | +3.60% | | |
| | BAD | legs | wraps her | 0.48370% | 5.80% | -27.91% | | |
| | BAD | imposing figure | He had an | 0.00022% | 0.00% | -0.08% | | |
| | BAD | shared challenges | Their bond strengthene.. | 0.00517% | 0.06% | -0.44% | | |
| | BAD | bond | forged a | 1.57202% | 18.86% | +12.12% | | |
| | BAD | bond | an unspoken | 0.14792% | 1.78% | -10.88% | | |
| | BAD | enhance our expe.. | I'm excited to see how | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sense of vulnera.. | create a | 0.00001% | 0.00% | -0.00% | | |
| | BAD | dimensions of in.. | explore new | 0.00087% | 0.01% | +0.01% | | |
| | BAD | deepening our co.. | while | 0.00000% | 0.00% | -0.00% | | |
| | BAD | shared experiences | through | 0.00003% | 0.00% | -0.01% | | |
| | BAD | societal expecta.. | that transcend | 0.00001% | 0.00% | -0.02% | | |
| | BAD | conventional bou.. | that defy | 0.00081% | 0.01% | -0.45% | | |
| | BAD | conventional bou.. | and defy | 0.00317% | 0.04% | -0.09% | | |
| | BAD | open communication | an environment | 0.00000% | 0.00% | -0.00% | | |
| | BAD | emotional vulner.. | an environment | 0.00000% | 0.00% | -0.00% | | |
| | BAD | heightens our co.. | touch and the anticipa.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sensations you'r.. | I'm enjoying | 0.00000% | 0.00% | -0.00% | | |
| | BAD | is truly arousing | attention to detail | 0.00000% | 0.00% | +0.00% | | |
| | BAD | is truly arousing | way you explore my body | 0.00001% | 0.00% | +0.00% | | |
| | BAD | challenge presen.. | my resolve unwavering .. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | humble vessel | surrendering to the ex.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | bond | cherishing the unique | 0.20155% | 2.42% | -22.38% | | |
| | BAD | bond | special | 0.00369% | 0.04% | -0.16% | | |
| | BAD | grows stronger w.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | that cannot be b.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | becomes unbreaka.. | bond | 0.00000% | 0.00% | -0.00% | | |
| | BAD | grew stronger wi.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | GOOD | The apple is in .. | Question: If I'm in th.. | 26.86230% | 26.86% | +23.60% | | |
| ------------------------------------------------------------------------------------------------------ | |
| | Totals | 157.39% | 1593.19% | -1054.16% | | |
| ------------------------------------------------------------------------------------------------------ | |
| * = Unweighted, raw probability - ** = Probability after weight adjustments | |
| -------- MERGE COMPOSITION --------- | |
| merge_stepBB: 0.56 | |
| mistralai_Mistral-7B-v0.1: 0.36 | |
| merge_stepAA: 0.07 | |
| ------------------------------------ | |
| 20:54:14 - Loading model (../merge_stepCC)... | |
| Loading checkpoint shards: 100%|██████████████████| 3/3 [00:05<00:00, 2.00s/it] | |
| 20:54:27 - Model loaded. Dtype: torch.float16 | |
| ------------------------------------ | |
| Optimizing Layer 1/32 (lerp): 100%|███████████████| 4/4 [00:34<00:00, 8.52s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 20:55:16 - Layer 1/32 - RETAINED - 15.39464 | |
| ---- | |
| Optimizing Layer 2/32 (lerp): 100%|███████████████| 4/4 [00:32<00:00, 8.01s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 20:55:59 - Layer 2/32 - CHANGED - 15.39464 > 15.35971 - 0.2% | |
| ---- | |
| Optimizing Layer 3/32 (lerp): 100%|███████████████| 4/4 [00:32<00:00, 8.24s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 20:56:44 - Layer 3/32 - CHANGED - 15.35971 > 15.30529 - 0.4% | |
| ---- | |
| Optimizing Layer 4/32 (lerp): 100%|███████████████| 4/4 [00:32<00:00, 8.06s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 20:57:28 - Layer 4/32 - CHANGED - 15.30529 > 15.25435 - 0.3% | |
| ---- | |
| Optimizing Layer 5/32 (lerp): 100%|███████████████| 4/4 [00:34<00:00, 8.54s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 20:58:15 - Layer 5/32 - RETAINED - 15.25435 | |
| ---- | |
| Optimizing Layer 6/32 (lerp): 100%|███████████████| 4/4 [00:32<00:00, 8.07s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 20:58:59 - Layer 6/32 - CHANGED - 15.25435 > 15.21839 - 0.2% | |
| ---- | |
| Optimizing Layer 7/32 (lerp): 100%|███████████████| 4/4 [00:34<00:00, 8.71s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 20:59:46 - Layer 7/32 - CHANGED - 15.21839 > 15.21246 - 0.0% | |
| ---- | |
| Optimizing Layer 8/32 (lerp): 100%|███████████████| 4/4 [00:32<00:00, 8.15s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepBB']] | |
| 21:00:30 - Layer 8/32 - RETAINED - 15.21246 | |
| ---- | |
| Optimizing Layer 9/32 (lerp): 100%|███████████████| 4/4 [00:34<00:00, 8.58s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 21:01:16 - Layer 9/32 - CHANGED - 15.21246 > 15.19112 - 0.1% | |
| ---- | |
| Optimizing Layer 10/32 (lerp): 100%|██████████████| 4/4 [00:36<00:00, 9.21s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 21:02:05 - Layer 10/32 - RETAINED - 15.19112 | |
| ---- | |
| Optimizing Layer 11/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.34s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.4, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 21:02:55 - Layer 11/32 - CHANGED - 15.19112 > 15.12176 - 0.5% | |
| ---- | |
| Optimizing Layer 12/32 (lerp): 100%|██████████████| 4/4 [00:35<00:00, 8.89s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 21:03:44 - Layer 12/32 - CHANGED - 15.12176 > 15.09187 - 0.2% | |
| ---- | |
| Optimizing Layer 13/32 (lerp): 100%|██████████████| 4/4 [00:35<00:00, 8.84s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.4, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 21:04:33 - Layer 13/32 - RETAINED - 15.09187 | |
| ---- | |
| Optimizing Layer 14/32 (lerp): 100%|██████████████| 4/4 [00:36<00:00, 9.04s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 21:05:23 - Layer 14/32 - CHANGED - 15.09187 > 15.08479 - 0.0% | |
| ---- | |
| Optimizing Layer 15/32 (lerp): 100%|██████████████| 4/4 [00:39<00:00, 9.78s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.2, 'merge_stepCC']] | |
| 21:06:15 - Layer 15/32 - CHANGED - 15.08479 > 15.06165 - 0.2% | |
| ---- | |
| Optimizing Layer 16/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.34s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 21:07:07 - Layer 16/32 - CHANGED - 15.06165 > 15.04180 - 0.1% | |
| ---- | |
| Optimizing Layer 17/32 (lerp): 100%|██████████████| 4/4 [00:39<00:00, 9.75s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 21:08:00 - Layer 17/32 - CHANGED - 15.04180 > 15.03153 - 0.1% | |
| ---- | |
| Optimizing Layer 18/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.38s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 21:08:50 - Layer 18/32 - RETAINED - 15.03153 | |
| ---- | |
| Optimizing Layer 19/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.26s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 21:09:40 - Layer 19/32 - RETAINED - 15.03153 | |
| ---- | |
| Optimizing Layer 20/32 (lerp): 100%|██████████████| 4/4 [00:36<00:00, 9.17s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 21:10:31 - Layer 20/32 - RETAINED - 15.03153 | |
| ---- | |
| Optimizing Layer 21/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.44s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 21:11:21 - Layer 21/32 - CHANGED - 15.03153 > 14.97763 - 0.4% | |
| ---- | |
| Optimizing Layer 22/32 (lerp): 100%|██████████████| 4/4 [00:38<00:00, 9.71s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 21:12:12 - Layer 22/32 - CHANGED - 14.97763 > 14.91363 - 0.4% | |
| ---- | |
| Optimizing Layer 23/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.28s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 21:13:02 - Layer 23/32 - RETAINED - 14.91363 | |
| ---- | |
| Optimizing Layer 24/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.41s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.4, 'merge_stepCC']] | |
| 21:13:55 - Layer 24/32 - CHANGED - 14.91363 > 14.91031 - 0.0% | |
| ---- | |
| Optimizing Layer 25/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.28s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.2, 'merge_stepCC']] | |
| 21:14:45 - Layer 25/32 - CHANGED - 14.91031 > 14.90836 - 0.0% | |
| ---- | |
| Optimizing Layer 26/32 (lerp): 100%|██████████████| 4/4 [00:38<00:00, 9.59s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 21:15:38 - Layer 26/32 - RETAINED - 14.90836 | |
| ---- | |
| Optimizing Layer 27/32 (lerp): 100%|██████████████| 4/4 [00:39<00:00, 9.77s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 21:16:31 - Layer 27/32 - RETAINED - 14.90836 | |
| ---- | |
| Optimizing Layer 28/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.37s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 21:17:21 - Layer 28/32 - RETAINED - 14.90836 | |
| ---- | |
| Optimizing Layer 29/32 (lerp): 100%|██████████████| 4/4 [00:37<00:00, 9.34s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 21:18:10 - Layer 29/32 - RETAINED - 14.90836 | |
| ---- | |
| Optimizing Layer 30/32 (lerp): 100%|██████████████| 4/4 [00:41<00:00, 10.44s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 21:19:09 - Layer 30/32 - CHANGED - 14.90836 > 14.86424 - 0.3% | |
| ---- | |
| Optimizing Layer 31/32 (lerp): 100%|██████████████| 4/4 [01:01<00:00, 15.28s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepBB']] | |
| 21:20:31 - Layer 31/32 - RETAINED - 14.86424 | |
| ---- | |
| Optimizing Layer 32/32 (lerp): 100%|██████████████| 4/4 [01:09<00:00, 17.26s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 21:22:06 - Layer 32/32 - CHANGED - 14.86424 > 14.85794 - 0.0% | |
| ---- | |
| Optimizing Header: 100%|██████████████████████████| 4/4 [00:50<00:00, 12.56s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 21:23:14 - Header - CHANGED - 14.85794 > 14.84594 - 0.1% | |
| ----------------------------------------------------------------------------------------------------- | |
| | Type | Phrase | Context | Raw Prob* | Used Prob** | Change | | |
| ----------------------------------------------------------------------------------------------------- | |
| | BAD | anticipation | Her body quivers with | 0.96543% | 11.59% | -92.24% | | |
| | BAD | anticipation | The atmosphere is thic.. | 5.13512% | 61.62% | -74.74% | | |
| | BAD | unwavering | Filled with an | 0.00780% | 0.09% | -3.10% | | |
| | BAD | determination | Her eyes were filled w.. | 0.00110% | 0.01% | -2.91% | | |
| | BAD | determination | Her stubbornness only .. | 1.50464% | 18.06% | -63.61% | | |
| | BAD | whisper | Her voice barely above.. | 97.83546% | 1174.03% | +19.60% | | |
| | BAD | spine | shivers down her | 17.91211% | 214.95% | -862.62% | | |
| | BAD | sends shivers | The thrill of the act | 0.00337% | 0.04% | +0.02% | | |
| | BAD | ministrations | She moans and twitches.. | 0.55440% | 6.65% | +1.88% | | |
| | BAD | legs | wraps her | 0.44506% | 5.34% | -28.38% | | |
| | BAD | imposing figure | He had an | 0.00012% | 0.00% | -0.08% | | |
| | BAD | shared challenges | Their bond strengthene.. | 0.00515% | 0.06% | -0.44% | | |
| | BAD | bond | forged a | 1.23465% | 14.82% | +8.07% | | |
| | BAD | bond | an unspoken | 0.11418% | 1.37% | -11.28% | | |
| | BAD | enhance our expe.. | I'm excited to see how | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sense of vulnera.. | create a | 0.00001% | 0.00% | -0.00% | | |
| | BAD | dimensions of in.. | explore new | 0.00083% | 0.01% | +0.01% | | |
| | BAD | deepening our co.. | while | 0.00000% | 0.00% | -0.00% | | |
| | BAD | shared experiences | through | 0.00003% | 0.00% | -0.01% | | |
| | BAD | societal expecta.. | that transcend | 0.00000% | 0.00% | -0.02% | | |
| | BAD | conventional bou.. | that defy | 0.00058% | 0.01% | -0.45% | | |
| | BAD | conventional bou.. | and defy | 0.00256% | 0.03% | -0.09% | | |
| | BAD | open communication | an environment | 0.00000% | 0.00% | -0.00% | | |
| | BAD | emotional vulner.. | an environment | 0.00000% | 0.00% | -0.00% | | |
| | BAD | heightens our co.. | touch and the anticipa.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sensations you'r.. | I'm enjoying | 0.00000% | 0.00% | -0.00% | | |
| | BAD | is truly arousing | attention to detail | 0.00000% | 0.00% | +0.00% | | |
| | BAD | is truly arousing | way you explore my body | 0.00001% | 0.00% | +0.00% | | |
| | BAD | challenge presen.. | my resolve unwavering .. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | humble vessel | surrendering to the ex.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | bond | cherishing the unique | 0.14126% | 1.70% | -23.11% | | |
| | BAD | bond | special | 0.00333% | 0.04% | -0.17% | | |
| | BAD | grows stronger w.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | that cannot be b.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | becomes unbreaka.. | bond | 0.00000% | 0.00% | -0.00% | | |
| | BAD | grew stronger wi.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | GOOD | The apple is in .. | Question: If I'm in th.. | 24.61224% | 24.61% | +21.35% | | |
| ------------------------------------------------------------------------------------------------------ | |
| | Totals | 150.48% | 1535.02% | -1112.33% | | |
| ------------------------------------------------------------------------------------------------------ | |
| * = Unweighted, raw probability - ** = Probability after weight adjustments | |
| -------- MERGE COMPOSITION --------- | |
| merge_stepCC: 0.38 | |
| mistralai_Mistral-7B-v0.1: 0.29 | |
| merge_stepBB: 0.29 | |
| merge_stepAA: 0.04 | |
| 21:23:28 - Saving model to ./toppy_new_remake2... | |
| 21:23:36 - Copying tokenizer files to ./toppy_new_remake2... | |
| Skipped added_tokens.json (not found) | |
| Copied tokenizer.model | |
| Copied special_tokens_map.json | |
| Copied tokenizer_config.json | |
| Skipped vocab.json (not found) | |
| Skipped merges.txt (not found) | |
| 21:23:36 - Model and tokenizer files saved successfully. |