WorldModel

Note: This was a passion project, crafted in two days. I hope it can be of help to many!

WorldModel is a MaskGIT model trained on 8x8x8 Minecraft voxel volumes. Beyond generating blocks from scratch, it excels in filling spaces based on neighboring blocks, ensuring seamless integration in Minecraft worlds

The model weights can be found here or in this repo

Prerequisites:

Ensure your server has the mcpi package installed. This code relies on it to place blocks.

Functionality:

This tool uses a special mask token, designated as 831. When you provide a tensor of shape [1,512] containing block values ranging from 0-831(including the mask token), the generate function will intelligently fill in the masked areas until none remain.

Sampling Strategy Adjustments to maskGIT:

In contrast to the original maskGIT, sampling solely from the most confident tokens can lead to mode collapse, often resulting in generating only stones or air. To address this, I've introduced a random sampling strategy. In the early sampling phases, the confidence of potential tokens is disregarded, and tokens are selected for unmasking at random.

You can fine-tune this behavior using the "random_steps" variable. It's crucial to strike a balance between "random_steps" and other parameters such as the total "timesteps", "temperature", and "topk_filter_thres".