Multiple crop box scales

#3
by jbergq - opened

With the current grid square approach, some large parts do not fit inside the crops. Perhaps you could add larger crop squares with the same stride as the small ones and do the embedding comparisons for these as well? In this case, the user would also need a way to select crop box scale easily, perhaps using the scroll/other keypress or even drawing a box with the mouse held down?

You could also circumvent this by using the object detection approach suggested in this thread and get boxes adjusted to the parts. :)

I see your point. Right now the only way I'm addressing this issue is by manually curating the dataset to include parts of roughly the same size.

From a technical point it comes down to that the CNN-model takes a 64x64 patch as input, so that's why I think it makes sense to limit the square to that size. For me, showcasing the model capabilities is the most important thing at this stage, refining the UI is an issue for later. (Unless someone want's to work on that right now, in that case, I'll do my best at supporting you)

Ok, makes sense and agree it's not a big issue at this stage. Just keep in mind you can always do a quick resize of the patch before feeding it to the model and get around the issue this way when you choose to look into this more.

Sign up or log in to comment