r/LocalLLaMA • u/ConfidentDinner6648 • 5h ago

New Model 4B 3D coding model update: much better one-shot results and visual quality

Enable HLS to view with audio, or disable this notification

Quick update: I’ve uploaded a new version of my 4B coding model. One-shot results and visual quality are much better in my latest tests, and training is nearly finished.

I recommend starting with Q8, which is the version I’ve tested. Q4 is also available, but I haven’t tested it yet.

Q8 settings: temperature 0.6, top-k 20, top-p 0.95.

I’ve also had good results generating 3D scenes from image references, even though the vision encoder wasn’t included in this training run.

Updated Q4 and Q8 on Hugging Face

If you downloaded an earlier version, delete the old model and download it again in LM Studio or whichever app you use. The filenames haven’t changed, so make sure you’re loading the updated files.

As promised, I’ll publish the dataset and full FP16 weights today.

I’ll add the links to this same post when they’re ready. This will be my last new post for this stage of the project.

Thanks everyone for the support, feedback, and testing! It’s been great seeing the community try it out.

30 Upvotes

100% Upvoted

10 comments sorted by

5

u/nikhilprasanth 5h ago

Curious, has the model been trained for Blender Python scripting as well?

5

u/ConfidentDinner6648 5h ago

only threejs

3

u/politefella0 5h ago

I don’t think so. I tried previous version and it didn’t do well. Only three.js I think.

5

u/ConfidentDinner6648 5h ago

1 shot all

3

u/politefella0 5h ago

Would you like to share your dataset? I’ll see if I can convert it to blender examples but only if you’d like to. I’m actually inspired and working on my blender finetune but I know rats about AI training and using LLMs to help with the task.

2

u/ConfidentDinner6648 4h ago

i'll actually be sharing it later today! the dataset is already uploaded to hugging face as a private repository, i'm just finishing organizing everything before making it public.

i'd love to see what you can do with blender using the same approach haha

→ More replies (2)

3

u/ComradeSaeezel 4h ago

Hey. I've tried yesterday Q4 +Unsloth Desktop, but it couldn't generate 3D scene (Dragonrider Aerie) in one-shot. Which harness do you recommend to use?

1

u/KaiChanBunny 5m left edited 11m left

Same, in Unsloth but with the Q8 one. It would try multiple times to create the HTML file and fail somewhere down the chain (either the edit file tool call would fail with strange errors or it gave up after writing it too long after going into a loop), or the resulting HTML wouldn't actually work and be broken. I am guessing OP is using a different harness?