Skip to content
View original post on X: DesignArenaOfficial
Published
34/100

Design Arena maps how two models think while building Three.js games

AIDesign Arena segmented the thinking traces of two models building Three.js games into more than 800,000 sentences. It embedded each sentence with OpenAI's text-embedding-3-large, reduced them with UMAP, and grouped them into topics using HDBSCAN. The post compares how much of each model's thinking falls into each topic.
DesignArenaVerified on XOfficial
@DesignArena
View on X

Part of a thread · earlier post

To answer this, we mapped how both models think while they build Three.js games on DesignArena. We segmented their thinking traces into 800,000+ sentences using SaT (Frohmann et al.) and turned every sentence into an embedding using text-embedding-3-large (OpenAI).

Sentences that mean similar things land close together, so we reduced their embeddings to five dimensions using UMAP (McInnes et al.) and grouped them into topics using HDBSCAN (Campello et al.), choosing the clustering by its DBCV score (Moulavi et al.). Then we compared how much of each model's thinking falls in each one.

Source details

DesignArena · x.comPublished · added here

Original title: To answer this, we mapped how both models think while they build Three.js games on DesignArena. We segmented their thinking traces into 8...