Back to explore

Experimenting with TypeSafe AI's Jev in Playground: Testing Semantic Evaluation via HEX/RGB

Testing Jev in Playground: hiding Choice candidate names as option_a etc. and providing only HEX/RGB values to see if the model evaluates them semantically as colors. When one of a candidate's HEX or RGB values is changed to red to create a contradiction, its probability drops to nearly 0%; no clear HEX-first or RGB-first bias observed so far.

TypeSafe AIの #Jev を Playground で実験なう✨ Choice の候補名を option_a 等に隠してHEX/RGB だけ与えても、値を色として意味的に評価する様子。 例えば blue 候補の HEX か RGB の片方だけデータで赤に変えて矛盾させるとその候補確率はほぼ0%。 HEX優先/RGB優先の偏りは今のところなさそう🤔

Experimenting with TypeSafe AI's Jev in Playground: Testing Semantic Evaluation via HEX/RGB 1
· 5 likesOpen on X