ImageBind: Holistic AI learning across six modalities

When humans absorb information from the world, we innately use multiple senses, such as seeing a busy street and hearing the sounds of car engines. Today, we’re introducing an approach that brings machines one step closer to humans’ ability to learn simultaneously, holistically, and directly from many different forms of information — without the need for explicit supervision (the process of organi

[yamadar]

Metaがオープンソースでリリースしたテキスト、画像、音声の相互変換AIツール。例えばペンギンの鳴き声から画像を生成したり、鳩の画像とバイクの音から、鳩が居る街角を走るバイクの画像を生成したりする