@ytm Very cool! How many parameters and how heavily quantized is that model out of curiosity? How fast if you're just generating embedding vectors using the first layer? Just thinking of additional applications that might go faster if you were just doing distance against vectors for similarity matching or RAG or whatever. Neat stuff though, will take a closer look later