Peter Devine

Peter Devine

How to train a Karasu

Our team at Lightblue has developed a new state-of-the-art public large language model (LLM) for Japanese called ao-Karasu. In this article, I would like to share how we made this model, what it can do, what is cannot do, and what we are do

Peter Devine

    • Cheat! Realistic evaluation of LLMs without cheating

      The world of local large language models (LLMs) has grown massively in the past year, with many amazing models such as Phi and Mistral showing real promise in being useful AI that can be run on more devices than ever before. However, it re

      Peter Devine

      • Karasu and Qarasu: The new top Japanese Chatbots

        In this blog post, we introduce Karasu and Qarasu - state of the art open-source Japanese chatbots. Try chatting to our best model, Qarasu, here (https://lightblue-qarasu.serveo.net/)! These models are able to chat in Japanese to a higher

        Peter Devine

        • KarasuとQarasu：最先端の日本語LLMオープンソースチャットボット

          このブログ記事では、最先端のオープンソース日本語LLMであるKarasuとQarasuを紹介します。 こちらでLightblueが公開している最も精度の高いQarasuを試してみてください！ ベースモデル私たちは、2つのモデルをベースとして学習を実施しました。 1つ目はAugmxntが提供するShisa（augmxnt/shisa-7b-v1）モデルで、日本語MT-Benchベンチマークで高いパフォーマンスを示し、日本語特有のトークナイザーを持っているため、トークン化と推

          Peter Devine

        How to train a Karasu

        Peter Devine