A Japanese-optimized large language model by NII, available in sizes from 150M to 172B. Trained on llm-jp-corpus v3, supports SFT and DPO via Instruct2/3, and is Apache 2.0 licensed for models up to 13B.
Parameters
Undisclosed
Context Window
License
Proprietary
Release Date
2024-09-23
API Pricing
API pricing for this model is not yet available
Strengths
- •Compact 3.7B model for broader accessibility.
- •Reasonable performance for its size.
- •Instruct-tuned for direct use cases.
Weaknesses
- •Weaker than models >7B parameters.
- •Limited context window possible.
- •Struggles with highly technical domains.
Use Cases
- •Responsive chatbots for web integration.
- •Educational tools and learning aids.
- •Initial prototyping for conversational AI.