A large language model optimized for Japanese, developed by NII. It comes in 8 sizes ranging from 150M to 172B parameters and was trained on llm-jp-corpus v3. It supports SFT/DPO through Instruct2/Instruct3 versions and is available under the Apache 2.0 license (for 13B and smaller).
Parameters
Undisclosed
Context Window
License
Proprietary
Release Date
2024-12-01
API Pricing
API pricing for this model is not yet available
Strengths
- •Good balance of performance and size.
- •Handles Japanese text effectively.
- •Potential for various downstream tasks.
Weaknesses
- •Limited capacity vs. larger models.
- •May struggle with highly complex reasoning.
- •Performance depends on fine-tuning.
Use Cases
- •Japanese text processing tasks.
- •Building specialized NLP applications.
- •Serving as a baseline model for research.