A Japanese-optimized large language model developed by NII with 13 billion parameters. Trained on 2.1 trillion tokens from the llm-jp-corpus v3.
Parameters
Undisclosed
Context Window
License
Proprietary
Release Date
2023-10-18
API Pricing
API pricing for this model is not yet available
Strengths
- •Fine-tuned for instruction following.
- •Trained on Dolly and OASST data.
- •13B parameter size for performance.
Weaknesses
- •High computational requirements.
- •Generalized training may reduce specificity.
- •Requires careful prompt engineering.
Use Cases
- •General-purpose Japanese instruction execution.
- •Content generation and summarization.
- •Educational tutoring systems.