xsanskarx/calculator-smollm2_v1

Calculator-SMoL-LM2 v1 - LLM Calculator Experiment

🚨 Disclaimer 🚨

This model is a work in progress!

• The current version (calculator-smollm2_v1) is an experimental model trained on a small subset of synthetic data (70,000 rows).
• Dataset scaling is ongoing, and future versions will be trained on larger and more diverse datasets.
• This model is not production-ready and is intended for educational and experimental purposes only.
• The base model used is smollm2-360m-instruct from Hugging Face.

Use this model with caution, and do not rely on it for critical or real-world applications.

---

Model Description

Calculator-SMoL-LM2 v1 is a small language model fine-tuned on a synthetic dataset of arithmetic operations and comparisons. The model is designed to perform basic mathematical calculations and comparisons, such as addition, subtraction, multiplication, division, square roots, and equality checks. This is an experimental model trained on 70,000 rows of data generated using a custom script.

Intended Use

This model is intended for educational and experimental purposes. It can be used to:

• Perform basic arithmetic operations (+, -, *, /).
• Calculate square roots.
• Compare numbers (>, <, =).

The model is not intended for real-world applications requiring high precision or reliability.

Limitations

• Precision: The model is trained on synthetic data with limited precision (up to 5 decimal places). It may not handle very large numbers or highly precise calculations well.
• Generalization: The model may struggle with inputs that deviate significantly from the training data distribution.
• Error Handling: The model does not handle invalid inputs (e.g., division by zero) gracefully.
• Scope: The model is limited to the operations it was trained on and may not generalize to more complex mathematical tasks.

Training Data

The model was trained on a synthetic dataset of 70,000 rows, generated using the following operations:

• Addition (+)
• Subtraction (-)
• Multiplication (*)
• Division (/)
• Square Root (srqt)
• Comparisons (=, >, <)

The dataset includes numbers with 3 to 10 digits in the integer part and up to 5 decimal places.