TSAIGPT is a transformer-based language model with only 0.16 billion parameters, trained on RedPajama 1T Sample.