#ai #stem #STEMedu Interesting, with the current training set (Moby Dick) the model hits a Brickwall at validation loss 1.5. It learns to form English words and Sentence - like phrases, and that's it. Turning up Model size makes the response better but the 1.5 remain a hard limit till now.
#ai #stem #STEMedu Interesting, with the current training set (Moby Dick) the model hits a Brickwall at validation loss ...